ComfyUI: CosXL, CosXL Edit InstructPix2Pix (Workflow Tutorial)

Поділитися
Вставка
  • Опубліковано 21 гру 2024

КОМЕНТАРІ • 51

  • @sudabadri7051
    @sudabadri7051 7 місяців тому +3

    I was about to sleep but now i gotta keep watching for half hour more haha. Keep up the great work.

  • @unsound-methods
    @unsound-methods 7 місяців тому +3

    One of rare gem channels in SD world. Awesome content. Would be so nice to see your take on fixing hands in comfyUi!

    • @controlaltai
      @controlaltai  7 місяців тому

      Thank you!!

    • @Nrek_AI
      @Nrek_AI 6 місяців тому

      Agreed 100% and I too would love to see what can be done about fixing hands

  • @gimperita3035
    @gimperita3035 5 місяців тому

    Really, thank you for this. Started playing with CosXL and I looked for an explanatory video, but this workflow and the insights on which is doing what blown me away.

  • @TutoView
    @TutoView 7 місяців тому +1

    Best channel! in ComfyUI! I liked the content, so I signed up for membership.😁👍

  • @jamesharrison8156
    @jamesharrison8156 6 місяців тому

    A wonderful tutorial! I learned a lot more about ComfyUI. Thank you so much for taking the time to create this. Also, showing how you created the workflow and following along myself works much better as a learning tool.

  • @dannywei
    @dannywei 5 місяців тому

    It's an amazing course. This has made a lot of practical improvements to my original workflow. Thanks a lot.

  • @kaibuddensiek8580
    @kaibuddensiek8580 7 місяців тому

    I am a Beginner in ComfyUI and it is hard for me to understand all. But i love it. Thx for the great work. Learn more and more when i watch your videos.

  • @sudabadri7051
    @sudabadri7051 7 місяців тому +2

    Absolutely incredible

  • @ayazrashid7357
    @ayazrashid7357 7 місяців тому

    wow what a great video watched through the whole thing and set it up myself. I also realized i was upscfaling my images wrong (facepalm). Im going to binge your videos great work buddy!!!

    • @controlaltai
      @controlaltai  7 місяців тому

      Thank you. Btw there is no wrong way to upscale. Every way is the correct way only different....😉

  • @AI_Creatives_Toolbox
    @AI_Creatives_Toolbox 7 місяців тому

    Amazing Tutorial! Why is it better to use the sampler custom advanced instead of a default k-sampler with all the widgets turned to input nodes? For organization purposes?

    • @controlaltai
      @controlaltai  7 місяців тому

      Thank you!! More advanced and fine tune controlling for CosXL. For best results use sampler custom advance.

  • @moviecartoonworld4459
    @moviecartoonworld4459 7 місяців тому

    Thank you for the fantastic lecture~!~!!😍🤩😍

  • @cptblood1981
    @cptblood1981 4 місяці тому

    Anyone know where to get the node samplercustomadvanced? I just cant find it...

    • @controlaltai
      @controlaltai  4 місяці тому

      It's build in within comfyui. Update comfy to the latest version.

  • @fc5130
    @fc5130 7 місяців тому

    wow! AMAZING. One question, can u merge cos edit and realvis? and edit images with the quality of realvis?

    • @fc5130
      @fc5130 7 місяців тому

      and one more question, an u use ipadapter with cosxl edit?

    • @controlaltai
      @controlaltai  7 місяців тому +1

      Cosedit edit causes some errora but works. I will try it. Ip adapter I have not try. What are u trying to do with ipadapter let me know I will try that.

    • @fc5130
      @fc5130 7 місяців тому

      @@controlaltai it would be amazing for example to change the material from a sofa and give it the reference of the material with ipadapter. i was trying that.

    • @controlaltai
      @controlaltai  7 місяців тому +2

      You don't need IP adapter you can describe the material. Thats The point of cosxl edit. Just say plastic sofa, leather sofa etc and it should work.

    • @fc5130
      @fc5130 7 місяців тому

      @@controlaltai yeah but what i need is the exact texture, imagine a pattern and i need to edit the sofa with it. Thank u to answer

  • @SerginMattos
    @SerginMattos 7 місяців тому

    Thanks for this tutorial. I'm having a problem. The cosxl_edit.safetensor model in Pix2Pix is returning a grainy green image that barelly resembles the original image. Any hint for me, please?

    • @controlaltai
      @controlaltai  7 місяців тому +1

      Check the dual cfg connections. They are tricky. Recheck cfg. Ensure image scale to total pixels is correctly connected. Close command prompt and restart comfy from cmd. Try again And let me know.

    • @SerginMattos
      @SerginMattos 7 місяців тому

      @@controlaltai Thanks for the answer! I checked the connections you mentioned. ComfyUI is updated. I downloaded safetensor again. And lastly, I looked for a similar workflow on civitai. I keep getting the same result. Now I just installed a clean Comfyui. Still the same problem. Really weird. Anyways, thank you for this video. You explain very well!

    • @controlaltai
      @controlaltai  7 місяців тому +1

      Send me an email with your workflow, image and the prompt. I will have a look. There must be something wrong, I don’t think it’s comfy. mail @ controlaltai. com (without spaces)

    • @SerginMattos
      @SerginMattos 7 місяців тому

      @@controlaltai I sent the email. But it's working... For some reason the 2 first times I downloaded the safetensor, it was corrupted. -.-"
      3rd for the charm. Thank you so much! It's working and It's beautiful!!!!

  • @AmitShq
    @AmitShq 5 місяців тому

    When im trying to merge checkpoints realvis4 with the cosXL im getting vram allocation memory error i have 15GB vram . anything i can do to fix it please? ty. ps perhaps its because coseXL+ sdxlbase+realvis= more than 15gb ?

    • @controlaltai
      @controlaltai  5 місяців тому

      Actually no, and it's cosxl minus sdxl base then plus realvisxl. Unless your are merging all three by mistake.

    • @AmitShq
      @AmitShq 5 місяців тому

      @@controlaltai I was doing as you said in the video not sure why im getting the out of memory error :( Error occurred when executing CLIPTextEncodeSDXL:
      Allocation on device

    • @controlaltai
      @controlaltai  5 місяців тому +1

      Okay, just confirmed it. It does take above 50% VRAM and System Ram on my system. You need around 24GB VRAM and about 64GB system RAM for this. I am running this on a 4090 (24GB VRAM). 16Gb VRam should work, as it did not go beyond 50-55%, however not the full 16GB must be allocated to PyTorch depending on your environment.

    • @AmitShq
      @AmitShq 5 місяців тому

      @@controlaltai ty perhaps i should run it via --normal-vram instead of high

  • @nkofr
    @nkofr 5 місяців тому

    is it possible to use COSXL with Controlnet? it seems not to be working
    Cheers

    • @controlaltai
      @controlaltai  5 місяців тому

      I just check and no. Doesn't work. Even with a merged checkpoint.

    • @nkofr
      @nkofr 5 місяців тому

      @@controlaltai interesting, thank you for trying

  • @eucharistenjoyer
    @eucharistenjoyer 7 місяців тому

    What's the minimum VRAM requirement?

    • @controlaltai
      @controlaltai  7 місяців тому +1

      I don't think it's anything specific for just the model, it's a simple sdxl based model just fine tuned. Whatever is required for SDXL, same here. Except for the upscale. If you don't refined or upscale 6 to 8 gb would work.

  • @manolomaru
    @manolomaru 7 місяців тому

    Treeeemendous video like always!
    ...although too advanced for me 😅😭😅
    ✨👌😎😮😵😮😎👍✨

  • @lightingthevalley-ltv5346
    @lightingthevalley-ltv5346 Місяць тому

    Dude, just explain about cosxl...

  • @cmlshn
    @cmlshn 7 місяців тому

    Hi, great work! I get this while merging cosxl_edit model with another sdxl model ->>> WARNING SHAPE MISMATCH diffusion_model.input_blocks.0.0.weight WEIGHT NOT MERGED torch.Size([320, 4, 3, 3]) != torch.Size([320, 8, 3, 3])
    Any thoughts?

    • @controlaltai
      @controlaltai  7 місяців тому

      Are you merging the sdxl model?

    • @cmlshn
      @cmlshn 7 місяців тому

      Yes finetuned sdxl model. Do u know how many ram u need for saving a merged checkpoint?

    • @controlaltai
      @controlaltai  7 місяців тому

      The cos xl edit model always will give an error. It's not designed to be merged. However it does work. But I would not recommend it. Vram is not an issue here. Merge only the cos xl model not the edit one.