ComfyUI : NEW Official ControlNet Models are released! Here is my tutorial on how to use them.

Поділитися
Вставка
  • Опубліковано 27 сер 2024
  • It's official! Stability.ai has now released the first of our official stable diffusion SDXL Control Net models. In this ComfyUI tutorial we will quickly cover how to install them as well as how to use the preprocessors to get things all set for the Control Net node. We will also cover installing the manager, since it makes things a lot easier going forward. I did cover that in Episode 2 in-depth, so if you need a refresher, check out that video as well. Please note, these are now the official models, not the ones released by others.
    Want to help support the channel and get this graph? WOOT!
    / @sedetweiler
    You can grab the official Control Net LoRA (OFFICIAL) files from here: huggingface.co... (Remember, these are Control Net files and are LoRA in name only!)
    Grab the manager custom node from here: github.com/ltd...
    SDXL model from here (OFFICIAL): (bonus LoRA also here)
    huggingface.co...
    Control Net Preprocessors are available here:
    github.com/Fan...
    Remember, you will have to restart the ComfyUI interface for these to start loading, and the models will also download as they are requested from the Controlnet processor.
    Twitter: / sedetweiler
    Threads: www.threads.ne...

КОМЕНТАРІ • 244

  • @AmateurSpecialist
    @AmateurSpecialist Рік тому +15

    I think you are the only Stable Diffusion video creator who actually pronounces Euler correctly. My poor ears thank you.

    • @sedetweiler
      @sedetweiler  Рік тому +6

      Dude, I am with ya! .🤣

    • @CoconutPete
      @CoconutPete 5 місяців тому

      do people still prefer Euler over DPM++ 2M Karras?

  • @GlassHexagonalColumbus
    @GlassHexagonalColumbus Рік тому +7

    Thanks for your lessons. Unfortunately, your videos are not popular among ALL Internet users, but know that for those who share your interests, you do a lot and inspire new things

    • @sedetweiler
      @sedetweiler  Рік тому

      I appreciate that!

    • @redgear5647
      @redgear5647 Рік тому

      @@sedetweilerhey bro do you know how can i use the control net in comfyUI to select an image, then using another to merge only the style of the image, without changing pose, details, ecc? Basically a style transfer, thanks

  • @s.anonyme6855
    @s.anonyme6855 Рік тому +14

    Thank you to spend time creating those so didactic videos. Building up the worflow from nothing, explaining the settings, the whys.. I have been using MJ for months and shifted to A1111 to have more control but ComfyUI is exactly the place I craved all along. And with your videos the learning process is so enjoyable. Thank you. Happy to have subscribed.

  • @coda514
    @coda514 Рік тому +4

    You are a wonderful teacher, I not only learn how to use new features but also how they work. Thank you.

  • @SachavaV
    @SachavaV Рік тому +2

    it's a pleasure to absorb knowledge from such a mentor.

  • @iresolvers
    @iresolvers 5 місяців тому

    finally someone who can explain comfyui the way I can understand, thank you so much!!

  • @grayaj23
    @grayaj23 22 дні тому

    Scott, you're a genius. I've had a project in mind and didn't know how to make it work -- I want a cameo of alabaster-on-onyx of a crescent moon with a sleepy beautiful female face. It's a specific look that I've been searching for and having no idea where to start.
    I had one that was the right shape, so after watching your video I pulled a depth map and ran that through and got - on the first try - closer than I've been able to get before.
    Of course, the second one was nothing like what I want, but now Ive seen the promised land.

  • @COMM1317
    @COMM1317 7 місяців тому +3

    Hey, Scott. Would you consider making us a short video about your Top 5 or Top 10 Stable Diffusion MYTHS (number of steps, schedulers, negative prompts, etc.)? 🙏

  • @Vestu
    @Vestu 11 місяців тому +1

    You are helping so much with these videos. Joined as channel sponsor (it's way way worth it folks)

  • @uk3dcom
    @uk3dcom Рік тому +11

    Might be worth mentioning the clone will take a while and the comand window won't show progress continuously, you just have to be patient and wait for the Filtering content line to hit 100%. First time round I quit out of the cmd window to early. 🙃

    • @sedetweiler
      @sedetweiler  Рік тому

      Thank you, that is a good observation!

    • @seanpretorius718
      @seanpretorius718 11 місяців тому +2

      I really struggled with this part. I was running Comfy via Swarm. When Control-Lora loaded, and Terminal/PowerShell said "done," I thought I was finished. I shut it down and restarted Comfy, hoping it would work. However, I didn't have any models when I restarted Comfy, and I started overthinking things.
      Despite having read this thread earlier, I continued to overcomplicate things. After several hours of installs and uninstalls with no success, I took a lunch break, and then this comment began to blossom in the overgrown garden that is my brain. So, thank you for this. Also Big thanks to Scott Detweiler for these fantastic tutorials!

    • @mhill88ify
      @mhill88ify 9 місяців тому +1

      Good shot m8, I totally did this also.

    • @mccloudmedia2686
      @mccloudmedia2686 8 місяців тому +1

      You should highlight this comment, I must have closed too early also and the controlnet models where empty.

  • @lelio87
    @lelio87 7 місяців тому +1

    Thanks for the video! I'm just getting started with ComfyUI and your video has helped me a lot! Thanks again!

  • @eliasdelreal3863
    @eliasdelreal3863 Рік тому +1

    Happy trees! 🤣 I love it. I think I know who your inspiration for good video tutorials is.

    • @sedetweiler
      @sedetweiler  Рік тому

      Yeah, that came out of nowhere! Lol!

  • @user-kl1bk4wx4v
    @user-kl1bk4wx4v Рік тому

    Thank you so much for being out there :)

  • @AceOnlineMath
    @AceOnlineMath 2 місяці тому

    a couple of videos back i commented that you are like Bob Ross. Thank you for saying "happy tree"

  • @UNOCASTILLO
    @UNOCASTILLO 9 місяців тому

    this is what i call a reeeeaaally good tut. thank you

    • @sedetweiler
      @sedetweiler  9 місяців тому

      Glad you think so!

    • @UNOCASTILLO
      @UNOCASTILLO 9 місяців тому

      @@sedetweiler I would like to suggest you a topic. could you make a tutorial on how to colorize black and white pictures using the new RECOLOR? could you teach us how to use various controlNet modules? Thanks

  • @androgynastronaut
    @androgynastronaut Рік тому +1

    Very good. I need to learn to keep faces similar in various character images for plot consistency.

  • @simonmcdonald446
    @simonmcdonald446 Рік тому +5

    I have the control - loras but nothing apprears in the "load control net model"box. whats gone wrong there?

  • @aunalise7091
    @aunalise7091 Рік тому +3

    I like to blend depth and canny or lineart 🙂
    But once it is all set up, I can easily choose whether to use all canny or all depth, or a certain ratio.

    • @jasondulin7376
      @jasondulin7376 Рік тому

      I want to try the same thing. Probably too large a question, but if I wanted to add another controlnet can I just duplicate a few modules and plug them into the same place?

    • @sedetweiler
      @sedetweiler  Рік тому +4

      Use them in a chain. The order isn't important.

  • @OneMinuteMeds
    @OneMinuteMeds Рік тому

    Now we cookin with FIRE!

  • @TomasWittelsbach
    @TomasWittelsbach Рік тому +2

    a touch-off subject, in the sdlx UIs, there is a tile button; where can I select the ability to make seamless tileable textures in comfy? I'm a sculptor seeing if I can maybe train a checkpoint or lora or something to create tiling patterns like snake scales and hopefully train in on alphas or depth maps so we can create interesting new stuff as opposed to my students always downloading the same old crap. I can imagine snake scales with mouths or eyes on them. but no one is training texture models. thank you t p.s. Thank you greatly you are making it possible for someone who can't c-prompt his way out of a paper bag to explore what these new technologies can take our art. I went from my best tools being an 800-year-old set of chisels to a computer when I saw Zbrush 18 years ago. Your videos are wonderful thank you again

    • @sedetweiler
      @sedetweiler  Рік тому +2

      Hmm, I know we have some methods for doing that in-house. Let me see if there is a method I can get out here that you can use.

    • @TomasWittelsbach
      @TomasWittelsbach Рік тому

      I joined last night, I don't want to take advantage of your generosity. I teach Zbrush if I can figure out how to train texture and seamless tileable texture models or Loras or something lol, it will be an amazing tool. I'm so excited I found your page. such powerful tools. thank you greatly @@sedetweiler

  • @alecubudulecu
    @alecubudulecu Рік тому

    small suggestion with these tutorials. and particularly these intro tutorials - slow down. like... a lot. I totally get you know what you doing... but most of us have to switch screens and hunt and peck for where things are... we don't even know menu buttons. we have to pause the video every few seconds.... rewind constantly. especially at the end... you move so quick.
    and I say that - because your tutorials are excellent. you communicate well and show very good details of what you are doing....just so fast! haha

    • @sedetweiler
      @sedetweiler  11 місяців тому

      Yeah, sorry about that. I have found that if I am to slow, people just leave the video, so I tend to just get it down to the actual points you need to know. I often suggest watching it first, and then doing it again with pauses as needed. I do the same thing with tutorials on products like zBrush, as those can be brutal to keep up with, so I totally understand what you mean. Since you are a subscriber, you will also see a recent live stream and you might really enjoy the speed of those. Thank you for your support!

  • @TransformXRED
    @TransformXRED Рік тому +2

    I would love to have the ability to split the screen, and then have one part that is fixed (on the image generation node), and the second part where we can move freely

    • @sedetweiler
      @sedetweiler  Рік тому +3

      Oh, that would be pretty sexy!

    • @TransformXRED
      @TransformXRED Рік тому

      ​@@sedetweilerBtw, I remember you talking about chaiNNer a while back.
      The recent versions have the ability to use automatic1111, and nodes specific to stable diffusion

    • @sedetweiler
      @sedetweiler  Рік тому

      Interesting! If you check the ComfyUI folders, you will also find chaiNNer is part of it's implementation as well.

  • @zaffarhayyat3608
    @zaffarhayyat3608 6 місяців тому

    Your tutorial videos on Comfy are fantastic! I'm truly enjoying them. How can I support your channel? Also, it would be great if you could add clear subtitles to minimize any language and accent barriers. Thank you!

    • @sedetweiler
      @sedetweiler  6 місяців тому

      Thank you! There should be a join button under the video or on my main page to help support the channel. Lots of great goodies as well as a sign of appreciation. Cheers!

  • @VenkmanZero
    @VenkmanZero 4 місяці тому

    7:54 Late comment, but you actually can override the default css font-size: values in ComfyUI/web/style.css by adding your preferred settings in the ComfyUI/web/user.css file. I did this once for the multiline textboxes to make them more legible on zoom out but it was awhile ago and I've reinstalled ComfyUI once or twice since then so I don't have that modified user.css anymore. Was only a matter of copying and pasting the relevant style section from styles.css into user.css and then modifying the part I needed to change.

  • @AlexKellyArtUK
    @AlexKellyArtUK Рік тому

    Thanks - very well explained!

  • @MacS7n
    @MacS7n Рік тому

    Thanks a lot. Please talk about the pipe in your next video.

  • @timreutemann9223
    @timreutemann9223 Рік тому +2

    Thanks for that. There is still one big big missing piece for narrative work with SD - namely LORAs for the refiner - we can get consistent characters with base LORAs via Kohya-ss, but refining screws them up, so quality of custom characters is barely better than SD1.5 at this point...

    • @wsippel
      @wsippel Рік тому +4

      I use Impact to fix that. Generate the image as usual, with the refiner, then run it through the Impact Face Detailer and regenerate the face with just the base model and character LoRA, without the refiner. The nice thing about Impact is that it detects the face automatically, so once you have your workflow set up, you don't have to worry about it anymore. Just let it do its thing.

    • @timreutemann9223
      @timreutemann9223 Рік тому

      ​@@wsippel Thank you for the idea! Will give it a try tonight.

  • @SergeGolikov
    @SergeGolikov Рік тому +1

    1:18 Struggling to understand the very first part, command line prompt? can you slow down? thanks 🍷

  • @dasmatthews
    @dasmatthews 4 місяці тому +1

    Hey Scott and community! First up, thank you so much for the very well and not too quickly explained tutorial!!
    I'm having a little problem though and I don't know exactly what to change/do to correct it...
    At 8:19 you're showing the long list of ControlNet Models and you say that we'll see the list if we did it correctly and I followed your video step by step but I still don't get that list... any idea or hint on what might've gone wrong?
    Thanks so much in advance!

  • @norcoreanodelsur
    @norcoreanodelsur 11 місяців тому +1

    Hi, this might be a dumb question but why it doesn't work with other checkpoints?, I have a setup to create pixel art, and I get an error in the KSampler "moduleList object doesn't have attribute 1", I tried with different models but the only one that works is the base model. Thanks for the tutorials I am binge watching your videos.

  • @jasondulin7376
    @jasondulin7376 Рік тому +2

    Thank you so much for these wonderful tutorials. I'm very new to this and have a newb question: Can this same workflow be used with other models? Any other model I try gives me a litany of errors, the first being - "Error occurred when executing KSampler: 'ModuleList' object has no attribute '1' Should I be changing a setting in the KSampler? Thanks!

    • @sedetweiler
      @sedetweiler  Рік тому +2

      Yes, the workflow will be the same for the models. If one is giving you an issue figure out if it is the preprocessor, controlnet model, or the inference model.

    • @jasondulin7376
      @jasondulin7376 Рік тому +1

      @@sedetweiler thanks so much!

    • @TheKMB787
      @TheKMB787 11 місяців тому

      @@jasondulin7376 Did you ever figure out what the issue was for you? I get the same error, I tried changing everything @sedetweiler mentioned and nothing helped or even changed the error.

    • @ruihan6583
      @ruihan6583 5 місяців тому

      hello! same error with you, How do you fixed it?

  • @idoshor4470
    @idoshor4470 День тому

    I tried to download the controlnet preprocessors, but apparently the list is missing. I have only two models there (maybe from another download I did?) : diffusion_pytorch_model and ..model.fp16.
    any ideas how do I get the full list? thanks

  • @divye.ruhela
    @divye.ruhela 2 місяці тому

    Q. Why don't we need the SDXL-specific CLIP text encoders (like used in the earlier videos) here?

  • @jac001
    @jac001 7 місяців тому

    Nice job, appriciate it. 😀

  • @francotobon
    @francotobon 5 місяців тому

    I'm encountering an issue while trying to use the 'INTER_LINEAR' attribute from the 'cv2' module in my Python code. When I attempt to execute my script, I receive the following error message:
    Error: module 'cv2' has no attribute 'INTER_LINEAR'
    I'm using OpenCV (cv2) for performing image processing operations, and I need to use the 'INTER_LINEAR' method for image interpolation in my project. I have checked the OpenCV documentation, and I know that this attribute should be available, but I don't understand why I'm receiving this error.

  • @38dedo
    @38dedo 9 місяців тому +1

    thank you for these videos but i need a little help! im a 3d artist that is transition to learning some stable diffusion, im an absolute boor when it comes to python, i use gpt to write maya scripts for me because looking at code makes my head spin.
    anyway, when i try to use the 2 pose recognition nodes installed in this video, one return an error that im missing something called "media pipe" and the other node says im missing "matplotlib". how can i install these? the manages doesnt show anything missing, and before this video i didnt even understand how to install stuff from huggingface or github because im used to a big green "download" button. cheers for the help :)

    • @sedetweiler
      @sedetweiler  9 місяців тому +1

      You might want to ask on the git for the nodes throwing the errors. Issues are so unique it would be hard to troubleshoot.

  • @CamiloMonsalve
    @CamiloMonsalve Рік тому +1

    Awesome démonstration. Do you have any playlist to start from baby steps?

    • @sedetweiler
      @sedetweiler  Рік тому

      Yup! ua-cam.com/play/PLIF38owJLhR1EGDY4kOnsEnMyolZgza1x.html

  • @miguelfigueiredo9814
    @miguelfigueiredo9814 5 місяців тому

    im using the comfyUi portable version and when i clone the comfyui manager to the custom nodes it wont appear the manager button on the ui

  • @Potts2k8
    @Potts2k8 3 місяці тому

    I'm hoping you can help, I'm trying to use the ControlNet Repository and OpenPose - bit I keep running into errors when at the Control Net Loader step, something about py lines 151, 81, etc.
    I've tried updating and reinstalling control net repository but I'm still running into the same issue.

  • @ahmedaborady7883
    @ahmedaborady7883 6 місяців тому +1

    in Load controlnet model node i get this Error that i can't understand why
    Error while deserializing header: HeaderTooLarge
    I did everything i reinstalled comfyui :) I'm using same model and same controlnet-lora you're using here
    any idea what this could mean?

  • @Renzsu
    @Renzsu 9 місяців тому +1

    Scott, do you know if there are plans to bring the lineart preprocessors to SDXL? I'm a product designer and for me it's one of the most exciting things about SD. Load in a clean sketch and see where SD takes it. I need more detail though for things like bicycles.. SD1.5 does cars really well, but fine details get lost and that's what makes up most of a bicycle :)
    I'm trying lineart with SD1.5, then taking the output of that into depth and XL, but it's a bit of a roundabout way of doing things with less accurate results than I'd like.

  • @joeyhandles
    @joeyhandles 11 місяців тому

    easy to follow very helpful euler gang euler gang

  • @desertshadow72
    @desertshadow72 Місяць тому

    Error occurred when executing KSampler:
    'ModuleList' object has no attribute '1'

  • @bordignonjunior
    @bordignonjunior 7 місяців тому +1

    hello Scott, how can y ou make the reroute nodes get the name of whaterver they are rerouting?

    • @sedetweiler
      @sedetweiler  7 місяців тому +1

      right click on the tiny dot and choose rename. Mine are that way because of the pythongossss node set I believe.

  • @DarenEilert
    @DarenEilert Рік тому

    How about a quick basic overview on recommended environment, directory structure, to manage in an efficient way - storage, update mgmt, image mgmt, workflow...

    • @sedetweiler
      @sedetweiler  Рік тому

      Sure! I can do that. I use a NAS so not sure how many others will be interested in using what I have.

  • @Xavi-Tenis
    @Xavi-Tenis 3 місяці тому

    perfect explanation

  • @kduxyz
    @kduxyz 3 місяці тому

    hi, you can help me? Error occurred when executing ControlNetLoader:

  • @christophermoonlightproduction
    @christophermoonlightproduction 8 місяців тому

    You lost me at the 15:55 mark. How do you place a model in the folder with a code? I'm equally confused as to what you were doing in Notepad. Is there a walkthrough where I can see it being done? Thanks.

  • @STaSHZILLA420
    @STaSHZILLA420 5 місяців тому

    Hi there. I used the manager to download comfyui-extensions to get the custom color nodes and titled reroutes etc, and it isnt workig. The extra options didnt even show up. Is there something i did wrong? Is there a fix for this or a step to solve this? thanks in advance.

  • @brandonflores4
    @brandonflores4 8 місяців тому

    i get the following error when it reaches the ksampler node. The ksampler is also outlined in purple at this step/error. Any idea how to fix?
    Error occurred when executing KSampler:
    'ModuleList' object has no attribute '1'
    EDIT: was using the soapmix load checkpoint from earlier videos, unsure why that one did not work. reverted to the SDXL load checkpoint, problem solved.

  • @MVLonden
    @MVLonden 6 місяців тому

    Im stuck on getting my loras into the control net. I have git LFS installed. But when I past into my control net folder. Nothing happens. Am I doing something wrong?

    • @miracletraveler2835
      @miracletraveler2835 4 місяці тому

      I’m new to this so I’m not sure what you mean but I managed to get a file called “control-Lora” to appear by opening in terminal and using the git clone

  • @lioncrud9096
    @lioncrud9096 11 місяців тому

    How would you set up multiple control nets? I tried to chain 2 Apply Control Net Nodes together but I think it’s not working. For example, let’s say first Apply Control Net is for a depth map, set to run from 0.0 steps to 0.2. Then, I chain that into another Apply Control Net that has a Canny, and set for start at 0.0 steps and end at 0.8…….wouldn’t the most recent Apply Control Net steps settings override the first Control Net? Since I passed the first into the second?

  • @97BuckeyeNut
    @97BuckeyeNut Рік тому +1

    I think we need a video showing how to add multiple LoRas to a ComfyUI workflow.

    • @lukeovermind
      @lukeovermind Рік тому

      Comfy Roll Nodes has a Lora Stacker

    • @sedetweiler
      @sedetweiler  Рік тому

      It's super easy. Just chain them together

  • @mkthedoctor
    @mkthedoctor 6 місяців тому

    I get an error at 6:13 that it can't find a file in custom_nodes\\comfyui_controlnet_aux\\ckpts\\lllyasviel/Annotators\\cache\\models--lllyasviel--Annotators\\snapshots\\982e7edaec38759d914a963c48c4726685de7d96'.

  • @Juliangonzi
    @Juliangonzi 3 місяці тому

    Conflicted node warning when installing that Controlnet thing, why?

  • @opensourceradionics
    @opensourceradionics 3 місяці тому

    Why is it not possible to use ControlNet with other models than SD?

  • @yoniwoker
    @yoniwoker 10 місяців тому

    friend I have
    extra_model_paths.yaml.example but I don't have
    extra_model_paths.yaml. What do I do, where can I get off?

    • @sedetweiler
      @sedetweiler  10 місяців тому

      You rename the .example file and edit it so it is pointing to the correct place. The example file is just an example.

  • @vilainm99
    @vilainm99 11 місяців тому

    Hi, in my controlnet/control-lora directory I only have the rank128 and rank256 of canny, recolor, depth and sketch. any idea what happened? (Windows system here with ComfyUI from Pinokio)

  • @0A01amir
    @0A01amir Рік тому +1

    Thanks for these awesome tuts. Why don't you use Link Render Mode: Straight ? it fixes the noodle problem. it's in the option (gear button on top right of Queue Prompts).
    I installed a bunch of custom nods now SDXL1 wont work anymore, before it was slow now i'm getting not enough memory error. well i guess XL is no for me.

    • @sedetweiler
      @sedetweiler  Рік тому +1

      Yea, I used straight for a bit, but prefer the noodles :-)

  • @basti11097
    @basti11097 11 місяців тому +1

    I´m always getting an error on the ControlNetLoader saying
    Error occurred when executing ControlNetLoader:
    'input_blocks.0.0.weight'
    any idea what that could be. Setup should be the same. Thanks!
    Awesome Tutorials by the way!

  • @Skettalee
    @Skettalee 9 місяців тому

    I get so lost trying to follow stuff like this. Mine has errors all over the place, both prompts and the ksaple and vae all are red and i seem to have all the same things you got. Where do i get your workflow files?

    • @sedetweiler
      @sedetweiler  9 місяців тому +1

      Be sure to change the model to things you have on your machine. The graphs for all of the videos are available on the Community tab here in UA-cam for channel sponsors. Have you done the earlier videos? This is not a good one to start with, as this is assuming you have done the previous episodes.

    • @Skettalee
      @Skettalee 9 місяців тому

      i have at this point, thanks man!
      @@sedetweiler

  • @kallamamran
    @kallamamran 7 місяців тому

    Why does the section in extra_model_paths.yaml say a111 and not a1111? 🤔

  • @galdocstutorials
    @galdocstutorials Рік тому +1

    You mentioned Blender -- here's a fun question: do you happen to know if there's ever going to be plans to port ComfyUI nodes in Blender? I recognize that these two programs both are VRAM hogs and this might limit the utility of it for a lot of people -- myself included; I def need a new card, hah -- but there seems to be a TON of potential for workflows, particularly with both the depth and normal maps, but also more creatively with the other bits, like rigged poses, training it to make textures for UVs, etc. :) Thanks!

    • @sedetweiler
      @sedetweiler  Рік тому +6

      We do have a stability API tie in for Blender, so we can get part of the way there. We do have some new goodies coming that I think you are going to enjoy!

  • @TheRMartz12
    @TheRMartz12 2 місяці тому

    Hey can you help me out? I cloned the repository with git clone like mentioned at 3:40 and everything was cloned except for the models 😓 can you tell me why this is? I always have to download models manually because of this

    • @TheRMartz12
      @TheRMartz12 2 місяці тому

      I have been trying to use any depth preprocessor and for the life of me I cant! I don't know why. i've been searching all the tutorials. I have all the auxilary preprocessors and the models in the right folders and it keeps telling me I dont :(

  • @WARweezy
    @WARweezy 5 місяців тому

    thank you!!!

  • @eliasherreradg5966
    @eliasherreradg5966 8 місяців тому

    How do I apply this same tutorial but for openpose?

  • @CalebHoernschemeyer
    @CalebHoernschemeyer 5 місяців тому

    Hey Scott, great video, i got most of the way there but keep encountering a "header too large" error. Running Apple Macbook Pro M2 24gb Ram. Is this hardware related? Im searching for a lighterweight model with little luck. Control net works, and I can run stable diffusion with control net on the webui, but not ComfyUI. Followed your tut to a t twice. Any direction or resources you can reccomend would be great, thanks for the informative video!

  • @Doomer35
    @Doomer35 9 місяців тому

    Forgive me I may be a bit slow but when I type in git clone and paste link in the cmd window it says "git not recognized as an internal or external command" etc. I also don't have admin privilege in the window, how do I fix this?

    • @sedetweiler
      @sedetweiler  9 місяців тому +1

      You will need to install git. Most of us already had it, so I made an assumption here that was apparently incorrect.

    • @Doomer35
      @Doomer35 9 місяців тому

      thanks@@sedetweiler

  • @Nexus-16
    @Nexus-16 11 місяців тому

    Hi i cannot get past the install custom nodes bit this update sign comes up and then just doesnt disappear what can i do???

  • @SaadKhanAhmed
    @SaadKhanAhmed 8 місяців тому

    I'm using SD 1.5 and using controlnet to give my character a pose as you described (without Reactor). Can I somehow control and define my own background that the subject (my character) blends in?

  • @gregoryh2os
    @gregoryh2os 5 місяців тому

    Where can I find help with a Depthmap error?

  • @rishatpepsi4333
    @rishatpepsi4333 11 місяців тому

    Hey thanks for the tutorial! I have a question: i have no problem using this with SDXL, but the moment i try to pair it with sd 1.5 checkpoints comfyUI sees an error
    It says: Error occurred when executing KSampler:
    'ModuleList' object has no attribute '1'
    What should I do?

    • @sedetweiler
      @sedetweiler  11 місяців тому

      you cannot mix the 2 models or loras. 😞

    • @rishatpepsi4333
      @rishatpepsi4333 11 місяців тому

      @@sedetweiler Can I use controlnet with sd 1.5 checkpoints in comfyui and if so, how?

  • @saymen881
    @saymen881 9 місяців тому

    What if i dont see the giant list at 8:19?

  • @ronnykhalil
    @ronnykhalil Рік тому

    wonderful news!

  • @SaadKhanAhmed
    @SaadKhanAhmed 10 місяців тому +1

    Hi @Scott, your videos are amazing!
    I am very new in this space and trying to do a PoC where I need to take person's photo with clear face and use the face and give a slightly different expression (maybe use controlnet openpose or canny) and more importantly create a comic style.
    I know we can do really good comic style using SDXL 1.0 but I can't use my custom face in such situation. Is my only way to achieve it is using training model or lora? Can you please guide me?

    • @sedetweiler
      @sedetweiler  10 місяців тому

      You can try roop or training a custom LoRA. You have a few options there, but roop or reactor would be your best bet.

    • @SaadKhanAhmed
      @SaadKhanAhmed 10 місяців тому +1

      ​@@sedetweiler , I am currently trying to use controlnet canny with SDXL 1.0 and positive comment "color comic book..." and it seems to work ok-ish. So roop/reactor would make sense to put before this flow to swap person's face into the picture and pose I want it to be and then do the same process?
      This eventually has to be hooked up on a website for people to try so training a Lora would be time taking process and probably not the best too?!

    • @sedetweiler
      @sedetweiler  10 місяців тому

      I am sure those would work. However, be careful what you allow people to use as training material!

  • @user-yo8pw8wd3z
    @user-yo8pw8wd3z 11 місяців тому

    Can I ask, since we are using SDXL, why is the standard Clip Text Encode node used instead of the CLIPTextEncodeSDXL node?

    • @sedetweiler
      @sedetweiler  11 місяців тому

      I just didn't need both G and L for this demo.

  • @carstenli
    @carstenli Рік тому

    Thanks for the great tutorial, Scott. How to get the VAE label on the reroute node btw?

    • @sedetweiler
      @sedetweiler  Рік тому +1

      It is automatic with some of the latest updates.

    • @CPDCT
      @CPDCT 11 місяців тому +1

      you can right clock on the reroute and set to 'show type by default'

  • @yoniwoker
    @yoniwoker 10 місяців тому

    Friend, I want to add realistic lights and shadows to a photo, without changing the characters, is it possible?

  • @royjones5790
    @royjones5790 11 місяців тому

    is there any stereoscopic/stereogram creating depth map in ComfyUI yet?

  • @joesheble5458
    @joesheble5458 Рік тому

    I have followed this to the letter but when I connect my ControlNet node to my KSampler and run it, I get an error that I have no clue about, as I'm just a user not a developer... Error occurred when executing KSampler: 'ModuleList' object has no attribute '1' Any ideas at all as to who I can ask, or what I can do?

    • @sedetweiler
      @sedetweiler  Рік тому

      what kind of control net are you using?

    • @joesheble5458
      @joesheble5458 Рік тому

      @sedetweiler The exact same ones shown in the video. For the Midas depth map, but also tried the Zoe as well.

    • @Raulikien
      @Raulikien 11 місяців тому

      You are using a SD 1.5 model, control loras are for SDXL. You have to download a control net model for 1.5, from lllyasviel/ControlNet-v1-1 Hugging Face

  • @Darkfredor
    @Darkfredor Рік тому

    Waouu,super merci c'est genial

  • @stef2020
    @stef2020 Рік тому

    Is it worth switching from a1111 to comfyui regarding performance? I am working with sd1.5 in a1111 but I want to try sdxl. So maybe a good Point to Switch.

    • @sedetweiler
      @sedetweiler  Рік тому

      I find it much faster since it is only loading what you need and not that huge interface.

  • @NHCH
    @NHCH Рік тому

    thanks dude, ur a dude!

  • @corknakovastein
    @corknakovastein Рік тому

    will these work for automatic 11? Both of my gaming rigs im unsuccessful at installing warpfusion which I want to use for better consistency in videos, especially to redo the last realism test I put on my youtube, as well as comfyui I cant install. I always run into some sort of issue with the installation on both

    • @sedetweiler
      @sedetweiler  Рік тому

      I think in the beta, but I have not checked with the most recent pull.

  • @alexlindgren1
    @alexlindgren1 10 місяців тому

    Would this work for replacing for example a sofa in a room with another sofa? Or would you suggest some other approach?

    • @sedetweiler
      @sedetweiler  10 місяців тому

      Sure! That would be a good example.

    • @alexlindgren1
      @alexlindgren1 10 місяців тому

      @@sedetweiler alright, but how would one know what is the sofa in the image and replace that part and not something else?

  • @CerbyBite
    @CerbyBite Рік тому

    Even if i run a workflow from the control Lora folder I get the error:
    'CFGDenoiser' object has no attribute 'model_config'
    on the Ksampler.
    Can someone help?
    But 1.5 controller models work.

    • @sedetweiler
      @sedetweiler  Рік тому

      It isn't a LoRA in the traditional sense. In the video I show where to place it.

    • @CerbyBite
      @CerbyBite Рік тому

      @@sedetweiler Yeah, i got that. The control Loras are in my a1111 installation/extension/model folder. Comfyui got the path to that, and 1.5 Controlnet files work on the XL model and vae, but the control lora gives the CFGDenoiser error. Welp, it's something that i don't need/want for now. Maybe it will fix itself with an update or something.

  • @MultiOmega1911
    @MultiOmega1911 Рік тому

    Good tutorial! I got a workflow that mixes SDXL with SD1.54 (i think as a refiner), does it makes sense? I use it like "a giant lora" as i make the denoise super low so it changes the features of the image with the model i choose but not changing the image as whole (es. A-Zovya has a particular style i like so i create an image with sdXL model i like, then the refiner will implement some features from the Zvya 1.5 model)

    • @sedetweiler
      @sedetweiler  Рік тому +1

      Sounds like fun! That is one of the reasons why I love this node method so much, as you can do whatever you want!

  • @user-sl3ri4lt9l
    @user-sl3ri4lt9l 11 місяців тому

    hi can someone tell me how can i add multiple preprocessor ?

  • @blacksage81
    @blacksage81 Рік тому

    I got it working just fine, and I did a test gen with the Canny model, and I was wondering what was taking my render so long... I realized that I loaded 6gb diffusion model and not the control Lora. I once again was setting my laptop's gpu on fire.

  • @caricaturecebuAI
    @caricaturecebuAI Рік тому

    Great Tuts, but unfortunately mine always got this error: input_blocks.0.0.weight'

    • @sedetweiler
      @sedetweiler  Рік тому

      Sounds like the preprocessors. I would restart comfy and it should locate the missing model.

  • @CodyPyper
    @CodyPyper Рік тому

    I'm getting this when clicking on Install Custom Nodes: raise ClientConnectorCertificateError(req.connection_key, exc)........certificate verify failed: unable to get local issuer certificate (_ssl.c:1129)')]. Any ideas? Im on M1 Mac

    • @sedetweiler
      @sedetweiler  Рік тому

      Hmm, no idea! Sorry. I am not a mac person.

  • @katjanka22
    @katjanka22 Рік тому

    Can you make a tutorial how to solve Clip Vision not appearing in preprocessors? It is something about yaml changing names. But No video about it. I’m Lost. 😄

  • @MLKL2011
    @MLKL2011 10 місяців тому

    amazing.

  • @CALIGARIS-xe1pp
    @CALIGARIS-xe1pp Рік тому

    Hi, I followed all your steps for installing clone models, but even after copying "clone this model repository " in huggingface (should I paste it somewhere?), then I can't find them in "controlnet" folder, but i only have the file "put_controlnets_and_t2i_here". What did I do wrong? Thanks if someone will answer me.

    • @sedetweiler
      @sedetweiler  Рік тому

      You need to download the models from huggingface and put them into the controlnet folder next to that "put_contronnets_and_2ti_here" file.

    • @CALIGARIS-xe1pp
      @CALIGARIS-xe1pp Рік тому

      Be patient, but for me this is a completely new thing, where do I find the files to download, can you give me the link please? Thank you@@sedetweiler

    • @thehowlingfantodz
      @thehowlingfantodz Рік тому

      Check again, mine too a while to load in folder, but let me know if they show up in controlnet checkpoint loader mine didn't@@CALIGARIS-xe1pp

    • @CALIGARIS-xe1pp
      @CALIGARIS-xe1pp Рік тому

      Sorry but i didn't find the files "control-lora and controlNet-v1-1 in hugginface, please could you help me with a link to download them? Thanks@@sedetweiler

    • @dirolawal8415
      @dirolawal8415 11 місяців тому

      would be much appreciated @sedetweiler
      @@CALIGARIS-xe1pp

  • @pogiman
    @pogiman Рік тому

    cant find your video that made the Manager button appear

    • @victorhansson3410
      @victorhansson3410 Рік тому +3

      You're watching it..

    • @pogiman
      @pogiman Рік тому

      @@victorhansson3410 thanks man.. I totally missed it... rewatched it and saw it..

    • @sedetweiler
      @sedetweiler  Рік тому

      glad you got it working!

  • @-Belshazzar-
    @-Belshazzar- Рік тому

    hey thanks for the video, unfortunately the git clone command dose not download the models themselves.
    Also a bit confusing is the the fact the old controlenet in AUtomatic1111 is actually installed under extentions > controlnet and not at Models > Controlnet

    • @sedetweiler
      @sedetweiler  Рік тому

      The models get pulled in for the preprocessors when you use them the first time. The scripts and the nodes are pulled in with the git.

    • @MartinDenStore
      @MartinDenStore Рік тому +1

      It did install them for me, but it took a long time, and the cmd window didn't update for like 10 minutes at one point.

  • @___x__x_r___xa__x_____f______
    @___x__x_r___xa__x_____f______ 10 місяців тому

    UPDATE: Found that the error came from my cuda12.1 installation. I reverted to 11.8. All good thanks: Hello Scott, when I install Controlnet_aux i get dw Pose error, unable to install, is there a known issue? I tried installing both from Manager and git clone.

    • @sedetweiler
      @sedetweiler  10 місяців тому +1

      I think DW pose uses onxy, so you might want to check their git for install tips.

  • @bluelantern5241
    @bluelantern5241 10 місяців тому

    I just installed comfyui. I'm having difficulty finding a tutorial on how to train my own images for use. Do you have a tutorial for that?

    • @sedetweiler
      @sedetweiler  10 місяців тому +1

      I don't use comfy for training, just for inference.

    • @bluelantern5241
      @bluelantern5241 10 місяців тому

      @@sedetweiler is there a way to drop in a random photograph and have comfy tweak it?

  • @tiffanyw3794
    @tiffanyw3794 Рік тому

    I have a1111 and a 4060 Nvidia graphic card takes 45 sec to 1min for images . Is comfy faster

    • @sedetweiler
      @sedetweiler  Рік тому

      Yup! It's a lot leaner application. It won't be a ton faster, but as you get your workflow in place, you can optimize it. For example you might find you can cut the steps on your first pass, or between control nets.

  • @untitled795
    @untitled795 11 місяців тому +1

    Man everything was easy to follow up until this video, there's no controlnet or lora in my models folders, yet I've literally done everything you have. "If you've done it right" Is amazing to say after such an extremely convoluted explanation of installation instructions. Hopefully I can figure it out, but there's genuinely only 2 youtubers who show anything of value in regards to comfyUI. Pretty steep curve of entrance, I hope this becomes way less convoluted QUICKLY.

    • @FamousRamos
      @FamousRamos 11 місяців тому +1

      I have the same problem - only the 1.1 controlnet folder shows up for me

    • @untitled795
      @untitled795 11 місяців тому

      @@FamousRamos yeah and can’t find any UA-cam video that explains this. By the end I don’t know what I have installed, where it properly should be, and doesn’t show up in nodes.

    • @sedetweiler
      @sedetweiler  11 місяців тому +1

      Did you configure the yaml file to point to your models if they are elsewhere?

    • @untitled795
      @untitled795 11 місяців тому

      @@sedetweiler I believe I did, but truthfully the explanation for that was really ethereal and relies on the fact people had previously used or installed A1111, which I have no idea what that even is

    • @FamousRamos
      @FamousRamos 11 місяців тому

      @@sedetweiler it's pointing to the right folder, but only the "old" model folder showed up. I even renamed it exactly like you did :) but I'm sure it's user error, usually is. Thanks for responding and great tutorials.