Stable Diffusion Fix Hands With ControlNet and Inpainting (Easy Method)

Поділитися
Вставка
  • Опубліковано 5 жов 2024

КОМЕНТАРІ • 66

  • @Aiconomist
    @Aiconomist  Місяць тому +1

    📢 Last chance to get 40% OFF my AI Digital Model for Beginners COURSE: aiconomist.gumroad.com/l/ai-model-course

  • @Ivan-pv4ix
    @Ivan-pv4ix 9 місяців тому +38

    Good video for beginner. Here some tips:
    Hand detailing can be done without PS. Just after first inpaint result that you like switch to "inpaint only masked" with the same area selected to process that with higher resolution. Denoising can be lowered to 0.5. That way fingers and nails will be drawn almost perfectly. Also instead of control images editing, you can tweak pose bones with openpose editor extension right in A1111 window.

  • @testales
    @testales 9 місяців тому +6

    DWPose is a blessing indeed. I'm not a fan of manual painting stuff so in ComfyUI I use now two samplers linked via a OpenPose C-Net with DWPose most of the time as my starting stage. This doesn't only fix hands but also extra limbs. Not always of course and sometimes it makes it only worse but overall I think this approach works better than any LoRa and you don't have to mess up your prompt.

    • @beaconing7689
      @beaconing7689 9 місяців тому +1

      im not not a fan, but i cannot draw!

  • @_inspirasiislam
    @_inspirasiislam 9 місяців тому +5

    I've tried this approach and used adetailer, and the results turned out pretty good. No need for additional editing in Photoshop. Thanks!

  • @zabiisuto
    @zabiisuto 19 днів тому

    This was actually really good! For Comfy UI this concept works really well

  • @jcdenton7914
    @jcdenton7914 9 місяців тому +10

    Now we just need to fix the feet next

  • @carlingo3191
    @carlingo3191 9 місяців тому +5

    Appreciate the video - never had a good handle on this. Did want to mention you say to set the "CFG" level to .9 twice (ie: 01:48) - I'm sure it's obvious by the onscreen and basic knowledge, but you mean to say set Denoising strength. Cheers.

  • @dagdun
    @dagdun 9 місяців тому +3

    4:16 after generated a preview. you can click "edit" button in the "preprocessor preview" box to easily drag and move each position

  • @Saphira_Paix
    @Saphira_Paix 8 місяців тому +5

    "easy method" and "photoshop" in the same context :D

  • @Djonsing
    @Djonsing 9 місяців тому +2

    1:51 I did everything according to your video tutorial, but when I set this parameter to 0.9 like you did, I end up with porridge instead of hands!

  • @ChanAndrew-w3q
    @ChanAndrew-w3q 3 місяці тому +1

    Great. It really works. Thks.

  • @nixonmanuel6459
    @nixonmanuel6459 11 годин тому

    Thank you.

  • @ignat3802
    @ignat3802 6 місяців тому +1

    Great vid! Thanks for a showcase.

  • @holerisen
    @holerisen 9 місяців тому +4

    Is this DWPose extension doing anything? Even without the extention, controlnet has "dw_openpose_full" as selection. (Controlnet v1.1.427)

  • @hyperdeloutz2444
    @hyperdeloutz2444 8 місяців тому

    Excellent tutorial. This alone deserves a sub and did just that!!
    Looking forward for more contents.

  • @OVERLOARD949494
    @OVERLOARD949494 4 місяці тому

    boy after 24h I finally got some results. Thank you so much^^

  • @nigel-uno
    @nigel-uno 6 місяців тому +7

    I was cringing so hard when you brought openpose into photoshop instead of using the built in open pose editor inside A111. Don't do tutorials if you don't know know what you're doing.

    • @manhvu3673
      @manhvu3673 20 днів тому +1

      probably he doesnt know its existence yet, he still went the right path though

    • @imonutiy
      @imonutiy 11 днів тому +1

      I enjoyed the tutorial, at least it was short

  • @grafik_elefant
    @grafik_elefant 9 місяців тому

    This video is gold. thank you!

  • @NEW-GENERATIONS_
    @NEW-GENERATIONS_ 7 місяців тому

    this is great, i just have this problem where when i follow your instructions and others... I get a blurry shape as my result. The hand will look like a ball of flesh or some type of shape.

  • @MrSongib
    @MrSongib 9 місяців тому +1

    same method that i did, but there is one more method as well that I did sometimes, with Lora hands + Neg hands embedding for inpainting. I use this when i really want good hands.
    Mu fast method was, Turn on the Adetailer (in this step from model 1-5) BG (using full body masking then invert it), Full body, Wardrobes (Using deepFashion2 model), and then Face. After this just upscale it if it's good enough. or just did the inpainting for hands for example, using the Lora + Neg Hands Embedding. For basic generation i rarely use the hands embedding and the hands lora.

    • @Darkwing8707
      @Darkwing8707 9 місяців тому

      I'm trying to understand your fast method. You use ADetailer for background, full body, wardrobe, and face? Like for BG, you use person_yolov8n-seg and select 'Merge and Invert' under Mark Preprocessing in ADetailer?

    • @MrSongib
      @MrSongib 9 місяців тому

      @@Darkwing8707 yes, set to higher resolution. and when it done it will be lowres in mycase 512x768 but with more clarity and details, and from there just do the upscale, instead of relying on hiresfix.

  • @JohnSmith762A11B
    @JohnSmith762A11B 8 місяців тому +1

    Followed this to the letter and now instead of weird hands I get smears in the masked area or pieces of my character's body missing where the mask is. I suspected this would be bad but it's worse than useless.

  • @rifz42
    @rifz42 9 місяців тому +1

    Is this for 1.5 or also SDXL? I don't have much luck with open pose and SDXL... got any tips?

  • @skily4866
    @skily4866 12 днів тому

    for pony 6xl ?

  • @morrissecondchannel9166
    @morrissecondchannel9166 3 місяці тому

    "Error RuntimeError: mat1 and mat2 shapes cannot be multiplied"
    What do I do wrong?

  • @Warrioroffaith11
    @Warrioroffaith11 3 місяці тому

    How do I install DW Pose and control net in Github and huggingface?? Cause i am so confused

  • @rileyxxxx
    @rileyxxxx 9 місяців тому

    why is it not recognizing any models for me.. I was using controlnet before but now its none. where do I have to place the models for dwpose?

  • @k-tron1412
    @k-tron1412 5 місяців тому

    which checkpoint model you use in second image

  • @PINKGIRL-lv7ow
    @PINKGIRL-lv7ow 7 місяців тому

    An excellent technique, but for a video of more than 900 frames it might be a bit too tedious

  • @seyfer110
    @seyfer110 8 місяців тому

    at 1:50 you said to set CFG to 0.9, but them moved the denoising strenght slider instead

  • @moonduckmaximus6404
    @moonduckmaximus6404 8 місяців тому

    a high cfg setting or denoising strength?

  • @taken9054
    @taken9054 9 місяців тому

    Good tutorials! Do you know of any AI that can edit the voice in a long video, running on my PC? Could you make a video on how to train artificial intelligence locally, providing information that we want? Thank you very much and keep it up!"

  • @mixedmeds
    @mixedmeds 8 місяців тому

    There's no preview button?

  • @AnutyMoyesha
    @AnutyMoyesha 5 місяців тому

    sir do I have to install this to my pc?

    • @Aiconomist
      @Aiconomist  5 місяців тому

      bsolutely, stability is key, whether you're running Duffusion on your computer or in the cloud!

  • @jd3dacat
    @jd3dacat 9 місяців тому

    4:00 She got those Stanford Pines hands lmao (Gravity Falls for those of you who live under a rock lol)

  • @Hyzaa
    @Hyzaa 6 місяців тому

    it wont let me install dw openpose?

  • @mockingjay5558
    @mockingjay5558 7 місяців тому

    but it looks still a bit awkward... :/

  • @Frankie-oy1lz
    @Frankie-oy1lz 9 місяців тому

    Which AI voice used here?

  • @chaicatty
    @chaicatty 9 місяців тому +6

    Great tutorial BUT it went a little fast and because the interface text was faint it was hard to keep track, not knowing what tab he was navigating on too, also an important step was missing and that is to install: control_v11p_sd15_inpaint

    • @mixedmeds
      @mixedmeds 8 місяців тому

      Do you know how to install that?

  • @PerfectArmonic
    @PerfectArmonic 9 місяців тому

    Awesome! ❤ but the hand bones still doesn’t look quite natural. A little more fine tuning is required….

    • @manhvu3673
      @manhvu3673 20 днів тому

      it may took hours of tries and probably 100 photos to get good result

  • @ChrisAIGuy
    @ChrisAIGuy 4 місяці тому

    Or the other option is too crop out the hands ;)

  • @snelle_tomos
    @snelle_tomos 9 місяців тому +1

    Could've sworn I heard MKBHD

    • @piracymoney
      @piracymoney 9 місяців тому

      it probably is, just AI voice

    • @snelle_tomos
      @snelle_tomos 9 місяців тому

      @@piracymoney Haha sick, do you think ElevenLabs can get this accurate with cloning?

  • @alonsogarrote8898
    @alonsogarrote8898 9 місяців тому

    Does it work with SDXL?

    • @manhvu3673
      @manhvu3673 20 днів тому +1

      SD1.5 or SDXL works the same, but need download separated OpenPose model version (ends with _xl_)

  • @cokuzaklar
    @cokuzaklar 5 місяців тому +1

    aint no body got time for ps

  • @geoAriton
    @geoAriton 7 місяців тому

    ai voice with mkbhd voice loooool

  • @TPCDAZ
    @TPCDAZ 9 місяців тому +3

    no need for this anymore with all the hand loras around and better models.

    • @TheKillingPerfection
      @TheKillingPerfection 9 місяців тому

      which hand lora is good?

    • @TPCDAZ
      @TPCDAZ 9 місяців тому +2

      @@TheKillingPerfection Go with band hands v4 and v5 are good, also loras like unrealisticdream have hands included.

    • @chiefbala0374
      @chiefbala0374 9 місяців тому

      ​@@TPCDAZ only for SD1.5 right?

    • @manhvu3673
      @manhvu3673 20 днів тому

      @@TPCDAZwhat you mean bad hands v4 v5? are they Lora model files or just text prompt?

    • @TPCDAZ
      @TPCDAZ 20 днів тому

      @@manhvu3673 They are two of many other than understanding how negative prompting works which helps without them. Also models like Flux do 99% better right out of the box.