ControlNet Reference-Preprocessor Comparison, Settings, Troubleshooting, and Style Transfer Workflow

Поділитися
Вставка
  • Опубліковано 11 січ 2025

КОМЕНТАРІ • 35

  • @CheckTheWiki
    @CheckTheWiki Рік тому +31

    Finally a channel that is actually teaching things intermediate users need to know. I'm so sick of every video showing how to install SD/Controlnet at the start for padding and then not much else of substance.

    • @siliconthaumaturgy7593
      @siliconthaumaturgy7593  Рік тому +8

      Thanks! That is why I started the channel. When I was starting out, I watched other UA-cam tutorials and found them a bit less informative than I personally prefer.

    • @lefourbe5596
      @lefourbe5596 Рік тому

      @@siliconthaumaturgy7593 indeed, i still hit my head against a wall when it comes to dreambooth training and Lora for some parameters.
      many written guide helped me understand what i was missing but as shown in your video. it comes with time and effort.

  • @lefourbe5596
    @lefourbe5596 Рік тому +7

    As Always thanks for providing this knowledge for free to the small "deep divers" audience.
    You work save us precious Time on question we didn't dare to research.
    I hope you keep on experimenting and stay motivated.

  • @msampson3d
    @msampson3d Рік тому +4

    Yay! A channel providing high quality SD content. Subscribing!

  • @jamarti
    @jamarti Рік тому

    Your style reminds me a lot of the "Battle(non)sense" yt channel, which is great. Comprehensive and to the point. I love your content

  • @BabylonBaller
    @BabylonBaller 10 місяців тому

    The community misses you bro, your vids are still in a league of their own!

  • @patricklearn6536
    @patricklearn6536 Рік тому +1

    I love this channel. I use comfy UI but everything here I can translate to that. Thank you for these very informative videos.

  • @lefourbe5596
    @lefourbe5596 Рік тому +1

    an incredible amount of work i should say ! pure madness to pull out in only two weeks !

  • @RieslinZ
    @RieslinZ Рік тому

    Thank you so much for all the contents you have provided! I never thought about using hires fix without upscaling!

  • @Aertuun
    @Aertuun Рік тому +2

    re: your section on excessive brightness or darkness. My experience is that this tends to happen when controlnet is "fighting" against what the model/prompt would usually want to produce. i.e. both sides are pulling in different directions.
    I've tended to solve this by improving the prompt so that the model's "standard" output more closely resembles the controlnet image, or by simplifying the prompt to give more flexibility and remove the conflict of model vs controlnet. Your solution also works of course; weakening the "strength" of either side of the fight lets one of the sides win more easily.

  • @lioncrud9096
    @lioncrud9096 Рік тому

    thank youu! I've been struggling with this tool and needed in-depth overview

  • @andresklagges460
    @andresklagges460 Рік тому

    Great video as always!

  • @mr2ti41
    @mr2ti41 Рік тому

    Just found your channel - Great stuff!

  • @LatentNoise-m9v
    @LatentNoise-m9v Рік тому

    Great job. Helpful, clear. Thanks

  • @krystiankrysti1396
    @krystiankrysti1396 Рік тому

    best episode yet, very useful info, thanks ! Darksushi is a borked model thats overtrained on anime, you cant do photographs with it which is probably the reason for overbaking

  • @DanailDichev
    @DanailDichev Рік тому

    you are the boss! (I'd love to see your take on outpainting:1.5)

  • @philiproberts
    @philiproberts Рік тому

    I've been trying to do Tiled Diffusion with the multi diffusion upscaler extension. And all I ever get is multiple images forced together ungracefully. A video on this extension and the tile controlnet model would be awesome. And your awesome too thanks for the videos 😊

    • @siliconthaumaturgy7593
      @siliconthaumaturgy7593  Рік тому +2

      Tiled Diffusion is on my radar and near the top of my list. It's probably going to end up being multiple parts since there is so much in that extension

  • @ekot0419
    @ekot0419 Рік тому

    Thanks for the tutorial. Short, but every second of the video is knowledge. I took a lot of notes from this 1 video.
    I would like to ask you why you think that highres fix is necessary for text to img? I haven't used SD enough to make a call. But from a professional designer's point of view, also using my not too cheap PC to try, adding this step does significantly increase the render time. So I incline to think that finetuning can be moved to img to img. But again, I am just a baby in SD. What do I know. Please explain a bit if possible. thank you. liked and subbed.
    xyz plot is amazing. 1 shot and we get to see all of them. Perhaps this is why you suggest using Hires fix everytime. Only issue is, I can totally feel the difference in terms of the wait.

  • @danishraza8843
    @danishraza8843 Місяць тому

    I use reference to light my images. I found that using best dynamic range images gives best results.

  • @MrSongib
    @MrSongib Рік тому

    10:00 for this part we can fix stuff with Adjusting prompt like you said and maybe adjusting other stuff like VAE, Lora for darken or lighten the image without destroying the composition and some CFG rescaling like "Neutral prompt" extension, There is some setting in aswell similar to this but from the webUI dev they said this one is a bit better (I'm forgot where in the setting tab as well. xd)
    18:47 maybe we can use ctrlnet segmentation here. idk
    great content as always. ty and have a nice day. (I'm done rewatch this and maybe ill watch again if I forgot some stuff as most likely would happen in the future. xd)

    • @siliconthaumaturgy7593
      @siliconthaumaturgy7593  Рік тому

      Thanks. ControlNet Reference is definitely the most challenging to use feature I've covered yet, so thanks for your patience.
      Unlike most other ControlNets, almost everything seems to matter and have a chance to mess it up. It's like riding a raging bull. So I really appreciate the suggestions and I'll try them out soon.

  • @shorts.cookingasmr
    @shorts.cookingasmr 11 місяців тому

    do you know if theres a way to use reference-only without using a prompt? i have an image and i want it to be replicated, but i don't want to prompt it

  • @feizhouji
    @feizhouji Рік тому

    very helpful!!

  • @37hp72
    @37hp72 9 місяців тому

    how can i made that in comfyui

  • @KillMode13X
    @KillMode13X Рік тому

    Thank you.

  • @meh2063
    @meh2063 Рік тому

    Thanks

  • @MrSongib
    @MrSongib Рік тому +2

    cool content but hard to follow, the editing jumping around as always and it's kinda hard to focus on what you talking about and what I actually seeing atm. idk how to explain it. i think I need to rewatch this later. ty and have a nice day.

    • @BabylonBaller
      @BabylonBaller Рік тому

      Yea, I felt the same, but simply pausing often to intake / review the grids helped a bunch.

    • @roymathew7956
      @roymathew7956 Рік тому

      I agree as well. It would be helpful when showing a big grid of images to actually mouse over or highlight the specific ones that you’re talking about. There’s just too much to process all at once when you show the entire grid and it moves very quickly from scene to scene.

    • @TheDocPixel
      @TheDocPixel Рік тому

      Change the speed to 50% and turn on subtitles; hit space bar to pause/resume. Learn how to use YT.

  • @Lishtenbird
    @Lishtenbird Рік тому +1

    Joke's on you - I _want_ human-animal abominations.