How to correctly train your Stable Diffusion model

Поділитися
Вставка
  • Опубліковано 24 гру 2024

КОМЕНТАРІ • 172

  • @gagandwaz6823
    @gagandwaz6823 День тому

    This is one of the very best tutorials I have watched on this topic.

  • @silverhand861
    @silverhand861 Рік тому +33

    "Basically you trying to look at a cloud, and figuring out what the shape actually is"
    I love this metaphor! Great shorthand for interpreting noise with preexisting training, notions and biases

  • @Metrionix
    @Metrionix 9 місяців тому +3

    Just wanna say, man... your style is great. These how-to videos are usually a snooze-fest, but you make it entertaining.
    You'll definitely be my go-to guy from now on.

  • @Hchtoru7179
    @Hchtoru7179 Рік тому +14

    bro I was trying to make a model/lora in SD for a week, I spent hours learning the basics of programming, I almost gave up, I tried again and there was always an error somewhere, this video saved me and finally I managed to generate the images that I wanted, thank you very much bro, success with your videos, you gained another subscriber

  • @danyaundercover
    @danyaundercover Рік тому +12

    Everytime I get to the training program i always get "python3: can't open file '/content/train_dreambooth.py': [Errno 2] No such file or directory" and it never shows that file when i open it through your link

  • @Rshbsahu.
    @Rshbsahu. Рік тому +8

    Honestly Speaking
    I was trying to train my model back from 2022 December
    But I failed many times
    This is one of the most Practical and quick tutorial
    Thank you Man

  • @KingVid-y2j
    @KingVid-y2j Рік тому +11

    i fallow every step but im ruining to a error (python3: can't open file '/content/train_dreambooth.py': [Errno 2] No such file or directory)

    • @lautaromarulanda1726
      @lautaromarulanda1726 Рік тому +1

      Hey did you get any solution?

    • @AnimeRookie
      @AnimeRookie Рік тому +1

      A path error somewhere the code should should you the line where it occurs

  • @DanicaCidosa
    @DanicaCidosa Рік тому +10

    "python3: can't open file '/content/train_dreambooth.py': [Errno 2] No such file or directory" what do I do if this happens?

  • @pd2170
    @pd2170 Рік тому +5

    This is one of the very best tutorials I have watched on this topic. Have not tried it out yet. But I will. Thx from Germany!

  • @UsmanAfridi-h6q
    @UsmanAfridi-h6q 4 місяці тому

    Great video. I cant imagine the work you have put up on this one video, especially the video editing.

  • @dhanisthsarawagi5395
    @dhanisthsarawagi5395 11 місяців тому +1

    I have a labeled dataset
    means I have a folder consisting of subfolders named according to the type of pattern they consist
    and another folder for the background
    so how to train with a dataset which have multiple sub-datasets
    and I want realistic images like texture of cloth should be generated so which model is best suited

    • @ThatArtsGuySiddhant-tk4jb
      @ThatArtsGuySiddhant-tk4jb  11 місяців тому

      Sorry Bro I don't know about that. Im currently learning about chat bots and no-code.

  • @ja6896
    @ja6896 Рік тому +2

    Had me chuckling the whole way through, nice and informative vid. Subbed

  • @K-A_Z_A-K_S_URALA
    @K-A_Z_A-K_S_URALA Місяць тому +1

    tell me the settings for the rtx 3060 12gig webui/bat video card/// thnx bro

  • @timmaltby7798
    @timmaltby7798 2 місяці тому

    Great Tutorial. I thought Andrew Kramer's After effects tutorials were good, but you out did him.

  • @HoangNguyen-rl4zs
    @HoangNguyen-rl4zs Рік тому +1

    Can we use SD's weights and create an api to incorporate into the application? Please make a video about this issue

    • @ThatArtsGuySiddhant-tk4jb
      @ThatArtsGuySiddhant-tk4jb  Рік тому

      Greate idea but I haven't tried that yet brother so I don't think I'm the right person for this.

    • @ThatArtsGuySiddhant-tk4jb
      @ThatArtsGuySiddhant-tk4jb  Рік тому

      Im doo learning about chatbots currently i will put a tutorial for that in few days

    • @HoangNguyen-rl4zs
      @HoangNguyen-rl4zs Рік тому

      Thanks for your repply. I will try it by myself@@ThatArtsGuySiddhant-tk4jb

  • @Content-Calling
    @Content-Calling Рік тому +2

    I keep getting this error ???? Help Please "python3: can't open file '/content/train_dreambooth.py': [Errno 2] No such file or directory"

    • @ThatArtsGuySiddhant-tk4jb
      @ThatArtsGuySiddhant-tk4jb  Рік тому +1

      Try reinstalling that whole colab file and then follow this tutorial word by word do not miss any step

    • @Content-Calling
      @Content-Calling Рік тому

      @@ThatArtsGuySiddhant-tk4jb Thanks my friend... i fixed it.. However the next question is how do i start it again when it times out or when i close my system down ? Do i need to follow the steps as per the initial install each and every time i want to run ???

    • @ThatArtsGuySiddhant-tk4jb
      @ThatArtsGuySiddhant-tk4jb  Рік тому +1

      @@Content-Calling yes you do plus just keep on doing some thing or another on your screen it will not shut down

    • @Content-Calling
      @Content-Calling Рік тому

      @@ThatArtsGuySiddhant-tk4jb does the hugging face token need to change every time ?

    • @Content-Calling
      @Content-Calling Рік тому

      @@ThatArtsGuySiddhant-tk4jb Having real difficulties re-starting, any advice. Should i delete everything and run again

  • @TheMcKing
    @TheMcKing Рік тому +1

    Afer I created a cpk file with your tutorial, I tried adding it to my personal stable diffusion and using it to make promts, but it is not working. How to I transfer that model created by your guidef over to my own stable diffusion?

    • @ThatArtsGuySiddhant-tk4jb
      @ThatArtsGuySiddhant-tk4jb  Рік тому

      So as per the info you provided . I think eather you didn’t downloaded the ckpt file properly or the file was too long and it didn't downloaded fully from that colab notebook

    • @ThatArtsGuySiddhant-tk4jb
      @ThatArtsGuySiddhant-tk4jb  Рік тому

      Try redoing it and do pay heat to all the key points / small details that I mentioned in this video

  • @altahookah
    @altahookah Рік тому +3

    Hi!
    tensorflow-probability 0.22.0 requires typing-extensions

  • @HunterK-he3lg
    @HunterK-he3lg Рік тому +2

    Best ai training vid on the tube godbless

  • @sanket_codes8485
    @sanket_codes8485 Рік тому +1

    Specify the weights directory to use (leave blank for latest) this gives error

  • @gregorymagid85
    @gregorymagid85 Рік тому

    Thak you for the video , i am stuck at 9:32 the play button returns zero seconds and dosent train the image set . do note my image are 1024X1024 and do not contain a face , i am traying to replacate a searten style of the environment in my data set. any advice ?

    • @ThatArtsGuySiddhant-tk4jb
      @ThatArtsGuySiddhant-tk4jb  Рік тому

      Well the colab notebook that I used back then is now having some issues, I would recommend you to try some other colab note book for Stable diffusion there are many if you search for it, they all have similar steps like this one

  • @AntonioFlaman
    @AntonioFlaman Рік тому +1

    how did you do this video at 5:56?

    • @ThatArtsGuySiddhant-tk4jb
      @ThatArtsGuySiddhant-tk4jb  Рік тому

      You can watch my another video that I made on how I turned a Video into animation. Its all about that only.😊 ua-cam.com/video/J3EuLW7phLo/v-deo.html

  • @nahathblah2242
    @nahathblah2242 Рік тому +2

    Brother it is showing "python3: can't open file '/content/train_dreambooth.py': [Errno 2] No such file or directory"

    • @nahathblah2242
      @nahathblah2242 Рік тому +1

      any help?

    • @ThatArtsGuySiddhant-tk4jb
      @ThatArtsGuySiddhant-tk4jb  Рік тому

      @@nahathblah2242 Can you elaborate a bit

    • @nahathblah2242
      @nahathblah2242 Рік тому

      @@ThatArtsGuySiddhant-tk4jb there was an error since my anti virus was blocking something. But it's fixed thank you!

    • @nahathblah2242
      @nahathblah2242 Рік тому

      @@ThatArtsGuySiddhant-tk4jb btw sir can this ckpt file be converted into tflite format and can it be used as a backend to send text input directly to the model and get an image output? If yes, can you please help me how should i pass the text and how to get the output

    • @ThatArtsGuySiddhant-tk4jb
      @ThatArtsGuySiddhant-tk4jb  Рік тому

      @@nahathblah2242 Sorry buddy I haven't tried that yet. 😅 So I'm not the best person to ask about it.

  • @falkar11
    @falkar11 Рік тому +1

    Does this still work? It won't work for me. I'm confused in rhe part where you input pictures. I put them in rhe data folder and then it just fails. How do you do it? You can't press run all?

  • @prpankajsingh
    @prpankajsingh Рік тому +1

    @ThatArtsGuySiddhant-tk4jb When i started the training, it generated few samples in for the class category as well and when i manually observed these generated images, these were images of person (as expected) however the face was deformed and not well formed and the the sample quality for the person class was bad. Why is that ? will it affect the our trained model output quality ? For better result, should we add the person's images ourselves ? Also, if we no better class keywords which represents the instance object, then should we rather use that for better results ? Say rather than person (in the context of the example you have given), should we use "male person" or "indian male person" for better results ?

    • @ThatArtsGuySiddhant-tk4jb
      @ThatArtsGuySiddhant-tk4jb  Рік тому

      There is no need to specify that its an indian person(its mostly going to make you in some random rajistani as it happened to me when I accidentally trained my model with me wearing turben ) rather then that do as i say in the persons folder where all those deformed human type pics are change them with actual human. To be more precise if you are training your own model then change it with pics of people who look like you. (If your from south the pic of south indian man and women, if your from north the pic of north indian man and wormen) just always remember this one thing that your are teaching the ai how a person looks like to be more presise how you look...😊

  • @MarcDanielLigaray
    @MarcDanielLigaray День тому

    how do i re install the entire colab file ? ive tried and tried but its so difficult pls help

  • @tilda140
    @tilda140 Рік тому +2

    nice effort brother, good work here

  • @rhinosdesigns291
    @rhinosdesigns291 Місяць тому

    hi lad, i have this issue : ImportError: cannot import name 'cached_download' from 'huggingface_hub' and cant fiw it, i tried many things, but still get that issue, im running on facehub 26 i think. and forums say its uncompatible with manythings, yet ive tried downgrading it to 24.1, 23.5 and 25.1 still the same issue, if not jax or compatibility issues. idk if you can help but if yes please do so. ive been on my pc for around 4 hours trying to figure this out.

  • @Seth_hahaha
    @Seth_hahaha Рік тому +1

    hlo sir i have a problem, when i open stable diffusion in google colab, then after 5 min i see some problem like "runtime disconnected your runtime has been disconnected due to executing code" pls solve my problem pls

  • @KillFrenzy96
    @KillFrenzy96 Рік тому +7

    Btw, it is not a good idea to only have simple backgrounds. The simple background will be associated with your character and will negatively affect backgrounds.
    Some of your images needs have a background, but you need to roughly describe the background in your caption for those pictures. Likewise, you should add a caption for simple background pictures with 'simple background'.
    This helps the training to associate the background with other tags rather than with your character tag. This also helps because it can now identify that simple flat backgrounds are not associated with your character.

    • @ThatArtsGuySiddhant-tk4jb
      @ThatArtsGuySiddhant-tk4jb  Рік тому +1

      Not really brother sd already is trained on millions of images therefore it already has references for backgrounds and stuff. But whats new to it is you face. Thats why in the training images if its the face thats constantly changing the ai will focus on learning that itself. Your explination is correct when you're training a model in a particular art style. "Anime, Disney etc" I especially in this video only trained my own model. 😊
      And btw sorry for replying so late😅.

    • @KillFrenzy96
      @KillFrenzy96 Рік тому +2

      @@ThatArtsGuySiddhant-tk4jb All good, and good insight. From my tests so far though, with enough regularisation (such as regularisation images, weight decay, max norm, network dropout) the AI will mostly learn what is consistent between images instead of everything about your images. If the background is consistently gray, then your generations will include more grey backgrounds.

  • @nihar334
    @nihar334 10 місяців тому +1

    Hey, do you take commissions?

  • @ywueeee
    @ywueeee Рік тому

    the algo is picking this up and showed me this great video, keep up the good work

  • @polyseptic
    @polyseptic Рік тому +1

    AWESOME TUTORIAL! This video is underrated 😅

  • @MarcDanielLigaray
    @MarcDanielLigaray День тому

    in () index error how do i fix this type of error pls respond

  • @MissMisha-yx1gb
    @MissMisha-yx1gb 10 місяців тому +1

    python3: can't open file '/content/train_dreambooth.py': [Errno 2] No such file or directory

  • @Sanguen666
    @Sanguen666 Рік тому +1

    well done pajeeet!

  • @ClaudetteFiguera
    @ClaudetteFiguera Рік тому +1

    Is there a way to use your trained model to carry over the image style to other photos?

    • @ThatArtsGuySiddhant-tk4jb
      @ThatArtsGuySiddhant-tk4jb  Рік тому

      Brother my model is training on me not a particular style. Its not an model trained on indian mens but a Siddhant model. Even if you use this model to generate images thay will have a very close resemblance to me. If thats what you want you can try but if you want a model specifically trained on indian then you have to find it on google brother😅.

    • @ClaudetteFiguera
      @ClaudetteFiguera Рік тому

      @@ThatArtsGuySiddhant-tk4jb 🤣 thank you for the reply! What I meant was I have a modeled that I trained on a specific photo style. I would like to be able to upload a picture and have the model implement that style onto the uploaded picture, not sure if that’s possible.
      Thanks again!

    • @ThatArtsGuySiddhant-tk4jb
      @ThatArtsGuySiddhant-tk4jb  Рік тому +1

      @@ClaudetteFiguera Brother if you have trained a model then you should get output in that particular style that the very reason we train it. Isn't it😅.
      1 Eather you are not prompting it properly.
      2 or you have just trained it on a very small data set.
      Well I'll give you a short cut rather then training a whole new model for a particular style. Use midjourney upload the image which style you want and then use a bot called insight face and with that you might get you desired outcome. Just google it midjourney insight face.😊👍

  • @Content-Calling
    @Content-Calling Рік тому

    How do we fine tune in this Web UI version of SD... It doesnt have any added features such as Extensions and Image to image etc ????

    • @ThatArtsGuySiddhant-tk4jb
      @ThatArtsGuySiddhant-tk4jb  Рік тому +1

      Brother this colab note book is strictly for straining you own SD model for any other activity like video to animation watch my other video where I turned black widow into a disney character

  • @arborius
    @arborius Рік тому +1

    Please make one for training SDXL now

    • @ThatArtsGuySiddhant-tk4jb
      @ThatArtsGuySiddhant-tk4jb  Рік тому

      Great Idea bro but currently Im focusing more towards my ai chatbots and automations. Video will be coming soon. Can't say the same about sd

  • @mikeirvin2233
    @mikeirvin2233 8 місяців тому

    Getting this error, however I have uninstalled torch 2.2.2 and installed 2.2.1 using both pip and conda. Conda list only shows 2.2.1 installed, however i keep getting this error.... Any suggestions?
    torchaudio 2.2.1+cu121 requires torch==2.2.1, but you have torch 2.2.2 which is incompatible.
    torchtext 0.17.1 requires torch==2.2.1, but you have torch 2.2.2 which is incompatible.
    torchvision 0.17.1+cu121 requires torch==2.2.1, but you have torch 2.2.2 which is incompatible.

  • @SyntheticSoundAI
    @SyntheticSoundAI Місяць тому

    For the Settings and Run part, could I train using any model I want? Including Flux?
    The model name used in the video is now deprecated.

  • @boucheromain-alexis9285
    @boucheromain-alexis9285 Рік тому +1

    Hi! Great video Sid, very informative thank you :) Would you know work with this stable diffusion model via API? I'd like to use an automation software to send it prompts and get back the result. Thanks!

  • @alyxyxzy
    @alyxyxzy 6 місяців тому

    Will it crash if i try this on mobile?

  • @DigitalMagicVFXTutorials
    @DigitalMagicVFXTutorials Рік тому

    I tried the shared method 10 times but failed and getting the following error everytime I try: python3: can't open file '/content/train_dreambooth.py': [Errno 2] No such file or directory

  • @aiblogsmsrajput4319
    @aiblogsmsrajput4319 10 місяців тому

    How to do that for multiple classes??

  • @antewoo
    @antewoo Рік тому +1

    super in depth and great tips. made sure i wasnt wearing a turban for sure

  • @pluto
    @pluto Рік тому

    Is there a reason you used different colors for the background on some of the images? Is there a reason I can’t use white or green or something

  • @BharathAchanta-j3l
    @BharathAchanta-j3l Рік тому +1

    end with sigma made me watch again and again ..keep sigma

  • @--Dipanshu--
    @--Dipanshu-- 11 місяців тому

    Very nice video dude

  • @AyazUS-b1h
    @AyazUS-b1h 4 місяці тому

    this colab is not working.giving dependency error

  • @surajkhan5834
    @surajkhan5834 8 місяців тому

    bro how to use this model as call of rest api, should i push this model to hugging face??

  • @KADstudioArchitect
    @KADstudioArchitect 3 місяці тому

    Very nice video, I get totally without Speaker, bravo

  • @hariharan-z9i
    @hariharan-z9i 10 місяців тому

    i am facing error on python code : Traceback (most recent call last):
    File "/content/train_dreambooth.py", line 18, in
    from accelerate import Accelerator
    ModuleNotFoundError: No module named 'accelerate'

  • @wecharg
    @wecharg Рік тому +1

    Really cool!

  • @camspider9887
    @camspider9887 Рік тому

    what a great video man.... keep up, bro

  • @beedeo3664
    @beedeo3664 Рік тому +1

    great job

  • @SuperRockerbilly
    @SuperRockerbilly 6 місяців тому

    Thanks for this great tutorial. However I'm stuck, after adding my images to the folder and adjusting the max train steps prompt, trying to run it, I get an error message saying "python3: can't open file '/content/train_dreambooth.py': [Errno 2] No such file or directory"
    Any advice? Thanks

    • @trevortfilms
      @trevortfilms 5 місяців тому

      same, anyone find the fix yet?

  • @scp-09698
    @scp-09698 Рік тому +1

    you are a life saver!!!!

  • @promptgeek
    @promptgeek Рік тому

    Awesome video and enjoyed your editing!

  • @pastuh
    @pastuh 11 місяців тому

    01:15-01:25 Simple and best explanation :X

  • @freakoutstation4867
    @freakoutstation4867 Рік тому +1

    Nice tutorial i hope it get well know it!

  • @vivekvp
    @vivekvp Рік тому

    Wow Awesome Video - love the edits, cadence and clarity! Really helped me understand diffusion as well! Thank you! Question: If I wanted to be crazy and try to locally install it on my home pc, would I clone it from Git, or download the files? I would love to see this being done!

    • @ThatArtsGuySiddhant-tk4jb
      @ThatArtsGuySiddhant-tk4jb  9 місяців тому

      First and foremost, I recommend not attempting to run Stable Diffusion on your PC. However, if you're interested, I've created a tutorial video. Simply clone the 'Automatic 1111' repository onto your computer and follow the instructions provided in the tutorial. This is advisable only if your PC is highly powerful; otherwise, the experience could be quite frustrating.

  • @niloytesla
    @niloytesla Рік тому

    proud to you bhai! top q vid!

  • @Jnaathra
    @Jnaathra 10 місяців тому

    4070 TI Super now available with 16GB of VRAM for around 800 US. Still not cheap, but not thousands either. Go nuts with local install.

  • @MacherTV
    @MacherTV Рік тому +1

    Great tutorial buddy! Thanks, learend some new stuff :)

  • @xuanloc5111
    @xuanloc5111 Рік тому

    nice video. Thank you!

  • @ronnyfenske9527
    @ronnyfenske9527 Рік тому +1

    2:36 *than

  • @3051suryanarayananbkrist
    @3051suryanarayananbkrist 9 місяців тому +1

    Bro for dreambooth only required 3 to 5 images. But I have only 1 image😅(of other person) now how can gather other images of that person he is not famous and he is a small school teacher

    • @ThatArtsGuySiddhant-tk4jb
      @ThatArtsGuySiddhant-tk4jb  9 місяців тому

      Ask him bro😅

    • @3051suryanarayananbkrist
      @3051suryanarayananbkrist 9 місяців тому

      @@ThatArtsGuySiddhant-tk4jb bro how to i train a different persons in one model in different GPU because after first training model GPU runtime out after some or using different GPU how to i second person and the photo required is of my principle thanks for your reply please also reply me for this 🙏🙏

  • @AlbertoCasanova
    @AlbertoCasanova Рік тому

    You talk a lot but I really enjoyed your chat, also, your editing style is very fun. ALSO, you're amazing with your results! Thanks! What city are you from?

  • @somanna_bu008
    @somanna_bu008 Рік тому

    Good stuff. 👌

  • @navirobayo
    @navirobayo Рік тому +1

    Amazing

  • @NaqashAfzal
    @NaqashAfzal Рік тому +1

    You can use roop Module without train your own model

  • @Tretteroa1-tg4rw
    @Tretteroa1-tg4rw Рік тому +3

    This colab note is broken DONT USE IT
    Waste of time..

  • @sus-lb8qv
    @sus-lb8qv Рік тому

    can you share your model?

  • @gaillardmarine2731
    @gaillardmarine2731 Рік тому

    If you dont move the page while is loading you have to start again; i did five tie i gave up ! you explain way more easier tho! you make me laught 💪💪💪

    • @ThatArtsGuySiddhant-tk4jb
      @ThatArtsGuySiddhant-tk4jb  Рік тому

      Yes this is the issue with the colab files that if you leave them dormant for a while the system shuts down itself😅

  • @VulgarTruth
    @VulgarTruth 8 місяців тому +1

    Oi. I have £1000-£1300 to spend on a laptop / Mac for stable diffusion.. what to choose?
    Bring me the horizon ❤❤..

    • @ThatArtsGuySiddhant-tk4jb
      @ThatArtsGuySiddhant-tk4jb  8 місяців тому +1

      No 😅. It's not about which laptop to choose, but how powerful your GPU is. To run SD, you need quite a powerful GPU, which itself could cost between $1,000 and $2,000. Therefore, it might make more sense for you to just get a Google Colab subscription. For a small cost of $10 a month, you can use a world-class GPU. Then, even a $200 PC would work. I myself have been running this whole thing on Google Colab.

  • @williamwherewhatwho6177
    @williamwherewhatwho6177 26 днів тому

    The tutorial is great but it does unfortunately not work anymore. Breaking changes in the dependencies :/

    • @C9BER
      @C9BER 12 днів тому

      noooooo

  • @shadowolf3998
    @shadowolf3998 Рік тому +2

    Colab banned all usage of sd sadly

  • @rifarira9160
    @rifarira9160 Рік тому

    i think it does not work anymore

  • @kali7143
    @kali7143 Рік тому

    No, this is not correct I am using every dimension image and the result very good 😊☺️

  • @pietryk-
    @pietryk- Рік тому

    7:20

  • @WackFPV
    @WackFPV 10 місяців тому

    wait hold up, how the fart did you get it to run on google like that... thats cool...

  • @pietryk-
    @pietryk- Рік тому

    10:30

  • @diewlaylomei
    @diewlaylomei 5 місяців тому

    this is hilarious as fuck!!! ahhahah

  • @christopherbrown1187
    @christopherbrown1187 3 місяці тому

    thanks mr poo in loo

  • @ChenHaziza
    @ChenHaziza 7 місяців тому

    may 2024 it doesn't work

  • @Abstractor21
    @Abstractor21 11 місяців тому +1

    don't use it please, i just wasted my time... lol

  • @DennisAH
    @DennisAH 10 місяців тому

    Someone who makes a video about training your own AI and then tells people that installing Stable diffusion on a local PC is a bad decision, is clearly a SCAM.
    Stop making videos, please.

  • @mcardielv23
    @mcardielv23 3 місяці тому

    I don't know if someone write you this already but I think when you change the words in # commented lines around 4:56 this will not affect. This lines are there to show you if you want to add more concepts to the training :)

  • @onejatt
    @onejatt Рік тому +1

    Hey bro nice video i m also learning ai and we can make a community research and generate ai arts and explore more if u are interested… contact me….