Download Prompt styles: www.patreon.com/posts/sebs-hilis-79649068 Please support me on Patreon for early access videos. It will also help me keep creating these guides: www.patreon.com/sebastiankamph
@@losttoothbrush Open source just means people can access the source code and therefore add to the tool. Being open source is not directly contributing to the "stealing" issue. Although indirectly it can make it more accessable. In the end it's a tool and I'd argue what you make with it may be transformative work or not.
@@losttoothbrush Well, yknow, if we are gonna steal art, at least make it public and for everyone instead for one big corpo having the goods, hell yea brotha
As a Drawing Teacher of having 33 years of experience of teaching school kids how to draw and paint, One thing for sure....AI can not replace human creativity but I must say this will surely help so many people with poor drawing skill to unleash their creative thoughts and imagination! which for a teacher like me gives immense hope of revolution in Arts! Thanks for such an easy and helpful tutorial on this topic!
@@ClanBez Same, I see possibility to work on multiple projects as a designer. Tedious parts of process are getting automated. Super excited keep exploring!! Will get more time for vacation, well I hope!🤞 PS: In my area, high school art teacher is referred to as Drawing teacher and College art teachers are referred to as Art teachers. Yeah it's little weird.
honestly refreshing to see some people be so open minded to this. AI art is often viewed as a job killer but i mean honestly speaking look at so many incidents from the past. When digital art first started i'm sure millions of artists who worked hard with paint, and pencils and ink and every other form of real life art, felt threatened by it. Why pay a guy to paint a logo for you, when you can use a paint tool? Among so many other stuff. But look what happened now, digital art is so common now because its quicker, cheaper and more flexible. If you made a mistake in a real life painting, you didn't have an undo button or an eraser. Just like digital art gave so many new individuals a chance to make art, so too is ai, its all on how you use it
People feel threatened because a lot of artists still lives from comissions (Btw, they aren't wrong for doing that, it's "easy money"). When you're a teacher in an art school it's easy for you to not be threatened by AI art. Don't get me wrong, I'm not here to sound mad or anything, I'm just saying the truth. I agree AI art will revolutionize the way we think about creativity and I also think it won't destroy art (At least not completely), people will still have their community of non AI art. But it's undeniable, AI art has tons of legal issues and the AI is pretty bad right now. Very rarely I wasn't able to spot if an art was AI or not.
@@viquietentakelliebe2561 How can u enhance a skill ur not practising? drawing a squiggle then letting ai complete the work based off actual artist's work isn't YOUR imagination or skill and u still learn nothing. ur not doing any of the work the ai is
If you want to use the source image as ControlNet image, you don't have to load the ControlNet image separately (it will automatically pick the source image when no image is selected). Saves some time. 🙂
@@Naundob img2img gives you way less control, basically you pick "denoising strength" which at 0.5 basically tells AI "this is a 50% done txt2img image, half way between random noise and desired result, continue working on it until the end" so you have to look for golden middle between your image not changing at all and changing way too much. Controlnet can be used both in txt2img and img2img and it has many powerful features like drawing very accurate poses, keeping lineart intact and turning simple scribbles into actual art (where with normal img2img you'd end up with either an ugly result or one that doesn't resemble the doodle almost at all)
man you are incredible! so good and simple, i installed stable diffusion with one of your videos, and now im ready to install control net. i am officially your fan!! thanks for everything!! greetings from corfu greece
Thank you, this is really helpful. My "pencil sketch of a ballerina" had three arms and no head, but eventually I generated something usable. It's all absolutely fascinating and it's been fun to learn over the past week or so.
@@sebastiankamph I'm going to get a new hd after work today. 2tb or so. My stable diffusion folder is 500gb. I'm also a little nervous since I have an AMD card I'm not sure if this will work on the CPU, but I'm working on building a new computer soon.
Since I've been playing with ControlNet I am in a constant state of awe and disbelief😮 Truly game changing. What I really like is the possibility of rendering higher resolution images with that much control. Does anyone have a tip on applying a certain color scheme when using ControlNet? Probably something we have to wait for until the next SD revolution hits. So roughly 5 days.. (me making sounds of pure excitement and slight fatigue at the same time).
Try using the base picture in the img2img for the colors and tone you want, use a de-noising strength of like 70+, (it can be of a completely unrelated subject and different aspect ratio) Then set the text prompt to the subject you want. Additionally you can set the base control net image, to the pose and subject your looking for. This is creating a relatively new image however, not color grading an existing one, still, it is an interesting way to control the general vibe and keep consistent colors between renders.
I'm having trouble to get it to work. I'm lost. I tried for example to scribble a poorly drawn dog, prompted "A photorealistic dog"(With openpose, canny, depth) and the only time I got a photorealistic dog was when it outputed a black img, otherwise It just spits out a 3D image of my scribble. Hope that made sense.
The pose algorithm is EXACTLY what I've been looking for. Thanks for this video! Hopefully I'll manage to install it. Last time I tried to use extensions, Stable Diffusion just refused it and I had to reinstall everything, lol. EDOT : Ok, I installed it, and it works! Sadly, the Open Pose model seems... capricious. It often doesn't give me any skull. The Depth Map works wondefully though.
...WOW! ...the next growth spurt of SD...people say AI makes us stupid but i haven't learned so much since AI crashed into my life...Big FANX for keeping us up to date!
AI does and will make people stupid, in the sense they don’t need to learn anything themselves they just ask an AI to do it for them. You are learning because you are interested in it and it is new, once it becomes more prevalent it will most likely stop being open source and people will just be interested in the results, not how it works.
I agree with many things and I think that children should not have access to generative AIs until a certain age ((16?). However, I have no idea how to remove open source software from millions of private PCs (?). My biggest concern is that the AIs will greatly increase the general smartphone addiction. (I don't have one myself and don't want one either). But: I love "painting" and filming in VR... and thanks to the new AIs, I now have the potential of an entire animation studio at my own disposal.... BTW: The absolute nightmare are AIs that develop weapons, toxins, etc. as well as the AI-based mind-reading technology that is already pushing onto the markets...
I'm convinced the future of IA generated picture will be with a mix of 3D models. Like you do a precise pose in 3D and apply stable diffusion on it so that it can have precise informations about depth in the scene and that will achieve true photorealistic render.
I feel silly, but I hadn't tried this yet because I dont have 50 gigabytes of free drive space. It didn't occur to me that I could just install part of them. This is truly amazing stuff, I'm looking forward to seeing how animations look with this tool.
That is really awesome :D Gonna try the scribble! I've been having horrible varied results of deformed humans and I was getting sick of it. Haven't touched SD since. Now this changes! :D
Sabastian, I get this error when I tried typing pip install opencv-python 'pip' is not recognized as an internal or external command, operable program or batch file. Any idea what is wrong?
Thanks for sharing your experience! I'd kind of given up on SD because my computer is way too slow (5-10min to generate a 512x512 Euler a image) but when I came back to the community last week, everyone was creaming their panties over Controlnet and I had no idea why. Thanks to your explanation, now I kind of understand but I guess I'll have to try it myself some day once I can afford a better computer.
Hello Sebastian Kamph, I really like your channel and the way how you talk and make those very comprehensive videos. I learn a lot from you and I thank you very much for that. Pls never change the way of your videos (calm, stabil, precise). Of course I have a question. I am concerned about the pickle files from Illyasviel. Does pickle mean, that it can harm your PC? If yes, what safetensor files can be the alternative? thank you very much and have a nice day. Best Regards
I'm trying to find a way to have SD include character accessories accurately and consistently. Like having a character holding a Gameboy, or some other specific device. Would love to see a video breaking down how to train SD on specific objects, and then how to include those objects in a scene.
Question about SD: I presume you want to set up a repository for data, which suggests a partition on your hard drive. What size should you make said partition, ideally?
Thanks for this well put together tutorial on how to get it going! This is kinda what i was hoping for, turning my b&w line art into ai generated images =D, lotsa scribbles here i come!
ACTUALLY YES!!! the penguin trick is what i need to do stuff like monsters with multiple limbs or animal hybridis for games or dnd !!! other models just freak out or donìt undestand that a dog can have fucking 6 legs and still look like a dog in a fantasy setting !!! this is great if it accepts shitty sketches!!!
I got an error "RuntimeError: mat1 and mat2 shapes cannot be multiplied (154x1024 and 768x320)" What exactly is wrong there? ... Oh, ... do not use 2.1 model(s) with 1.5 ControlNet! That is why is there an error!
The only problem we artists have is that there are people or let's say companies, who sell their AI like Midjourney for money, in that case, it is stolen art. If you just use it for free and sell it for free open source like for everyone, then no one has a problem and it isn't a job killer. I don't know any artists who say it is a job killer, that's nonsense.
Some artists have a job where they take customer scribble as input and they create output based on that. They should be afraid of their job security if they cannot adapt. However, if they learn to use these AI tools, they can increase their throughput maybe 10x or 100x. And they can always tune required parts fully manually if they have the skills to draw the whole image - then AI is just work multiplier and they can output higher quality output than competitors without manual skills. However, going full luddite and avoiding use of AI tools is a no-go.
My question is: Can you give SD a character in the img to img tab and use ControlNet to pose them, thus having a near identical character from the img to img one, just in a different pose?
I find that if you're doodling yourself, lowering the weight of the control net to 0.9-0.95 is better because then the network would add its own thing to your presumably terrible doodle instead of strictly adhering to it
the crazy thing is, AI learning got this good by accessing the collective history of human art, but there is now so much new AI art online that it must be extrapolating from millions of new AI generated images, which is probably why it is progressing so rapidly.
Pretty awesome! 😍 Now I’d like to know if there’s a way to apply these poses to our own custom characters, instead of just random characters. 🤔 Is it possible to pose two of our original characters together? Also, it’s nice that we can copy the pose, but can we also copy facial expressions into our characters?
Yes and yes! 🌟 It might be a little tricky to get exactly what you're looking for though, but it is possible. I would inpaint each character separately to get the original features.
Both! Your Stable diffusion program is not version dependant. It's the actual model .ckpt or .safetensors file that has a version. 1.5 is great for illustrations, while 2.1 does a great job with photorealistic portraits.
Whenever I try to generate anything with for example img2img, it freezes and the generate button doesn't function anymore. Normal txt2img works just fine.
Can you recommend a good ControlNet installation guide for Mac? I've used a few different tutorials, but can't get the program to run properly when it is installed. I want to make sure I'm not missing anything. Thanks!
I dont know what im doing wrong but ControlNet UI isnt even showing up for me and I get this error. Error loading script: controlnet.py Traceback (most recent call last): File "C:\Stable Diffusion\stable-diffusion-webui\modules\scripts.py", line 195, in load_scripts module = script_loading.load_module(scriptfile.path) File "C:\Stable Diffusion\stable-diffusion-webui\modules\script_loading.py", line 13, in load_module exec(compiled, module.__dict__) File "C:\Stable Diffusion\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\controlnet.py", line 17, in from modules.ui_components import ToolButton ModuleNotFoundError: No module named 'modules.ui_components'
@chainreadydefinewsresearch7970 ua-cam.com/video/B_w7eZbdN3U/v-deo.html I just followed this video for a fresh intall and moved all of my models to the new folder and everything worked fine afterwards.
What stable diffusion checkpoint do you recommend? Does it change anything picking a different one apart from the first image generation? Amazing video! Got everything up and running
Is the preprocessor always has to match the controlnet model? I was using it with mostly no preprocessor selected and it seems to still work? I thought it's only an optional thing which allows you to create an additional pass.
Download Prompt styles: www.patreon.com/posts/sebs-hilis-79649068
Please support me on Patreon for early access videos. It will also help me keep creating these guides: www.patreon.com/sebastiankamph
This is the reason that its so important that Stable Diffusion is open source.
I mean its cool yeah, but doesnt it steal art from Artist that way?
it's*
@@losttoothbrush
Open source just means people can access the source code and therefore add to the tool.
Being open source is not directly contributing to the "stealing" issue. Although indirectly it can make it more accessable.
In the end it's a tool and I'd argue what you make with it may be transformative work or not.
People "artists" cling to their prompts like their lives depend on it.
Asking them to share is like squeazing blood from a stone.
@@losttoothbrush Well, yknow, if we are gonna steal art, at least make it public and for everyone instead for one big corpo having the goods, hell yea brotha
As a Drawing Teacher of having 33 years of experience of teaching school kids how to draw and paint, One thing for sure....AI can not replace human creativity but I must say this will surely help so many people with poor drawing skill to unleash their creative thoughts and imagination! which for a teacher like me gives immense hope of revolution in Arts!
Thanks for such an easy and helpful tutorial on this topic!
@@ClanBez Same, I see possibility to work on multiple projects as a designer. Tedious parts of process are getting automated. Super excited keep exploring!! Will get more time for vacation, well I hope!🤞 PS: In my area, high school art teacher is referred to as Drawing teacher and College art teachers are referred to as Art teachers. Yeah it's little weird.
honestly refreshing to see some people be so open minded to this. AI art is often viewed as a job killer but i mean honestly speaking look at so many incidents from the past. When digital art first started i'm sure millions of artists who worked hard with paint, and pencils and ink and every other form of real life art, felt threatened by it.
Why pay a guy to paint a logo for you, when you can use a paint tool? Among so many other stuff.
But look what happened now, digital art is so common now because its quicker, cheaper and more flexible. If you made a mistake in a real life painting, you didn't have an undo button or an eraser.
Just like digital art gave so many new individuals a chance to make art, so too is ai, its all on how you use it
People feel threatened because a lot of artists still lives from comissions (Btw, they aren't wrong for doing that, it's "easy money"). When you're a teacher in an art school it's easy for you to not be threatened by AI art.
Don't get me wrong, I'm not here to sound mad or anything, I'm just saying the truth. I agree AI art will revolutionize the way we think about creativity and I also think it won't destroy art (At least not completely), people will still have their community of non AI art. But it's undeniable, AI art has tons of legal issues and the AI is pretty bad right now. Very rarely I wasn't able to spot if an art was AI or not.
yeah, but it can sure enhance what skill you have yet to acquire or lack the talent for
@@viquietentakelliebe2561 How can u enhance a skill ur not practising? drawing a squiggle then letting ai complete the work based off actual artist's work isn't YOUR imagination or skill and u still learn nothing. ur not doing any of the work the ai is
If you want to use the source image as ControlNet image, you don't have to load the ControlNet image separately (it will automatically pick the source image when no image is selected). Saves some time. 🙂
I wonder why img2img is used at all since ControlNet is meant to do the job now instead of the old img2img algorithm, right?
@@Naundob ControlNet can create from something whereas img2img can create from nothing.
@@superresistant0 Interesting, isn't img2img meant to create a new image from an image instead from nothing?
Please please please finish these arguments... I don't understand what you both talking about hahaahahah. And give conclusion please. Thanksss
@@Naundob img2img gives you way less control, basically you pick "denoising strength" which at 0.5 basically tells AI "this is a 50% done txt2img image, half way between random noise and desired result, continue working on it until the end" so you have to look for golden middle between your image not changing at all and changing way too much. Controlnet can be used both in txt2img and img2img and it has many powerful features like drawing very accurate poses, keeping lineart intact and turning simple scribbles into actual art (where with normal img2img you'd end up with either an ugly result or one that doesn't resemble the doodle almost at all)
man you are incredible! so good and simple, i installed stable diffusion with one of your videos, and now im ready to install control net. i am officially your fan!! thanks for everything!! greetings from corfu greece
Thank you, this is really helpful. My "pencil sketch of a ballerina" had three arms and no head, but eventually I generated something usable. It's all absolutely fascinating and it's been fun to learn over the past week or so.
Glad it was helpful! And we've all struggled with the correct amount of body parts 😅
This is the second best thing right after Ikea Köttbullar
🐴 🍖
Really cool. Things are evolving pretty fast! Thanks
Right? This is moving extremely fast. I'm hyped for what's more to come! 🌟
This looks amazing. My drive is full but I definitely want to play more with this.
Throw away the other models and get this, it's fantastic! If you only have space for one, get the canny model.
@@sebastiankamph I'm going to get a new hd after work today. 2tb or so. My stable diffusion folder is 500gb.
I'm also a little nervous since I have an AMD card I'm not sure if this will work on the CPU, but I'm working on building a new computer soon.
This is probably the most useful thing for SD. Thanks for showing us!
Since I've been playing with ControlNet I am in a constant state of awe and disbelief😮 Truly game changing. What I really like is the possibility of rendering higher resolution images with that much control. Does anyone have a tip on applying a certain color scheme when using ControlNet? Probably something we have to wait for until the next SD revolution hits. So roughly 5 days.. (me making sounds of pure excitement and slight fatigue at the same time).
Hah, I totally feel you. I'm hyped for every new update, and then I look at the list of all the videos I want to do.
Try using the base picture in the img2img for the colors and tone you want, use a de-noising strength of like 70+,
(it can be of a completely unrelated subject and different aspect ratio)
Then set the text prompt to the subject you want. Additionally you can set the base control net image, to the pose and subject your looking for.
This is creating a relatively new image however, not color grading an existing one, still, it is an interesting way to control the general vibe and keep consistent colors between renders.
@@sebastiankamph SEBASTIAN GREAT CHANNLE AND CONTENT, i hacve a doubt this extention work with stable difusion 1.5 models?
@@sergiogonzalez2611 Works with all models, majority of my testing have been on 1.5.
I'm having trouble to get it to work. I'm lost. I tried for example to scribble a poorly drawn dog, prompted "A photorealistic dog"(With openpose, canny, depth) and the only time I got a photorealistic dog was when it outputed a black img, otherwise It just spits out a 3D image of my scribble. Hope that made sense.
The pose algorithm is EXACTLY what I've been looking for. Thanks for this video!
Hopefully I'll manage to install it. Last time I tried to use extensions, Stable Diffusion just refused it and I had to reinstall everything, lol.
EDOT : Ok, I installed it, and it works! Sadly, the Open Pose model seems... capricious. It often doesn't give me any skull. The Depth Map works wondefully though.
This is gold, and Im talking about your video, dude. Really well explained, very detailed, thanks a lot!
Why thank you for the kind words, that's really thoughtful of you 😊🌟
I had Pingu vibes at the end, this is quite an amazing update.
Be so much better when somebody actually puts a proper UI on all of this.
...WOW! ...the next growth spurt of SD...people say AI makes us stupid but i haven't learned so much since AI crashed into my life...Big FANX for keeping us up to date!
So much new information entering our heads 😅 Thanks for the support! 🌟
AI does and will make people stupid, in the sense they don’t need to learn anything themselves they just ask an AI to do it for them. You are learning because you are interested in it and it is new, once it becomes more prevalent it will most likely stop being open source and people will just be interested in the results, not how it works.
I agree with many things and I think that children should not have access to generative AIs until a certain age ((16?). However, I have no idea how to remove open source software from millions of private PCs (?).
My biggest concern is that the AIs will greatly increase the general smartphone addiction.
(I don't have one myself and don't want one either).
But: I love "painting" and filming in VR... and thanks to the new AIs, I now have the potential of an entire animation studio at my own disposal.... BTW:
The absolute nightmare are AIs that develop weapons, toxins, etc. as well as the AI-based mind-reading technology that is already pushing onto the markets...
Brah, your camera is so nice..... Love to see the commitment to your craft. Keep it up fam
controlnet is king from what I can tell.. so far
If you lower the weight to zero it will cost you and arm and a leg. Brilliant! Thanks for Your Video! Definitely Highly Valuable Content.
I'm convinced the future of IA generated picture will be with a mix of 3D models. Like you do a precise pose in 3D and apply stable diffusion on it so that it can have precise informations about depth in the scene and that will achieve true photorealistic render.
You can do that already with ControlNet
This is an AMAZINGLY useful tool. Another big step for A.I art.
Couldn't agree more! Real game changer 🌟🌟🌟
Thanks Seb ! you are my Obiwan Kenobi of ai !
Thank you as always my friend! Your supportive attitude is a national treasure 🌟
Cute. At 10 mins in, note there is an undo button, but no eraser.
I feel silly, but I hadn't tried this yet because I dont have 50 gigabytes of free drive space. It didn't occur to me that I could just install part of them. This is truly amazing stuff, I'm looking forward to seeing how animations look with this tool.
GLORY TO A.I REVOLUTION!!!
That is really awesome :D Gonna try the scribble! I've been having horrible varied results of deformed humans and I was getting sick of it. Haven't touched SD since. Now this changes! :D
"actually, I want the penguin" lmao
For storyboarding this is insane.
I was hoping you'll creating the image from the thumbnail, instead, I got a penguin. lol
it's important to note that to get this to work you HAVE to use SD 1.5 for now, it's possible to use SD 2.1 but it's not fully compatible for now.
great video on controlnet man, thanks a lot !!
Glad you liked it!
Sabastian, I get this error when I tried typing pip install opencv-python 'pip' is not recognized as an internal or external command, operable program or batch file. Any idea what is wrong?
Thanks for sharing your experience! I'd kind of given up on SD because my computer is way too slow (5-10min to generate a 512x512 Euler a image) but when I came back to the community last week, everyone was creaming their panties over Controlnet and I had no idea why. Thanks to your explanation, now I kind of understand but I guess I'll have to try it myself some day once I can afford a better computer.
I feel you! But yeah, ControlNet is WILD!
Hello Sebastian Kamph,
I really like your channel and the way how you talk and make those very comprehensive videos. I learn a lot from you and I thank you very much for that. Pls never change the way of your videos (calm, stabil, precise).
Of course I have a question. I am concerned about the pickle files from Illyasviel. Does pickle mean, that it can harm your PC? If yes, what safetensor files can be the alternative?
thank you very much and have a nice day.
Best Regards
Hey! Thank you! Safetensors are pickle-free and safe, yes. But official files from lllyasviel are safe
I messed with this already... seems like the first step to something amazing!
Another good easy to follow tutorial, thanks Seb 👍
Controlnet is insane. Thanks for the examples
You bet!
Set this up yesterday its pretty amazing
People at Artstation just watching as their careers fade away.
On Civitas there's "extracted" safetensors models of the controlnet models - 700mb instead of 5-7GB each.
One of these days, I will watch a tutorial that before everything in my webui changes. No drawing canvas.
Beautiful images in the thumbnail. Crappy pinguin in the actual video
Check my workflow video if you want the thumbnail art.
I'm trying to find a way to have SD include character accessories accurately and consistently. Like having a character holding a Gameboy, or some other specific device. Would love to see a video breaking down how to train SD on specific objects, and then how to include those objects in a scene.
Installing controlNet !!!! eeeeeek great tutorial so much fun!
Have fun!
I had difficulty cutting through the jargon. thanks man.
Glad I could help 😊
After being so disappointed with Pose, I had much better results with Depth. Thanks!
Great to hear!
ooohhh someone that explain things like should be done. ty
Thank you, that's very kind 😊🌟
The audio is SUPER👌👍
Can you do a tutorial on how to do this in google colab? My GPU cant handle this
I would also love to know this. I know there's a way, but I'm totally lost on trying to figure this stuff out myself.
i would also love it. i cant find any tutorial videos how to do ControlNet in collab in whole youtube.. why nobody shows how to do it. im lost
Question about SD: I presume you want to set up a repository for data, which suggests a partition on your hard drive. What size should you make said partition, ideally?
I was so worried at all the sexy ladies until I saw the old man. Appreciate that.
Thanks for this well put together tutorial on how to get it going!
This is kinda what i was hoping for, turning my b&w line art into ai generated images =D, lotsa scribbles here i come!
thanks for the tutorial ! However I couldn't find the tab "Open drawing canvas"
Thank you for the tutorial - I am not getting the two images when I generate from ControlNet - just the one.
controlnet is amazing.. still trying to figure out the HED model
This is absolutely amazing! Thank you so much!! s2
Thank you for the kind words 😊
This is really a Game Changing feature!!!
Sure is! 🤩💥💫
I was interested in the video but can't deal with the mouth clicks, please try to remove them, easily done with Adobe Audition
I would love to see the specific examples in the video thumbnail be reproduced
ACTUALLY YES!!! the penguin trick is what i need to do stuff like monsters with multiple limbs or animal hybridis for games or dnd !!! other models just freak out or donìt undestand that a dog can have fucking 6 legs and still look like a dog in a fantasy setting !!! this is great if it accepts shitty sketches!!!
You have teached me so much, thank you very much!
Glad to hear that!
having issues with scribble brush color.. seems as if I'm drawing with a white color brush on a white canvas
What GPU do you have? I noticed you generate stuff way faster than I'm able to.
Thanks for the tutorial btw
RTX 3080. You're welcome!
Is this the minute papers guy?
got it working, great video.
that pip gave a fatal error. This one worked fine python -m pip install --upgrade pip
I got an error
"RuntimeError: mat1 and mat2 shapes cannot be multiplied (154x1024 and 768x320)"
What exactly is wrong there?
...
Oh, ... do not use 2.1 model(s) with 1.5 ControlNet! That is why is there an error!
Thanks for explaining this.
Super helpful content man, thank you for making it.
My pleasure! Glad you enjoyed it 😊
Thanks for this well put together tutorial on how to get it going!👍👍👍👍👍
The only problem we artists have is that there are people or let's say companies, who sell their AI like Midjourney for money, in that case, it is stolen art. If you just use it for free and sell it for free open source like for everyone, then no one has a problem and it isn't a job killer. I don't know any artists who say it is a job killer, that's nonsense.
Some artists have a job where they take customer scribble as input and they create output based on that. They should be afraid of their job security if they cannot adapt. However, if they learn to use these AI tools, they can increase their throughput maybe 10x or 100x. And they can always tune required parts fully manually if they have the skills to draw the whole image - then AI is just work multiplier and they can output higher quality output than competitors without manual skills.
However, going full luddite and avoiding use of AI tools is a no-go.
My question is: Can you give SD a character in the img to img tab and use ControlNet to pose them, thus having a near identical character from the img to img one, just in a different pose?
I would like to know the answer to this too
I find that if you're doodling yourself, lowering the weight of the control net to 0.9-0.95 is better because then the network would add its own thing to your presumably terrible doodle instead of strictly adhering to it
Good insight! I mostly go between 0.5-1 depending on the image.
the crazy thing is, AI learning got this good by accessing the collective history of human art, but there is now so much new AI art online that it must be extrapolating from millions of new AI generated images, which is probably why it is progressing so rapidly.
What is interesting is that I need the opposite, I need that coloring page lineart from the beginning :D LOL
I'll tell you a secret, that was the hardest part when I played around with this! 😅 But you can still use photos as references.
amazing video, thanks!
Pretty awesome! 😍 Now I’d like to know if there’s a way to apply these poses to our own custom characters, instead of just random characters. 🤔
Is it possible to pose two of our original characters together?
Also, it’s nice that we can copy the pose, but can we also copy facial expressions into our characters?
Yes and yes! 🌟 It might be a little tricky to get exactly what you're looking for though, but it is possible. I would inpaint each character separately to get the original features.
This is truly mind-blowing. Thank you for sharing. What version of Stable Diffusion are you using. 1.5 or 2?
Both! Your Stable diffusion program is not version dependant. It's the actual model .ckpt or .safetensors file that has a version. 1.5 is great for illustrations, while 2.1 does a great job with photorealistic portraits.
what do i do if my canvas won't show any marks even after inverting the preprocessor?
Could do also provide guides of installations for MacOS as well?!!
perhaps a bit late but diffusionbee, it just got it all
i dont get why this guy has only 13K followers.
Looks like humans prefer to follow incompetents instead of who deserve
Fact: Your presence here deserves the Nobel Prize. Keep being you, superstar 🌟
another great video!
Glad you enjoyed it!
thanks alot. only works with 1.5 tough. but i found out, so all good:)
How did you do it?
Very helpful.. Thank you!
There is literally NO reason why we cant have a fully animated lord of the rings unnabridged.....90 percent of the work is done!
I am following the tutorial, but why my controlnet is for videos ?
Whenever I try to generate anything with for example img2img, it freezes and the generate button doesn't function anymore. Normal txt2img works just fine.
This doesn't work for me sadly. I just get random pictures and no sketches of it
Great video thank you brother!
Can you recommend a good ControlNet installation guide for Mac? I've used a few different tutorials, but can't get the program to run properly when it is installed. I want to make sure I'm not missing anything. Thanks!
I dont know what im doing wrong but ControlNet UI isnt even showing up for me and I get this error.
Error loading script: controlnet.py
Traceback (most recent call last):
File "C:\Stable Diffusion\stable-diffusion-webui\modules\scripts.py", line 195, in load_scripts
module = script_loading.load_module(scriptfile.path)
File "C:\Stable Diffusion\stable-diffusion-webui\modules\script_loading.py", line 13, in load_module
exec(compiled, module.__dict__)
File "C:\Stable Diffusion\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\controlnet.py", line 17, in
from modules.ui_components import ToolButton
ModuleNotFoundError: No module named 'modules.ui_components'
I'm having same issue... installed extension, but doesn't show up under text2image or img2img
@chainreadydefinewsresearch7970 ua-cam.com/video/B_w7eZbdN3U/v-deo.html
I just followed this video for a fresh intall and moved all of my models to the new folder and everything worked fine afterwards.
What stable diffusion checkpoint do you recommend? Does it change anything picking a different one apart from the first image generation?
Amazing video! Got everything up and running
I've been playing a lot with Dreamshaper and variants of Protogen lately, but there are a lot of good ones out there.
Thank you for this mate
Happy to help! 🌟
another awesome video. Thanks!
Glad you enjoyed it! 🌟
Can't wait to pair my 5950X with a RTX 4090 :D
Vroom.
Can you change fashion celebriti?
Fantastic! thanks for the tutorial! let's play!
Have fun! Good to see you again Gerard 💫
Is the preprocessor always has to match the controlnet model? I was using it with mostly no preprocessor selected and it seems to still work? I thought it's only an optional thing which allows you to create an additional pass.
HI! Very useful video i got intrigued but how to do it all in Google Colab especially the first steps in "Command Prompt" or cnd, is it possible?
Does this have to be on windows? Can it be installed on Mac?