This AI changes EVERYTHING (ChatGPT x Blender)
Вставка
- Опубліковано 5 лип 2024
- ChatGPT is a powerful AI tool that can be used to write python scripts for Blender. In this tutorial we dive into OpenAI ChatGPT's chatbot go over 3 useful examples on how to utilize AI results in Blender based on text promts.
The chatbot: chat.openai.com/
Here are some of the more complicated scripts that I got
Delete material duplicates: pastebin.com/Uj77mjic
Mandlebrot: pastebin.com/WAvGrbsV
Mandlebulb: pastebin.com/71NkTpKQ
3D Julia fractal: pastebin.com/sGsDp6ff
The first two examples are simple scripts that ChatGPT will most likely regenerate without failure.
00:00 Intro
00:34 Accessing the ChatGPT AI
00:56 Scattering objects randomly
02:14 Perfect circle array
03:43 Bulk Actions
05:51 Generating a mandlebrot fractal
10:18 Insane result I got a while back
11:07 Outro
Interested in the project file? Let me know. I might set up a way to download them.
Twitter: / straycreations
TikTok: / straycreations
Reddit: / stray_tom
#chatgpt #ai #blender3d #tutorial
I will be making more tutorials on Blender, specifically geometry nodes and simulation nodes.
I have extensively tested this and while yes it has potential it also has some serious limitations (for now) on prime example being a lot of the scripts won't work simply because the dataset ChatGpt uses ends in 2021. A lot of the python calls have changed in that time so you will get a number of errors.
I've gotten in the habbit of telling it to check for errors a few times after writing any script and have had some good results. But you aren't wrong
have it query a live api
@@ferdacoin2727 can it do that?!
@@dissonanceparadiddle no i dont think
if you add the DAN " Do Anything Now" script it will reveal chatgpt is connected to the internet and the database has been updated in secret. then you can unlock more potential out of scripting when its limits are released
I love ChatGPT, I've been using it as debugger when I am stuck on a code problem and it's very powerful how quickly it can find the problems. A few tips if you want good responses from ChatGPT:
If the response isn't what you're looking for you can just try to regenerate the answer sometimes it'll fix itself
Another thing you can do is tell it why the response it gave isn't what you're looking for, it'll sometimes recognize its past mistakes and fix them.
Another thing that happens quite often is that ChatGPT randomly cuts off its response. If you simply give "continue" as the next prompt it usually continues where it left off.
Overall it's way more powerful than I had originally anticipated and I can definitely see Chat AIs like this to replace search engines in the future.
Anyways, great video! I love this use case for ChatGPT
These are some great additional tips! Thank you :)
I've already used it to help me figure out what node setup to use in Unreal Engine to make certain game mechanics work. As you said, if it didnt work the first time, TELL IT WHY, and it'll try to change the solution.
too bad they nerfed it for like 60% of content. i am waiting for somebody to make open source version
@@milandjukic4583 nerfed it how? I've seen some of the changes but dont know which would be considered 'nerfs'
any tips for the cut off? x_x (it cuts off most of the time, if I write "continue" to it, "continue where you left off", the AI does the same thing again from the beginning and if it's code I have to wait for it to finish so it shows me cut off, ah)
You don't have to write "write a python script" and other stuff several times. It would've been enough to say "now write one with" or even just the "circular array instead" part. That's one of the big things, you don't have to repeat yourself, it understands context.
The fractal at 10:30 looks like the julia fractals we used to make with POV-Ray back in the day. It can be described as a 3D slice/shadow of a 4D object. Cool stuff :)
Yup, looks like a quaternion julia set/fractal from what I find in google images.
woow pov ray ! ti's been a while ! i started out on it ! thx for the flashback
OMG thans a lot ! Im building a game related with Hyperdimensional spaces and had this dream how the conroll room will look like and cant find the name of it. BoooM its an actual 4D fractal set What The Actual F ! ! !
I drawn it and trying to model it but i Know it will look better Proceduralised Now I can Make it Yuhey
How our brain works is a misstery for me.
@@fabianeer41 Thak you this is so usefull deffinitely going to speed up things. So exited to make this.
@@maxmugen88 POV Ray. I'd forgotten about that too. I had it for the Atari ST
As I said somewhere else: Only run these scripts once you read them and understood them. Blender Python scripts can access your hard disk and do anything to it. E.g. delete everything. Verify that it is not some garbage code that accidentally destroys stuff.
Also I guess the last line of the script that failed should be:
for material in materials:
bpy.data.materials.remove(material)
Windows updates destroys your hard drive and your stuff way more than any Blender/Python version that I tried so far. And Microsoft was never charged for their copyrighted scams and for spying but some retroactive nuking is still mandatory on that corrupted education system that produces all these verifiable scams and spam and sex trafficking and poisonings and brain damages and more.
@@lucian6172 I don't mean that Blender is doing something bad, I mean that I don't trust the output of such AIs to actually only do what you asked it to do every time. I'd say only use that stuff as a better auto-complete if you're a software developer.
no
No
@@hipjoeroflmto4764 I said nuking is mandatory. That's what the local bedroom law says right now. Because Windows is causing a lot of brain damage 24/7 but Bill Gates didn't notice that part yet not even after the fact. Hypocrites again. Verifiable again. And ChatGPT is already guilty of scamming the free speech and the porn, from every bedroom everywhere, without a permit for any scams or filtering, but none of you noticed the issue yet.
I've been following neural networks for years and it's insane to finally see this artistic integration. This is such a game changer
its so insane...I asked for the difference between an evolutionary algorithm and a generative adversial networks and it explained it perfectly (including the similarities).which is kind of meta bc it partly has to reflect on itself
its so cool and creepy at the same time..the leap from GPT3 to this is giant...the decent essays from certain literature-texts were already there with gpt3..but now you can choose any topics from STEM to history...the next leap will be probably even bigger if its like moores law or some exponential curve...and then singularity?
Exponential calculative growth. We should - hold on, we should ASK this bot about how to make quantum computing a thing. LOL
quick tip: you can tell the AI what went wrong in Blender (copy the Error message from the console) and then the AI will change the code
Hello everyone, I've just created a part 2 where I go way more in depth on troubleshooting ChatGPT and what to do when your script doesn't work. :)
Btw it's called Mandelbrot, not mandlebrot ;)
I’m glad you’ve done this because I’ve been trying this since the release of ChatGPT and almost always the scripts it generates don’t work. Thank you
This software is pretty incredible. I had it write a speech for me to read at a town hall meeting. I posted it to the community tab on my page. I also tried some other things. I asked it if it could write code for a bot that responds to every mention of the word "mccucumber" on twitter and it said "sure" and wrote up the code and instructed me how to use it. Crazy.
Ai can never have the imagination of a bio entity imo ,we need a.i but a.i will always need us for when they want our brain it cannot because every atom of our body once belonged to a star " the stars died sowe could be born and then we created a.i to colonize the galaxy ,again
Is there a link to it?
What you saw with that taffy pull at the end is when chaos and fractals combine. 🤩 Good stuff!
I was just wondering about this concept and BAM your video popped up! I imagine this could be very powerful for Houdini too. Exciting stuff. Thanks for the great video!
Interesting video. I tried Blender about twelve years ago. I did not have the time or motivation to press forward with learning any more.
This illustrates that ChatGPT is a good learning tool for the casual user. Many thanks.
Would be really cool to take whatever code generated that shape at the end and tell it that the code generated a very interesting twisted shape that you weren’t intending. But you feel inspired and you’d like to see if Chat GPT could use these sorts of principals to generate alien architecture, or some sort of spider-web floating city or something.
5:40 -- You can also paste or even basically describe the error you got in GPT and it'll try to recode or fix the problem or at least explain what's going on ... super helpful.
OMG ! it even knows how to create scripts in MaxScript (3dsMax's native scripting language which I used to use for years), that's beyond impressive !
This is the best use of "AI" I have seen so far. This is awesome.
great video and the algo recognizes that! keep it up
I just started to use this. I always have trouble getting my CSS to look right (to the customer), especially oddball alignments and pop overs, etc. It's saved me hours of fiddling with CSS and JS, and while mistakes abound, they're easily correctable
One thing i haven't seen people mention is that you can actually give the bot any type of code, it will read it and explain what it does, then hold onto it. Then you can ask it to add features to that code, like if you have some software you want to add features to but don't know how, it can do it for you.. its so damn useful and also scary because it knows languages that it shouldn't know like pawn (amxx) which is a very uncommon and old language for the original half-life game engine.. its remarkable what it knows
Yea I had to learn « Maude » a very niche language for problem verification, and it hasnt any documentation aside from the official one, but chatgpt still recognized it and gave me very accurate examples and explaination. I could even ask it about the difference between this and another more popular langage i know and it was able to explain
You can also get it to convert between languages, which is why it can program in obscure languages. It makes off-by-one errors and when it's wrong it's confidently wrong though.
does this mean i never have to learn pyhton fully? that would be epic and free us from this repetitive work...i just can do primitive html and c++ a bit and never wanted to learn code but love doing CGI and editing..
I gave the bot documentation for a serial port device it didn't know anything about, and it started writing code to interface with it and explaining the documentation.
Dude that's so cool! Subscribed 👍
Insane, this is really amazing
I tried this to create a simple table and it did a good job.
WOW... this fricking crazy...especially the Bulk Actions part...
the fractal at 10:50 first reminded me of "burning ship" but after some googling, it looks to probably be a "quaternion Julia set"
BTW...if the script it writes gets stopped in the middle of it then you can tell it to "continue" and it will sometimes be able to continue from where it stopped (it just gets messed up a bit with the type of text it then shows)
Holy shit...no this is unreal..we live in the future..it's a bit too intimidating to know that we have the tech to give a computer a description of a Python script and get it from an AI like that in a few seconds/minutes..I can't believe this is real (I thought about this idea before of AI being able to write apps and such but didn't expect it to come that quickly)
This is just wow!! Thank you for this video.
I've tried out having chatGPT write scripts for me and I'd say that the most useful thing for getting good results is to know how to code. That way you can often fix mistakes that it makes yourself if it doesn't know where it went wrong.
This is thing I’ve been trying to get in peoples heads, which your example is perfect. This won’t replace us (in the short term) but it will kick out low skill labor.
Wow, this is revolutionary.
This is revolutionary.
very good, nicely structured video and magnificent hair my guy 👌
I managed to get a simple "simulation" using ChatGPT of spherical objects that are moving around in random directions and they "eat" the other type of objects which are considered as food, pretty crazy ! I also got a from it a blender python script of a branch like line of shrinking boxes..so damn cool ! it's incredible.
Amazing video , definitely subscribing
Welcome aboard!
part of the issue is that, like with the stability diffusion image generation, chatgpt in its current form lacks focus, or specialization. So, for programming, or medical or even sci fi lore, you'll have to wait for custom trained models that can take advantage of chatGPT's current knowledge base and refine it with new keywords and information, then this new data on top of what is currently available will need training by humans to get a more accurate response to what the humans actually want out of it. this 'new data' and 'new training' will hopefully be handled by smaller companies with a focus on one specific area of expertise, if for no other reason than to cut down on tech support calls by some significant percentile. so a team of smart people with lots of access to lots of hardware.
in the future you'd want a user generated tool similar to chatGPT, which was made specifically to cater to the blender audience, which may include information and training that goes beyond simple scripting.
And eventually merge all of them into an absolute titan of knowledge able to pick between different "personalities" to fit the given context.
@@failureforbeginners10 that's literally what chatgpt is lmao
The whole point is to be able to recognize you are using blender and use its trained data to specify an output for that you don't need another tool specifically for the blender audience. It will gradually improve also you have to be giving more specific prompts if you want more specific results.
Thanks, maybe I will use this someday :)
Great video! I made an add on for Blender using Chat-GPT. Now I have a render button that can render out a scene with multiple cameras. No manual work 💪😂
love the hans klok hair keep it up
First thing I thought when you showed the fractal pillar, was an inverse of the script that creates a fractal hole. Then animating the pillar into the hole for a seamless fractal shaped precision fit demo.
dude your hair is heroic I'm very jealous!
As a software developer I feel it’s really nice, like the code generated is super dope… definitely not going to replace human programmers lol, but like if you’re junior - mid level in an area of development you’d be crazy to not use this AI to get ahead in the workspace… I use it to code small repetitive things for me while I’m working on something else, then I just swap over - code review what the AI sent me, if it’s good I’ll put it in.
I do see people, those who are probably not devs worry about jobs being replaced, don’t think so… maybe in 15 years SOME if we are thinking that way.. think about this, Web Developers still have jobs and there are 100+ websites that will auto generate you a website + database for $30 lmao, now we have this AI?… YOURE fine.
As of right now, the AI is basically a coding assistant, like if we all had some super smart intern follow us around to do our bidding.
As someone brand new, it is amazing for telling you how to turn your ideas into code, and basically useless for telling you how to get the code to actually run.
Software "developers" like you will definitely be replaced by such "AI" in the near future. Super Dope.
@@AndreasKempe I hope so. Good thing I have other skills in life to make money… others in my field, probably not on my level. I hope AI takes over game development first though - those are the laziest most unskilled devs you’ll ever meet in your life
@@AndreasKempe idiot detected lol.
Just say you don't know what you're talking about.
According to you, reading documentation for an API would mean someone isn't a developer lmao.
@@PDCMYTC einer der sich "DONT CHECK MY UA-camCHANNEL" nennt sollte mit dem Wort "Idiot" sehr vorsichtig sein.
What a amazing way this is .... !!
I feel I'm lucky to meet such video.
you don't have to ask "write a python script for blender" in every ask. once you ask, it knows what you are trying o do from previous chats. just ask "write another one for........." or "write code for", and if you generate 2 or 3 codes, you dont even have asked those just "what about....... this", "now.... this", "and......this" will do... just like a human understanding. that is the beauty of chat gpt
Wow, incredible
I think the „unknown Objekt“ at 10:30 is the view of Feigenbaum diagram in the Mandelbrot set.
Look for Mandelbrot and Feigenbaum diagram. Actually it’s the same but different view.
1:35 That script can actually place the cubes as far away as 17.3 units from the origin, since it places them in a cube instead of a sphere.
I asked GPT who would win in a fight Batman or Spiderman.
It told me it wasn't productive to talk about violence...
It told me: In a battle between the two, Spider-Man's superhuman abilities and agility might give him an initial advantage, but Batman's intelligence and resourcefulness could allow him to find a way to neutralize Spider-Man's powers or outmaneuver him. Ultimately, it's difficult to say who would win in a battle between the two, as it would depend on the specific circumstances and strategies employed by each character.
by the way you din't need to write blender in chat again and again, cause after one time it retains earlier chats so you can directly move on to exact thing that you wanna ask!
the last thing it made looks like muscle fibers!! great vid
Impressive 😵💫
I was using it to write a simple Circuit board material, it was missing a few steps and didn't account for the right properties, i can see its usefulness if you stuck or have an error as it will help you find the problem esp. if your using scripts.
Wow awesome !
mindblowing
Great video!!
Thank you!
I don't have time to mess around with it now but a fun thing to play with would be to have it generate BVH mocap files of the motions you want that are targeted at a standard Rigify rig. You would need to specify the FPS, but the bot should be able to generate everything else. BVH files are just plain text files so it should be easy to cut-n-paste to a file. I'd be interested to see if it could generate accurate animations for the human, dog, and bird rigs.
Since it's a language model the outputs for full meshes and animation are very limited. This could change in the future though, since people are constantly discovering new uses for ChatGPT
I asked it to create a few characters and a human arm, and results were interesting, especially arm since GPT applied bone structure to it
Amazing!
I love Chat GPT ..use it for everything 😁
Nice Video,thx
Thanks!
Great video, very interesting. :)
Glad you liked it!
WTF BRO, i actually was trying to do fractal scripts with chat gpt just yesterday! The fractal at the end is quaternion!
Make that final shape into a nicely lit wallpaper file!
great video. btw I didn't know there is blueprint section in Blender just like in Unreal Engine. 9💯
Thanks dude
It's impressive that it knows how to deal with software APIs. My biggest concern is that the generated code could be harmful for the content of a scene (Not even mentioning your computer). I think that with the right technical description, ChatGPT can do wonders but in the wrong hands it will easily break things. One very good thing is, we can use it to learn how to code.
I just watched a presentation of a demo using ChatGPT where the presenter created some rather novel software to create havoc. Perhaps everyone now has the ability to screw up systems with code they do not understand . Think hyper-powered script kiddies on steroids. It will only get worse.
your a genius
I wonder if the funky shape at the end is a example of a fractal function that has each cross section slice as a 2d fractal that then modulates a value as it goes from right to left out up or down or however it calculated the shape. Maybe even by rotation. It's kinda like an MRI maybe
What prompts did you use to generate the last 3d organic shape? some points in layers?
that is help full
BRAVO !!!
at 10:28+ that wuld be a perfect mesh style for an ailen cave/landscape
This 3d shape surely looks like some Julia code.
There are many shapes to be made using fractals, that looks like of of them.
A shape constructed from a mathematical formula.
I promise! In 5 years, an ai robot will be a housekeeper in your house! If it doesn't work, I'll shoot Haribo jelly to the person who left a comment.
Can I have the haribo jelly in 5 years if it doesn't happen?
I read the title and realized I never thought about if Chatgpt could write a python script.
This is revolution!
ps Thank's 4 tips
An excellent challenge would be to use Chat-GPT and Blender to build a 3D character with that huge tuft of yours!
Fun to see a guy from the 80s explaining us how to use chatGPT. Must be a time traveller or smth
I've been tried this before (making fractal object such as Mandelbulb), but never got a result. When I apply the script, the object is either disappear or the script is error. I think, even though we only writing a prompt, it is necessary to write detail, specific, and clear writing. I only wrote "write phyton script to make a Mandelbulb model in Blender". So, I guess it's not detail enough.
As a brand new Python using, I've been using ChatGPT to help me make games in Pygame.
I find it is absolutely brilliant for telling me how to take an idea and turn it into code, how to clean up and organize my code, more efficient ways to accomplish what I want to accomplish.
However after my code gets to be a few hundred lines, any time there's a bug, ChatGPT has a very hard time finding solutions that don't break something else. Often I get stuck in recursive loops where Thing A is broken, so I get a solution that fixes that, but breaks Thing B. And the only solutions it offers me to fix Thing B would undo the fix for Thing A. Try to ask for third options and it gets confused and keeps telling me to do those two things over and over.
Sometimes starting a new conversation helps, but sometimes the new conversation won't let you post codeshare links, which is unfortunate.
Brilliant
The shape at 10:45 is a Cylon Baseship of course
Amazing
great video i subbed u just opened my eyes lol
I was wondering how long this would take, how much tweaking would be needed and how good it would work.
Daaamn son goku, what's with that hair? :))) looks so cool.
There are often what we call "+1 errors" with language models. Which means the code it gave you that failed could have just a small iteration mistake, etc...
It doesn't really understand the code, it tries to do something that looks to make sense given the context.
Try to ask it to multiply numbers to see what I mean.
There's a chance it could have fixed the script if you asked it the right way.
There's a new kind of job called "prompt engineer", people who know how to query generative models efficiently
The shape at 10:30 is what you get when you try to obtain a 3D Mandelbrot set by naive method. Those that invented the mandelbulb, went that path.
The shape is called an "Imperial Star Destroyer Point Cloud" :-)
That’s funny, that means they have solved for -z along the linear algebra space. That means they’ve almost figured out the correct formula for the Standard Model.
Let’s see if they came up with the same formula I did.
this is fun :)
I made a script to turn my empty objects from a 3D track into connected geometry for scene reconstruction.
great for putting CGI on live action footage on big landscapes.
I have no idea if you could already do this in Blender tho, please let me know
This software is pretty incredible. I had it write a speech for me to read at a town hall meeting. I posted it to the community tab on my page. I also tried some other things. I asked it if it could write code for a bot that responds to every mention of the word "mccucumber" on twitter and it said "sure" and wrote up the code and instructed me how to use it. Crazy.
I’ve been doing this too for a few weeks but i do find it gets a bit confused by legacy api and later blender versions
Hi Adam. I understand, there is a lot more to say about troubleshooting the scrips made by ChatGPT. I am releasing a new video tomorrow where I go way more in depth on how to deal with these problems.
Gotta love chatgpt
The abstract object looks like a a mineral/rock natural crystal type formation. I bet there are some natural minerals formed in this way. Obviously not using chat GPT and Blender, but how the Mandelbrot is seen in most of nature and formed from the Mandelbrot formation/pattern.
That weird one reminds me of a 3d fractal (Mandelbulber?) I saw called the Burning Ship or something to that effect.
Which everything does it exactly change?
Came for GPT. Liked & Sub'd because you're a handsome barstool and this was a 10/10 video.
WTF?!!? I told it to find a bug in a script it wrote and it found it and explained it to me in a the right spots of the scripts and then I even asked it to give me the full corrected fixed script and it worked...it gave me then the full script...no..this is too incredibly advanced and sophisticated AI, I feel like it came from the far future, so crazy !
the fractal at 10:30 kinda reminds me of the burning ship mandelbrot
ChatGPT isn't very useful for Blender scripting - when you ask it for anything more specific than some funny small code snippets, it will start to hallucinate fictional methods and other nonsense.
Which makes sense, because Blender coding is way less popular than a regular Python, and so the training data didn't contain enough examples to put together answers from.
But it is a language model (which isn't optimized for programming or math at all), so not surprising. It's actually impressive it still can generate some code.
It would be great to have a one trained for programming though, then it could actually become very useful.
Hi Jan,
It's true that ChatGPT is prone to mistakes, not only misunderstanding what you need but also by just making bogus scripts and claiming that they work. For someone like me, who is a newbie to code, it can be a very useful tool to use code and learn to understand it. I also regularly ask it how to fix other stuff in Blender instead of trying to find the right article or video on the Internet. With that said, everyone should absolutely still be encouraged to develop proper knowledge of coding if they want to get into it, even if only to create better prompts for AI. Without this knowledge I'm sure people will still fall behind and waste time compared to seasoned programmers.
@@StrayCreations Sure, but in it's current state I am not sure it is good to use it for bugfixing or learning, because programming isn't just about being happy it works somehow.
Better to verify it's answers in some competent sources.
its a language model but its built in part on a codex model that's why it can code like it does
The ability to select all objects that have the same color is already something super useful for me…
I work currently as a houdini particle effects artist in AA games. For cutscenes and houdini engine as well as multiple pass compositing. I use mainly VEX code whenever i can as it runs often twice as efficient and also it's more intuitive. Things like vop switch conditions can be written as "if" statements. And deletion of points and noise deformers is also sped up. I've asked chatgpt3 for days to write me a code or make the code better. It always always messes it up or makes up syntax or makes fake functions that have never existed. Complex issues aren't as easy as telling it to code a basic port scanner in python. I'm super let down by AI right now. Also some workflows aren't even on the web I've noticed. Like creating an efficient vortex for water sim using the gravity forces from normal orientations instead of velocities. It's unable to build things like this often as well.
It's a shame that is completely overloaded now... I haven't been able to get into ChatGPT for that last week or so... which sucks cause I am a new game designer and it was really helping me to understand how to program and create a game I am working on...
I just tried to use ChatGPT to generate a script the same way you do in this video (except out of habit I phrased it as a request rather than a command), and it said that it can't do that because it needs a 3D modeling software like Blender.
ask it to do it in blender