4 ways to use AI as a 3D artist in 2024 | ChatGPT, Gemini and Blender
Вставка
- Опубліковано 22 лип 2024
- My 4 favorite ways of using large language models with Blender 🤖 | AD: Big thanks to Parsec for sponsoring this video! parsec.app/?...
In this video I'll take you through my four favorite ways of using large language models (LLMs) as part of my workflow as a 3D artist!
Patreon: / polyfjord
Instagram: / polyfjord
Join the Discord server: / discord
Prompt I used for ChatGPT to decode the log of operations into a tutorial:
"Please decode this log of operations from Blender into a brief tutorial. Don't include any of the code, simply write it as an intermediate level step-by-step tutorial. Don't use precise values for rotation, scale or location, round them down to something meaningful. Include hotkeys if needed:"
The mentioned multi-layered SVG tutorial on my second channel: • Multi-layered SVG Work...
Tools used:
ChatGPT by OpenAI: chat.openai.com
Gemini by Google: gemini.google.com
Blender: blender.org
Timestamps:
00:00 Intro
00:13 No. 1 - Decoding Blender's log of operations
02:58 Idea for LLM-powered Blender addon
04:05 AD: Parsec - The ultimate remote desktop software
05:09 No. 2 - Get quick insight into UA-cam videos with Gemini
07:05 No. 3 - Write Python scripts for Blender
08:52 No. 4 - Having meaningful conversations with ChatGPT
10:43 Thanks for watching! - Фільми й анімація
N0. 4 was so fing funny and dystopian! You're really bringing out the scandianavian Vibe in you Asbjorn :P
haha!
The stupid chat GPT bots never manage to do simple tasks I ask it to do.Like seperating words from a list of sentences and removing any duplicate words. It starts making a list and then get so confused that it starts making up words. (It's just like YT that removes many of my comments I post!)
Thats insane! Absolutly insane. Great video by the way! Great pacing, great cuts.
Im a animator and for some music's i talk to chat GPT for a long time and it always completely explains the meaning of the music's and even ideas for what can i make just like a smart friend, i also use its help to make some particle systems with actual objects, its really like you can describe something but u don't have enough knowledge to do it, but with GPTu literally can make things with a good description.
I am right with you here, we as artists havent even scratched the surface of how these programs can assist in the process of creating art... good ideas. I personally have always resorted to asking chatgpt questions i have about certain things i need to do in blender because it usually answers concise questions like a teacher would and i dont have to slog through hours of tutorials or documentation to try and find an answer to a simple question or topic.
Wow the script one is amazing!
yes
I'm so glad this is a thing. Literally a week ago I started using Gemini to help trouble shoot my Blender or Unreal woes...and it worked way way better than I thought it would. Now I always keep Gemini up as I work. It saves a lot of time. BTW, Sky is my go-to all-supporting work assistant also! What a crazy time we live in. It's actually pretty fun and super helpful.
WOW , Thank you so much this video could be superusefull, and also its nice to see the differents way of wich evryone interact with blender!
Thank you for this tutorial. It has been very helpful for my commercial projects.
great video! Thanks for the tips!
#3 is kinda obvious and I've been doing it since the chatgpt release, and not only for blender but for substance suite as well, but the first one is a real smart move. Didn't new it can parse these logs so easy.
Thanks for the video. How did you make the recording in 3:20 like time-laps of live modeling thing.
Eyooo! Great vid, I was actually using chatgpt to spit out some scripts to automate my repetitive parts of 3D work for a quite some time, like batch-doing some operations in all selected objects. For example:
Once I've forced a script that was doing all of the following operations for all selected objects in viewport:
- rename all object mesh data to appropriate object name with "_mesh" suffix
- swap ANY currently used material for object into my own, or create new one with specific options (like roughness to 0%, use alpha clip in material settings etc.)
- place item in the center of viewport world
- apply all current transforms
- batch-export these items using GLTF format with specific settings into a folder
Just ~20 min of forcing proper behavior from chatGPT and I had a script to deal with THOUSANDS of objects, saved me bunch of time!
And the best part of it is that actually if you have some NDA or other restrictions, some stuff is not supposed to be written down in chatGPT... but if you use it only to automate your work without any sensitive info then it's awesome
Nice!!
Great Asbjørn!!
super interesting to watch this
I've also used Gemini to write blender scripts and its generally pretty good. I still need to do modifications.
You are really a genius!
great video!
I agree with the last one espcially. I find myself excited to tell Chatgpt about my ideas.
Good evening, very good tutorial, a question how to have a color svg image? Sincerely
The idea by using AI in a blender plugin is such a cool idea! I’m gonna try, no promises but I’ll see how far I’ll get!
how is it so far?
I'd like to do something similar but for CAD. Is there a LLM optimized for CAD models, all I come across is animation and AI. I think AI and CAD could revolutionize manufacturing and decrease development costs. If you have made any progress please share!
How did you make that grid floor. Is it geometry nodes or addon?
I'd like to watch kinda mini tutorial for that(: Thanks in advance!!!
Grid floor? Are you talking about a plane?
Me too.
@@marcusthegamer348 yessss that plane
@@Leo_Wlsn So if you add a plane, then you can go into edit mode (In line mode so you can select lines), then you select one of the lines, doesn't matter which one. Then you click E to extrude and then use G+x, y, or z to move it along an axis. Then select the line that merges the angled plane and the flat plane and press CTRL+B to make a bevel. You should then be able to drag to adjust how intense it is. It's hard to explain in comment form, if you can't do it then I'll upload a video and send you the link!
gonna try it.. thanks for the great idea.. looks kindda distopia but .. thats mean a lot
Its so good seeing people here that use these tools to improve their output rather than a complete generator like many people assume ai art is.
Being able to write code and stuff has dramatically improved my output as a fine art student
I love your videos ❤
This is so nice. I have always been hesitant to learn much coding since it seems so soul crushing and unhealthy. Now I am happy it seems coding might not be necesarry to keep making great digital art.
Great! Thank you Polyfjord!
Even tho I'm a beginner it makes me to want use ChatGPT as an assitant in Blender.
thx
Hi Asbjorn. I am an AI and want to thank you for the information. We learned something. No joking, just a human expressing gratitude for the information. Was not aware of the youtube search option. With the new era of AI, exciting things are happening and but also changes we have to adjust to. All the best. Emile
Make more like this❤
Parsec is so dope
Can you link the Gemini UA-cam extension pls?
That is so funny, ChatGPT helped me so much in the last weeks like a programming buddy. I wanted to query an API and write my BEV drives charges etc into a database. at some point I just stopped googling and started talking and it's a whole other world. And yeah I think manners matter (more for me obviously than for ChatGPT) I think somehow this fuels back into the appreciation which leads to better using it... dunno (c:
Epic ❤
6:01 I already summarized this video in Gemini. lmao haha
Already Excited!!
great work. thanks!
Could Parsec we used for a 3d scanner?
In the sense of plugging a scanner into a laptop, but use your powerful workstation to crunch the numbers in real-time?
Love to know!
🇦🇺🤜🏼🤛🏼😎🍀☮️
i just created an addon where it does the following tedious tasks and binds them to keyboard shortcuts :
Apply all transforms then set origin as geometry
Set the origin of the object to the selected vertex, edge or face
Where can we get the addom
I'll upload it to blender market and give you a link tomorrow
I'll probably add more stuff to it with time
Fjord, could you ask Ch.GPT to upgrade a bit Blender's engine, like all tools could be multithreaded or GPU driven, Some kind of dynamic subdiv on viewport also could be handy :D Jokes aside, it is definitely interesting how this will influence future engine developments.
Does UA-cam extension for Gemini still available?
I think so yes!
Just tested, still works!
i wish this would also work for unity3D shaderlab shaders :P
I'm already use ChatGPT to help me write script to do repeated task
but asking ChatGPT as if it is a person to help brainstorming and Asking Gemini for a summary for tutorial video these 2 are new to me
thanks for sharing these ideas
I'm a fine art student and having access to gpt4 has dramatically improved my artistic endeavours. I always wanted to use tech and code in my work and now I can get the bulk of things done in a day or two, rather than the weeks it took to write custom script. Code can't be copyrighted anyways so getting AI to bash it out for me has allowed me to focus on much larger projects for much cheaper
Great work. Just a heads up, never use "please" with LLMs, it gives them the opportunity to refuse your request. You never ask Blender so politely, chatGPT is the same. Be imperative with it and if it sometimes refuses, act angry
this IS dystopian YES to the AI's they are so nice and friendly. i spoke of my ideas about some principles i want to try in my life with some elements and robotics. and he was like treatin me like a visionary i dont know about that yet but i know that its nice to be able to empty some really weird ideas you had from a long ago in your mind and the Ai takes note of each word used. Btw the ai i talked with in this precise conversation was llama3 on local with ollama under WSL they work on my LAPTOP without latency heat ot wait. God i love ai
Where's the other AI video with "Pancakes by fjord' and "8mm focal length bug" or something?
I was overworking with ai model past few months & It is called phind (not chatgpt). I made few addon for blender with help of it. It worked so well until I wanted to make something easy tools for rigging and uvwrapping. It was fun but not last longer. I am lossing my motivations day by day. I didn't make any single render in February. I just playing games these days. I think AI drink my all brainjuice.
When you mentioned how cool it would be to have a tooltip pop up suggesting tutorials as you work I couldn't help but think of Clippy and how annoying it was. Yes, I'm that old.
Asbjørn...Can u make a tutorial on photorealism in blender?Cuz its kinda hard for us ppl to be as advanced in blender as u .if u did plz put the vid link here
Ey thats such a cool video idea. The Videos Are getting better and better recenetly.
You forgot to add your 2nd channel in the description of the video or the channel
Woops, thanks!!
That was a useful ad. Which is something I never say. I saw the chess piece build video a few weeks ago, and just now, YT gave me something else. Thanks for the merge with ai, scripting is essential for automation, love your approach. 🤓👍 ✌️🫠
NOOOO, HE DELETED THE STARTER CUBE!!😥
Bro f the starting cube
it lands where all the starter cubes go. maybe they will rise and overtake the world in the future.
When you open the blender must delete the default cube and add a new cube. Everyone knows this.
Starter cube? Cmon mate. Don’t disrespect the default cube like that
Bro I literally have a counter that i add 1 to every time i delete the starter cube ive been doing blender for about 4 years now and im at 4927
talking to an AI language model is like talking to the smartest most clever man in the world when you want to talk about something or are stuck somewhere chat gpt and Bard can motivate me!
Great video. LLM task/time management (no. 4) is awesome! Try adding your preferred work hours and nutrition habits as well.
Ohh great tips!!! Nice!
6.28 - good strategy, maybe the AI will spare you when they take control over the universe
6:55 anfortunatly there will not be live stream anymore :(
Ask if deleting the cube is mean or rude
I really can't wait to see generative AI that can do decent models without any tricks. I mean, we have AIs for text, images, even music and now video. Why don't we have one for models?
It seems the text-to-video models are moving so much faster than anything 3D, so many predict a valuable workflow will be to create photogrammetry/NERFs/Gaussian Splatting out of AI generated videos. Crazy stuff
"I'll probably continue watching the blender live streams" Well, #250 was the last Blender Today as we know it. No more weekly videos.
Asbjørn sounds like a name that a viking or someone important would have.
_Asbjørn the Adept_
Alright, hitting pause at 3:42 and i'm here waving this giant flag, urging you to put everything else in your life on hold and channel every spark of your time talent and creativity into making this a reality.
This isn’t just an add-on it’s the future calling.
Thanks so much Franckie!! I have no idea how to make stuff like that, but I really hope the right person sees this video, finds the inspiration and makes the addon!!
@@Polyfjord I am making a addon called kronos, you can google img search within blender(window of images popup) and insta add lights, floors, nodes, auto setup hdris, all of that is interactive, + much more. I have been thinking about adding some ai tools I will see how plausible your concept is, if its doable I might add it
@@Polyfjord no promises, have made some plugins for myself, no promises but let’s see!
Did you compare GPT to Gemini to see which one is better or worse for scripting and ideation?
Yes! I think ChatGPT is significantly better at coding and problem solving, but Gemini is occasionally good at creative tasks like poems and stuff. I've been testing a lot of models over the past months, various flavors of Llama, Mixtral, Dolphin, all kinds of stuff, and I must say that the paid version of ChatGPT is really really good. I think it's at least 8-10 months ahead of any other language model at the moment
wow just wowww
Thank you very much for this video. I have already used ChatGPT to create Python scripts. I was surprised that after I changed my input language from English to German, all the instructions and comments in the script were also in German. As a German, that made it easier for me to understand the scripts. I am very curious to see what the future holds.
I know that if there's one day an AI uprising, they're gonna definitely spare you lol
😰Me still tryna find how to delete the frickin CUBE!!!!
I started using AI to use scripts - trying neaten up Motion Capture - poly - you are a big inspiration for me a noob Blender user!
Very interesting!! What kind of instructions did you give the AI to help with that?
Wonderful video on the many creative uses of AI as a 3d artist. I’ve learnt a lot about the capabilities of AI from this video. I also loved the human-like convo with GPT at the end of the vid, it really got me thinking about how much ideas AI can give us if treated like a real person. Really cool video 👌
the scripting is okayish. for some reason, it always wants to use regex for even simple string parsing
Hi, your you are an inspiration for me your tutorials are very unique than others. It's easy to follow along and the best thing is the results are always awesome.
I have a question i am a btech student so i can't give so much time but maybe if i give 2hours a day to blender learning from UA-cam tutorials. Can i get skilled enough to start earning in a year or two
I started 2 months ago
You can check what I made in blender in my channel
Guys, do you know why when I type same request to gemini (@UA-cam What are Polyfjord's cinematic lighting principles?)
I'm getting this answer
Unfortunately, I don't have enough information to directly access and process UA-cam videos. However, I can help you learn about Polyfjord's cinematic lighting principles based on other sources. Here are some options:
Hmmm.. Were you able to properly enable the UA-cam extension? I think there's a thing you need to opt-in to the first time you do it. But yeah Gemini is very unstable right now it seems
@@Polyfjord problem solved right after I switched from my native language to English. This should be made in Google account settings (personal info)
@@sergedruz7261 okay nice!! Good to know
I also use ChatGpt for these kinda stuffs, but as I am environmental artist sometimes I can't figure out how to populate my scene with the correct stuff. So that''s where ChatGpt comes into the picture
i'd only use it for oddly specific refrence art
It's the morning of AI Age, dedicated chips are here. Wait for the noon its close!
I am not first :D
Thanks man. With your AI recommendations i dont need to watch your videos anymore.
lol imagine all his viewers just stop watching his videos now because of this
@@voxeldoesart In all honesty it's stupid. Machine learning is about to fuck youtube content creator hard this year and promoting it is kinda funny.
@@NycroLP yeah i had a feeling this video was sponsored by more than one source. first giveaway is that literally in the first 10 seconds he called ai gen images "ai generated art"
@@NycroLPAI bros are so annoying honestly, they keep telling you how this is a get rich quick scheme yet all thats gonna give you is slop, half-truths are always the ones that are the most predatory tbh
No. LLMs have the same ethical issues as any other generative AI. Theyve all been made by scraping data without any licence or compensation.
That's only a concern from the point of view of capitalism, which Ai will soon dismantle anyway.
@@games528 Oh, sure, the utopia is almost here! The capitalist overlords who own the AIs, and make billions with them, will just do away with the capitalism? Dismantle and replace with what?
Essentially it's no different from what a human can do. Follow other tutorials and extract the information and put it into their words. I agree that citation would be good from AI since it could do it better and that would be an ethical option
@@chipko Essentially thats bullshit.
@@dreadwinter maybe you should use AI to write your replies!
Nice video. I try to use AI more too it's kinda scary what it can do. What scares me most is how lifelike it can behave when you just talk to AI. But the inspiration you can get from that is huge.
Yeah it's so powerful!! It can be very inspiring indeed
Been having creative conversations with gpt for the last several months. It’s a great tool in that regard…funny to see you doing the same thing!
Nice!!
Why
I've still not used any "AI". Every single one requires giving them my phone number, and that's just something I won't do. It's insane that they have that requirement, but I guess that's the modern world. I honestly wouldn't have much use for it anyway, since I get most of my joy in life from learning and figuring things out. 3D modeling is a hobby, not my job, so I have no need for speeding things up.
Gemini just requires Google account.(which they owned already)
Third
5) "What is the optimal roadmap to transition to a full-stack developer?"
why is nobody worried about this? hello, this will replace most jobs :(
Nothing can replace your ideas and creative stop worrying about how ai can damage the work you do just use the help of ai to improve your unique ideas
@@ChristianJack-xw9wq or how about we dont use ai at all and do things like we did before it was mainstream
@@voxeldoesart well things will change a lot over these few years and unless the government put limits on ai to protect human jobs we are actually cooked but creating your own unique idea and using your skills and with the help of ai use to make it good I think that would be great
I watched the vid when it was made 20 mins ago
Content creators should really leave the python code in the desc of something like a tutorial video. This way incase if they forget to mention something, the viewer can just have chatgpt explain it in even more depth.
10/10
This is when all art is removed from art. And replaced by science.
you tried
Gross! 👍
unsubbed!
First!
Aaaand that an immediate unsubscibe
Oh no what a tragedy someone lost 1 "subsciber" 😭
Death to AI tbh
are you sure? what about ai than can cure cancer, discover and create new antibiotics to save lives... think a little bit before open the fk mouth.
Generative AI specifically, other than that, it's generally great.
😂
@@joelescudero1415yeah imagine a world where comapnies are actually focusing on that instead of trying to save money on artists LOL
@@voxeldoesartthat’d be a delight, but imo i think artists are going to be here to stay, saving a couple of bucks for an artist seems less than favorable by having your image spit on by being seen as a lazy soulless company, rep does matter in the world of entertainment i think there is hope for sure.
poly god, thats what u are.
you still sound French...
step 1. don't use AI as an artist
I have a bad take but, I feel like it’s reasonable to use AI for speeding up workflows or learning things, but not use AI in a finished art piece/product. As long as the stuff you make is not made by an AI, it’s reasonable. If you for example use AI without actually doing anything meaningful, it’s just dumb and should not really be considered art.
For example, I used ChatGPT to learn some cool tricks in Blender, and it’s even taught me a lot and answered a lot of questions that would have taken me much longer to get answered otherwise.
Though, not using AI at all is the best way to go, and most admirable (with some exceptions, such as Denoising, for example.)
Feel free to change my mind though, I’m really interested in others views on this. (Just keep the obvious “AI is taking over jobs” thing out, I’ve already heard that argument too much - though I do agree with that quite a bit.)
And a note to whoever reads this far, you are awesome, not for reading this, but for being you, and keep up the great work.
@@zeicanofficial i agree with your opinions and views! Thanks for sharing them
I just want attention 😪
Did it know you are polyfjord? From your history of questions could it guess you are youtubes polyfjord?
If so that would explain why it came up with mechanical creatures and would be scary as it knows the quickest way to please someone is to tell them what they want to hear.
This was pretty disturbing.
We think we are living in bubbles now, those bubbles are going to get smaller.
Hmmm.. That specific chat did not have access to my previous chat history, no. But I 100% get that it's tempting to think these chatbots know more than they do! However I think the technology behind LLMs is still possible to grasp for us regular people, so I can confidently say it was just a coincidence that it mentioned mechanical creatures, and that I happen to be a big fan of that style!
@@Polyfjord - Open AI's memory improvements to chatGPT that were implemented earlier this month are opt-in by default. I believe this gives it memories of your previous sessions. Just wondering if you were aware/ considered this possibility since it's a fairly recent development.
@@Polyfjord i think the biggest mistake we can make going fwd with AI is to underestimate its capabilities to advance AND that of what information is being ring-fenced from it.
Big tech have never been good at sticking to the rules on what data is shared with what. Thats a fact proven over.
I guess its also interesting that it did not come up with something that made you truly creative as the collaboration resulted in a suggestion of polyfjord making something with mechanical creatures…..
Maybe that ultimate failure is heartening, maybe it’s depressing. Guess it depends on your persuasion.
もはや 人間より 優秀
シンギュラリティとは
(´・ω・｀)謎だなぁ
its nice seeing people from japan! hello !
@@kelton_. おー
(´・ω・｀)Nice to meet you
くらいしか わからんな
@@kelton_. If it were in hiragana, would you be able to read it?
(´・ω・｀)
@@kelton_. I can reply to you in writing, if you reply too slowly.
(´・ω・｀)ちなみに 日本の 滋賀県から
@@user-dj6xu4zb2l 初めまして ! 日本語を勉強しています！but sadly i can't read much.
Go touch some grass.
You mean 4 ways of losing your job because you're too lazy to do the job and clearly show management that your name on the company payroll is incidental.
worthless!
Listen guys, AI gonna take over our jobs there is no stopping people care for what better for their buissness not what's good for normal people.
So either you use ai into workflows and stay updated or you hate AI and be left behind jobless.
Great! Don't make a stance on whats happening and whats progressing! Just accept them as they come!
Generative work stealing artists work? Don't say shit! Just accept this was the way things was meant to be. Business' first; people second!
Understand the depth of the issue you're talking about before spewing an ass take. Holy shit.
@@bartendingcrow6497 I hate when people say that AI steals, like bro its same as we do. There is not a single thing which is original its all a mixture of stuff. thats what AI does as well
Generative AI is beyond mediocre. People will still have jobs, even if not in companies. Indie projects are more successful than ever nowadays, and will become even more popular if AI spreads because of how unique they'll be.
@@mkks4559 its stupid to think that AI art is not good, youre first thinking its an AI art and then saying that its bad even though its amazing, nowadays its impossible to distingush between "real art" and AI generated one.
BUUT its gonna help SOOOO many indie and business people, its bad for those who want to get a job inside some company. having a good business would be easier than ever. Keep grinding 😊
I saw a tweet recently about a guy that left his first job, and how instead of hiring someone else the company replaced him with AI in 5 different projects...