Make a 3D model from an AI image with FREE tools!
Вставка
- Опубліковано 18 лип 2022
- This video is by request, creating a 3D model from an AI generated image using FREE tools, including BLENDER. This will work with Midjourney, DALL-E 2, Disco Diffusion or any AI image generator. The supporting assets are on Gumroad, including all texture maps, Blender file and STL for 3D printing here:
mcpoly.gumroad.com/l/xhzldp
Part of the right hand side of the video was cropped, but it shouldn't be an issue.
Programs used -
Photopea: www.photopea.com/
ShaderMap 4: shadermap.com/home/
Or, try cpetry.github.io/NormalMap-On...
Blender: www.blender.org/download/
The end result can be exported as an STL for 3D printing in your favourite slicer
Artstation: www.artstation.com/PeteMc - Фільми й анімація
Cool to see the people are starting to understand that AI is a collaborative tool.
For sure
Well this is a very mild example of AI usage
@@Settiis Now you have the tools you need to go WILD
Its the honeymoon period for AI creativity.
Seen as collaborative tool right now. Soon it will take over completely. Its inevitable
@@hrzn202 There's definitely a love affair with it right now. Work with enough though and the current limitations become obvious. I hope to use it as a tool for generating ideas and mutations
It's amazing to see how someone with minimal knowledge of Blender, is able easily create something so beautiful. Especially with no equipment beyond a mouse and keyboard. The combination of AI, and the power of Nodes has drastically increased the accessibility everyday people have for expressing themselves. Truly a wonderful development for art.
Thanks
This will be fun and inspiring.
can you try this using a video game character face?
I've tried this www.artstation.com/blogs/petemc/468w/midjourney-to-3d
If enough people like your comment I could do a video on it.
@@gameartexp I would love a video on it :)
@@chrisgreenwell3404 keep an eye on here or subscribe ;)
That would be amazing my! I’d love to see that tutorial.
@@thegeekclub8810 Ok I think I know what my next video will be
Wow! You got to this free sortware version so fast! I'm super grateful and impressed at your quick turn around. Thanks mate! I'm traveling and can't wait to go thru this video in depth and try this out for myself, I feel like I'm gonna learn a lot.
You're welcome
You are a man sir. You will never be seen as a woman lmao. At least you'll make it to the 41% you sussy baka
It may be not perfect, but you just opened a lot of possibilities! this is so amazing . Thank You !
Nice one Ash!
You are a hero man, for making this tutorial again but with free tools!
Thanks!
Backface selection is enabled by the little icon next to the wireframe selection on the top right corner of the viewport or you can alt left click the selection to get all in that edge.
Great tip Chris, thank you.
Nice! great to see this evolving!
More to come, thank you!
Fascinated at every step. What a great set of tools and information to use them wisely. Thank you very much!
Glad you enjoyed it!
Blimey, I'm really impressed - if you're not really a Blender user you certainly did a cracking job of looking like you were.
I've used it plenty and I still struggle to remember how to find my way around some parts of it.
It helped that i made it in 3DSMax first, so I knew the steps, i just had to locate the Blender equivalents and muddle through :D
Your videos are very comprehensive. Thank you so much for sharing ^^
You're very welcome Lucas, thanks for the kind words.
Imagine if this whole process was automated, wrapped up as a separate software, further developed and improved and monetized. Would be a game changer for multiple industries.
It's getting there, quickly. Would be especially relevant to engines where polycounts are less of an issue, eg. Nanite in UE5
Yeah I want to make a mini for dnd out of an image but man… I’m just not quite up to this level of computer wizardry.
Thank you so much for this video. I mean it. You've broadened my horizons so much with this. I appreciate the time you spent on explaining everything. Big ups mate 👍👍
Glad it was helpful!
one of the best tutorials I have come across
Thanks for the kind words
This is an awesome video with so much information included. Really cool. Thank you!
Glad you liked it!
Great video, im definately going to try this! A little tip is that you can press "U" while in edit mode to see all the unwrap options without having to go all the way up to to top. Another tip is using proportional editing to make the egg a bit easier, and the last tip is that you can press tab to switch between edit mode and object mode. I know this advice is a bit unsolicited, but I just think it could help your viewers, and yourself. :) keep up the amazing work, i learned so much from this video!
I love the tips, I'm a Blender noob, so thank you!
+1 remindme
great stuff, really excited to go try this! Thank you for sharing!
Have fun, thank you!
It's astonishing what you can do with free tools. Great video, you explain very well.
Glad you liked it, thanks
For Midjourney atleast, it is not free, as everybody seems to be pretending. You only get your first 25 images for free. Afterwards you have to pay a subscription fee of 10 or 30$ a month for 200 images and unlimited respectively.
I see a lot of video's have this in common, giving the impression that Midjourney is a free tool. And the weird mindset that you shouldn't take other peoples words, because that is "stealing someones creativity skills", but stealing someones actual work (be it drawing, photosgraph, 3D model, ... ) apparently is not.
@@JustAnotherGamer1005 Just use Stable diffusion...
@@JustAnotherGamer1005 25 tries (with a grid of 4 images in each, so 100 images in total assuming you didn't get what you want 25 times) are more than enough to come up with an alien Faberge egg. As mentioned in the info under the video, this will work with any AI image generator such as Disco Diffusion, Stable Diffusion, Wombo etc. Agreed that there is a level of idiocy around the whole "prompt engineering" thing, I guess people want to hold on to some sort of create input when so much is done for you by the AI.
@@gameartexp Indeed, the Faberge egg was a cool idea. And looking at the result, a surrealistic one also 😄. And for experimentation, those 25 are enough.
But there are people who seem to assume or portray this as a free tool in your workflow. If it's something you need recurring, it's not free anymore.
I've seen a bit of that Stable Diffusion, I think. That one is free, i think?
It's nice too see what AI comes up with. And for indie-devs, this is a great tool that can burden a bit of the load.
Fantastic!!! I can't wait to try this out.
Hope you enjoy it!
This is an incredible resource. Thanks mate
Glad you think so, thanks!
Great video! Very instructive. This has so many possibilities.
Thanks Patrick
Ray Length 10.0 and Ray Spread 0.0002 in Occlusion settings per Shader Map. Should give you a very nice occlusion map to work with!
I will try those settings, thanks for this!
Fantastic content, GAE. I'm new to the channel but this is right up my alley. Now if I can only find all the time to get to this stuff outside my normal 14 hour trucking day, that would be even better. 😂
Welcome aboard! Finding time is the hard part!
Thanks again for this great tutorial. Simple and effective I can't wait to try this!
No worries, hope you enjoy it!
Thank you for this tutorial! You have a great talent! Hope to see more
Thank you! Cheers!
This is a great tutorial. Thank you. My results were not as good but I see this as the start of a journey. Partly my generated egg had a lot of shine and not as much bone. I have now maxed out my mid-journey beta generating a decent egg... so that's another hurdle I'll have to jump.
The input image is key to the detail in the end result, keep refining your prompts, maybe try another AI?
My source assets are here BTW mcpoly.gumroad.com/l/xhzldp
Literally can’t wait to try this. This video is gonna change lives, good sir!
SO MUCH AWESOME! 🔥🔥🔥
Nice one, hope it opens some doors!
Before AI generators, I was already creating images with fractal image generators.
Now I'm very eager to take these and newer images up another level, and maybe even
3D print them! Looking forward to what other creative people will produce!
Big thanks for sharing your insights and methodes for making AI-images come to life.
You're welcome Mark
Fractal noise was huge playground in the 2D and 3D abstract art a lot of techno trance or cyber stuff artwork where made this way in the 90s with a lot of Blue and fluorescent purpose color, but that works for anything that look organic.
Wow, couldn't ask for a clearer explanation of the process. I'm gonna scroll the comments if someone found a way to get Ambiant Occlusion infos for free. Thank you so very much! Great stuff!
Shadermap 4 can bake geometry too, so you could export the egg model back into Shadermap and bake AO. Or, use Blender's baking tools
Nice to see a fellow Irish man stuck into Blender 👍 In the middle of converting an AI image into a game character myself, hopefully finish it tomorrow 🤞
Nice one Ian!
What you do is incredible and really interesting, thanks for sharing it !
Thanks for the kind words, appreciate it👍
@@gameartexp You’re welcome !
Loved this video. I design mechanical parts for 3d printing in Fusion 360. What you just showed blew my mind and seems fairly easy to replicate without much experience with blender. I'm definitely checking out your other videos.
Glad you enjoyed it! Thank you for the kind comments, I hope the tutorial sparks some cool ideas
Great tutorial on tge basics of texturing!
Glad it was helpful!
This was amazing‼️❤️
Thanks
Free tools are the best, thank you sir !
You're welcome
Brilliant. I was wondering if this was possible. Thanks for the lesson.
Glad it was helpful!
Soo useful tips, thanks man!
No problem!
Great video, nicely explained. A better way to select vertices on both sides is to switch on x-ray mode (the two squares icon next to the shader view icons - top right of the 3d viewport) or Alt-Z. Wth that on boxing around will select all vertices on both sides of the mesh.
Great tip! Thanks Darren
You probably know this already but you can easily select vertices/faces/whatever in the back when you go into wireframe mode.
The AI is amazing when it comes to creating textures and concept art. I use it to make my own textures so I don't have to buy them or use the free ones while my friend uses the generated output as concept art for a video game he is making.
Cool tip, thanks
What AI is it?
I learned so much from this video!
Glad it was helpful!
Amazing! this is gold content!
Glad you think so Daniel, thanks for the comment
nice job looks amazing thanks for sharing
Thanks for watching!
blend indeed awesome
Thanks
great tutorial, thanks!
You're welcome!
My g, i sure hope you keep doing these easy to do tutorials! With all AI possible objects! i wouldn't be able to think if whats possible since idk 3D and I see you just uploaded an AI gun model in 3D so u hope you keep finding these objects that are possible to turn into 3D and please do a tutorial for the gun and others 😩😍🙏
Thanks John! The sci-fi pistol was for modelling practice really, I made that the old fashioned way using the AI image as reference. I have some ideas on some easier conversions though, subscribe if you'd like to be kept informed
Mate, thank you so much for teaching me this, my alien egg is rendering and I am so happy :)
Glad I could help!
Thanks mate, hella helpful!
No problem 👍
Really well presented mate, I'm using the free software called Materialize to generate the maps. Not sure if its any better but seems to have a good range of parameters to get the most out it. Looking forward to see more videos. Subbed!!
Thank you, yep Materialize will also get you over the line!
This is exactly what I was looking for. I've been searching for something like this for weeks. Thank you so much for sharing this knowledge...... Subbed. Is it possible to do this on a plane or side of cube? Im trying to prepare STL's for laser engraving.
Absolutely, you can apply the image/displacement to any geometry that has UVs and enough polygon density to support it. Follow this tutorial with the geometry of your choice! Thanks for the kind words
Very nice! Good job.
Thank you very much!
AI is going to make the more tedious parts of 3d modelling much easier, this is very cool stuff
Glad you liked this
Loved your first video and this one is even more accessible but I have an issue I hope you can help with, I use mac! so is there a replacement/alternative for Shadermap that I can use you'd know of? Thank you in advance.
Ah I didn't mean to exclude Mac users, I don't use one myself! You could try Quixel Mixer - Mac downloads here quixel.com/products/mixer
You can use controlnet/stable diffusion to make normal/height maps for an image that might make this easier!
It might do! Tech is moving so quick this is outdated already
you really can't use common shortcunts or blender fields for convenient workflow but, man, you're so good still. the result is amazing. thank you so much for this. get some Grant Abbit tutorials for easy workflow and you are just unstoppable!
Thanks for that!
@@gameartexp Hey, could you advice please, how did you come by with displacement, normal map and othe jpegs?
Great video. You can also add displacement in texture editor, there is a socket in material output. Its a bit easier that way. And if you want to have more realistic look use Cycles render engine instead of Evee.
Great tips, I'm a 3dsmax user so still a Blender noob
thank u shar ur hard work
It's my pleasure
Question: If you had the money, would you use something like Substance Alchemist for your bitmap to material conversions, or any other program for that matter? Or does Photopea meet all your needs? Thanks!
Yes is the short answer. In this video I used Photoshop, 3DSMax, Knald (for the normals, height etc.) and Toolbag for rendering ua-cam.com/video/8uh-qFOi7lQ/v-deo.html
Substance would definitely be of use here and Photoshop is useful for the neural filters.
I Swear... this is absolutely incredible..
Glad you liked it
@@gameartexp "Liked" isn't even the word for it. LOVED, is a better word.
i got a question though, say i wanted to use Zbrush or Zbrush Core "For some people who can't afford normal Zbrush" is there a way to use it for the sculpting part? like could i keep the Normal Map and Texture and stuff on it while in Zbrush? do you know anything about any of that? cause if you could make a Tutorial for how to use Zbrush to help enhance the sculpting part, i think it'd help people as well. i know the widest net has already been thrown out, cause you did a blender Tutorial here, but blender just can't offer as good of sculpting as Zbrush can currently.
@@Glitch-Gremlin Absolutely Zbrush/Mudbox could be used instead. I'd forgotten about Zbrush Core actually, the tools and high poly model management would be better over there. The benefit of Blender is that it has everything under roof and there's less hopping between applications but I'll look into including Zbrush Core next time around. Thanks.
@@gameartexp If you'd like a full version of Zbrush, i can get you a "Maxon One" Zbrush, Cinema 4D, Red Giant and others Sub for ya, it can only be used for Educational but for UA-cam videos im sure that'd work. ArtHeroes gives them out, you just buy one of their tutorials "One of them is only $50" and then ask them to set you up an Educational License sub, and then pay the $10 per 6 months, they say you only need to re-up it every 6 months, so basically $20 a YEAR for all those? great deal for learning them. but i got a sub im not using for it, so i could just give it to you and you can use it if you want, take over the account and stuff. or you could make one with them, too. let me know though if you'd like that.
@@Glitch-Gremlin Thank you so much, i appreciate the offer. I actually have a full Zbrush license so including it in a video should be no problem. Thanks again.
i like to feed the texture color into the color for the subsurface scattering.
Absolutely, I used that method in some earlier work, just not in Blender. www.artstation.com/artwork/5B2gmz
you're very good at copy paste, hope they can invent a AI add on to do the rest of the little work.
Can you explain a bit more please?
I wish I could upvote it more than once.
Thank you
Amazing! How hard is it to make an object to be animated or to interact with it? Like running or shooting
Adding physics collisions is pretty easy in a game engine for a static object. I had a displacement map gradient scrolling along it in early tests that made it pulse slightly. Further work needed to animate it though, like rigging with bones or making blendshapes/morph targets.
great video, how are you getting rendering inside blender so fast like this 09:11 while moving through the scene at the same time ?
Thanks. It's just shaded mode using Eevee, with a direct light for shadows and bloom enabled in the render properties
This video is great! Even i could understand it without experience. The right side of the video was cut off so some things i want able to see what you clicked.
Sorry about that, an issue with the OBS capture settings - I watched it back before posting and it should be possible to work through with the dialog. Thanks.
Super useful! Liked & subscribed :)
Awesome, thank you!
you have about the software. I personally enjoy learning so it was a little bit easier to do it over ti. But you’ll get there brother
Good to know!
great video ! Does it work also for character model?
I guess you checked my other vids!
Came for the tips, stayed for the soothing accent
:D:D:D
What other type of objects are good for this method? like what shape do they need to be? I know basic shaped would be better
Objects that look similar from the back or front work well with this method. Complex organics or foggy scenes could be problematic, but in theory, if you can map the image onto some representative geometry, the process should be the same. For characters, you don't get side or rear views with AI, so you could either map the front image on to the back and be careful how it is seen in 3D or hand paint the texture for the back.
For videogames it would be heavy to import to a game engine for a lot of subdivisions right?
It depends, UE5 could handle a high detail model with ease with Nanite. It should also be possible to user a medium detailed model in Unity, by using the normal/height maps with some real-time tessellation and displacement based on distance to camera.
This is amazing, and genius tutorial. Don't know how you figured this out, but kudos to you.Taking a stab at this today. See if I can get one of my ai female cyborgs to complete 3d model. Two years about ,on Blender and again, don't know how you figured this out. Wish me luck. I'm old and I'm slow.
Glad it helped! Go for it, I'm about to upload a character tutorial that may help!
@@gameartexp Excellent. Watched and did the tutorial on the egg, substituted a character generated in Nightcafe. Took 100 credits to figure out how to get a model sheet created. You can use "model sheet" Unreal character metahuman render" as potentially useful prompts. Have Unreal 5.1 installed and it looks similar to Unity thankfully. Resolution is amazing. It will be some time to figure. Unity is hard. Have little coding skill. Use chatgpt to help create code, but it makes mistakes. No way around having to learn some coding. Back to the tutorial.I see the workflow, photopea to shadermap to blender. Put the character texture on the ball. Learned how to move and adjust the uv map and thank you for explaining that so well. I've done tutorials on it, that didn't click, but now see how that works. So far haven't gotten Nightcafe to do back of character. Model sheet shows front view and side views. Tried "model sheet, t-pose, three views, front,back,side " and it's night generating back. Best I've gotten is front which isn't always a straight frontal view, and two side views. Fingers on hand are deformed. Nightcafe has new algo, which is called SDXL. Uses 3 credits, so have been using 5.1 to test results. Have a couple low poly 3d character modesl to see if the texture will map to those. It's going to be hard to figure fingers. Looking forward to seeing your character tutorial.
@@joelstolarski2244 Great progress! As explained in the character video (live now!) coaxing out the right prompt can be really tricky
Is it possible to utilize these techniques and make a, lets say, a fantasy tree?
Or would the geometry be to difficult?
Anything with tendrils (branches in this case) that extrude outwards in different directions would be tricky. You could ceratinly do the trunk like this and then add branches yourself and deform it afterwards
Awesome, is there any shadermap alternative for mac ?
Yes, check the video info for a browser based alternative
impressive,, subbed.. Love this..
Thanks for the sub!
Is this efficient for detailed CHARACTER MODELING? Especially when creating complex characters with MidJourney (e.g. aliens)? It would be cool to see a video on that
To some degree, have you seen this? shunsukesaito.github.io/PIFuHD/
ua-cam.com/video/r6hoY0C-O7o/v-deo.html
Does this "tricky" only works with spheres? I have tried using a cube and couldn't make it work at all :( Great video thank you very much for taking the efforts for making it.
The hemisphere works well I've found, I've created heads etc. in this way. As long as your displacement works reasonably well on a plane, adding to a hemisphere will help pull it into 3D a little better. Some subjects don't translate well with this method.
Great video!!! I would like to try it. Where can i find the image?
In the description, there is a link to the scene files on Gumroad
i have zbrush, but am having a really hard time getting this to work the same as you did in that program. do you have zbrush to do another tutorial in that program?
Hi there, I use Zbrush and may include it in a future video
Thank you for this amazing tutorial! It's a very interesting workflow 👍🏻
No worries, thank you for watching
is there a way to 3d ai generated structures/assets (like houses) ? that would be crazy
I'm sure you could make a floor plan using AI that could be extruded, it would give you ground floor at least. There are also options for image to image and depth to image in Stable Diffusion which would be worth looking at
How's the job market for 3d up in Ireland?. Haven't been on the island since 2020.
Pretty good, not sure it's much improved on 2020 though
Thank you so much! I have one question, you said that it won't work for every image, what's the main issue?
Thanks Fred. The issue is complexity. To make this feasible we need to be able to use the same AI image front and rear on the 3D model.
@@gameartexp Got it, thanks!
@@fredferkel9604 ua-cam.com/video/r6hoY0C-O7o/v-deo.html
wooow i very like your video
Cool, thank you!
Amazing , do you think you could make another tutorial for those who would like to 3d print the file later? Would be amazing to resin print this one 😮 you made
All you need to do art the end is export the file from Blender as STL, then import into your slicer and use whatever your favorites settings are to print in resin or extrusion
@@gameartexp I’ll keep rewatching your video till I get how to make 3d and shape it like you did , amazing amazing work ! Is there also a place where one could understand the key words to use to get something as amazingly complex as yours?
@@gameartexp thank you , is there a way to transfer the shape from original images to skip creating a shape in blender? while it might be not as complex with an egg shape it would near impossible with a miniature lets say due to shape complexity? Thnx
@@MaksAMD UA-cam is as good a place as any to find tutorials on 3D modelling etc. Start with the basics ;)
@@MaksAMD If I understand you correctly, and you want to skip the Blender part, you could achieve something by displacing a plane primitive with the original images, but I doubt you could get much with it. Take a look at this: www.artstation.com/blogs/petemc/468w/midjourney-to-3d
Imagine the pain of the hen that laid that egg
oof
Coolest. Santa. Ever.
🔥
I'm still looking for an AI tool that will create 3D OBJ shapes from images without modeling. I've found free sites that will do humans, but nothing abstract yet. What if you generate the egg images in a series of rotations through prompts, then generate a 3D object with Instant-nurf or photogrammetry?
NeRFs could work, I've been testing them lately. LumaLabs AI, OpenAI and Nvidia are all testing text to textured 3D model right now
ua-cam.com/video/r6hoY0C-O7o/v-deo.html
Hi there! Do you think it could be with a shoe?
It would certainly be more difficult
I remember I used to tell people about ai image generation but no one listened (because ai image generation used to be kinda trash but still impressive) and now people are starting to use them to make 3d models
I think everyone is sitting up and noticing now
If i do that kind of egg im probably using substance sampler or designer to extract the normal Map and depth Map and color from the original design, first you model the egg in blender you UV unwrap you made a front projection of the original jpeg artwork add symmetry and let substance extract the volume , maybe some tweek in zbrush Can do that too, it's easy to do stuff liké that with an egg shape and zsketch for the RIB cage and spinal things.
Absolutely, that's the way to go if you are a subscriber to ZBrush and the Substance Suite. This video is primarily aimed at people who don't have access to paid tools
@@gameartexpthe good Thing is it work with freenstuff krita Can extract a lot of normal Map.
🔥🔥🔥
Nice one
can someone please explain how to get a glare\glow effect like this 09:04 ???
Ensure viewport is set to Eevee, you're in the Shading window, then enable the "Bloom" checkbox in the Render Properties tab
My web antivirus blocks SM4 access while im trying dowloading the program!
That sucks, try this instead boundingboxsoftware.com/materialize/
anyone knows where he got the picture of egg from ? please
It was generated from text prompts with an AI service, such as Midjourney or Stable Diffusion
Sky is the Limit!!!
Please try it out!
@@gameartexp I will as soon as I can!!!
Have you ever made 3D models based on AI Art of animated characters like mascots or cartoon animals? I would love to see if that is possible to do like use AI Art to make a cartoon character like say a cute Coco-Cola character and make it into a real model? I wanna commission a game dev I know to make a 3D model of one of those AI Art images and see if that is possible.
A good 3D artist can model anything, Nvidia are releasing code next week to create 3D models from text prompts
@@gameartexp awesome
@@NitwitsWorld ua-cam.com/video/r6hoY0C-O7o/v-deo.html
Holy shit, I just know how to model, then uv, then texturing, how many more ways of doing things are there?
There are many ways to model, or you could use alpha textures on cards, each AI scene calls for different approaches!
Which website is that from?
There is a list of used apps/sites in the description
based
Appreciate it!
you said spanner - good lad :)
Well, that's what it is!