AI to 3D Characters: Next Level For Blender, Unreal Engine and more!
Вставка
- Опубліковано 27 лют 2024
- I'm exploring the innovative app AI Character creator called 'Chat Avatar', a cutting-edge tool that has been in development since last year. Join me as I guide you through the entire process in blender, from the initial creation of your AI character to the intricate steps of re-rigging and implementing iPhone motion capture and body animation.
An Unreal version will be coming soon, just wanted to separate the videos.
Please note: This video is not sponsored, nor am I affiliated with the 'Chat Avatar' company. However, I did have an enlightening meeting with the developers to gain insights into the current state of their technology. Dive in to experience first-hand the blend of art and technology!
Chat Avatar:
hyperhuman.deemos.com/
Accurig:
actorcore.reallusion.com/
Mesh Data Transfer:
mmemoli.gumroad.com/l/tOKEh
LiveLink for Blender (Face Mocap):
nickfisher.gumroad.com/l/tvzn...
Any iOS device with a TrueDepth camera (iPhone X or higher)
Actorcore (Body Mocap):
actorcore.reallusion.com/3d-m...
Chatavatar Discord:
Discord forum / discord
Patron
/ promptmuse
🥤If you want to buy me a coffee, I'd really appreciate it:
ko-fi.com/promptmuse
FAQ
1. DreamFacev2 CURRENTLY at the time of posting will be the only model to provide Rigging and body options. Thanks @binyaminbass
2. Website may be slow (Its still in Beta) . Works fine for me atm, but there has been times it's been slow. Discord forum / discord
3. If packing fails and you have paid...It should be free to repack, this has been the case for me :) . It will display a 0 as payment when you redownload. If unsure just ask on their discord above
#aiactor #ai #midjourney #stablediffusion #aianimation - Навчання та стиль
I'll Pin an FAQ etc here when they come in :)
1. DreamFacev2 CURRENTLY at the time of posting will be the only model to provide Rigging and body options. Thanks @binyaminbass
2. Website may be slow (Its still in Beta) . Works fine for me atm, but there has been times it's been slow. Discord forum > discord.com/invite/AhYWCT8WNH
3. If packing fails and you have paid...It should be free to repack, this has been the case for me :) . It will display a 0 as payment when you redownload. If unsure just ask on their discord above
This is mind blowing! In a few years indie devs will be able to overtake AAAA studios. Being able to combine ideas will become more important than anything, every year. Thanks for sharing!
Also great in depth, no nonsense tutorial 👌.
would you please leave your emailaddress ? for business inquiries
When is the next vid about hairtools haircards and metahumans ?!
@@davy4842 on its way!! Sorry for the delay!
Amazing workflow tutorial. Thanks for all the effort that went into producing it. With this new wave of interoperable tools, crazy to imagine how many indy projects and studios can suddenly bring their dreams into reality. Way to explore the frontier!
Thanks PM, Always such clarity in your tutorials, making 3D seem less daunting for newbie’s like me venturing into 3D/BLENDER creations. Cheers
Hello and thanks again for your clear and logical presentation of a complex process!!! The pace of your presentation is like a swift stream, and your mellifluous voice is mesmerizing!!!
this is so valuable. even with hand modelled characters we can use accurrig to quickly attach mocap
Ummmmm.......that was amazing!!! Thank you so much for your time and efforts regarding this!!
So awesome! Deep thanks! This is such a great workflow, and much appreciation for being so concise. Cheers, keep looking up.
Hello, I really enjoyed the video & workflow shown but my only question is how we're you able to texture the rest of the body shown at 12:54. I'd appreciate any help or tips given, Thank you!
Hi, PM you make really cool tutorials, thank you very much.👍👍👍👍
Best regards Robert
Thanks so much, Robert!! 🙏
I didn't know this kind of add-ons exist. I was doing it the primitive way! thank you so much for this very informative tutorial. ❤
It’s been around since last year, so kind of known, but not massively known. It’s nice we get a preview before launch in April 🙏
What a useful guide ..! Thank you ..!
Hello Muse
I love your videos, even with little time and I always use the translator, I love all the information. The daily changes and news that emerge are truly crazy, it is impossible to follow everyone, but always follow you.🤩🤩🤩
Thank you so much! Yes I try not to post content too much but content I think could be useful to viewers. I am so glad you enjoy it. What language are you speaking and where in the world are you?
Great tutorial, I’d love to see you animate a short 2 minute scene someday using all these tools. You are so talented.
🔥 This was awesome !
Amazing. This will come in very handy in my future projects 😁❤
Awesome , would love to see your work when you are complete !
I cannot live without your Earnest Coati Eyes, teaching me how to do stuff. 🐼🥰
Excellent
Wow this is so informative!!
Thankyou tried to pack a lot in in under 20 minutes haha
Thank you for your detailed explanation
You are more than welcome 🫶
love this! thank you
Aweome tutorial!
Great tutorial thx!
I just wanted to say that your videos are awesome thank you so much for such great content love the accent
Amazing video. Got everything working except the hair library. I know you did another tut on it, but i think it would have been great to see how to install the things without having to go to find other tut. Keep up the good work! you are amazing :)
Great video, like always!
Thanks for watching once again 🫶
Not only was this the ish I could listen to you talk all day :) TU
great this was all in one
What did you do to get the clothes and body texture? Thanks.
Interesting . Blender needs to address AI because AI is out doing all of the 3D programs . Krita image editing software has done this and it works great and , like AI itself , it is addicting . AI is such a threat to so many platforms . Art that has taken some years to complete can now be done in a single click . It is a mind bender. From my point of view AI is not our friend and will , eventually , take over everything . Thanks for the tips . :O)
It does feel like it’s a Trojan horse. The speed it’s going at, does not seem to be much regulations. Which on one hand promotes innovations, but not all have good intentions.
I for one fully welcome the massive advance in AI, I doubt it will truly replace all artists/creative jobs, and on the positive side, it will allow solo devs and artists/small teams to accomplish way more, since we will be able to allow AI to do most tasks, streamlining boring steps, create tons of assets and procedural stuff, and in the end, the artist can assemble them together into whatever they want, like, create an entire open world game or animation.
I mean, if legions of cheap artists from third world countries haven't killed the industry, what makes you think AI will?
I love all your videos.
Thank so much, that’s really kind ❤️
Thank you!
Great stuff
Thanks do much! Glad you enjoyed
excellent!
Great video! Will try this out for sure. What model iPhone will work
I have an iPhone 8 Plus
Thanks for the very good tutorial
Iphone 15. Any iOS device with a TrueDepth camera (iPhone X or higher) should work
AI Really is saving us so much time.... There is so many pros and cons, but I see so many pros. It really will take time off the overall development. There's even world map AI now :O
Cool!
wow what a tutorial! Thanks so much for sharing your knowledge! i will spend some $ in the future...!
Great info > Compact video editing
Thank you!
you are the best thank you sharing
Wow. You are amazing.🎉🎉🎉
Thanks Ed! Not amazing but just addicted to this life ha
@promptmuse love it. Well I am entitled to my own humble opinion and you can't change my mind... so there! :P P.S. I sent you a message on insta.
Like Fuse, but with prompts!
Bravo!!
Thankyou!
amaaazing
Accurig is absolutely phantastic. Better than all these "AI thingies".
Is it possible to export a character in a chosen pose for 3d printing?
Omg, that more clicks then used during a starcraft2 gradmaster league match, but you sure explain it good! =)
Haha 🤣
muito bom !
Muito obrigado, com amor do Reino Unido
Oh yes, Unreal version please :)
thank you
You're welcome 🫶
4:36 Is there any way to get like lower topography version? *to use in mobile app/ games, etc*
In it's current form no, there are lots of plugin to do this in blender but you will lose you blend shapes...but that's pretty each to recreate. hopefully in April there will be this option as many users have requested this. I'll pop it on their discord as a suggestion and see if it's built into the release timeline.
Great video. You are so beautifull and inteligent 🫶🏻 Cheers from Ecuador 🇪🇨
Do you have any alternative for android to motion /face capture?
Wow! Simpy Amazing! How did you get textures onto the body? And the dress? Thank you for sharing! Subscribed...
Just making a video about clothes for the character 🫡 Also body wise I just took the face texture map into photoshop and colour picked it and made a new body texture. I’ll probably do a quick video on this and link in the description 👍
Hi Please I want to know how I could delete a model I created?
And thank you very much
what?? that looks good
Very informative and entertaining can you use an android phone for this?
idk if anyone else had this problem but every time i got to transferring the mesh it would transfer them all fd up. took days for me (newbie) to figure out but I had to transfer them manually by selecting a material on og, drop down arrow n hit copy then go to accurig select corresponding material and then dropdown arrow paste. repeat. i did all the eyelashes on og rig to the one spot on accurig.
Do you know if live link is available for android?
Is it possible to use these shapekeys in iClone for acculips and the like?
Iclone and CC use slightly different shape keys. I’ll give it a go today and see if it works (but doubtful!) If you have headshot you can bring it in via that method as it will convert it to a CC character automatically with all their own blend shapes.
However, I know that character are working on a plug-in for Iclone but unsure if that will create transferable lens shapes. It will be interesting if it does!
I wonder what graphics card ur pc should have for this. I got a 3070 but getting a 4090 soon. Does RTX help or make it more realistic
Nice, to be honest nothing crazy is needed. I'm just running it all in blender. Have you looked the the 4080 Super? Might save some money if your looking for a new card but want to save some £££. RTX is great for 3D, I've just purchased a 4080 and loving it (Annoyingly got it before they annouced the 4080 super).
NVidia's shares have gone crazy (up by 225% over the past year) as everyone is buying their cards for AI. Always been the go to for 3D in my opinion too.
@@promptmuse I"ll start creating as soon as I get my 4090 as well will try the Unreal engine too. I want a 4090 because I play games .... Thanks for the content you make 👍
@@princematthew Awesome, getting a new PC is good times. Enjoy it when it arrives!
@@promptmuse something better gets released after you buy it? Welcome to the graphics card game 😛
What do you think about Meshy AI?
You are a godsend. Its criminal you dont have more subs, cos you are deffo putting out some of the best and most useful content in this area.
Thank you so much ❤️ That’s really kind
when I install mesh data transfer into blender, it pops up an error saying "ModuleNotFoundError: No module named 'mesh-data-transfer-2'", any help?
Hey! Which version of blender are you installing it to (I’m on the latest version) 4.0.2 off the top of my head. May be a version issue?
Just checking are you installing as a zip? Needs to be a zipped files. Preference>addon>install the zip.
Also if none of the above was an issue I’d redownload from the gumroad page in case the file was corrupted during downloading
Not sure what I'm doing wrong or if you have access to different features but I didn't get any options for bodies, rigging or blend shapes, just 4k or 8k textures and then "Pay" which uses your credits. I don't even really need the body or rig (blend shapes would be nice) but it also comes in with most of the head being white like in the review which isn't great.
Edit: I figured it out, only V2 produces anything other than the bust with the face texture. Wish I would have known that ahead of time so you might want to add that info somewhere.
Currently (as it keeps changing day by day) you can only get those features with the Hero model V2. But I’m assuming they will roll it out to the other models by or before April ! Oh just read you edit as I write this 🤣 yes I’ll had it in the description or try and add text to the video 🙏
@@promptmuse Hopefully they do as the more stylized models do open up your options a lot. I just took a deep breath and bought the $120 commercial package which feels weird for a AI tool but you couldn't get a single head commissioned at this quality with all of the maps for $120. I guess there's Metahuman but there are all sorts of issues using those outside of Unreal.
@@user-on6uf6om7s metahuman is great but simply adjusting the mesh is a bit long winded. I have to use maya and quite a pricey add on. Also the licensing seems very flexible with chat avatar. The body textures are on their list as well. For now I just use the Uvw map they supply as it’s all unwrapped and make my own in photoshop. I’m excited to see what other features they bring. They are also very active on Discord and if you have any suggestions they take them on board because I’ve been suggesting stuff 🤣
mi muse
What if I change out the body they provide? Will it still work the same way?
You would have to redo the blend shapes for the face but that does take too long to adjust. If the vertex order changes the blend shapes will stop working. 👍
so as long as I keep the face the same I can transfer over the facial blendshapes? Basically want to change the body out and adjust then use accurig to rig it like you did. but with a different body. @@promptmuse
Can you make some sort of half stylized hair for metahuman?
Good to mention that only the Dream Face style offers body, and blend shapes
Will pin this 🙏 hopefully they are the bodies out for the other models very soon.
I did find with the dream face, I could get a stylized version by prompting anime etc. I had to go in manually fix the eyes blend shapes in blender though, as they were slightly terrifying 🤣🤣🤣🤣
Great video, well done explaining everything. Honestly, glad this was so in depth.
Thank you 🫶
Do you take in clients?
Sometimes I do, I have insta if you want to message there :)
I tried the chat avatar and after using the credits, i got to "mine" and the status just says "packing". no option to download
You should be able to repack for free once you’ve paid if that one has failed. However if there are issues just go to their discord on the bottom of the chat avatar page and let them know cause they’ll fix it for you.
@@promptmuse cheers, thanks
Hi Prompt Muse, Can you make a Video on using Metahuman with real world footage as composite background footage for metahuman animation.
Also, Adding Jewellery and Clothes to Metahuman. Thanks in Advance. ❤❤❤❤
That would be great just making a quick clothes ❤️*4
This is epic! These tools are the future of ai. Basically just plugins. ❤ thanks for the knowledge 🫶
THIS is why I love blenders open source policy :)
just a question, did you write Robert di Niro on purpose, to avoid censor? because his name is "Robert de Niro", maybe the reason why you didn't have a "perfect" portrait of the actor
Wow! Everything is becoming so easy now with AI. Can't imagine 2 years from now
Please you didn't explain how you added cloth and the skin color
I will be doing this is the next tutorials 👍
Doing faces is honestly not that hard and you might more intentional and good decisions that way, but it seems it’ll be so good for background characters
Ok now im scared lol everything i spent so many years learning .. time to adapt😅
I totally get it I spent many years learning 3-D and art like many others here. I get the worry from people, it is moving very fast.
I have an issue when i try to copy the materials. In fact the eyelashes model explodes after accu rig. Great content keep it up!
Hey did you find a resove at all? Just check in Accurig when you are placing the face joint that it’s on the mouth of the character as that will determine the eye joint positioning. Also that output is Blender(I’m sure you did that). Perhaps also try and select your character before exporting to accurig and Alt+ A > all transforms then export selected mesh to fix once again and run it through 👍 good luck
@@promptmuse Thank you so much for replying, but unfortunately it's not working :(
Take care
Thank you, you too !
aaaaaaaaaah quicker than a quicky
Did you make the body skin yourself
Yeap I just slapped a colour png from photoshop 🤣 colour picked from the face texture. I did speak to them. They will be adding a body texture hopefully soon to the program. 🤞
my character didnt have his beard, and eyebrows were just painted on is that normal?
Yeap, it doesn’t currently create hair. Developers say they will add this in at some point. I use Hair tools (blender market) Has beards and eyebrows etc but there is a bit of a learning curve 👍
upload the hair part soon
I love the fact that you use bing and search google😂😂
Blend shapes are completely not working at all and i followed all steps correctly. The mesh stretches crazy
Just check that your models align exactly on top of each other. Otherwise the vertex order gets messed up (produces crazy results).
@@promptmuse still not working after importing the fbx. what step do i need to make sure the models align on?
specifically, the mouth opening gives some weird stretching thing where the lips are attached.
the eyes also get distorted in shape and the teeth material dont transfer
You, Olivio and Matt wolf are my favorite Ai youtubers.
Absolutely love your passion for art, ai and technology :)
Aww thankyou, that means a lot. I know them both,and they are very passionate and driven and know their stuff 🔥
I guess you would have reached a better result if you had prompted Robert "De" Niro, instead of "Di" ;)
Haha whoops Good catch 🤣🤣
Why is this video edited in such a frantic manner? It's OK to take a breath occasionally. People won't flee the channel.
Haha It’s true, wanted to get as much info in as possible 🤣 but might calm down on the next video. Was chugging coffee
I believe it's like she said to fit in as much information as possible and me personally as fan of her I truly appreciate the amount of information that she delivers in her video ❤
that frantic editing manner is pretty much standard operating procedure for most youtubers who make the effort to respect the viewers time. i always appreciate it, a lot.
You can airways get the transcript and after watching a segment pause and read at ur own pace...
Just go to settings and reduce speed of video. Her voice may sound a bit deep 😂 but you won't miss anything 😉
They will directly compete with Tafi
Daz is working on something as well. I imagine there will be a bit for a space race.
The website is either slow or doesn't work 😔
It does work, however they are continuously developing it as it’s still technically in development and test. So when they update stuff it can crash/ slow. The launch date for release when everything is ironed out is April this year 🙏 try it again tomorrow it should hopefully be fine 👍 they are also very responsive on Discord as well so will let you know if they’re having issues on the site.
@@promptmuse oh ok thank you. The whole website just went black after logging in
Soo does this mean your done with Reallusion's CC4? I feel like Reallusion is losing more everyday to Metahumans, Ai, and now this.
No wayyyy, I'm actually going to look combining getting this in and mixing it up. Reallusion seem to move fast with plugins etc so I will expect some nice stuff from them.
Last time I checked this out it was a bit costly for being a beeta product.
Yeah it's quite pricey. But depend if it will save you time.
whenever I try to use this site it just doesn't even let me download the face I make, is there something wrong with it? is it a scam? Not your video, but the site that is.
Marry me !!! 🤩🤩🤩
E con miXAMO??
pretty girl, thank you
You did that black woman dirty 😂😂
oh great another job taken by AI geez
too bad its 12 credits to export it the way you do it on chat avatar when you only have 10 credits to begin with and you dont want to subscribe without knowing if its actually any good and useful for yourself :(