Text To 3D Character Animation With AI • MOOTION
Вставка
- Опубліковано 3 лип 2024
- Register as an AI creative for free at aianimation.com.
Checkout Mootion at www.mootion.com/?source=7
(Save 20% before the end of Dec '23)
Mootion Discount Code:
XCLXPFHL
Mootion Discord Server:
/ discord
This video is a showcase of Mootion, the new AI tool to create 3D animation for characters using a text prompt.
Plus it evolves into to an in-depth tutorial, where I take you through all the steps to work with the downloadable video file or 3D FBX file from Mootion.
------------------- -------------------- ---------------------
Times
0:00 - Awesome-ness
1:51 - Mootion
6:18 - After Effects Composite
7:45 - Blender
10:36 - OpenPose Blender Rig
20:42 - ComfyUI
22:22 - ComfyUI Results
24:32 - That's A Wrap
------------------- -------------------- ---------------------
Tools Used in this Tutorial:
Mootion:
www.mootion.com/?source=7
Mootion Discord:
/ discord
- Blender
www.blender.org/
- ToyXYZ's ControlNet Rig for Blender:
toyxyz.gumroad.com/l/ciojz
- MidJourney (For the Futuristic Tea Factory backdrop)
www.midjourney.com/
- Adobe After Effects
- ComfyUI
- Vast (To rent GPU's in the cloud)
cloud.vast.ai/?ref_id=91751
- Upcoming ComfyUI tutorial and Vast Setup: (*Text tutorial ...for now.)
aianimation.com/comfy-ui-anim...
------------------- -------------------- --------------------- - Фільми й анімація
This is very good stuff. It's amazing how these tools have evolved in such a little time. Impressive. Good job and thanks!
Looks so cool! Guess it can be the most genius motion generation product I ever used.
Amazing, especially the second half
thank you so much - just tested for unity works well! hope that will speed up my cartoons
Looks amazing and fun
Thank you for showing us. I can't wait to try it. I think we are facing a very interesting era.
Fantastic video! Thx!
Cheers, glad you liked it.
Wow!!!!
Amazing topic this
Thanks. Yeah it's going to be interesting to see this space develop.
Amazing! I look forward to us being able to generate our own characters. Maybe even uploading a JPEG of a character and the character is automatically animated.
I took a pass at a text->3D during the April AI rush. Ultimately the papers I was following just came to be too intensive for floating point operations (literally 100gigs of vram for a potted plant)
Taking a whack at it again now that I have some compute time banked.
Keep it up this is awesome work.
Genial!
Hello! Thank you for sharing such valuable information with us! You have the best quality animation content I've ever seen! Tell me, is there already a way to obtain 3D models from 2D images?
Hi, thanks so much.
Yeah you can do 2D to 3D models using something list CSM.ai . Plus there are a few others on the scene now too. Plus a slightly simpler but free (or paid if you need to skip the queue) approach is to use Dream Gaussian via Hugging Face.
@@AIAnimationStudiohow to do this animation in a1111
amazing video!.I was wondering do you have a workflow to download? and I'm wondering how did you add the openpose rig as video for comfyui?.I subscribed!. and add animation from the openpose video to comfyui.
How to make character bigger in photo
Hello, I’m new here, and I would ask you what is your computer specification? Thank you, your work help me a lot !
Thanks. My local computer is an M1 Max, Mac Book Pro. 32GB of ram.
But for running ComfyUI. which I was running locally. I'm now running via the cloud. Renting 2 x 4090 Nvidia GPU's. I'll post a video about this approach soon.
can you please do the video on using auto rig pro to retarget the animation fbx
Hey. I actually covered retargeting the FBX animation to another Character rig here last week. Hope it helps.
ua-cam.com/video/BabkaTF-kw0/v-deo.htmlsi=Q46S0nSCFKbryxNk&t=247
Hi, is there a a way to lip sync 3D models? Or can we use 2D lip syncing tools available and apply them as a texture to a 3D model?
Hi, whilst you can animate the mouth of the openpose rig it does'nt translate across as overly great lip sync. There are some pretty complex 3D head rig, lip sync approaches which are probably not what you're after. An alternative approach would be to pass your rendered footage of a character as a video clip through Lalamu Studio (demo) or synclabs.so where it attempts to add animated mouths to your characters aligned to your audio file. The results can be pretty good particularly if you're character isn't too stylised and has typicaly human proportions. For more stylised options you may have to go a bit more old school, and create the mouth shapes and animate manually in your 3D package.
@@AIAnimationStudio thanks, will check that out
Does this program allow to upload your own 3d characters?,
and generate animations of that character that only you will have access to?
Not yet, but maybe they'll add that in the future. So the approach with the FBX file download and transferring the animation to your own character is the best approach at the moment.
In other platforms WonderStudio have made setting up your own character to use on their platform a bit easier. (Their platform turns live-action footage into, motion capture and applies it to a 3D model, plus matches the scene lighting).
As requested: Hi! 👋
Gimana cara nya
How capable would this workflow be of making a virtual music video of a rapper with as lifelike a look as possible?
Describe the rapper and I might give it a go on the weekend. If it needs to be a specific rapper some new face swapper approaches are working really well.
Good quality lip sync though is still tricky, but different approaches are improving all the time.
@@AIAnimationStudio Yeah there are some decent quality lipsync colabs up. The other option is rapping it with UE5 face animator and deepfaking over the top of the metahuman with Deepface Live. The main thing Im looking for is if this Mootion can do lifelike rapping animation or if its still too generic. How does it handle fingers for example. Currently I have high quality Tupac and Eminem rap tracks made with AI voice clones. Just looking for the most realistic method to put them in music videos. So far however nothing has come close to licensed stock footage with lipsync and DFL dfm deepfaked over the top.
@@aaagaming2023 . Yeah the whole Metahuman approach is definitely the bets way I've seen for really good lipsync. Otherwise you're a bit restricted with Sad Talker Colabs/Discord, or D-iD etc and trying to pair it up with the body aniamation.
I defintely think Mootion could make some cool rap moves. Plus (I think) there is some finger animation... but you might want more refined control, though it's the only text to 3D animation tool I've seen with decent results so far.
Otherwise you could explore the Vid 2 vid wokrflows with Comfy UI, where it cna create the OpenPose/Controlnets from the video source and use that to drive the animation.
Hmmm.... potential to get it all working... just needs some time and a bit of R&D to find a way that does'nt take too long.
In the future anyone will be able to make today's blockbuster movies.
AI will generate different movies for everyone.
low sound
Yeah.. annoyingly.. rushed the export and didn't double check the Db levels. 🤦♂
9:42 I was here only for this thing and you didnt do it
:-) ... here you go ... think this is what you're looking for.. ua-cam.com/video/BabkaTF-kw0/v-deo.htmlsi=LQoGydnCOlbq_QSL&t=335
@@AIAnimationStudio thx
These examples look awful. I was expecting something like the prompt/ run and fall down after tripping on untied shoelaces and then sitting on the ground holding your toes in pain. Maybe in a few years the tech will be there
It's already improved quite a bit since this video was first made at launch. You can now do multiple actions, one after another in a single prompt. Not sure if it would deliver on your described prompt... but maybe... It can now also do motion capture using your own recorded video to drive the 3D animation. Plus it also now lets you generate Stable Diffision (animateDiff style) animations directly from the Mootion generation as well as the FBX download. No doubt there's tonnes of areas that can and will be improved but as one of the first (if not the first) text to 3D animaton generations they're leading the way. So many new tools coming out and improving... it's a lot to keep up with 😅
Dude, the feet of the model are all over the place. What a disappointment.
Yes, How dare they not make it perfect on the first try
As with all this AI stuff, It's only going to get better. Plus lots of the other 'Tea making' mootion generations had static feet.
Trivial fix to constraint feet bones.