MetaHuman Animator Tutorial | Unreal Engine 5
Вставка
- Опубліковано 13 тра 2024
- Step by step guide for Unreal Engine's MetaHuman Animator, the latest update for high fidelity facial motion capture. In this video, we are going to show you how to setup your iphone with the LiveLink app to capture your facial motion, then bring the footage into Unreal Engine 5 to Calibrate, Process and then transfer that facial animation to your Metahuman.
If you don't know how to create a MetaHuman, here is a complete guide:
• Create your own MetaHu...
Timestamps:
00:00:00 Intro
00:01:35 Setup LiveLink and Record Takes
00:02:28 Setup Project in UE5
00:03:50 Import footages into UE5
00:04:46 Calibration
00:06:42 Process Animation
00:07:17 Add Face Animation
00:09:31 Add Body Animation
00:12:10 Blend Face and Body Animation
Shoutout to @ibrews for his body and head blend tutorial: • MetaHuman Animator Com...
Join our discord server:
/ discord
If you wanna see us to do cool things follow us here too:
Instagram: / badxstudio
Twitter: / badxstudio
TikTok: / badxstudio
LinkedIn: / badxstudio
Bad Decisions Podcast 🎙️:
podcasters.spotify.com/pod/sh...
Our personal handles: (if you wanna stalk us)
/ farhad_sh
/ farazshababs
/ farhads__
/ farazshababi
/ farhadshababi
/ farazshababi
#unrealengine5 #metahumans #ue5 #metahuman #metahumancreator #vancouver #blender3d #canada #blender #metahumananimator - Розваги
Most common issue: If your head is moving and your face is not"
Make sure that in the sequencer, where your FACE is, delete the CONTROL RIG LAYER.
There must only be ONE layer under face. That is your baked animation :)
as usual, ue4 is crashed and now I can’t find even a sequencer or animation at all, I already got to the part where idle animation was applied but it didn't work for me and when I tried to switch to hoodie everything fell down and now it's just an empty project
idle animation isnt working on metahuman
@@sergeypopik6879 do the same for the body as this comment says for the head. delete the Control Rig under BODY. worked for me. goodluck!
o you know by any chance how to import metahuman with the animation and everything textures, hair ect. In to a 3D Program like blender or similar to then render it there?
The face animation is working stand alone, but when I remove the control rig layer, the face does not move anymore.
What could this be?
For anyone who is using UE 5.3.2 and has a problem with not having FACE in sequencer, I got it working this way:
- In MetaHuman Performance view, do everything the same until Export Level Sequence
- When you click there and you get Export settings, go all the way down to MetaHuman Tracks
- Select your MetaHuman BP as Target MetaHuman Class and tick Enable MetaHuman Head Movement
- Now you have your MetaHuman in Sequencer, remove the controlRig from Body
- Add animation to body
Done. Thanks Bad Decisions Studio for awesome tutorial!
I much needed this solution. Thank you so much.
This is exactly what I need... thank you
but my editor keep crashing when I try to add the animation:
Assertion failed: Pose.IsValidIndex(BoneIndex) [File:D:\build\++UE5\Sync\Engine\Source\Runtime\Engine\Public\BonePose.h] [Line: 568]
anyone getting the same error??
I get that too@@pipcy
following this step also automatically connected the head to the body and maintained the neck movement.
Thank You!!!!!
Love what you have done here. Really nice work.
I am a member of the MetaHuman team at Epic, and have just one small comment on the creation of the MetaHuman Identity. For the 'Teeth' pose, you should make sure that the top and bottom teeth are together, with the back teeth meeting in a 'clench', and (likely) top teeth slightly overlapping the bottom teeth, and opening the lips so that the upper teeth tips are visible. In your pose, there was a small gap between top and bottom teeth, which can lead to slightly less accurate positioning of the teeth in the MetaHuman Identity, and therefore slightly less good quality of animation.
Hey Jane!!
Nice to meet you and thanks so much for your feedback.
We are definitely going to implement this next time :)
Is there anyway we could contact you? we have a few questions that we'd love to clear out before releasing here on the channel :)
@janehaslam684 Still the weakest part of Metahumans is the eye integration. The face seems to be a mask, then there seems to be a gap and then come inside both eyes. They seem not connected. In real life there is translucent flesh and tear fluid. I know it's possible to fix it manually, but it's not easy. Hopefully this will be improved. And otherwise @badxstudio it's worth another tutorial, if you find out how to fix this... Thanks
Hey Jane, sorry to ask an unrelated question here but maybe you know the answer :)
Can animations done with Metahuman Animator in 5.2/3 be exported backwards to 5.1 as FBX, or did Metahuman rigs change too much when this new tool was added in 5.2? I'm afraid of buying a new iPhone to record animations for my 5.1 project in 5.2 Animator, without knowing if it will work (and I have dependencies that lock my project to 5.1).
Can anyone please help??? I AM STUCK
When Exporting the Level sequence, Face is not visible in the sequencer. There is ust Newmethumanidentity and Animation and face controlboars_CtrRig under it. what do I do now?@@badxstudio
Hello Jane, I can’t help but ask pro in metahumans as you are. I’m trying to make manually keyframed body animations with control rig implemented in MH combined with face animation made with MH animator, but I still get the detached head when I try. Please help me find the solution of this problem. Maybe you know how to fix it, or you know someone who explained it on YT, anything helps, any help is appreciated. Thank you in advance. And, thank you for your hard work!!! You and the whole team you work with made a big step in CG, you created a spectacular masterpiece.
This is insane. I didn’t know stuff like this was possible. It’s incredible how fast technology is moving
I found you guys like a month ago and by far give the best UE tutorials, so thorough and entertaining! Keep up the great work!
Agent this means a lot to us man ... we really do spend countless hours re-writing our intros and main script to ensure its entertaining and clear so people can really learn something. The fact that it's working and you guys like it means a lot to us
One of the best, easiest to following and engaging tutorial that I have ever watched. Thank you sir!
It's amazing to see how fast this channel is growing. Super deserved work, guys! 🥳🥳
Thank you for bringing yet another quality tutorial and still supplying details and procedures that most didn't do.
Thank you so much! Your words mean a lot man.
Gentlemen, This video is incredible. I was totally lost when it come to metahuman animation - but you guys got me up and running like a charm. Excellent instruction.
Wow, thanks! So happy that it helped you 🙌
Thanks Mate, your video was, by far, the most complete and well made about metahumans. You turned something dull and tedious into something simple and freaking funny to watch. I've just subscribed. Thanks again!
You are absolutely welcome ❤️❤️ we put a lot of effort to get that exact vibe across and glad it worked out! Listen we’ve got another one coming for metahuman customisation over the next 3 weeks ❤️
@@badxstudio I can guarantee that every effort put into the videos is noticed, top notch content.
I've seen several other videos from you guys and I'm sure the UA-cam algorithm will promote BDS soon...
Congrats again and keep up the good work...
Cheers!
Subscribed! You guys are awesome! straight-to-the-point videos, no BS, and a great vibe! Keep it up!
Awesome! Thank you so much!
i iwsh all tutorials were this direct, no filler stuff that is distracting, step by step and clear and concise
Glad you liked iit bro
Great Tutorial again, always with lots of fun and it really helps to learn new things about Unreal Engine and Metahuman. Thank you guys for this great demonstration. 😉
That was the whole goal
Superb tutorial! thank you guys! I look forward to your next installment.
Thanks for watching!
Thank you so much for going through all the neede steps. You guys rock!
You guys are my go to Unreal tutorials for sure. Thank you!
We love you
thank you for the neck and body section! incredibly helpful
We knew its gonna be a pain ... glad it helped
@@badxstudio you guys are really doing the lords work. So precise and entertaining to watch, you nail it every time. As someone who has watched many tutorials for the last 5 years, you two are by far the best.
thank you soo much i tried to do learn how to do this several times and it was always too confusing but this made it infinitely clearer so thankyou
🙏🙏🙏
You're very welcome! Glad that it helped :)
Dude god bles you I’ve been trying to figure out if I’d ever be able to make short funny animations and this tech is possible now and high quality now. Wow I used to draw frame by frame this is amazing you basically just have to be able to act in character. Insane!!
amazing and so helpful, seemed like you guys just started a youtube channel. I have to say that this is reallllly interesting. keep going kings! you're so potential.
hahahah thank you we started about 100 days ago :D Pretty new but we quit everything to do this so we are all in.
Thank youu for supporting us!!
dudes your both awesome thanks for this when my head stops spinning ill see if i can take this all in
Hahhaha love you brother!
Im sure you can handle it :) Let us know if u need any help
Amazing tutorial. Talk about delivering value!
Thank you brother
Amazing content guys. Im doing this process tomorrow and was curious how I was gonna connect the head to the body. Thanks for the funny walk through 🎉😂❤
Thank you
At last! I have been waiting for you guys to do this very tutorial.
Well now that you've seen it, what did you think?
@@badxstudio It most certainly reduced the headaches of getting the animations from the performance mesh to the metahuman. I'm pretty new to Unreal Engine and have a lot to learn...
@@badxstudio Also, where did you get a Patrick Stewart Metahuman?
I’ve been waiting for this for so long!!!
Glad to know you are watching it now
@@badxstudio Just went through the process and it's super cool! Thanks for the easy tutorial!
Very clear and concise tutorial... thank you
genuinly one of if not the most thorough, well developed tutorial ive ever followed. You accounted EVERY possible error, this was fantastic. Thank you.
Thanks mate! Glad it helped!
All worked fine for me (thank you SO much, so awesome), except once i click Disable Post Process Blueprint for the face it goes bad for me and the face animation no longer plays/works :( Any ideas?
@@rctakedown9595 i have the same issue and idk how to solve it either :(
*I love this channel, great tutorials here*
You are welcome brother!! Jus checked your vids too they are dope :)
داداشا دمتون گرم بهترین و با کیفیت ترین آموزش هارو داخل چنلتون با تمام جزیات میزارین ایول❤
damet garm bro ❤ Thanks for watching
Awesome tuts guys, keep it up!
Thankyou for the awesome tutorial!! Definitely subbed!
Awesome, thank you!
Thank You SO Much For MAking This Awesome Tutorial For fRee
perfect! i'lm loving yours energy guys! keep going
Thank you so much!!
Thank you very much. I know how much hidden work is behind this video. Much appreciated! Where did you get the Patrick Stewart model?
Awesome, super easy to do. Can't wait to see what we'll have in 10-20 years
Dude 10 years? Man jus wait for 1-2 years this is gonna jus keep gettin better!!
@@badxstudio Yeah, 10-20 years? FFS, I and millions of others might and will be dead in 10-20 years. Things are moving extremely fast right now, and there is no reason to wait a day let alone years to see how things are "better". There is no excuse to not start making cool things right now. You can use the cloud to use a computer so you don't even have the excuse of not having a computer. Kids these days don't have a clue how easy mode they have everything!
I get your point though.
@@vincestevenson9430 couldnt agree more 🤟🏼 crazy times we live in and no excuses
The beest tutorial for thiss, thanks!
Glad you like it mate 🫡
Agsolutely amazing!!! 👏💎
메타휴먼 관련해서 가장 멋진 채널 중 하나입니다! 재밌으면서 실용적인 컨텐츠 앞으로도 기대합니다
This is SO cool!
I know right!! Just imagine the possibilities now for the Music industry!
Hello Guys! great video this has helped me a lot!
I have a question, I have a turtleneck on my character which is plugged into the Torso mesh, how can I make sure the cloth neck region also gets the info from metahum animator? as this currently only gets the info from body anim sequence and therefore get intersections :S
Thanks in advance!
This is so good, and easy to follow!
My brother
love the work brother, b y the way i recognize Iranian accent anywhere, proud of you man
Thanks bro ... and you guessed it right :)
This.... Is ... Crazy. People could make an easy Animation with this🤯
This continues to blow our mind!!!!
This is so amazing!
No you are breathtaking!!
oh hey thanks for the shoutout guys-- you rock :D
Hi!! Amazing content!!
I wonder for any advice for troubleshooting these three issues on Metahuman Animator:
- “Promote Frame” randomly jumping to a different frame than the selected one.
- Metahuman Identity Solve not accurate result.
- “Add Teeth Pose” breaking the Identity Solve even more.
Any ideas?
Thanks a lot!!!!! Awesome channel
Love that part you guys cover your local network Ip address to avoid any hack attempt and protecting your privacy :D
man we love the perfect videothat no other one created thanks alot
Glad you liked it
Hey Guys. Nice Tutorial. I still have a question. When it’s all set and done and I try to tweak my facial animation by baking my face to the control rig in sequencer, the face expression freezes/ doesn’t show anymore. Any idea how to fix it?
Make sure that in the sequencer, where your FACE is, delete the CONTROL RIG LAYER.
There must only be ONE layer under face. That is your baked animation :)
It is. My eye sight is kind of messed up. So i try to bake the animation to the face Controller rig but then it freezes. Maybe because of the switch in the animation mode? „Use animation blueprint“?
Cool, now let me try to do this again wiothout following a tutorial :D . . . . This tech is amazing but damn it's a hell of a lot of steps... I'll have to do this 20 times before I can do it fluently. Great tut guys!
best unreal engine Tutorial in the planet
Hahaha love u!!! We got ripped doing all the metahuman scene exports 🤪🤪🤪
Thank you for the tutorial! It is one of the only complete mocap ones.
Just a quick question, my 3070 always freezes when I get to baking the animation of the head. Is there some way I can fix that?
thnks for this video's bruh i wanted create realistic animation and u helped a lot 😉✌️💓💓💓💓
U are absolutely welcome ❤️
daaaaaaaaaaaaang!! This one is EXACTLY waht i needed
Hellllll yeahhhh
It's a good day when Bad Decisions uploads!
Honestly if a video doesnt get a comment from shelf then the video aint good … ❤️❤️
best tutorial and narative
Thanks.. happy you liked it buddy 🙌
best tutorial ever
Thanks! It works !
Amazing tutorial!
Can you please make a step by step tutorial on how to use scan-based texture to achieve maximum likeness? 🙏
Seeing Patrick Stewarts head in this detail, is incredible!
Hey guys, this is a stunning tutorial! I learned so much from it, so thank you !! I have a small question. Is it possible to import the animated metahuman with facial animation into your scene? and make it into a BP with a skeletal mesh (the auto-rigged metahuman) and attach an animation (UE defult animation + facial animation ) ? Great content again !
Thank you it is amazing and thanks againg for pricesless informations
Our pleasure!
No haunting! Sub'ds. Awesome work. Much appreciated.
Honestly, what you do is incredible, it helped me too much for the projects I'm doing, thank you very much and I hope you continue with this incredible content, greetings from Colombia
Ma maaaaann from Columbia!!! Glad you enjoyed it broski. Listen we are just starting out and doing thiis full time so expect LOADS of content comin at ya!
If you dont mind me asking what kind of project you are working on? And also what other videos would you like to see next from us?
so good haha, thank youuu
Broski we did it for you
You rock !!! Thanx !!!!
Glad it helped!
thank you for the tutorial, how ever I have a lot of problems tryng to solve the connection between my Iphone and the computer, it doesn't appear available in my unreal viewport even when is working with my livelink animation.
I have try to do it manually, but it seems to not be possible i alreadey updated the IOS to the last version,
Great tutorial - thanks for this. However, the tracking data Im receiving is quite..terrible. It seems that the bottom lip of my character constantly pulls back which results in a massive overbite - one eye is always slightly closed more than the other, and it is impossible to replicate an angry face. Do you have any suggestions that I should try? Currently in a well lit room with my phone on a chest mount. Would love any feedback!
Hey thanks for the great tutorial! At 11:00 Its suppose to automatically show the sequencer? But I'm still in my content browser, do you perhaps know how to solve this?
Cheers!
trying to make my own open world story game with 0 experience it’s going to take years but with things like move ai and this for storyline based cutscenes will make my life a whole lot easier
Thank you so much for the tutorials you guys are my number 1 source for metahuman knowledge. can you please tell me the render settings you´ve used in Movie render queue? I always have to much noise in the shadows from hair or problems with hair physics when using anti aliasing. do you even use AA or is there another way to get high quality renders with metahumans?
Yes! Now I can take my tiktok NPC business to the next level!
Gang gang
Lol :D :D Gang gang ... those were some of the weirdest videos we've watched!
Hey guys have used this for months and I'm so grateful for your genius problem solving skills. Having some issues in 5.4 though, have you run into any yourselves ?
I'll be glad when all this cool MetaHuman stuff actually works on Macs.
I love this tutorial and everything works perfectly, one small thing, maybe someone can help me out. After disabling the Post Process Blueprint on the face and fixing the blend shape of the head. I can't see the facial animations anymore. How can I fix that? (I am using the idle animation from the 3rd person BP)
Basically the baked animation that was recorded on my iphone, the face, the mouth, all animations stop after I disable post process blueprint.
It looks amazing :D I noticed that you have mentioned IPhone only. What about Android users?
God damm this is so good !
Juan thank god you commented if you didnt we'd be sad :(
great tutotiral
Thank you 🙏
Awesome.
Thank you! Cheers!
thanks for the wonderful video!🤩
request: can you show how to animate the face of the character that I created in Blender?
And how in general should this process take place CORRECTLY?🥲
I tried but my textures are not working correctly in UE😓
You are absolutely welcome
thank you. Just a couple of things to make your life easier: you don't need to change the identity or bake it. Simply export the sequencer and the animation will be on the control rig. You can then apply it to any other face without any additional steps. You don't have to go through the retargeting process at all. Just export the body animation as an FBX, then import it back as a Metahuman base skeleton, and you'll have your body animation ready to go. I will have a through tutorial soon on my channel.
i dont get this :P for which part are you taking about ?
I don't understand this, can you elaborate? Checked your channel and there isn't a video describing this.
@@poppi3362 for the face. don't do any baking just export the animation to control rig and for the body after savin the animation don't do retargeting export the animation file as fbx and then import it while importing make sure you select metahuman base skeletal
@@Metarig export to control rig, what do you mean by that? I am able to export the animation in the performance file but where else do I apply it other than the sequencer? Maybe a short video, even if unlisted, would be easier as I am not that familiar with unreal.
@@poppi3362 ok bro the next video will be about that
This video just earned you a new subscriber, good job fellas 🤌🏾
Thank you brother! Welcome to the Bad Decisions Fam :)
That's some strong coffee right here.
Great tutorial guys!!
Thanks
how did you get a good lip sync? Any tips on improving the accuracy? Is it possible to control and manage the eyes separately in order to,follow the camera?
Outstanding video. Now I just need to know how to add clothes and I’m good. 👍🏼
Thank you for the love!!
yeap clothes is another boss of its own. Do you know marvelous?
@@badxstudio no, I used iClone Daz and Blender so, it isn’t difficult on those platforms. But I’m trying to transition to Unreal which is more industry standard.
I can show you clothes
hey guys, great tutorial thanks! I have everything up till the end of this video but im having trouble exporting it to maya onto the bridged asset, using snolands github tools, dont suppose you have any tips? can i export it from the level sequence or do i need to convert it to a animation sequence somehow? any help greatly appreciated!
Hey mate sorry but we’ve got no idea for the maya export
I have a live link metahuman animator take which needs a jump cut (I ended up cutting out part of the dialogue) at what point in the process should I do this editing?
I have completed the animation, but as a result I am having trouble in rendering and making it into a video, how can I do it?
😂😂😂 apple getting slick to collect those face profiles.
The MetaHuman Plugin seems to be windows-compatible only and I'm running a Mac. Is there any work around to this?
به به یه ایرانی میبینی آموزش انگلیسی خفن میزاره ادم عشق میکنه❤❤
Hhahahah merci dadash asheghetam
After 7 months after I watched this tutorial I bought an iPhone only for this. I am re-watching it step by step again 😃
Were you able to connect to your phone in UE?
I only get the realtime version working, but the saved sequences won't appear. I don't know...
@@meskalation Yes, I tried both. Better results are using the pre recorded video
@@AlexisRivera3D Thanks. I assume that, but couldn't get access to the prerecords. I'm sure i mess up something in the connection setup :/
@@meskalation use ipv4 address
HIlarious :D!
Thank you so much for creating this tutorial. It is very much helpful and latest.
Is it possible I can do it without calibrating my face?
I am trying to make a fun mirror in which you can come against a LED Screen and stand (Camera is there to record you - high processor computer is attached). Do whatever you want in front of the screen and a avatar will mimic whatever you do, without calibrating to that avatar. Avatar will be same for all so no need to change the avatar. but there will be no time for calibrating each person. is this possible? how? can you please help?
I think they have a video on that, i watched it recently
Been loving this channel in the last few weeks, guys. Keep kicking butt. I do have a question: I can get the animations and blending working as you describe, which is awesome, but every time it works, I seem to lose the connection with my groom binding for my metahuman. If I reconnect the binding in the MHP blueprint, I lose the head / body connection. If I fix the connection, I lose the groom binding! I'm going around in circles 😅 Any advice??
Hey buddy thanks for the love! Lol hahaha that sounds horrible sorry brother! Listen no idea why thats happening but im literally replying while in bed… if you can join our discord we can try to figure it out together tomorrow?discord.gg/J2FbSqBB
@@badxstudio Will do!
I get an error at prepare for performance it says " machine has less than 64gb of memory to run performance preparation and to go too fast prepare for a performance in meta settings in the metahuman plugin" I can't find the meta human plugin preferences anywhere???
Having issues with 5.3
Disable post process blueprint will freeze the face
Can't wait until you can use the Apple Vision Pro with Metahuman.
Imagine being in the scene with the cgi metahuman actors, like standing next to them.
Acting out each metahuman. 1st the main metahuman that drives the scene, then you change to act out the other metahuman characters.
Hey guys your tutorials are really helpful. In this particular one I've a issue with head movement when I switch calib face mesh to my own metahuman face( @ 8.35 ) I lost the head movement. Dose anyone have the same issue ? I'm trying to fix this but not able to get head movement back.
I have kind of the similar problem but worse. My custom metahuman even with the applied baked animation the head either moves and no facial expressions or nothing happens completely. If you figured out the issue do you mind telling me too, thank you.
I lose the neck movement as soon as I switch the Skeletal Mesh to my Metahuman, any ideas?