Animate MetaHuman Face with your Phone | Unreal Engine 5 Tutorial
Вставка
- Опубліковано 26 чер 2024
- Step by step guide to animate the face of your MetaHuman using Live Link face app on your phone and Unreal Engine 5. Plus, we showed you how to fix one of the most common bugs in MetaHumans at the end ;)
This is part TWO of the series "Create your MetaHuman". In the upcoming days, we will post the next parts which includes customising Mesh, Texture, Hair and etc.
Timestamps:
00:00:00 Intro
00:01:00 Setup
00:01:43 Connecting Phone to UE5
00:04:01 Record Face Animation
00:06:31 BUG FIX - Detached hair
00:09:14 FIX missing hair
Day 69 our daily vlog 🎥
Join our discord server:
/ discord
If you wanna see us to do cool things follow us here too:
Instagram: / badxstudio
Twitter: / badxstudio
TikTok: / badxstudio
LinkedIn: / badxstudio
Bad Decisions Podcast 🎙️:
podcasters.spotify.com/pod/sh...
Our personal handles: (if you wanna stalk us)
/ farhad_sh
/ farazshababs
/ farhads__
/ farazshababi
/ farhadshababi
/ farazshababi
#unrealengine5 #ue5 #metahuman #livelink #faceanimation #metahumancreator #vancouver #blender3d #canada #blender #photogrammetry - Розваги
Can you put the
Pt.1
Pt.2
Pt.3
Etc.
All in description
All the Metahuman Tutorials are in this Playlist
ua-cam.com/play/PLIn-yd4vnXbjwxPNYeHz4Ac3le_zIZc-P.html
Great job guys, I was waiting for this video and now I am waiting for the third too.
Third one is coming soon this week ❤️❤️❤️
great tutorial details about solving the bugs and all. Really Appreciate it.
No worries ❤️❤️ glad you enjoyed it!!
awesome!!! would love to see more content related to virtual production. especially on how to do it on a budget
That is a great idea! We definitely have that in the pipeline too so don’t worry it’s coming 😍
@@badxstudio maybe you gonna use the VIVE Mars Camtrack System?! #Budget #VirtualProduction
It's eerie how every time I have a question the bois have answered it in a video published LIKE THAT SAME DAY 😇😎💥
SAMMM!!! ma man thank you for the love
You guys are awesome, you've earned a sub!
Heheheh thank u
I have subscribed you guys to keep it up. Never stop making these types of tutorial.
Brother thank you for your time and trust! We will KEEP MAKING VIDEOS! Thiis is full time for us :) :)
Thank you very much! Just super, everything is simple and neat!!!👍👍👍
No worries at all ❤️ see you in part 3!!
You guys got me addicted to scanning people and turning them into Metahuman, and now I see this??! The journey continues 😂
Hahhahahahaah WE WANNA GET EVERYONE ADDICTED LETS GOOOO!
Part 3 coming soon
@@badxstudio part 3?! Can’t wait!
@@lewliteki Lol
Part 3: Customise mesh in blender
part 4: Customise texture in substance
part 5: Custom hair in blender
part 6: Attach items to Metahuman (Hat/glasses)
Part 7: Animate metahumans
Part 8: To be announced :D
loved it. And subscribed 🤭 because the last sentence sounded like it was an order for me 🤣
Hahahahahah lol yeah we had to force people
Great content. Good job guys 🙌
Suzanneeeeee you know we love you right???
@badxstudio You sure you don't have me confused with COFFEE? xD haha you guys are soooooo amazing 🩵
Thank you
very simple explaination
You are welcome 😍
Love the series so far! Will you have a video on creating custom hair not using the metahuman default hair styles?
Eventually yes! probably gonna try MetaHuman animator first and then customising the hair.
@@badxstudio Awesome! Yeah excited for you guys to do the animator!
Hey guys you are doing great stuff, making something educational with good sense of humour. I hope you get thousands of views which you deserve! Keep it up and all the best!
Wow thank you so much!! That means a lot we will keep workin to create cool shit for ya
bro u guys are crazy
Brilliant guys
Cheers ❤️
Before i try this what PC can i get to try this cos am using mini PC so can you tell me the pc to get??
So to get the voice you have to render out the sequence and add the voice track in post or can you add the voice track inside UE5?
Amazing video guys. I love your chanel. Are you planing to do a video showing how to animate and/or import body animations to the Meta Humans? Is there some stock animations available for MH?
Thanks buddy, for sure will do it in future
Awesome vid. In case anyone had the issue of "hey, my head movement isn't tracked!?". Don't worry, in the livelink app on your iphone, click the gear in the top left of the screen and enable ' Stream Head Rotation'. Voila babbyyy
Thank you for that extra tip!
i ctrl+f search 'head', i knew you will be here!
cheers bro!
This is really cool what you are doing I roam around in a wheelchair and i have just scanned myself so I'm going to walk around in the virtual space
I have a question for animation the app that you use Is it available on android
If not can you recommend another app
I think it would've been a good idea to note Live Link is only available for Apple users with Iphone X and newer or Ipad Pro (3rd Generation or newer)
its pretty sad that there isnt android version of this. Probably because there is no other phone that have a lidar sensor
Yesterday we create our metahuman with your first tutorial and it was great! I can send you some pictures if you want. Thank you a lot! ❤Just want to ask can we use android for this tutorial or it has to be an iPhone?
Ok first of all you are awesomeeee!! thank you for letting us know that the video actually helped.
WE WOULD LOVE TO SEE THE RESULTS! yes pls send it in our discord:
discord.gg/XZ3tD2Xf
Also as for livelink that app is only available for iphone and Ipad with TRUDEPTH camera!
For android you probably cant use livelink BUT there were videos of different work arounds to animate the metahuman face. Not sure what they are but we remember we saw videos before. You might wanna search that on youtube :)
Awesome, good job M F
HELLO, i am having an issue where LOD are forced set to 1, but in the sequencer there is no hair showing up, thats on only 1 map , do you know why?
Hi, so I followed all your steps one by one, double check and I have a problem, when I add the animation to the face on the sequences only the neck moves, but not the eyes, mouth or anything else, do you know why this could be happening?
Thank you for the video.
What should I do if the rotation and the direction of the head are not reflected when I play back the recorded animation in the timeline? (Sometimes the neck keeps fixed although the motion of the face is successfully reflected)
I have an issue like that when export. the head moves on sequencer but not in the export
arkit has 50+ blendshapes but i know metahuman has more than 700. how do you gain control to the full range of motion locked in the model ?
Epic! But how do you animate the face and use mocap to animate the body movements at the same time?
Body mocap is coming in the upcoming episodes of this series so don't worry we gotchu
@@badxstudio WE CANT WAIT FOR IT!
hi! in 5.3 the hair dosent stick to the face, like beard when animating... Do you have a fix for that? Binding asset dont work , it wont apply and just disappears from the slot.
Beautiful, I would like to know if I can create a face, a scenery, or a scene and then sell it as an NFT on a marketplace just like with any digital creation software.
I was able to do every thing fine, the sequencer plays de facial and head rotations, but, when i trie to render a cinematic, only the facial expressions move, not the head rotations.... What would be the probem. Thanks.
is there an Android version of the live link app, or do i need to go out and by an iphone just to do this?
Hi! Great tutorial but I have an issue in neck movement facial expression works fine but neck is not moving.
So in your livelink app go to settings and make sure NECK/HEAD Movement and rotation is ENABLED!
If that doesnt work I realized just creating a new project in unreal works :)
Does it works with iPad PRO? (with lidar sensors)
Awesome tutorial!! still cant get the hair though, followed the steps and seemed like it should work. Other than that everything works great!
Glad that it helped ❤️❤️ whats the problem u faced with the hair?
Also, enable the Groom plugin, or your metahuman will be completly hairless, not only from distance. And, at least in my case, enablling the groom plugin after downloading the metahuman didn't work, I had to redownload the metahuman from Quixel Bridge after the groom plugin was enabled. That in 5.3.2 UE version. I have no idea about other versions.
I can't connect my iPhone to the live link, I put the same IP, submask and router and nothing, nothing appears on the live link! Could you help me?
Any Android alternatives for 3D scanning and exporting, and for Live Link?
head movement works but once i record it and put the animation in the sequencer the head movement doesnt work only eyes and mouth move
does this work with android phones?
When I try to add my Metahuman to the scene it only imports the materials, textures, etc but not the mesh
Hey we checked and dont know why thats happening
Is there any way to do this with an Android phone?
Bro please answer after this animate how to use hand animation i mean hand moving
What the app you use on phone
can it be put in a model game created by me?
Live link is not available for android ! what can I do ?
hey you guys did what i wanted to learn, Thanks. but can you make a video on how can i make my character move (walk) so that i can create a story. cause character moving only head don't looks realistic. btw really appreciate your work.
Of course we can
@@badxstudio thanks i'll try this + wait for your updated video as well ❤
@@ShreyanshMehta-ov8ze Comin soon
Then how do you move the body
Hey can you make a full tutorial where you create a short UA-cam video using just meta human.. by adding background and scene
yessss thats a dope idea! Will definitely do that in the upcoming days
I can't import my custom Metahuman to UE5, I just click on Add, creates the folder but there is not mesh
Not sure why we're sorry
Is there some similar app for android?
wow soo cool دمتون گرم خیلی حال می کنم ایرانی های مثل شما رو می بینم
Thanks a lot dadash 😍
my characters head is not turning, what could be the problem?
This is a wonderful job, is it possible to do it with an Ipad?
Thanks a lot. The ipad must have a true depth camera. Only Ipad pro 3rd generation or newer ones currently have this
@@badxstudio I see, thanks for answering. I believe that feature is ONLY in the front camera for Iphones and Ipads, does that mean we can't scan animations with the rear camera?
lol yeah so easy and no single word about detouching head problem and rotatation issue
Ive been wanting to do this but don't have an iPhone. Might try to borrow a friends
My current project is low poly though so ill try it on my next one
Heyy so borrowing is a good idea since you can record it and give it back to your friend!
Alternatively there are some other android solutions, other youtubers might have covered it so pls check it out
@@badxstudio didn't know about Android solutions. Ill definitely check it out THANK YOU
Is there a way through Live Link being able to allow your character move its neck so it doesn’t look stiff?
You should have neck movement my man! Make sure in your livelink setting on your iphone turn on neck movement.
ALso if that still doesnt work, start a new project in unreal and try it on your metahuman again.
Anyways u shud probably check out our METAHUMAN ANIMATOR tutorial which has far better facial animation :)
Hmm.... Apple only - grabbing some old iPhone with iOS 15.8 latest installable version: Live Link App needs at least iOS 16 :D Isn't there some alternative to do the same on your pc with a simple webcam?
I can’t get pasted Prepare for Performance. It just errors and says failed.
What if the Angelina metahuman stops following your movements one day and starts acting on its own. Looking forward for day 213 when that happens!
Hahahaha dude we are gonna fken pin this comment in the video on day 213 when it happens bro
I’m having trouble connecting my iPhone. I’m on same network but it’s not working. Is there more plug-ins that I have to check? Thanks in advance
That's weird! It's hard to troubleshoot the problem like this.
Since it's been a day already have you found a fix?
@@badxstudio Yea my iPhone an SE. I need a X or better. Thanks anyway
Hi, I did the whole thing but I do have a walking Animation Asset and a Face Animation but the movement of the Face and Body is not synced so the whole body appearance breaks and the face clips out of the body. Any ideas?
In your sequencer can you just move the track for the face animation to sit at the position you want. That should help manually sync it with the body movmeent. Let us know if that helped
@@badxstudio it didn't help
So what I did is that I used the method you described but recorded the body as well
Then I changed the Body Movement to the Blueprint asset I recorded and the face movement (two separate animations created by this one recording). They should be synced because I tracked the body and face simultaneously... but it's slightly different (It's a scream animation and the face moves 1-2 seconds faster to the front than the body)
Need help, I can't move the metahuman neck but rest is working perfectly.
Adipurush vfx artists watching this tutorials😂😂
Wait is that Adipurush the movie???
Yo Faraz you look like Adam Jones from TOOL a bit :D
Hahhahaha really? :D
@@badxstudio not really, he looks like you! :D I really like yours channel
excuse me.... when i import animation, head is not moving... only face moving. I dont know why.. HELP PLS
Cant get the neck joint to move, my mouth eyes and eyebrows move but no face rotation :(
same problem
What phone model is needed at the lowest price to work?
You need an iphone or ipad that has trudepth! So any of them that come with that ...
عالی
Alternative for Android?
If anyone is having a problem where the expressions + neck movement all work fine in the Take Recorder, but the neck movement stops working once you add the animation in Sequencer - open up the MetaHuman BP, select the 'Face' component on the left-hand side, then in Details, make sure Anim Class is set to ‘none’ for the character BP’s Face component.
I am, the first time I used this tutorial it worked fine, now nothing works - if you ever find a fix please let me know! I am currently having a snoop so I'll do that same if I find the cause!
I found the fix - go to the animation properties and make sure 'Force Custom Mode' is enabled.
Thank you
yes!!! I've been stuck here for almost a week, you've saved my life bro!!!!
But i don’t have the version that you have i have the new version of the app in that i can’t do this can you please do it in the new version of live link
Make sure mode is set to "Live Link (ARKit)" or you won't see the live link target in settings.
The facial tracking works but when I add the BP to sequencer the facial animations stop? Really strange
Can you elaborate more? maybe we can help fix it
can you make a tutorial on custom body and custom clothes to meta Human
Yessssir! Will do ❤️
Title should be = Animate Metahuman with i Phone 🗿
hairs??? LET'S GO
Lol hair is juust ONE of the upcoming tutorials :)
can we able to make this with android instead of iPhone ????????????????????????????????????????????????
Wow😂 , please can you create your own character or upload your own character inside the app?
Hey!! We are making our own character. Please check out our PART 1 that we uploaded a few weeks ago :)
@@badxstudio please help me with the link
how can we import offline video in ue5.2
For offline video, you better use the MetaHuman Animato. We have a full tutorial here:
ua-cam.com/video/hZ2mkcd4C7M/v-deo.html&lc=Ugz9WDr_v81RhDVgzst4AaABAg
Is there any way to do this without Iphone? I only hv android.
Unfortunately not as of now
@@badxstudio ohk thanks. IG I need to start some side projects for marketplace :) RTX 3050 w 4gb vram is also not enough to run UE properly :/
can metahuman talk with a script we provide?
In next part tell us to import metahuman in blender please 🥺
That’s coming soon too! This week ❤️
@@badxstudiopls
I dont have the same settings in Live link on my phone
What?? how come? Whats the difference?
@@badxstudio I figured it out, just in a different place
is it possible to make if we only have human photos , HOW?
U can try a blender addon called FACEBUILDER from keentools :)
Great Tutorial. I tried. But Mouth is not closing. Teeth visible even if i am closing mouth. What is the solution?
Thanks a lot
For the 'Teeth' pose, you should make sure that the top and bottom teeth are together, with the back teeth meeting in a 'clench', and (likely) top teeth slightly overlapping the bottom teeth, and opening the lips so that the upper teeth tips are visible. In your pose, there was a small gap between top and bottom teeth, which can lead to slightly less accurate positioning of the teeth in the MetaHuman Identity, and therefore slightly less good quality of animation.
Thank you for reply. 😊
Does this only work with iPhones??? Is there an Android solution????
Ok, I've managed to import the face animation to the Metahuman and all plays ok in the sequencer, but when I export a render from it, it won't show the animation, only te Metahuman! What am I missing?
is this the new Face-Mocap technique, Epic Games showed at their show a few weeks ago?
no
No the new Animator update isnt out yet! But you bet we are going to cover the the second its out!!
@@badxstudio cool, therefore i leave a like and follow. Cant wait for it
Make videos using unity also sir
Dudeeee I wish we could right now butttt unfortunately our team is not well versed in Unity yet!
I don't want us to come and talk about something we don't know much about.
BUT we promise that over the course of our channel as we grow we will definitely be catering to the Unity audience too
This app works whit blender ?
Which app my friend?
@@badxstudio livelink 🙂🙌🏻
I'm not joking when I say that this tutorial can be made in under 2 minutes.
Yes and we have already done that :) we posted it as a shorts and insta and tiktok video! Some people couldnt follow the speed so we made a longer version
@@badxstudio yea and you made it just about long enough for what again? We both know it's not about the speed man. And we also both know why shorts exist lol.
Man I must have done this 50 times and live link still doesnt connect. Ive putinthe ipv4 address exact but my iphone doesnt connect. Why?? All plugins are activated.
Found out why. For anyone else who may have followed exactly how to connect but still can't. Go to your Windows network settings and make sure its set to private network and not public. This cured it for me. 😉👍
Glad you found the solution
MF was personal so i sub
holy cow i have to learn how to make an AR KIT FOR MY AKIDCALLEBEAST WTF
You know the blender FACEIT addon right?
@@badxstudio 😯
@@badxstudio I just saw a video on it I have to buy it !! Pretty crazy would be sick to use a trial of it to test it before I buy it to see if it’s possible to do it before I waste $100 🙃🔥 thanks broo
Sad that live link is only available for apple and not android
I know :(( Listen can you check youtube for android alternatives to animate metahumans? im sure there are ways!
do you need an iphone to do this?
You need a supported IOS device so we believe some Ipads are supported too.
We wished that android phones were supported but unfortunately many of android phones or maybe all (we are unsure) do not have a depth camera which MetaHuman Animator uses to calculate the super realistic performance and bake it into a sequence.
But you can always consider how expensive or unattainable the other alternatives for such animation quality is .... any head gear can cost upwards of $5,000 to achieve similar qualities and can be a hurdle. If you really need this level of quality you can always consider buying a second hand iphone juust for this scenario. Just make sure the iphone/ipad you buy is supported by MHA
@@badxstudio thank you for the quick reply and the tip about buying a second hand iphone. considering that this is free and the only cost to create these will be the cost of buying a second hand iphone is well worth it. I am still considering if I should wait till it becomes available on android (if it even does) or just buy the iphone. Love your content! Liked and subbed!
Is this released yet
This is released since a long time ago
@@badxstudio lol I should have watched it I thought to was the new Metahuman Animator and jump the gun
One of the super tutorials. But in my case, there are few bugs. 1.Metahuman is not pronouncing as I pronounce. 2.Metahuman's expression slightly does not match my expression. Please help me by suggesting a solution.
Hello hellooo!! Of course!
We uploaded a new video called "METAHUMAN ANIMATOR TUTORIAL"
That will give you MUCH Better animation! Please check that out :)
ua-cam.com/video/hZ2mkcd4C7M/v-deo.html&lc=UgwH6FkaqlaK8_h28at4AaABAg
Thank you for the reply. I tried that one also but it's not pronouncing as I pronounce. Is there any solution?
been trying to get it to work for 2 hours, but the only problem i've had is that my iphone will not appear as a subject
i've tried turning off my firewall
reconnecting to the same network on both devices
changing the unicast endpoint to my pc's ip
Hey so are you absolutely certain that your iphone and pc are connected to the SAME WIFI NETWORK! Not one on ethernet and other on a wifi.
Like literally the same WIFI and using the PC IPV4 address?
@@badxstudio yup, same wifi, using the IPV4 address, neither are using ethernet