MetaHuman - Real-Time Facial Model Animation Demo | State of Unreal 2023
Вставка
- Опубліковано 5 тра 2024
- Unreal Engine 5's MetaHuman is getting a new update called Animator to create new fully animated facial models in real time with just a phone camera. The team from Ninja Theory, including Senua actor Melina Juergens shows this process in real time.
#IGN #Gaming #UnrealEngine5 - Ігри
I’m no game developer, but the fact that it took less than 5 minutes to do this is mind blowing!
But was this really captured on iPhone ?
@@Bananaz9xx yeah. That's not what they would use in professional settings, but with lighting adapters and the iphone's 3d scan ability, you can do amazing things with it. Like, your iphone can literally scan your whole house and render it out in real time. It's fkn crazy!
Don't judge yet, we need to see this real-time when released, so everyone will make a video about it if it's true or lie.
@@FantasyNero It's not a matter of if the phone is capable, as doing research shows that it can. It's a matter of whether or not Epic can make the software to do it.
Yup UE5 is quite à technological milestone for the industry. A lot is going to change in the background. People might not see it through games and shows/movies but it will be used in a lot of production pipeline now.
It's hard to overstate just how incredible it is to get to 85% finished facial animation (especially since it is now easily editable with animatable controls) integrated into the pipeline in around 3 minutes of real time using a freely-available engine and only a phone camera for the capture. They're playing it cool, but this is a serious flex.
3 min for 85% of a 9 second shot.
honestly id say its above 85 the movements almost perfect, but it’s rendering in real time. absolutely insane.
@@ThatGuyMata Its free
@@ThatGuyMata yea its great
That cleanup though!
That deserved a standing ovation. This is so impressive to be able to render this level of quality animation in only 5 minutes.
Everyone is overwhelmed with all the innovations happening all the time. We can't keep acting surprised and blown away every 5 minutes.
@@jmasked5082 bro is not excited 💀
@@jmasked5082 because it doesn't look like your as passionate about it as we are
Metahumans are not game-ready. And they will not be game ready for a few years at least. They TANK the performance of your project. And that is before optimizing with LOD, adding facial animations or adding hair physics. Yeah its cool technology. But Unreal Engine 4.26 without Metahumans is the meta for indie developers. Haha did you see the pun there.
And using a phone as the capture device.
This is quite amazing.
You know what they need to do? Go to visually pleasing places and take a stroll and record it, take a recording of people talking, record a couple. Then recreate the scenery and model and animate them in a similar fashion. Then put them in any order and see how many people can spot which one is the real and which one is the Unreal.
That idea is unreal
TM
you're hired!
It's not perfect but this is incredible for how much time this saves and how little needs to be adjusted
What nickpick do you have clown
True, but imagine that you can have high quality close-up while you talk with literally every NPC in some RPG... Insanity.
No worries AI will fix it by next week.
Well, they did do this with a cell phone.
@@korinogaro the only thing really missing for NPCs are human like behaviour. Imagine if NPC act like humans? Hopefully as advancement in AI, we would see it applied in game where there are a billion parameters the NPC can act like at all times.
This is gonna be huuuuuge for low budget projects, amazing
which will never come out in the frst place
@@rokpepeshogun Spiderman lotus reference
So now we will have better corn animation?
For everyone really
neil breen might be able to make even more amazing movies
This brings AAA animation and graphics to the hands of indie game developers. The future is looking so exciting!
Or boring and repetitive
@@jhinabloomingflower807 will see tho
Its looks dystopian and evil tbh
You miss the point. This technology is boring and old without AI-NPCs
Wait till AI takes away your writing job too...then AI will do all the 'developing'. No humans required.
It's absolutely insane how quick that process is. With maybe 10-20 more minutes you could pretty much completely clean up the animations and smooth everything out.
Really excited to see what independent filmmakers do with this tech
One man movie... you can create a whole movie alone. Or from clips on the internet. :D
You won't watch it, even when they do. There's so much content out there now, no one has the time.
Zumeckis enters the chat
They don’t need to hire actors.
@@badpuppy3 you're boring
Eerily scary to see that from just a short period of time,from 1990s' onwards,technology has progressed immensely.
Right? 50 years ago was when Pong arrived.
Why is everything going so fast
@@jojothepro15 Technology will keep expanding exponentially. Especially now A.I is becomming to become a thing. It will actually go faster.
@@jojothepro15 Gotta go fast!
@@jojothepro15 That's how technology works. But still... not fast enough.
we are near the peak of graphics. What more could you possibly want more than this.
Wow, 2023 is off to a great start with all the incredible advancements in tech! From AI to Unreal Engine 5.2, this year is already shaping up to be a wild ride.
Holy crap! From months to minutes… Games in the coming years are going to be absolutely insane
Let's hope that games will come out faster because nowadays it takes them forever.
@@Rapunzel879 that's the aim of many of the improvements made to unreal. hoping for the best but even with all these advancements, I'm unsure games will come out much quicker.
@@Rapunzel879I’d rather have them take forever and make a masterpiece, than have it sooner and be terrible.
graphics aren't what makes the games fun, as we have witnessed in the last... 7-10 years
Lets hope the file size is smaller.. current game at least 20gb
David Cage : "Emotion is something complex and challenging to capture"
MetaHuman Team : "All we need is a phone a PC and a couple of minutes"
And a cup of coffee (not included for free in Unreal) Engine
A lot of complex things are being calculated by the phone and PC.
This is a crazy game changer for cutscene animation. Traditional motion tracking is still using reference to start from scratch, while this goes through 80 percent of the process and leaves only a bit of rendering left for the animators. Crazy.
4 minutes for that level of quality animation is absolutely insane. Can't wait for this
Happy to see Melina is basically the face of a bright-looking future for performance capture.
Following their whole process from making Hellblade, she became my favorite person with no prior cinematic experience be able to elevate the character they way she did it is exceptional.
She's gorgeous
@@darcksonrabelo1866 no cap
who is melina
That’s MIND BLOWING… even the smalles of studios have facial motion capture within reach now… what a time to be alive… Unreal is just giving the best tools to developpers right now.
2 minute papers ha ha!!
This could be useful for artists too, you could take a picture of an expression and showcase it from different angles and use it as a reference
Now that we have soundbites from people with the exact facial movements when they said them, it seems like in the future if we have vocal chord mapping, we should be able to also take quotes from people and change the voice to any person we want the same way they effortlessly changed the model as shown at the end of the video.
metahuman looks more promising than metaverse
Different technologys.
@@AlmiranteLobo yeah no s**t sherlock ☠
You do know that unreal engine 5 will be used for the metaverse and there is a tech called metahero that scans items.
metahuman looked like Mark Zukerberg tho' :v
WTF is "metaverse"??
I've been impressed with motion capture and performance capture for many years. But it's the first time I've seen it done in a way that doesn't require a separate room with trackers, many cameras and an entire team to make it go prrrrr. This is beyond impressive and should help even the tiniest teams to get some great performances in their games. Incredible!
Thanks to Jordan Mechner who started the motion capture way back in 1989, in a game "Prince Of Persia"
Uncanny-valley still evident but things keep on improving and it is highly impressive. There are nuances, particularly in the stop/start movements that look a little bit like the old days of stop-motion animations.
honestly, the slight smile seriously impressed me. That part looked the most human to me
Well to be honest
She herself was uncanny in the capture athe very first place
It's still in the uncanny valley, but just the amount of workload that's being cut out is amazing!
True. Climbing that valley!
For sure, but this can be hand tweaked to fix a lot of that as far as animation. However, think back just a few years to high budget CG movies like Beowulf, Final Fantasy Spirits Within or even Avatar and how close this gets to that in real time without armies of artists and with almost no budget. It's a huge leap.
the eyes still looks dead !
@@offlinegamer6756 cry to mommy
@@bulletsmichael Why are you butthurt?
The future is bright for Game development
Just wait until they implement AI into game engines.
@@Siranoxz Unity just added chatGPT into the engine
@@Irrelavant__ There ya go, it already begun..
Scary 😱
Sorry to be pessimistic, but we've been saying that for years and the quality of games has decreased. Everyone was saying ''future looks bright for gaming'' but then we just got disappointments.. The only game that truly reached the expectations from 10-15 years ago is RDR2. Most gamers expected that every game will have the same quality as RDR2 by now, but that's not the case. Even the most advanced technology is useless if the companies are greedy and the developers are lazy and have no passion..
for a process that would take weeks to get to this stage, forming almost instantly, it's impressive.
Whoa that's crazy. No dots on the face with just a phone. Insane.
Insane how far our technology has come in the last 50 years. Even in an early state this looks phenomenal!
Imagine what the next 50 years will be like.
50? Try 10.
50 years? Try 15 days.
@@SassInYourClass 15 days? Try 5
@@sandprince4165 5 days? Try 5 minutes
Imagine one day we have the opportunity to "upload" our face to a character customization process, rather than trying to re-create ourselves... 🤯
Combine that with the programs that can recreate your voice from just a couple of words and people could be playing as themselves.
You can already do it on sports games now at a lower level. Games like NBA2K allow you to scan your face with your phone and upload it into the game. Not nearly as detailed as this, but the idea is def out there.
The whole point of gaming is being someone else no?
So we can have better avatars for social media than the ones on our phones
@@dazshcan1224No
Now imagine this with a layer of ai diffusion on top while communicating through GPT-4. The near future is scary fascinating.
This has terrifying uses. Awesome, but also oh no what have we done.
IDK why people are saying the end result looks "rough". The result was on par with my many AAA titles today, and yet it was done in just a couple minutes using an iPhone. To get comparative performance with tradtional methods would take way more time, money, and skill.
This saves a lot of production time and is efficient.
The devs just need to focus on the finishing touches
Or focus on looking for new jobs or start their own projects
Finally. It's just crazy how game developing time is 2...7 years nowadays
Great work. It gets me woried about actor and actresses's future.
i'm waiting for the combination of Metahuman + chatgpt + whisper + text to speech.
the last few seconds of the capture looked the best of it all
If this tech was used in an online VR setting with more processing power you could have real time facial capture animated on your avatar. Getting closer to ready player one every year.
This was my thought as well. You've got to think that's next.
That would be a online game with quiet some minimum requirements, just for one feature. Unlikely financially feasible in the coming decade, because those games want a huge userbase, i.e. let it run on a potato
Sounds like you'd need a NASA computer for that
@@lgolem09l you could just turn it on or off
Amazing work guys!
-Phillipa Soo
“Exposing yourself to many kinds of art can only lead to amazing things. It helps you learn about your own art, your own taste, what kind of art you want to create for yourself.”
It is really fast to finish the capture…Awesome!
This is absolutely insane!!!! Congrats to all the devs that developed this tech as you are the real hero's here... seriously!!!!! Thank You!!!!
This is a game changer for creatives everywhere. This technology is going to unlock new levels of innovation for artists! Wow!
It is crazy how far we keep advancing in mo-cap! Truly impressive!
Feels like we're in the future. Gaming went from lovable pixel art to "life could be a simulation" in the span of
This will change the digital industry forever.
This is insane!!!!!
01:23 Angry while smile 😁 ❤
This is absolutely astonishing and is a massive breakthrough for animation technology.
everything ive been learning about animation and modelling over the last 5 years? defeated lol. the rate of development at the moment is really incredible.
Its rough for like a finished game but big budget games that will be using this stuff already has people that tweak little facial movements after they were recorded so this would DRASTICALLY shorten the process its actually insane
Insane how every year some tech company unveils their new stuff and each time I'm blown away
have you seen Ubisoft games? This is in no way rough! This level of facial performance is already better than many AAA games' already
@@alexdoan273 It's not perfect, but they didn't really take their time to make any adjustments, they did it in under 3 minutes, imagine if they took 10 minutes to tweak it
@@alexdoan273 Keyword "finished" no Ubisoft game is finished lmao
@@misterteee9471 LOL truth about Ubisoft 😂
Not sure if you watched to the end but after the raw capture they cut to a polished clip. The capture isn't lacking its the environment/lighting/Vfx work that puts it over the top.
This is insane... it's absolutely crazy to think how much this type of technology has developed. What a great time to become a game dev.
It looks mind blowing on the stylized characters! Game changing.
O que ainda não conseguiram chegar a "perfeição"...é de fato o movimento dos olhos!
Imagine video game performers doing their jobs without a mocap
This is still MoCap..
You mean without the mocap suit
@@trmbne yup its using Iphone to detect our facial structure, so webcam or android phone cant be use since the technology is better on Iphone
You know what Motion Capture is.. right?..
Happy to see Melina again.
Imagine for a moment you capture the facial expressions in 8K, 240fps... The level of detail in the animation though... Mind-blowing is an understatement!
Baffled me wordless. The time savings let alone the worktime-flow! Impressive! Thats gamechanging
That rig generation was super fast and the quality looks pretty amazing. Metahuman is truly a game changer the moment it arrived. Always happy to see it progressing beyond limits.
What a time to be alive guys! Now imagine old games like PoP with this features..
Mentions PoP, deserves a like. My man.
Prince of Persia?
mind blown! from months to minutes! technology sure is fascinating!
This is truly amazing! Awesome job!
This is pretty incredible for devs and creators, small especially in terms of accessibility etc, but large too for time and budget and such. Really looking forward to this tech being used more widely.
Well guys, after seeing recent developments like Robotics, Quantum computing, AI, Chat GPT, and now this there is only one thing to say
It's been nice to know you guys
yeah... humanity get a real speed up in tech advancement... scary times
Simulations within simulations, we keep going further and further inward
Luckily, batteries are holding everything back. As far as I'm aware, there's been nothing revolutionary in that area for years. As soon as there is, the physical world really will change. Robots with fusion batteries, uh oh.
Hey, I'm not a bot but in a few years? Yeah we're all gonna be married to in game NPCs.
Gentlemen, it has been a privilege playing with you tonight.
Imagine when it starts processing the facial actions realtime. It's going to speed up the conversion incredibly. 😮
keep the magic flowing guys! to infinity and beyond!
Wow. Extremely impressive.
The automatic rotoscoping alone deserves recognition.
there is no rotoscoping.... the tracking data its being placed on a 3d character with a 3d background.
Its not rotoscoping. That is different.
Rotoscoping is 2d animation technique and this is a 3d model.
Awesome! So glad she ended up playing Senua.
Stunning demo!
Looks like a big step towards getting past the Uncanny Valley problem. Though the different faces at the end were weird. That is to be expected from different facial structure.
This, along with the program that allows people to generate large simulated areas through AI will make it to where one person can make a full length animated movie or game by themselves.
Wow the technology of what it can do now is freaking Amazing!
This would not only revolutionize game design but pretty much anything else CGI related. Fantastic!
At some point they will release a video like this and reveal the presenters were actually the MetaHumans.
Epics killing it.
Just downloaded it from the App Store. It great!
WOW this has improved SO MUCH
This is incredible tech that is only going to improve over time. Indie devs and filmakers are going to benefit tremendously from this
Competition will skyrocket.
So, it's not perfect, but the fact that this could be produced so quickly is mind-blowing, especially considering this was captured on a phone.
In five minutes to transferred a scene. It's amazing.
Yessir can’t wait to play with this!!
This is absolutely AMAZING. Gawdamn!!!!!!!
This looks so cool. If I’m not mistaken the little kid model that they showed on the screen looks like it can be a character in the movie Monster House
The last one is the kid model in "A Boy and His Kite" - a previous Unreal Engine demo.
Thats just incredible! It always feels like when you think that you're at a point where you can use cutting edge technology than It's already outdated
they did all this in less than 5 minutes on a phone. Imagine what game studios can do with even better equipment and time to properly fine tune the facial expressions.
Minha cabeça explodiu com isso, meses de trabalho em minutos! Eu aplaudi junto com o público.
you guys witch extra time you saved you can tweek the animation better but out the box it looks amazing
I'm genuinely impressed. Bravo 👏
melina juergens is such an actor, amazing performance, always!
I'm not in a field even remotely in gaming but this is just incredible work
This is phenomenal wow !!
That was incredible!!
This is seriously impressive tech.
This will make cinematography so much fun!
Insane!!! Bravo to the developers!!! 🎉🎉🎉
Wow!! This is insane
amazing technology
wow! these are giving me goosebumps
This is easily the biggest benefit for me as an independent filmmaker in Unreal Engine
This would forever keep people alive no matter what age
Politics getting wild in 10 years
@@LouSipher It's wild enough now ffs
Nice. Pet Cemetery not required.
@@devinsidell It was wilder before. Someone legit made a horse a politician in the past.
Deepfake grandma doing her own funeral service.
Finally, Marvel can make decent cgi
LOL
😂
They wouldn't have created the highest grossing movies franchise of all time if they had bad CGi, but nice try ;)
And some how they still won't lol 😂
@@MatthewdangeR Marvel makes better CGI than Nickelodeon cartoons but not the best.