Meet MAVE: the virtual K-pop stars created with Unreal Engine and MetaHuman
Вставка
- Опубліковано 31 тра 2023
- Find out how Metaverse Entertainment used MetaHuman and Unreal Engine to create a natural, believable, and charming virtual K-pop band, and in the process, produced IP content in various forms.
Read more at: unrealengine.com/en-US/spotli...
#UnrealEngine, #virtualproduction, #digitalhuman, #Virtualkpop #MetaverseEntertainment, #UE5 #MAVE:,
Metaverse Entertainment is a company that combines the technology of Netmarble F&C and the sensibility of Kakao Entertainment. Founded in 2021, our company has talented individuals coming from various industries, including games, movies, and entertainment. Through their experience and collaboration, a group called MAVE: was formed.
MAVE: is a meta K-pop band. We aim to develop attractive characters with all new appearances, as well as working in various forms of content and media, also providing fans with interactive experiences.
Considering the visual quality, which is comparable to offline rendering and the efficiency in making various types of content from a single source, Unreal Engine was our best option. Unreal Engine truly helped us to produce a music video in a short period of time with high-quality visuals.
Unreal Engine enabled us to create the large amount of content we needed for social media channels without compromising the content quality. This has helped us build a strong foundation for MAVE:'s transmedia storytelling through constant communication with fans.
A four-person K-pop band requires each member to have a unique personality and an attractive appearance. As well as the appearance, it is important for the members to be able to express characteristics and detailed facial expressions reacting to various situations. Even a single facial expression requires repetitive and time-consuming tasks such as modeling and rigging. MetaHuman technology has been the perfect choice. MetaHuman is built on decades of accumulated Digital Human creation technology.
The facial rig enables us to easily create detailed facial expressions for a desired character, as well as share animations with multiple characters. MetaHuman's high degree of compatibility with external tools makes it possible for us to share animation mesh data with them.
This greatly reduced the actual production time. Rig Logic is an advanced character customization system in MetaHuman. We had the benefit of the Rig Logic white paper in developing the functions we required effectively.
The character production cycle consists of character planning, modeling, facial expression creation, and rigging, hair production, body correction, and more. Character planning was conducted in close collaboration with the experts from Kakao Entertainment, who have a great deal of successful K-pop band planning experience.
K-pop band members are created with a combination of an attractive basic appearance along with matching style. In traditional K-pop bands, the members are selected from existing trainee pool and their final looks are finished up with make-up and styling. Virtual bands have a big difference in that new members have to be created from scratch, including their appearance, expression, movement, and tone.
We built a pipeline that uses a GAN network to automatically generate desired images and modify or combine eigenvectors to provide an environment as close as possible to the original one.
This allowed entertainment experts to select a character whose appearance ideally matched the formula of a successful K-pop band and then modify the character as intended, utilizing their knowledge to the fullest extent.
In the stage of creating and modifying facial expressions, we analyzed the model and developed our own tool that automatically creates about 800 facial expressions by employing information of the location and size of each area and the flow of muscles.
In addition, we created a function that can customize a unique expression that reflects the character's personality and characteristics.
As rigging was required for a facial expression that did not exist before, Unreal Engine's Control Rig was automatically created and configured to suit the character.
Since the Mesh to MetaHuman Plugin hadn't been released yet, we developed our own tools and features. This experience helped us a lot in modifying the algorithm as needed and building an automated pipeline. We used Maya's XGen to create the character's hair. Through Unreal Engine's groom hair rendering, we were able to obtain hair quality comparable to that of offline renderers.
We created a tool that turn groom-based hair into a card and used it according to performance, and then optimized the work process so that it automatically created cards without binding assets.
We also applied automation to the body correction stage and modified the shape according to current pose, utilizing dozens of correction shapes.
.... - Ігри
This is. . . Fascinating and unsettling at the same time.
It is a bit unsettling, but... I don't think it is as bad as the entire addiction-formula behind pay-to-win games.
It's no different from vtuber and vocoliod, but still it is what it is.
You could make them look like whatever you want but all 4 of them basically have the same face model with different hair.
which is pretty accurate to real life. all those irl korean idol looks like they have the same plastic surgeon
On today's racist 🤌🏾
You can import your own head...its bullshit to claim that metahuman is limited to any type of face
This faceshape is called ulzzang...and is popular within and outside of korea
@@7WhiteSword its batter if look diffrent in all times..like climate and shadow things like we human felt...hope future animation have tools like ai to create same thinds we human felt..
Watching them in VR would be cool
I can recreate this work in Unreal in a WEEK. But I WOULDN'T FORGET THE EYES! They look soulless...
Yes, more dystopian feature please, thats exactly what we want
yes I do
With all the movies TV shows etc trying to warn us I kinda figured wed be safe but seems like people are leaping into dystopia like there's no tomorrow. Virtual bands? Yes please, AI art? Why certainly
Vocaloid has been around for a while and no one bat an eye. AI re-surface for a year and everyone loses their minds.
Don't worry about dystopian future since you won't be a part of it anyway.
sure... "dystopian" 🤣 "poor of us" 😂
please create more tutorials for this topic!! All you need is to create more tutorials!! UE, I am calling you!!!
MMD with higher production value and newer tech/workflow. Nice.
The fact that there's so much unreal expectations from kpop idols these seem perfect for this perfection obsessed audience!
This comment is as true as it is sad
I wish to stay updated and create a building for Unreal Engine ❤
That is a gold mine. I really would love to see an panel with this team teaching how they did the steps of metahuman animating😮😮😮🎉🎉🎉🎉
Metahuman is an step on future😊🎉🎉🎉
Motion capture. They are adequate at the technical side but not so good at the Art side. They all look like the exactly same character (because they not character artists). They rely too much on the tech. I've worked in MetaHumans since they existed. But i've also worked as a character artist for twenty five years. There's no way I put out four characters that all look like the same character!
But what madness 😮 just like the collaboration with 7ds grand cross and mave was something unexpected 🧐
incredible even the guy speaking looks real😂
Haha, this should be top comment
HAHAHAHAHAHHAAH
I also have a virtual band made in Unreal Engine! 😌
So the people who are voicing mave are not the same with people who do the dance moves in their mv and music shows ? Or am i wrong ? Please correct me if im wrong, im still trying to process the information from this video
there totally was a movie about this in like the 90's xD
Happy Gilmore? Clueless?
S1M0NE (2002) starring Al Pacino, Catherine Keener and Rachel Roberts as Simone
wow...
Why the level of dislikes? This looks awesome.
The fact that we basically had to launch MAVE because KDA have been dragging their feet for years says it all.
Wow! These look so good and the movements are fluid. I've created a few videos with the metahumans and they are amazing. I can't wait until mine look as smooth as these animations done with mocap. Superb work!
Have you heard about motion capture? Have you seen Avatar movie? It's easy and not expansive.
@@UnrealQWthe same avatar movie that was the most expensive movie in hollywood history? it does cost quite a bit and is hard to make look this good
wow!
Nice!
Really, really hate to nit pick cause this is awesome and yet...something about their movements just seems to fall in to uncanny valley territory. It looks as if their is no flesh under their skin so the effects of gravity and mass on the body are missing.
Yep! There is no fat displacement!
They have cloth and hair physics, but their arms, legs, and other parts are stiff unlike real people
But they can't fan meet, but how lucky no sasaeng in there
Reminds me of the film Simone.
is that was team flaw or ungine ? i just learn to ue . in this video the hair feel so weird
Viiiiiconnnnn
I'm a 3D artist and all I have to say is that this is getting out of hand. Is the "goal" to develop "charming" characters? Or create silly, addictive, extremely fanatical people who say, oh, here's my idol."
The goal is to sell a product. Pop music has been about making money for a long time now. Even when theres a real human presenting the music and dancing, its typically just a manufactured product. Written by someone else choreographed by someone else, mastered to sound better than the person can song, miming during live performances, its all just about making a brand.
With this, you cant work one person to thw point they go crazy and have them have to deao with the fame. They can just pay dancers, or animators, they can use ai voice generation before long. This is just thw job of popstar being replaced by "robots". Just like a worker in a factory gets replaced by a robot.
Ye this genre of music is pretty much souless mass produced by computers idk why so many ppl like it
@@tux_the_astronaut you have no idea what you are talking about
Hmm as they say in the industry "sex sale"!
Any vr content in the future?
when blender users see people using maya and zbrush with unreal, A war is going to start here...
3ds Max actually! :)
Zena!
This is really Amazing 👍👍👍
What game at 0:16
Wooo... 😮 Really "khatarnak Graphics"
This is interesting
lóoks like they going to replace kpop to virtual lol
Finally someone made it happen great job team these look great!
Why somehow I feel you had something to do with it! :D I would suspect You above anyone else : >
@@3sgamestudio cringe
@@3sgamestudio hahahahaha thanks man
Sadly IMO they fall into the uncanny valley trap .. they are trying too hard to look real but falling short of that, whereas something like KDA embraces the stylish look and unique designs of the characters and doubles down on them, which is why I still think they are the best virtual K-pop girl group so far.
What group? I see the same exact character with 4 different hair Grooms...
what are they doing? are they flexing?
Models require more real human guidance per keyframe for movement and less interpolation. Why are you ignoring this? The lack of attention to detail is holding you back. Just train an A.I. to manage the interpolation issues between keyframes for human recognizable movement. Let the A.I. direct from your curated corpus of kpop dance performances. What is the problem?
불쾌한골짜기가 뭔지 정확히 알게 되었습니다
There it is dude. There it is. The Future is here.😆
Would be interesting to hear their songs, the background music sounds a lot like KDA.
Lmao didn't we get a black mirror episode on why this will turn out to be a bad idea once AI reaches near-singularity?
Yeah, it's really impressive! But I also get why people are a bit... suspicious about how this product will affect the mental health of the overall population... still, for the most part, this looks like harmless, well-executed entertainment - and clearly not as bad as Pay-2-Win games.
nice move, Epic, nice move 😊
Robuts coming for our jerbs
Though I suppose this gets rid of the creepy stalker fan problem...
WTF? Why no English translation?
closed captions works
All that power of tech and this is what you came up with....? *takes toys away*
"Go to your room!"
хочу с вами сотрудничать
这张脸不是杨超越吗
So first, they dont all use the same face model. Ppl have this thing. If you dont regurally interact with people from other races. They all look alike to you. Beyond that you can easily tell they arent human. Their eyes are dead. That said, still really good work. Havent messed with metahuman. Im more into stylized designs & characters. Seeing this does make me think I should check it out. UE5 has been crushing it for a year+ now. Keep up the good work.
Im sure it wont be long till someone takes footage of peoples eyes and creates an ai model of how to animate eyes in between main movement animations to make them not feel so dead.
@@ge2719 Yep, the tech is like 2 years old. We haven't seen anything yet
White people look alike to me.
I am a Character Artist for 25 years and work in MetaHumans every day (I bring them to life with AI) but these look like EXACTLY the same face copied 4 times...
@NextWorldVR If that's how you feel. I'm totally fine with that. I zoomed in and looked at their faces. Jawline, chins, noses, and lips all look different to me. Look, I can go. I've been making art for 30 yrs. New to metahumans, but I use UE almost daily? But how does that change how you feel or what you see? Your opinion is as valid as mine, but it doesn't change what I saw. So, respectfully, I'm unsure what you're trying to get out of this conversation?
No thanks, I prefer K/DA xD
Weird. 😐
🫥
❤ beautiful 🥰😍
Bruuuuh lolll
They created a tool that turns Grooms into cards? EPIC MADE THAT and 3ds Max, Maya, Blender and Softimage before that!
As a huge kpop fan, I don't like this. KDA is fine because it's game characters. Creating fake girls with fake personalities is not okay with me. I hope the singing voices and dance moves are not being done by real people.
But everything is already fake in the kpop industry
Girls just have the personnality producers want them to
Ehhh, not really interesting tho.....
just remember guys, THEY ARE NOT REALLLLLLLL!!!
Ok!?
All i can think of is dark it's better to leave the comment section respectfull even though i hate k-pop stars
Rule 34
Great! Now you we make realistic 3D ai-audience that will listen to this empty pop cringe.
Cruelty-free kpop
Cringe.
ew k pop stans
VATA A JOKE!!!!!
nope
Ha Ha, the sims have more personality than the real k-pop girls, and that's not saying much. What a great metaphor for the whole of the k-poop industry.
Ew. Just ew.
Yikes