Real-time Full Body Webcam Mocap in Unreal Engine - Dollars MONO Tutorial
Вставка
- Опубліковано 30 тра 2024
- Get ready to explore real-time full-body Metahuman motion capture using just a simple webcam in Unreal Engine! You might be thinking, 'What do you mean by full body?' Well, I mean face, fingers, and body - so yes, you heard it right, it's all possible with a single, simple webcam!
Join me for an in-depth review & tutorial of Dollars Mocap Mono. We'll go through its features together and I'll show you how to use your own Metahumans!
Download links:
● Dollars MONO - Unreal Engine Plugin - Control Rig for UE MetaHuman
www.dollarsmocap.com/download
● Sample Project
drive.google.com/u/0/uc?id=1E...
● Dollars EGAO (Free Facial Capture)
www.dollarsmocap.com/egao
● Dollars MoCap Documentation
docs.dollarsmocap.com/categor...
-----------------------------------------------------------------------------------
Chapters:
00:00 - What's Dollars Mocap Mono?
01:21 - Sample Project
02:18 - Features (Video Options)
03:37 - Features (MoCap Modes)
04:43 - Features (Facial Capture)
05:26 - Stream and Sensitivity Settings
07:10 - Part 1 : How to use your own Metahumans? (Body Capture)
10:17 - Part 2: How to use your own Metahumans? (Facial Capture)
14:18 - Conclusion
-----------------------------------------------------------------------------------
#unrealengine #mocap #metahuman #motioncapture #webcammocap #realtimemocap #metahumanmocap #dollarsmocap #dollarsmono #unrealenginetutorial #unrealengine5 - Наука та технологія
This is strange. the downloads do not come in files with the file names in your video.
I've checked the updated files. Your downloaded files now look like this:
"Dollars", "Dollars_Metahuman", "Dollars_MONO"
The only change is the removal of the "DollarsMarkerlessUE" folder, and now this file downloads directly as "Dollars"
In the video, I showed how to copy the "Dollars" folder from inside the "DollarsMarkerlessUE" folder into the "Content" folder. But now, things are simpler. The file directly downloads as "Dollars", so all you need to do is copy the "Dollars" and "Dollars_Metahuman" folders into the "Content" folder. Hope this helps!
Thank you for your coverage for this app. I really am thinking of starting to mocap soon and these kind of reviews of different products and services gives me a good idea about my options and price range.
awesome to hear it's helping you! you're welcome and best of luck as you dive into mocap 👍
Thank you for the explanation!
Thanks for sharing this amazing tool
really great bro, got it working by watching the vid a few times!
Glad it helped! if you run into any issues give me a shout
Alot of companies are about to be put out of business. Most of us have been just trying to find some decent waist up mocap options. This including the face makes it beyond amazing. I purchased a license halfway through your video. Thanks!
Happy you liked it, good luck with your mocap projects!
I love the ability to shoot with a good camera and then doing the mocap in post.
Yes, the winner is video footage... much better results than a webcam and more suitable for mocap.
@@duz_gen That's good to hear. When you already have good camera gear, it's nice to be able to take advantage of its features.
sweet, perfect timing as I start building our first public game next week. Perfect software for indies. Definitely going to purchase it. Thanks for bringing this into my attention :)
You're welcome and best of luck with your game. Happy new year! 🎉
amazing lord, i love you for you tutorial i need this
thanks buddy, glad you like it!
nice i like it good work
thanks man
wehen i put the folders into my project folder and i open the project they are not visibable... the programm is working but i cant find the folders in the content browser
Any idea how to record an animation and finetune it? I got it on Take Recorder, but i cant edit it to perfect it. Any idea how to fix?
can we record the capture for a metahuman and then record another one for another character ?
the blueprint inside the dollar metahuman folder is throwing a ton of compile error for me :/
Thank you for this insight! It would be also interesting to see how to integrate a custom made character (for exmaple in Character Creator 4) into this MoCap system.
Character Creator 4 offers an Auto Setup for UE which already includes the rig for body and face. I wonder if Dollars MONO MoCap system is able to work with this.
You're welcome! I think what you're looking for is here ua-cam.com/video/NDslO7iYeto/v-deo.html
good work but u can sync 3 camera in time for scan all pose from back and front and more camera for face reaction ?
It supports only 1 camera.
Thanks for the video! This is very helpful. Did you do setting IPaddress etc for BP_DollarsReceiver?
You're welcome! No, I didn't. It's already set up, you don't have to manually enter the IP address for anything
Is it possible to capture movement like playing guitar hanging on the strap? I mean when you're not 'playing' an invisible guitar, but really do precise movenets with your both hands and then add a 3d guitar into the scene?
It's good at tracking finger movements, as long as your webcam can see every finger. I'm not sure how well it would perform for activities like playing a guitar there could be potential problems.
This is a great tutorial, thanks so much! The only bit I can't figure out is how to capture the mocap animations with take recorder and then get them onto my metahuman. How do you do this?
Glad you like it! You can use window > cinematics > take recorder
Please take a look at this: ua-cam.com/video/xqTqWk1jUQ0/v-deo.html
Does this mocap record information on spine? Or spin will be stiff?
Yes it does but the spine mocap data will be different depending on which mocap you choose because each mode captures the spine data differently.
this is great, but there has to be a better way to set this up with your own metahuman than the process you described. if there's already a template project with it ready to go...no way to just migrate?
I was thinking about this idea while working on the video!😀 Tried changing a few files, thinking it should work but didn't get the result I wanted. Setting up body mocap is easy but when it comes to face mocap it takes a bit more time and seems a bit complicated. Perhaps dollars mocap might figure it out soon.
Is it possible to tweak the capchered data to enhance the quality ? Can you maybe make a tutorial on this??
Editing metahuman animations in the sequencer is possible but not straightforward. I'll consider your suggestion thanks
Was there not an option to move the mouth line onto your mouth position on screen? That could improve the capture and matching of your speaking and mouth expressions, no?
The mouth line is automatically adjusted by software, no tweaking allowed. In the new version, 'facial capture sensitivity' has been added, which improves the effectiveness of facial capture compared to the previous version.
can we use iPhone for Facial and Dollar for Body motions together ?
Yes, you can. Start by setting up a body mocap, then move on to a standard live link setup. If you want to get better performance for the body and head, just turn off the 'head rotation' option in the live link settings.
God bless you
While im first opennig the dollars mono app, the Unreal is OFF in the application, what should i do?
same here what should i do?
@@itzarcade5141 found the solution, go to the settings in the app and check the box with unreal ip, hope it helps you
@@itzarcade5141 Found the solution, go to the settings in the app and check the box where it say Unreal, hope it helps
@@itzarcade5141 Check in the settings in the mocap app if you have checked the box where its says ,, Unreal,, hope it helps
gracias capo sos un genio!!!
Hey, muchas gracias, me alegra que te haya gustado. Saludos!
step by step still having issues, how come some of the folders I download (name ones you did) have different names?
I've checked the updated files. Your downloaded files now look like this:
"Dollars", "Dollars_Metahuman", "Dollars_MONO"
Actually, the only change is the removal of the "DollarsMarkerlessUE" folder, and now this file downloads directly as "Dollars"
In the tutorial, I showed how to copy the "Dollars" folder from inside the "DollarsMarkerlessUE" folder into the "Content" folder. But now, things are simpler. The file directly downloads as "Dollars", so all you need to do is copy the "Dollars" and "Dollars_Metahuman" folders into the "Content" folder. Hope this helps and let me know if you need help.
thats amazing! it worked, purchased license through your link idk if youre an affiliate but just in case, definitely helped content creation for me today!
@@duz_gen
So glad to hear that! I don’t have any affiliate links. Best of luck with your content creation!
Hey your tutorials are amazing and very helpful for begginers like me 😄.
I have a question, How can i composite metahuman animation in real life footage ? Like some of the virtual influencers do? I tried to search on whole internet but not able to find any tutorial on it, it will he very helpful if you make one of those 🙌🙌🙌
Thanks! glad you liked it 🙌 so when you say "real life footage" are you talking about those super realistic scenes and virtual influencers like codemiko? drop an example, I'll totally check it out!
@@duz_genI meant footage(video) recorded on phone or camera, like filmmakers make CGI and VFX effects and merge it with raw video, one of the example is @lilmiquela
@@duz_gen I mean footage (video MP4 format) captured through phone or camera. Like filmmakers add CGI and VFX effects in raw footage. One of the example is @lilmiquela you can check her posts and reels.
My guess is that she uses real people in her pics and puts her own face on them with photoshop. If I were a virtual influencer, I'd do the same thing. Creating everything in 3D and making it look photorealistic? Tough job.
And check out her vids closely, those backgrounds aren't real spots, but 3D animations. She might be using Unreal Engine.
What are your PC Specs to run UE that smooth ?
Nvidia 3090, ryzen 5950x, 64 gb ram. For setup and system requirements, please check at 14:52
Is there a way to get the facial mocap data into Blender?
I'm not 100% on this, but if you save your facial mocap data in BVH format, I think you can totally bring it into Blender.
Bro, which camera are using for motion capture?
I'm currently using the Creative Live 1080p V2 but don't like its narrow view.
If you're looking for a wide-angle webcam, google it >> Spedal C920 Pro
@@duz_gen thanks bro
Which version of the Unreal Engine are you using?
Latest version (5.3.2)
How does this work with Kinect? Facecap?
This one is for the webcams, but they have another software for Kinect called "Dollars DEEP"
Whats the classical music name please
A Far Cry - Josef Suk, Serenade, Op 6
thank for the tutorial , The creator of this plugin should try to place some type of smoothing or some type of control of the speed of the animation in real time to have more control of the nervous movements. I wish he implemented this, it would be even better.
Great suggestion, thank you! Let's pass it on @dollarsmocap
Can I save the mocap animation?
Yes you can. Window > Cinematics > Take recorder
Take a look at this: ua-cam.com/video/xqTqWk1jUQ0/v-deo.html
how to render this animation after mocap
Window > Cinematics > Take recorder
take a look at this: ua-cam.com/video/xqTqWk1jUQ0/v-deo.html
Is it a one time payment system or is it a monthly payment or annual payment system of $99?
It's one time payment
@@duz_gen wow thanks
I also noticed a control rig for Daz 3D. Do you have a video going over it?
@@conciousnessofsteel6033 My channel mainly focuses on Unreal Engine so I don't have any content related to Daz 3D
Can i use it with blender?
Yes you can but there won't be any real-time integration. The only method for blender is to record the motion capture data as a BVH file and then edit the data in blender to create animations.
doing face animations and body animations separately has always made me very tired. i should definitely try this thanks
figuring out the best workflow can be a bit of trial and error. if you're using an iphone I recommend trying livelink + dollars mono. It's easy to set up and the results are pretty good
@@duz_gen I will try. thank you for the advice
@@duz_gen Can you make a video trying livelink + dollars mono?
💡🥳
Please show in iClone if possible
Hi, hope this helps ua-cam.com/video/SK10asjmwz8/v-deo.html
the thumbnail 🤣🤣🤣face fingers body 🤣🤣🤣
I'm ready to kiss you, my friend, there is no limit to happiness, thank you very much, there is nothing in official documents about individual dollars folders, and files are downloaded without these folders. You are a great man, thank you a hundred more times.
bro you killed rokoko directly
Haha, i'm considering a vid on rokoko's mocap software to see if it's worth the $240/year price tag
More than that, I'll skip buying a super expensive Iphone at the moment
why cant companies just use cameras and software's instead of having us spend thousands of dollars on freaking suits that could be a waste of money in the future
MOVE AI has a camera-based motion capture app going for $500/month and that's for the standard dual-camera package. The problem is it's pricey and you'll also need cameras or iPhones, starting with 5 cameras would be a good start. People seem to like it but I haven't tried it yet. I'm curious to know if it's as precise as the traditional mocap suits