Realtime Unreal Face Mocap (RTX GPU)

YOU NEED TO TURN ON OSC ON UNREAL TOO, I FORGOT IT IN THE VIDEO
VSeeFace: www.vseeface.i...
Vrm 52blendshape model: github.com/hin...
Unreal Plugin: github.com/ruy...
Offworld repo: github.com/Off...
Ifacial:www.ifacialmoc...
If I'm not wrong you need broadcast sdk (ar) for ifacial to work: www.nvidia.com...
#3d #realtime #unrealengine #facemocap #motioncapture #metahuman #rtx #rtxgpu

[@REALVIBESTV]

I am seeking a technology that enables real-time synchronization of audio with facial movements, particularly focusing on accurate mouth movements that match the spoken words.

[@spaceorcastudio]

I think a good fit for that is audio2face from nvidia, but you maybe need to blend 2 animations sources (from the face capture, and from the audio capture) but I'm not there yet.

[@REALVIBESTV]

@@spaceorcastudio When you there link me

[@rambabu_2403]

Please upload a video for body mocap too !!!

[@spaceorcastudio]

OOOO I'm going to do it next year!
but if I still have a bit of time today a drop a single camera one, and them next year a multicam for high quality productions (the whole setup and gear)!

[@spaceorcastudio]

there you go:ua-cam.com/video/VOZXzH8TZJU/v-deo.html

[@martinsfi2ho]

🤩🤩🤩🤩🤩🤩

[@brianwilson7934]

The animation bp does not appear in my content drawer. Do i need to be running a specific version of UE?

[@spaceorcastudio]

Probably 5.2+

[@Silentiumfilms007]

Only iphone?

[@complexs1mplicity]

I just want you to know I really appreciate you I had a lot riding on getting this project done and I cannot get the facial face linked together with an iOS device or anything but I did it the way you had did it before like 6 months ago before I learned how to do everything else my life was about to fall apart on this I owe you a gift when I get this job I'm dead sir