【XR Animator】Explore your VTubing world with webcam mocap
Вставка
- Опубліковано 16 січ 2025
- It's common for 3D VTuber to use 3D scene for streaming, but have you ever imagined that you can explore your scene with just a webcam and WASD control? Bring your audience to a virtual tour. No VR required!
Both "VR Apartment" and "Level5 Zone1" scenes demonstrated in this video are available for download.
ko-fi.com/s/38...
ko-fi.com/s/9a...
---------------
"XR Animator" is an AI-based (MediaPipe) full-body mocap solution which supports image, video and webcam as input. Both browser and Windows version are available. Windows version supports the VMC-protocol which allows beaming realtime motion data to external apps such as VSeeFace, Unity and Unreal Engine. The browser version supports AR (Augmented Reality) mode on Android.
🌐 XR Animator - browser version
sao.animetheme...
🖥️ XR Animator - Windows app version
github.com/But...
---------------
Features:
Support full-body AI motion tracking using a single webcam or media file (image/video)
Support using any MMD/VRM model as your 3D avatar
Record mocap motion and export it to VMD motion format
Support loading VMD/BVH/FBX format 3D motions
Export BVH/FBX motions to VMD format
Customize the background and 3D scene with 2D image/video , 3D panorama, 3D objects (.x/.glb format), or a plain simple green screen for VTubing and video recording with a transparent background
Support VMC-protocol to animate a 3D model elsewhere in other VMC-enabled applications such as VSeeFace, Unity and Unreal Engine (Electron mode only)
Support frameless window with transparent background on video capture apps such as OBS (Electron mode only) (*)
Support AR (Augmented Reality) on Chrome browser (Android only)
---------------
Contact:
Ko-fi☕
ko-fi.com/butz...
Twitter
/ butz_yung
Facebook:
/ animethemegadgets
UA-cam:
/ animethemegadget
Homepage:
www.animetheme....
How to adjust the VR apartment to fit with my avatar on my laptop?
Fantastic! Does it work with VSeeFace? Could you make a tutorial for that, please?
You can connect XR Animator to VSeeFace via VMC-protocol. Double-click the "VMC-protocol" icon for options.
Hello, how can we retarget the BVH files we obtain with this program to an Unreal Engine mannequin? Is there an easy way to do this?
thanks for your amazing work :D
I'm trying to work with it in OBS but when I capture the window and drag it ,it doesn't stop getting bigger and bigger,any tip?
Amazing! Thanks for the tutorial
how can you get 3d buildings with colors in them? how can i find 3d buildings to download?
Try this if you are looking for 3D models.
sketchfab.com/
I found an exemple of multiplayer in github ut struggle to implement it for my own scene and use case, any clue ? I would like to make a stream with other people in same 3d house
Networking with other VTubers/people is a fairly complicated issue. If you really have to do this, VRChat is still a better option in the mean time lol
I never use vnyan before. What is the advantage of using vnyan instead of only using xr animator?
If you are fine with how you have been using XR Animator, of course you can use it alone. VNyan provides more Twitch interaction features and stuff with their node-based system, but there is a learning curve.
@@AnimeThemeGadgethow can I put this on UA-cam for real this time
Thanks plz iclone 8 plugin connect sir