【XR Animator】Explore your VTubing world with webcam mocap

Поділитися
Вставка
  • Опубліковано 16 січ 2025
  • It's common for 3D VTuber to use 3D scene for streaming, but have you ever imagined that you can explore your scene with just a webcam and WASD control? Bring your audience to a virtual tour. No VR required!
    Both "VR Apartment" and "Level5 Zone1" scenes demonstrated in this video are available for download.
    ko-fi.com/s/38...
    ko-fi.com/s/9a...
    ---------------
    "XR Animator" is an AI-based (MediaPipe) full-body mocap solution which supports image, video and webcam as input. Both browser and Windows version are available. Windows version supports the VMC-protocol which allows beaming realtime motion data to external apps such as VSeeFace, Unity and Unreal Engine. The browser version supports AR (Augmented Reality) mode on Android.
    🌐 XR Animator - browser version
    sao.animetheme...
    🖥️ XR Animator - Windows app version
    github.com/But...
    ---------------
    Features:
    Support full-body AI motion tracking using a single webcam or media file (image/video)
    Support using any MMD/VRM model as your 3D avatar
    Record mocap motion and export it to VMD motion format
    Support loading VMD/BVH/FBX format 3D motions
    Export BVH/FBX motions to VMD format
    Customize the background and 3D scene with 2D image/video , 3D panorama, 3D objects (.x/.glb format), or a plain simple green screen for VTubing and video recording with a transparent background
    Support VMC-protocol to animate a 3D model elsewhere in other VMC-enabled applications such as VSeeFace, Unity and Unreal Engine (Electron mode only)
    Support frameless window with transparent background on video capture apps such as OBS (Electron mode only) (*)
    Support AR (Augmented Reality) on Chrome browser (Android only)
    ---------------
    Contact:
    Ko-fi☕
    ko-fi.com/butz...
    Twitter
    / butz_yung
    Facebook:
    / animethemegadgets
    UA-cam:
    / animethemegadget
    Homepage:
    www.animetheme....

КОМЕНТАРІ • 14

  • @damienkwok6361
    @damienkwok6361 8 місяців тому

    How to adjust the VR apartment to fit with my avatar on my laptop?

  • @activemotionpictures
    @activemotionpictures Рік тому

    Fantastic! Does it work with VSeeFace? Could you make a tutorial for that, please?

    • @AnimeThemeGadget
      @AnimeThemeGadget  Рік тому

      You can connect XR Animator to VSeeFace via VMC-protocol. Double-click the "VMC-protocol" icon for options.

  • @okgreat4851
    @okgreat4851 Рік тому

    Hello, how can we retarget the BVH files we obtain with this program to an Unreal Engine mannequin? Is there an easy way to do this?

  • @andresrochel2073
    @andresrochel2073 Рік тому

    thanks for your amazing work :D
    I'm trying to work with it in OBS but when I capture the window and drag it ,it doesn't stop getting bigger and bigger,any tip?

  • @PULPANIME
    @PULPANIME Рік тому

    Amazing! Thanks for the tutorial

  • @Miyuyus
    @Miyuyus Рік тому

    how can you get 3d buildings with colors in them? how can i find 3d buildings to download?

    • @AnimeThemeGadget
      @AnimeThemeGadget  Рік тому

      Try this if you are looking for 3D models.
      sketchfab.com/

  • @-.-._
    @-.-._ Рік тому

    I found an exemple of multiplayer in github ut struggle to implement it for my own scene and use case, any clue ? I would like to make a stream with other people in same 3d house

    • @AnimeThemeGadget
      @AnimeThemeGadget  Рік тому

      Networking with other VTubers/people is a fairly complicated issue. If you really have to do this, VRChat is still a better option in the mean time lol

  • @JonesLsi27
    @JonesLsi27 Рік тому

    I never use vnyan before. What is the advantage of using vnyan instead of only using xr animator?

    • @AnimeThemeGadget
      @AnimeThemeGadget  Рік тому +1

      If you are fine with how you have been using XR Animator, of course you can use it alone. VNyan provides more Twitch interaction features and stuff with their node-based system, but there is a learning curve.

    • @KaylynKorir-bs7bh
      @KaylynKorir-bs7bh Рік тому

      ​@@AnimeThemeGadgethow can I put this on UA-cam for real this time

  • @yunankkays3901
    @yunankkays3901 Рік тому

    Thanks plz iclone 8 plugin connect sir