FULL BODY TRACKING ON QUEST 3 - BUILT-IN!
Вставка
- Опубліковано 2 жов 2024
- So the Quest 3 has upper body tracking and Ai estimated legs! This allows us to get full body tracking on the Quest 3, but right how it only works via Virtual Desktop Beta! - / discord
You can get it 25% off using my link! - UPDATE! Meta Lowered my link to only 10% off cuz a lot of people used my link! I'm sorry about this I'm trying to see what I can do!
www.oculus.com...
All the gear I use here! Using my link helps support my channel! Thank you!
www.amazon.com...
Join my Discord server! - / discord
Become A Member! Your support helps me make more videos! - / @hakarikimura
Check out my carrd page to follow my on my other platforms! - hakarikimura.c...
You can also email me there to talk about business!
![Goodbye Controllers? VR Gloves are BACK! [UDCAP FIRST LOOK]](http://i.ytimg.com/vi/xOW_JJRB4E8/mqdefault.jpg)
@4:30 I mention this is full body tracking in the way that upper is tracking with metas hand and upper body tracking movements and lower body is estimated. I’ve seen many people and UA-camrs call this a form of full body tracking in there vids and titles and I did the same in a way. It’s not full body estimation or full body tracking exactly it’s more of a hybrid but upper body tracking with estimated legs on quest 3 built in would be way to long of a title. Thank you for understanding love you all ❤
i got it to work finally after some time. the leg estimation is not working though in vrchat. any ideas why this is happening?
@@brandonbeck2645 do you see your trackers for your legs that are being estimated in steam VR
@@HakariKimura same here i see the trackers at my feet but my legs are stiff and stuck together
same
@@brandonbeck2645 Same problem. The Arms and even Finger tracking works nice - but legs are not working. I am on latest 1.32.4.0 app. I can't switch app versions to beta. Tried on phone and on website - no actions for dropdown.
5:00 I think you have your glasses on. 😁😝
I realized that after the edit😂
@@HakariKimura Don't worry that happened to me either with my car keys. 😝
@@HakariKimura Next time said: Where is my Micro SD Card? 😆
This is so huge... There is no reason why game devs should not invest into making better body and tracking for their games now. I am sure this is gonna spread to other headsets over time too. Also can't wait for the tracking to fix one of the most problematic things with VR = feeling sick. If you can track your upper body, waist and head movements separately (like you can in VR now) that means that if other games make the tracking work as well, then you can actually move around in the game and walk straight forwards while looking at whatever you want and keeping your upper body also "moving forward". It's already tested in Skyrim VR and it's absolutely amazing for people like me who get sick because of the locomotion is tied to the headset orientation.
Yess 1000% more games need this! I’m tired of only testing these out on vrchat we need more games with this!!!
Damm this is awesome!!!❤❤❤
It’s incredible!!! 👀
THIS IS AWESOME 🔥
Ikr!!! 🔥🔥🔥
Works on Quest 2 too btw. Instead of using camera for upper body, it estimates everything like Standable. And I'd say the standing and sitting on a chair is better on VD but sitting on the floor + laying down is better on Standable 1.0. Let's hope Standable 2.0 is a massive upgrade considering with VD you can do mixed tracking (upper body using the cameras and lower body using proper trackers).
Old comment I know. But Standable 2.0 is FIRE.
Just tried it. It won't let me lift my legs but it will let me walk
Too awesome! Tabor devs needs to enable this! :D
Yessss
Now, if only Quest 3 had eye and face tracking like on the Quest Pro, this would be awesome! Speaking of which, can you use this on the Quest Pro...?
I’ll try and find out!
Inside out body tracking is only available on Quest 3, not sure if they're planning on adding it to the Pro
@invalidcreations I am sure they will release a new Quest Pro 2 that has all the bells and whistles on it. Maybe, even better pass through. 🤔
HEYY 🇹🇩🇹🇩🇹🇩
Wassap!!
how are you???
@@Ru-eye I’m great how are you!
i’m good! thanks for asking
Bring back the Rex avatar
😂 haha I don’t know
@@HakariKimuraSame and the Novabeast because they are looking better.
@@sorkoatbot7792 they definitely have better face tracking
@@HakariKimura They look cute too. 🤩
I appreciate the new avatar it’s realistic and represents Hakari well
"fruity" 3:36 bruh you've got cat ears on your q3 while using a fruity elf avi
👾
Nice!! Great video!! Thank you for sharing!!
I hope they will add more to it to allow accurate tracking when laying down as well!
Thank you so much I appreciate that and I agree I hope they add more!!
So go down an update then go up and update? Who made this stupid shit. Messes with ovr settings? Theu should have really fixed that like 2 years ago at lightspeed. Too much stupidity here, gotta deal with microsofts bullshit,download metas bullshit,steam,steam vr,another god damn meta app,virtual desktop thats several GB too god damn many they gotta stop with this clutter clusterfuckery.
@@hexshadow6647 gets a little frustrating sometimes when shi breaks 😂😭
Its Upper body tracking (pretty much only what the center out sensors can see) Leg estimations are janky at best, you're better off with slimes if you can get them (assuming you dont have the option of light houses).
does not work for me. i downloaded the streamer app but i cant use it. i cant even change the version on my phone
Fantastic video mate!
I'm thinking about buying Quest 3 just for this feature alone. But I've a question. Will this method work with Mocap Fusion VR on Steam? I want to record my full body animation and export it into 3D software
I mean they show up on steam as real trackers so I bet it would totaly work for Mocap Fusion VR! and thank you homie!
Awesome video! Btw I'm new to vr... I am wondering Which version of virtual desktop should I get? the one in steam or the meta quest 3 version
They work the same doesn’t matter but it’s better if you get it on meta cuz then it’s installed natively to the quest and you can still content it to your pc. And thank you!
It's better to buy from the Meta store. Since the render settings, etc. are only there. The steam version is useless.
@@soupsoup9887 yess exactly fair point!
Quick question is a laptop needed for this or no because yesterday I took my oculus quest two back to Best Buy so I can upgrade to a quest three but I decided to wait until they go on sale to buy it. Also that being said I do not have quest tracking devices. They’re like $100 on Amazon.
I saw this other day just got it working last night you show of the new feature well
Thank you so very much! 🥹 I’m happy you took the time to comment this! Makes me happy you enjoyed my showcase!! I hope this feature work’s amazing for you as well!
Can this be used for other games as well?
Yes it can as long as they in steam vr
wait do i need to get the steam version of the virtual desktop or the occulus app version?
From what I can tell, you'll need the steam version, given that he mentioned he's running this on SteamVR
@@raloo. no only on the quest store. The only thing you need for your pc is the free app virtual desktop streamer. The steam version is useless don't buy it.
How powerful does your pc have to be? I have a microsoft pro laptop. Would that be able to work?
Can this also be used with blade and sorcery?
Yeah I’m curious bout that too
This is pretty impressive stuff!😃
For any grandmas watching, the future is NOW!
🤣
😂😂
They may be a dumb question but do you need a pc or laptop or anything like that for this to work?
Yes you need VD on stream on your pc
This is epic. Does anyone know if you can use base station trackers as well? I have tundras and one has connectivity issues, but maybe I could bridge that gap by using this for my hips/upper body and my other two for my feet like usual
It can’t so far as what I know so far
@@HakariKimura I actually found out that you can!!
@@Grymx really!?
Is it possible to combine this with Amethyst to get accurate hip and leg movement? this seems... better than vives if you could do that
Not working my legs are not tracked
i bought virtual desktop on steam years ago, do i need to purchase it again from the quest store?
Yes 😅
So it tracks your legs too!??! Please let me know, if it does then I’m buying the Quest 3 asap
So it tracks your upper body movement using the onboard cameras, and then it fills in the gaps of your legs. It doesn’t necessarily know where your legs are exactly, but it does a really good estimation for where they are based on the forward, tracking movement of your upper body it tracks your legs really well for walking standing, crouching, jumping sitting and laying down kind of like standable if you’re familiar with it.
It makes your legs not look horrible in regular leg position but no dances or specific one leg movements but it's the cheapest option for vrchat avatar not glitching out.. cheapest way to make things not ugly but not perfect though
Will this work for dance dash?
Idk tbh 😭
Can we use 3 cameras?
where did you get the ears from on your headset
3-D printed them from thingy verse
Bring back the rex avatar! X’D
Oml 😂
Hello! i’ve got an issue while trying this: when i run steam vr through virtual desktop, there is just a black screen in my oculus quest 3, but i can hear the game and i can see the game on my pc monitor, but not in the headset. If i run steam vr without virtual desktop it works perfectly. What should i do?
where did you get the ears from on your headset
3r printed them from thingyverse
could you use leg tracking of some sort in mix with this or no?
you sat down but what about crossing legs? or laying down?
Right how do u lay down?
Unfortunately. VD is a laggy mess for me
@@squidiskool how!?!
@@HakariKimura No Ethernet ☹️
Do you need a pc for this? 😢
Yes you need Virtual Desktop on Steam on your pc
Is there a way to use the upperbody tracking without PCVR just on the VRChat that is in the meta store?
nah this is definetly fake how can just the headset track your whole body 😑
Bro doesn’t know the lore smh
HEH? @@HakariKimura
Did it word with quest pro ?
no, upper body tracking is only on quest 3. idk if the ai leg tracking works on quest pro, i would say not though
Hay i’ve been using it but for some reason, my legs keep going more forward so it looks like I keep sitting down. Is there a way to fix it and also it’s not perfectly with my feet it seems my avatar is too big but should automatically connect.
do i need a pc to use this and is it work at vr chat with a quest 3 standalone? i do have a pc its lenovo Z500. but i afraid its not powerful enough.
i tried search but the answer is not clear.
thank you
Can you use the Quest 3's full body tracking while using Quest link?
Not atm you need it through VD and steam VR
@@HakariKimura thank you for your response.
Would've been cool though :)
@@HakariKimura so connecting it to my computer for virtual desktop won't work if so how do I connect it otherwise?
IM FREAKING SITTING!!!
😂yess
immediately got it and its amazing
that basicly same way bonelab and boneworks body works tbh you can't deny it
Nothing works for me. Updated virtual desktop to latest version on my PC and on my Quest 3. Checked those boxes on the Quest 3 virtual desktop app “forward tracking data to PC” and “emulate steam VR vive trackers”
In VR chat now and all I see is my head and hands. No arms or torso or legs shown at all.
Anybody know what I need to do to get it working?
Do you see trackers in steam VR?
The bad thing is that it cannot be used with the HTC full body
Yes it can 😂 I have a video on it check the channel for upgrade full body tracking video
I have a MacBook and steam be isn’t compatible.. so does virtual desktop emulate windows or will it show my Mac?
Damn good question I don’t know cuz I no have Mac I’m sorry
it is not showing up on how to switch it to beta version on my phone
Don't worry it's built-in the lastest Version
@@HakariKimura thank you!
@@HakariKimura i am also unsure the legs arent working and as yo why they arent
@@frostz3253 because he's lying.
i like it with hands, but how exactly do you move then
@@shtwick thumb and middle finger pinch then
@@HakariKimura and as for the expressions menu?
@@HakariKimura im also trying to figure out how to do your beta things, since on the meta quest horizon app theres no "beta" version anymore
When I go to the mobile app and try to change the version I have no access to the beta version. Any one had this issue and know a solution?
I have the same issue. Someone help
does the legs get tracked.? like can you actually move them?
Does it have to be bought in the meta store for it to work not steam?
Well, preferably you want it to be running on the headset, standalone most convenience
Ahh ok thanks, just wanted to make sure
@@HakariKimura how do you get it to run so smoothly on yyour end, because mine don't track as well as yours do and its way less smooth with the movement? Now I am new to body tracking so I'm also curious of what else I'm missing that would help
@@MrShinoXD6933 good Wi-Fi and fast computer ig what are you running
@HakariKimura I'm running a 3070 and my wifi is strong to. But it's like the cameras don't pick my upper body properly.
HOW DID I JUST HER ABOUT THIS. GETTING VIRTUAL DESKTOP AFTER DONE WITH THE VID A SETTING IT UP IMEDIATLY
Haha 😂 I love it!
Hey! Can you use this together with vive trackers?
Yes I made a video about this!! 🙏🏼
What's the vrchat world called?
Does this work on the quest 2 as well? 6:04
I don’t think so unfortunately
I’ll be testing it out tonight just to be sure.
EDIT: I tested this and yes it works, you can emulate Valve Index to do the finger tracking in Quest 2, but that's all you get with it. :)
@@X1erra thank you I’ve been out today so I’m ganna mess with it tn
The legs dont work
Welp, that seals the deal, once I can afford if I'm picking up a Quest 3.
Yessir 😂 agreed
@@HakariKimura
Yeah, I'm still running a Quest 1 so the upgrade will be good, especially since support for it ends soon.
I don’t have a good enough computer😢
@@teddygoozvr638 what pc you got?
@@HakariKimura not a very good one
@@HakariKimura hp
I’ve already tried it. It doesn’t work I think.
@@teddygoozvr638 good cpu, gpu? Ram?
Nice avatar btw
Thank you!!!!
@@HakariKimura of course
Man can you possibly, create an Anime using this!?, because if you create an avatar and make a scene,
It’s very well possible!
Wait so do I have to download virtual desktop on my quest or my pc, or my phone?? I'm kinda confused
On your quest or quest app linked to the headset
i gotta get a quest 3, will this work for contractors? or any fps/sport games?
They become steam trackers so anything that supports Vr trackers should work!
I wonder if there is a way to add base stations into the mix to better track leg movement. Are there any that are compatible with the quest 3?
Not atm that ik off 😭
Goodness… it looks so well. Now im torn between upgrading Quest 2 and getting Quest 3 for upper body estimation OR Quest Pro for facetracking. Could I get a genuine two-sense of yours?
Definitely a reason to get it now tbh 😂👀
i dont see the option to change versions when i click it am i bugging or is it gone (help me)
it's already out of beta, it now built in
how do you record yourself with your avatar?
Camera irl and vrc camera filming at the same time
I dont get how to make it work. I have the beta version on my meta app and its updated but I don't know how to change the virutral desktop on the PC to a beta version
you gotta download the beta streamer app from there discord
anyway to do this with out remote desktop. Like connecting directly to PC?
Not atm unfortunately sorry
jump jump
I just read this and he started jumping in the video
@@Jet_Set_Go the bunny 🐰 jump! lol
quick question can i not be connected to pc while using this on vrchat? like its quest only not pc?
Has to be with steam vr unfortunately
Are you sure you are looking for your glasses💀
I was indeed
Guess you've convinced me to save up for a meta quest 3.
Damn I gotta get meta to give me a code 😭
there away to use the body tracking on standalone VrChat?
Hoping meta does something about it in future updates but rn we got nothing
Can you export this as mocap data?
I believe you can with mocap fusion vr
This is so dope
The quest 2 works on this beta it's not quest 3 exclusive.
Interesting!!! I didn’t know that
people on the discord were sharing this video and saying stuff like "UA-camrs once again spreading misinformation, talking about the title of the video. I think it'd make passerby people and future viewers of this video happier if you would edit the title to not make it seem like this is a quest 3 exclusive feature with VD. but that's up to you
Hey is there any way I can get this with pcvr on quest 3 or am I barred in to only when I do quest 3 standalone.
I mean, it is still PCVR you’re just running it in the virtual desktop, which is the only way right now. It’s not standalone as in built-in the quest three as a so far.
@@HakariKimura so essentially virtual desktop emulates a pc on the standalone quest 3? That would be really cool if thats the case.
@@WarpedKarma6471 yes, you download virtual desktop standalone on the Meta Quest 3 from there you download the streamer app for your PC you connect to your PC and open steam VR through Virtual desktop and that’s it
Is not working for me, i hot the beta verions on both headset and pc, but when I join vrchat I don't have the calibration option 😊
Can you see the trackers in steam VR?
No, that's the problem I guess@@HakariKimura
@@tupak2730 so you do see your trackers in steam VR, correct? If so, make sure full body calibrations on in VR chat
that fantastic !!!!!!!!!!!!!!!!!!!!
Ikr!!
It won't work for me
I need a lil more info to help 😅
I've had a quick mess around with combining this with SlimeVR and it works pretty awesome. Use this for upper body and SlimeVR trackers for legs and feet.
How did you get 2 different tracking systems to work?
@@HakariKimura Keep trying to say but I guess YT doesn't like what I'm saying. SlimeVR works it out with some tweaks.
You have to turn off Chest and Hip tracking in Slime VR settings and use something that can be found in a place with a SlimeVR Community that can't be mentioned beginning with dis to turn of the foot and leg tracking in Virtual Desktop.
i see the fake little trackers on my arms but i cant move my legs
In the video I mentioned the legs are estimated
oh so it just simulates walking?@@HakariKimura
It only gave 10% off
damn it! Meta has updated the terms it seems, they think I'm spamming the link cuz probs to many people used it, aghhh sry about this, imma see what I can do.
This made me get a quest 3
Damn meta better give me a cut 😭😂
Is this feature provided by quest 3 or vr desktop? I'm curious about other apps
the what's happening is the quest 3 does this tracking built in it's self, but the data doesn't transfer to vrchat without Virtual Desktop, Virtual Desktop takes the info and makes the trackers for VRChat to use! Virtual Desktop is an app that allows you to connect and control your PC wirelessly through wifi, and lets your run steam vr!
@@HakariKimura so quest 3 provide all the data and ready to be consumed.. That's great!
Can you do this with a virtual desk top alternative?
as of rn I don't think so
@@HakariKimura okay thanks
Cant get the legs to woodwork :(((
Legs are Ai like I mentioned in the video
@@HakariKimura oh! My bad
no way, i'm so glad this is here
Bet!
ya this is pretty amazing.
I agree completely!!! I hope we keep getting updates like these!
Is anyone having the same issue that walking doesnt work? Better said leg movement is not working. HELP!!!
Are your legs frozen?
I dont think so, but what may be the issue if they are frozen?@@HakariKimura
Followed the tutorial and it doesn't really work like it's shown in the video :/
This was when it was beta, it’s now in public release, should be easier and all be built in without needing discord
@@HakariKimura Yet it still doesn't work for me. I'm not sure how to make it work. It's something that you either turn on or off yet it's not really tracking my entire body and working the same way it's being shown.
@@joey_outdoors do you see the extra trackers in steam Vr?
@@HakariKimura I see all the trackers on my avatar when I go to calibrate, and in the steam vr window. But they don't respond to my body movements or position.
@@joey_outdoors well the arms and torso track but the legs are estimated, I mention this @4:30 if nothing moves then that's a weird glitch your experiencing.
does it have hip sway tracking?
Koichi walk?
What’s that
@@HakariKimura jojo reference look it up also great video btw this really helped
Man I’m so jealous 😭
Whyyyy!(
@@HakariKimura I only have a quest 2 😞