Crazy how well the index STILL holds up, even 4 years later. Genuinely my only 2 complaints with it were the displays and lenses, everything else was perfect. Main reason I'm so excited for the beyond.
That's actually the main reason I'm doubtful about the Beyond - the displays and lenses are all it is. Everything else about Index that was great is missing. If they can somehow make the FOV as good as Index and offer an off-ear audio strap that sounds as good as Index, then the other missing features can be overlooked, but I doubt they'll even get those two things right before launch.
@@DMan-ud6bt You have a point. It needs audio, it needs trackers still so it's not any more mobile, and it still requires a cable which is honestly the heaviest thing about headsets. It's cool how small it is though.
@@blackjacksike1808 Yeah, I 3D printed a replacement frunk, like one that would unscrew the funk out and replace it with a fan, and what keeps my sweat down and eyes from drying out. It gets unbearable in a warm apartment without it.
Quest 2 owners & trolls who don't know what they're talking about trash talked the resolution _numbers_ off the panel spec sheet data without 1st hand knowledge of the dot pitch, contrast, PCVR resolution scaling, and other qualities making it the superior viewing experience to the panel and glass of a Q2, as well. "But I read some bigger number-thingies on the Internet, therefore I cannot be wrong"
Someone I know has been tracking his drinks for quite a while now. His beer bottle has a 1:1 3D object indicating how full it is. Also makes that nice *clang* when you cheers with others. Want to get to know him?
You say the Beer Tracker was the dumb one but honestly that's the number one thing I wish I had in VR. Even playing games, I wish I could just see where a drink I put down is.
omg the wiggly box when your dog runs around is frickin adorable. And this overlay thing is awesome! And it's nice to see the Steam Controller being of use. I haven't used mine in forever, but I still love it.
Meta should leverage AI technology to scan and track real-world objects, and then integrate them into the VR environment using the new Quest-3 high-resolution color camera. This would allow users to interact with their real-world items while in VR. For instance, imagine playing poker in VR and being able to see and interact with your beer, or watching a movie in a VR environment like big screen vr and seeing your popcorn. You could even bring your Nintendo Switch into VR chat, or mark out your real-world TV so you can see it in your virtual room in VR chat world. This integration of real and virtual environments would significantly enhance the user experience in VR.
Beer Tracking, definitely the future! This is actually the opposite of what I thought you were going to show. I thought you were going to show VR objects in your actual room. But this makes more sense for you I can see.
Finger tracking itself could find this useful as well indeed. Much potential. And best part, the bigger the play space, the more potential it has. It’s self composing or something.
Super cool. I'd imagine in the future you might spend time before you enter the game/chat to assist AI in identifying specific items that might transfer into VR. You either record a 3D model, or you ensure that an AI can identify a can/keyboard/dog. You might have a choice to re-render the items in polygons - send them in or out of view - with highlighting or lighting. :) So many systems working together.
This is awesome! I always was bugged how Vive advertises you can "bring objects from the real world into the virtual universe" with their trackers, but there is just so little software support for anything other than body tracking. I hope to see object tracking get more creative and supported :)
This feels like watching an early prototype of products and concepts we might see in a few years. The dream would be, to be able to do this kind of tracking of objects without the need of attaching an expansive tracker to it. Makes me excited for what's to come - thanks Brad :)
Neural network to detect object bounding boxes / create a per-pixel cutout are pretty mature. So fine tuning one for your particular dog / beer shouldn't be that hard. It's brute force and probably not accurate enough for attaching screens to stuff but it'd work for any number of arbitrary objects at once.
The Index really was way ahead of it's time in terms of capabilities. My only complaints now are it's bulk, the heat, the lenses, and the display. Really wish it was M-OLED rather than LCD. :(
I'm just waiting until we're at the point where I can toss away my monitors because the resolution/colors/contrast/etc is on par with one in the physical world. I know our screens now are 'thin', but when you have 3-4 of them... things can start getting crowded. Would much rather have a clean desk with some HID devices on top than a tri-mount stand+monitors, etc. That coupled with something as unnoticeable as AR contact lenses and some sort of tactile+force feedback for the hands, and the desk can get tossed too ;) Keep up the great work and staying technical! It's harder and harder nowadays to find any in-depth info on anything without some entertainment or 'celeb scientist' element mixed in, especially on YT.
Well, getting rid of the bed in the background was a big step I'm sure. Congratulations you're one step closer to the background matching your content and becoming a regular UA-camr 😉. I enjoy your very well researched and insightful content, thanks.
New tracked controller: A dog xD I heard someone mention pets when saying that Vive trackers can track anything, but that's the first time I see someone actually do that.
Wow, mind blown. Leave it to Bradley to kick things up to an 11. Now I have to go buy another 4 pack of Tundra Trackers. . . I like playing retro games with the right controller and it is difficult in EmuVR but with this I can track a few controllers. The main problem is finding them. I'd rather not have my hands and be able to see my controllers instead.
Imagine a workplace meeting in VR where you are communicating with your engineering team. You have a meeting room that is completely vr, But you are showing off a real life prototype. Would it be possible to "cut out" this real world prototype to show it to your coworkers, but have them see the real world cutout of the object as it is viewed from your headset?
Now THIS is what a real Metaverse looks like! Really cool concepts. You should submit these to some of these to VR companies like Meta so they can make them standard features.
Very clever adaptations! You seem knowledgeable and inventive, so....perhaps I could bother you with a (semi-related) question: I am a looping musician and i want to create a VRchat avatar & then livestream my avatar performing on my irl musical instruments (synth, guitar, drum kit) in real time. Do you think green screen reversal is my best approach, or should I be looking at using something like Reality Mixer or LIV to map and virtualize my instruments, so they can be played in a vr setting that my avatar streams from? (hope that isn't confusing, lol) thanks for any shared thoughts.
This might be new to some people but a lot of people's have already been working using VR using the quest 2! I work in VR with a quest pro. its amazing
You doing the RC car/steam deck screen pass through reminded me of how Apple has been doing screen sharing from Mac to iPad over wifi for a while. I’m guessing that this will be used with the HMD to show virtual screens in MR.(I am eternally scarred by a question on Cash Cab: What are the special characters above the numbers on a standard US keyboard? I didn’t know them in order!)
you should do a denuevo vid. there's a huge community against it. given the praydog mod coming, denuvuevo deoptimization might affect a lot of games. (discourage devs from using them)
I wonder... with Meta / Oculus's newest headsets, the PSVR2, the Pico 4, HTC Vive XR Elite... all of these headsets have internal camera tracking of the environment rather than base stations and external tracking devices that require their own separate power supply from a battery or cable. I wonder if they can make it so that newer headsets can track a specific object you set, like a drink can or pet or other similar examples you gave. I know it's easy enough to press a button and use the pass through function, but in theory... they could use eye tracking of the user to see where one is looking, and if it's over an object it's meant to track, it will pass through that image. In theory... it's possible. 🤔
When dual graphics cards were first a thing someone in my school made a multi use Linux terminal where each player would get one graphics card, each their own monitor and keyboard/mouse so you could have two games of quake III playing. The CPU was split of course but I wonder if this could be done in VR, give VRChat it's own graphics card and give the game it's own. Steam could let multiple games be run IF they were on the same PC. The memory would have to be split but that wouldn't be that big of a deal with modern memory, just buy 32GB of it. The CPU would be a problem though and mother boards that support two CPUs is really rare now. I also have no idea if Windows can even do this, I saw this on a Linux machine. This is a setup just for someone who wants to live in VR but if I could just get a new graphics card and mix it with my current one, giving the higher end graphics card to the most demanding of the two, either VR chat or the game, that would be cool. Buying two of the latest graphics cards at the same time because I think that is what would have to be done. . . Eh, I'm not that rich.
If we can reduce Latency from Input to the Virtual Display and any micro latency factors between Headset and Games on the Virtual Display, we can remove all needs of super expensive multi display systems. I think, however, we'll need Multi-Chiplet based GPUs to make up for raw compute performance needed?
Wish i could get the Mixed Reality working on my valve index. Turned on cameras and all i get is a box with fuzzy stuff in it. No camera pass through, frustrating the hell out of me.
I’ve been trying to play to 2D games in the VR chat but I keep running into an input problem which is when I play the 2D game I also move around in VR chat at the same time while using a controller. Do you know any way to get past this?
something I'm wondering is if the steam contoller is tracked within vrchat because vrchat shows a steam controller on the floor in your play space center when a gamepad is used. okay well I said this a second before you switched to vrchat gameplay
This video is the reason why I bought a vive tracker. I wanna be able to use my Steamdeck in vrchat! What did you use to attach the tracker to your deck? If it's 3d printed it would be nice if you could share the model.
The box moving/rotating with your dog is hilarious
Kneel before Zod's Dog.
that was perfect
reminds me of the shields from the original Dune movie lol
Ever time you say "Hi I'm Brad"
I imagine a rehab group respond "Hi Brad."
Copium addiction ruins lives. The first step is to admit you have a problem. The second step is for Valve to release the Deckard.
Crazy how well the index STILL holds up, even 4 years later. Genuinely my only 2 complaints with it were the displays and lenses, everything else was perfect.
Main reason I'm so excited for the beyond.
That's actually the main reason I'm doubtful about the Beyond - the displays and lenses are all it is. Everything else about Index that was great is missing.
If they can somehow make the FOV as good as Index and offer an off-ear audio strap that sounds as good as Index, then the other missing features can be overlooked, but I doubt they'll even get those two things right before launch.
@@DMan-ud6bt The Index also had overheating issues.
@@DMan-ud6bt You have a point. It needs audio, it needs trackers still so it's not any more mobile, and it still requires a cable which is honestly the heaviest thing about headsets. It's cool how small it is though.
@@blackjacksike1808 Yeah, I 3D printed a replacement frunk, like one that would unscrew the funk out and replace it with a fan, and what keeps my sweat down and eyes from drying out. It gets unbearable in a warm apartment without it.
Quest 2 owners & trolls who don't know what they're talking about trash talked the resolution _numbers_ off the panel spec sheet data without 1st hand knowledge of the dot pitch, contrast, PCVR resolution scaling, and other qualities making it the superior viewing experience to the panel and glass of a Q2, as well. "But I read some bigger number-thingies on the Internet, therefore I cannot be wrong"
Good stuff! Seems like Valve had a lot of plans for the Index cameras that never happened, could have been a great first mixed reality dev device
For sure. BTW, have always loved all your XR stuff. Past and present. Modbox still has a special place in the corner of my brain!
They could have released some kind of usb stereo high Def camera for the 'Frunk' to have a really good pass through MR experience.
@@CorporateZombi What about the stereo cameras already built into the device?
Those real-items, square-shaped windows into the real world reminds me of the special effects of the personal shields in the first Dune movie.
It looks just like a cube map but you can actually see the cube which is the odd part. Pretty interesting trick.
Seeing your dog tracked looked just like the shields in the 1984 Dune movie!!! So cool!
Brilliant! I love the r/c car!
Someone I know has been tracking his drinks for quite a while now. His beer bottle has a 1:1 3D object indicating how full it is. Also makes that nice *clang* when you cheers with others. Want to get to know him?
Ya, I’d love to meet them and show off their advanced beer tracker
Another awesome video Bradley!
glad you enjoyed :D
Wow, great video, I definitively watched everything, even though the video was posted 2 minutes ago
The ability to drink a drink while in VR is why apple vision pro will succeed.
Was it now a first xr-tracked dog just there?
I saw a couple of VR recreated dogs, but this was the first MR dog in VR I think XD
You say the Beer Tracker was the dumb one but honestly that's the number one thing I wish I had in VR. Even playing games, I wish I could just see where a drink I put down is.
Da puppy is SOOO CUUUUUTE!
omg the wiggly box when your dog runs around is frickin adorable. And this overlay thing is awesome! And it's nice to see the Steam Controller being of use. I haven't used mine in forever, but I still love it.
Oh my god...a tracker on your drink sounds so insane..lol but fckn awesome imo
I like the outside the box thinking! Great work with the experimentation!
Great show mate 👍
The beer finder is brilliant. #1 most needed vr feature
Nut tracker! Also I love what you did with the steam deck passthrough, so cool!
What a treat, so many vids this week!
Is this a new camera or just improved lighting? Video looks super clean!
Somewhat both. Recently started using Razer Kiyo Pro Ultra as my camera
@@SadlyItsBradley dude that's webcam quality!? Holy cow does that thing look good 💪
Meta should leverage AI technology to scan and track real-world objects, and then integrate them into the VR environment using the new Quest-3 high-resolution color camera. This would allow users to interact with their real-world items while in VR. For instance, imagine playing poker in VR and being able to see and interact with your beer, or watching a movie in a VR environment like big screen vr and seeing your popcorn. You could even bring your Nintendo Switch into VR chat, or mark out your real-world TV so you can see it in your virtual room in VR chat world. This integration of real and virtual environments would significantly enhance the user experience in VR.
Beer Tracking, definitely the future! This is actually the opposite of what I thought you were going to show. I thought you were going to show VR objects in your actual room. But this makes more sense for you I can see.
Nice to see some love for the steam controller
Finger tracking itself could find this useful as well indeed. Much potential. And best part, the bigger the play space, the more potential it has. It’s self composing or something.
freaking cool!
This is indeed the right way to go learning to incorporate about new tech
Never knew i needed beer and dog tracking for VR but now i want it 😂
Super cool. I'd imagine in the future you might spend time before you enter the game/chat to assist AI in identifying specific items that might transfer into VR. You either record a 3D model, or you ensure that an AI can identify a can/keyboard/dog. You might have a choice to re-render the items in polygons - send them in or out of view - with highlighting or lighting. :) So many systems working together.
This is awesome!
I always was bugged how Vive advertises you can "bring objects from the real world into the virtual universe" with their trackers, but there is just so little software support for anything other than body tracking. I hope to see object tracking get more creative and supported :)
This feels like watching an early prototype of products and concepts we might see in a few years.
The dream would be, to be able to do this kind of tracking of objects without the need of attaching an expansive tracker to it.
Makes me excited for what's to come - thanks Brad :)
Neural network to detect object bounding boxes / create a per-pixel cutout are pretty mature. So fine tuning one for your particular dog / beer shouldn't be that hard.
It's brute force and probably not accurate enough for attaching screens to stuff but it'd work for any number of arbitrary objects at once.
omg the dog strapped to tracker
The Index really was way ahead of it's time in terms of capabilities. My only complaints now are it's bulk, the heat, the lenses, and the display. Really wish it was M-OLED rather than LCD. :(
Thanx, Brad. This is awesome, just bought it for my Valve Index. Keep this stuff coming, you are great.
Glad you enjoyed it!
Definitely trying some of this out for my sim setup! Also, nice Yuru Camp shirt!
1.5 meters to beer
1.0 meters to beer
.3 meters to beer
Beer Imminent
Beer Acquired
TIL I'm obsessed and crazy, thanks, brad!
I had never heard of Reality Mixer. This might finally get me back into flight simming in VR!
This video is basically, "So like, what if, instead of *body* tracking, we did, like, *everything* tracking?"
I'm just waiting until we're at the point where I can toss away my monitors because the resolution/colors/contrast/etc is on par with one in the physical world. I know our screens now are 'thin', but when you have 3-4 of them... things can start getting crowded. Would much rather have a clean desk with some HID devices on top than a tri-mount stand+monitors, etc. That coupled with something as unnoticeable as AR contact lenses and some sort of tactile+force feedback for the hands, and the desk can get tossed too ;)
Keep up the great work and staying technical! It's harder and harder nowadays to find any in-depth info on anything without some entertainment or 'celeb scientist' element mixed in, especially on YT.
Well, getting rid of the bed in the background was a big step I'm sure. Congratulations you're one step closer to the background matching your content and becoming a regular UA-camr 😉.
I enjoy your very well researched and insightful content, thanks.
New tracked controller: A dog xD
I heard someone mention pets when saying that Vive trackers can track anything, but that's the first time I see someone actually do that.
Wow, mind blown. Leave it to Bradley to kick things up to an 11. Now I have to go buy another 4 pack of Tundra Trackers. . . I like playing retro games with the right controller and it is difficult in EmuVR but with this I can track a few controllers. The main problem is finding them. I'd rather not have my hands and be able to see my controllers instead.
This is such a good video! Some really fun experiments!
Imagine a workplace meeting in VR where you are communicating with your engineering team. You have a meeting room that is completely vr, But you are showing off a real life prototype. Would it be possible to "cut out" this real world prototype to show it to your coworkers, but have them see the real world cutout of the object as it is viewed from your headset?
Now THIS is what a real Metaverse looks like! Really cool concepts. You should submit these to some of these to VR companies like Meta so they can make them standard features.
Its.. kinda brad
A neat XR prototype is that shooter with random characters within your own house/environment, forget the name of the project
Very clever adaptations! You seem knowledgeable and inventive, so....perhaps I could bother you with a (semi-related) question:
I am a looping musician and i want to create a VRchat avatar & then livestream my avatar performing on my irl musical instruments (synth, guitar, drum kit) in real time. Do you think green screen reversal is my best approach, or should I be looking at using something like Reality Mixer or LIV to map and virtualize my instruments, so they can be played in a vr setting that my avatar streams from? (hope that isn't confusing, lol)
thanks for any shared thoughts.
5:04 FRIENDLY FIRE
"This is the Valve Index"
My surprise is non-existent and my day is made.
Wonder if developers could use google 360 world map. We could play in the real world as an avatar, would sort of be like using AR outside.
This might be new to some people but a lot of people's have already been working using VR using the quest 2!
I work in VR with a quest pro.
its amazing
You doing the RC car/steam deck screen pass through reminded me of how Apple has been doing screen sharing from Mac to iPad over wifi for a while. I’m guessing that this will be used with the HMD to show virtual screens in MR.(I am eternally scarred by a question on Cash Cab: What are the special characters above the numbers on a standard US keyboard? I didn’t know them in order!)
That doggy box looks like it might need to be just a little bit bigger for those fast movements.
with the boxy slightly distorted passthrough it reminds me strongly of a personal shielding from the old Dune movie. Quite amusing I thought :)
you should do a denuevo vid. there's a huge community against it. given the praydog mod coming, denuvuevo deoptimization might affect a lot of games. (discourage devs from using them)
Denuvo really does bring down games to its knee.
I wonder... with Meta / Oculus's newest headsets, the PSVR2, the Pico 4, HTC Vive XR Elite... all of these headsets have internal camera tracking of the environment rather than base stations and external tracking devices that require their own separate power supply from a battery or cable. I wonder if they can make it so that newer headsets can track a specific object you set, like a drink can or pet or other similar examples you gave. I know it's easy enough to press a button and use the pass through function, but in theory... they could use eye tracking of the user to see where one is looking, and if it's over an object it's meant to track, it will pass through that image. In theory... it's possible. 🤔
Apparently Peanut committed warcrimes and is now stuck in the Phantom Zone with General Zod from Superman.
Very interesting stuff.
Next video: getting drunk in VR using beer tracking.
1:58 that's pretty sick
maybe a yuru camp shirt? hmm
Correct 👍
Makes me realize the cost and size of trackers really needs to come down.
LMBO!!!!! The tracker on the dog!!!!
I use the 3d lines on my boundary to interact with things on my desk constantly. Makes me feel kinda cyberpunk
I would like to see upgrade / spare parts kit for index that contains better resolution displays even if it means to give up 120 and 144 Hz modes.
What did he mean by this? Quest 3? Or some other headset? 4:21
Would be great to see a tracked ball and playing catch with it
can you just map a button to act as a torchlight and create a portal attached to the controller while you hold it?
When dual graphics cards were first a thing someone in my school made a multi use Linux terminal where each player would get one graphics card, each their own monitor and keyboard/mouse so you could have two games of quake III playing. The CPU was split of course but I wonder if this could be done in VR, give VRChat it's own graphics card and give the game it's own. Steam could let multiple games be run IF they were on the same PC. The memory would have to be split but that wouldn't be that big of a deal with modern memory, just buy 32GB of it. The CPU would be a problem though and mother boards that support two CPUs is really rare now. I also have no idea if Windows can even do this, I saw this on a Linux machine.
This is a setup just for someone who wants to live in VR but if I could just get a new graphics card and mix it with my current one, giving the higher end graphics card to the most demanding of the two, either VR chat or the game, that would be cool. Buying two of the latest graphics cards at the same time because I think that is what would have to be done. . . Eh, I'm not that rich.
the vr car thing could be used for a virtual gimbal
Cool, next and I want to see a selfie cam tracker that doesn't require the source hmd's line of sight. 🤔
If we can reduce Latency from Input to the Virtual Display and any micro latency factors between Headset and Games on the Virtual Display, we can remove all needs of super expensive multi display systems. I think, however, we'll need Multi-Chiplet based GPUs to make up for raw compute performance needed?
I gotta finish your review on DPVR I like the flip up & user friendly design. What is a cheap PC you recommend?
Soda tracker, love it!
Wish i could get the Mixed Reality working on my valve index. Turned on cameras and all i get is a box with fuzzy stuff in it. No camera pass through, frustrating the hell out of me.
Shooting laser beams into your eyes sounds terrifying.
I think I need a tumbler or glass and mount a tracker to it... can stay hydrated in VR
Imagine pairing that with Facebook new model which crops objects very accurately. You will basically import your dog into vr 😅
That ws jaw dropping
Woof
4:32 I NEED the name of that VRC world
"Shoegaze Apartment"
and the first one is "Archipelago"
would be awesome to play guitar or drums in vr
hi dad
Chookity!
I wonder how it is like to have one of these tracked dog while doing Vesper peak. The human brain can't handle MR double dogging I bet.
Gonna be interesting when Razer releases a mouse with a built-in vive compatible tracker.
i wish we had this kind of thing in the quest2, mind boggling that we dont...
I’ve been trying to play to 2D games in the VR chat but I keep running into an input problem which is when I play the 2D game I also move around in VR chat at the same time while using a controller. Do you know any way to get past this?
something I'm wondering is if the steam contoller is tracked within vrchat because vrchat shows a steam controller on the floor in your play space center when a gamepad is used. okay well I said this a second before you switched to vrchat gameplay
The inputs work , but needs a unit to be tracked along with it
This video is the reason why I bought a vive tracker. I wanna be able to use my Steamdeck in vrchat! What did you use to attach the tracker to your deck? If it's 3d printed it would be nice if you could share the model.
This is the one I printed: www.printables.com/model/480241-steamdeck-tundra-tracker-mount
does anyone know what that pool vrc world was called
whats the bar world called in this video? looks nice
A.venue Pub by Reava_
this is the future
Craziest thing is Nintendo had cool at for The 3ds for its time. I was fascinated
It would be really cool if you could just have a 3d model instead of the passthrough
I feel like Quest 3 would be well set up to do this stuff with it's depth sensor if Meta had the imagination to think of it... but I doubt they did :P
A remote control vrc camera man?