Crazy how well the index STILL holds up, even 4 years later. Genuinely my only 2 complaints with it were the displays and lenses, everything else was perfect. Main reason I'm so excited for the beyond.
That's actually the main reason I'm doubtful about the Beyond - the displays and lenses are all it is. Everything else about Index that was great is missing. If they can somehow make the FOV as good as Index and offer an off-ear audio strap that sounds as good as Index, then the other missing features can be overlooked, but I doubt they'll even get those two things right before launch.
@@DMan-ud6bt You have a point. It needs audio, it needs trackers still so it's not any more mobile, and it still requires a cable which is honestly the heaviest thing about headsets. It's cool how small it is though.
@@blackjacksike1808 Yeah, I 3D printed a replacement frunk, like one that would unscrew the funk out and replace it with a fan, and what keeps my sweat down and eyes from drying out. It gets unbearable in a warm apartment without it.
Quest 2 owners & trolls who don't know what they're talking about trash talked the resolution _numbers_ off the panel spec sheet data without 1st hand knowledge of the dot pitch, contrast, PCVR resolution scaling, and other qualities making it the superior viewing experience to the panel and glass of a Q2, as well. "But I read some bigger number-thingies on the Internet, therefore I cannot be wrong"
Someone I know has been tracking his drinks for quite a while now. His beer bottle has a 1:1 3D object indicating how full it is. Also makes that nice *clang* when you cheers with others. Want to get to know him?
You say the Beer Tracker was the dumb one but honestly that's the number one thing I wish I had in VR. Even playing games, I wish I could just see where a drink I put down is.
New tracked controller: A dog xD I heard someone mention pets when saying that Vive trackers can track anything, but that's the first time I see someone actually do that.
you should do a denuevo vid. there's a huge community against it. given the praydog mod coming, denuvuevo deoptimization might affect a lot of games. (discourage devs from using them)
Finger tracking itself could find this useful as well indeed. Much potential. And best part, the bigger the play space, the more potential it has. It’s self composing or something.
Beer Tracking, definitely the future! This is actually the opposite of what I thought you were going to show. I thought you were going to show VR objects in your actual room. But this makes more sense for you I can see.
The Index really was way ahead of it's time in terms of capabilities. My only complaints now are it's bulk, the heat, the lenses, and the display. Really wish it was M-OLED rather than LCD. :(
Wow, mind blown. Leave it to Bradley to kick things up to an 11. Now I have to go buy another 4 pack of Tundra Trackers. . . I like playing retro games with the right controller and it is difficult in EmuVR but with this I can track a few controllers. The main problem is finding them. I'd rather not have my hands and be able to see my controllers instead.
Meta should leverage AI technology to scan and track real-world objects, and then integrate them into the VR environment using the new Quest-3 high-resolution color camera. This would allow users to interact with their real-world items while in VR. For instance, imagine playing poker in VR and being able to see and interact with your beer, or watching a movie in a VR environment like big screen vr and seeing your popcorn. You could even bring your Nintendo Switch into VR chat, or mark out your real-world TV so you can see it in your virtual room in VR chat world. This integration of real and virtual environments would significantly enhance the user experience in VR.
omg the wiggly box when your dog runs around is frickin adorable. And this overlay thing is awesome! And it's nice to see the Steam Controller being of use. I haven't used mine in forever, but I still love it.
I am interested in jumping into tethered VR in the future, but not interested in buying into the Index at this stage in it's product cycle, so looking forward to Valve's next iteration (hopefully it isn't like HL3).
This is awesome! I always was bugged how Vive advertises you can "bring objects from the real world into the virtual universe" with their trackers, but there is just so little software support for anything other than body tracking. I hope to see object tracking get more creative and supported :)
I'm going to say it's not the 4090 that was causing performance problems with Denuvo games. It's your CPU. The GPU has nothing to do with Denuvo. What processor do you have?
I’ve been trying to play to 2D games in the VR chat but I keep running into an input problem which is when I play the 2D game I also move around in VR chat at the same time while using a controller. Do you know any way to get past this?
It was fun (And Money Making)while it lasted..Brad has sadly been exposed as a Scam Artist ! He's about to be fired from Bigscreen for giving poor development advice regarding their floundering headset His inaccurate analysis of the PSVR2'S screen persistence problem has been Busted by Red Matter 2.(Horizon and GT7 are shit BTW) but it's a Software problem not hardware .His CAD File "Leaked" Images are one of many prototypes and definitely will not look like the next Meta headset (I dislike Meta) Why no images of the fictional Decard?? Because Bradford has been given the Bums Rush !
You doing the RC car/steam deck screen pass through reminded me of how Apple has been doing screen sharing from Mac to iPad over wifi for a while. I’m guessing that this will be used with the HMD to show virtual screens in MR.(I am eternally scarred by a question on Cash Cab: What are the special characters above the numbers on a standard US keyboard? I didn’t know them in order!)
Very clever adaptations! You seem knowledgeable and inventive, so....perhaps I could bother you with a (semi-related) question: I am a looping musician and i want to create a VRchat avatar & then livestream my avatar performing on my irl musical instruments (synth, guitar, drum kit) in real time. Do you think green screen reversal is my best approach, or should I be looking at using something like Reality Mixer or LIV to map and virtualize my instruments, so they can be played in a vr setting that my avatar streams from? (hope that isn't confusing, lol) thanks for any shared thoughts.
This feels like watching an early prototype of products and concepts we might see in a few years. The dream would be, to be able to do this kind of tracking of objects without the need of attaching an expansive tracker to it. Makes me excited for what's to come - thanks Brad :)
Neural network to detect object bounding boxes / create a per-pixel cutout are pretty mature. So fine tuning one for your particular dog / beer shouldn't be that hard. It's brute force and probably not accurate enough for attaching screens to stuff but it'd work for any number of arbitrary objects at once.
If we can reduce Latency from Input to the Virtual Display and any micro latency factors between Headset and Games on the Virtual Display, we can remove all needs of super expensive multi display systems. I think, however, we'll need Multi-Chiplet based GPUs to make up for raw compute performance needed?
Well, getting rid of the bed in the background was a big step I'm sure. Congratulations you're one step closer to the background matching your content and becoming a regular UA-camr 😉. I enjoy your very well researched and insightful content, thanks.
Wish i could get the Mixed Reality working on my valve index. Turned on cameras and all i get is a box with fuzzy stuff in it. No camera pass through, frustrating the hell out of me.
When dual graphics cards were first a thing someone in my school made a multi use Linux terminal where each player would get one graphics card, each their own monitor and keyboard/mouse so you could have two games of quake III playing. The CPU was split of course but I wonder if this could be done in VR, give VRChat it's own graphics card and give the game it's own. Steam could let multiple games be run IF they were on the same PC. The memory would have to be split but that wouldn't be that big of a deal with modern memory, just buy 32GB of it. The CPU would be a problem though and mother boards that support two CPUs is really rare now. I also have no idea if Windows can even do this, I saw this on a Linux machine. This is a setup just for someone who wants to live in VR but if I could just get a new graphics card and mix it with my current one, giving the higher end graphics card to the most demanding of the two, either VR chat or the game, that would be cool. Buying two of the latest graphics cards at the same time because I think that is what would have to be done. . . Eh, I'm not that rich.
I'm just waiting until we're at the point where I can toss away my monitors because the resolution/colors/contrast/etc is on par with one in the physical world. I know our screens now are 'thin', but when you have 3-4 of them... things can start getting crowded. Would much rather have a clean desk with some HID devices on top than a tri-mount stand+monitors, etc. That coupled with something as unnoticeable as AR contact lenses and some sort of tactile+force feedback for the hands, and the desk can get tossed too ;) Keep up the great work and staying technical! It's harder and harder nowadays to find any in-depth info on anything without some entertainment or 'celeb scientist' element mixed in, especially on YT.
I wonder... with Meta / Oculus's newest headsets, the PSVR2, the Pico 4, HTC Vive XR Elite... all of these headsets have internal camera tracking of the environment rather than base stations and external tracking devices that require their own separate power supply from a battery or cable. I wonder if they can make it so that newer headsets can track a specific object you set, like a drink can or pet or other similar examples you gave. I know it's easy enough to press a button and use the pass through function, but in theory... they could use eye tracking of the user to see where one is looking, and if it's over an object it's meant to track, it will pass through that image. In theory... it's possible. 🤔
Super cool. I'd imagine in the future you might spend time before you enter the game/chat to assist AI in identifying specific items that might transfer into VR. You either record a 3D model, or you ensure that an AI can identify a can/keyboard/dog. You might have a choice to re-render the items in polygons - send them in or out of view - with highlighting or lighting. :) So many systems working together.
This might be new to some people but a lot of people's have already been working using VR using the quest 2! I work in VR with a quest pro. its amazing
Imagine a workplace meeting in VR where you are communicating with your engineering team. You have a meeting room that is completely vr, But you are showing off a real life prototype. Would it be possible to "cut out" this real world prototype to show it to your coworkers, but have them see the real world cutout of the object as it is viewed from your headset?
The only downside is this is taking Valve time to get this far plus still more wait to happen. While they're a good headset - they're moving, personally, a bit too slow to what everyone else is doing to some level. This means everyone else can almost do what they're doing now or getting close to it while offering better headsets now or about to come out.
Now THIS is what a real Metaverse looks like! Really cool concepts. You should submit these to some of these to VR companies like Meta so they can make them standard features.
I'm searching for an app to just use my desktop in VR like i do with 2D-games with alt-tab, but without controllers because I don't even own any for simming. Is this possible?
![10 Must-Try Meta Quest 3 Experiences [Non-Games]](http://i.ytimg.com/vi/2Q-PpuPEqY0/mqdefault.jpg)
The box moving/rotating with your dog is hilarious
Kneel before Zod's Dog.
that was perfect
reminds me of the shields from the original Dune movie lol
Ever time you say "Hi I'm Brad"
I imagine a rehab group respond "Hi Brad."
Copium addiction ruins lives. The first step is to admit you have a problem. The second step is for Valve to release the Deckard.
Crazy how well the index STILL holds up, even 4 years later. Genuinely my only 2 complaints with it were the displays and lenses, everything else was perfect.
Main reason I'm so excited for the beyond.
That's actually the main reason I'm doubtful about the Beyond - the displays and lenses are all it is. Everything else about Index that was great is missing.
If they can somehow make the FOV as good as Index and offer an off-ear audio strap that sounds as good as Index, then the other missing features can be overlooked, but I doubt they'll even get those two things right before launch.
@@DMan-ud6bt The Index also had overheating issues.
@@DMan-ud6bt You have a point. It needs audio, it needs trackers still so it's not any more mobile, and it still requires a cable which is honestly the heaviest thing about headsets. It's cool how small it is though.
@@blackjacksike1808 Yeah, I 3D printed a replacement frunk, like one that would unscrew the funk out and replace it with a fan, and what keeps my sweat down and eyes from drying out. It gets unbearable in a warm apartment without it.
Quest 2 owners & trolls who don't know what they're talking about trash talked the resolution _numbers_ off the panel spec sheet data without 1st hand knowledge of the dot pitch, contrast, PCVR resolution scaling, and other qualities making it the superior viewing experience to the panel and glass of a Q2, as well. "But I read some bigger number-thingies on the Internet, therefore I cannot be wrong"
Good stuff! Seems like Valve had a lot of plans for the Index cameras that never happened, could have been a great first mixed reality dev device
For sure. BTW, have always loved all your XR stuff. Past and present. Modbox still has a special place in the corner of my brain!
They could have released some kind of usb stereo high Def camera for the 'Frunk' to have a really good pass through MR experience.
@@CorporateZombi What about the stereo cameras already built into the device?
Was it now a first xr-tracked dog just there?
I saw a couple of VR recreated dogs, but this was the first MR dog in VR I think XD
Those real-items, square-shaped windows into the real world reminds me of the special effects of the personal shields in the first Dune movie.
It looks just like a cube map but you can actually see the cube which is the odd part. Pretty interesting trick.
Someone I know has been tracking his drinks for quite a while now. His beer bottle has a 1:1 3D object indicating how full it is. Also makes that nice *clang* when you cheers with others. Want to get to know him?
Ya, I’d love to meet them and show off their advanced beer tracker
Wow, great video, I definitively watched everything, even though the video was posted 2 minutes ago
Oh my god...a tracker on your drink sounds so insane..lol but fckn awesome imo
You say the Beer Tracker was the dumb one but honestly that's the number one thing I wish I had in VR. Even playing games, I wish I could just see where a drink I put down is.
This video is basically, "So like, what if, instead of *body* tracking, we did, like, *everything* tracking?"
New tracked controller: A dog xD
I heard someone mention pets when saying that Vive trackers can track anything, but that's the first time I see someone actually do that.
Seeing your dog tracked looked just like the shields in the 1984 Dune movie!!! So cool!
Another awesome video Bradley!
glad you enjoyed :D
You should work for valve 😮 hmm I wonder if that's your goal.?
you should do a denuevo vid. there's a huge community against it. given the praydog mod coming, denuvuevo deoptimization might affect a lot of games. (discourage devs from using them)
h
Finger tracking itself could find this useful as well indeed. Much potential. And best part, the bigger the play space, the more potential it has. It’s self composing or something.
Da puppy is SOOO CUUUUUTE!
Beer Tracking, definitely the future! This is actually the opposite of what I thought you were going to show. I thought you were going to show VR objects in your actual room. But this makes more sense for you I can see.
hi dad
Woof
Is this a new camera or just improved lighting? Video looks super clean!
Somewhat both. Recently started using Razer Kiyo Pro Ultra as my camera
@@SadlyItsBradley dude that's webcam quality!? Holy cow does that thing look good 💪
Imagine pairing that with Facebook new model which crops objects very accurately. You will basically import your dog into vr 😅
The Index really was way ahead of it's time in terms of capabilities. My only complaints now are it's bulk, the heat, the lenses, and the display. Really wish it was M-OLED rather than LCD. :(
Never knew i needed beer and dog tracking for VR but now i want it 😂
Wow, mind blown. Leave it to Bradley to kick things up to an 11. Now I have to go buy another 4 pack of Tundra Trackers. . . I like playing retro games with the right controller and it is difficult in EmuVR but with this I can track a few controllers. The main problem is finding them. I'd rather not have my hands and be able to see my controllers instead.
freaking cool!
Meta should leverage AI technology to scan and track real-world objects, and then integrate them into the VR environment using the new Quest-3 high-resolution color camera. This would allow users to interact with their real-world items while in VR. For instance, imagine playing poker in VR and being able to see and interact with your beer, or watching a movie in a VR environment like big screen vr and seeing your popcorn. You could even bring your Nintendo Switch into VR chat, or mark out your real-world TV so you can see it in your virtual room in VR chat world. This integration of real and virtual environments would significantly enhance the user experience in VR.
Wonder if developers could use google 360 world map. We could play in the real world as an avatar, would sort of be like using AR outside.
Nut tracker! Also I love what you did with the steam deck passthrough, so cool!
The ability to drink a drink while in VR is why apple vision pro will succeed.
Its.. kinda brad
Beer tracking is useless without WC tracking
1.5 meters to beer
1.0 meters to beer
.3 meters to beer
Beer Imminent
Beer Acquired
Denuvo really does bring down games to its knee.
Next video: getting drunk in VR using beer tracking.
omg the wiggly box when your dog runs around is frickin adorable. And this overlay thing is awesome! And it's nice to see the Steam Controller being of use. I haven't used mine in forever, but I still love it.
I am interested in jumping into tethered VR in the future, but not interested in buying into the Index at this stage in it's product cycle, so looking forward to Valve's next iteration (hopefully it isn't like HL3).
The beer finder is brilliant. #1 most needed vr feature
Chookity!
Nice to see some love for the steam controller
What a treat, so many vids this week!
Brilliant! I love the r/c car!
omg the dog strapped to tracker
This is awesome!
I always was bugged how Vive advertises you can "bring objects from the real world into the virtual universe" with their trackers, but there is just so little software support for anything other than body tracking. I hope to see object tracking get more creative and supported :)
Great show mate 👍
I like the outside the box thinking! Great work with the experimentation!
wait the steamdeck can play fuckin vrchat?? why didnt anyone ever tell me?
Yeah.
At the end of the day, it's just a PC with Linux.
Fifth? Excited for the watch.
I'm going to say it's not the 4090 that was causing performance problems with Denuvo games. It's your CPU. The GPU has nothing to do with Denuvo. What processor do you have?
I’ve been trying to play to 2D games in the VR chat but I keep running into an input problem which is when I play the 2D game I also move around in VR chat at the same time while using a controller. Do you know any way to get past this?
I gotta finish your review on DPVR I like the flip up & user friendly design. What is a cheap PC you recommend?
I like how you got 117k subs and now post a video playing Halo lol (at least playing for a little bit)
Oh Fug lol
It was fun (And Money Making)while it lasted..Brad has sadly been exposed as a Scam Artist ! He's about to be fired from Bigscreen for giving poor development advice regarding their floundering headset His inaccurate analysis of the PSVR2'S screen persistence problem has been Busted by Red Matter 2.(Horizon and GT7 are shit BTW) but it's a Software problem not hardware .His CAD File "Leaked" Images are one of many prototypes and definitely will not look like the next Meta headset (I dislike Meta) Why no images of the fictional Decard?? Because Bradford has been given the Bums Rush !
You doing the RC car/steam deck screen pass through reminded me of how Apple has been doing screen sharing from Mac to iPad over wifi for a while. I’m guessing that this will be used with the HMD to show virtual screens in MR.(I am eternally scarred by a question on Cash Cab: What are the special characters above the numbers on a standard US keyboard? I didn’t know them in order!)
Brad, take care of your eyes. It is visually noticeable that you often spend time in vr.
I had never heard of Reality Mixer. This might finally get me back into flight simming in VR!
Imagine having your dog, in Horizon Call of the Mountain/HL:A lol. Know those games can't be put in the same sentence...
Very clever adaptations! You seem knowledgeable and inventive, so....perhaps I could bother you with a (semi-related) question:
I am a looping musician and i want to create a VRchat avatar & then livestream my avatar performing on my irl musical instruments (synth, guitar, drum kit) in real time. Do you think green screen reversal is my best approach, or should I be looking at using something like Reality Mixer or LIV to map and virtualize my instruments, so they can be played in a vr setting that my avatar streams from? (hope that isn't confusing, lol)
thanks for any shared thoughts.
This feels like watching an early prototype of products and concepts we might see in a few years.
The dream would be, to be able to do this kind of tracking of objects without the need of attaching an expansive tracker to it.
Makes me excited for what's to come - thanks Brad :)
Neural network to detect object bounding boxes / create a per-pixel cutout are pretty mature. So fine tuning one for your particular dog / beer shouldn't be that hard.
It's brute force and probably not accurate enough for attaching screens to stuff but it'd work for any number of arbitrary objects at once.
If we can reduce Latency from Input to the Virtual Display and any micro latency factors between Headset and Games on the Virtual Display, we can remove all needs of super expensive multi display systems. I think, however, we'll need Multi-Chiplet based GPUs to make up for raw compute performance needed?
Well, getting rid of the bed in the background was a big step I'm sure. Congratulations you're one step closer to the background matching your content and becoming a regular UA-camr 😉.
I enjoy your very well researched and insightful content, thanks.
Wish i could get the Mixed Reality working on my valve index. Turned on cameras and all i get is a box with fuzzy stuff in it. No camera pass through, frustrating the hell out of me.
When dual graphics cards were first a thing someone in my school made a multi use Linux terminal where each player would get one graphics card, each their own monitor and keyboard/mouse so you could have two games of quake III playing. The CPU was split of course but I wonder if this could be done in VR, give VRChat it's own graphics card and give the game it's own. Steam could let multiple games be run IF they were on the same PC. The memory would have to be split but that wouldn't be that big of a deal with modern memory, just buy 32GB of it. The CPU would be a problem though and mother boards that support two CPUs is really rare now. I also have no idea if Windows can even do this, I saw this on a Linux machine.
This is a setup just for someone who wants to live in VR but if I could just get a new graphics card and mix it with my current one, giving the higher end graphics card to the most demanding of the two, either VR chat or the game, that would be cool. Buying two of the latest graphics cards at the same time because I think that is what would have to be done. . . Eh, I'm not that rich.
Steam doesn't like you running the games you own in parallel? That's not ownership. Also XR needs eurobeat.
I'm just waiting until we're at the point where I can toss away my monitors because the resolution/colors/contrast/etc is on par with one in the physical world. I know our screens now are 'thin', but when you have 3-4 of them... things can start getting crowded. Would much rather have a clean desk with some HID devices on top than a tri-mount stand+monitors, etc. That coupled with something as unnoticeable as AR contact lenses and some sort of tactile+force feedback for the hands, and the desk can get tossed too ;)
Keep up the great work and staying technical! It's harder and harder nowadays to find any in-depth info on anything without some entertainment or 'celeb scientist' element mixed in, especially on YT.
I wonder... with Meta / Oculus's newest headsets, the PSVR2, the Pico 4, HTC Vive XR Elite... all of these headsets have internal camera tracking of the environment rather than base stations and external tracking devices that require their own separate power supply from a battery or cable. I wonder if they can make it so that newer headsets can track a specific object you set, like a drink can or pet or other similar examples you gave. I know it's easy enough to press a button and use the pass through function, but in theory... they could use eye tracking of the user to see where one is looking, and if it's over an object it's meant to track, it will pass through that image. In theory... it's possible. 🤔
Gonna be interesting when Razer releases a mouse with a built-in vive compatible tracker.
Super cool. I'd imagine in the future you might spend time before you enter the game/chat to assist AI in identifying specific items that might transfer into VR. You either record a 3D model, or you ensure that an AI can identify a can/keyboard/dog. You might have a choice to re-render the items in polygons - send them in or out of view - with highlighting or lighting. :) So many systems working together.
Apparently Peanut committed warcrimes and is now stuck in the Phantom Zone with General Zod from Superman.
This might be new to some people but a lot of people's have already been working using VR using the quest 2!
I work in VR with a quest pro.
its amazing
I would like to see upgrade / spare parts kit for index that contains better resolution displays even if it means to give up 120 and 144 Hz modes.
Imagine a workplace meeting in VR where you are communicating with your engineering team. You have a meeting room that is completely vr, But you are showing off a real life prototype. Would it be possible to "cut out" this real world prototype to show it to your coworkers, but have them see the real world cutout of the object as it is viewed from your headset?
I would rec chrome CANARY beta branch over metachromium
Brad, you are, you are, like a super nerd bro! Like SO nerdy.....lol Rock on! OH my God!
Ok, hear me out, take out that half broken vive wand, rubber band it to your drink. Boom, smart alcoholism!
I wonder how it is like to have one of these tracked dog while doing Vesper peak. The human brain can't handle MR double dogging I bet.
I'm in the simming community and I never knew that feature existed 😭😭😭
TIL I'm obsessed and crazy, thanks, brad!
"This is the Valve Index"
My surprise is non-existent and my day is made.
This is indeed the right way to go learning to incorporate about new tech
Definitely trying some of this out for my sim setup! Also, nice Yuru Camp shirt!
The only downside is this is taking Valve time to get this far plus still more wait to happen. While they're a good headset - they're moving, personally, a bit too slow to what everyone else is doing to some level. This means everyone else can almost do what they're doing now or getting close to it while offering better headsets now or about to come out.
I accidentally tugged on my webcam cable and all of a sudden my pc showed me the two fisheyes of my index instead
Was kinda cool tbh
Cool, next and I want to see a selfie cam tracker that doesn't require the source hmd's line of sight. 🤔
It would be really cool if you could just have a 3d model instead of the passthrough
I feel like Quest 3 would be well set up to do this stuff with it's depth sensor if Meta had the imagination to think of it... but I doubt they did :P
A neat XR prototype is that shooter with random characters within your own house/environment, forget the name of the project
So, yeah. Beer tracking. This is the future!
Craziest thing is Nintendo had cool at for The 3ds for its time. I was fascinated
Yall heard it here first… beer tracking is the future 🤣
Shooting laser beams into your eyes sounds terrifying.
Faites de même avec Zelda TotK avec une image 3D stéréo ! 🙏👍👋
That doggy box looks like it might need to be just a little bit bigger for those fast movements.
What did he mean by this? Quest 3? Or some other headset? 4:21
Now THIS is what a real Metaverse looks like! Really cool concepts. You should submit these to some of these to VR companies like Meta so they can make them standard features.
I’m watching this for the first time 2 months late, so much has changed sense then, still interesting tho.
Valve index is still rly good, we just need higher resolution and be wireless. Hopefully no downgrades on sound, microphone or comfort.
I'm searching for an app to just use my desktop in VR like i do with 2D-games with alt-tab, but without controllers because I don't even own any for simming. Is this possible?
I genuinely can’t think of one 😭