I just wanna see Goggle manufacturer's take a cue from goggles like bigscreen VR. Optics are massive pancakes yet the goggles are tiny vs all the hardware they got. I wouldn't even mind if a hdmi sized cord ran down the back to a VRX That's not mounted to my head weighing me down, though some would still want a clip on vrx to keep things compact. So many ideas that haven't been tried in fpv goggles. Imo goggles should be stand alone with VRX modules like analog used. This would allow HD transmission to be the focus of walksnail/hdzero and others to focus on comfort/size/image quality
Im doing same with oculus quest 2 because i dont have real fpv googles 😅 but i only see big screen in front of me. But i have usb antena for video feed directly from drone and an actual app inside my quest, pretty seamless experience
5:52 cool thought, but thats not line of sight 😰 You are still watching a camera feed from Vision Pro's camera. The whole Vision Pro concept is you will never see anything line of sight, including your own hands.
Thanks for this awesome test. This is the future, definitively. This is much more natural than having fixed and fpv feed only. Been able to grab the remote control, and walk without removing the glasses is really natural. But we need to fix the distraction of side immersion. I had not thought about this issue. Vision pro price will go down, and will support better video integration. And we will see more and more devices like this in the future. I'm 100% sure that this will be a really valid solution on Les than 5 years from now. And need to fix the latency of course.
I’m really wanting this to work for my Mavic three set up. Having multiple screens like shot list, safari and FPV in front of me all at once is a game changer.
This video reminds me of older Rotor Riot videos -- which I loved -- when the cast tried all sorts of wild things. Good to see Le Drib again. Please do more like this!
DJI apps are flyable but still have DJI latency. Can’t say what it would do with O3 but not sure you would be able to get that feed without DJI goggles.
No matter how much money they put into these goggles, they still won't be able to create a stereoscopic FPV system that transmits video from two cameras to both eyes.
How about taking the next step ... a 180 degree fisheye lens, and then render the resulting video feed to the inside of a hemisphere in the goggles, so that you can look up/down/around with no fixed camera angle ;) OpenHD + Android app + 'cardboard' VR - should be a LOT less laggy ;)
I've been using x-real air glasses with my walksnail set up and i feel that's more of a future for our fpv hobby than these apple ones .. it is a lot more comfortable to wear, even for longer periods of time .
Ok…Shawn makes a bulletproof glass drone frame and standoffs (if possible), not including screws and mounting hardware (unless you can make that too). Dude what a freaking sweet video to make
why the lag? Seems really impressive, this Apple Vision Pro. So expensive and so exciting. I’m still not used the this vision after watching your trial
they are soo close to perfection, looking over the specs, all they needs is 3d hd input at 4k and 2 axis gimbals that move the cameras as you move your eye balls(these googles already have cameras on your eye balls to track them) from there it just needs to feed the data back to the fpv 3d cameras/motor combos and you'll have REAL 4k 3d with cameras that adjust the focal point in real time based on your own visions movement! bliss!
Why not start with a VRX? I'm testing the Xreal Air 2s tomorrow. Should be no additional latency beyond the extra frame of running a VRX. The VRX when run at 720p 100 fps feels like DJI 03 latency.
The issue then is also getting the video into the vision pro, most of the latency will come from the capture card and wireless connection from the laptop to the vision pro, just like this setup. Chances are the goggles aren’t contributing significantly to the latency.
I appreciated your explanation of how to get the FPV footage into the Vision Pro. The real question is “Would the ‘line of sight’ test count with the Vision Pro view?”
thank you for the video... it doesnt feel real like FPV, but the good side is operator can always have a visual line of sight of the drone without a need for spotter..
It's just good for making this UA-cam video. Whatever setup you have screams LATENCY! A capture card? Putting the captured video onto the laptop screen and then using Vision Pro to view the laptop screen. State of the art.
Meta Quest 3 with their Link cable direct to the laptop removes the video capture gadget/lag. Similar desktop app routine. So should be a bit faster? Less lag? Laurie NZ.
That is cool! I think its the captuce card causing all the Lag... Is there no way to have an HDMI or USB-C Video Input, directly from the Goggles to the Apple Vision Pro's. Or maybe even a VRX at that point lol..
yassss, I def think if we can get the latency down something like this could be huge for FPV💓...it's always just a little bit unnerving being fully immersed in the goggles when people are around you, being able to fly while feeling safe in your surroundings would be game changing ❤🔥
Great to see the vision pro test and appreciate that you show how and what it looks like. Love the idea that ar/vr goggles/glasses are so multi use. This can be done with meta quest and other “smart glasses” too. The link is capture card from analog or capture card from digital. Then side load apps to get capture card feed direct into quest or other Android based glasses. Quest is probably most like the vision pro and can do pass trough and have multiple apps opened. Add BF configurator and you don’t have to carry a laptop or your phone, it’s in your face 😅. I’ve set up another set of Epson ar glasses that are great to mix LOS with a screen like you pointed out. I don’t think these options will be the best replacement for ultra low latency purpose built goggles but might not be too bad. Testing is inconclusive for now. Best thing with these mixed use glasses is …mixed use. I could be writing this in a quest or vision pro and getting my pids changed on another screen while staring at my camera feed or flight plan and shot list (like someone commented), or google maps, or UA-cam videos, or…YEAH! *bonus you can get some DJI apps to side load and fly. I’ve flown a spark and skydio 2 using my hands in quest! *extra bonus I’ve got HDZero to work in quest and Epson too. Hoping to post videos soon. Had to comment cause we’re all thinking alike here and we learn from each other. Don’t love that vision pro cost +$3k but you show a great use and these types of glasses and videos show the possibilities.
I think that ability to see your environment is the future of fpv. It needs to be perfected and built for that purpose but will eliminate the need of a VO. I see a huge use case and potential
Chances are it will just cause new regulations. A better option is just to scrap the LOS laws, or maybe at least let people sit a test to prove they are competent and can be aware of their surroundings.
decreasing the resolution of the mac screren mirror drastically helps with the latency. Also it would've been useful to see how good/bad the latency was just on the MacBook, would've given us an ideas if it was the equipment or just the connection to the mac mirroring
Yeah. If the latency gets down to a tolerable amount, I’d say it makes more sense to fly with these AR headsets. It’s like ebook readers vs tablet. You not only have most of the features an FPV goggle gave but also a whole bunch of practical applications.
It was pretty obvious this wasn't going to work well, but there are a couple of other things I would have been interested in. First, how was the quality of the image compared to a pair of good OLED FPV goggles? Did the perceived quality change when you adjusted the size of the image (essentially your virtual goggle FPV)? Second I would have liked to see an experiment where you tried to match the apparent FOV of the image to reality (so that the virtual goggle and the drone camera have the same FOV). This might require video player software that would project the image onto a sphere instead of a plane which probably ins't available (but wouldn't be hard to implement). Third you could have eliminated all of the 'extra' latency that you added to the setup by trying to do more line of sight flying. That would give you the minimum latency of the system. The ultimate take on this would be to have the vision integrated into the FPV feed. Using the foveated rendering the air unit could transmit just the area in front of your pupil in high def and deliver everything else at much lower resolution. That would probably allow for an effective 4k image with current image transmission technology.
How does it? If the antennas are mounted on you then you can’t turn to stay facing the drone you would need to move the screen too. A better option is just to decouple you and the antennas, have a tripod or something so the antennas can stay fixed or you can add some motors and have then track the drone.
Did not expect this. I want an app made for FPV. It could be made to be immersive and the low latency of the AVP natively should be much better than goggles>capture card>MBP>AVP
This could be useful for piloting dual operator cinema drone like inspire or alta, so far most pilots use 2 monitors, one for the fpv and one for the cinema camera. Both feeds in big virtual reality screens will make tons of difference compared to using the usual 7" monitors. Imagine all those setups with tripods, sun hoods, batteries and etc. could be solved with only one set of goggles.
I'd imagine with an optimized app, they could probably achieve decent latency. The hardware is there. The biggest issue is probably the lack of a wired input so you gotta transmit a video twice
Afaik the lsptop screen is transferred wirelessly to the goggles, which probably causes a lot of interference with the FPV video transmission. So I guess moving the fpv goggles farther from the laptop AND vision pro goggles should improve the feed quality. Not sure about the lag though.
imagine having everyones feed all at once, do split screen co op with other pilots lol
somehow i had the 4way splitscreen of mariokart in my head after reading that.. 😂😂😂👍🏻
@@Charlie_WafflesI had exactly the same thought 😂
@@GarethDix 👍🏻💪🤣
I hope that was a mannequin @ 6:40
Me too 😬
I instantly saw this too haha.... Looks like shriveled post mortem hands tbh.
Good to see Drib flying again, love that style. These may not be the future but maybe a glimpse of the future.
I just wanna see Goggle manufacturer's take a cue from goggles like bigscreen VR. Optics are massive pancakes yet the goggles are tiny vs all the hardware they got. I wouldn't even mind if a hdmi sized cord ran down the back to a VRX That's not mounted to my head weighing me down, though some would still want a clip on vrx to keep things compact. So many ideas that haven't been tried in fpv goggles. Imo goggles should be stand alone with VRX modules like analog used. This would allow HD transmission to be the focus of walksnail/hdzero and others to focus on comfort/size/image quality
I like that style. So buttery smooth, like 100% pure lube.
@@ChrisHarmon1 openipc does and will work with Quest
I always thought they were just glorified FPV goggles! I'm glad someone is finaly testing it!
Calling the AVP glorified FPV goggles is like calling an F1 car a glorified go-kart.
@@willsintheairtrue :)
Im doing same with oculus quest 2 because i dont have real fpv googles 😅 but i only see big screen in front of me. But i have usb antena for video feed directly from drone and an actual app inside my quest, pretty seamless experience
@@willsintheairdude i tried apple vision and it sucked 😅 ita definitely not f1, ans im not a newbie neither in vr or xr
When your buddies keep distracting you during an FPV session - just go to the moon! ^^
That seemed pretty cool aside from the latency issues.
Finally we got drib flow!!! Made my night man!! The style is yours only 👑 💯 And this was pretty awesome watching the VR. Fun stuff!
Dead guy at 6:39 lol
5:52 cool thought, but thats not line of sight 😰 You are still watching a camera feed from Vision Pro's camera. The whole Vision Pro concept is you will never see anything line of sight, including your own hands.
Thanks for this awesome test. This is the future, definitively. This is much more natural than having fixed and fpv feed only. Been able to grab the remote control, and walk without removing the glasses is really natural. But we need to fix the distraction of side immersion. I had not thought about this issue. Vision pro price will go down, and will support better video integration. And we will see more and more devices like this in the future. I'm 100% sure that this will be a really valid solution on Les than 5 years from now. And need to fix the latency of course.
12:04 the latency on the goggles alone was 96ms - something was way off on your goggles/vtx let along cap card and laptop and vision :/
Bubby flew 1mbps with insane delay, that quad needed to be power cycled. I am impressed he flew through all that.
If anyone can…. 😂
Why is there a dead body on the ground at 6:39 ?
Would DJI USB out work directly with the Vision Pro and widefpv website?
Good to see Drew flow again. Miss the vlogs and relaxing style of flying.
My favorite part was watching drib rip after the attempts with those goggles. It’s been a while since I’ve seen a nice freestyle from Drew!!!!
Pilot: How is the latency? Answer: YES
I’m really wanting this to work for my Mavic three set up. Having multiple screens like shot list, safari and FPV in front of me all at once is a game changer.
You guys should try out the Meta Quest 3, I belive you can use it to fly fpv with low latency and in mixed reality.
This video reminds me of older Rotor Riot videos -- which I loved -- when the cast tried all sorts of wild things. Good to see Le Drib again. Please do more like this!
I do wonder if flying thru the DJI Fly app's mirroring would have less latency
DJI apps are flyable but still have DJI latency. Can’t say what it would do with O3 but not sure you would be able to get that feed without DJI goggles.
Now you can sit in the comfort of your home and fly everywhere with a better FPV feed. But nothing will replace the FPV goggles.
I wonder what happens if you connect to the XREAL Air Pro 2 glasses? I bet with the significantly less software processing it may have less latency.
No matter how much money they put into these goggles, they still won't be able to create a stereoscopic FPV system that transmits video from two cameras to both eyes.
How about taking the next step ... a 180 degree fisheye lens, and then render the resulting video feed to the inside of a hemisphere in the goggles, so that you can look up/down/around with no fixed camera angle ;)
OpenHD + Android app + 'cardboard' VR - should be a LOT less laggy ;)
Amazing!
btw at 6:38, wtf is the body on the ground? HAHHAHHAH
I was so tempted to press F to switch the FPV to fullscreen
Come on guys, you know we all would react like ole boy, "We about to rip with the Vision Pros?"
I wonder how it is on a quest 3. A quest 3 will get you 85% with all the same hand tracking and Mixed reallity there and save you $3000
It works! I've done it with my Quest 2 and a ~20$ ADC board. Latency feels like somewhere between 100 and 200 ms.
Aw man this is what I missed!! The Vision Pro!! 😅
I've been using x-real air glasses with my walksnail set up and i feel that's more of a future for our fpv hobby than these apple ones .. it is a lot more comfortable to wear, even for longer periods of time .
When you said let’s go to Joshua Tree I though you were going to end up standing in Joshua Bardwells yard….
I'm glad this video is coming out because I want to do the same thing with a Meta Quest 3 and an analog signal.😅
Try to side load the fly app. I have DJI go 4 on quest 2 working but fly app doesn’t cooperate just yet.
This is freaking awesome!
OMG...😂
how long time lag when flying a drone using vision pro ?
Its def not the future of fpv
EDIT: omg chill idc if it is or not i just said that to be early
Why isnt it, this is a first iteration in which fpv was not even considered
@@joshstroud6823 lol it might be, i just said that because i wanted to be early
It will be. And I say this never having owned one apple product
@@joshstroud6823because it's just not. Explain how this is better than just regular goggles?
DJI Goggles 3 may introduce something of similar experience
latency has to be the laptop. can't you take the video out from the FPV goggle directly to the vision Pro?
bro 4000$ goggles
i guess drib found a way to expense a set of apple vision pro's.
😇
Okay thats a really cool idea and i really would buy a vision pro just for this if there was no latency! But the idea is🔥🔥🔥
Drew !!! We want to see you fly more often ! Fun video anyway. But fly more please !
openipc i wonder if that can be made to connect.
Can the vision pro do the remote id for the dji series?
Ok…Shawn makes a bulletproof glass drone frame and standoffs (if possible), not including screws and mounting hardware (unless you can make that too).
Dude what a freaking sweet video to make
I'm curious of the refresh rate is on those, if you were able to have a direct feed, how good would the latency be.
why the lag?
Seems really impressive, this Apple Vision Pro. So expensive and so exciting. I’m still not used the this vision after watching your trial
they are soo close to perfection, looking over the specs, all they needs is 3d hd input at 4k and 2 axis gimbals that move the cameras as you move your eye balls(these googles already have cameras on your eye balls to track them) from there it just needs to feed the data back to the fpv 3d cameras/motor combos and you'll have REAL 4k 3d with cameras that adjust the focal point in real time based on your own visions movement! bliss!
i think something wrong when bobbys turn, its more pixelated image, something like an antenna position or connection with donggle
Thanks guys for this video. Very nice! i enjoyed it 😊 even if this is not FPV future!
Why not start with a VRX? I'm testing the Xreal Air 2s tomorrow. Should be no additional latency beyond the extra frame of running a VRX. The VRX when run at 720p 100 fps feels like DJI 03 latency.
The issue then is also getting the video into the vision pro, most of the latency will come from the capture card and wireless connection from the laptop to the vision pro, just like this setup. Chances are the goggles aren’t contributing significantly to the latency.
I appreciated your explanation of how to get the FPV footage into the Vision Pro. The real question is “Would the ‘line of sight’ test count with the Vision Pro view?”
Instead of Joshua tree it would be cool if you posted the inside of a cockpit and put the voltage and osd function on the gauges of the cockpit.
thank you for the video... it doesnt feel real like FPV, but the good side is operator can always have a visual line of sight of the drone without a need for spotter..
It's just good for making this UA-cam video. Whatever setup you have screams LATENCY! A capture card? Putting the captured video onto the laptop screen and then using Vision Pro to view the laptop screen. State of the art.
Meta Quest 3 with their Link cable direct to the laptop removes the video capture gadget/lag. Similar desktop app routine. So should be a bit faster? Less lag? Laurie NZ.
You guys should also test a fpv sim in vision pro and see if it actually feels more immersive and not sitting behind a monitor screen.
thats was fun, plus it remined me of the alexanfer o'neil track, if you were here tonight.
Don't give apple any ideas if you don't wanna be over charged for basic functions.
That is cool! I think its the captuce card causing all the Lag...
Is there no way to have an HDMI or USB-C Video Input, directly from the Goggles to the Apple Vision Pro's. Or maybe even a VRX at that point lol..
fantastic guys, looks awesome
really cool episode. Drib, you should be in the videos more often, or post more on your personal's because i miss your flying.
I’ll be at GTI April 19th for Third Coast Airsoft “Stonebreaker 2024” we’ll be using drone to drop ordinance.
I was waiting for someone to do this!
I was waiting for someone to involve Fpv with the Apple vision pro
What about the quest meta 3? Maybe there is less lag cuz of the direct input video system they have.
yassss, I def think if we can get the latency down something like this could be huge for FPV💓...it's always just a little bit unnerving being fully immersed in the goggles when people are around you, being able to fly while feeling safe in your surroundings would be game changing ❤🔥
Does “Full Screen” do anything?
The capture card is obviously the source of the latency.
A lot of people are complaining about virtual display latency with the vision pro so it at least plays a role as well.
Very interesting. I saw Billy Kyle flying his Mavic but I guess the latency for fpv is far too bad and having the screen move is at least strange.
Couldn't you just link your phone or sumn or dji o3 with dji fly app and send that to the vision pro screen?
Great to see the vision pro test and appreciate that you show how and what it looks like.
Love the idea that ar/vr goggles/glasses are so multi use.
This can be done with meta quest and other “smart glasses” too. The link is capture card from analog or capture card from digital. Then side load apps to get capture card feed direct into quest or other Android based glasses. Quest is probably most like the vision pro and can do pass trough and have multiple apps opened. Add BF configurator and you don’t have to carry a laptop or your phone, it’s in your face 😅.
I’ve set up another set of Epson ar glasses that are great to mix LOS with a screen like you pointed out.
I don’t think these options will be the best replacement for ultra low latency purpose built goggles but might not be too bad. Testing is inconclusive for now.
Best thing with these mixed use glasses is …mixed use. I could be writing this in a quest or vision pro and getting my pids changed on another screen while staring at my camera feed or flight plan and shot list (like someone commented), or google maps, or UA-cam videos, or…YEAH!
*bonus you can get some DJI apps to side load and fly. I’ve flown a spark and skydio 2 using my hands in quest!
*extra bonus I’ve got HDZero to work in quest and Epson too.
Hoping to post videos soon.
Had to comment cause we’re all thinking alike here and we learn from each other.
Don’t love that vision pro cost +$3k but you show a great use and these types of glasses and videos show the possibilities.
Normally you fly in a sim from real life. Now you're flying in real life from a sim!
I think that ability to see your environment is the future of fpv. It needs to be perfected and built for that purpose but will eliminate the need of a VO. I see a huge use case and potential
Chances are it will just cause new regulations.
A better option is just to scrap the LOS laws, or maybe at least let people sit a test to prove they are competent and can be aware of their surroundings.
Try with the quest 2 or 3, you can plug a capture card directly into it, barely any latency
You should try it with the developer strap... might get the latency down.
decreasing the resolution of the mac screren mirror drastically helps with the latency. Also it would've been useful to see how good/bad the latency was just on the MacBook, would've given us an ideas if it was the equipment or just the connection to the mac mirroring
Sorry that looks laggy? And how's the latency?
how to connect my analog cam to apple goggle? :))
analog capture card
@@mrvelocity3428 Owh, Thank you 👍
Very cool guys!
Yeah. If the latency gets down to a tolerable amount, I’d say it makes more sense to fly with these AR headsets. It’s like ebook readers vs tablet. You not only have most of the features an FPV goggle gave but also a whole bunch of practical applications.
Those Macintosh goggles are just a big WHY? :D
Do it with the quest 3. Has hdmi input not
Quest 3 app when ?
I guess will be cool to have a live feed from a 360 camera(probably with openipc) and with an app on Apple Vision to display that live feed in 360
It was pretty obvious this wasn't going to work well, but there are a couple of other things I would have been interested in.
First, how was the quality of the image compared to a pair of good OLED FPV goggles? Did the perceived quality change when you adjusted the size of the image (essentially your virtual goggle FPV)?
Second I would have liked to see an experiment where you tried to match the apparent FOV of the image to reality (so that the virtual goggle and the drone camera have the same FOV). This might require video player software that would project the image onto a sphere instead of a plane which probably ins't available (but wouldn't be hard to implement).
Third you could have eliminated all of the 'extra' latency that you added to the setup by trying to do more line of sight flying. That would give you the minimum latency of the system.
The ultimate take on this would be to have the vision integrated into the FPV feed. Using the foveated rendering the air unit could transmit just the area in front of your pupil in high def and deliver everything else at much lower resolution. That would probably allow for an effective 4k image with current image transmission technology.
Screen staying in spot help with keeping directional antennas right direction if it was fpv goggles
How does it? If the antennas are mounted on you then you can’t turn to stay facing the drone you would need to move the screen too. A better option is just to decouple you and the antennas, have a tripod or something so the antennas can stay fixed or you can add some motors and have then track the drone.
@conorstewart2214 well true if you start flying fast right you can just turn your head alil
This could be the next fpv thing. With dji, creating a system where you can the world and the fpv feed so you can fly and be safe.
WHY DONT USE HDZERO SYSTEM ?
bro I love pdevx's long hair
Did not expect this. I want an app made for FPV. It could be made to be immersive and the low latency of the AVP natively should be much better than goggles>capture card>MBP>AVP
This could be useful for piloting dual operator cinema drone like inspire or alta, so far most pilots use 2 monitors, one for the fpv and one for the cinema camera. Both feeds in big virtual reality screens will make tons of difference compared to using the usual 7" monitors. Imagine all those setups with tripods, sun hoods, batteries and etc. could be solved with only one set of goggles.
I connected DJI RC2 with USB-c to HDMI, to a HMDI to USB-C capture device connected to quest 3, and there is almost no latency.
dji should release an app for o3 and the vision pro..
Imagine a good looking sim on the Vision Pro, that would be awesome, I guess
Great video!!!
I will be happy to make this app.
I'd imagine with an optimized app, they could probably achieve decent latency. The hardware is there. The biggest issue is probably the lack of a wired input so you gotta transmit a video twice
Afaik the lsptop screen is transferred wirelessly to the goggles, which probably causes a lot of interference with the FPV video transmission. So I guess moving the fpv goggles farther from the laptop AND vision pro goggles should improve the feed quality. Not sure about the lag though.
good passthrough will come back to fpv goggles
Did anyone notice that dead body @6:39?
I think y'all should definitely try cars with FPV on it while you're walking behind the car
It would be fun to see how other vr goggles work in fpv