A proof of concept attempt at true Mixed Reality Flight Simulation utilizing the color passthrough video to combine a real life cockpit with the VR flight sim world.
This topic interest me as someone that has a lot of money in peripherals and needs to be able to see them. It's hard to correlate their relationship and what's happening in VR in a smooth manner, rather than having to constantly rely on muscle memory.
They actually already have this and it is being further developed. No "mixed reality" needed. Real world knobs, etc., that have virtual 3d models of its real world counterpart, that you can then place in your virtual cockpit and sync them together. Reach out to grab that virtual flaps lever, and actually grab a real world flaps lever whose location is perfectly synced with your virtual flaps lever! It is VERY cool and I believe this type system will dominate over a mixed reality system.
Another great video Russ. You are a great innovator with regard to Flight Simming. This looks like the start of something great. It will surely be developed further.
Super interesting video here Russ, thank you for sharing. I had a feeling it wouldn't be long before someone developed a solution given the pass through on the Quest 3 is as you say, getting there. I may give this a go once I get the Somnium VR1 and XR-4 in my hands. Exciting stuff. Best wishes.
Thanks for your comments . Yes it’s not a great solution yet but Varjo has a rather elegant implementation of MR. A home cockpit will never compete with the beauty of a VR cockpit so I’d love to see an effective hand tracking solution but for hands on training MR seems to be the best current option. Keep up your great work for the community!
Great POC Russ. I've been trying to set it up with my Quest 3 and when I add the boxes all I see is white noise graininess. I go to camera configs and the cameras won't initialize and the option that you have that said "Quest, Pico, of Vive XR Use Solid Color..." just doesn't exist on my camera config screen. Any tips? I'm super interested to try this out.
Same here. I can't get the Quest3 Cameras to be available. Looks like I need the Beta version you mentioned. Is there an access code for the beta as Jasper mentioned?
Inspiring video and ideas, I really think that mixed reality will be the future of flightsimming and increased immersion, if we can use and see our own hands within the simulation that will be a huge change.
Good afternoon Please tell me what could be the problem, when I launch Reality mixer on my Meta Quest 3 glasses, it’s like my cameras don’t work. The area in which the room should be visible is simply gray. What could be the problem?
Been a vr user since the original oculus rift. I just purchased the quest 3 from a quest 2. Night and day diffrence adding color pass through. Mixed reality is where it’s at.
Interesting, but clearly lacking a lot! If you are into "immersion" of the flight simulator, I believe this Mixed Reality destroys that reality. Maybe in a year or two Mixed reality will get better. Are you in the PDX area?
Thank you for this video. I was not even aware of this possibility, but that is because I've switched to MSFS2020 from Xplane11. This is great and exactly what I was wishing for. Even just the possibility of taking hand notes in RL or looking at the charts and maps, rather than having a separate window in the VR cockpit I think is a lot more user friendly. I've been struggling with that a lot. Shame that this is not available in MSFS but this alone may persuade me to switch back to Xplane.
Great work! This is where VR needs to go! I don't enjoy flying with my headset often simply because if I'm trying to be a "serious simmer" (for lack of better word) I have so much hardware that I can't use in VR, which makes me less efficient flying. Let alone the touchscreen interfaces making operating aircraft faster than any VR or mouse setup can possibly offer currently. This is the future for sure
As someone that doesn't have the hardware the headset is nice because I can pretend it's there. I already have too many expensive hobbies to justify building a fake airplane in my house lol.
Thanks Russ for bringing this to our attention. I've seen so many videos of the Varjo XR-3 MR and wondered when the technology would make its way down to the consumer level. I'm in the process of setting this up now to try it out. I have the Quest 3 and RealSimGear Cirrus SR22 cockpit. I'm so used to using muscle memory for all my flight planning it's going to be weird seeing my actual cockpit in MR. Cheers!
Amazing! It gave me the idea to use OpenKneeboard to create a solid color PDF that gives me a passthrough window to my physical kneeboard for taking notes. That works in openXr as opposed to reality mixer, which is is steamVr only.
Yes and if Laminar Research or Asobo would create a tool to make editable color boxes render inside the VR cockpit they could create passthrough areas in their sims eben in OpenXR. Nieither seem interested.
Trailblazers for next gen pilots!16 year old me would be extremely happy to see the progress. Now at the airlines. This really make me happy to see what available for the next generation of pilots.
That is pretty cool! This is getting really close to what I am hoping for! Really hope that external cameras will be supported soon and proper chroma keying for physical greenscreens. How did you find the resolution of the cameras hold up with actually being able to read the instruments, looking at physical checklists and charts, taking notes etc. ?
@@jango71 Yes I know. But there are some many use cases for using chroma keying on a physical greenscreen. Masking out your physical panel and peripherals. What is shown in this video is simply a workaround to enable passthrough from the Quest 2 cameras.
Love this. Can reality mixer let you draw a specific shape to match your cockpit? And can you have multiple boxes at the same time? My thought is to draw a non-box shaped box for the panel and the yoke, then another for the throttle, and another for the radios and gps. And letting the sim draw itself in the spaces between them.
That would work currently. I will do a follow up video when I have time. Using gaze activation you can have boxed activate when your headset points within a certain angle off the box. Stays open until you look away.
Thank you, Sir! For all your brilliant work of putting your own personal knowledge gathered the hard way into very straight forward and easy to follow informational videos, Thank You!
Certainly a good option and as you said, this will only get better. But, for me, the ideal setup would be for the system to track my hands and fingers so that I can interact with the virtual cockpit. And yes, I have a diy cockpit but I would gladly ditch the hardware if it meant that I could seamlessly interact with the virtual one.
You have to use the controllers but it does that. I don't have any physical controls so I just use my hands on the virtual knobs and switches and such.
There are a lot of systems that allow this, such as captoglove. The issue is that without fully haptic force feedback it's essentially impossible to naturally interact with a cockpit in this way as you aren't actually moving a switch you're just putting your finger in a rough area near the switch and hoping it fires off. Unfortunately no company trying to make full force feedback haptic gloves has A) brought any to market or B) made any that actually have the granular precision to simulate interacting with cockpit switches. As such the best option right now is this pass through and a sim-pit.
I guess Virtual Desktop has already been upgraded to work via OpenXR. Now it'll just require getting Reality Mixer to work with OpenXR. I won't take a stab at trying to set this MR up until that happens because OpenXR improves MFS performance greatly over that achieved with SteamVR. I just don't want to fool around with learning SteamVR while waiting on the upgrade of Reality Mixer.
Amazing vidéo ,I have a Pimax Crystal but the Best solution ,it’s not HandsTracking In DCS World /Mfs 2020/ or Xplane 12 ? Better caméra or HandsTracking ! I buy the HandsTracking module by Pimax this week and I going test this quickly 🇫🇷🇫🇷🇫🇷 Thank you so much for this excellent vidéo .👍🏻👍🏻 Me too ,my dream it’a a better work by all studio developper with News tool In Quest 3 or Pimax Crystal (HandsTracking + caméra ) A day perhaps ?? Aplushhss 😇👍🏻👍🏻
Hi Russ, thanks for all those videos! thats's great and amazing! I am using A320(FBW) with MSFS and have HW(Airbus Joystick and saitek panels + tablet connected to emulate the FMGS). As you refeering to Xplane, would the Quest 3 mixed reality works? thank you
Russ, I'm getting ready to buy a VR headset. I tore my old sim (HUGE THING) apart and I'm building the frame for my VR simulator tomorrow. 2-24" Touchscreens for Air Manager (love my knobster), Honey Comb yoke and throttle quadrant. I'm building this to use for instrument flying practice (Private pilot with instrument rating). You said the resolution could be better. Is it good enough to see what you need to see to practice instrument flight. I practice on steam gauges with a pair of G5s and the Garmin 540, mostly. You know if the Air Manager guys have any intention to model the Avidyne IFDs for Air Manager? That's my real world flying IFD.
@Russ Barlow. Hi Russ. I'm certain you may not remember, but we have had this debate before and I stand by my previous argument. It was some time ago, but we debated which "system" would be best for VR flight sim cockpit interactivity. I do not agree that mixed reality is the future of VR flight sim. There are several negatives which I will mention below. My belief is the use of VR hands, in combination with real world yoke, throttles, rudders, and whatever knobs, switches, flap levers, trim wheels, and equally important, KNOBS, where the real world peripherals are SYNCED with your VR cockpit will be the dominant means of interaction. There are several advantages to this type system over a mixed reality system. 1. The break of immersion with mixed reality is awful, and even though this is expected to improve, you will still be forced to use, often very expensive peripherals. 2. In mixed reality, the user will still need to purchase the real world screens, gauges, and displays, of all the various cockpit equipment and avionics. AND, you would be "locked in" to those devices. In a VR hands, used with synced real world peripherals, 100% of the tactile feel is achieved, WITHOUT the need for real world screens, gauges, or displays. 3. In mixed reality, your peripherals are, for the most part, fixed, and aren't conducive to use with a variety of aircraft. With the system I am referring to, while still not totally adjustable to every kind of cockpit, it is considerably more flexible and can be fairly easy to move around to accommodate various cockpits. This system IS currently being developed and has the potential to totally change how we interact with our Sims. Simple kits will be produced for various aircraft and many of those parts will be usable for other aircraft. For example: A consumer would purchase a General Aviation "panel". Then purchase a Piper Warrior package. This package would include (assuming they already had basic GA yoke, throttle, and rudder pedals) 6 single knobs for the 6-pack, a flaps handle, a tank selector unit, 4 dual rotary knobs, a trim wheel,..... you get the idea. A user could purchase as much, or as little, as they choose. Personally, I feel I would only "need" the rotary knobs, the trim wheel, and the flaps handle as the tactile input on those items is significantly more important than needing to "feel" the landing light switch. I would just "push" the virtual switch with my virtual hand. Just hearing the click it would make would be satisfying enough. Now exactly HOW does this system work??? The user sits in their VR cockpit. Through 3rd party software they import the individual 3d model of the real world knob. While holding the real world knob, they see their virtual hand holding the virtual knob. They then place the knob on their GA panel exactly where the VR panel knob is and "lock" it there. .... They then proceed to do this with all of the peripherals they purchased. And whallaa... When the user reaches out with their virtual hand to turn the knob to adjust their altimeter they are actually grabbing and turning a real world knob because their real world knob and virtual cockpit knob are in the exact same location. The system is still in its infancy, but as you stated, the advancements are coming very fast . There are a few UA-cam videos of the first of these systems being used and it will only continue to get better and more accurate. I'd love to hear your thoughts on this system after getting a good look at it. As always, I love your videos and keep up the excellent content! Thanks.
Do you think it could run on a laptop so I could use a very simple version on location? I’m thinking of only a yoke, throttle and rudders as real instruments and the rest VR - just for entertainment.
Russ please advise What system pc do i need to run MS2020 VR currently running amd ryzen 7 3700 8core cpu and amd 5700xt which is out dated updating to amd ryzen 9 5950xt stil 3 years old am I missing the boat as this is still outdated by 3years however 570MB and cannot get MS windows 11 install due a software glitch old system adding this new chip will start me in a newer direction. or with all the new chips coming out this week processing power is over the top. what software you using today to run VR3 on a budget head sets are expensive so 55inch monitor for now 2 side monitors 32 inch monitors for now just have joy stick fine with me..x-plane 11 at moment your advise greatly appreciated
If you are on a budget the 5800X3D is a better upgrade than the 5950X if gaming is your focus. I have both, and get 15-20% better performance on the 5800X3D.
Russ loved your mixed reality demo. I’ve spent about 20 hours trying to get it to work. I have nice pink box I can move it around and resize it but no video passthrough. I think it’s one small thing I’m missing the program isn’t very intuitive. Not giving up😊
@@Soap.h yes I’m 76 years old I’m trying to remember. If I remember I had to close the desktop program and restart it, I wasn’t able to change a setting until I restarted it. I’m in Florida so my setup is in Pittsburgh other wise I’d be able to start it up and give you a much better explanation
What setup do you have there ? Could you list your components you use in this video please ? I’m considering a quest3 and desperately need to update my old plastic pedals and yoke. I have MSFS so do you think the Mixed Reality pass ugh software would work the same (I assume so since it’s just a hole on the desktop ?). Would also like to know how immersive it is and how much it models reality. Thanks.
Can you use Steam Reality Mixer to overlay on non-Steam games? I have DCS standard install, so I need to be able to run the Steam Reality Mixer over the non-Steam DCS. It would be prohibitively expensive to buy all my DCS aircraft and assets over just to get them in Steam
That really looks promising. After 700+ hours between x-plane and MSFS. I am starting to build a better cockpit. Torn on how to do so. I believe the touch panels and 3 Tv's. But now with this Vr possibility...I might have to rethink it. ON a side note. Something I've notices in your videos. I cant help but laugh. When you take off, you tend to aim for the control tower right away. Each time it makes me wide eyed thinking. No you cant do that!
My ex wife was a tower controller….just kidding. Still married to my ex-wife. As an old Captain told me as a young First Officer…It’s cheaper to keep her.
This looks alright, but not great yet. Better would be if software do a z cutoff so only real world objects up to a certain distance will be shown and anything beyond it will come from the sim. It would be like seeing the physical cockpit and your hands etc overlaying the virtual world. Technically it should be possible to do this with the two cameras in the headset and photogrammetry. Hopefully we won't have to wait long before things like that become available!
This is the technology I have been waiting for, before taking up VR/MR. I want it for my space sim games, so that I can see my keyboard and controllers at all times. For me though, I think I'm gonna hold off for a little while, until the process is simpler. Currently, I'm using triple screens @ 5760x1080, and TrackIR 5, in a dark room, with a stack of power amps and a massive 7.1 Hifi audio system. In effect my gaming rig is a devastatingly powerful 7.1 Hifi setup with a computer attached to it. :P Please don't ever let anyone tell you headphones are the way to go: they are garbage compared to 20K worth of all-analog 7.1 system. :)
When I run reality mixer dcs starts getting super choppy and loses frames like crazy. Even if I have the passthrough window closed (I have it on a toggle). Are there any settings in steam that can help this?
The Quest 6, will have 8k passthrough with perfect object separation, and MSFS2030 will have photorealistic scenery that surpasses current graphic mods.
Just spent the last hour playing warthunder with my mosty DCS f16 styl sim and damnnn so cool! the immersion levels are high! I tried MSF2020 via VD but it was soo jittery, any tips?
Based on your videos, I bought the Quest 3 and everything needed to do this, and I'm disappointed with the results. The passthrough video quality is worse than it looks in your video. Hard to read what's on the monitor without getting very close to it. It's a hassle to have to keep managing the passthrough boxes. I've got some issue where MSFS gets jerky or twitch when Reality Mixer is being used (others are reporting the same issue). And wearing and using the headset is just an uncomfortable and inconvenient experience all around. I really wanted it to work, but I think I sending it back. The added immersion is real but hardly with it to me.
The passthrough video quality is a Meta issue. The passthrough quality should be an end user choice. The way you record video from the Quest 3 does not show the quality degradation (also proves that it is being degraded on purpose). The immersion for me is still worth it. I use my sim for instrument practice and it's 100% effective and transfers to a real plane! I hardly ever do VFR flying.
Russ, I applaud your efforts to make flight simulation more realistic. There has been a lot of discussion about how x-plane generates weather and how the aircraft responds to the weather. Much has been said about wind shear, microbursts etc, but I have not found anything about how the pilot's upper body responds within the aircraft relative to the instruments. It is this response that affects the pilot's ability to twist dials and read displays in turbulance. This is a very important aspect of flying in a real aircraft. From the seat up, a pilot's body is flexible and responds to external forces differently than the aircraft. Modeling this correctly would greatly improve realism. This is especially important in MR. Your thoughts?
Excellent explanation! Reality mixer has the option to "add or remove" games to a profile. Were you able to do it? If affirmative, how? Thanks big time!
Mixed or Augmented Reality is defiantly the future of flight simulation. I have always loved the idea of a simpit, a full 1:1 recreation of a real cockpit (or something comparable) that would feature all of the cool bells and whistles that would you see in the virtual cockpit. This naturally allows it to be interacted with without a mouse or pointer. However, this (used to) come with essentially one of two options. One, VR. This removes half the purpose of an actual simpit because you can't see your controls and makes it much more difficult to navigate the panels (it is possible, but takes a lot of practice.). Two, surrounding projector / monitor setup or even 2D head tracking (Track IR). This allows you to view and navigate the simpit while easily viewing the virtual world you are flying in. However, this results in losing the emersion that VR brings that myself and others have come to love, primarily the ability to use and experience Propper depth perception while flying. Mixed reality combines the best of both of these solutions. Once these consumer level mixed reality solutions become easily available to the general public, I know and hope that it will truly change the flight simulation world by allowing simpits and projects alike to become available to more people, increasing their immersion and experience that it provides.
That is so cool. Thx for demo. What is that flicker to what looks like a glass cockpit (20:39) in video that pops up once in awhile? Still trying to figure out what all that clutter is in background (middle right in screen) of your cockpit? Let us know about Microsoft Flight Simulator and if it works with that someday.
it is possible to toggle the passthrough with a joystick button. I justr turned off the passthrough showing the physical panel for a second or two and it showed the MSFS panel in the the sim. Did you see my follow on video ua-cam.com/video/7_X1wReZHgc/v-deo.htmlsi=2Wghmr15z_AUMt_Z
Great video as usual. Thanks Having to use Steam VR is a major problem based on my experience with Steam. Do you see a way to achieve acceptable MR without having to use Steam?
Thx for this video! I've been trying to figure out if quest 3 had passthrough or not, but didn't know how to phrase my question. Definitely buying one now to use with DCS and my Virpil controls.
How soon would you venture to guess will there be a hand glove/passthrough of hands so you can manipulate the different instructions/controls without headset grips directly in Sim? Or is there? First time viewer and enjoyed tutorial. Thank you
Does Reality Mixer work with a green screen? I have been thinking about hanging a green screen behind my HOTAS and around my cockpit so that I can do what you're doing without the window boundaries
I think that feature is under development in Reality Mixer. Actually Virtual Desktop is what does the chroma Key magic. It now replaces a chosen color( within a set allowable variance ) in the VR world with the pass through camera feed. There needs to be a toggle so that a chosen color in the pass through feed is replaced by the VR world. That mask area could be as physical green screen or one generated by Reality Mixer. Check my latest video on passthrough hand tracking and you will see the faint color boundary lint between passthrough and VR…. It may be an artifact of Virtual Desktop and still appear in your scheme too, if it becomes possible to reverse he setup and replace camera feed areas with the VR feed.
Hey, Russ. I like your approach to this technology. I have a Rift, but the Quest 3 seems more forward to what I'd like. Iwas informed that because of my meds I can no longer fly via Commercial nor Private certification. Is the Quest 3 a viable surrogate?
I’m curious if the occluded area decreases the load on the PC’s GPU thus giving a higher fps performance. If so, that’s a selling point. Turn up the settings !
Ross thank you for the video. I did quite not understand , looks like it does not work with msfs 2020 , even if you have bought it from steam ? Am I right ? what is the name of the program you mentioned ? Thanks
I was uncertain when I made that video several months ago, but it does work with MSFS 2020. Check out my more recent video on color panel, which is easier to use and accomplishes much of the same thing. It only requires virtual desktop and works with open XR, which gives better performance in VR. Easiest MSFS Mixed Reality: Color Panel for VR ua-cam.com/video/o2vHWNf7pW4/v-deo.html
When Reality Mixer is on, are those pixels no longer being rendered in MSFS? That would be awesome if having all IRL gauges would cut down on the rendering requirements of the sim and therefore result in not only a more interactive experience using XR, but also a higher framerate in the sim.
Question for Russ: I think that neither the Pico 4 nor the Quest 3 have eye tracking. Do you think that the large sweet spot afforded by the pancake lenses obviates the need for eye tracking in MFS?
Does the quest 3 use more gpu or cpu resources? Since it has its own computer on the headset I’m hoping it might be a good middle ground for computers with the 20xx series gpu
Unfortunately, the simulator is being run completely on the PC and the headset. It’s just displaying the output. The pass through video is being processed on the Headset but you still need a pretty beefy computer. I don’t think I’d be happy with much less than a 3080ti or 4070ti. If I have a chance I will try things with my 2080ti and see how it works. GPU prices are crazy now so I’d hate to be shopping now.
@@rbarlow I’ve got a 2060super with a Ryzen 3700x running msfs okay-ish. When it tried the reverb g2 a few years ago I just didn’t get the fidelity I wanted to justify the price. But if I can swap out for a 2080ti it’s how I might squeak out a few more years of system use.
I have a full a10 pit for DCS. I’m excited to get this going. Santa is bringing a quest 3 for Christmas and this is going to be one of the first things I do. I been waiting for a decent passthrough application before I got into vr.
Looks great, but a little out of my ability to totally understand what most of your video demonstrates. Many things you talk about are probably things most computer guys take for granted but I have to really dig to figure out what certain things are or how they work. I was very happy to figure out how to set up 4 monitors, air manager, and the knobster. You have gone to a higher level.
Good evening from the Netherlands, This video convinced me to finally order a new PC which is heavy enough to fly DCS and BMS in a Mixed reality Home made F16 cockpit. Thank you for helping me out with your cool progress. Regards Maarten
1:09 The default Air Manager panel has the vertical speed stacked above the altimeter. You can easily change it but it bugs me whenever I see ppl using it without fixing that
This is a step in the right direction. Flight sim with VR is amazing because of the 3D effect, specially when flying over mountains!. But with no visibility to the real hardware buttons is really the problem. Only the yoke and throttle are easy to control. I really think the future is with AR, where you could control those nice 3D cockpits renders that comes with the planes you use, with your hands. Good eye tracking within the headset combined with AR like the direction that is taking the Vision Pro headset is really what will change the game. Air Manager is great. But being able to interact with the game cockpit while still in VR, without having to use a mouse, would be even better!
This augmented reality is getting better indeed. Would be great to be able to create the vr part along the windows of my cockpit shell. So only the outside view is vr. Well maybe soon…
This could be a total game changer for DCS sim pilots. What you mention at the 7:30 mark about home built "simpits" and not wanting to change over to VR hits the nail right on the head. That's the exact boat that I'm in currently.
@@yokoh691 Are you using the Steam version of DCS, or the standard install? I have the standard install, but reality mixer runs through steam... can it be run over the standard DCS install running VR?
this is pretty unreal. Extremely excited for the forthcoming chroma keying functionality in Reality Mixer, that may very well convince me to switch from my Reverb G2 to Quest 3. I don't fly but i do have a VR-only sim racing rig and being able to key in just my steering wheel, shifter/handbrake, and/or button box without the other surroundings is super enticing
It would be nice is to be able to select a knob on the XP12 aircraft panel and then use Knobster to manipulate the knob. I've attempted this using KnobXP but with no success. Selecting is easy but setting frequencies, altitudes, courses etc. using rotating actions is difficult with vr manipulators. KnobXP with its vr window is not realistic. Any thoughts on this, Russ?
Totally agree. I've spoken with Austin Meyer about this and his answer was that I should create a plug-in to do it. Yes, KnobXP was an idea that came along much later that Knobster and wasn't intended to be a final solution. The VR development in XP is not well documented so even if it were possible to build a plugin it would take someone with inside knowledge of XP. I hate using a mouse in the VR cockpit but have found a kneeboard mounted wirelessTrackball with a scroll ring is the easiest solution. You know where it is, no desk required, and the ring moves like a dial. Stacked knobs are still difficult.
I've been using a trackball for a few months. As you say, it is probably the best solution for now. However, my thumb is not as agile as my fingers, so the positioning is difficult in rough air. And, it is hard to keep the curly arrows in place while using the scroll wheel. I appreciate your leading efforts to bring about the changes we are looking for.
Your "quest" is the same as mine,😁 so I've been following the VR pass-thru development and waiting for this moment.👀 I just checked the Meta shop page for the Meta Quest 3 and see they offer two storage capacities 126 & 512 GB. I guess bigger is better, 💪but 128 GB is AU$799.99 and 512 GB is AU$1,049.99 so a AU$250 difference... just might not get past the "finance manager"! 💰👰♀🚫 What do recommend for the storage?
This type of innovation is what makes me excited for the future of VR/MR, thanks for your contribution to the space!!
This topic interest me as someone that has a lot of money in peripherals and needs to be able to see them. It's hard to correlate their relationship and what's happening in VR in a smooth manner, rather than having to constantly rely on muscle memory.
This is a way forward. Optimal hand tracking and virtual cockpit interaction, with haptic feedback, would be another piece of the puzzle.
They actually already have this and it is being further developed. No "mixed reality" needed. Real world knobs, etc., that have virtual 3d models of its real world counterpart, that you can then place in your virtual cockpit and sync them together. Reach out to grab that virtual flaps lever, and actually grab a real world flaps lever whose location is perfectly synced with your virtual flaps lever! It is VERY cool and I believe this type system will dominate over a mixed reality system.
Another great video Russ. You are a great innovator with regard to Flight Simming. This looks like the start of something great. It will surely be developed further.
Thanks. I think it looks exciting for the future.
A glimpse in to the future of VR. Thanks Russ!
Super interesting video here Russ, thank you for sharing. I had a feeling it wouldn't be long before someone developed a solution given the pass through on the Quest 3 is as you say, getting there. I may give this a go once I get the Somnium VR1 and XR-4 in my hands. Exciting stuff. Best wishes.
Thanks for your comments . Yes it’s not a great solution yet but Varjo has a rather elegant implementation of MR. A home cockpit will never compete with the beauty of a VR cockpit so I’d love to see an effective hand tracking solution but for hands on training MR seems to be the best current option. Keep up your great work for the community!
@@rbarlowCheers Russ 😊
Great POC Russ. I've been trying to set it up with my Quest 3 and when I add the boxes all I see is white noise graininess. I go to camera configs and the cameras won't initialize and the option that you have that said "Quest, Pico, of Vive XR Use Solid Color..." just doesn't exist on my camera config screen. Any tips? I'm super interested to try this out.
Figured it out...I was on the latest full release and needed to be on previous Beta of the Reality Mixer.
@@garinhess9069 Thanks for this but I see you need a code to access this beta. Can you perhaps advise?
Same here. I can't get the Quest3 Cameras to be available. Looks like I need the Beta version you mentioned. Is there an access code for the beta as Jasper mentioned?
Is it possible to run it via link cable without having to deal with virtual desktop?
Inspiring video and ideas, I really think that mixed reality will be the future of flightsimming and increased immersion, if we can use and see our own hands within the simulation that will be a huge change.
Good afternoon Please tell me what could be the problem, when I launch Reality mixer on my Meta Quest 3 glasses, it’s like my cameras don’t work. The area in which the room should be visible is simply gray. What could be the problem?
Been a vr user since the original oculus rift. I just purchased the quest 3 from a quest 2. Night and day diffrence adding color pass through. Mixed reality is where it’s at.
Interesting, but clearly lacking a lot! If you are into "immersion" of the flight simulator, I believe this Mixed Reality destroys that reality. Maybe in a year or two Mixed reality will get better. Are you in the PDX area?
Thank you for this video. I was not even aware of this possibility, but that is because I've switched to MSFS2020 from Xplane11. This is great and exactly what I was wishing for. Even just the possibility of taking hand notes in RL or looking at the charts and maps, rather than having a separate window in the VR cockpit I think is a lot more user friendly. I've been struggling with that a lot. Shame that this is not available in MSFS but this alone may persuade me to switch back to Xplane.
Great work! This is where VR needs to go! I don't enjoy flying with my headset often simply because if I'm trying to be a "serious simmer" (for lack of better word) I have so much hardware that I can't use in VR, which makes me less efficient flying. Let alone the touchscreen interfaces making operating aircraft faster than any VR or mouse setup can possibly offer currently.
This is the future for sure
As someone that doesn't have the hardware the headset is nice because I can pretend it's there. I already have too many expensive hobbies to justify building a fake airplane in my house lol.
Thanks Russ for bringing this to our attention. I've seen so many videos of the Varjo XR-3 MR and wondered when the technology would make its way down to the consumer level. I'm in the process of setting this up now to try it out. I have the Quest 3 and RealSimGear Cirrus SR22 cockpit. I'm so used to using muscle memory for all my flight planning it's going to be weird seeing my actual cockpit in MR. Cheers!
Just a matter if time....but I'm impatient😀
Amazing! It gave me the idea to use OpenKneeboard to create a solid color PDF that gives me a passthrough window to my physical kneeboard for taking notes. That works in openXr as opposed to reality mixer, which is is steamVr only.
Yes and if Laminar Research or Asobo would create a tool to make editable color boxes render inside the VR cockpit they could create passthrough areas in their sims eben in OpenXR. Nieither seem interested.
Trailblazers for next gen pilots!16 year old me would be extremely happy to see the progress.
Now at the airlines. This really make me happy to see what available for the next generation of pilots.
That is pretty cool! This is getting really close to what I am hoping for! Really hope that external cameras will be supported soon and proper chroma keying for physical greenscreens. How did you find the resolution of the cameras hold up with actually being able to read the instruments, looking at physical checklists and charts, taking notes etc. ?
You do not need chroma backgrounds for this to work. It may help but it is not the same technology.
@@jango71 Yes I know. But there are some many use cases for using chroma keying on a physical greenscreen. Masking out your physical panel and peripherals. What is shown in this video is simply a workaround to enable passthrough from the Quest 2 cameras.
Love this. Can reality mixer let you draw a specific shape to match your cockpit? And can you have multiple boxes at the same time? My thought is to draw a non-box shaped box for the panel and the yoke, then another for the throttle, and another for the radios and gps. And letting the sim draw itself in the spaces between them.
That would work currently. I will do a follow up video when I have time. Using gaze activation you can have boxed activate when your headset points within a certain angle off the box. Stays open until you look away.
A song can make or ruin a person’s day if they let it get to them.
Thank you, Sir!
For all your brilliant work of putting your own personal knowledge gathered the hard way into very straight forward and easy to follow informational videos, Thank You!
Certainly a good option and as you said, this will only get better. But, for me, the ideal setup would be for the system to track my hands and fingers so that I can interact with the virtual cockpit.
And yes, I have a diy cockpit but I would gladly ditch the hardware if it meant that I could seamlessly interact with the virtual one.
You have to use the controllers but it does that. I don't have any physical controls so I just use my hands on the virtual knobs and switches and such.
There are a lot of systems that allow this, such as captoglove. The issue is that without fully haptic force feedback it's essentially impossible to naturally interact with a cockpit in this way as you aren't actually moving a switch you're just putting your finger in a rough area near the switch and hoping it fires off.
Unfortunately no company trying to make full force feedback haptic gloves has A) brought any to market or B) made any that actually have the granular precision to simulate interacting with cockpit switches.
As such the best option right now is this pass through and a sim-pit.
I guess Virtual Desktop has already been upgraded to work via OpenXR. Now it'll just require getting Reality Mixer to work with OpenXR. I won't take a stab at trying to set this MR up until that happens because OpenXR improves MFS performance greatly over that achieved with SteamVR. I just don't want to fool around with learning SteamVR while waiting on the upgrade of Reality Mixer.
Your approach makes sense but I just couldn’t help myself. It really is a cool sensation just being able to see your hands and controls in VR
Amazing vidéo ,I have a Pimax Crystal but the Best solution ,it’s not HandsTracking In DCS World /Mfs 2020/ or Xplane 12 ?
Better caméra or HandsTracking !
I buy the HandsTracking module by Pimax this week and I going test this quickly 🇫🇷🇫🇷🇫🇷
Thank you so much for this excellent vidéo .👍🏻👍🏻
Me too ,my dream it’a a better work by all studio developper with News tool In Quest 3 or Pimax Crystal (HandsTracking + caméra )
A day perhaps ??
Aplushhss 😇👍🏻👍🏻
Hi Russ, thanks for all those videos! thats's great and amazing! I am using A320(FBW) with MSFS and have HW(Airbus Joystick and saitek panels + tablet connected to emulate the FMGS). As you refeering to Xplane, would the Quest 3 mixed reality works? thank you
Guess what I'm trying this week! Definitely a step in the right direction!
LMAO Oculus graphics look like an Atari 2600.... very fuzzy and color off
Russ, I'm getting ready to buy a VR headset. I tore my old sim (HUGE THING) apart and I'm building the frame for my VR simulator tomorrow. 2-24" Touchscreens for Air Manager (love my knobster), Honey Comb yoke and throttle quadrant. I'm building this to use for instrument flying practice (Private pilot with instrument rating). You said the resolution could be better. Is it good enough to see what you need to see to practice instrument flight. I practice on steam gauges with a pair of G5s and the Garmin 540, mostly. You know if the Air Manager guys have any intention to model the Avidyne IFDs for Air Manager? That's my real world flying IFD.
@Russ Barlow.
Hi Russ. I'm certain you may not remember, but we have had this debate before and I stand by my previous argument.
It was some time ago, but we debated which "system" would be best for VR flight sim cockpit interactivity. I do not agree that mixed reality is the future of VR flight sim. There are several negatives which I will mention below.
My belief is the use of VR hands, in combination with real world yoke, throttles, rudders, and whatever knobs, switches, flap levers, trim wheels, and equally important, KNOBS, where the real world peripherals are SYNCED with your VR cockpit will be the dominant means of interaction. There are several advantages to this type system over a mixed reality system.
1. The break of immersion with mixed reality is awful, and even though this is expected to improve, you will still be forced to use, often very expensive peripherals.
2. In mixed reality, the user will still need to purchase the real world screens, gauges, and displays, of all the various cockpit equipment and avionics. AND, you would be "locked in" to those devices. In a VR hands, used with synced real world peripherals, 100% of the tactile feel is achieved, WITHOUT the need for real world screens, gauges, or displays.
3. In mixed reality, your peripherals are, for the most part, fixed, and aren't conducive to use with a variety of aircraft. With the system I am referring to, while still not totally adjustable to every kind of cockpit, it is considerably more flexible and can be fairly easy to move around to accommodate various cockpits.
This system IS currently being developed and has the potential to totally change how we interact with our Sims. Simple kits will be produced for various aircraft and many of those parts will be usable for other aircraft.
For example: A consumer would purchase a General Aviation "panel". Then purchase a Piper Warrior package. This package would include (assuming they already had basic GA yoke, throttle, and rudder pedals) 6 single knobs for the 6-pack, a flaps handle, a tank selector unit, 4 dual rotary knobs, a trim wheel,..... you get the idea. A user could purchase as much, or as little, as they choose. Personally, I feel I would only "need" the rotary knobs, the trim wheel, and the flaps handle as the tactile input on those items is significantly more important than needing to "feel" the landing light switch. I would just "push" the virtual switch with my virtual hand. Just hearing the click it would make would be satisfying enough.
Now exactly HOW does this system work??? The user sits in their VR cockpit. Through 3rd party software they import the individual 3d model of the real world knob. While holding the real world knob, they see their virtual hand holding the virtual knob. They then place the knob on their GA panel exactly where the VR panel knob is and "lock" it there. .... They then proceed to do this with all of the peripherals they purchased.
And whallaa... When the user reaches out with their virtual hand to turn the knob to adjust their altimeter they are actually grabbing and turning a real world knob because their real world knob and virtual cockpit knob are in the exact same location.
The system is still in its infancy, but as you stated, the advancements are coming very fast . There are a few UA-cam videos of the first of these systems being used and it will only continue to get better and more accurate.
I'd love to hear your thoughts on this system after getting a good look at it.
As always, I love your videos and keep up the excellent content!
Thanks.
Do you think it could run on a laptop so I could use a very simple version on location? I’m thinking of only a yoke, throttle and rudders as real instruments and the rest VR - just for entertainment.
Russ please advise What system pc do i need to run MS2020 VR currently running amd ryzen 7 3700 8core cpu and amd 5700xt which is out dated updating to amd ryzen 9 5950xt stil 3 years old am I missing the boat as this is still outdated by 3years however 570MB and cannot get MS windows 11 install due a software glitch old system adding this new chip will start me in a newer direction. or with all the new chips coming out this week processing power is over the top. what software you using today to run VR3 on a budget head sets are
expensive so 55inch monitor for now 2 side monitors 32 inch monitors for now just have joy stick fine with me..x-plane 11 at moment your advise greatly appreciated
If you are on a budget the 5800X3D is a better upgrade than the 5950X if gaming is your focus. I have both, and get 15-20% better performance on the 5800X3D.
I wouldn't shit on the best part of Oculus... THEY SUCK!!!
wow esta genial eso!
como se mezclan los mandos y controles reales dentro de la realidad virtual !
Would the Quest 2 be able to do this? I know it's passthrough is Black and white. But I wouldn't mind if this would work
I use "Spitice Color Panel"... I find it much easier and convenient... I just need a window to read my kneeboard...
Russ loved your mixed reality demo. I’ve spent about 20 hours trying to get it to work. I have nice pink box I can move it around and resize it
but no video passthrough. I think it’s one small thing I’m missing the program isn’t very intuitive. Not giving up😊
Im having the same issue… did you figure it out?
@@Soap.h yes I’m 76 years old I’m trying to remember. If I remember I had to close the desktop program and restart it, I wasn’t able to change a setting until I restarted it. I’m in Florida so my setup is in Pittsburgh other wise I’d be able to start it up and give you a much better explanation
What setup do you have there ? Could you list your components you use in this video please ? I’m considering a quest3 and desperately need to update my old plastic pedals and yoke. I have MSFS so do you think the Mixed Reality pass ugh software would work the same (I assume so since it’s just a hole on the desktop ?). Would also like to know how immersive it is and how much it models reality. Thanks.
Thanks Russ, decided the quest 3 aint up to it for my use,
Can you use Steam Reality Mixer to overlay on non-Steam games? I have DCS standard install, so I need to be able to run the Steam Reality Mixer over the non-Steam DCS. It would be prohibitively expensive to buy all my DCS aircraft and assets over just to get them in Steam
That really looks promising. After 700+ hours between x-plane and MSFS. I am starting to build a better cockpit. Torn on how to do so. I believe the touch panels and 3 Tv's. But now with this Vr possibility...I might have to rethink it. ON a side note. Something I've notices in your videos. I cant help but laugh. When you take off, you tend to aim for the control tower right away. Each time it makes me wide eyed thinking. No you cant do that!
My ex wife was a tower controller….just kidding. Still married to my ex-wife. As an old Captain told me as a young First Officer…It’s cheaper to keep her.
This looks alright, but not great yet.
Better would be if software do a z cutoff so only real world objects up to a certain distance will be shown and anything beyond it will come from the sim. It would be like seeing the physical cockpit and your hands etc overlaying the virtual world.
Technically it should be possible to do this with the two cameras in the headset and photogrammetry.
Hopefully we won't have to wait long before things like that become available!
This is the technology I have been waiting for, before taking up VR/MR.
I want it for my space sim games, so that I can see my keyboard and controllers at all times.
For me though, I think I'm gonna hold off for a little while, until the process is simpler.
Currently, I'm using triple screens @ 5760x1080, and TrackIR 5, in a dark room, with a stack of power amps and a massive 7.1 Hifi audio system.
In effect my gaming rig is a devastatingly powerful 7.1 Hifi setup with a computer attached to it. :P
Please don't ever let anyone tell you headphones are the way to go: they are garbage compared to 20K worth of all-analog 7.1 system. :)
When I run reality mixer dcs starts getting super choppy and loses frames like crazy. Even if I have the passthrough window closed (I have it on a toggle). Are there any settings in steam that can help this?
Excellent! Thanks for sharing.
Steam has a streaming app in quest store now as of posting this video. Can bypass virtual desktop.
Encouraging! My next step is VR!
The Quest 6, will have 8k passthrough with perfect object separation, and MSFS2030 will have photorealistic scenery that surpasses current graphic mods.
Just spent the last hour playing warthunder with my mosty DCS f16 styl sim and damnnn so cool! the immersion levels are high!
I tried MSF2020 via VD but it was soo jittery, any tips?
Based on your videos, I bought the Quest 3 and everything needed to do this, and I'm disappointed with the results. The passthrough video quality is worse than it looks in your video. Hard to read what's on the monitor without getting very close to it. It's a hassle to have to keep managing the passthrough boxes. I've got some issue where MSFS gets jerky or twitch when Reality Mixer is being used (others are reporting the same issue). And wearing and using the headset is just an uncomfortable and inconvenient experience all around. I really wanted it to work, but I think I sending it back. The added immersion is real but hardly with it to me.
The passthrough video quality is a Meta issue. The passthrough quality should be an end user choice. The way you record video from the Quest 3 does not show the quality degradation (also proves that it is being degraded on purpose). The immersion for me is still worth it. I use my sim for instrument practice and it's 100% effective and transfers to a real plane! I hardly ever do VFR flying.
Russ, I applaud your efforts to make flight simulation more realistic. There has been a lot of discussion about how x-plane generates weather and how the aircraft responds to the weather. Much has been said about wind shear, microbursts etc, but I have not found anything about how the pilot's upper body responds within the aircraft relative to the instruments. It is this response that affects the pilot's ability to twist dials and read displays in turbulance. This is a very important aspect of flying in a real aircraft.
From the seat up, a pilot's body is flexible and responds to external forces differently than the aircraft. Modeling this correctly would greatly improve realism. This is especially important in MR.
Your thoughts?
This is the only reason I haven't used VR with my flight sim! But... Does it only work with steam apps? I bought MSFS through microsoft.
Yes SteamVR for now but hopefully some smart guy will see my video and make the software we need to use OpenXR.
Excellent explanation!
Reality mixer has the option to "add or remove" games to a profile. Were you able to do it? If affirmative, how?
Thanks big time!
Mixed or Augmented Reality is defiantly the future of flight simulation. I have always loved the idea of a simpit, a full 1:1 recreation of a real cockpit (or something comparable) that would feature all of the cool bells and whistles that would you see in the virtual cockpit. This naturally allows it to be interacted with without a mouse or pointer. However, this (used to) come with essentially one of two options. One, VR. This removes half the purpose of an actual simpit because you can't see your controls and makes it much more difficult to navigate the panels (it is possible, but takes a lot of practice.). Two, surrounding projector / monitor setup or even 2D head tracking (Track IR). This allows you to view and navigate the simpit while easily viewing the virtual world you are flying in. However, this results in losing the emersion that VR brings that myself and others have come to love, primarily the ability to use and experience Propper depth perception while flying.
Mixed reality combines the best of both of these solutions.
Once these consumer level mixed reality solutions become easily available to the general public, I know and hope that it will truly change the flight simulation world by allowing simpits and projects alike to become available to more people, increasing their immersion and experience that it provides.
That is so cool. Thx for demo. What is that flicker to what looks like a glass cockpit (20:39) in video that pops up once in awhile?
Still trying to figure out what all that clutter is in background (middle right in screen) of your cockpit?
Let us know about Microsoft Flight Simulator and if it works with that someday.
it is possible to toggle the passthrough with a joystick button. I justr turned off the passthrough showing the physical panel for a second or two and it showed the MSFS panel in the the sim. Did you see my follow on video ua-cam.com/video/7_X1wReZHgc/v-deo.htmlsi=2Wghmr15z_AUMt_Z
Great video as usual. Thanks
Having to use Steam VR is a major problem based on my experience with Steam. Do you see a way to achieve acceptable MR without having to use Steam?
Thx for this video! I've been trying to figure out if quest 3 had passthrough or not, but didn't know how to phrase my question. Definitely buying one now to use with DCS and my Virpil controls.
How soon would you venture to guess will there be a hand glove/passthrough of hands so you can manipulate the different instructions/controls without headset grips directly in Sim? Or is there?
First time viewer and enjoyed tutorial. Thank you
Does this work with the gamepass version of msfs?
Does Reality Mixer work with a green screen? I have been thinking about hanging a green screen behind my HOTAS and around my cockpit so that I can do what you're doing without the window boundaries
I think that feature is under development in Reality Mixer. Actually Virtual Desktop is what does the chroma Key magic. It now replaces a chosen color( within a set allowable variance ) in the VR world with the pass through camera feed. There needs to be a toggle so that a chosen color in the pass through feed is replaced by the VR world. That mask area could be as physical green screen or one generated by Reality Mixer. Check my latest video on passthrough hand tracking and you will see the faint color boundary lint between passthrough and VR…. It may be an artifact of Virtual Desktop and still appear in your scheme too, if it becomes possible to reverse he setup and replace camera feed areas with the VR feed.
Hey, Russ. I like your approach to this technology. I have a Rift, but the Quest 3 seems more forward to what I'd like. Iwas informed that because of my meds I can no longer fly via Commercial nor Private certification. Is the Quest 3 a viable surrogate?
I’m curious if the occluded area decreases the load on the PC’s GPU thus giving a higher fps performance. If so, that’s a selling point. Turn up the settings !
Good info, just bought the quest 3 a week ago and hope it gets support with mix reality for MSFS2020 and DCS soon.
Ross thank you for the video. I did quite not understand , looks like it does not work with msfs 2020 , even if you have bought it from steam ? Am I right ? what is the name of the program you mentioned ? Thanks
I was uncertain when I made that video several months ago, but it does work with MSFS 2020. Check out my more recent video on color panel, which is easier to use and accomplishes much of the same thing. It only requires virtual desktop and works with open XR, which gives better performance in VR. Easiest MSFS Mixed Reality: Color Panel for VR
ua-cam.com/video/o2vHWNf7pW4/v-deo.html
Thank you Russ, Great video. Can you tell me what you use for a touch screen monitor. I have been looking for a 14 - 15.6" and just not sure yet.
It isn't clear to me what you mean by "left menu button" at 11:31. Could you please clarify?
Menu button on the left controller( flush with 3 horizontal lines)
Can mixed reality b done without Virtual Desktop? I use my Quest 3 using the link cable directly ...
VD is required but it works with the cable now
When Reality Mixer is on, are those pixels no longer being rendered in MSFS? That would be awesome if having all IRL gauges would cut down on the rendering requirements of the sim and therefore result in not only a more interactive experience using XR, but also a higher framerate in the sim.
Excellent Guide Russ. Thanks a lot. Really looking forward to FalconBMS getting support for OpenXR in Q12024. Finally I can find my buttons properly.
Question for Russ: I think that neither the Pico 4 nor the Quest 3 have eye tracking. Do you think that the large sweet spot afforded by the pancake lenses obviates the need for eye tracking in MFS?
Given this uses SteamVR, it would probably work with DCS World as well?
VR just looks horrible man sorry
Does the quest 3 use more gpu or cpu resources? Since it has its own computer on the headset I’m hoping it might be a good middle ground for computers with the 20xx series gpu
Unfortunately, the simulator is being run completely on the PC and the headset. It’s just displaying the output. The pass through video is being processed on the Headset but you still need a pretty beefy computer. I don’t think I’d be happy with much less than a 3080ti or 4070ti. If I have a chance I will try things with my 2080ti and see how it works. GPU prices are crazy now so I’d hate to be shopping now.
@@rbarlow I’ve got a 2060super with a Ryzen 3700x running msfs okay-ish. When it tried the reverb g2 a few years ago I just didn’t get the fidelity I wanted to justify the price. But if I can swap out for a 2080ti it’s how I might squeak out a few more years of system use.
I have a full a10 pit for DCS. I’m excited to get this going. Santa is bringing a quest 3 for Christmas and this is going to be one of the first things I do. I been waiting for a decent passthrough application before I got into vr.
Looks great, but a little out of my ability to totally understand what most of your video demonstrates. Many things you talk about are probably things most computer guys take for granted but I have to really dig to figure out what certain things are or how they work. I was very happy to figure out how to set up 4 monitors, air manager, and the knobster. You have gone to a higher level.
Good evening from the Netherlands,
This video convinced me to finally order a new PC which is heavy enough to fly DCS and BMS in a Mixed reality Home made F16 cockpit.
Thank you for helping me out with your cool progress.
Regards Maarten
Qest 3 sucks worst headset l own 😮😮😮😮
1:09 The default Air Manager panel has the vertical speed stacked above the altimeter. You can easily change it but it bugs me whenever I see ppl using it without fixing that
This is a step in the right direction. Flight sim with VR is amazing because of the 3D effect, specially when flying over mountains!. But with no visibility to the real hardware buttons is really the problem. Only the yoke and throttle are easy to control. I really think the future is with AR, where you could control those nice 3D cockpits renders that comes with the planes you use, with your hands. Good eye tracking within the headset combined with AR like the direction that is taking the Vision Pro headset is really what will change the game. Air Manager is great. But being able to interact with the game cockpit while still in VR, without having to use a mouse, would be even better!
Fantastic Video! I know what I'm getting (myself) for Christmas this year.
This augmented reality is getting better indeed.
Would be great to be able to create the vr part along the windows of my cockpit shell.
So only the outside view is vr.
Well maybe soon…
HP Reverb G2 for the win....
Works in MSFS 2020. Might want to use the Steam VR beta.
This is IT!!!!! I hate the mouse! Hardware peripherals mixed is indeed the way to go!!! Thanks!!!
Russ, how does the mic and audio work for thinks like PilotEdge? Does the headset have a mic?
Is this possible with Htc vive pro 2?
Great video, Russ, very interesting. Will the recently released “Steam Link” Quest app improve or streamline the set up/use of this kind of setup?
Interesting stuff ...amazing technology 😮
Thanks for the video Russ 😀👍
205 bridge looks nicer than MSFS bridge! Was like PDX soon I see you fly lol.
This could be a total game changer for DCS sim pilots. What you mention at the 7:30 mark about home built "simpits" and not wanting to change over to VR hits the nail right on the head. That's the exact boat that I'm in currently.
Been using this mixed reality with warthunder and DCS, it’s so good to see your instruments aha
Did a test short on my page aha
@@yokoh691 Are you using the Steam version of DCS, or the standard install? I have the standard install, but reality mixer runs through steam... can it be run over the standard DCS install running VR?
@@AdamM-fd7hs Dcs standalone uses steam vr, so it works.
@@liamnolan1663No it doesn't. It uses OpenXR. Only the steam edition forces Steam VR.
Great ... never seen something like this ... very impressive !!! Ciao from Italy ...
Was the footage from the first 20 seconds of this video from the Quest3 or another professional solution?
this is pretty unreal. Extremely excited for the forthcoming chroma keying functionality in Reality Mixer, that may very well convince me to switch from my Reverb G2 to Quest 3. I don't fly but i do have a VR-only sim racing rig and being able to key in just my steering wheel, shifter/handbrake, and/or button box without the other surroundings is super enticing
Is this possible with Quest 2?
Another viable option is to use InfuseVR where you can see 3d representations of your hardware in VR
What’s it called
What is your view of the Pimax Crystal with passthrough
It would be nice is to be able to select a knob on the XP12 aircraft panel and then use Knobster to manipulate the knob. I've attempted this using KnobXP but with no success. Selecting is easy but setting frequencies, altitudes, courses etc. using rotating actions is difficult with vr manipulators. KnobXP with its vr window is not realistic. Any thoughts on this, Russ?
Totally agree. I've spoken with Austin Meyer about this and his answer was that I should create a plug-in to do it. Yes, KnobXP was an idea that came along much later that Knobster and wasn't intended to be a final solution. The VR development in XP is not well documented so even if it were possible to build a plugin it would take someone with inside knowledge of XP. I hate using a mouse in the VR cockpit but have found a kneeboard mounted wirelessTrackball with a scroll ring is the easiest solution. You know where it is, no desk required, and the ring moves like a dial. Stacked knobs are still difficult.
I've been using a trackball for a few months. As you say, it is probably the best solution for now. However, my thumb is not as agile as my fingers, so the positioning is difficult in rough air. And, it is hard to keep the curly arrows in place while using the scroll wheel. I appreciate your leading efforts to bring about the changes we are looking for.
this is what I looked for immediately after trying vr flight sim a single time, obviously needs to happen for all the nice gear to be visible and work
Russ, great news.. Encouraging.. Thank you.
Your "quest" is the same as mine,😁 so I've been following the VR pass-thru development and waiting for this moment.👀
I just checked the Meta shop page for the Meta Quest 3 and see they offer two storage capacities 126 & 512 GB.
I guess bigger is better, 💪but 128 GB is AU$799.99 and 512 GB is AU$1,049.99 so a AU$250 difference... just might not get past the "finance manager"! 💰👰♀🚫
What do recommend for the storage?
It's weird, they don't have a 256GB that probably everyone would opt for.. The Quest 2 has a 256GB version oddly.