VR Pilots Mixed Reality Window for MSFS | Easy Set Up | See the World around You!

[@SimHangerFS]

Mixed Reality is the future of VR and this small step is a taster of things to come. To use Color Panel your headset must be capable of using Virtual Desktop and operating wireless. Currently I think this will be limited to Q2, Q3 and Pico4. Check out my follow up video here kzbin.info/www/bejne/imeXqGWtibtnjtksi=opGl3V7dh3Jj8aBV

[@lesneilson67]

Is the passthrough image on the quest 3 stereoscopic?

[@VRFlightSimGuy]

This has great potential, especially with the latest pass through update. Cheers Mark.

[@HomesickforAlaska]

This looks really promising. I have been holding off switching to VR specifically because of the passthrough issue and using all of my cockpit peripherals. The other one that I am watching closely is the Yaw VR version that seems much closer to a true mixed reality but is currently only in Limited Beta on Steam. Now if the Crystal Super has Color MR passthrough I will be set to make the move. 😊

[@dasbootuk]

Saw this on Russ Barlow channel earlier, thanks for the detail, will give it a this a go, looks like with some more development it could be a game changer

[@seattime4075]

I would happily pay money for a application like this were you can import a self made shape to better cover any instrument panels..

[@AeroCherokee]

Exactly the feature that makes the flight sim useful for pilots!

[@themorethemerrier281]

This seems to be a wonderful tool! I hope I can try it tonight. An alternative modus could be a window that is fixed in your fov that you could toggle with a button on your stick or yoke. And with that window you could just peek around and turn it off when done.

[@emarcel-l4i]

How about making it respond to your head movements? It could pop up when you glance at it, just like the UI Panels in Elite:Dangerous! 😄

[@AuthentiKit]

The pieces for a truly immersive vr experience are slowly coming together. I’m glad it supports openxr. I’m very curious how close an alignment you can achieve with your yoke and our TPM in the Comanche. This would be the true test. Probably closer than our Spitfire controls can manage.

[@Huddison]

Very clever stuff 👍

[@CyclingIngenieur]

I have a Pico 4 which i think is great, it's my first VR set. What I'd love to be able to do is to use my hands/fingers to press buttons etc in the VR cockpit. The Pico recognises hands in the home area, so I feel it's tantalisingly close but I'm still waiting! I salute the creators of these add ons, i think they're really clever but I agree with others that it's a bit too 'immersion-breaky'.

[@CyclingIngenieur]

I would pay (quite a bit) for this!

[@joelmulder]

This might finally allow me to fly on VATSIM or BATC in VR, because I might be able to take and see my notes.

[@pmadsea077]

I've been flying on the Vatsim network in VR for about a year now. I'm not sure if you find this helpful but I get my IFR clearance before putting my headset on. I use a kneeboard with my note pad and if I need to make any notes in flight, I loosen my headset strap just enough so I can peak out enough to see my note pad.

[@marcusdamberger]

I got a Quest 3 mostly because I was interested in checking out it's stand alone features and wanted to see how the passthrough worked. I'm considering selling it as I haven't had a ton of time to use it, but maybe this version of mixed reality might be really fun to play with in MSFS. My main headset is the Pimax Crystal for MSFS to have the most clarity. But I was impressed with what the Quest 3 has for resolution and how good the pancake lenses are. I noticed how wide the sweet spot was, and how comfortable it is to settle into. I feel on the Crystal I have to make sure it doesn't move too far out of position otherwise I lose the sweet spot.

[@simple-controls5507]

Been using another program named Reality Mixer for about a year. Less setup hassle than this one. Just draw as many windows as you need/want for all your controls. Works with you headset or a camera.

[@doubleu2]

perfect timing with this! looking forward to using this to see the BeyondATC window until VR support is added! (if i understand things correctly)

[@SimHangerFS]

Snap!

[@michaelhoffmann2891]

Looks interesting, but having to fiddle with that square across my panel leads to a new aviation paradigm: aviate, navigate, communicate, VR-fiddligate! 😆

[@SimHangerFS]

🤣

[@mikecoffee100]

this a very Useful video even though I don't use VR more like I can't use VR with my current video card which serves me quite well thank You

[@Redridge07]

next upgrade should include two windows

[@matp8493]

This is great isn't it, it's a few updates away from being something really excellent

[@_flyby]

Thank you! Do you like more the Quest3 over the Pimax? I am in the reflection process to buy a headset but do not know which one to go for...

[@tomc1380]

Like you say, this is a pretty small step, lol! Not something I can see myself using right now. Personally I'd rather see development and implementation of proper hand tracking within all sims. Anyway, thanks for your informative and interesting vids mate and best cheers.

[@jarekpiwar3688]

In the past, when I flew with gliders, I was always towed by Wilga.

[@ChristopherForand]

THANK YOU. I cannot wait to see if this works in Virtual Desktop using VDXR instead of StreamVR. I have been trying to like RealityMixer ... actually, let me reframe the thought. I love RealityMixer, I just cannot stand using SteamVR as VDXR gives me so much smoother performance. When i try to use RM under StreamVR I actually get a little queasy because of the stutters. If this works with VDXR, I'm all in, though I wish it would have all the options of RM.

[@SimHangerFS]

Yes works on Q3 with VDXR. That was what I was using in the video 😀

[@ChristopherForand]

@@SimHangerFS super cool. Thank you. The video on this with VDXR runs so much better than SteamVR.

[@emarcel-l4i]

Wondering if such software would work with pimax crystal ...

[@lesneilson67]

I can confirm.it works with the Pico 4, but only at low resolution.

[@pchow6829]

Does this impact frame rate?

[@gordonwatson7292]

Doesn't work will G1000 in air manager it freezes the pop out screens. It does work with single instruments.

[@dannyvr1225]

Nice, Can you also give me a link please to one of your video how to record VR (quest3) with OBS, mainly the setup of the source in OBS? thanks a lot in advance :-)

[@fugginrambo]

Dang this is cool

[@graemekinzett7977]

Looks great. Will it work with HP reverb g2 ?

[@vangoghoff5521]

At the very least u could use it to see a separate screen, showing live youtube flights u may be in or on long flights a movie? ;) or maybe facetime with a comrade pc pilot.

[@zeevkatz6]

Looks pretty useful, what about performance? Any noticeable degradation?

[@SimHangerFS]

Not that I noticed, but not measured.

[@tomschulte6518]

You were positive about Pimax Crystal Light (affordable high resolution) but mixed reality has the future so isn't this a show stopper for the Pimax Crystal light (no real color pass-through)?

[@SimHangerFS]

Depends on what you want from your vr experience.

[@Hans-PeterGottschalk]

Hello Marc, Question 1: Can I also use Spitice Color Panel on the HP Reverb G2? Question 2: If so, how exactly do I get to the Virtual Desktop settings window to make the streaming, video and passthrough settings! Question 3: Does “Virtual Desktop” mean the same thing as the Virtual Desktop in Windows 11? Thank you Hans Peter

[@SimHangerFS]

Sorry, but the HP Reverb does not have pass though so it is not compatible with MR applications.

[@CharliePowell7]

I never get to fly in VR because in order to stay married, my wife is usually in the room and we are also watching TV together. I could use this window to be able to watch TV whilst flying. 🙂. I just got a Meta Quest 3, and haven't really tried it yet. Do you have a video on how you did you OpenXR + Quest 3 setup? I am unfamiliar with OpenXR.

[@jvazquez53]

Do you need Virtual desktop in order to work?

[@MaxPower69]

How do I get this running in the Crystal? Could you please do a video mark?

[@SimHangerFS]

I’m not sure this would run on the Crystal, you need to front load Virtual Desktop.

[@jamesleicher]

hey boet so this is your goto head set over pimax?

[@tangocharlie9291]

Custom shapes and I’d pay good money for this.

[@adr1uno638]

is there a transparency setting ?

[@retroreplay1980]

This is great!

[@TENGILL]

woo, this is a game changer! Will this work with other sims?

[@SimHangerFS]

Only MSFS as far as I am aware.

[@leedove7255]

Hmm. Downloaded and put in community folder, set VRD up but no menu item in MSFS so can't open. Installed a couple of times but no luck.

[@SimHangerFS]

Not sure, try install as Administrator. Check anti-virus.

[@leedove7255]

@@SimHangerFS I fixed it! Brain fart on my part. I had put the folder in the backup of the Community folder not the active one .... duuh .. All working now.

[@sascenturion]

Hi Mark You must be a mind reader! ..lol Past couple of days ive been trying to get the "pass through" mode to work on my pimax crystal and for the life of me i cant get it to work ..grr. ( the "tick box" in pimax play wont stay ticked amongst other pimax unstable software shenannigens). So maybe this works on a pimax headset ? ..maybe worth a try. Credit to yourself ,the developer Spitice and of course Russ Barlow for bringing it to the communities attention. 👍😀

[@SimHangerFS]

You need Virtual Desktop and wireless connectivity so this will be a limiting factor for the Pimax right now.

[@DS-bj9br]

Mark sorry to bother you been trying to get it to work with Pimax Crystal. Do you have to have steam VR enable or will it just work with Pimax Crystal interface and PimsxXR runtime and OpenXR Toolkit Compananion. Wondering if you could please explain step by step how it's done or show a video with Pimax Crystal. THANKS for all your great tutorials

[@SimHangerFS]

Sorry, I need to be clearer. Pimax Crystal has all the specs to use it (openXR runtime and passthrough), but you need VD app and wireless capability which is still to be made available from Pimax.

[@benvanboom8907]

Hi Mark, thanks for this tip….do you know if this will work with the Varjo Aero?

[@SimHangerFS]

Only if it has access to VD and can operate wirelessly

[@benvanboom8907]

@@SimHangerFS thanks Mark….it is wireless but what is VD?😅

[@SimHangerFS]

@@benvanboom8907 virtual desktop. From what I have researched today, it will not work on the Aero.

[@benvanboom8907]

@@SimHangerFS thanks Mark !

[@jangonzales7750]

For some reason, it does not work for me. I followed every step you showed.

[@waterrat50]

Hi Mark, I have installed and uninstalled 3 times now all with the same result. I just end up with a purple rectangle in my Quest 3 headset without any passthrough. Checked and triple-checked your video to ensure I'm following exactly, but still no luck, unfortunately. Any suggestions? Thanks

[@SimHangerFS]

Check your Q3 settings to see if anything disabled?

[@waterrat50]

@@SimHangerFS thankyou, but all is enabled as per your always excellent video.

[@SimHangerFS]

@@waterrat50 I’m not sure why, contact rkApps directly, they are normally quite quick to respond.

[@DS-bj9br]

Will this work with the Pimax Crystal and if it does will it still be in black and white?

[@SimHangerFS]

Yes if you use PimaxVR / VD and colour passthrough. You need to access VD wireless so this will be a limiting factor at the moment.

[@bobfry1011]

Will this work with the Varjo Aero? Thanks

[@VRFlightSimGuy]

Negative, the Aero does not have any cameras for pass through unfortunately.

[@rmgf1005]

How does it work with the Pimax Crystal?

[@SimHangerFS]

Virtual Desktop requires wireless connectivity.

[@1pilot34]

Will you have the color option with the reverb G2?

[@SimHangerFS]

No passthrough on the G2

[@1pilot34]

@@SimHangerFS thank you

[@jarekpiwar3688]

Do You like free Cessna 152 from JP?

[@SimHangerFS]

I use the mod from Bagalo via flightsim.to

[@kurtkaeferboeck5323]

The problem is that it doesn't work with a USB link cable. The performance using a USB link cable is much better, so I could do without it with msfs. The WiFi network is susceptible to the transport of large amounts of data. If you increase the Mbit, the transport lag gets higher and higher, and it's also completely uneven, sometimes going over 20 ms. With a USB connection, the transport lag is always the same, regardless of whether you put 200 mbit on the line or 20. It stays stable between 2 and 4 ms. That's an enormous lag saving. What's more, both the encoder and the decoder seem to be burdened by the irregular transfer rate and take up a lot more time than with USB, with which even weaker computers with good settings can still fly reasonably well in VR. From 35 to 40 frames it becomes comfortable and smooth, but it only works via a USB connection. Not necessary with msfs either. Anyone can set up the cable so that it doesn't cause any disruption.

[@PeteV80]

How doesn't this ruin immersion?

[@marcusdamberger]

I think this will be useful if your fumbling and need to look at something quickly in the real world like he demonstrated, then close the view. I wonder if you could map different views to different buttons on your controls. It would be neat if it could have multiple views stored.