Easiest MSFS Mixed Reality: Color Panel for VR

A review of the Freeware app Color Panel for VR by Spittice on flightsim.to .
Bring your physical cockpit controls into VR to use your hands in a realistic way.

[@davidlewin2744]

I’m on the cusp of committing to a sim build of my own. Videos like yours are so important to understanding this whole subject. Thanks a lot 👍🏻

[@rbarlow]

Glad it was helpful!

[@SimHangerFS]

Going to try it out for sure, thanks for the heads up. 😊

[@永よし]

I am watching your videos from Japan. I have been an aircraft design engineer, almost retiring within a few years. After the retirement, I would like to build a home cockpit of mixed reality as yours. So, please keep on showing simple and good way of making MR cockpit.

[@rbarlow]

Currently to have a quality MR setup requires the Varjo XR-4 headset and a very strong computer and graphics card. The quality will continue to improve and prices will continue to fall in the future.

[@olliefick8881]

I believe I read somewhere that this will work for XP12 by placing the 'spitice-color-panel' in the XP12 Custom Scenery Folder. Have you tried this?

[@rbarlow]

That is news to me but happy to try

[@likes2fly]

I'm using simxr and it works great but I'm having issues with the pop out panels of the instrument panel. Once I go into VR the pop out panel freezes. I've tried this with both my pimax crystal and quest 3. I have realsimgear instruments(g1000's, 530,750,650). It dosn't mater where I have my pop out panel it freezes when I start VR. Its been awhile since I've tried pop out panels in vr but they always worked before. I'm not sure if its in msfs, video card driver, virtual desktop streamer or something else. I was so excited that I finally had passthrough for my realsimgear equipment but the screen freezes in VR. Any ideas how to fix it?

[@carlboulianne4284]

Hi M. Barlow, I installed air manager, I already have the knobster. When flying with the monitor I can use air manager with G1000 and knobster but if I try to fly with quest 3 in vr with virtual desktop and color panel, It says the kobster is not plug and the g-1000 don't work. Do you have a idea what can be my problem, thank you and have a nice day.

[@carlboulianne4284]

Hi, I installed and I have in my toolbar as you show the color panel. I set in virtual desktop the color variation, I chose the white bloc in VD. But when I launch color panel, at first I see through but as soon as I move it, It become pink. Do I need to change the color in VD only in the white bloc or is there something else, thank you and have a nice day.

[@marcosa995]

Hi Ross even I set the colors as instruct on the color panel I still do not see the pass through as you demonstrate in this video. I was wondering if my Nvidia color settings has an impact with this mob. Any recommendation . Thank you

[@vfx7t]

You know, I was fortunate enough to acquire a panel for the Cessna 172 and a Garmin 530 GPS from Digama Simulator company that specialized in manufacturing equipment for flight simulators, located in Miami at the time. How I came up with the idea to purchase them from Miami to Algiers, Algeria, I don't know. Organizing their transport over such a distance was a real challenge. Fortunately, my equipment finally arrived. Unfortunately, this company has since gone bankrupt, but I consider myself lucky because without this equipment, I wouldn't have been able to fly on my flight simulator ! Thank you from Algeria !

[@LalaPala-ml2or]

Does it work with Bms Falcon simulator?

[@slimpikkins9526]

Hi Russ...thanks so much for your tutorial on the binding settings for the OV-10 Bronco...it was very helpful...and thanks for all you do to help all of us to enjoy flight simming...

[@tarrowdriver]

MSFS currently does not support panel pop-outs in VR - so you can't currently use Air Manager with MSFS in mixed reality. As soon as you switch to VR, the popped-out panel freezes. I had no idea that this was the case until recently. Not sure if this will get fixed in the upcoming MSFS update.

[@737sst]

Why would you need MSFS pop-out panels when you have airmanager which runs its own panels and gauges (outside MSFS)?

[@jpr7365]

Hi, thanks for saying that...I've finally found someone who has had the same problem as me with MSFS and mixed reality with AM. It's very frustrating to see it work fine in 2D but then it freezes in vr when you think you are going to get a great MR experience. Hope Asobo get on to fixing that glitch soon.

[@tarrowdriver]

@@737sst All of the glass cockpit Air Manager panels (that I'm familiar with) require pop-outs.

[@rbarlow]

@@tarrowdriveractually in XP12 with AM 4.2 the glass panels can be streamed to the AM panel instruments even on another computer. MSFS has no such capability.

[@adielelimelech9213]

@@rbarlow it’s working with DCS?

[@simonhouel1984]

That is very nice ! Thank you :-) Could it work with hand tracking like you did in another video ? I find that solution (pass through and hand tracking) to be the very best solution.

[@MotoFuzzi]

Hello, thanks for the interesting video. I just got BeyondATC and was wondering if you know of a solution to at least see the BeyondATC window in VR, since this feature has not been implemented yet in BATC. Thanks!

[@-TK-421]

Very cool. I would like to be able to see my alpha and bravo. Or if i switch the alpha with a stick. I go by muscle memory but there are time i am trying to figure out where a button is. Do you feel the resolution was good enough to read the gauges.

[@rbarlow]

Yes but not the text on glass gauges without leaning in

[@jonmabec]

The problem with this setup is that it's using a workaround using virtual desktop to get the passthrough from the Quest 3 to work. I understand that's the only way to do it since Meta doesn't allow third party software to access their cameras. Using colour keying to get the passthrough to work is a very hacky solution. What Reality Mixer does is that it allows you to access any camera directly and don't have to use Virtual desktop with colour keying to make it work. Colour keying in Reality Mixer is reserved to what is is supposed to be used for: physical greenscreens. So it's difficult to set up with Quest 3 because of restrictions. Not trying to bash this developer or software as it's seems to be doing its job just fine. I just wish we could get a more streamlined solution where chroma keying is used properly. And a solution that is not headset specific. Having to choose a headset for its built in passthrough cameras limits you as to what HMD you can get. I hope that a standalone camera module will be developed that allows you to use any headset regardless of it having built in passhthrough or not. Reality Mixer currently support external cameras and I hope other software will do this as well. Using an external webcam works fine, but once again, it would be nice with a stereoscopic camera module attached to your headset. As for OpenXR, Reality Mixer is going to support that in the future. I want to clarify something though: Using OpenXR gives you better performance ONLY if you use a headset that is not native SteamVR. A native SteamVR headset will work best with SteamVR and will not receive a performance boost using OpenXR. So once again, this is very headset specific.

[@rbarlow]

Check out a non SteamVR OpenXR alternative kzbin.info/www/bejne/pWPZeYqEm5yjjZYsi=lxrtdYyR5w2q-QVJ

[@jonmabec]

@@rbarlowactually, I have a native SteamVR headset so I need to use SteamVR.

[@DS-bj9br]

Will this work with Pimax Crystal and if dose will it still be in black and white?

[@rbarlow]

Possible but color makes it and the Crystal cameras are really not great rez

[@VRFlightSimGuy]

Very cool video Russ. Take care!

[@rbarlow]

Thanks, you too! Can’t wait to see how this evolves with XR-4 and beyond.

[@737sst]

Although this is a nice solution, it's in my opinion not sufficient. I would rather see another direction when it comes to hardware cockpits. Combining XR and chromakey. Instead of e.g. TV's for outside view what would e.g. a pink (or green) screen do in front of a hardware cockpit? Curious if this has been tried yet.

[@mcpfpv7535]

so with this program you can use air manager in vr mixed reality mode? i know you can't use air manager in vr.

[@DB-zp9un]

Only downfall that I see, and some will argue, is that you cant use it when linked.. Think it is a wireless only app (virtual desktop)..

[@rbarlow]

No with Quest3 and the latest Virtual Desktop version ( purchase from the Meta store not Steam) you can use the link cable for VR and this works fine with it

[@DB-zp9un]

@@rbarlow nice! Do you like this one better or the mixed reality program? Now all they need to do is make it so you can fine tune weird shapes and really make a precise mask..

[@DB-zp9un]

@@rbarlow alas sorry to say I have to disagree with you about it using the link cable.. Even on the meta store, it says wirelessly, and if you try to find it on the "link store" you wont find it.. So, that sucks.. I may have to look into a dedicated 6e router..

[@FlyingTheston]

I tried the Color Panel option as well, it was pretty good and definitely good enough for those who want to just get a decent passthrough quickly without the overhead of reality mixer. Great video as always!

[@rbarlow]

Totally agree!

[@marcosa995]

Thank you Ross I will get it and use it with Quest 3

[@billwells7464]

I'm hoping someone will come up with a system that uses QR markers on the vertices of whatever panel or device you want to pass-thru. Putting 4 or 6 stickers or magnets on a physical panel or controller would make the window dynamic. I'm sure it's possible, just don't know if current hardware could do it or what impact it would have on framerates.

[@rbarlow]

Varjo already has such a system that can use optical markers or a SteamVR tracker to keep things aligned. They also allow you to define vertices of a pass through area using a controller. Finally they support physical chroma key. The Quest 3 could do this too with the proper software from Meta.

[@marklee1462]

what was the challenge with lining up reality panel so it overlay virtual, The misalignment means you could see both

[@rbarlow]

Yes my basement wall and not the instrument panel😀

[@tangocharlie9291]

This looks promising. Imagine at some point we’ll have templates for various airplane panel shapes, and when custom panel shapes happen, I’m in 100%.

[@FlyingTheston]

you know what would be really cool, if plane developers included a magenta cockpit with their liveries :)

[@jpr7365]

Hi Russ, have you used this with the G1000 on Air Manager? Mine still doesn't stream what is on the G1000 when in vr.

[@rbarlow]

It is shown briefly in one of my early mixed reality videos. Somewhat difficult to read small text without a lean in. Be sure you turn your lcd screen down to a very low brightness level to reduce blooming and increase quality

[@rcbruce841]

Russ been working with this passthrough. struggling a bit. with this work in vdxr in virtual desktop.

[@MevRB19]

You will - passthrough is crap ! - try reading a normal monitor or phone just from startup of the quest 3.... it is absolutely terrible. From this point - NO program will make it better. TRY to ignore steam VR - or in fact- ANY STEAM programs for VR. Then also try to ignore Virtual Desktop as it is a rip off and the Meta PC link is far better than both - NEVER use the wifi as it is useless.

[@rcbruce841]

Hey Russ, one more question. have you had any issue with dual images in vr. I am not sure what setting i may have changed to cause this. any ideas

[@rbarlow]

No never have. I'm sure you have Googled it?

[@LancastrianDarren]

I've been wanting to move to VR for my flight simming for a while, but I've already invested in cockpit hardware and software, and whilst your video shows an excellent way to see that hardware in VR, I wonder if there's a simpler solution? Given the size of the flightsim market, and the hobbyist interest in building real instrumentation, isn't there an opportunity for VR headset manufacturers to produce a headset or even glasses which has a transparent area in the lower half so we can visually see the yoke, quadrant, and instrument screens when we look down, perhaps the headset could just have displays in the top half for the flight sim display which might be an easier solution to the aims of mixed reality and if MSFS had a keypress to "disappear' the cockpit interior, like FSX and older versions had, that would be an ideal configuration for me to make the jump to VR.

[@rbarlow]

Microsoft discontinued their Augmented Reality glasses that projected VR images onto transparent glasses because they were too expensive and didn’t sell. The home dim market is relatively small and cheap. I have focused on the Q3 because it is the only affordable passthrough headset. Higher resolution passthrough is already available in the Varjo XR-4 and others will follow and the prices will continue to fall. The resolution will soon reach human eye quality so that will not be an issue. It wasn’t that long ago the RiftS with its much lower visual quality we deemed fantastic. Have you been able to seriously try VR in the Q3. It is quite a value proposition. The upcoming Pimax Crystal Light has no passthrough but also looks like a game changing VR headset. Once you experience VR on a high resolution headset the flat screen world just seems to be missing something

[@737sst]

​​@@rbarlow Two words: green screen. 😅

[@yokoh691]

These are the best vids! I can’t fly none mixed reality now lol

[@FlyingTheston]

same here, mixed reality is the only way to fly for me!

[@MevRB19]

Hi Russ, you must have an exceptional - in fact - incredible Q3 to get a clear passthrough on a monitor - or from a monitor !> Yes, the passthrough has improved slightly in 64 and 65, yet, it is still virtually impossible to read a monitor or phone using passthrough. Note, recorded video always looks better than what you see with passthrough. Are you actually saying that the monitor - in passthrough, look CLEAR ????? if so then as said, you must have some exceptional version of the Q3 as that is certainly not normal. Cheers.

[@rbarlow]

Yes the video slightly over states the clarity since it is viewed in the headset through a lower resolution screen. I can’t read the small text on the glass displays without a slight lean in but otherwise things are plenty clear. I attribute the quality to a very bright overhead 4’ two tube LED light. The room is almost uncomfortably harsh and bright. I also have to turn the brightness of my ips LCD screens down to almost their lowest brightness to avoid blooming. I also may have an exceptionally good Q3 too as it is the only one I have tried in my setup.

[@MevRB19]

@@rbarlow lol, yes, that is what I thought. I think you should state this as it make people believe they will get this with a plain Q3. The very bright lighting and the low settings on the monitor is ok, but hard to work with. It is a very specific Q3 setting. There is no way you could night fly - for example. I think we are years off a practical solution sir.

[@rbarlow]

@@MevRB19 the brightness of the LCD monitor is what I use in nonMR too. Check out my videos below to see a couple more refined setups. The quality is quite usable and immersive. I will concede your point about night flying. Pilot Review: Altimeter Motives Cessna 172 Dual G5 Panel VALUE! kzbin.info/www/bejne/bp7NgYuXgatnaLM Quest 3 Mixed Reality Flight Sim: Full Panel Integration kzbin.info/www/bejne/bZC7YqqImr97ncU

[@miket3445]

Just been looking at this VR stuff and reminds me of using NVG in the military. NVG, ANVIS, in particular are basically 2 x phosphorous tubes showing the image. The breakthrough came about when the google tubes where positioned about an inch from your eyes allowing you to look down at your instruments and switches. VR, to me anyway, is similar……any reason why you couldn’t open up the bottom of your VR headsets so you can look down at your switches??

[@rbarlow]

Check out the Lynx R-1 headset that is not high resolution but has an open mode as you describe. I think passthrough resolution will become near human eye resolution in 3-5 years.

[@tangocharlie9291]

I trimmed the nose / cheek padding on my headset. Free & effective!

[@miket3445]

I just found the best mixed reality setup so far……. kzbin.info/www/bejne/jnjNgYqVoJqcqaMsi=HzPkaolejPEdmguQ …….have a look at their demo……seamless!

[@rbarlow]

Try this, I have NOT tried it. Let me know if it works, github.com/Christian1984/fsdesktop

[@TheRigmarol]

Can it work in DCS and IL2?

[@rbarlow]

No the addon is for MSFS currently

[@TheRigmarol]

@@rbarlow Thank you very much