Passthrough Cameras bring the Real World into VR | SimXR from rkApps tested in MSFS | Mixed Reality

[@rkApps-shop]

Hey Mark, what a profound, fun, and fantastic review! We really appreciate it. 🍺 We're absolutely thrilled to keep pushing SimXR to new heights and it's awesome to see how much the community is enjoying it. Wishing you smooth landings and epic mixed reality flights 😎

[@petersenpansen8658]

Thanks Roy, nice price and great to have a 7 days trial! Great work!

[@-TK-421]

This is so amazing. Total game changer for people who only fly in VR. Now we can use custom made things and see it. As long as you can actually read and clearly see. To me the price is perfect.

[@CyclingIngenieur]

I've said this before but the Pico 4 for one will recognise hands and fingers in its native environment. It just can't be much of a stretch to get something like this to work inside the virtual cockpit in MSFS. Then there'll be barely any need for all that specialist hardware unless you're particularly interested in the tactile part of it. I think that would bring real immersion to VR simming.

[@chrisvowell2890]

This is exactly what I've been waiting for! You'll recall that I stated earlier I didn't fancy strapping a brick to my face for VR because of the lack of being able to control periferals. Well, this seems to satisfy this more than adequately. (Checks finances to see whether I can now afford to purchase a pass through VR headset ... YES!)

[@pchow6829]

Excellent review Mark. They need to make this for DCS.

[@flightsimbuilder1]

Holly cow, the future is here! This is really cool and I can start using VR again :) I see in the comments there is something like "Hollow" selection for the avionics. I'll give it a shot and maybe even with a full panel. Thanks Mark!

[@seattime4075]

There is also a 'Hollow' selection specifically for Garmin type panel use.

[@davidhorobin1060]

Superb Mark, what would we do without you? ! Thank you for keeping us up-to-date.

[@SimHangerFS]

Thank you ☺️

[@matp8493]

This is a very good app, mixed reality is moving along nicely. Being able to wite down ATC instructions in VR is great.

[@fwdskillzone1767]

Okay, now we are talking a real mixed reality, this is very impressive. When are we gonna get it for X-plane?

[@DaveBrown1]

Thanks for the info Mark, I am stuck with a Aero but will keep an eye on this.

[@seattime4075]

Great app, I'm using a green colour for pass through, as it is easier on the eye. RO,G100,B51, although your sim background must be suitable.

[@86abaile]

I've come to terms with the fact that I'll never have decent passthrough on my G2 without also crippling it with steamVR; but I'd also like to see passthrough tech become part of the openXR standard so that it could implemented without the need for an extra app like virtual desktop.

[@DaveBrown1]

Agree as I only ;) have an Varjo Aero so no passthrough at all. I am watching this with interest.

[@SimHangerFS]

The G2 is not a passthrough capable headset unfortunately

[@themorethemerrier281]

​@@SimHangerFSwhich is sad because I CAN activate a passthrough/torch in vanilla wmr with my g2. The picture is bw and not brilliant. but for being able to view my throttle it would be quite helpful.

[@rotormann]

I only need this for DCS. Got a bunch of controls, buttons, panels… that need to be used quick and easy in DCS. In MSFS I dont’t need it really.

[@rogergmorris]

Excellent, and, funnily enough, I just twigged this very thing yesterday, while taking a flight from Norwich airport, up to Fishburn airfield, in Co. Durham. I decided to find where I'd read about it, and lo, here you are!😎

[@VPopkins]

Tanks for the vid. Why is physical pad slightly shaking inside the window, tracking issue ir ut was actually shaking

[@moviefan8939]

That seems like a very promising product. However there are 2 catches for me: 1) As you already mentioned, the windows have to be rearranged every time. I would like to have to buttons, for turning pass through on/off and re-centering the pass through windows. (just like 2 buttons to switch between VR/2d and re-centering the VR view) 2) Pop out windows are not updated any more if VR is turned on, so you will not be able to make use of the picture on your real world GNS 530 when in VR using pass trough. (operating its knobs is of cause working) From my point of view both are shortcomings of MSFS. And as the VR community is small (in comparison to all X-Box users) my hopes for improvements are limited.

[@SimHangerFS]

These are still early days….time will tell 😀

[@boborbob7579]

Is it possible to use a green screen behind the controller with this to obscure background objects? I only have a hotas so would be nice to only see that

[@gerryabbott]

Awsome! When will it be compatible with DCS World and BMS?

[@SimHangerFS]

I don’t know to be honest.

[@johnmaguire2185]

I think a bindable on off switch would be needed. A bit like re-centre to turn on off the pass through.

[@SimHangerFS]

Agreed. Essential

[@gordonroxburgh]

Tested with PICO4. Does need to be on high setting in virtual desktop. Does not support Ultra or Godlike.

[@SimHangerFS]

Did you need to change the color values?

[@aplaceinthesky82]

hello one question on VD what AP do you use with it?

[@k9ulan]

I'm trying to get this to work, but can't make it "not pink" on the sim. I feel like I have everything set up correctly in Virtual desktop. However I don't see a tab specifically for Pass thru in the streaming tab. Any help appreciated!

[@SimHangerFS]

It should be in your top toolbar in the sim

[@k9ulan]

​@@SimHangerFS Thanks for the reply. Turns out I needed to remove and re install Virtual Desktop, Go figure....

[@_flyby]

Thank you. Do you know if Reverg g2 is compatible with it?

[@86abaile]

It won't. Firstly it would require you to use WMR for steamVR, which cripples performance significantly, just in order to use the app. Secondly the G2 doesn't make its cameras accessible to app developers. The best you're going to get is the flashlight function built into the G2.

[@waltersbg]

LOL...the pass through for your drink can!

[@SimHangerFS]

😂 essential requirements

[@simpitacademy]

How are you getting your secondary displays to run in VR? Are you using third party apps like Air Manager or just right Alt click and drag? I use the right Alt key and instruments like MFD, glass cockpit only work on second monitor in 2D and stop working in VR. Then I can't use it in MR.

[@SimHangerFS]

@@simpitacademy I’m using the gns530 physical device from FlightsimBuilder.

[@simpitacademy]

@@SimHangerFS MSFS still has to port the display to this device like a second monitor correct? did you have to install some software for the device to talk to MSFS?

[@SimHangerFS]

@@simpitacademy no, it’s a window out of VR into my physical cockpit.

[@TheJamster1234567]

The steam verson of virtual desktop doesnt have any of those settings? Can any one assist? im using a HTC Vive

[@AnthonyRobson-tl6zs]

installed for demo but can register details

[@micgrech]

I have a hp reverb g2... would this work?

[@SimHangerFS]

Unfortunately not, no colour passthrough cameras

[@micgrech]

@@SimHangerFS thx

[@snnfly]

Do you know how I can get virtual desktop on my HP Reverb G2 to run this. Do I need to download it to my computer or to the Reverb? Many thanks

[@SimHangerFS]

You can’t do this on the Reverb. No colour passthrough

[@snnfly]

@@SimHangerFS Thanks Mark, disapointed even bought the programme without realising there was a free trial.

[@jonmabec]

These developers really need to make their apps independent from virtual desktop and support external cameras so that people without proper built in pass through have an option.

[@SimHangerFS]

I’m sure that will come.

[@jonmabec]

@@SimHangerFS I hope so!

[@Buddy308]

@@SimHangerFS If that does come to pass, it would make this functionality available on the Pimax headsets, which currently do have pass-through of a sort but not with the color and resolution needed for Color Panel or SimXR.

[@richardPalmisano]

OK, so for this to work properly, you do need virtual desktop right which I have already

[@SimHangerFS]

@@richardPalmisano yes you do, installed into the headset.

[@4secsharkmr352]

❤ thx Mark

[@benvanboom8907]

I hope they can bring this kind of app for my Varjo Aero too…😊

[@richardPalmisano]

ok so this dosent work with pimax crystal ?

[@SimHangerFS]

@@richardPalmisano correct.

[@PepuDrummer527]

So, this doesn't work via link cable?

[@SimHangerFS]

@@PepuDrummer527 no it doesn’t unfortunately.

[@vangoghoff5521]

I just want it to bingewatch Game of Thrones on long haul flights ;)

[@SimHangerFS]

😂

[@miraclealigner]

Hi Mark, so no support for pimax Crystal

[@Blodwyn1976]

Just wondered the same. As you theoretically can use Virtual Desktop with the Crystal, perhaps it could work. But never tried it yet. If someone knows, how to realize that with the Crystal, let us know 🤓

[@vangoghoff5521]

This not working together with virtual desktop on crystal light will end up me cancelling preorder and waiting for deckard or quest 4

[@miraclealigner]

@@Blodwyn1976 I didn’t know the crystal could work with Virtual desktop

[@maxmirot9460]

Crystal doesn't have color for pass through. It would nice to have a good app for MR on the Pixmax

[@SimHangerFS]

No, I’ve tried on Crystal. Not compatible.

[@simonoregan4744]

Does the require Steam VR or can I run it with Oculus and or OpenXR?

[@SimHangerFS]

You can run it with VDXR (openXR for Virtual Desktop)

[@EscapeRealityMedia]

Would it work with sim racing as well or is it made for msfs

[@SimHangerFS]

As far as I can ascertain only MSFS at the moment. Xplane coming soon.

[@EscapeRealityMedia]

@@SimHangerFS thanks for the reply I will check it out the demo looks like it works quite well

[@legerstee1]

On my pico 4 it does not work. In VR i get this bright purple/pink square that i draw but it does not put passthrough video into it.........to bad....anyone tips?

[@SimHangerFS]

The default ‘’passthrough’’ colour for the Pico may be different meaning you’ll need different values in VD.

[@legerstee1]

@@SimHangerFS I tripple checked these settings are the same and even set them a bit off... No changes

[@SimHangerFS]

@@legerstee1 not sure, check settings perhaps - is something disabled?

[@legerstee1]

@@SimHangerFS yea tonight I perhaps have another chance, thank you very much for the great videos and the nice and slower pace in them, it's a relieve to many other vids 👍

[@mikeSL246]

Same here,at first. Try 9 and 30%. Seems to be dependent on room brightness. VD doesn't allow Ultra or Godlike for passthrough either. I had to set it to high to get passthrough enabled. My guess is the Pico 4 doesn't have the horsepower for higher.

[@pcgamernw5702]

could not reach simxr site

[@SimHangerFS]

Link in notes below the video

[@pcgamernw5702]

@@SimHangerFS tried it. Not working for me

[@pcgamernw5702]

@@SimHangerFS looks like site blocked in usa

[@SimHangerFS]

@@pcgamernw5702 weird…I thought they were based there, not sure though.

[@iconcity]

Wow! Mind blown?!! Pimax crystal thou??? Anyone?

[@SimHangerFS]

Not compatible unfortunately

[@jamierichards925]

shouldn't be called simxr when it only works with 1 game lol when I first heard the name I thought it was something for all sim games like seeing your actual racing wheel etc in game lol

[@critical_always]

This is an incredible step up. In fact... SOLD! I want a copy. ...Uhm... Paypal only? I refuse to use Paypal because they debank people they don't like. ...Can't find an email address to ask for payment options. Yeah nah too hard.