Hand & Peripheral Visualisation in VR | Free & Pro Version Options | Infuse VR

Is this the first step into AR/MR for VR Pilots? Newly developed software which should be ready for release soon enables you to see your hands and peripherals whilst in VR. Plus you can place them in your VR world to represent where they are physically on your desk or sim-rig!
FS Academy Commander is available now from various retailers and direct from the in-sim Marketplace, PC & Xbox compatible. More info here: www.fsacademy....
REFERENCED LINKS
InfuseVR Video: • Infuse VR - Streaming,...
InfuseVR: www.yawvr.com/...
FS Academy Commender Review: • Expect the Unexpected ...
Support the channel so I can continue to bring quality content to you:
✈ You can donate here: www.paypal.com...
✈ You could also buy me a coffee here : www.buymeacoff...
SIMHANGER KZbin Channel Link: / simhangerflightsimulation
Join Simhanger on Discord: YOUR DISCORD INVITE: / discord
For more details visit Simhanger Website: www.simhanger.com
Connect with me on Facebook, Instagram and Twitter: @Simhanger1
VR Pilots, need prescription lenses? Link to VR WAVE : www.vr-wave.st... Get 5% discount by entering in promo code simhanger (all lowercase) at checkout, (non-affiliated).
Everything you wanted to know about VR - Playlist here: • ESSENTIAL VR
Looking for help with MSFS, then check out my HOW TO GUIDES, link to playlist here: • MSFS HOW TO GUIDE
MSFS on Xbox playlist can be found here: • MSFS on XBOX
Thanks for watching
#microsoftflightsimulator #msfs #flightsimulation #vr #infusevr

[@SimHangerFS]

What is your take on this...? Massive VR aid or immersion breaker?

[@karmabasedj8184]

Haha nice! We were just talking about this the other day!

[@mikegc3816]

There are some clever people around. Seen similar things but very expensive - looking forward to this - cheers Mark

[@srobak]

That is one of the most impressive things I have seen for VR in a while. I know it is just in its infancy - but this has the potential to be a game changer for sure. Very excited to see this. Hopefully iy will be available for standlone MSFS as well - not all of us use steam :)

[@pesto12601]

This should be built directly into the sims themselves... come on.. it is 2023 after all!

[@JohnGrimble]

its a load of shyte

[@davidrose4900]

Hopefully they will add a mixed reality feature to allow you to use the Q3 pass through and align the peripherals to match the real world ones even easier. I will definitely be keeping my eye out for this when it is available.

[@GreenBlueWalkthrough]

Or even better just key you and things you want into the VR game!

[@Mesusir]

And without any Steam app.

[@Digger513]

I don't think having my real stick and throttle displayed on the screen will be of much help. Now if this allows for interacting with the virtual buttons of the cockpit, different story

[@SimHangerFS]

That’s the next step towards real immersion. 👍

[@ComdrStew]

Need to have someone to make a passthrough like the Varjo XR-3. Where you can see your cockpit, but outside the cockpit is the VR world.

[@IrvingWalker82]

I would love to see some implementation of a virtual notepad. I think this software looks the closest to being able to have that! There are apps that allow you to use a mouse to ‘write’ notes but the idea of being able to pick up a pen or object and write in vr would open up great options from anyone wanting to use vatsim in VR I think.

[@86abaile]

It's of little use to me unless it works with openXR. If it did though and could be used with DCS standalone, it would be amazing for virtual cockpits (especially if visibility could be toggled with a button). Oddly enough, joystick and throttle visualisation are probably the least useful features of this software; where it will REALLY shine is fixed position keyboards and custom button boxes (no more looking down my nose to try to find my MFDs please).

[@Pics2FlicksDennis]

OpenXR will be possible once ALVR is compatible with OpenXR. The importance of this is understood.

[@clayton4115]

Really prefer something which you can interact with the actual VR cockpit knobs, dials, throttle etc

[@terrycrooke1]

Yes it is the ultimate goal I'm sure

[@charlysix]

This is becoming interesting. My dream is to mix the scene with my home cockpit by using the pass through feature, this is the last mile towards the top !

[@SimHangerFS]

I agree, a real mixed reality environment must be the target.

[@twodogzz9291]

I agree too. I've held off getting VR until an affordable HD pass-through is available. This may be an alternate option though.

[@raymondgoubet]

Very informative video: thank you Mark! Well it is interesting, but I would prefer having a mixture of reality and Sim in VR. I explain. Put a camera on the VR headset. Then software will allow the user to define an area, of any shape (like the bottom half for example), for real view to appear over sim view. A toggle would swap from full sim view in VR to mixture real view and sim view. Their concept needs lots of menus to match the position of items, and this won't include any other objects like a glass, a pen, anything not controllers. A camera of the real view will always show you all, and we could toggle this. Do you see my idea?

[@raymondgoubet]

@@bb-sky Yes, and will show everything when the user needs to. We could also mix the sim AND reality, to see both, with a choice to give priority to one, then toggle sim only.

[@Josh23913]

Having virtual representations of my physical controls superimposed on top of the virtual cockpit would be too much of a break in the VR immersion experience for me. But I'm sure there will enough people interested to make it a viable product.

[@SimHangerFS]

It’s an interesting observation, and one that has occurred to me also.

[@sascenturion]

Looks very cool ... certainly something I would consider Thanks mark 👍

[@r4microds]

Augmenting hardware into the virtual space is awesome

[@jl7224]

They had me at being able to track my drink! lol! Can't wait to see Mark's full review when it is available.

[@SimHangerFS]

😂…agree, not spilling your drink in VR is critical😊

[@hanswurst3811]

@@SimHangerFS but obviously you would bump the can on your vr headset :D

[@rhcorr]

This is pretty cool! I hope to see this released soon.

[@bronco5334]

It's a start, but finding joysticks, throttles, and keyboards by feel is pretty easy. We don't REALLY need a VR avatar for that. What we need VR interface with, is individual switches and buttons on button boxes and simpits. And doing that through "avatars" placed purely in VR is the wrong way to go about it. We need mixed-reality. Quest 3 already has excellent passthrough capability; we just need a way to define WHAT AREAS it shows in passthrough and what areas to depict the 3d VR world onto. If we could define an area, either by azimuths, real-world 3d space boundaries, distance from the headset, or greenscreen color-coding, then we could have it automatically show us our simpit and hands in reality, but everything else in VR.

[@laurentsamson8927]

Hmm, it's really impressive what this guy managed to do but I find it a bit of an immersion breaker. Personally, I have no problem finding and using my 2 main peripherals, the mouse and the joystick. So I don't want them to appear on the virtual cockpit. The only thing I have some difficulty with is my keyboard accessing certain hotkeys. So it would be great if it was precise enough to let me reach for particular keys instead of just seeing where my keyboard is. Overall, if this program can see my hands in 3D, what I would love to be able to do is actually be able to use them to interact within the cockpit switches.

If this will allow me to both see and use my hands in VR in MSFS with my Varjo Aero instead of using the mouse, I'm thrilled and can't wait!

[@Fib3R21]

I Dont think you will be able to use it with varjo Aero as it does not have passthrough

To me, seeing my virtual hands and being able to manipulate things in the cockpit using them rather than using the mouse would be good enough

[@joelmulder]

Looks very cool, but $50 for the full versions seems very steep.

[@krazypinoy6495]

I saw this video a week ago and I think this is great and can't wait for it to come out

[@docslappy8946]

Very useful but, for me, very immersion breaking. Unless... It can be set to only show the controller when you move your head close to it or press a specific button. I love the detail of VR cockpits and feeling that I'm really there. Having a ghostly hand and an inappropriate controller spoils that. I use some other software that activates a pass through view, around an object, and that can be set to only activate when your moves closer. I use it to see my keyboard when I need to.

[@SimHangerFS]

The immersion question you raise could be the make or break for this application.

[@VRSimWizard]

Nice overview, Mark. Thanks for posting.

[@LWJCarroll]

Thanks thats really interesting for VR flight simming. Laurie NZ. 😊

[@SJkopa]

META QUEST3 is Fantastic!!! 👍

[@GreenBlueWalkthrough]

Honestly the hand tracking in PCVR for Quest 3 should just work as you can bring up the palm menus already... Styill I don't think meta would go into this detail with pcontroller tracking and it looks great can't wait to try it out when it releases!

[@mikegc3816]

Made me laugh, it was like watching myself fiddling around for switches

[@critical_always]

Fantastic! You beat me to it but that is actually a good thing. You prove this can be done. The flightsim api didn't allow it but external overlay... Of course! Beyond my software skill anyway. You're going to have one of the most important pieces of VR sim software in existence. So... Shut up take my money! No really. Take it.

[@TENGILL]

Wow, this will bring it to the next level! Looking forward to trying it out. I just need to get a 4090, a new motherboard and cpu, so i can run MSFS in VR.

[@Deyan_B_Travels]

This is the ONLY problem that kept me from buying a VR set.

[@EmesiS]

Well you've been missing out then if that's the only thing.

[@NGC008]

FINALLY! Thanks for sharing.

[@randellriley795]

I have been waiting for this for a couple of years. I think it will be transformative for VR use of my simulator. For some it may be able to eliminate multiple monitors.

[@TheDigitalFlight]

Looks very very interesting

[@johnwjensen]

YES! This would be so amazing. Of course my favorite hmd doesn't have hand tracking but even to have the model there would be soooo helpful.

[@GSpotter63]

Would love to see something like this for Virtual Desktop

[@SimHangerFS]

Me too. That would be awesome indeed.

[@Bigpopp1]

Would be nice to allow early access right now

[@hanskrohn]

I‘m not so sure about this. The yoke is the last thing I need to „see“ when in VR - as a matter of fact, I don‘t even need muscle memory in order to find it. If I‘m correctly positioned in my VR cockpit, it will be in front of me, right where I see the virtul yoke… On the other hand, when I fly for example the P-38, I would not want to see a Warthog throttle (or the Virpil in my case). Seeing the „real“ throttle of my plane in VR is enough to convince me that I am actually operating it, even though my hand is on the Virpil. Just my 2cts…

[@SimHangerFS]

The immersion creation or breaking of this app will be the acid test. I too have my concerns, but a step in the right direction.

[@Xenomorphine]

This is intriguing and makes me hopeful that 'VTOL VR' could allow HOTAS in the future, but I've no idea if Rift S would be compatible for it.

[@chrishinch8810]

Extremely cool, and is exactly what I have been waiting for since starting with VR. But no OpenXR support? Thats in all likelihood a deal breaker.

[@daveyoung2056]

Nice, what would be really nice is if we could have a notepad that we could make notes on, great for vatsim

[@ColinDyckes]

Now do the augmentation by means of one or two webcams so that it works with EVERY VR headset!

[@sveng9933]

That's awesome idea! 👍

[@SimHangerFS]

That’s the future 😊

[@channelvr1293]

Count me in ....would be a amazing upgrade for my 6DOF rig . Now i'm all over the place then i have to lift my HMD to peek at my peripherals then my HMD is either not sitting correct anymore or its automatically adjusting my IPD this destroys the overall experience....

[@gerryabbott]

Thanks for highlighting this Interesting tech. Must be using the pass through camera for hand position, so that's going to be a requirement. If this can be done, surely the sim publishers can give us hand tracking in the pit. Saw somewhere that the pass through camera will take away FPS, so wonder how efficient its going to be. Holy grail is to have the actual replica hotas in the same position as the ones in the VR world, with hand tracking for all the other buttons. Avatar sitting some where else not properly integrated with the pit, will be an immersion breaker. Its a good step forward though.

[@anotheralternative7585]

Wonderful and much needed for VR. It would have been cool if you could simply print QR code stickers, attach them to your gear, and have the software pick up the placement and type of gear with the vr headset cameras.

[@RandyWatson80]

thats a step in the right direction, awesome

[@tikibird8053]

It's sorely needed yes...but the requirement to use it only with SteamVR ruins it. SteamVR is bad with msfs. Virtual Desktop and the XR toolkit combo offer much smoother performance for flying in VR. So, this needs to function using VDXR.

[@mururoa7024]

They should change the Off/On buttons to be On/Off instead. The way they implemented it is reversed to normal logic (e.g. the ON position of the light switches in your house don't turn the lights off). You'd want to click ON to turn something on, instead of clicking OFF. Since it's a toggle button it should also change it's aspect to indicate the toggle state (on vs off). E.g. make it look like an actual switch, or make it glow or change color when it's "active" (just like IRL). There's various ways to solve this, but in general it's a bad practice to change the text on a button upon clicking, as it's likely to confuse users as to what the final state actually is.

[@diegokoszutskisantamaria6221]

I preffer the other way around. Beign able to virtually touch the instruments

[@baomao7243]

✅ Warthog joystick ✅ Warthog throttle Looking good, so far, esp. if it shows the position of your can of Coke ! Even if requires small “beacon-stickers” on the corners of peripherals (akin to TrackIR tracking) i would be thrilled.

[@skytreks8687]

Immersion breaker. Putting a virtual representation of my HC Bravo quadrant would make it 'float' above, say, a 737's console because I have it attached to my desktop. My muscle memory has improved enough I don't need to look at my controls anymore to know where all the switches and knobs are. What I'm still waiting to become available is hand-tracking, or even haptic hand-tracking so my physical hands can interact with all of the many knobs, switches, and buttons I see in the virtual cockpit, which will only serve to enhance immersion vs breaking it.

[@crikycrocky]

Now 5 months later and nothing of substance! Looks like being a revisit to the original occulous Rift which took forever and a day to get to market and then continued to mess people around until it was bought out...

[@RobertGeez]

This headset was not, in any way shape or form designed for simulations. In particular MSFS. It’s a mitigating disaster.

[@gvrose1]

What I would like to see is the correlation of your hands to the VR panel. That way you can stay immersed and you can control the instruments while in VR..

[@Viking8888]

I can’t wait to give the free version a go as my main issue is not seeing my keyboard. Hopefully that’s all I will need as the price is rather steep for the pro version.

[@brent4770]

That takes away from the immersion. Unless they can make it where your hands can click the buttons in the cockpit.

[@paulbellino5330]

Perfect

[@ErickNagy]

As long as it can run straight on OpenXR and does not require the heavy SteamVR as all other solution, it could be a good option. Although it is highly priced, too.

[@tedstriker4278]

Can it be used to operate the VR cockpit buttons with the hand? I only fly simple planes in vr cause it takes so long to hit them with mouse.

[@khaledassaf6356]

If this will allow adding custom made button boxes and controllers then it's a no brainer for me once it's out.

[@karmabasedj8184]

Why ALVR? No one uses that! I hope this works with Virtual Desktop

[@chrisgard4076]

i refuse to have anything to do with Steam

[@vegeta19940]

what headset your recommend for VR ?

[@jules611]

Fantastic !

[@chrisgard4076]

let me know please when it will be available

[@gianlucacoloretti931]

did you try, with the Quest 3, the sw "REALITY MIXER" that allow to mask your full cockpit area, this should be the real VR solution. There is an interesting video from Russ Barlow about it, but he used the Q2 so the cockpit area has poor quality and black and white, not color thanks regards

[@SimHangerFS]

Not tested yet

[@Shamdouh1]

It breaks the immersion

[@StekuVideo]

How the hands are tracked? Will it work only with Quest and its native handtracking feature?

[@SimHangerFS]

Will work if your headset has hand tracking capabilities. So something like Pimax Crystal and Pico 4 would work for example

[@rembratt]

You lost me at "Steam VR"

[@Falckodotcom]

Looks very cool! Looking forward to try it out. It would be very nice if you can switch it on and off in flight.

[@waltertrees2412]

I want it now!🤤

[@TheStlgg]

Take my money 😃

[@acratone8300]

Geiko Gekko: I HAVE a stolen flap lever !!!!

[@SimHangerFS]

😂

[@cbrider726]

Hi i am looking for bit of help . I own a Honeycomb Yoke and just wandered if i could use the Thrustmaster throttle quadrant with it. I simply cant afford to buy the Honeycomb Quadrant . Also what make and model of hub could i use to connect everything to the PC . I am going to buy the Thrustmaster pedals. Many thanks .

[@SimHangerFS]

PC or Xbox?

[@cbrider726]

PC Thanks @@SimHangerFS

[@artinsidethebus]

Very cool!

[@sveng9933]

Question because it's not entirely clear for me. Could I build a let's wooden mockup of a cockpit and then use my hands to manipulate buttons and rotarys in my virtual cockpit in the Sim?

[@JB-fh1bb]

Not unless your wooden mockup has functional controls that can be mapped to the flight controls regardless of the VR headset. As far as I’m aware, no one is working on tracking non-functional controls in to VR

[@sveng9933]

@@JB-fh1bb Thanks for the answer. That's sad because that's what I'm hoping for. But technically it couldn't be so far away, I can use the controller to turn rotarys or push buttons, and they do nothing else than track and tell the pc where my hands are. Am I missing something 🤔

[@JB-fh1bb]

@@sveng9933 I empathize. It’s especially hard because it’s something that could be done with current tech and much easier with headsets that have the depth sensor. Someone could make software that: sees the wooden mockup, recognizes the things that look like buttons and knobs, tracks hand position as it touches the wood, and gives that back to the VR app as “actual” knob/button interactions. It’s possible it’s just that no one is currently working on it. If you can gather a team feel free to reach out.

[@SimHangerFS]

Not with this software, but Yaw have done this with their Cessna cockpit - Yaw Aviation - check out their site for details. Not an everyday solution for home simmers at the moment.

[@KarelKist]

@@SimHangerFS But it is the road certain cockpit builders will love to go. In fact, one should see it's own (hardware) cockpit and be able to flip switches, turn dials, tune radios, etc. The only thing they need is the outside view from the top of the glare shield. I'd like to have e.g. a 'blue/green screen' in front of me that gives me (in VR) that view. Would save me 3 large TV's or projectors and a big curved projection screen. 😁

[@johnreveley3798]

Thanks Mark, great video. Can't wait for the full review!! I am a little confused about the hand tracking. I assume you would need a VR headset that can track hands. The Quest 2 (hopefully Quest 3 soon) can do that, but I am unable to see my hands in the Sim. Would this App still allow me to do that in MSFS 2020 with the Quest 2?

[@SimHangerFS]

I believe so.

[@renfar3518]

is this software free of charge?

[@Steztheskinhead]

The basic version is yes. The full version will cost $50

[@regwatson2017]

I thought Quest 3's advances in Mixed Reality would make a product like this unnecessary. You should be able to see the real-world or part thereof - or have we been misled ?

[@SimHangerFS]

Time will tell.

[@EmesiS]

Interesting, but only with Steam VR? I never use Steam VR with any of my sims unless I have to.

[@chrisgard4076]

i hope it works with LeapMotion

[@SimHangerFS]

I can’t see why not. Interesting question.

[@chrisgard4076]

will it be interactive (ie sitches and levers etc ?@@SimHangerFS

[@lucaslehmann794]

Danke!

[@SimHangerFS]

Thanks for supporting the channel. Much appreciated! 👍

[@p1pem]

I think it would be good if, as it can sense hands, could use the same to identify and set positions of peripherals automatically, without the need for the manual drag/stretch activity. Or perhaps could implement some sort of small sticker(s) that could be put on the accessory maybe in a pre-determined location, to help automatically locate and set the position of the items?

[@jeanfrossard]

Amazing...hug from Brazil

[@currololo]

Will it work with not Steam versions of MSFS and DCS?

[@SimHangerFS]

Yes, my MSFS is store version, but needs SteamVR as runtime as well as ALVR.