COCKPIT INTERACTION | ESSENTIAL VR Part 4 | Different ways to interact in your 3D environment

There are many different ways to interact with your cockpit in Virtual Reality! In this video we take a look at the more common ways, as well as a few that are growing in popularity as technology advances. We look at mouse and VR controller to voice and bespoke cockpits, through to hand tracking and more.
REFERENCED LINKS
VR Essentials playlist: • ESSENTIAL VR
VR Wave store: www.vr-wave.store/
Stream Deck: www.elgato.com/
Voice Attack: voiceattack.com/
HCS Voicepacks: www.hcsvoicepacks.com/
Pieintheskytours video: • MSFS | FLY WITH YOUR V...
FS2Crew: fs2crew.com/
Yaw2: www.yawvr.com/
Authentikit: authentikit.org/
Video - Cockpit for VR Pilots: • COCKPIT FOR VR PILOTS ...
UltraLeap: www.ultraleap.com/
Simhanger video LeapMotion: • Leap Motion for VR Pil...
OpenXR Toolkit: mbucchia.github.io/OpenXR-Too...
TIME STAMPS
00:00 Introduction
02:18 VRWAVE discount
02:55 Basic Set Up
03:29 Essential VR Config
05:05 Peripherals
05:32 Mouse
06:07 VR Controllers
08:13 Passthrough Mode
09:05 Stream Deck
10:26 Voice
14:06 Bespoke Cockpit
15:44 Hand Tracking
SIMHANGER KZbin Channel Link: / simhangerflightsimulation
Join Simhanger on Discord: YOUR DISCORD INVITE: / discord
For more details visit Simhanger Website: www.simhanger.com
Connect with me on Facebook, Instagram and Twitter: @Simhanger1
✈ Would you like to support the Simhanger Channel? You can donate here: www.paypal.com/paypalme/simha...
You could also buy me a coffee here : www.buymeacoffee.com/SIMHANGER
Looking for help with MSFS, then check out my HOW TO GUIDES, link to playlist here: • MSFS HOW TO GUIDE
MSFS on Xbox playlist can be found here: • MSFS on XBOX
Everything you wanted to know about VR - Playlist here: • ESSENTIAL VR
Thanks for watching
#xbox #microsoftflightsimulator #virtualreality #msfs #vr #cloudgaming

[@SimHangerFS]

In this video we look at different ways to interact with your environment in virtual reality. Do you have a favorite I've missed out? Please comment below. 5% discount on VR Wave lenses now available. See video for details! You can see all the videos in this VR series here kzbin.info/aero/PLSyT1Loyov5iNmElUYTthr7oh_FCpDVpU

[@sascenturion]

Very interesting stuff Mark 😊 Thanks yet again for a well produced and informative video.. I would certainly like to see more on the " Hand tracking" front 👍

[@jopa_ryds]

Really useful, thanks so much for this entire series but this one about the setup and hotkeys will be very useful for me and my Reverb.

[@GrundleStiltSkin]

Some items other VR users might want to checkout. Logitech Farm Simulator heavy equipment side panel, it is awesome for flight sims, space sims, driving sims --as a button panel, 2 different joystick axis via a button, and scroll wheel...... Kensington expert trackball mouse--it has a flat bottom where you can add some velcro---attaching the mouse to a table joystick mount, you have a good vr mouse that wont move, has 4 buttons and scroll.... works great.

[@Huddison]

Great series of videos Mark - very useful for now and moving forward 👍

[@musoseven8218]

As always, a thorough and interesting video/review and insights, thank you👍😊

[@ellonysman]

Graphic trick into the cockpit, E P I C !!

[@citizenguod]

Terrific information. Thank you, Mark.

[@GG_Booboo]

Fantastic series!!!😃

[@tangotango256]

COOOOL!!! You're sitting in the vr cockpit !!! Lol

[@roberthunter7060]

I really appreciate this video and your Is VR For You video.

[@zenair250]

Once again a very interesting and informative video.

[@johnvulcan212]

Very informative, thanks Mark, especially the sections on voice control and hand tracking. I also have an old Leap Motion controller sat in a box and will be very interested in following along with any progress you make. PS: Just watched the video "Leap Motion for VR Pilots" you mentioned in this video, a real eye opener! I now have a much more realistic expectation of what it will be like to use hand tracking in MSFS 2020. Your excellent round up of the different ways of interacting with the sim makes it very clear that each approach comes with its good points and bad points, for instance with hand tracking you really need to know where each switch is in each of the aircraft types you fly, which for some of us simmers could be many different types. While with voice control, you can just say the same phrase in each of the aircraft types and the bindings take care of the rest, which is a whole lot easier on the memory cells. Much to think about.

[@4secsharkmr352]

Excellent video Mark 👍 Thank you very much. Take care buddy

[@SimHangerFS]

Thank you 🙏

[@andrewsolo2561]

Great video. 5 years with VR cv1 now q2.

[@antoniocalheirosneves]

Thank you.

[@marekrybarczyk4912]

Very useful, thx!

[@ianyeates9872]

Great set of videos covering VR. I am still on the fence regarding VR, I have never tried it but the amount of secondhand VR units for sale with little use makes me wonder if it is for me. I have currently spent a small fortune on upgrades and addons, Airbus throttle and sidestick set and StreamDeck.Your videos have had great value in explaining an area I have known little of. Thank you so much for your insight, I will borrow a mates PS4 headset and try that first, if I like that I will look at VR for MSFS. Back to sorting out Lorby's AAO after a new update, difficult program to get my head around. Cheers Mark, look forward to your next video.

[@after_midnight9592]

I have the camera change and show toolbar mapped to a side mouse buttons. You're anyway gonna click and spin the camera with mouse, so just have it there.

[@VRFLYBOB]

Great video. Am also looking forward to seeing if hand tracking will work effectively. I struggle with immersion using a mouse. Have just ordered a Kensington wireless trackball with scroll wheel. See how that goes.

[@rogerferraro6661]

I'd be interested in following along with hand tracking. I have a Leap collecting dust in a drawer somewhere that would like to see the light of day. Great series, I'm still using a Quest 1 for VR while saving my pennies for an HP G2

[@sascenturion]

As an "add-on" (pun intended) ..to my earlier comment ,i followed the various links you posted with your video . One in particular was the "voice attack" software which led me to their website and a follow-on utube link to a utuber called "Obsidian Ant" who demonstrated the voice attack software in a video about controlling the ships on board computer in Elite Dangerous and using the Star Trek Captain actor William Shatner' s voice ..it was Awesome! Voice attack seemed to integrate itself flawlessly and Shatner's voice took me back to my youth as an avid star trek fan. (Admittedly Obsidian Ant' s video is rather old but it's the first time I've heard of voice integration thanks to you mark)

[@himmelhorse]

Mark, Count me in as far as hand tracking is concerned. For me, being able to manipulate switches, rockers and knobs etc, would really complete my VR experience. Given the level of VR support (including Controllers) currently in MSFS I am wondering if any of this is going to be worthwhile for me due to my age. I live in hope though and look forward to many more of your very useful videos. Best regards Tony

[@samj11791]

So hard to find videos on this! Thanks for doing it is there any chance you’ll do an updated video? Thanks again!

[@babithefriendlyghost]

Great video once again! And I’m very very interested in a step by step tutorial about hand tracking with leap motion sensor please. I have one and couldn’t figure out how to get it to work with msfs2020 openxr toolkit.

[@FlightSims]

Hey Mark! I’d be interested in following with your hand tracking. I’ve got a Leap too sitting while collecting dust. If the tech is better, then by all means, let’s rock! Also, I was one of the first backers of Yaw and my Yaw2 pro model was just ok’d for manufacturing after a six month delay for several reasons, albeit totally acceptable ones. Hopefully I’ll have it by months end. Sure enough, voice command would be perfect for the setup I have. So, let me know when you start the hand tracking project. Cheers! And thanks for your work and insights! Between you and Chris, I see a happy marriage some day soon 😉

[@martygenska8117]

Also looking forward to hand-tracking solutions.

[@felcas]

I don't have access to latest technology but I had an idea I never saw in videos. Ability to setup a switch or button to zoom in directly to certain areas of the cockpit, for example zoom in directly over the garmin unit or autopilot unit, CRT or damage warning panel. It would be also easier to the use hands to contact virtual buttons or switches on this zoom .

[@dungthuanthien]

great video sir, in the meantime i can use VR controller and mouse while waiting the toy from thrustmaster

[@jameslee-pevenhull5087]

It all started with the Saitek yoke having a dreadful dead spot in both Roll and Pitch. I sent for a Leo Bodnar A/D converter board and put it inside the Yoke body. There are eight A/D converters on the Bodnar board, so I built the Throttle and Mixture module for the Cessna 172. Then the flaps paddle. I used linear Variable Potentiometers with the same resistance range as the Saitek quadrant. With a plank of timber, I placed the new controls in just the right place in relation to the yoke. 'Muscle memory' is a big part of flying in VR. Hands go straight to the plungers now. I have a small table like Mark's for the mouse. Thanks for this vid mark.

[@KawaCon]

Would a trackball mouse work well in this application? I think I saw Russ Barlow using one.

[@grzegorztomasiak]

this man is unbelievable, you put so much into the sim world that is truly amazing!! very nice and professional tutorials!

[@SimHangerFS]

Thank you 🙏

[@calumw8409]

I agree. Initially setting up my controllers for FS2020 was much easier with his videos. A few days ago I wanted to start learning helicopters and his video was clear, concise and understandable for setting up helicopter controls.It's great we have helpful people in the flight sim community.

[@Recon777x]

I have a VKB Gladiator NXT joystick with a ton of buttons on it. But I don't have a HOTAS throttle. Only the little flap throttle connected to the base of the stick. Using the Reverb G2, I guess the way to control everything else in the cockpit would be with the mouse? I haven't got MSFS yet but I've been seriously thinking about it. Undecided on which version to get. But I was mostly concerned with how to control cockpit switches while in VR and whether the throttle would be awkward as I don't want to have to reach over to the stick with my left hand to adjust the throttle while flying. One thing I do have is a racing wheel with very nice clutch, brake, and accelerator pedals at my feet. I wonder if I could map some controls to those pedals, like perhaps rudder.

[@tomgoehle4162]

I would be interested in your adventure into hand tracking!

[@spediegunz]

Is there an add on that can read out loud what a button press does on short press and on long press actually perform the action? This way when in vr if I’m feeling around for my button that raises the gear I don’t accidentally shut off the engine lol

[@JakeMakesProductions]

What would be recommended peripherals for someone interested in pursuing a private pilots license. VR vs non-VR, yokes etc

[@stemadden2404]

Ive had a leap motion for a few years but hardly used. extra wires added to the vr headset and keeping iton the front of the headset put me off it. like to see how much better it can be used

[@CLANCY84]

How do I remove the Hmd dot that when you look at things activates all my instruments it come up with a dot in vr

[@captainwealthy]

Have you done any research/videos on recording/live-streaming on the main screen, WITHOUT the 'binocular vision' whilst using VR?

[@weircottage]

VR a compelling reason for ditching XBox! Always brilliant videos. Thanks…

[@motansky4366]

Hello, i want to buy a VR headset with a phone because i dont got a lot of money and i need controllers, how can i use leap motion to move in games or using buttons like on vive controllers?

[@ProAbe81]

I do the same on my pico4, but I just can’t switch to vr mode (ctrl+tab) stays in virtual room with msfs in VD:((

[@dano293]

great video Im just starting VR in MSFS still waiting on my Headset to come HP REBERB G2 R2. Would luv to see how you fly the PMDG737 in MSFS. and the best way to g about cockpit interaction.

[@SimHangerFS]

Check out my latest video….testing the 737 in VR 😀. kzbin.info/www/bejne/imKqp6CMrMiqaMk

[@martygenska8117]

Thanks again for another informative video Marc; you have become my favorite MSFS/VR/HP Reverb resource. I'm a little too late for your VR Wave discount as I ordered mine right after I saw your earlier video :) On that note, have you had any issues with your HP Reverb pinching when wearing glasses? Anyway, I'll look into changing some of those VR commands to something other than the keyboard; I really don't like lifting up the headset to hit the CTRL-TAB key. I also noticed that when wearing my headset, I seem to be sitting low in the cockpit. Is there a setting I've missed?

[@SimHangerFS]

The default position in VR is preset. You can adjust using the arrow keys

[@VRFLYBOB]

Or Bob down a little as you enter VR😊

[@sarathab]

Hi Mark, Your videos have been invaluable for me - just starting VR. One of my problems is that I need glasses (distance, 2m, reading). Help I need is to understand whether I can wear glasses and use VR, and if so which glass would be most suitable. I have tried all three, but my vision is still not quite sharp. Understand that you may be able to get some special glasses as you mention but that may be beyond me for now.

[@SimHangerFS]

Recommend prescription lenses. See this playlist…there are two videos dealing with glasses and prescription lenses, plus where to get them.

[@sarathab]

Thanks

[@rfarley565656]

I'd be extremely interested in hand tracking. I may go ahead and start researching myself....Great video's..

[@SimHangerFS]

Keep me posted on your progress 👍

[@after_midnight9592]

It's exactly how he said. In DCS it's perfect to control the "phone dial" panels right in front on the pilot (ICP in F-16, I don't know what's that called in the hornet). But that's it. MFDs are still managable, but nothing on the side panels. The problem is, because the hands are not limited to front only, you may inadvertly push some button on the side panel with it, for example stores jettison, which is right behind the full throttle in the F-16. I don't know if it's possible to limit the field of view on LEAP, that would solve it. To detect your hands only in the center, to control the front console, but not on the sides.

[@SimHangerFS]

@@after_midnight9592 there is no limit in terms of range span as far as I am aware.

[@MadsGranumMusic]

Thanks for great content, Marc. I have a question you maybe can answer…. I have trouble reading some of the instrumentation (eg autopilot) in the payware Kodiak, I want to use for online Pilotedge flying. I wonder if it is a Common problem in VR or I can change a setting. My system is G2, I9 10900k, 3080

[@SimHangerFS]

It is a common issue. Check your IPD is set correctly and this may also help kzbin.info/www/bejne/epLdoZp8hLp4gpI

[@get_outdoors]

I have the Capt. Williams voice pack and it’s excellent, I’ve also mapped other custom commands to run in parallel. I’m just missing a Kneeboard / chart/ document viewer app for VR, I’m aware of 3 on the market but cannot decided which is the best investment.

[@SimHangerFS]

I can recommend fskneeboard and sim efb.

[@rv8-m948]

ditto the trackball mouse!

[@Verbal_DEU]

Hey thx for the nice video! How can I capture my video seeing me sitting in cockpit of fs2020! Like you at begin of this video. Thx!

[@SimHangerFS]

It was edited in Davinci Resolve…not in MSFS.

[@NylonStrings46]

Hi.... Can you move the gauges Overlays around in the open screen in MSFS2020???? If so how....

[@SimHangerFS]

No, but you can pop out some windows…how to is covered in this video kzbin.info/www/bejne/iKa9XpKngKmVfbs

[@MrCraptakular]

Is it possible to change the order of the videos in this playlist? It currently goes 4>3>2>1 but should be ordered 1>2>3>4

[@SimHangerFS]

The order will be changed once the series is completed 👍

[@Jazzzon777]

So you wouldn't reccomend using the VR controllers to fly? I have a stick and throttle but i never use it because i am too lazy to stick it on my desk. also hard to travel with.

[@pastuh]

controllers very sensitive I hope new mfs will solve such issue. Mouse is much simpler.. Stick&Throttle also solves multiple issues.

[@pilotpawanc]

Loved the video. I have RTX 3060 and 3600X. Will oculus 2 be the right choice or you recon that it's l it won't work.

[@SimHangerFS]

It will run, but settings will be low to medium. Consider a CPU upgrade perhaps?

[@pilotpawanc]

@@SimHangerFSThanks. As of now thinking of purchasing the VR headset only as it will be an investment for me. In Asia the cost is higher than that in USA as its imported. It will set me behind by atleast an additional $120 vis-a-vis the price in USA.

[@flyhalf2]

One problem some of us have when using the mouse to interact is a double cursor. i.e the left and right cursor images do not align. This is most pronounced when zoomed in to an instrument view and only happened since SU8.

[@SimHangerFS]

I haven’t experienced this, I’ll check again.

[@flyhalf2]

@@SimHangerFS There was a hot fix in Early March Mark which fixed it for some. Then someone in the forum found that turning off the "Home cockpit" option corrected the problem, That fixed it for me for a few days but then it returned. What I don't understand is why it returned despite, AFAIK, nothing changed in the sim or windows. I'm not sure if it only affects those using WMR headsets

[@Jgjkolbn]

Hello Mr Mark ,need to know if I need to install google map instead ,how could I install it pz if it’s better the ping map ,thank you

[@SimHangerFS]

Hello, you can find information on flightsim.to website. I personally don’t recommend it, due to update issues.

[@concerned-cyclist]

Hello Mark, great video as always, I however wonder if you'd mind helping me out. at 6:20 you demonstrate rotating knobs with the VR controller, I am able to do this in X-Plane but do date I haven't been able to find the correct set up to achieve this. If possible could you send me your set up for your VR controllers. Regards Mark

[@SimHangerFS]

In Xplane, use the legacy config if I remember correctly. Point to the switch or dial, hold the trigger down and slowly rotate the controller in the direction you want to turn the dial.

[@concerned-cyclist]

@@SimHangerFS Sorry Mark, It's not X-plane I need the advice on, it's MSFS2020, it's your VR controller settings/key bindings that I'm after, that allow you to rotate knobs.

[@alexw8021]

Hello Mark. Would you recommend a VR set up (hardware and software) that allows me interact with a B777-300ER cockpit? I prioritize the cockpit and FMC interaction because I need to use it regularly for self-enhancement at work. It’s my first time knowing about VR and flight sim.

[@SimHangerFS]

What flight simulator?

[@alexw8021]

@@SimHangerFS I heard about Microsoft flight sim, aerofly, and prepar3d.

[@clementstals1574]

Once again a wonderful video. Flying in VR is fantastic. But how do you do that during online flights with IVAO. I have not found a solution or method for this anywhere.

[@SimHangerFS]

We need to be able to import a third party window we can interact with.

[@clementstals1574]

Mark, thanks for the quick response. A separate window in VR is indeed the solution. But how?

[@SimHangerFS]

@@clementstals1574 this function is not currently supported natively in MSFS. Hopefully it will be added soon.

[@drumbri]

The mouse cursor in VR does not line up with my “dominant eye” (right) I have to close my right eye in vr in order for my cursor to hover over a switch and have it be highlighted.

[@SimHangerFS]

This can happen, check your IPD to reduced the impact of this…sounds like it needs adjusting.

[@Hani_Santa]

I hope that developer from pointctrl for DCS can also make it work for MSFS. The best would be handtracking but we are not there yet, hopefull soon with the Openxr toolkit. For now I prefer mouse control.

[@SimHangerFS]

Me too

[@shaib.7626]

I would like to use the G2 has a training tool and project the flying into my desktop screen in real time so I can see what is my student doing , any suggestions how to do it and without killing my RTX 3080?

[@SimHangerFS]

Use the WMR window. Setting under vr in windows for headset need to be best quality for option to show. On WMR Home Screen click pause/play button on bottom of display.

[@shaib.7626]

@@SimHangerFS is it going to be a recording or a real time projection so I can monitor my student?

[@SimHangerFS]

@@shaib.7626 realtime

[@jean-michelnadeau2833]

Hello. Have you figured out how to brake with just the controllers?

[@SimHangerFS]

Default is X

[@teletesch3627]

It is so frustrating that FBW or Fenix have not managed to synchronize the thrust lever to this day. With VR controller it is not possible to operate the thrust lever reasonably. You can only operate one lever of the two at a time. This makes a flight impossible

[@neverclevernorwitty7821]

I really like the idea of VR flying, but I think I prefer to fly online with VatSim or PilotEdge. I can imagine a big mess when a controller gives me a complicated instruction that I would usually write down on a kneeboard, kinda hard while in VR. Anybody find a smooth way to do this? I imagine Voice interaction of some kind is the only way to mitigate.

[@gp1003]

Is it possible to hold a switch in VR (using mouse) while looking away? On the Saab, the start switch is spring loaded so I have to keep holding it while looking at the instruments during startup. The problem is that as soon as I look away, I loose the start switch as my mouse cursor automatically goes back into my field of view. How to keep holding the switch while looking at other things?

[@SimHangerFS]

You are better off assigning it to a button.

[@gp1003]

Looks like it. Thanks

[@hcsvoicepacks]

there's always voice control ;)

[@SimHangerFS]

Great products. Amazing realism. 👍

[@hansholland5300]

What Brand of VR are you using?

[@SimHangerFS]

HP Reverb G2 (WMR).

[@code_man69]

can some one tell me why my left controller won't turn on during flight simulator

[@SimHangerFS]

Re-run set up and pair it again.

[@minitobo928]

I use VR in flightsim since 5 years and a few weeks ago i decided to give the MSFS a try. But i was disappointed. I am one of these who only want to use the controllers, no mouse, no other additional hardware and this laserpointer-interaction in the cockpit kills the immersion completely for me. That's far more important than better graphics. I hope they improve this to the standard of other flight sims. Until then MSFS is nothing more than a waste of mor then 100 euros. That's a pity.

[@DerekSpeareDSD]

only a proper button controller can be intuitively used in VR.

[@phoenixrising011]

Left handed trackball mouse mounted to the right side of your throttle. Pretty damn good.

[@joelpetersen2480]

I can land a 737 with a PS5 controller.