Head Tracking With A Webcam For FREE! Part 2 Refine Our Settings

Following on from the previous video, we are going to tweak and refine our "base line" settings to try and improve the free headtracking experience...
Useful Links -
Part 1 Video - • Head Tracking With A W...
OpenTrack -github.com/opentrack/opentrack
AITrack - github.com/AIRLegend/aitrack/...
Time Stamps -
0:00 - Intro
0:34 - Tweak AITrack
1:50 - Tweaking OpenTrack
2:48 - OpenTrack Mapping Tweaks
5:25 - Into DCS To Test
6:21 - Tweaking Some More
7:08 - Outro

[@Honosuseri]

Useful Links - Part 1 Video - kzbin.info/www/bejne/g3jSg6GjjaqLj7M OpenTrack -github.com/opentrack/opentrack AITrack - github.com/AIRLegend/aitrack/... Time Stamps - 0:00 - Intro 0:34 - Tweak AITrack 1:50 - Tweaking OpenTrack 2:48 - OpenTrack Mapping Tweaks 5:25 - Into DCS To Test 6:21 - Tweaking Some More 7:08 - Outro **EDIT** Those of you having trouble with it in DCS... Go to settings then Controls. Look for the TrackIR column (you might need to move over to the right depending on how many peripherals you have) there's a small down arrow in the tab, click it and make sure it's NOT disabled! Worked automatically for me but it seems some of you are having issues.

[@Faded-420]

I’m using the original Xbox Kinect for a webcam and it’s working great! Thank you so much for taking your time out of your day to make this video! I was lost until I found this! Literally copied your settings minus resolution, if I drop the camera resolution below 1900x1080 it crashed and my zoom isn’t as smooth as your but overall super happy about these results!

[@VimyScout]

Not got round to trying this out yet, had to order a camera from Amazon. Threw my old one out a while ago. Knew i should have hung on to it 😊. Anyway, much appreciated and thanks for sharing part 2 also👍

[@youssefidbella5979]

these sittings are priceless dude!! thanks so much!!

[@Crowbarski]

Thank you for these vids . Absolutely saved me.

[@tinaboy99]

Great vids thanks. Hard to set up with telephone so tried the camera, and with your help it works well.

[@joedoolan7115]

Wow thats crazyyy

[@voidcomm14]

Im having a bit of trouble with the diagonal movement when cornering... the combination of the two movements is tricky.

[@Dazza_Doo]

Much better! If you was going to buy TrackIR why not Tobii ? is there some differences ? Cheers

[@Honosuseri]

I've heard that TrackIR is a better experience than Tobii, I can't comment personally. Each to their own and tweaking is going to be involved with any method chosen. The point of these videos was to show a free software solution. I prefer to fly in VR, headtracking with the webcam is useful to me when I want to learn an aircraft and still easily reference written materials or videos. There is also "aruco" where a printed image mounted to a hat/cap is tracked via the webcam, again a free software solution built in to Opentrack. It might be a little more precise than "AITrack" or "Neural Net Tracker".

[@terrysharpe23]

Great video, question? How do I get the software to be open while I’m in DCS sitting in the cockpit so I can make the final tweets? Thanks in advance

[@Honosuseri]

I don't have DCS set to "fullscreen" in the settings, so it stays up in the back ground when I Alt + Tab with the keyboard to switch between programs. Use the DCS active pause shortcut, so you can test the headtracking and flick switches in the cockpit without having to worry about flying or the aircraft crashing.

[@ErnestIsGaming]

Hey man what kind of webcam are you using? Do you think the frames of the webcam is essential for smoother tracking? Is 30fps not enough for competitive dogfighting?

[@gaster4565]

i just want to use it as a mouse input how can i do that?

[@justaperson1619]

Hey man, I yuck question. How do you actually connect the both programs to DCS and how do you bind the head movement? Do you do it in the DCS settings?

[@Honosuseri]

Go to settings then Controls. Look for the TrackIR column (you might need to move over to the right), there's a small down arrow in the tab. Click it and make sure it's NOT disabled! DCS had it configured for me automatically, I have no idea why other people are having issues with it. Unfortunately I can't cover every game & sim and how it implements headtracking

[@shelder1368]

i can´t open it says i have to download something from microsoft store

[@ataleofgames5555]

Everything is so jittery for me. No use what to do

[@Ultimatevr123]

It works OK, but struggles turning to the side and looking up

[@domant6481]

Hi, Thanks for the video ! Could you please tell me how to have the hud information when you turn the head on right and left side ? Thks

[@Honosuseri]

That's the JHMCS (Joint Helmet-Mounted Cueing System), some aircraft have this feature like the A-10 & F-18. You can read Chuck's Guides to get a better understanding of the modules you own in DCS. chucksguides.com/

[@domant6481]

@@Honosuseri Many thanks ! Chuck’s guide is really helpful ! Great job

[@Back2TheBike]

I've just followed your superb instructions to install on XPlane 12, thanks It works, but the image shakes and trembles badly. I have decent lighting and am using a decent spec Logitech webcam. Any thoughts?

[@Honosuseri]

I don't use Xplane so can't test if it's an issue with that sim. You can watch my part 2 video where I tweaked things further, the changes in AI Track might help you. You can also use "neuralnet tracker" in Opentrack rather than UDP from AI Track, to rule out an issue with the version of AI Track you are using. All the best with it.

[@Back2TheBike]

@@Honosuseri thanks for your advice. I've already watched part 2, no difference but Ill check out that alternative setting. As a Pro trainer myself I compliment you on your teaching style!

[@Honosuseri]

Thank you! I've heard people with facial hair have issues. Maybe look into "Aruco" instead, you print an image and attach it to any head wear like a baseball cap. As it tracks the image rather than facial features you might find it more accurate, never tried it myself but it's still a cheap option for headtracking.

[@Honosuseri]

P.S Just noticed you are commenting on the Part 2 video, it's usually part 1 I get the comments on. Can tell I've had a heavy weekend ;)

[@programmingboss2382]

Thanks for that but I have issue when I try it with msfs my mouse doesn’t work I can’t click things in cockpit. Is that normal or it’s just a set up ?

[@Honosuseri]

That doesn't sound normal no. Alas I don't have MSFS to test it. You'll have to Google it

[@Daniel-CMelinte]

Hello,quick question,can you just upload the ini file with the settings that you use ?

[@Honosuseri]

I could BUT I won't, for the same reason people don't share their TrackIR profiles. People will complain it doesn't work for them, which should be obvious as the profile is made for me and my peripherals not theirs.

[@hackxy1165]

So everything works good for me except the "zoom" portion. when I'm sitting normally at my desk it puts me really far up in the cock pit and i cant see anything and i gotta lean back a lot. Ive tried moving my distance in AITrack it didn't work. Only fix i can find is just sitting a good half foot farther back. Any ideas on what to do? And one last thing i think its because of how high up my webcam is but looking straight on is making me look up a a little bit and its fine for a minute but anything longer my neck aches. Any ideas on a fix for that one aswell. Sorry for such a long reply.

[@Honosuseri]

Instead of using AITrack, try enabling "Neural Net Tracker" under the inputs in Opentrack. You might need to do some tweaks and invert an axis or two.

[@hackxy1165]

@@Honosuseri so everything works the same as AI track but this time my zoom keeps zooming in and out. It will zoom all the way out and then start at the begging and zoom all the way out again. It moves it itself even tho I'm sitting still

[@Honosuseri]

Disable the Z axis then under options and output in Opentrack. That will stop the zoom

[@hackxy1165]

@@Honosuseri eyah i already did. I was just wodnering if there is a fix, guess not

[@Honosuseri]

It's hard for me to say. My webcam is mounted "high", on top of my 32inch monitor and works fine. Does your webcam have software for adjusting focus etc? Neural Net Tracker should show options for tweaking the webcam if it can. Maybe try doing "Aruco" with Opentrack as I've suggested to other people in the comments. That uses an image you print and mount to a hat/cap to track. It should be more accurate.

[@mr.danload]

Nice video! I have a problem though: when I nod my head down opentrack sees that as closing and turns 90 degrees right. Idk what's the problem

[@mr.danload]

I literally cant nod head down without moving forward and up to max

[@Honosuseri]

Hard to say. Try relocating the Webcam so it's looking at you from a different angle. Sounds like it's having trouble recognising your face when you are looking down.

[@derekvanheumen5581]

It works fine except when I look up. Idk why but I can’t look up, when I do it just gets close to the hud or it looks backwards. What do I do?

[@Honosuseri]

Try "neutral net tracker" as an input in Open track, instead of using AI track. See if that behaves better, note you may need to invert the vertical axis when you switch. If you can't get it to play ball then try "Aruco", which tracks an image you can print and fix to a hat/cap etc. rather than tracking your face. github.com/opentrack/opentrack/wiki/Aruco-tracker All the best with it.

[@derekvanheumen5581]

@@Honosuseri thanks, where can i find that input

[@Honosuseri]

I show how to select the opentrack input in the part 1 video dude.

[@derekvanheumen5581]

@@Honosuseri o then I missed it sorry

[@rowanchavarin7234]

there's a little bit of a delay on mine

[@CaptHalcyon]

It’s probably because of the deadzone. I removed mine. If you have a steady head it’s fine and actually better

[@jimmyjameswright2236]

how do i get it to work in dcs. i have it all done but nothing happens in dcs

[@Honosuseri]

I've already answered this in other comments, I have now edited the pinned comment to include it. Sadly I can't cover every game/sim and how they implement head tracking

[@torides.]

do you use this system? or do you use trackir

[@Honosuseri]

I mainly use VR. I do use this when learning new aircraft. Works well enough once you tweak the settings. No need for me to payout for trackir

[@franciscoheyde7934]

practically set everything the same, but it's very rough I can't look at a fixed point because it moves constantly even if I keep my head still and I don't know how to fix it Can somebody help me?

[@quentinfourie4301]

Set bigger dead zones, I just had to fix mine as well and set it to the Heavy model type, hope that helps

[@franciscoheyde7934]

@@quentinfourie4301 could you upload your configuration pls?

[@paulg2234]

if you notice when you turn your head set your head turn the go to pich turn your head again im sure your caching pich as you turn your head

[@conran9451]

Nothings happens when I go to DCS. How do you attach it to DCS?

[@Honosuseri]

I've already answered this in other comments, I have now edited the pinned comment to include it. Sadly I can't cover every game/sim and how they implement head tracking

[@conran9451]

@@Honosuseri Thank you for your easy to follow steps.

[@most_sane_piano_enthusiast]

Doesn't seem to work in War Thunder

[@Honosuseri]

Never played it personally. Quick KZbin search shows people using Opentrack with it so it does work

[@gloup81]

so it seems my eyeglasses and beard give AItrack a hard time :/

[@Honosuseri]

Shame. Look into "aruco" instead. You wear a printed image on a hat and that's tracked instead. Still a cheap a viable option

[@olegknowsbest4971]

As great is I think this is, I have one problem: When I fly in IL-2 BoS and I put the autopilot on, everything works as it should be. When I take the autopilot off, head movement becomes really limited. All of a sudden the screen doesn't pan to the left, right, up and down anymore. Does anybody know a solution?

[@Honosuseri]

Never used it for IL2 as it had great performance in VR. I've uninstalled the game now so can't test it easily