Quest 2 Finger Tracking

VRChat Patch 2022.4.1, we've added a new experimental feature -- finger tracking for the Quest 2 and Quest Pro!
This isn't just the ability to use your real hands via the Quest's powerful finger tracking -- it also means you don't have to use your controllers at all in VRChat. You can move around, jump, and use your menu, all with just your hands.
Notably, this hand tracking system only works on VRChat on Quest 2 or Quest Pro stand-alone, and does not work via Quest Link, Quest Airlink, Virtual Desktop, or other PC-connected solutions for now. This is due to platform and technical restrictions. We're looking into ways to get this same capability on PC VRChat.
Follow VRChat on Twitter: / vrchat

[@TheBobbu]

It would be great if this was supported when using the Quest 2 via link cable or Airlink. I tend to connect to my PC to get the advantages of better avatars, worlds, and all-round performance - so much so I barely have any Quest avatars any more. But I would definitely use this feature, and having to choose between the two is tricky. Totally understand it's probably a pain to implement, just raising it so you splendid folks at VRchat know it's a desired feature!

[@metroidmen]

Agreed. But sadly not possible because Meta doesn’t allow hand tracking information to pass through with link. It’s ridiculous.

[@zerocool6452]

Your only option would be Leap Motion it will be slightly more cumbersome and of course more expensive. But thats all we got for PCVR sadly.

[@shanroxalot5354]

@@metroidmen Maybe if Virtual Desktop can be updated to pass handtracking data

[@jakefever7193]

@@shanroxalot5354 nope atm they used oculus SDK maybe they can emulate the index once they move to openxr

[@Gianderzoon]

@@metroidmen unless someone completely jailbreaks quest 2

[@cobaltskyhunter2696]

Got really excited until I realized it's only for the Quest standalone version. Hope it comes to PCVR soon.

[@AlwaysOnline2001]

this

[@jbsilveradoo8788]

If only someone could develop a program to run in the background on pc that does hand tracking for any headset with tracking cameras.

[@spaceshark12385]

@@jbsilveradoo8788 and that would be?

[@wademyler9167]

There's no PCVR headset that supports hand tracking

[@tybost]

It's not going to happen for PCVR. Meta has been working on hand tracking for Quest 2 since the beginning and it only just recently came to the original quest (oculus). If there was any hope for hand tracking with PCVR it was with mods which are banned.

[@kirianvr]

That is cool af, if you manage to make it work for virtual desktop as well that would be such a great addition to the different ways you can play vrchat, probably not the best to play games that require you to hold props (such as weapons that you also have to aim) but for casual world exploring sessions I'd love to use only my hands. Not to mention the positive that this could have for sign language for people on quest standalone!

[@mjcox242]

This can't work with virtual desktop It will always emulate touch controllers Same with oculus link only accepting real oculus controllers.

[@kirianvr]

@@mjcox242 Not true at all, I've already been using the oculus hand tracking with virtual desktop, it just wasn't of much use because there was no way to emulate a joystick to move but otherwise it works perfectly!

[@VerniMain]

@@kirianvr Well, he is right tho, we all know you can "use" hand tracking with VD, but it's still emulating touch controllers and all the input still belongs to touch controllers.

[@jakefever7193]

@@VerniMain yeah vd uses the oculus SDK once they move to openxr which they're trying you might be able support index controller emulation

[@VerniMain]

@@jakefever7193 I hope for that! This feature looks awesome and having it on PCvr would be fantastic, no more index users bullying my touch controllers XD

[@Thawah]

This is so awesome!!! I hope to see it on PC soon

[@Schwinggggg]

Finger tracking is kinda magical! Really glad that Quest users will get to experience it.

[@ozlo_fox]

i don't usually use the quest version, but this is a nice feature none the less.

[@supasaynkat737]

How do you use it?

[@smoke......]

@@supasaynkat737 non quest duh

[@randomfurryidiot9568]

I would use this more often if quest hand tracking actually tracked better. This did still super cool though

[@freddyfazbear3397]

Finally, Something actually useful for the quest users with stick drift, At least they can still play while getting their controllers fixed/replaced

[@nickbensema3045]

it works pretty good although I can't get into the Expressions/Emoji/Options menu with this. Also beware; it only detects your hands when they're visible to the Quest's cameras, so you'll have to learn where the boundary is. But it does detect each finger's movement very precisely.

[@buxx4878]

But how do you enable it in VRCHAT and when disconnect my controller and show my hands it doesn’t work so do I have to enable something in the settings of the quest 2?

[@aesthetic_blssom9521]

@@buxx4878 it's only in the beta version for now !

[@bananaman6867]

@@aesthetic_blssom9521 how do u get into the beta version ?

[@buxx4878]

@Smokey Playz it is possible I tried it and it work

[@nickbensema3045]

If you can hand-track in your Quest home, you will be able to hand-track in VRChat Beta. You do have to activate hand tracking in Quest settings.

[@StevenSpectacle]

It'll definitely get me to try Quest version for a bit of time. Would love to see how quick you can get this on PC version though. Specifically through Virtual Desktop.

[@smoke......]

uh itll never happen so keep waiting

[@flameknight7]

More power to the quest users! Can wait to see pc version

[@turbone]

Then hope someone comes up with pcvr with installed camer

[@turbone]

Cameras

[@Kendall_Hook]

When I used this feature for the first time it was nothing short of magical. I felt a sense of Immersion I haven’t felt since I put on my first headset for the very first time. I got phantom touch from touching mirrors, walls, and my own avatar, I felt super immersed that my brain was confusing virtual reality from reality, this gives quest users a deeper sense of immersion than ever before, this is a truly revolutionary feature

[@zyonss]

how do you get it

[@Mikev8.8938]

Don't fall for this, this person couldn't open their menu...

[@The-Soothsayer]

Sign language 😍

[@lostdreamzx]

Haven’t tried it yet, but I bet it wouldn’t work out as well especially for fast signers Maybe I’m underestimating the Quest’s finger tracking capabilities, but we’ll see

[@DiamondDepthYT]

@@lostdreamzx Hand Tracking 2.0 might work pretty decently for sigh language. probably much better than controllers at least!

[@laoo]

@@lostdreamzxhand tracking just got a huge update, so if you tried it months ago and it wasn't that good i would try again now

[@Luca_Woulfe]

i was literally talking with some friends about finger tracking in vr chat last night! YES!

[@Mikev8.8938]

Aaaaannnnnndddd the menu gestures are bugged so NO menu... talk about THAT to your friends...

[@MynicknameisViolet]

!! This will definitely make VRchat more immersive

[@amaikarai5007]

"Notably, this hand tracking system only works on VRChat on Quest 2 or Quest Pro stand-alone, and does not work via Quest Link, Quest Airlink, Virtual Desktop, or other PC-connected solutions for now. This is due to platform and technical restrictions. We’re looking into ways to get this same capability on PC VRChat" Seeing that statement makes me hopeful that we'll get hand-tracking on Quest PCVR sometime in the future!

[@EggyBaconYT]

I got so hyped when I saw this coming into vrchat i always wanted it to have hand tracking but now it does thank you vrchat! ❤

[@ajbanimatedstudios5014]

People whom speak with sign language have been saved! And me who uses controllers but wishes to just not sometimes... lezgooo!!!

[@bullabythecroissant2004]

OMG i have been dreaming of that for sooo long

[@itsWISHY]

Rare VRChat W

[@olliepala]

yess

[@GR33NY]

Common vrchat W

[@itsWISHY]

@@GR33NY kappa

[@wryytard]

Testing this out felt like playing vrchat for the first time again

[@wryytard]

@@beatcat1265 it’s in the open beta

[@Mortugues]

The locomotion controls remind me of the pioneering days of VR where people would hook up their phone and wii remotes to their PC to emulate a Vive headset and controllers. You had to click the A button and tilt the controller to emulate the touchpad similar to this video

[@DiamondDepthYT]

Yes! I did this while using a crappy Google Cardboard headset!

[@0vxx]

FINALLY! I can play on my Quest 2! I have MAAAJOR stick drift on both of my Touch Controllers, can’t wait until this is out of beta!

[@matthieubrisebois8067]

Literally what ive been the most excited about!

[@connorama1650]

If you guys manage to figure out a way to allow for hand tracking thru Quest 2 Airlink, that would be absolutely awesome.

[@Mikev8.8938]

If they could find a way to get the menu gestures working that would be awesome

[@Pendarr]

Looking forward to the PC version!

[@SkullfootGaming]

I hope the facial and eye tracking from Meta Quest Pro would work on VRchat in the future, both standalone and PCVR

[@Nyx-Arc]

It already works in PCVR. They are still ironing out the kinks though. I took a look in the VRCFaceTracking discord.

[@jquiles410]

To get the circle menu, I think that it should be thumb and pinky together. A lot of avis have gogo loco and atm you have to switch with controllers to put up the circle menu.

[@asaasa7900]

Protip: use the main menu's left tab for an easy (maybe slightly frustrating) way of getting into expressions and thus GogoLoco

[@jennywakeman4964]

If you are to use alvr on quest 2 you can swap the controllers to valve index and use oculus hand tracking that way, so maybe look into that type of thing and figure out how to improve it

[@TrevanHaskell]

Please add a quick movement tutorial in-game, was very confused how to move before googling and finding this!

[@nimushbimush2103]

Yyyooooooooooooo great job! i guess tbis is the first game ever to use quest 2 hand tracking in such way! loving it!

[@WallyDarling.]

How do you open the action menu so I can turn on osc?

[@Spidoc]

This is really fucking cool, I only wish I could do this on PCVR with VD

[@Raikuthedragon]

Yeah in VD we can only do basic gestures...... But they're working on it.

[@NegaTheImpmon9508]

this even today still remains a major W for all of us quest users -w-

[@jrobdoesgames]

How do you turn it on? I tried turning on hand tracking and even looked in the settings but i can't find it.

[@x_tils_yx9862]

seperate app, get the link from their discord

[@Trekeyus]

When it works it's great when it doesn't it's incredibly temperamental. I find the thing that's the hardest is selecting buttons such as when your teleporting as a flat out refuses to accept input at times

[@Gamen4Bros]

This is great! Hope to see this in the future in steamvr! (Since vrchat can't implement it without steamvr support guys chill

[@bullabythecroissant2004]

how can i activate it though ? anyone ?

[@businessgoat8945]

Its so good I love it! I got the quest pro and been playing it non stop.

[@Foxy_VR_gaming]

This is some next level sao stuff

[@humamon2211]

FINALLY! I've been looking for a tutorial all day

[@Vaxton7]

It'll be great if you add the nameplate menu ( circle menu ). And it will be the best if i can join my friends in normal vrchat

[@x_tils_yx9862]

exactly! every time i join an instance with players, it sends me to a different one... -_-

[@pilhasuja]

Beta version don't interact with the servers of live version, so, u cant see your friends for now

[@YallSoBad]

The most important question I need to know when is it coming out

[@DiamondDepthYT]

I am gonna be using the Quest 2 version a lot more now!

[@DiamondDepthYT]

now all thats needed is better quest 2 performance! (which I know is possible, its been shown to be)

[@MightyRobot3347]

THANK YOU, this is one of the things I love about vrc

[@PatrickXVRC]

the moving around or turning sucks but something new

[@AxulFolan]

How do you get it working I can’t find it?

[@fireTiger1]

that’s really inoffensive i can’t wait to test it wen it’s is released

[@HikariSakai]

wait so this is without controllers in your hands?

[@nebulazz9298]

You mean I can play this game without my messed up controllers? It's a miracle!

[@Mikev8.8938]

Nah. You're messed up controllers could AT LEAST open the damn menu...

[@itsreallypola1332]

so happy quest has a quest only thing now. now all the pcvr players know how we feel. now i can finally say "just get a quest bro"

[@galaxytea6609]

My exact thoughts! Although PCVR will get it aswell, probably soon.

[@TheRealScootie]

my friend doesnt have controllers yet and was about to play and i said Hand tracking isnt on VRChat, TODAY, I SAID THAT TODAYYY AND I LOOK IT UP AND THIS WAS NOT EVEN A DAY AGO YET

[@daggerdino]

are we still going to be able to use gestures with finger tracking?

[@LilCoookiee]

Please bring this to pcvr soon i was super bummed when it ealised it didn't work pcvr

[@Secret0zv]

Does anyone know how to open the expression menu with it? They removed the option to access it from the regular menu, so Idk how I'm supposed to open it with just my hands.

[@Vaxton7]

It would be great if the finger tracking is in the main vrchat app so i can talk to my friends

[@dylanm.harter9754]

Just need the expression menu added to the pinkies and then upping the accuracy a bit. Other than that it's an amazing feature utilizing the stand alone tracking !!!

[@FantasyNero]

Okay you mentioned all these good stuff, What about How crouch and prone with your fingers without using the menu?

[@treschlet]

Ooh, please work with the virtual desktop developer to pass the hand tracking data through to the PC version! Obviously we can't do it using air-link until Meta decides to pass it through, but there's no reason this couldn't work through virtual desktop!

[@ReaperMain]

The UI development going forward seems ass backwards considering you don't need controllers for this build. You should really take advantage of finger and hand gesture movement tracking development to the max. The UI should be closer to something futuristic like SAO wheres its more immersive to interact with the menu. I know you guys can do it and I'm willing to wait.

[@joaquinparedes899]

this is maybe an update i thought it would be possible but thought it wouldnt be used nor integrated....man i was wrong and i cannot wait to try this ._.

[@GoofyVrmonke]

This help a lot because I only find out to to go to menu

[@Ms_FluffySheep]

This looks really cool! I'm excited to try it.

[@joshuamercer9181]

How do you get it to work?

[@roblox_builder1271]

The moving still doesn’t work for me, I tried today and yesterday but it didn’t work.

[@poguraag]

this with the bhaptic glove bout to be sick

[@Mikev8.8938]

this with the menu gestures working would be sick

[@Mikev8.8938]

So for anyone coming to this video to figure out why you can't open the menu with hand tracking it's just a bug it's not you doing it wrong it's just a bug

[@ULTRAtheCYBORG]

Y'Know These Don't Seem Too Bad? Dunno Why My Friend Said It Was Horrible? I'll Try Them Out When I Get A Quest Pro

[@Kepler170]

little annoyed that it isnt for PC VR yet. Still is really cool tho

[@thebeautifulrose294]

I’ll be getting the quest for Christmas

[@kenplays017]

Thanks for making the game better

[@Mikev8.8938]

The menu gesture is bugged... they made it worse...

[@creamsupreme8630]

But What About When You AREN'T Looking At Your Hands. It Can't Track Them, So Wouldn't It Make The Arms And Hands Bug Out?

[@haon_the_fox75]

Question: how do I use this feature I’ve been looking but haven’t been able to find any information yet. Thanks in advance.

[@mwising]

You have to enable hand tracking in your quest 2 settings under hands/controller

[@ImSemmi2711]

@@mwising then how do I use it I’m vrchat?

[@zephyr9022]

@@mwising When you do so your controllers are still connected.

[@undermoons7799]

@@ImSemmi2711 you have to go to beta mode since it’s an experimental update

[@NormalYeep]

So I use hand tracking alot in vr chat but there's no way to pull up the quick menu, I think it would be cool if when you held your pointer and thumb after the pop up menu appears then the quick menu appears and you use thumb and ring finger to select quick menu options or if you tap your pinki and thump quick menu apears

[@randomahh445]

How do I open the menu? I am holding my Palm toward my headset and pinching my LEFT Index-finger and my left thumb together and the the three lines don't do what it's supposed to do in this video. The three lines instead, Glow and disappear and I think there is a bug because no one else I knew has had this issue I need help.

[@Mikev8.8938]

You are not the only one. Came back to play this mess JUST FOR THE HANDTRACKING, but can't open the menu. It worked ONCE but then after that the app said "eat shit and die". The MOST IMPORTANT thing to get right and it wasn't a problem apparently until recently... ugh people...

[@bee8228]

I would love to use this! But unfortunately my oculus says I need to pick up my controllers in order to play vrchat standalone when I launch it, so it turns my hand tracking off once I open VRchat, does anyone know how to fix this? I just updated VRchat too.

[@buxx4878]

Me too I disconnected my controller and put my hand but I didn’t work

[@naia_love]

you need for now to install vrchat beta, this update isnt yet released on live. All info for download are available in the beta-info channel on the discord

[@yarizuniverze]

I just have a question. I’m not sure what the thing is called so I’m calling it tongue edit wheel. Basically the thing you usually use for 4.0 avatars. Is there any way of opening it in finger tracking?? If not, I would really like for y’all to add it c:

[@Soleil_Sol]

IT'S A REALLY BIG STEP IM SO EXCITED!!!

[@AzureOnyxscore]

I wonder if this can be used for Quest 2 users who use Virtual Desktop 🤔

[@ParadisEnjoyer]

At the moment is a exclusive update for quest 2 standalone users, maybe they will put this in PCVR i hope

[@northernsunset1]

Dude I tried moving and it is annoying. I recommend you make jump and run different. Controls so it’s smoother for me

[@WhoaWoken]

I loved this update! Lil difficult but you get the hang of it

[@neonkapawn]

Got really excited for it until I saw it's on standalone only.. I never touch that version except to test avatars.

[@mintyvmiku6866]

In my personal opinion I feel like PC users have to much on vrchat so this would honestly be a nice thing for quest only users so we can at least have some sort of small tracking since PC users already have fbt I feel us quest users should get hand tracking for ourselves 😃

[@FumoPliskin]

PC already has finger tracking, still a great feature to be added to the quest however!

[@mintyvmiku6866]

@@FumoPliskin exactly

[@goremilk3168]

@@mintyvmiku6866 this also will not fully work on quest you can’t open your menus and navigate

[@mintyvmiku6866]

@@goremilk3168 but the demo clearly shows you can 😐

[@Something_Disgusting]

@For3verX Sage Bruh watch the damn video

[@NicksonNg]

Be like Wanda with all those hand gestures

[@jessicabunbun620]

How can I do facial gestures? This is very important to me because that adds so much to socializing

[@_VXIN777_]

When I pinch my thumb and middle finger for my left hand for my avatar to move it didn’t work ): I still try but yet it still didn’t work. I might have to check in settings or something.

[@xodnr7702]

There are people who don't use Hend Trekking Please turn it off and turn it on I like the previous one better

[@ShannonMcCraryH]

Great to see, but I am with everyone else. Need to work through PCVR too. The stand alone version is missing WAY too many things to make it viable.

[@Mikev8.8938]

Yeah like being able to access the damn menu thru gestures

[@zioxi.]

Im trying this tonight

[@konin4438]

there goes the 1000 dollars we spent on index

[@Superkuzia15]

For me it felt like pain trying to walk for more than a single frame, the hands would constantly not get tracked, and when i tried turning it just opened the quest menu. I know it's not vr chat's fault, and it's probably an issue with the quest's cameras that are causing the terrible tracking, but i don't think i'll come back to it soon

[@aKuBiKu]

yeah same it's really unplayable lol quest 2 hand tracking just kinda sucks for anything more than simple menu navigation

[@Superkuzia15]

​@@aKuBiKuyeah. And it's sad that it's that way, as there are so many games that would be amazing with hand tracking, I honestly think gorilla tag is one of them

[@aKuBiKu]

@@Superkuzia15 okay to be fair after giving it some thought it's fine as long as you're not trying to do any complicated gestures like vrchat does, you need to bend your wrist at a really awkward angle to get it to understand that you're touching your middle finger to your thumb, not the pointer. for example hand tracking works well in vacation simulator because it's a simple game that only requires you to: move your hands grab objects teleport to predetermined locations but in general it's still really goofy and something like the vavke knuckles is still a lot better.

[@IndianTroller974]

Question how do you turn it on because Im having slight issues with turning it on

[@buxx4878]

Me too

[@blazeforpaze514]

This is gonna be so cool with the powers

[@St00pid_Dawg]

They didn't show the part where it constantly disappears

[@Mikev8.8938]

They didn't show the part where they bugged the menu gesture so it can't show up

[@zdoginterprise]

This looks hard to do, too many things to remember thankfully i have the index and don't have to remember all to much 😭 my brain isn't built that way

[@cskhard]

Nice, great implementations of the UI with hands :)

[@medjaimcgraw5632]

For roleplay and other reasons, can you make ✊️ or any other hand motion disable the pinching ones for a bit so you can still touch stuff without accidentally jumping?

[@Mikev8.8938]

How about fixing the damn menu so pinching ACTUALLY makes it show up?

[@medjaimcgraw5632]

@@Mikev8.8938 wa

[@Kazou_Yashiki]

i honestly i hope this comes soon, as i have horrible drift on my quest controllers.

[@Mikev8.8938]

Hopefully they fix the bug were opening the menu doesn't work with finger support

[@kingoftanks1682]

Can't wait for leap motion support

[@x-man31good57]

I am going to love the concept but also strongly struggle for a while

[@Briishfox]

Ive just tried it and it works in light areas but dosent work in dark areas and its very accurate.

[@xavierarthurs9491]

How do you set it up?

[@troyjohnson2395]

Hey, I accidentally locked my finger tracking and can't figure out how to unlock it, so now I can't move with finger tracking and my controllers are dead.