FULL BODY TRACKING ON QUEST 3 - BUILT-IN!

[@HakariKimura]

@4:30 I mention this is full body tracking in the way that upper is tracking with metas hand and upper body tracking movements and lower body is estimated. I’ve seen many people and KZbinrs call this a form of full body tracking in there vids and titles and I did the same in a way. It’s not full body estimation or full body tracking exactly it’s more of a hybrid but upper body tracking with estimated legs on quest 3 built in would be way to long of a title. Thank you for understanding love you all ❤

[@brandonbeck2645]

i got it to work finally after some time. the leg estimation is not working though in vrchat. any ideas why this is happening?

[@HakariKimura]

@@brandonbeck2645 do you see your trackers for your legs that are being estimated in steam VR

[@Nadimir]

@@HakariKimura same here i see the trackers at my feet but my legs are stiff and stuck together

[@jakenotjake899]

same

[@sithmaster]

@@brandonbeck2645 Same problem. The Arms and even Finger tracking works nice - but legs are not working. I am on latest 1.32.4.0 app. I can't switch app versions to beta. Tried on phone and on website - no actions for dropdown.

[@zjhinsongaming]

THIS IS AWESOME 🔥

[@HakariKimura]

Ikr!!! 🔥🔥🔥

[@Omili]

This is so huge... There is no reason why game devs should not invest into making better body and tracking for their games now. I am sure this is gonna spread to other headsets over time too. Also can't wait for the tracking to fix one of the most problematic things with VR = feeling sick. If you can track your upper body, waist and head movements separately (like you can in VR now) that means that if other games make the tracking work as well, then you can actually move around in the game and walk straight forwards while looking at whatever you want and keeping your upper body also "moving forward". It's already tested in Skyrim VR and it's absolutely amazing for people like me who get sick because of the locomotion is tied to the headset orientation.

[@HakariKimura]

Yess 1000% more games need this! I’m tired of only testing these out on vrchat we need more games with this!!!

[@sorkoatbot7792]

5:00 I think you have your glasses on. 😁😝

[@HakariKimura]

I realized that after the edit😂

[@sorkoatbot7792]

@@HakariKimura Don't worry that happened to me either with my car keys. 😝

[@sorkoatbot7792]

@@HakariKimura Next time said: Where is my Micro SD Card? 😆

[@PotatoWagon]

Works on Quest 2 too btw. Instead of using camera for upper body, it estimates everything like Standable. And I'd say the standing and sitting on a chair is better on VD but sitting on the floor + laying down is better on Standable 1.0. Let's hope Standable 2.0 is a massive upgrade considering with VD you can do mixed tracking (upper body using the cameras and lower body using proper trackers).

[@MeatMoji]

Old comment I know. But Standable 2.0 is FIRE.

[@Kana_108_]

Nice!! Great video!! Thank you for sharing!! I hope they will add more to it to allow accurate tracking when laying down as well!

[@HakariKimura]

Thank you so much I appreciate that and I agree I hope they add more!!

[@0akBeanz]

Just tried it. It won't let me lift my legs but it will let me walk

[@TophatRaptor_]

Damm this is awesome!!!❤❤❤

[@HakariKimura]

It’s incredible!!! 👀

[@WOojerVest3andQuest3onMe]

Now, if only Quest 3 had eye and face tracking like on the Quest Pro, this would be awesome! Speaking of which, can you use this on the Quest Pro...?

[@HakariKimura]

I’ll try and find out!

[@invalidcreations]

Inside out body tracking is only available on Quest 3, not sure if they're planning on adding it to the Pro

[@WOojerVest3andQuest3onMe]

@invalidcreations I am sure they will release a new Quest Pro 2 that has all the bells and whistles on it. Maybe, even better pass through. 🤔

[@KontagiousKitten]

@@HakariKimura well.. did ya find out?

[@HakariKimura]

@@KontagiousKitten yes, but it works like the quest 2 where it acts a lot like standable!

[@markdavenportjr5129]

Too awesome! Tabor devs needs to enable this! :D

[@HakariKimura]

Yessss

[@demizewaffle8716]

Awesome video! Btw I'm new to vr... I am wondering Which version of virtual desktop should I get? the one in steam or the meta quest 3 version

[@HakariKimura]

They work the same doesn’t matter but it’s better if you get it on meta cuz then it’s installed natively to the quest and you can still content it to your pc. And thank you!

[@soupsoup9887]

It's better to buy from the Meta store. Since the render settings, etc. are only there. The steam version is useless.

[@HakariKimura]

@@soupsoup9887 yess exactly fair point!

[@boahblank9644]

Can this be used for other games as well?

[@HakariKimura]

Yes it can as long as they in steam vr

[@XtheFox1]

Bring back the Rex avatar

[@HakariKimura]

😂 haha I don’t know

[@sorkoatbot7792]

​@@HakariKimuraSame and the Novabeast because they are looking better.

[@HakariKimura]

@@sorkoatbot7792 they definitely have better face tracking

[@sorkoatbot7792]

@@HakariKimura They look cute too. 🤩

[@TheBonneter]

I appreciate the new avatar it’s realistic and represents Hakari well

[@dougmoore1077]

I saw this other day just got it working last night you show of the new feature well

[@HakariKimura]

Thank you so very much! 🥹 I’m happy you took the time to comment this! Makes me happy you enjoyed my showcase!! I hope this feature work’s amazing for you as well!

[@Grymx]

This is epic. Does anyone know if you can use base station trackers as well? I have tundras and one has connectivity issues, but maybe I could bridge that gap by using this for my hips/upper body and my other two for my feet like usual

[@HakariKimura]

It can’t so far as what I know so far

[@Grymx]

@@HakariKimura I actually found out that you can!!

[@HakariKimura]

@@Grymx really!?

[@jack_5344]

wait do i need to get the steam version of the virtual desktop or the occulus app version?

[@raloo.]

From what I can tell, you'll need the steam version, given that he mentioned he's running this on SteamVR

[@ikira_ttv]

@@raloo. no only on the quest store. The only thing you need for your pc is the free app virtual desktop streamer. The steam version is useless don't buy it.

[@overeactive36]

all the trackers seem to end up at my feet when i take the headset off or leave the boundary, anyone know a fix??

[@fischy0339]

IM FREAKING SITTING!!!

[@HakariKimura]

😂yess

[@fischy0339]

immediately got it and its amazing

[@jealousgoose]

Fantastic video mate! I'm thinking about buying Quest 3 just for this feature alone. But I've a question. Will this method work with Mocap Fusion VR on Steam? I want to record my full body animation and export it into 3D software

[@HakariKimura]

I mean they show up on steam as real trackers so I bet it would totaly work for Mocap Fusion VR! and thank you homie!

[@B-Shorts27]

do you have to have a camera up in the video or can you just have it from the quest

[@Ghost_guru-d9c]

A couple of questions. do you need pcvr to do this? and does it track legs if you lift them up or something

[@OnlySayori]

could you use leg tracking of some sort in mix with this or no?

[@svett_music]

does the quest pro also get this update? I'm looking to get the quest pro mainly for the eye/face tracking but I think it's awesome the quest 3 doesn't need fbt 3rd party equipment anymore. So can the quest pro also have the same functionality ?

[@comadombreart6795]

does the upper body tracking work without a pc or is it mandatory to have a pc? because I plan to use the headset without a pc

[@lobsterpoptart26]

does not work for me. i downloaded the streamer app but i cant use it. i cant even change the version on my phone

[@Dante_juiceylishous]

Can this also be used with blade and sorcery?

[@DavidSoczewka]

Yeah I’m curious bout that too

[@Daster131]

Have you tried using the Pro Touch controllers on quest 3

[@Eros_Wonderland]

They may be a dumb question but do you need a pc or laptop or anything like that for this to work?

[@HakariKimura]

Yes you need VD on stream on your pc

[@Gigabyyyte]

Bring back the rex avatar! X’D

[@HakariKimura]

Oml 😂

[@aidenbalalala]

1, so we dont need a body suit 2. how accurate is it can i do a kick in blade and sorcery

[@TheBonneter]

Goodness… it looks so well. Now im torn between upgrading Quest 2 and getting Quest 3 for upper body estimation OR Quest Pro for facetracking. Could I get a genuine two-sense of yours?

[@HakariKimura]

Definitely a reason to get it now tbh 😂👀

[@PointatThings]

i bought virtual desktop on steam years ago, do i need to purchase it again from the quest store?

[@HakariKimura]

Yes 😅

[@Leo_Ponn]

Is this better than standable? I got standable and tested it and I’m not sure if it works correctly cause it only picks up the controllers and headset. It shows all the trackers added by standable but in VRC it seems to pretty much just make movement like swaying side to side a bit more fluid than with just the quest and contollers

[@xythrr]

Is it possible to combine this with Amethyst to get accurate hip and leg movement? this seems... better than vives if you could do that

[@kinatoyukiko8138]

Quick question is a laptop needed for this or no because yesterday I took my oculus quest two back to Best Buy so I can upgrade to a quest three but I decided to wait until they go on sale to buy it. Also that being said I do not have quest tracking devices. They’re like $100 on Amazon.

[@closeings6302]

Is there a way to use the upperbody tracking without PCVR just on the VRChat that is in the meta store?

[@kyohi_sekinin_kara]

Hello! i’ve got an issue while trying this: when i run steam vr through virtual desktop, there is just a black screen in my oculus quest 3, but i can hear the game and i can see the game on my pc monitor, but not in the headset. If i run steam vr without virtual desktop it works perfectly. What should i do?

[@Monkeyman-ky9fq]

Hay i’ve been using it but for some reason, my legs keep going more forward so it looks like I keep sitting down. Is there a way to fix it and also it’s not perfectly with my feet it seems my avatar is too big but should automatically connect.

[@iwewewlo6439]

do i need a pc to use this and is it work at vr chat with a quest 3 standalone? i do have a pc its lenovo Z500. but i afraid its not powerful enough. i tried search but the answer is not clear. thank you

[@RandalFairtree]

How powerful does your pc have to be? I have a microsoft pro laptop. Would that be able to work?

[@Super_Burrito]

I’m sure you could but it wouldn’t be super smooth (not sure what your specs are) since when you’re using your quest linked to your PC your pc does the processing power and your headset just handles the visuals. So basically the headset is glorified monitor strapped to your face

[@jflobeatbox]

you sat down but what about crossing legs? or laying down?

[@ShirouJuin]

Right how do u lay down?

[@nhazul8164]

I wonder if there is a way to add base stations into the mix to better track leg movement. Are there any that are compatible with the quest 3?

[@HakariKimura]

Not atm that ik off 😭

[@squsshy1621]

Does this work on the quest 2 as well? 6:04

[@HakariKimura]

I don’t think so unfortunately

[@X1erra]

I’ll be testing it out tonight just to be sure. EDIT: I tested this and yes it works, you can emulate Valve Index to do the finger tracking in Quest 2, but that's all you get with it. :)

[@squsshy1621]

@@X1erra thank you I’ve been out today so I’m ganna mess with it tn

[@issamaj2383]

I have a MacBook and steam be isn’t compatible.. so does virtual desktop emulate windows or will it show my Mac?

[@HakariKimura]

Damn good question I don’t know cuz I no have Mac I’m sorry

[@ricster1234]

I've had a quick mess around with combining this with SlimeVR and it works pretty awesome. Use this for upper body and SlimeVR trackers for legs and feet.

[@HakariKimura]

How did you get 2 different tracking systems to work?

[@ricster1234]

@@HakariKimura Keep trying to say but I guess YT doesn't like what I'm saying. SlimeVR works it out with some tweaks.

[@ricster1234]

You have to turn off Chest and Hip tracking in Slime VR settings and use something that can be found in a place with a SlimeVR Community that can't be mentioned beginning with dis to turn of the foot and leg tracking in Virtual Desktop.

[@blakehitchcock5537]

Nothing works for me. Updated virtual desktop to latest version on my PC and on my Quest 3. Checked those boxes on the Quest 3 virtual desktop app “forward tracking data to PC” and “emulate steam VR vive trackers” In VR chat now and all I see is my head and hands. No arms or torso or legs shown at all. Anybody know what I need to do to get it working?

[@HakariKimura]

Do you see trackers in steam VR?

[@kang2877]

Do you need a pc for this? 😢

[@ChilletCraze]

Yes you need Virtual Desktop on Steam on your pc

[@killerkarate247]

where did you get the ears from on your headset

[@HakariKimura]

3r printed them from thingyverse

[@420heavenNow]

So it tracks your legs too!??! Please let me know, if it does then I’m buying the Quest 3 asap

[@HakariKimura]

So it tracks your upper body movement using the onboard cameras, and then it fills in the gaps of your legs. It doesn’t necessarily know where your legs are exactly, but it does a really good estimation for where they are based on the forward, tracking movement of your upper body it tracks your legs really well for walking standing, crouching, jumping sitting and laying down kind of like standable if you’re familiar with it.

[@meh6513]

It makes your legs not look horrible in regular leg position but no dances or specific one leg movements but it's the cheapest option for vrchat avatar not glitching out.. cheapest way to make things not ugly but not perfect though

[@somediedrank]

hey. how can I access this traking information inside my apps? (unity development for meta)?

[@HakariKimura]

I believe meta has a toolkit for unity

[@frostz3253]

it is not showing up on how to switch it to beta version on my phone

[@HakariKimura]

Don't worry it's built-in the lastest Version

[@frostz3253]

@@HakariKimura thank you!

[@frostz3253]

@@HakariKimura i am also unsure the legs arent working and as yo why they arent

[@Wojak378]

@@frostz3253 because he's lying.

[@Devour_]

use viso to track just your legs and you have a great combo

This is pretty impressive stuff!😃 For any grandmas watching, the future is NOW! 🤣

[@HakariKimura]

😂😂

[@MrShinoXD6933]

Does it have to be bought in the meta store for it to work not steam?

[@HakariKimura]

Well, preferably you want it to be running on the headset, standalone most convenience

[@MrShinoXD6933]

Ahh ok thanks, just wanted to make sure

[@MrShinoXD6933]

@@HakariKimura how do you get it to run so smoothly on yyour end, because mine don't track as well as yours do and its way less smooth with the movement? Now I am new to body tracking so I'm also curious of what else I'm missing that would help

[@HakariKimura]

@@MrShinoXD6933 good Wi-Fi and fast computer ig what are you running

[@MrShinoXD6933]

@HakariKimura I'm running a 3070 and my wifi is strong to. But it's like the cameras don't pick my upper body properly.

[@brandonbeck2645]

quick question can i not be connected to pc while using this on vrchat? like its quest only not pc?

[@HakariKimura]

Has to be with steam vr unfortunately

[@capolean2902]

i gotta get a quest 3, will this work for contractors? or any fps/sport games?

[@HakariKimura]

They become steam trackers so anything that supports Vr trackers should work!

[@Purasutta]

I dont get how to make it work. I have the beta version on my meta app and its updated but I don't know how to change the virutral desktop on the PC to a beta version

[@HakariKimura]

you gotta download the beta streamer app from there discord

[@WarpedKarma6471]

Hey is there any way I can get this with pcvr on quest 3 or am I barred in to only when I do quest 3 standalone.

[@HakariKimura]

I mean, it is still PCVR you’re just running it in the virtual desktop, which is the only way right now. It’s not standalone as in built-in the quest three as a so far.

[@WarpedKarma6471]

@@HakariKimura so essentially virtual desktop emulates a pc on the standalone quest 3? That would be really cool if thats the case.

[@HakariKimura]

@@WarpedKarma6471 yes, you download virtual desktop standalone on the Meta Quest 3 from there you download the streamer app for your PC you connect to your PC and open steam VR through Virtual desktop and that’s it

[@Bostv2]

that basicly same way bonelab and boneworks body works tbh you can't deny it

[@tupak2730]

Is not working for me, i hot the beta verions on both headset and pc, but when I join vrchat I don't have the calibration option 😊

[@HakariKimura]

Can you see the trackers in steam VR?

[@tupak2730]

No, that's the problem I guess​@@HakariKimura

[@HakariKimura]

@@tupak2730 so you do see your trackers in steam VR, correct? If so, make sure full body calibrations on in VR chat

[@timeriksson6020]

ayo! sick video, just wanting to know, can you use this on any avatar or is it specific full body tracking avatars that work with this?

[@HakariKimura]

Vrc avatars that support full body, any humanoid/furry avatar are pretty much always full body

[@timeriksson6020]

@@HakariKimura thank you so much for your answer

[@HakariKimura]

@@timeriksson6020 no worries, anytime!

[@bellat6889]

Hey! Can you use this together with vive trackers?

[@HakariKimura]

Yes I made a video about this!! 🙏🏼

[@elijah4085]

Does this also work with the meta quest 3s?

[@HakariKimura]

@@elijah4085 check latest vid. 😎

[@arenaling]

Is this feature provided by quest 3 or vr desktop? I'm curious about other apps

[@HakariKimura]

the what's happening is the quest 3 does this tracking built in it's self, but the data doesn't transfer to vrchat without Virtual Desktop, Virtual Desktop takes the info and makes the trackers for VRChat to use! Virtual Desktop is an app that allows you to connect and control your PC wirelessly through wifi, and lets your run steam vr!

[@arenaling]

@@HakariKimura so quest 3 provide all the data and ready to be consumed.. That's great!

[@iknowbroikno]

anyway to do this with out remote desktop. Like connecting directly to PC?

[@HakariKimura]

Not atm unfortunately sorry

[@macIain]

When I go to the mobile app and try to change the version I have no access to the beta version. Any one had this issue and know a solution?

[@juliansandler6423]

I have the same issue. Someone help

[@Breakfast_Table1]

Can you do this with a virtual desk top alternative?

[@HakariKimura]

as of rn I don't think so

[@Breakfast_Table1]

@@HakariKimura okay thanks

[@Themoofy]

Wait so do I have to download virtual desktop on my quest or my pc, or my phone?? I'm kinda confused

[@HakariKimura]

On your quest or quest app linked to the headset

[@pickletheprotogen6857]

no way, i'm so glad this is here

[@HakariKimura]

Bet!

[@adingadormeo8229]

Will this work for dance dash?

[@HakariKimura]

Idk tbh 😭

[@shtwick]

i like it with hands, but how exactly do you move then

[@HakariKimura]

@@shtwick thumb and middle finger pinch then

[@shtwick]

@@HakariKimura and as for the expressions menu?

[@shtwick]

@@HakariKimura im also trying to figure out how to do your beta things, since on the meta quest horizon app theres no "beta" version anymore

[@IbrahimAfrazaziz]

Does it work with blade and sorcery

[@tublar_stanley]

ok so it recognizes i have trackers, but my legs do not move. also its not detecting my steam games

[@HakariKimura]

Did you open it and run it through VD?

[@tublar_stanley]

​@@HakariKimura yeah I did, I don't know what's going on. Since it seems that the other trackers on my arms work, but not the legs.

[@TableTop420]

i dont see the option to change versions when i click it am i bugging or is it gone (help me)

[@HakariKimura]

it's already out of beta, it now built in

[@omsmada]

"fruity" 3:36 bruh you've got cat ears on your q3 while using a fruity elf avi

[@HakariKimura]

👾

[@WalidXQ]

Fr

[@WalidXQ]

@@HakariKimurabest come back

[@rowanunderwood]

When I heard emulate Vive tracking I thought I was gonna be kicking in Blade and Sorcery - but no its FINGER tracking.

[@Ru-eye]

HEYY 🇹🇩🇹🇩🇹🇩

[@HakariKimura]

Wassap!!

[@Ru-eye]

how are you???

[@HakariKimura]

@@Ru-eye I’m great how are you!

[@Ru-eye]

i’m good! thanks for asking

[@myshadow9630]

Is anyone having the same issue that walking doesnt work? Better said leg movement is not working. HELP!!!

[@HakariKimura]

Are your legs frozen?

[@myshadow9630]

I dont think so, but what may be the issue if they are frozen?@@HakariKimura

[@mori_aGhostboi]

there away to use the body tracking on standalone VrChat?

[@HakariKimura]

Hoping meta does something about it in future updates but rn we got nothing

[@JYTheHungryRonin]

how do you record yourself with your avatar?

[@HakariKimura]

Camera irl and vrc camera filming at the same time

[@fabienlelaurin7760]

Did it word with quest pro ?

[@catmandude6905]

no, upper body tracking is only on quest 3. idk if the ai leg tracking works on quest pro, i would say not though

[@joshvr3]

Hmm does this work for quest 2?

[@TabithashYT]

Can you use the Quest 3's full body tracking while using Quest link?

[@HakariKimura]

Not atm you need it through VD and steam VR

[@TabithashYT]

@@HakariKimura thank you for your response. Would've been cool though :)

[@akaspen4739]

​@@HakariKimura so connecting it to my computer for virtual desktop won't work if so how do I connect it otherwise?

[@cuzzsofly4522]

do you have to have PC?

[@QDOG78]

No just 20 bucks

[@air4970]

Can we use 3 cameras?

[@joey_outdoors]

Followed the tutorial and it doesn't really work like it's shown in the video :/

[@HakariKimura]

This was when it was beta, it’s now in public release, should be easier and all be built in without needing discord

[@joey_outdoors]

@@HakariKimura Yet it still doesn't work for me. I'm not sure how to make it work. It's something that you either turn on or off yet it's not really tracking my entire body and working the same way it's being shown.

[@HakariKimura]

@@joey_outdoors do you see the extra trackers in steam Vr?

[@joey_outdoors]

@@HakariKimura I see all the trackers on my avatar when I go to calibrate, and in the steam vr window. But they don't respond to my body movements or position.

[@HakariKimura]

@@joey_outdoors well the arms and torso track but the legs are estimated, I mention this @4:30 if nothing moves then that's a weird glitch your experiencing.

[@obitouchiha6689]

Not working my legs are not tracked

[@olivecool]

does it have hip sway tracking?

[@StevenBalboa-bh6pt]

Does this reduce performance ?

[@HakariKimura]

not that I could tell

[@Invader_Era]

Guess you've convinced me to save up for a meta quest 3.

[@HakariKimura]

Damn I gotta get meta to give me a code 😭

[@mrgalaxifitcam6475]

The bad thing is that it cannot be used with the HTC full body

[@HakariKimura]

Yes it can 😂 I have a video on it check the channel for upgrade full body tracking video

[@kondzai4170]

What's the vrchat world called?

[@gabrielrodriguez7632]

i see the fake little trackers on my arms but i cant move my legs

[@HakariKimura]

In the video I mentioned the legs are estimated

[@gabrielrodriguez7632]

oh so it just simulates walking?@@HakariKimura

[@nikushim6665]

Its Upper body tracking (pretty much only what the center out sensors can see) Leg estimations are janky at best, you're better off with slimes if you can get them (assuming you dont have the option of light houses).

[@timarlow8007]

Can you export this as mocap data?

[@HakariKimura]

I believe you can with mocap fusion vr

[@TheUnknownD]

This made me get a quest 3

[@HakariKimura]

Damn meta better give me a cut 😭😂

[@zackcord3588]

Hi i joined the discord and theres no instructions t follow

[@HakariKimura]

It’s no longer in beta it’s all public release now

[@zackcord3588]

@@HakariKimura thanks!

[@kurisu7885]

Welp, that seals the deal, once I can afford if I'm picking up a Quest 3.

[@HakariKimura]

Yessir 😂 agreed

[@kurisu7885]

@@HakariKimura Yeah, I'm still running a Quest 1 so the upgrade will be good, especially since support for it ends soon.

[@2Dpocky]

omg that is awesome!! i need a headset now!!

[@HakariKimura]

It’s absolutely incredible!!

[@Apocalyman]

Quest 3s?