Hand Gesture Detection with Unity XR Hand Tracking

Рет қаралды 19,963

Күн бұрын

Пікірлер: 39

@Nick2054 10 ай бұрын

Thanks for the tutorial, I couldn't find the hand gestures sample scene because I didn't have experimental packages enabled. Its amazing how Unity has made absolutely complex logic like pose detection so accessible.

@billkeane1375 10 ай бұрын

Perfect tutorial. Complete concept from start to finish, efficient and fast. Very, VERY useful. Thank you.

@De-Panther 11 ай бұрын

Thanks! Great tutorial! It works on WebXR as well🤩

@ironandsilk 10 ай бұрын

How does that work on WebXR?

@De-Panther 10 ай бұрын

@@ironandsilk there's WebXR Export package. The same tutorial here can be applied to that package.

@ivanaguilar2856 11 ай бұрын

Great tutorial on inputs via hand gestures. Will you create a tutorial on how to use Meta's new inside-out body tracking (IOBT), for instance, to detect if the user is leaning forward (rotated their torso) instead of walking forward? This will be useful to not have the character move forward and just lean forward (i.e., leaning forward to grab something on a desk and not have the character's body move forward and collide with it).

@teawa_ 11 ай бұрын

Great tutorial as always Valem!

@peterschreuderr 11 ай бұрын

Yess!! Just what I needed since i dont work with the Oculus package anymore

@dopinkus 11 ай бұрын

Would love a tutorial on how to make good quality UI in VR / on Quest! I think you go through it another - but I believe it’s outdated

@semihyildiz2977 7 ай бұрын

Hi Valem I have a probelm it always tells me NullReferenceException: Object refernce not set to an instance of an object - when I try to use the displaying with the text. Do you have any tips for me?

@desmondantony7058 7 ай бұрын

same issue bro any solutions?

@davidosorio1585 5 ай бұрын

Comment the lines that are showing an error, so you have to double click on the error to open the script. There you have to add double slash "//" in the beginning of the lines 195, 207, and for the line 156 replace with "m_BackgroundDefaultColor = Color.black;" without ""

@iABOoDxZ 4 ай бұрын

@@davidosorio1585 thanks bro you saved me

@JT_6233 4 ай бұрын

@@iABOoDxZ You need to assign the Background in the "Static Hand Gesture" script in scene view. I just figured it out. It took me two days to find this solution.

@JT_6233 4 ай бұрын

@@davidosorio1585 Thats not an ideal solution, you are not really supposed to change existing scripts since a package upgrade would bring the issue back. What you need to do is this: You need to assign the "Background" in the "Static Hand Gesture" script in scene view. I just figured it out. It took me two days to find this solution.

@sarumanork-orphanage5612 2 ай бұрын

Salut! Is there a way to display hand poses or poses while editing them in unity? That would be cool!

@roguestargun 10 ай бұрын

Damn just when I thought I was done adding features to Rogue Stargun (cough, coming February 1st to Applab). Thanks for the tutorial Valem!

@Hemecan. 10 ай бұрын

Did you upload to Applab

@Besttechnology 11 ай бұрын

Hi valem can u made a video of how to navigate using hand

@ivanaguilar2856 11 ай бұрын

If you take the output of the "Static Hand Gesture" script (Gesture Performed) and have it send a signal (i.e. a boolean of true) to a locomotion script, you can then trigger the virtual camera (i.e. VR rig) to move until another gesture is performed (sends a boolean of false). You can then have the player move based on a constant speed based on a direction, for instance the virtual camera's forward direction. I haven't seen a tutorial show how this is done, but if you take what I said with what this tutorial shows and with a continuos locomotion (i.e. joystick locomotion) tutorial, you should be able to create a simple locomotion system based on gestures. I hope this helps.

@Besttechnology 11 ай бұрын

@@ivanaguilar2856 thank you so much it's completely logic I will try it.

@ivanaguilar2856 11 ай бұрын

@@Besttechnology you're welcome. I hope it works out well.

@ivanaguilar2856 11 ай бұрын

Here are some other forms of locomotion that could also be used through hand tracking. It might be useful if you really want to use your hands to control navigation, but know that it isn't very precise or fast - kzbin.info/www/bejne/jJvMpnx5pbeeiM0feature=shared kzbin.info/www/bejne/aXjMq4t6nKdgobsfeature=shared I think using your body's leaning to control locomotion might be a better solution as your hands are free to do other actions, like interact with virtual objects, instead of being used to control locomotion (like in real life) - kzbin.info/www/bejne/oKvSknV3mZuahrsfeature=shared Leaning to fly: kzbin.info/www/bejne/f4O9eqyqh5mKodkfeature=shared I hope this helps.

@starbuck3980 6 ай бұрын

XR hands works with AR?

@WarrenEBB 10 ай бұрын

can you (or anyone here?) note what replaced TrackedPoseDriver component - for sticking a mesh onto your hand anchor? (say I wanted to put a custom mesh prop onto my wrist). + and can this mesh stay: in same spot when you put controllers down and switch to gestures? ( InteractionSdk suggests HandJoint component, but this doesn't keep mesh in same spot when you cross over between controller and raw hand input.) (... i'm debating joining everyone in XR Toolkit usage world, after watching this video, but still not clear how to best stick props onto my custom VR hands. Want to support switching between controller and controller free usage at will. Guessing i need to have 2 setups and switch what is active when I detect change. curious what more experienced folks would suggest. mostly curious if there is an established "this has officially replaced Tracked Pose Driver. everyone should use it."

@XaviDevSama 10 ай бұрын

XR HANDS work fine on Unity Editor but in the build it doesn't detect my hands its this normal, or I have to make some changes in the configuration?

@zobairhasan24 2 ай бұрын

Does it work with quest 3 as well

@woohee_b 11 күн бұрын

I've been following this tutorial but my text doesn't seem to change..

@daryladhityahenry 10 ай бұрын

Hi Valem! I have a question... Why do you choose unity over unreal engine? I am really curious... I like unity of course, I never even touch the unreal engine. But, wherever I see, unreal engine seems to have massive advantage if we're going to do realistic VR graphics.. Is there any specific thought on that? I really think a lot wether I should learn unreal or not at this point... Thanks.