How to use the leap motion in Unreal 5 - AKA Ultraleap

Here's how to set up and use the ultra leap / leap motion in unreal.
This is a really fantastic device for hand tracking. This tutorial just covers the basics. I might cover this subject more in depth in the future.
_____________________________
/ woodydevs
/ woodydevs
/ discord
_____________________________
00:54 Downloading the developer tools
01:55 Using the visualizer
03:16 What's in this tutorial?
03:34 Downloading the Unreal Plug In
04:17 Using the Starter Content
05:37 Building a new Blueprint
06:04 Component Events
06:44 Moving a cube with our hand
10:26 Visualizing a hand
14:35 Looking at my Character set-up (advanced)
18:20 Ending
#unrealengine #unrealengine5 #vtuber

[@WoodyDevs]

Hey all. Here's an update on this. Part two is in the works but it's really tricky. It's probably the most complicated workflow I've tried to make a tutorial about, so it's gonna take some time. It's gonna be a minute. I appreciate the patience.

[@LexAstro]

I need this! i'm looking forward to it! So far I've been using VseeFace and VRMs to get leap motion data into unreal but the VRM workflow has been a huge pain. I'd love to cut out the middle man and send leap directly into unreal. Big fan of the channel, super helpful in my virtual character journey. Thanks for all you do! PS. I'd totally pay money for a UE project with this anim blueprint / control rig.

[@MasekFilip]

great news, really looking forward to your part 2. I personally would like to explore a way how to use a separeta animation for whole body and only use this for the fingers

[@sallydanger]

Looking forward to this as well! Been researching all over trying to find out how to get LeapFrameData directly into my SkeletalMesh.

[@boyboy11799]

pleaseeee!!!!

[@notmyself9279]

pleaaassee

[@WoodyDevs]

Alright. Final update on this. When I first recorded this tutorial I did not realize how difficult my workflow was for doing characters. I thought "oh sure, I'll make a part two no big deal" There is a plug-in you can use for unreal directly from Leap inside animation blueprint for characters, but in my experience it doesnt work - not well enough to make use of. If it did, I'd just put out information about it. I haven't seen any successful cases out there. My character works via hard-coded control rigs. At this time, this is not something I'm able to share with other people as the tutorial - it would be 2 hours long and likely wouldn't work with everyone's rigs (fingers especially). If you're really adept with control rig and animbp, some folks have told me they were able to figure it out from what I've shown in this video near the end. If you're not, you might just want to use an IK to get a hand the the character position. This is step one. You can check out this tutorial for a good look at how to do this - this same technique would work in 3d with the leap. kzbin.info/www/bejne/oYiZqZaama9-aLc Fingers are the tricky part. Again, I've shown a lot of the code in the later part of the video. A lot of this goes all the way back to the support Leap gives to UE creators. While the Leap is useable in unreal, there's no where near as much support as there is for doing this work in unity. I'm sorry to disappoint folks and for assuming I could support a pt.2. At this time I don't think it can be done.

[@miccaravings]

Just found you and wanted to say thank you so much! It's incredibly hard to find information about this specific stuff about the leap and so well explained, been using it for years now but wanted to introduce it somehow to my development workflow

[@Xandra3D]

Amazing content, looking forward to Part 2!! I'm setting up my marketplace characters with Leapmotion and ARkit 🙂

[@sweLogan]

Just what I 'm looking for! Just started playing with this!

[@zmjjiang2766]

Good introduction, thanks bro.

[@allenbeckman1777]

I would like to checkout the second video. Your very easy to fallow and learn from. Thanks alot

[@alan112223]

Thanks man!

[@inachen1022]

Would love to know more on the control rig setup!! this is great thank you!

[@OfficerBewm]

*printscreen* thanks for sharing another tutorial!

[@lumatrace]

Thank you for this! Would love to see how you got this working with metahumans!

[@marcoo.d.798]

pasado de lanza, thnxx

[@edwinmartin9660]

Wow.. amazing.. let me test it out

[@Pablocanoide]

Oh please.. Part 2! And thank you for part 1

[@MichelangeloBedetti]

Yep. I would really like to see how to use the leap with a character controller. Hands are the second most important body communicators after the face, so if someone figures out some sort of pipeline to handle this, it would be phenomenal.

[@Megasteakman]

Thanks for this! I'll have to order one, but every time I am about to pull the trigger I get afraid a new model will come out.

[@user-oz3rn6kp4c]

The key is ->>>> body state anim instance, you can auto map tracked bones to custom bones. It include you need everything (offset, Baserotation, flip model........). It is worth mentioning that it is more convenient to use with fullbody ik。

[@benjaminm6479]

yes Please do one for hand animation

[@boyboy11799]

pleaseee!!! make a video going in depth on how to use leap motion for characters!

[@vladlevcg]

Thanks for the video! Is it possible to record hands movement in sequencer and use it if first person game?

[@411Adil]

please make boxing game, great content!

[@marquescarrington]

Thanks! Have u been able to use Leap Motion in a UE5 packaged build? It seems there might be a driver issue that breaks Leap in package but works in the editor/simulation. Answers I’ve found are from ~5 years ago UE4.

[@danD315D]

Which node would I need to replace the for each loop? I don't know which is compatible.

[@UnrealEnginecode]

Hello, I want to record detailed hand animations on my game character. He will throw playing cards and razors and spin them in his fingers. Please send a detailed installation video of leap motion and unreal engine.

[@incomingfire2504]

Why do you add the input listener and then skip frames to were that input listener is no longer part of the actor and then add the leap component ? Do i even need the input listener because it looks like you deleted it between frames.

[@thecyclenovel1468]

can these be used along with sony Mocopi?

[@yiouyou]

Btw, where to find the puppet-styled character used in this video? It's such cute that reminds me a cartoon movie in childhood, almost 20 years ago.

[@WoodyDevs]

I made this character! I'm glad you like it.

[@PAT3978]

Hi. Can you help me with how to develop just a basic spin and such with a 3D car model? Turn the object and open doors etc? Is this difficult? I create 3D in Maya and have the Leapmotion controller but no idea how to create an .exe for it!

[@WoodyDevs]

I think if you use this tutorial but send rotation data to a “set actor rotation” node you’ll be on the right track. You can make .exes by building for a specific platform. There are tutorials for this around.

[@PAT3978]

@@WoodyDevs ok thanks. I would think grab and rotate wouldn’t be too difficult. I’m just not a developer lol.

[@Shadowreaper5]

4:37 where the devil are you right clicking to get that option?! I have spent the past half hour trying to find it.

[@devonebonsai]

Hi there, I'm working with the Stereo IR 170 from ultraleap on windows everything seems to be fine. But building for Android still seems to be off. Have you tried packaging it for Android? (Pico Neo 3/quest/etc)

[@WoodyDevs]

I'm sorry, I have not.

[@devonebonsai]

@@WoodyDevs Found the solution, you have to sideload the ultraleap service apk to the pico neo 3. Afterwards everything works as expected!

[@76Dybala]

Why there is no engine folder with content folder in my unreal 5

[@WoodyDevs]

You need to be able to see it by showing developer content. :)

[@sukebanichigo7331]

Ultraleap is cant be downloaded any more

[@CamuiKushi]

"Not a lot of great tutorials out there" kind of applies to the leap in general.

[@heidenburg5445]

I thought this thing was a useless brich when it first came out Dx

[@habibmensch7368]

Thank you but can you please keep in mind that not everyone who is watching your tutorial is a pro ue developer and can follow your steps in ultra speed. There is many times in the video where you skip through the steps really fast, in some occasions just initiate a step but do something else in the next frame. Not intuitive at all