Metahuman Hand Animation With Leap Motion - Unreal 5

In this Unreal tutorial, I'm going to show you how to use Metahuman character hand animation using the Leap Motion device.
CHAPTERS
0:00 Preview
0:08 Uninstall the old driver
00:28 Download the latest Ultraleap Gemini 5.6.1
00:54 Install the latest driver
01:24 Download the latest Unreal Leap Motion plugin
01:53 Create a new Unreal 5 project
02:13 Adding Leap Motion plugin to Unreal
03:44 Add Metahuman character to Unreal
04:40 Start Create Leap Motion supported Metahuman
11:30 Fix rigging issue
13:31 Final preview
Ultraleap Gemini 5.6.1 SDK : developer.leapmotion.com/tracking-software-download
Ultraleap Hand Tracking Plugin: www.unrealengine.com/marketplace/en-US/product/ultraleap-hand-tracking-plugin or github.com/ultraleap/UnrealPlugin/releases/
Unreal Leap Motion Tutorial: kzbin.info/aero/PLjJDULD7sQMstZzaJBft8W1lXFwpBEut0
#epicgames​
#unrealengine​5
#unrealengine​
#metahuman​
#animation
#ue4​
#leapmotion
#handtracking
#tutorial
#Ultraleap
#installation
#sdk
#Gemini
#Latest
#Latest SDK
#setup
#developer
#ULTRALEAPPLUGIN
#Software
#UnrealPlugin
#epicgames​
#ue45
#rig
#rigging
#leapmotionmetahuman
#metahumancreator
#development
#hand

[@wywarren]

Thanks for this tutorial! It helped me get started a lot quicker. Note that at 10:25, the positioning of the child actor doesn't matter. It actually loops for an instance of a PlayerStart class to snap the position to, I had removed mine in a test so it was just sticking to origin and once I added one back it was able to move the starting position.

[@xl965]

amazing，i like it

[@raxio1111]

Really helpful！ Wondering if there's also a simple way to apply Leap motion data to default UE5 mannequin and UE5 mannequin based skeleton character ?

[@stereochips]

Clock noise makes video better

[@xl965]

I carefully watched your gesture binging tutorial ,so i tried to bing with the arms of the first person ,and found that the binding cound not be done .Could you please give me some suggestions

[@RyansMashup]

Is there a way to get movement starting from the shoulder, not the elbow? My guy looks like he has worked out too much and can't lift his arms.

[@DarkBarBarian]

hey I only went finger movement is that possible with that because I'm using xsens suit, I don't want to conflict with xsens suit

[@DarkBarBarian]

make video on this with finger movement only. Thanks

[@Manjyoti_Medhi_]

i have got this error" Infinite loop detected. Blueprint: IEButtonStyled Function: Set Collision Enabled Call Stack: Show" how you correct it

[@serenama6402]

Hi! My UE5 crashed every time when I put the play button. The reason is "Assertion failed: Pose.IsValidIndex(BoneIndex)". Can you resolve this problem? thax!

[@EveSaika]

I faced the same problem. Did you find a solution?

[@benjavides]

Having the same problem

[@higon99]

Oh, ya. It crashes everytime on me as well >.>

[@benjavides]

I remember I worked around the crashing problem by setting the pawn as the default one in the game mode or by avoiding that and manually placing it in the scene setting it to auto posses the player 0. Don't remember which was the solution, I tried both

[@higon99]

@@benjavides I got it working somehow by getting a specific version set. Soooo this video's installation instruction is a trap. Don't use any Github zip. Below is my result: 1. Using UE5.1 + UnrealPlugin (Github current 4.6.0) -> CRASH 2. Using UE5.0.3 + UnrealPlugin (Github current 4.6.0) -> CRASH 3. Using UE5.0.3 + UnrealPlugin (Github previous 4.5.0) -> CRASH 4. Using UE5.1 + UnrealPlugin (Github 20221222 compiled) -> CRASH 5. Using UE5.0.3 + UnrealPlugin (Github 20221222 compiled) -> CRASH 6. Using UE5.0.3 + UnrealPlugin (Unreal Marketplace) -> WORKS!!!! 7. Using UE5.1 + UnrealPlugin (Unreal Marketplace) -> Not compatible Thanks you so much for giving me your workaround. I uninstalled 5.1 so right now I can't try it but I'll keep it in my mind when I revisit UE5.1. I found that the crash happens only when I use MetaHuman_Template so I think there should be a workaround like that.

[@Red_Gambit]

This is actually a great tutorial BUT with one caveat: As mentioned in the comments, you need to try this on a specific build of Unreal (5.0.3 is what I used) as more recent builds will get you a crash error when you try to view the project.

[@Manjyoti_Medhi_]

i have got this error" Infinite loop detected. Blueprint: IEButtonStyled Function: Set Collision Enabled Call Stack: Show" how you correct it

[@Red_Gambit]

Sorry, no clue. I just posted what worked for me.

[@Manjyoti_Medhi_]

have you done everything accordingly or did you change anything other than that @@Red_Gambit

[@Manjyoti_Medhi_]

which procesor you have used

[@Red_Gambit]

@@Manjyoti_Medhi_ I did everything in the tutorial except I used Unreal 5.0.3 and used the ue5_3-4.11.0 build of the Ultraleap tracking plugin.

[@psychoticgiraffe]

for me the examples do not exist in the folder, and i checked my download and its just not there even with show plugin content on

[@ThePravenpjose]

kzbin.info/www/bejne/n2i4p52OfJtgatk - You need to enable "Show Plugin Content" to see that folder

[@habibmensch7368]

when I try to add the eventgraph content into my animbp, I am getting the prompt: 'Fix Self Context Function References'. It gives me the option for DebugEffectors 'Do nothing', 'Create Matching Function in Blueprint' and 'Remove Node(s)'. Which one do I have to pick?

[@BrotherL0VE]

Hey, did you find a solution for this? I'm dealing with this same problem. I tried both "Do Nothing" and "Create Matching Function" and got errors.

[@habibmensch7368]

@@BrotherL0VE no solution yet unfortunately

[@BrotherL0VE]

@@habibmensch7368 Damn. What's crazy about it is that after I typed that to you, I was deleting and recopying/pasting the nodes into both over and over while ranting to someone about it. I was half-paying attention and then suddenly the option didn't come up and it just worked. Unfortunately, I messed up on another step and had to delete everything and start over. Now I can't get past the same option again.

[@xl965]

How can i see the content in the plugins in the ue5 ? I cannot find the Metahuman Template. Please

[@ThePravenpjose]

kzbin.info/www/bejne/n2i4p52OfJtgatk , You need to enable setting->show plugin content

[@xl965]

@@ThePravenpjose Oh， i found it，thank you very much。

[@MrReliablerod]

the face doesn't show up on my what may i be missing ? also can you do a tutorial to include live link for face movement?

[@ThePravenpjose]

I don't understand what you mean by not showing face? Can you share any picture. For live link for face you required iPhone/iPad Pro. Using leap motion only can track hand.

[@MrReliablerod]

@@ThePravenpjose drive.google.com/file/d/1ujNyAuBjEWSYSCUDtVjCEom0SpcIHWal/view?usp=share_link

[@MrReliablerod]

hair doesn't show up and head follows mouse how can i add something to the blueprint so that live link controls the head

[@ThePravenpjose]

@@MrReliablerod kzbin.info/www/bejne/m4PNgJ16fdt4qtU - Hair fix, Head follow the mouse need to check.

[@habibmensch7368]

I am getting a compile error when I add the desktop actor into the level. What might cause this?

[@habibmensch7368]

the blueprint has a huge error list:Node Get Leap Options . The node won't be pruned as isolated one. The node is not pure, but it has no exec pin(s). Verify IsNodePure implementation in K2Node Call Function. Can't parse default value 'LEAP_MODE_DESKTOP' for Default Mode . Property: DefaultMode. No structure in SubCategoryObject in pin Out Options In use pin no longer exists on node Get Leap Options . Please refresh node or break links to remove pin. In use pin no longer exists on node Get Leap Options . Please refresh node or break links to remove pin. In use pin Out Options Mode no longer exists on node Get Leap Options . Please refresh node or break links to remove pin. Could not find a function named "GetLeapOptions" in 'LeapDesktopActor'. Make sure 'LeapDesktopActor' has been compiled for Get Leap Options In use pin no longer exists on node Set Leap Mode . Please refresh node or break links to remove pin. In use pin Mode no longer exists on node Set Leap Mode . Please refresh node or break links to remove pin. Could not find a function named "SetLeapMode" in 'LeapDesktopActor'. Make sure 'LeapDesktopActor' has been compiled for Set Leap Mode In use pin no longer exists on node Set Leap Mode . Please refresh node or break links to remove pin. In use pin Mode no longer exists on node Set Leap Mode . Please refresh node or break links to remove pin. Could not find a function named "SetLeapMode" in 'LeapDesktopActor'. Make sure 'LeapDesktopActor' has been compiled for Set Leap Mode Could not find a function named "None" in 'LeapDesktopActor'. Make sure 'LeapDesktopActor' has been compiled for Get Leap Options

[@ThePravenpjose]

@@habibmensch7368 Which UE and Leap sdk version are you using?

[@habibmensch7368]

@@ThePravenpjose 5.1 on both

[@ThePravenpjose]

​@@habibmensch7368 What problem are you facing? I haven't had leap motion for the past few weeks. I tried today and it works fine for me. I used Version: 5.1.1-23901901

[@SimulatedSavage]

Would you be willing to take the time to help me set this up for a non-conventional avatar in UE? I wouldn't mind paying for your time.

[@BrotherL0VE]

Praven, could you walk me through copying the nodes to the Animgraph and Event blueprints and until the end? I will give Paypal for your time.

[@ThePravenpjose]

What problem are you facing? I haven't had leap motion for the past few weeks. I tried today and it works fine for me. I used Version: 5.1.1-23901901

[@BrotherL0VE]

@@ThePravenpjose When copying the event graph from the Metahuman template, there is a node called "debug effectors" that is basically empty. The engine asks what to do with it and gives the options "Do Nothing", "Create Matching Function", or "Remove". I couldn't get past that until I double clicked within that node on the Metahuman template and found it had even more data within it. So I copied the data within the template to the node in Anim_BP_MyPlayer. Everything compiled fine, so I *THINK* that fixed it. HOWEVER, whenever I drag the BP_MyPlayer on the map and press play, EVERYTHING crashes. I have tried this on 5.1 and 5.0. There's several other people it's happened to as well.

[@ThePravenpjose]

@@BrotherL0VE Ok, I will check. Give me some time

[@BrotherL0VE]

@@ThePravenpjose Ok, thank you very much

[@ThePravenpjose]

​@@BrotherL0VE I tried with the latest SDK and I am getting the same problem you are facing. I tried with the old Leap Motion SDK and that plugin works fine in UE 5.1.1. I am attaching the link, try it once and let me know we.tl/t-KeNSCu73Xm

[@cassidycash8805]

p̷r̷o̷m̷o̷s̷m̷ 🤩

[@sukebanichigo7331]

Would you be willing to help me in real time learn about how to do this? Yes, if you have a paypal I would be happy to pay you for your time!

[@ThePravenpjose]

Do you have discord? If yes please join discord.gg/WvaQ4y53

[@sukebanichigo7331]

@@ThePravenpjose Yes. Sorry for the late reply. I did join the discord