DeepMotion to Unreal Engine 5 | Animation Retargeting Tutorial | AI Motion Capture

[@CobraCode]

Had a lot of fun making this one and learned a bunch about retargeting during my research! Sign up for a free DeepMotion account: www.deepmotion.com/sign-up If you run into the 5.0.3 issue please check out this video with a workaround: kzbin.info/www/bejne/e3LakoxumJasY6c

[@MaxStudioCG2023]

hello ..it's a realy nice powerfull tool but i have a question regarding the copyright ...WHat or how we are alowed to use the free animation created with the free montly credits ? (i mean do we have full rights to use it in any way mabe to create games or in tutorials or mabe in creating some assets blueprints with those anims etc endless posibilityes ,so what is the copyright for that free montly created animation? thank you!

[@CobraCode]

@@MaxStudioCG2023 That's actually a really good question. Sadly I'm not too sure either since I'm not too directly involved with them and was just sponsored for these 2 videos. I think it's best to just directly ask on their forum: forum.deepmotion.com/

[@MaxStudioCG2023]

@@CobraCode well ,whatever just asking ...i will only use those for practice coz i see some fails on the manequins anims but is good for practice on blueprints (mabe the payd version is better :)) ...but i think best animation will be the ones with motion caption suit wich is rraly expensive ,and then other option just buy packs with animations from marketplace ...and then better option is to learn how to do it but ofcource that will be years of practice to perform professional animations :)))) so the easy way left is to save some money and buy the dang thing :)))))))

[@rolytnz]

This is off the hook. I can't wait to dive in and try it out.

[@holdthetruthhostage]

Oh this was needed brother, I predicted this software would come over 10 years ago rip the animation from a video

[@cloudtheboy8940]

regarding the error import issue, the new ue 5.03 limited it to 30 fps imports. basically its whatever your highest value frame is divided by 30. so if its 117 frames u need rather 90 or 120. which leads to leakage of up to 29 credits everytime its imported. so you wont have to guess what frame number will work , it just sucks rn with the error.

[@CobraCode]

Thanks for sharing your experience with the issue! Yeah, it's an unfortunate situation and I hope it will be resolved soon. Hmm in my experience I also got numbers working that were not multiples of 30. As you can see in my workaround clip I had an animation with a frame length of 113. And I got it working by setting the range to 108. Basically the sub frame that is shown in the error message needs to be either 0 or 1 for it to allow importing, so we can use that number as a reference to see how many frames lower we need to go. I feel like it works on about every 6th frame, at least for the 60 fps clips I was using.

[@MoraSaba-v]

Import to Max and supplement the number of frames to a multiple of 30. Such as 29，59， 89，119. it works.

[@DankFranks]

Did this step by step and no animation plays when I finally get to 12:37. this interface is a little outdated too. Helppp

[@getshotUK]

Wooooo this is amazing

[@ydvisual5530]

Thanks, cool stuff !

[@byondent]

When i ctrl click on the bones to creat new chain it creates a seperate chain for each bone. Any advice?

[@GrossAnatomy]

Great video!!

[@amzilomar743]

أنت رائع ياصديقي 👏👏👏

[@SwapnilPadhye-x6z]

The new deepmotion does not have a seperate root bone. any workaround that?

[@xaramelx]

Thanks for this tutorial! Question: why don't you need to retarget the other bones like the fingers etc? Is it because this particular animation doesn't need it?

[@CobraCode]

Yes, exactly! In this example we had finger tracking off for the animation, so there is no animation on those bones anyway and there is no need to retarget them. I have another video on my channel where we also do the fingers and also facial expressions.

[@xaramelx]

@@CobraCode Ah, got it! Thanks again!!

[@yiiarts6641]

can you use the jump animation as a playable controller? example, you press the jump button and the system simulates the jump animation etc... every time you press the jump button, this animation occurs. can you understand what i mean? not only that. i would like to know how to make your own mocap animation playable movement. I don't know what that means but I heard this system is called rootmotion or something..?! I would really like to learn this system. if you know good tutorials, please let me know. thank you for your help!

[@CobraCode]

Hey, yeah you certainly can! After going through the process shown in the video you can then set the animation to play at certain points in your animation blueprint or create an animation montage you can trigger from your blueprints. In that case you'd probably need to do some more prep or cleanup work with your video clip though since you need to make sure the movement is correctly aligned to be used with the player character. Yes, you should also be able to use root motion with these animations. In that case you might need to set the root target bone to root instead of hips in the IK_Rig. This is a video I found explaining it: kzbin.info/www/bejne/nJDUmaemftiUptE

[@yiiarts6641]

@@CobraCode thx u mate! 🙌

[@IndieQuest-s8q]

when i use the animation in the editor like for an attack animation by pressing a button the animation bugs

[@GameDevUE]

I'd like to use this method to create my own locomotion, would i be able to?

[@CobraCode]

Yeah I think you could. But you'd probably have to plan out exactly how you wanna record all of your motions and might need some manual clean up.

[@roydash5657]

Please make a tutorial on how to create a VHS effect for Unreal Engine Please, I really wanted to see the tutorial

[@CobraCode]

Hey, thanks for the suggestion, but VFX like that aren't really my strength

[@roydash5657]

@@CobraCode Really!? I can't believe this. You fantastic person and amazing teacher. But, it's okayy. Anyway thank you so much for your awesome tutorial. I wish you Wonderful weeks

[@davidMRZ]

Hey , thank you so much for this video. just a quick question. I am trying to use an animation from Deepmotion to my character but my character doesn't have Pelvis and its like Root and then Spine,Spine1 and spine 2. and I don't know what to do when you say right click on Pelvis and click Set retarget root. I would appreciate it if you can help me with that. Thanks

[@CobraCode]

Hey, so I assume you are using a custom character that isn't using the standard Unreal Engine Mannequin Skeleton? You probably want to see which bone most closely resembles the Hips or Pelvis in your case and set that as the retarget root. You can simply try out how it looks with Spine or Root since it's a setting you can easily change. If it doesn't work after going through the remaining steps, you can just try setting the retarget root to something else.

[@davidMRZ]

​@@CobraCode Thank you so much.yes it is a custom character. I will try different bones then. cheers :)

[@LouderThanLoud651]

Is there any way to use those animations for character you are playing as?

[@CobraCode]

Yes you definitely can. But you'd need to make sure to record or select a video with a very clean animation and pay attention to the direction and rotation of the character.

[@braymondumas4033]

I need this thank you

[@syedaayesha-2178]

I have tried multiple tim es to start the process but after getting sign in I could not get into it. I don't know why

[@Jarate_expert]

same

[@flatpoint.]

For anyone who exported a UE5 character and can't figure out how to retarget it, try placing the root of the Deepmotion Character's IK to the hips!

[@elieltogoncalves]

Its works for face tracking?

[@CobraCode]

Yes, please check my other video I made around the same time

[@AzhypaMediaCenter]

And why the hell not be able to use UE skeleton in advance and not doing this grinding?

[@CobraCode]

Yeah retargeting definitely isn't easy and going through the steps can be quite frustrating. However, once you've done it a couple of times and really get how it works it opens a lot of doors for you. Not just for using animations from DeepMotion, but also from Mixamo and many other places, so I think it's worth putting in the effort.

[@rueriazel]

Will this animating method compatible with Metahuman?

[@CobraCode]

Yes it is! But the bone names are different, so you'll have to improvise a bit when using this video. I actually made another video about retargeting to metahumans. If you only care about the major limb animations you don't have to follow along with the entire video. kzbin.info/www/bejne/nny1lHiYmNypjpY

[@rueriazel]

@@CobraCode thank u! Helps a lot👍

[@kazbuks]

That's it, I'm making UFC 5

[@wackthewrld9119]

😂I’m here for infamous 3

[@David_Fernandez]

So difficult! Really? Isn't there a script or functionality that makes all that manual retargeting automatically?? It's really discouraging and intimidating ...

[@CobraCode]

Retargeting has never been an easy process and yeah it definitely is intimidating. I also avoided doing it for a long time since I always felt it was too complicated. However now with UE5 and the workflow you can see in this video it has actually become a lot easier than it used to be. It might seem daunting at first but if you go through it once, you'll understand it and can easily apply it to all kinds of skeletons and animations, so I think it's definitely worth learning since it opens a lot of doors for you. I think there are a couple of paid plugins on the marketplace that do make retargeting easier, however then you'll need to read through the documentation of those plugins. So at that point it might make more sense to just do it yourself.

[@David_Fernandez]

@@CobraCode Thanks for your response! ...one day I will try

[@Catthyp]

Yes yes yes!!!

[@abdulkhalilsalik]

animation has a lot jitter noise

[@eldersteve4552]

Can I have the app please

[@CobraCode]

Hey, it's available for free. Please check the link in the description or pinned comment.

[@holdthetruthhostage]

Subbing

[@CobraCode]

Thank you :D

[@godned74]

I guess the software is still to new to simply drop the animation in.

[@Rajeyshah]

The motion looks weird... As if it has no weight.

[@CobraCode]

I believe it most likely feels like that because the original video clip was in slow motion. You can easily adjust the speed inside the animation asset in Unreal Engine to adjust it to your liking.

[@Rajeyshah]

@@CobraCode speed is not the problem I guess. The models don't react to hitting the ground in the way real people do.

[@showPayne]

I think this is not very good. A lot of editing and work for a short animation. If a person creates an 8x video, he will spend hours adjusting the settings of the characters. Unnecessarily lengthy work for me

[@CobraCode]

Hey, thanks for the feedback. The sad truth is though that retargeting simply is a process that has many steps and takes time no matter how you do it. Things have gotten a lot easier with the update to UE5 though, so if you put in the time to really understand the system you'll get faster and faster at implementing it and can also use it for assets from the marketplace, mixamo and so on, so I believe it's definitely worth learning.