FREE Mocap Animation for UE5 in 10 Minutes [OUTDATED, Only applies for Cascadeur 2023.2.1 or below]

IMORTANT update : you can use older verion than 2024.1 of cascadeur to export fbx, cause after this version they changed their license & plans.This video is almost year old, it was free at that time.. within that their features and plans changed.
Also, You can get $99 indie license, which has unlimited export & is also perpertual, so you own it.
In this video, you will learn how to use ThreeDPoseTracker to capture your body movements with a webcam or even use pre-recorded video, how to import the data into Blender and retarget it with UE5 skeleton, how to export the animation to Cascadeur and refine it with physics-based tools, and how to import the final animation into Unreal Engine 5 and use it in your project. This is a fast and easy way to create realistic and smooth mocap animation without any expensive equipment or software. You will also get some tips and tricks on how to optimize your workflow and avoid common errors. By the end of this video, you will be able to create your own mocap animation video in UE5 with ThreeDPoseTracker, Blender, and Cascadeur in 10 minutes or less.
Here, I showed how to do some basic mocap clean up.
Links to all used softwares -
ThreeDPoseTracker - digital-standard.booth.pm/items/3698596
Blender(Free 3d graphics software) - www.blender.org/download/
Rokoko Studio Live Plugin for Blender (Free retargeting plugin, requires signup) - www.rokoko.com/integrations/blender
Cascadeur (Partial Free AI Assisted animation software) - cascadeur.com/download
Unreal Engine 5.3 - www.unrealengine.com/en-US/download

[@IamSH1VA]

*IMORTANT UPDATE* : This is kind of OUTDATED video.... *You can still use older verion than 2024.1 of cascadeur to export fbx* , cause after this version they changed their license & plans.This video is almost year old, it was free at that time.. within that their features and plans changed.

[@Ollacigi]

you never know how bad i needed this tutorial,,thanks for sharing it mate

[@IamSH1VA]

Glad it helped 🙂

[@IamSH1VA]

Glad it helped 🙂

[@user-kk8fj4ye5r]

Very nice, my friend, we will do it ❤❤❤❤❤

[@quetepetinbenfort]

You are the master! Thanks a lot!

[@IamSH1VA]

You're welcome!

[@alirezakhademi6093]

how can we clean foot sliding? thanks for great tut by the way

[@IamSH1VA]

Thanks... To clean foot sliding "Quickly" you can try to use *"Fulcrum Motion Cleaning"* , check this short - kzbin.infoTN5Nurgq8uk?feature=share (Video is in Portrait mode, sorry for that ) Sometimes it may create weird results, so manual cleanup might be necessary.

[@alan112223]

Thank you, subscribed

[@IamSH1VA]

Thanks for the sub! Really Appreciate it.

[@RictorScale]

This is amazing thank you

[@IamSH1VA]

Thanks for watching.... 🙂

[@GDevGameDev]

Thnx for making the video .. subscribed to your channel appreciate you

[@IamSH1VA]

Thanks for the sub!

[@GDevGameDev]

​@@IamSH1VA i did not receive the desired results in 3dpose tracker ... however using your mothod of retargeting i was able to use rokoko video mocap to produce great animation 😊

[@IamSH1VA]

@@GDevGameDevGreat…. Also before retargeting try to match A-Pose as much as possible for 1 to 1 retarget. I just noticed I forgot to fix spine and ankle little.

[@123happily]

I don't aim to export the end product to unreal engine, so can I use a different model (final result target model) to do the retargeting? or will there be issues with scale? The only issue is the target model is A pose, and of course TDPT is T pose. No bending of knees/arms like in your tutorial (which was very good by the way) Many thanks.

[@IamSH1VA]

Thanks.... You can use any model and just retarget your animation to that model. Also *very IMPORTANT* , you can now retarget directly inside Cascadeur, so you can skip retargeting phase of blender (which is kind complicated). hope this helps.

[@luismbdesign]

Awesome. Now, what is the best way to return to blender once more and have a skeleton as "rigify" of Blender?

[@IamSH1VA]

I didn’t understand your question. Do you want to retarget animation to rigify skeleton? I have never worked with rigify skeleton, but in that case procedure would be similar just match bones and then retarget animation.

[@506admin]

Hello, is Cascadeur necessary? Why is Cascadeur needed in this stage? Can I directly import the FBX exported by Blender into UE5 for animation redirection?

[@IamSH1VA]

It is not necessary, you can absolutely export animations from Blender to UE5. Here Animation had some issues, to edit that I used Cascadeur, which has easy AI/Physics animation tools. It is easier to cleanup mocap in Cascadeur that's why I used it. Also, *you can directly stream animation from TDPT to UE5 & record there* , search for "TDPT VMC Protocol"

[@506admin]

@@IamSH1VA Thank you very much for your patient answer, it has been very helpful to me.

[@Sgirlie755]

Do you know if there is auto physics for the fingers to clean up already posed animation? For example, fingers clipping through the body or clipping through other fingers (TDPT always has the hand going through the body). Are there rigid body collisions in Cascadeur for those mentioned situations? Also, have you tried Cascadeur's video mocap feature and how does it compare to Rokoko's video mocap feature and TDPT's video mocap feature? For TDPT IS 30 fps the highest or can I manually set it to 60 fps?

[@IamSH1VA]

There is finger auto-physics but it is for pro/paid version of cascadeur. I never tried it, I use box controls for fingers. You can find finger autophysics tutorial on KZbin. I tried Cascadeur’s video Mocap, but it was not that accurate also was very slow, each frame took like 30 seconds. That’s why I started using TDPT, which is real-time mocap. I think newer version of TDPT(Windows/PC version) has 60FPS.

[@Sgirlie755]

@@IamSH1VA I found videos on finger auto posing, but not auto physics so I was curious. Does Cascadeur in your opinion help with TDPT animation where the arms clips through the body? Yea I've been using the TDPT iPhone version and the max is 30 fps so maybe I will switch to Windows/PC version and give it a try. I'll download Cascadeur to try it out as well. I hope my laptop requirement is compatible with the software.

[@IamSH1VA]

@@Sgirlie755 best thing about cascadeur is that, you can literally delete key frames where it is clipping through body & let software/ai interpolate those for you. You don’t have to keep every frame, just choose which frames are good & delete bad/unnessary frames, or adjust little bit & let cascadeur handle in between frame interpolation. Also, *TDPT pc version requires very less specs something like 1060ti something like that* Even if your laptop is slow there is an option of “Catchup” while recording so it doesn’t skip frames.

[@Sgirlie755]

@@IamSH1VA Can you do a video tutorial on how to change the character rig with rigid bodies? Also did you hear Cascadeur has released the 2024.1 version today, offering a 2-year Indie license for free for those who registered for the basic license before March 1, 2024. This version allows exporting in FBX file format, limited commercial work, and no time limit for animation export. Users can also use features like autopose/autopose finger and animation unbake. I think you have two months to claim your free 2 year Indie license, and if you miss the deadline then a $99 per year subscription is required.

[@IamSH1VA]

@@Sgirlie755​​⁠​​⁠WOW!!!! THANKS 🤩 you just saved me ton of money That indie license price is so fair and sweet $99, I would have bought it even if they didn’t gave it away for free 🥹😅 I was waiting for sale or offer to buy pro license. (Buying at $ price is pretty expensive, also our government taxes too much) If this gives me finger auto-posing and other pro features, that would be golden 🥳🥳🥳 What do you mean by change character rig? You want to use not humanoid? About fingers, I don’t if you can replace with rigid bodies, if that’s possible I will make short or some once I get time 🕰️ Again thanks for the headups about price update. 🙏

[@Jagaballer]

Hello, I can not export fbx files in Cascadeur in the free version, is this new, or has it something to do, that you imported a fbx? Also, you can mocap direct in Cascadeur, and i think it works better than, threeDpose tracker, but after the clean up, i couldnt export it. Is there an other option you know? thanks!

[@IamSH1VA]

Yes, they changed their plans, BUT the good news is *you can still export your animations as FBX* , just use older version than 2024.1 of cascadeur. *This video is almost year old & In 2024 they changed their subscription plans, No FBX export on Free Tier for v2024.1 & above* Hope this helps....

[@Jagaballer]

@@IamSH1VA Thank you for your answere. Sorry im a newbe, how can i get an older version of Cascadeur? XD Thank you!

[@Jagaballer]

@@IamSH1VA I am now, trying to skip that part, and use threeDpose tracker and VMCtoMOP to my metahuman. The plan is now to record the metahuman in UE5 and hopefully cleanup the animation there. My current problem is: I can make the metahuman move by pressing Play, or record an not moveing metahuman. I cant record the metahuman in the sequencer.

[@Jagaballer]

@@IamSH1VA It is downloading Cascadeur 2024.1.2 no matter what version i am Choosing, i deinstalled and changed the google adress. It doestnt helped :(

[@IamSH1VA]

@@Jagaballer Go to the Cascadeur’s download page, scroll down little bit there is a list of links with all the previous versions, says *“Older Versions of Cascadeur”* I can’t put a link cause youtube doesn’t allow external links. Download version 2023.2.1 or older.

[@Reemus1878]

is there a specific version of Blender this works on?

[@IamSH1VA]

I tried blender 3.4,3.5 & 3.6, works on all versions I used. Rokoko Retargeting Addon supports “Blender 2.80 or higher”.

[@Reemus1878]

Have you tried this with the Auto-Rig Pro plugin for retargeting? The new MoveAi software creators are recommending it. Im wondering if you think Rokko or Auto-Rig Pro is better? @@IamSH1VA

[@IamSH1VA]

No, I haven’t. I will give it a try once I am free.

[@IamSH1VA]

Just did some quick search on AutoRig pro, workflow is kind of similar, also seems like it has some presets to import/export which is great for interoperability between softwares.

[@Admin-oe8zj]

that not free ... to export fbx from casadeur you need the pro verion and that verion is about 300$

[@IamSH1VA]

*IMORTANT update : you can use older verion than 2024.1 of cascadeur to export fbx, cause after this version they changed their license & plans (like 2 months ago)* This video is almost year old, it was free at that time.. within that their features and plans changed. Also, You can get $99 indie license which is perpertual so you own it... You could have got 2 year free Cascadeur, they were giving it away for free till May for loyal customers(even Free ones).. but now that offer is expired