35 | Tutorial | Rokoko Video to Metahuman | Unreal Engine 5.1

[@n.j.presents5310]

This is the only lesson that worked from beginning to end. Thank you very much GOD of Unreal.

[@itsMBWAAA]

You can clean up any feet jank in Cascadeur as well. I am no pro at it by any means, but it does seem like a huge time saver to take your base mocap data and then move it to Cascadeur to clean up and interpolate any jitters/ trembles whatever Thanks for the video! liked and subbed!

[@Lrakshlaw]

Thank you. I followed this religiously and it really helped! X

[@jamesmcandrew7860]

This was the most helpful thing! Thank you so much!!! I really appreciate you for making this so well!

[@ksunnywazowski]

THANks!!! I had a lot of fun!!! At the end when I try fix my animation when i move legs the head moves tooo. It unreal funny :D

[@shadowgames50]

This is the only tutorial that works, tysm I was loosing my mind

[@stefanskillzpeev]

This is how you make a tutorial! Awesome! Thanks!

[@bakedmystic3D]

Glad it was helpful!

[@Andreas28]

If you cant see the bones when you do the retargetting, go to character -> bones -> all hierarchy

[@sakarias00]

i love you omfg

[@javieroryan9797]

just lookihg for this, many thanks.

[@bakedmystic3D]

Glad to help

[@vjnaoconsta7036]

great tutotial!

[@adnanezaouadi5121]

really really cool mate!

[@bakedmystic3D]

Thanks a lot!

[@alan112223]

Thank you and Happy New Year!

[@bakedmystic3D]

Happy new year to you too!

[@David_Tangarife]

Master! Thank you so much!

[@upcomingvillain]

Thank you for the tut! Question if you were going to start adding 2nd and 3rd animation clips, would it be easier to set up the next ones or does this whole process start over for each animation clip?

[@bakedmystic3D]

Depends. If you use the same skeleton then it will be the same. You just select the old skeleton when importing the new animation.

[@upcomingvillain]

@@bakedmystic3D thank you!

[@alisamini]

Amazing! Thanks.

[@recursivedreamer3149]

Thank you so much for this video. It was simple and to the point... you are a god among men.

[@mokasiri]

Where have you been all this time!!

[@kyungseomin]

Hi! Super appreciate the tutorial! I have a question at 9:42. On my screen, I don't see the "source/target" window which is at the left side of your screen. Any idea??

[@lamarhillll]

that's new in Unreal Engine 5.1. You probably have an older version

[@beyondcinema]

Great tutorial mate!

[@bakedmystic3D]

Glad you enjoyed it! 😁

[@JohnToenjes]

my metahuman f_med_nrw_body is much shorter than my rokoko animation model. But the animation still retargets perfectly. BUT in 5.1 I have a bug that I have to move the window with my mouse to get the animation to play!!

[@bakedmystic3D]

The new retargeting system pretty much retargets without issues between different sized models. It is pretty cool. Regarding UE5.1, I am unsure that specific issue. I haven't used it much and whenever I use it, there is some bug or the other. I am still waiting for them to fix foliage on it which crashes my Editor as soon as I try to add any plant.

[@blairzettl3933]

If you want it to look perfect, you can also pull the ANIM into Cascadeur the export / import the final product into Unreal.

[@chinonsopromise4962]

please can you recommend a tutorial on how i can get that done Thanks

[@blairzettl3933]

@@chinonsopromise4962 I don’t think there is one. Just save out your character with animation as an FBX and then import. I use MoBu for assembly so files are natively fbx.

[@alexgd6161]

Thank you for this tutorial ! Following you way, how could you keep a T-pose / A-pose for the start animation ?

[@nishantKumar-ft6cl]

Thanks For this wonderful tutorial, I create Animation first time for my game , and successfully . Only thing how can I improve the finger animation properly like pointing something by finger?

[@bakedmystic3D]

So, I am not sure if rokoko video records finger animations. One way to do it would be to select the control rig controls you would want to manipulate and store them as poses. You could then easily go between different finger poses and keyframe them over time to get your fingers animating. Also, a good way to easily select fingers is to use the control rig picker tool. Let me know if you need a video on this and I would be glad to put one out.

[@alexgd6161]

@@bakedmystic3D Hey It would be very usefull and nice complement to this nice tutorial

[@jeffdavies2824]

UE 5.1.1 Import dialog demansds I select a skekleton before it will import an Mixamo FBX generated by Rokoko studio. Am I missing a detail? TIA!

[@rafl2627]

Hello, I did the tutorial step by step, but when I have to add the MH_Custom_New_Recording_1_mixamo_anim file, the animation does not appear in the list, can you help me please, I only need that step, thanks

[@nghile7219]

Hello thank you for great tutorial. But i have a question how to assign finger too?

[@bumpedwithchildrenfba7294]

Hello. When i import from rokoko to UE5 , there are only skeletons and meshes- doesnt import my animation sequence - any tips ?

[@bakedmystic3D]

Did you check the box to export along with body mesh in rokoko? Maybe that is causing the issue? Another issue could be not selecting "import mesh" option in the import dialogue box inside UE5. Let me know if these help.

[@gabrielkungfushaolin]

I have a problem with this rokoko program after I make a video the video does not appear in the program do you know why?

[@bkunal88]

We live in an era where unbelievable realtime renders can happen locally with consumer grade hardware like 3060 graphics card, and I cannot figure out why do we need to upload the data to the server, Why can't we run it locally?

[@GaradrielS]

Hey, I have a problem: the Animation Sequence is missing whenever I import the fbx in UE5. Moreover, this might not be related but, in Rokoko Studio, I cannot select the "Body Skeleton" option when exporting, that option is disabled. Can someone help me please? Thank you.

[@TopFlightGeneral0220]

Make sure to check the "Import Animation" box when you try to import

[@ultimabrines]

@@TopFlightGeneral0220 thanks!

[@thedeadvision]

on 10:25 i don't have an option for 'edit mode' im using version 5.3 where can i find it ?

[@Iain_Sunday]

I used live link to animate the face first but when I put the body animation in, the head becomes separate. How do I fix this? Great tutorial btw 👍

[@Studio_Reborne]

4 months late but Unchecking "Stream Head Rotation" in the app should fix that

[@FPChris]

So I wasted $3k on the suit?

[@bakedmystic3D]

Nop! Video mocap is still nowhere near suit based one. Lots of small issues with video which would take anyone a decent amount of time to fix to get something good. Suit, on the hand, would save you a lot time which you could use to focus on the actual art and not waste on cleaning and troubleshooting.

[@itsharryk7449]

So I gotta do this for every anim?

[@bakedmystic3D]

I am not sure what you mean by "this" but if you are asking about recording video and using rokoko studio then yes, for every anim. But if it is just retargeting then that is not as much work. Only the first time takes a bit of effort

[@JohnToenjes]

How do you get this sequence to play in a level? I can't seem to get it to play once I've created it. Do you have a tutorial taking this into a level and making it play? thanks.

[@matthewperry3366]

Did you make the character spawnable in the sequencer? I overlook that all the time.

[@JohnToenjes]

@@matthewperry3366 Thank you SO much, that did it! I was going nuts trying to get it to work.

[@matthewperry3366]

@@JohnToenjes Awesome!👍

[@kontrolthetown]

the feet on my meta human do not touch the ground how do i edit this

[@bakedmystic3D]

For now you can add an additive control rig layer and add in keyframes to fix this. Even I am struggling with some videos having floating and sliding feet issue despite the feet lock feature of rokoko studio. Need to look into it a bit more.

[@ZakariaKhaldi]

I don't know why metahuman animation aren't smooth like AAA Games animation.

[@bakedmystic3D]

Depends on what you are comparing against. Do you mean cinematic scenes in AAA games? There can be various reasons for that - quality of motion capture, quality of edit of the animation, mood of the environment, composition, etc, etc.. The point is you will never see a simple retargeted animation into a metahuman resemble a finished cinematic from any game...

[@Manuschan]

Tq very much bro can u saw like this about face

[@bakedmystic3D]

I have not tried the face yet but I think it would work in a similar manner. You can then combine it with NVIDIA Audio2Face to get the whole thing working.

[@ilkclub]

In my rokoko studio, no option for body skeleton in export section, also just rokoko newton in skeleton preset... Help

[@bakedmystic3D]

That seems like an issue with multiple possible reasons. I would try these things to see if it gets fixed - check if I am using the latest version of rokoko studio beta, check that I am connected to the internet, check that the export format is fbx and not bvh (bvh has limited export options). If all of this doesn't fix my issue then I would reinstall the software.

[@oniseikeji6023]

Same issue ...have you been able to fix?

[@MegaKhaitan1]

Bro, I just wasted 2 hours uninstalling and installing rokoko studio for the same issue. The solution is "CLICK ON THE DROPDOWN ARROW". The UI design for the dropdown list is so bad.

[@ilkclub]

@@MegaKhaitan1 Dropdown list in rokoko export section sometimes selectable sometimes unselectable.

[@ilkclub]

@@oniseikeji6023 Dropdown list in rokoko export section in right side panel skeleton preset sometimes selectable sometimes unselectable.

[@borisstengele5389]

[@vid828]

Friend how do I contact you? I want to pay you to take a few zoom calls to help me with my perosnal project.

[@lmzsource]

nope