Free & Easy Mocap with Rokoko Video & Blender Tutorial

[@dissonanceparadiddle]

This is the stuff that AI is going to help the masses with. Just 10 years ago motion capture was impossibly expensive for the individual but now... now it's crazy just how far it's come in so quick a Time.

[@RomboutVersluijs]

They need stop calling everything AI.

[@unnoficialsatan741]

just don't tell our bosses, mine thinks most of my animations are still handmade

[@dissonanceparadiddle]

@@unnoficialsatan741 absolutely. You're definitely not getting paid enough for how much work you do as I'd I'm sure. Might as well make the job as automatic for you as you can.

[@dissonanceparadiddle]

@@RomboutVersluijs right this is like, 1 part physics simulation 1 part kinematics calculation 1 part some other third thing

[@JohnTitor-yh7gu]

And the free part? It's all premium and trial versions

[@dannopalmer6083]

Legit though

[@starplatinum1222]

its free...

[@LambVisionStudios]

Best tutorial on this so far awesome job man I subbed. 😊

[@badxstudio]

Thanks a lot man … appreciate it

[@KadalYuki]

Cut recorder when want to select rokoko, the question is, how to get rokoko to combine character and gesture

[@TechMatra6]

love your enthusiasm❤

[@badxstudio]

Thank yoU!!

[@SimmerJonny]

Great tutorial, but when I try to click on my model to retarget the animation, it's just blank?

[@cuentosconmensaje]

great video! I suscribe!!! These types of videos are what give value to KZbin!!!🎊🎊🎊🎊🎊🥳🥳🥳🥳 Btw Happy new year!!!🥳🎊🎊🎊

[@badxstudio]

Thank you! You too! LOVE U!!!! will be making more

[@ianfavreau9776]

Thank you so much for this tutorial - you made my game that much easier to make!!

[@AnthonyTori]

is this still available on their website or do you need to download their studio now?

[@androzons]

Thank you, easy to understand,now I don't need to buy the suit

[@badxstudio]

Glad it helped u man! Just be aware that this is still as of Dec 2022 not going to beat the fidelity of a suit! However I bet with the rapid tech advancement in AI we believe soon it just might :D

[@curioVN]

Youre doing God's Work. All the best for your future

[@badxstudio]

LOVE U!

[@gamers_repblic]

Thank you so much you have earned subscriber

[@Trivia2023]

Terrific

[@percyrogers7246]

I tried to do my own animations on there and its horrible. It is nowhere ready for everyone to use but it is a step closer. They need to get everything working right before even thinking of sending out an update.

[@badxstudio]

Well percy tbh the technology is available for FREE which is why its nuts ... iits current state is not meant to replace the way you animate but to speed it up by giviinig you the main keyframes so you can do the in-betweens. however do check out MOVE AI also if you really are curiiious about where the tech is going :)

[@dorothymorris6536]

aw I really wish I could try this out but blender just... freezes when I click on "Retarget Animation". Some more information about how this works would help out a lot: does this need a lot of processing power for a 2 min video? how long should it usually take to process? any setting I can turn on to make it lighter? what's the recommended specs to run this?

[@mrobertson501]

same issue

[@Malmezo]

Amazing !!! Thank you!!

[@badxstudio]

Our pleasure!

[@jadpaulelias790]

Can you use KZbin videos too?

[@JayJay3D]

I can see the animation when i open rokoko studio?

[@MohammadRajabloo]

what about facial animation?

[@jamesonvparker]

Amazing! Looking forward to your Unreal tutorial!

[@badxstudio]

Uploading first thng tomorrow mate :)

[@badxstudio]

Heyy brother the unreal tutorial u requested is out! Enjoy

[@badxstudio]

Hey brother sorry the video wiill be up in 2 hours ... the 4k is being processed :)

[@jamesonvparker]

@@badxstudio Wheeeeeeeew!! Thank you!

[@badxstudio]

@@jamesonvparker no problem broski

[@ORTyOW]

Wow, amazing...

[@badxstudio]

Glad you like it!

[@brandonjacksoon]

Thanks!

[@Davincisgarage]

Hey can yu put ur own drawings of cartoons in rokoko to be animated??

[@arrahman33333]

I hope this video viral

[@badxstudio]

Love yaaa

[@Mastershifu707]

Comment for the Algorithm. Btw Great tutorial. Learned something new today

[@badxstudio]

Thank you susant! Uploading the export to metahumans in the next video for unreal engine!

[@Mastershifu707]

@@badxstudio Best of Luck 🤞 I will watch it

[@sarahmargaret7181]

Wondering if you can help with a specific issue. I am trying to attach my rokoko animation to a Sims 4 character rig. The sims 4 character rig is in a blender file. I can open it, I can import the rokoko animation but when I re-target and build bone list, the list stays blank. I'm wondering if I have to export the animation from rokoko in a different way or if there is some other issue causing this. (In your video is seems like you export it specifically to work with Mixamo) If you have any idea on how I can do this, it would be much appreciated. I know its possible, I just can't find any tutorial on how to do it specifically for sims 4 rigs. Thanks! :)

[@ZuzannaFavesDie]

i haven't tried this yet but perhaps once you've got a working rig in, rename all the bones to match with the ts4 rig & copy the rig action over though i see you made this comment a year ago, i'm looking to do the same thing so let me know if you found your own solution or have anything to let me know before i try it myself ^^

[@magicimaginations]

Wow super cool, going to try this ty 😊😊

[@badxstudio]

Have fun!

[@TheRealWolfCap]

Im very sad it's not working for me idk if im doing it right are wrong :(

[@beranekthekid]

How to export and add this to an actual video? great video though:)

[@Kawakajii]

Hi thank you for the video. I did everything but for some reason the in the target tab my character doesn’t appear.. so I can’t target the source. Is there a reason why?

[@3DElitePersona]

cool bro amazing tk

[@Mans_Ruin-s9n]

When I did it, the video was slow and blurred

[@psychoticgiraffe]

How do we also add the Apple arkit face tracking to it

[@pericoel21]

I have no idea but I know Corridor Digital does it. Also, I bet the solution is to search for the correct plug in in Blender which can translate the info from arkit. Other thing to keep in mind: Human body rigs tend to be pretty similar from one app to another. Face rigs tend to be more custom, so you might find that your model's face simply cannot be animated, or the arkit controls don't even begin to coincide with the face rig you have in your model. Disclaimer: I replied on a few comments of this video. This is the first one that is pure speculation.

[@sakthilakshmi3808]

Nice video. but for me its not coming properly. the animation are collapsing and not syncing. what i want to do? pls rply me

[@badxstudio]

Are you saying that the animation u get from your video is fine in the ROKOKO STUDIO but when you bring it to blender it messes up?

[@lunaizpisuadekissel1820]

how do you add this animation to a real life video you are editing? ie once the animated figure is in blender, how would I export it to overlay it onto my video?

[@brentbagshaw3270]

When I import my 3D model to Maximo it's tiny. I can really only see a dot. Any suggestions?

[@xazarshahverenov6755]

I can't open the recording or video selection section. help me

[@badxstudio]

U mean in rokoko studiio software?

[@lordnaps]

yo bro, great tutorial. i followed it step by step but once i retargeted the animation, the model wasnt linked to the animation at all, it was just flying all over my viewport as though it was linked to some animation which was causing it to move in the first place but just wasnt accurate at all. frustrating because the process seems so simple and straightforward. any tips?

[@lordnaps]

found the solution immediately after lol. if anyone had this issue, i just checked CURRENT for Use Pose instead of REST, found right above the retarget animation button

[@badxstudio]

hahahhah sorry we saw this late but glad u figured it out :D We've been there before were we put it on rest and LOOKED FOR HOURSSSSS trying to figure it out :D hahahhahaha

[@TheOscarGamer_]

Hope it works for me 🙏🙏

[@badxstudio]

❤️❤️

[@surgeofenyx]

I am having an error with the rokoko plugin. At first the I installed the latest version and there was no tab for rokoko. Afterwards I installed beta version of the plugin but now I am getting a new error. After opening the rokoko tab it tells me to download the libararies and when I click on that I get a whole new error. Try running blender as admin and install libraries again. Any Idea how to fix this?

[@SageCrispin]

Great vid-thanks. FYI, audio cuts out at end.

[@badxstudio]

Hey man thnx for letting me know yeah that was because i added a copyrighted music

[@ShiveringTales-t1y]

Mine keeps making the arms getting inverted and dont move correctly any idea whats wrong? thanks!

[@badxstudio]

Is this in the rokoko studio software? It could possibly be due to the fact that your input video was not optimal .. lighting, your clothes, your movement and all that matter! even video qualiity ... But nonetheless you can always clean up the animation within blender ... should we do a video of that?

[@ShiveringTales-t1y]

@@badxstudio That would be greatly appreciated!

[@badxstudio]

@@ShiveringTales-t1y Sure we will put that iin the plans

[@nathancarbajal6783]

My character is bigger then the rig and it expands the character whenever I regather

[@nurintisya]

How to export it?

[@silentstormstudio4782]

root bone missing error , cant believe i got this far

[@fabianalifka7595]

i cant find the rokoko page in blender i already install it

[@badxstudio]

Hmmm not sure why that is happening for you? Did you try hitting the N button and looking on the tabs on the right? if that doesnt work maybe try to download a different version of blender and install the addon again?

[@fabianalifka7595]

@@badxstudio me bad i frogot to enable it

[@BenjaminLimachi]

alguien saben por que rokoko dice que registrara togo que haga en la internet no cren que es extraño

[@tamilorejoseph4704]

what can i do if the hands are going inside the body?

[@petit-pedestre2334]

You can easily tidy up the animation by changing the key frames inside of Blender

[@terryrhuebottom]

The examples here have some crazy puppet like look to the motions. It's really cool. But a little concerning.

[@j.d.8479]

It doesn't work it says to restart blender to update

[@kartiksaxena2515]

its a 3 min video but took me 3hrs to do it and that too didnt make it but would try again

[@badxstudio]

Hahahaha why 3 hours? Do you need help? Ask any questions if u need :)

[@kartiksaxena2515]

@@badxstudio i was talking about the whole installation process, downloading models but i tried it on a model but the movement is not as exact ,the hands are crossing the body from middle and i dont know the error of repetition of bone use in the bone list where can i show you ?

[@pericoel21]

@@kartiksaxena2515 Good luck! Also, maybe try to do just a few steps of the process: Make sure you're able to import and export fully rigged and animated models from Mixamo. If everything works, come here again and try to go over the full process!

[@MrGamelover23]

This could be amazing for Vtubers.

[@badxstudio]

Right?? Thing is they need to make this realtime first

[@MrGamelover23]

​@@badxstudioWell, do I have some news for you. Xranimator and warudo BOTH use Google's media pipe to do full body motion tracking in real time. And with a couple of blender plugins, you could theoretically make it work in blender in real time. Dollars mocap made a couple videos on this, but since it's using the VMC protocol, which both of the aforementioned programs support, you could theoretically use either one.

[@rarebellion]

Awesome video! Question, can you do a video on exporting from blender to another platform. When I go to export it, I have to use bvh format, however, when I get to the third party platform it gives me an error of “Unable to read animation file. Incorrect root joint name, use hip.” And it works perfect in blender, not sure where I’m going wrong..but other than that thanks for the vid.

[@badxstudio]

Heyyy so it really depends which platform you are speaking of! Because all these different export settings from Rokoko essentially use the same animation but use different bone names and joints. For instance the bonelist of a mixamo rig is different of one that is Unreal Engine mannequin both of which rokoko export is capable of. For this tutorial we used mixamo export and rigs because thats free and most people are accustomed to it. So in conclusion I guess i wanna know which platform you are trying to export to and also why do you have to do bvh? fbx should work fine in most places :)

[@pericoel21]

​@@badxstudio Some issues you may fix by manually renaming bones, and software like maya and blender have features that make this process easier. This usually is something like: change every "_L" into a ".L" or use numbers with 3 digits instead of two. So I would say: 1- Learn the nomenclature for rigs used in the software you are exporting into. 2- Get familiar with the renaming tools of your software. 3- Make sure you are exporting from Blender in a correct format (i.e.: a format that the other software can read and that can contain animations).

[@davidsmart3272]

I am always having error when exporting it in fbx in rokoko

[@badxstudio]

What kind of error?

[@Optimusprime-ve7xi]

the hands are not moving at all adn theya re inside the body

[@thesecretsofjordan]

Can you do walk cycle like this

[@pericoel21]

Technically, yes. But: Usually a walk cycle is a loop. The video might be a loop too, in that case it might be easy to tweak the animation keyframes by hand so the final product loops. Though, none of the software pieces used in this video "thinks" that you are actually making a loop. So, you probably have to tweak things by hand anyway. Keep in mind: the techniques shown in this video are super cool, especially in the case that you cannot find a pre-made animation that suits your project. But Mixamo (one of the webs shown in this vid) has loads of animations, some of them are walk cycles. Loops. I know the mocap technique shown here is super quick, but for many cases you can solve your needs even faster: go to Mixamo and search for your walk cycle.

[@gothiceltic]

Voilà super je me filme et hop. Merci. Thank you.

[@badxstudio]

Vous avez deja essaye rokoko video?? De rien

[@michaeltyers7336]

I feel like this won't be free forever. It'll be free so long as there's still plenty of people out there who can still animate from scratch.

[@harem137]

Im a old skool blenderer im just looking at all the support right now! and Man mocap transfering just went childs play....when i started there was no Mocaps....

[@badxstudio]

Lol its super easy now :D

[@di5031]

Что за трек?

[@alexzagoren6864]

it won't put my scene into Rokoko Studios

[@funnyslimworld1487]

Niggas just don’t know the struggle, don’t worry bro this video helped me out, I hate animation

[@badxstudio]

Im glad it did brother

[@funnyslimworld1487]

@@badxstudio blender

[@badxstudio]

@@funnyslimworld1487 Oh then this tutorial should be just fine for ya! Only saying because importing to unreal is a lil more difficult and we are releasing a tutorial specifically for that too! Thought you might be interested

[@muchalmametta7190]

Yeeeeiii, interesting thing

[@badxstudio]

Thnxx

[@praneethruthprabhu8719]

Is it free?

[@wirawhitebelt7364]

👍

[@no_damage]

lol watch when you do the same thing its going to look messed up

[@suman_de]

Doesn't work anymore. Seems like Rokoko doesn't want us to use it for free.

[@AWetPanda]

This is just having too many difficulties for me, the animation doesn't look right, arms are broken.

[@patfish3291]

This KI Tools still needs a lot of work to transfer real movements - yes, it's 70% but the last % are the hard part to do

[@badxstudio]

Well you can imagine how much this could help in pre-vis or storyboarding alone where you want to just pitch an idea of animation but dont want to actually hand animate everything! Not to mention AI technology is one that grows every single day so one can only imagine how this will turn out to be in 1 year time. The point here is that Rokoko is making an effort to democratize mocap and make it free and accessible where many companies charge for the same service.

[@patfish3291]

@@badxstudio One year is too fast but 5 years more than realistic

[@starwarz8479]

Wow the animation looks really bad, it'll require lots of clean ups, but I think that's the point to get ppl to buy their suit

[@Phant0mFreshBread]

It’s probably because of the baggy clothing and the background not being simple.

[@StickyLabDev]

i failed

[@MlleJinx]

Fake

[@marcelfusco6128]

Can you please, please shout even louder? I still have some hearing in my eardrum! 🙄

[@badxstudio]

Sure thing! Will definitely consider that :D

[@Hydrotoxic]

Ive never seen any of these AI mocap videos look good. It's basically a useless impractical toy. You might as well learn to animate

[@badxstudio]

Well the one from MOVE AI actually does beat out many mocap tools out there with just a few cameras. Now in the case of a free tool like this, it's not meant to replace manual animation, but rather help with the blocking phase so you have a base to begin with and then you can go ahead and add your own flavour to it. At least this is what we've found from our experiences :)

[@anaisbdx]

The end result looks pretty bad, honestly. Technically interesting, but unusable for a real life project.

[@robertdouble559]

Very stiff, a lot of popping. Better than nothing I guess. Needs a LOT of cleanup.

[@DidacticEditions]

Cut the crap and advertise your masters for they offer. You can't do any of this for free. It's 240 a year.

[@sichtbeton]

Stop shouting.