Free & Easy Mocap with Rokoko Video & Blender Tutorial

Enjoy unlimited AI Powered mocap by Rokoko Video which allows you to enhance your animation workflow at the fair price of 0 DOLLARS :D
If you want to give it a try check it out right here: rokoko.co/BadxStudio
Hope you guys enjoyed this tutorial! There is also a workflow to get this anim to unreal engine 5 so if you guys want that for metahumans, let us know in the comments!
‪@RokokoMotion‬ You guys rock for making this tech free! Can't wait to see how the AI powered solutions improve over the years ...
We also upload cool stuff on our Tiktok & Insta:
/ badxstudio
/ badxstudio
#rokoko #rokokovideo #blender3d #3d #blender #animation #cgi #unrealengine #unrealengine5 #vfx #3danimation #blendercommunity #blendertutorial #mocap #motioncapture

[@dissonanceparadiddle]

This is the stuff that AI is going to help the masses with. Just 10 years ago motion capture was impossibly expensive for the individual but now... now it's crazy just how far it's come in so quick a Time.

[@RomboutVersluijs]

They need stop calling everything AI.

[@unnoficialsatan741]

just don't tell our bosses, mine thinks most of my animations are still handmade

[@dissonanceparadiddle]

@@unnoficialsatan741 absolutely. You're definitely not getting paid enough for how much work you do as I'd I'm sure. Might as well make the job as automatic for you as you can.

[@dissonanceparadiddle]

@@RomboutVersluijs right this is like, 1 part physics simulation 1 part kinematics calculation 1 part some other third thing

[@LambVisionStudios]

Best tutorial on this so far awesome job man I subbed. 😊

[@badxstudio]

Thanks a lot man … appreciate it

[@user-xm7db8yi9v]

Cut recorder when want to select rokoko, the question is, how to get rokoko to combine character and gesture

[@JohnTitor-yh7gu]

And the free part? It's all premium and trial versions

[@dannopalmer6083]

Legit though

[@starplatinum1222]

its free...

[@Kawakajii]

Hi thank you for the video. I did everything but for some reason the in the target tab my character doesn’t appear.. so I can’t target the source. Is there a reason why?

[@ianfavreau9776]

Thank you so much for this tutorial - you made my game that much easier to make!!

[@JD_Playtime]

Great tutorial, but when I try to click on my model to retarget the animation, it's just blank?

[@ansarahmad7196]

I am having an error with the rokoko plugin. At first the I installed the latest version and there was no tab for rokoko. Afterwards I installed beta version of the plugin but now I am getting a new error. After opening the rokoko tab it tells me to download the libararies and when I click on that I get a whole new error. Try running blender as admin and install libraries again. Any Idea how to fix this?

[@lunaizpisuadekissel1820]

how do you add this animation to a real life video you are editing? ie once the animated figure is in blender, how would I export it to overlay it onto my video?

[@brentbagshaw3270]

When I import my 3D model to Maximo it's tiny. I can really only see a dot. Any suggestions?

[@cuentosconmensaje]

great video! I suscribe!!! These types of videos are what give value to KZbin!!!🎊🎊🎊🎊🎊🥳🥳🥳🥳 Btw Happy new year!!!🥳🎊🎊🎊

[@badxstudio]

Thank you! You too! LOVE U!!!! will be making more

[@AnthonyTori]

is this still available on their website or do you need to download their studio now?

[@JayJay3D]

I can see the animation when i open rokoko studio?

[@sarahmargaret7181]

Wondering if you can help with a specific issue. I am trying to attach my rokoko animation to a Sims 4 character rig. The sims 4 character rig is in a blender file. I can open it, I can import the rokoko animation but when I re-target and build bone list, the list stays blank. I'm wondering if I have to export the animation from rokoko in a different way or if there is some other issue causing this. (In your video is seems like you export it specifically to work with Mixamo) If you have any idea on how I can do this, it would be much appreciated. I know its possible, I just can't find any tutorial on how to do it specifically for sims 4 rigs. Thanks! :)

[@ZuzannaFavesDie]

i haven't tried this yet but perhaps once you've got a working rig in, rename all the bones to match with the ts4 rig & copy the rig action over though i see you made this comment a year ago, i'm looking to do the same thing so let me know if you found your own solution or have anything to let me know before i try it myself ^^

[@TechMatra6]

love your enthusiasm❤

[@badxstudio]

Thank yoU!!

[@Trivia2023]

Terrific

[@THEREALPOPTARTKING]

Im very sad it's not working for me idk if im doing it right are wrong :(

[@Malmezo]

Amazing !!! Thank you!!

[@badxstudio]

Our pleasure!

[@magicimaginations]

Wow super cool, going to try this ty 😊😊

[@badxstudio]

Have fun!

[@brandonjacksoon]

Thanks!

[@nurintisya]

How to export it?

[@jamesonvparker]

Amazing! Looking forward to your Unreal tutorial!

[@badxstudio]

Uploading first thng tomorrow mate :)

[@badxstudio]

Heyy brother the unreal tutorial u requested is out! Enjoy

[@badxstudio]

Hey brother sorry the video wiill be up in 2 hours ... the 4k is being processed :)

[@jamesonvparker]

@@badxstudio Wheeeeeeeew!! Thank you!

[@badxstudio]

@@jamesonvparker no problem broski

[@dorothymorris6536]

aw I really wish I could try this out but blender just... freezes when I click on "Retarget Animation". Some more information about how this works would help out a lot: does this need a lot of processing power for a 2 min video? how long should it usually take to process? any setting I can turn on to make it lighter? what's the recommended specs to run this?

[@mrobertson501]

same issue

[@curioVN]

Youre doing God's Work. All the best for your future

[@badxstudio]

LOVE U!

[@3DElitePersona]

cool bro amazing tk

[@rarebellion]

Awesome video! Question, can you do a video on exporting from blender to another platform. When I go to export it, I have to use bvh format, however, when I get to the third party platform it gives me an error of “Unable to read animation file. Incorrect root joint name, use hip.” And it works perfect in blender, not sure where I’m going wrong..but other than that thanks for the vid.

[@badxstudio]

Heyyy so it really depends which platform you are speaking of! Because all these different export settings from Rokoko essentially use the same animation but use different bone names and joints. For instance the bonelist of a mixamo rig is different of one that is Unreal Engine mannequin both of which rokoko export is capable of. For this tutorial we used mixamo export and rigs because thats free and most people are accustomed to it. So in conclusion I guess i wanna know which platform you are trying to export to and also why do you have to do bvh? fbx should work fine in most places :)

[@pericoel21]

​@@badxstudio Some issues you may fix by manually renaming bones, and software like maya and blender have features that make this process easier. This usually is something like: change every "_L" into a ".L" or use numbers with 3 digits instead of two. So I would say: 1- Learn the nomenclature for rigs used in the software you are exporting into. 2- Get familiar with the renaming tools of your software. 3- Make sure you are exporting from Blender in a correct format (i.e.: a format that the other software can read and that can contain animations).

[@lordnaps]

yo bro, great tutorial. i followed it step by step but once i retargeted the animation, the model wasnt linked to the animation at all, it was just flying all over my viewport as though it was linked to some animation which was causing it to move in the first place but just wasnt accurate at all. frustrating because the process seems so simple and straightforward. any tips?

[@lordnaps]

found the solution immediately after lol. if anyone had this issue, i just checked CURRENT for Use Pose instead of REST, found right above the retarget animation button

[@badxstudio]

hahahhah sorry we saw this late but glad u figured it out :D We've been there before were we put it on rest and LOOKED FOR HOURSSSSS trying to figure it out :D hahahhahaha

[@nathancarbajal6783]

My character is bigger then the rig and it expands the character whenever I regather

[@Davincisgarage]

Hey can yu put ur own drawings of cartoons in rokoko to be animated??

[@j.d.8479]

It doesn't work it says to restart blender to update

[@xazarshahverenov6755]

I can't open the recording or video selection section. help me

[@badxstudio]

U mean in rokoko studiio software?

[@psychoticgiraffe]

How do we also add the Apple arkit face tracking to it

[@pericoel21]

I have no idea but I know Corridor Digital does it. Also, I bet the solution is to search for the correct plug in in Blender which can translate the info from arkit. Other thing to keep in mind: Human body rigs tend to be pretty similar from one app to another. Face rigs tend to be more custom, so you might find that your model's face simply cannot be animated, or the arkit controls don't even begin to coincide with the face rig you have in your model. Disclaimer: I replied on a few comments of this video. This is the first one that is pure speculation.

[@sakthilakshmi3808]

Nice video. but for me its not coming properly. the animation are collapsing and not syncing. what i want to do? pls rply me

[@badxstudio]

Are you saying that the animation u get from your video is fine in the ROKOKO STUDIO but when you bring it to blender it messes up?

[@davidsmart3272]

I am always having error when exporting it in fbx in rokoko

[@badxstudio]

What kind of error?

[@nando3d]

Mine keeps making the arms getting inverted and dont move correctly any idea whats wrong? thanks!

[@badxstudio]

Is this in the rokoko studio software? It could possibly be due to the fact that your input video was not optimal .. lighting, your clothes, your movement and all that matter! even video qualiity ... But nonetheless you can always clean up the animation within blender ... should we do a video of that?

[@nando3d]

@@badxstudio That would be greatly appreciated!

[@badxstudio]

@@nando3d Sure we will put that iin the plans

[@Optimusprime-ve7xi]

the hands are not moving at all adn theya re inside the body

[@tamilorejoseph4704]

what can i do if the hands are going inside the body?

[@petit-pedestre2334]

You can easily tidy up the animation by changing the key frames inside of Blender

[@muchalmametta7190]

Yeeeeiii, interesting thing

[@badxstudio]

Thnxx

[@ORTyOW]

Wow, amazing...

[@badxstudio]

Glad you like it!

[@Mastershifu707]

Comment for the Algorithm. Btw Great tutorial. Learned something new today

[@badxstudio]

Thank you susant! Uploading the export to metahumans in the next video for unreal engine!

[@Mastershifu707]

@@badxstudio Best of Luck 🤞 I will watch it

[@percyrogers7246]

I tried to do my own animations on there and its horrible. It is nowhere ready for everyone to use but it is a step closer. They need to get everything working right before even thinking of sending out an update.

[@badxstudio]

Well percy tbh the technology is available for FREE which is why its nuts ... iits current state is not meant to replace the way you animate but to speed it up by giviinig you the main keyframes so you can do the in-betweens. however do check out MOVE AI also if you really are curiiious about where the tech is going :)

[@fabianalifka7595]

i cant find the rokoko page in blender i already install it

[@badxstudio]

Hmmm not sure why that is happening for you? Did you try hitting the N button and looking on the tabs on the right? if that doesnt work maybe try to download a different version of blender and install the addon again?

[@fabianalifka7595]

@@badxstudio me bad i frogot to enable it

[@SageCrispin]

Great vid-thanks. FYI, audio cuts out at end.

[@badxstudio]

Hey man thnx for letting me know yeah that was because i added a copyrighted music

[@praneethruthprabhu8719]

Is it free?

[@alexzagoren6864]

it won't put my scene into Rokoko Studios

[@di5031]

Что за трек?

[@androzons]

Thank you, easy to understand,now I don't need to buy the suit

[@badxstudio]

Glad it helped u man! Just be aware that this is still as of Dec 2022 not going to beat the fidelity of a suit! However I bet with the rapid tech advancement in AI we believe soon it just might :D

[@wirawhitebelt7364]

👍

[@gothiceltic]

Voilà super je me filme et hop. Merci. Thank you.

[@badxstudio]

Vous avez deja essaye rokoko video?? De rien

[@arrahman3321]

I hope this video viral

[@badxstudio]

Love yaaa

[@silentstormstudio4782]

root bone missing error , cant believe i got this far

[@terryrhuebottom]

The examples here have some crazy puppet like look to the motions. It's really cool. But a little concerning.

[@lovelylonerboy7156]

Can you do walk cycle like this

[@pericoel21]

Technically, yes. But: Usually a walk cycle is a loop. The video might be a loop too, in that case it might be easy to tweak the animation keyframes by hand so the final product loops. Though, none of the software pieces used in this video "thinks" that you are actually making a loop. So, you probably have to tweak things by hand anyway. Keep in mind: the techniques shown in this video are super cool, especially in the case that you cannot find a pre-made animation that suits your project. But Mixamo (one of the webs shown in this vid) has loads of animations, some of them are walk cycles. Loops. I know the mocap technique shown here is super quick, but for many cases you can solve your needs even faster: go to Mixamo and search for your walk cycle.

[@lookingforfreewifi]

for whatever reason, my character is missing his colors, it's just a white model =/

[@badxstudio]

U mean after u get it from mixamo? if you have the original character then just bring iit side by side then click the white one and then shift click the original one and use CNTRL + L .. then copy materials :) if u need to just look for how to copy materials on utube

[@lookingforfreewifi]

@@badxstudio I am vacation right now and didn't bring my Laptop, but I will try it once I'm back. That's a great suggestion, thank you man!

[@AWetPanda]

This is just having too many difficulties for me, the animation doesn't look right, arms are broken.

[@kartiksaxena2515]

its a 3 min video but took me 3hrs to do it and that too didnt make it but would try again

[@badxstudio]

Hahahaha why 3 hours? Do you need help? Ask any questions if u need :)

[@kartiksaxena2515]

@@badxstudio i was talking about the whole installation process, downloading models but i tried it on a model but the movement is not as exact ,the hands are crossing the body from middle and i dont know the error of repetition of bone use in the bone list where can i show you ?

[@pericoel21]

@@kartiksaxena2515 Good luck! Also, maybe try to do just a few steps of the process: Make sure you're able to import and export fully rigged and animated models from Mixamo. If everything works, come here again and try to go over the full process!

[@MrGamelover23]

This could be amazing for Vtubers.

[@badxstudio]

Right?? Thing is they need to make this realtime first

[@MrGamelover23]

​@@badxstudioWell, do I have some news for you. Xranimator and warudo BOTH use Google's media pipe to do full body motion tracking in real time. And with a couple of blender plugins, you could theoretically make it work in blender in real time. Dollars mocap made a couple videos on this, but since it's using the VMC protocol, which both of the aforementioned programs support, you could theoretically use either one.

[@harem137]

Im a old skool blenderer im just looking at all the support right now! and Man mocap transfering just went childs play....when i started there was no Mocaps....

[@badxstudio]

Lol its super easy now :D

[@TheOscarGamer_]

Hope it works for me 🙏🙏

[@badxstudio]

❤️❤️

[@suman_de]

Doesn't work anymore. Seems like Rokoko doesn't want us to use it for free.

[@funnyslimworld1487]

Niggas just don’t know the struggle, don’t worry bro this video helped me out, I hate animation

[@badxstudio]

Im glad it did brother

[@funnyslimworld1487]

@@badxstudio blender

[@badxstudio]

@@funnyslimworld1487 Oh then this tutorial should be just fine for ya! Only saying because importing to unreal is a lil more difficult and we are releasing a tutorial specifically for that too! Thought you might be interested

[@no_damage]

lol watch when you do the same thing its going to look messed up

[@patfish3291]

This KI Tools still needs a lot of work to transfer real movements - yes, it's 70% but the last % are the hard part to do

[@badxstudio]

Well you can imagine how much this could help in pre-vis or storyboarding alone where you want to just pitch an idea of animation but dont want to actually hand animate everything! Not to mention AI technology is one that grows every single day so one can only imagine how this will turn out to be in 1 year time. The point here is that Rokoko is making an effort to democratize mocap and make it free and accessible where many companies charge for the same service.

[@patfish3291]

@@badxstudio One year is too fast but 5 years more than realistic

[@michaeltyers7336]

I feel like this won't be free forever. It'll be free so long as there's still plenty of people out there who can still animate from scratch.

[@StickyLabDev]

i failed

[@starwarz8479]

Wow the animation looks really bad, it'll require lots of clean ups, but I think that's the point to get ppl to buy their suit

[@Phant0mFreshBread]

It’s probably because of the baggy clothing and the background not being simple.

[@marcelfusco6128]

Can you please, please shout even louder? I still have some hearing in my eardrum! 🙄

[@badxstudio]

Sure thing! Will definitely consider that :D

[@anaisbdx]

The end result looks pretty bad, honestly. Technically interesting, but unusable for a real life project.

[@DidacticEditions]

Cut the crap and advertise your masters for they offer. You can't do any of this for free. It's 240 a year.

[@Hydrotoxic]

Ive never seen any of these AI mocap videos look good. It's basically a useless impractical toy. You might as well learn to animate

[@badxstudio]

Well the one from MOVE AI actually does beat out many mocap tools out there with just a few cameras. Now in the case of a free tool like this, it's not meant to replace manual animation, but rather help with the blocking phase so you have a base to begin with and then you can go ahead and add your own flavour to it. At least this is what we've found from our experiences :)

[@sichtbeton]

Stop shouting.