Rokoko AI: easy Free Mocap from Video

[@CGDive]

🔥Rokoko has kindly provided a discount for CGDive viewers! Get 10% OFF Rokoko Gear using code *RKK_CGDIVE* at checkout. glnk.io/3vn51/cgdive

[@_s_s_world_]

the only channel I need to understand rig/mocap/animate technique

[@miniMasud]

Amazing tutorial as always. Thank you so much Todor.

[@osaka6814]

Great video. Look forward to your next videos about rokoko! I've already tested Rokoko AI but it's still weird and awkward. I believe that technology gets better. Also hoping to create and re target armature's animations generated by texts in the future.

[@TheZahnputz]

really cool, thanks!

[@thomasfrose]

"One more paper down the line" and "What a time to be alive". Nice reference to @TwoMinutePapers 😄

[@CGDive]

high five!

[@alan112223]

Thank you

[@jinn_animation]

i have to try this

[@ShaunOwens]

When using the plugin, when you click regather animation does it take awhile to load?

[@CGDive]

Which plugin and where do you press retarget animation? :D

[@NycroLP]

Hey, will you also cover Cascadeur? It just released recently and looks very promising as well.

[@cynth4941]

I also wanted a video on Cascadeur. Seems right up CGDive's alley

[@CGDive]

Yeah, it looks amazing. Really want to find the time to review it properly.

[@GarviHere]

Really looking forward to it

[@roguecherry]

Definitely would be great to see you break down a rigify to cascadeur and back workflow.

[@npan40]

Does it work well with videos that only show the upper body?

[@CGDive]

It may not but the legs may behave erratically.

[@llYuki0okami]

there is also "OpenPose" AI Motion Capture

[@CGDive]

Thanks, will check it out!

[@CGDive]

Ah, OpenPose's license is for non-commercial use.

[@MaxStudioCG2023]

avatary have better option and they released free version too (the rokoko is good too but the character from video from the front is ok but when move it to the side the character is bind over to the front ,inclined character)

[@CGDive]

avatary is facial mocap, isn't it?

[@MaxStudioCG2023]

@@CGDive it have a free option where you can upload any video and make a animation just like rokoko but is better :D check it out

[@CGDive]

@@MaxStudioCG2023 Nice, thanks for the info!

[@MaxStudioCG2023]

@@CGDive np

[@MaxStudioCG2023]

@@yahammmm if i remember there is an option on the software called livedrive

[@professorfx.]

Sir the application is not open. It stays in the loading screen. Please tell me any solution sir 🙁🙁😟

[@CGDive]

Please contact Rokoko about that. I'm just a tutorial guy.

[@vahnvallain]

How to motion capture a fighting scene?

[@AaronTaylor-un4sf]

Is it a common issue for rokoko web not to sync to the app? I keep recording videos on the web application and I can't even access it when I open the desktop app. I know it's in the early stages. It's a good concept but still kind of sucks. The UI is really bad and it's not very user friendly.

[@CGDive]

Make sure you're using the beta desktop app. The legacy one doesn't import AI mocap.

[@PrinceWesterburg]

If its an online service it basicallyu means you are building them ahuge motion repository for free! I'd prefer a downloadable AI tool that did the job offline, mainly as it will still be there tomorrow. Who needs to quote for a job then discover that 'free' tool is expensive or gone?! Thanks for the heads up though, might well play with this over Christmas

[@workflowinmind]

I feel like this is the new model of software companies unfortunately... Build hype on a free version, become part of the user's workflow, and then BAM ask for a fee once you"re used to it...

[@CGDive]

Yeah. There are some offline tools but they are hard to set up and often their license is for non-commercial use only...

[@RuniDjurhuus]

Does it work for daz 3d

[@CGDive]

No idea.

[@ihassan1001]

The only issue with all these mocap is that their is a lean on all models and I am not sure how to clean that up

[@CGDive]

True. I shared some techniques to fix that in this video. kzbin.info/www/bejne/p33Jo6Wqf7OKhpo

[@iBlueHood]

Has anyone else had the issue of the captures leaning forward when recording using Rokoko AI?

[@CGDive]

I think I know what you mean. Since Rokoko AI does not have any settings it must be a case of the AI not reading the footage correctly. You could report that to Rokoko and they may use your feedback to make future improvements to the software.

[@iBlueHood]

@@CGDive thanks for your reply! Yes I was wondering since it’s the AI and not a suit maybe didn’t didn’t quite understand the 3D position, I will do that. Thank you for the great video I’ve learnt a lot already!

[@maker2661]

will you ever consider adding bendy bones to spines? its alot better than the current spine controls since its alot more flexible to control. Like if you bend the hip, the rest of the spine with bend with it and the end of the spine chain will track the location of the spine master controller. And you can make it game engine compatible too.

[@CGDive]

Is this a general question or related to something specific? In general. yes, bendy bones and spines can work well together.

[@maker2661]

@@CGDive it is related to the addon

[@CGDive]

@@maker2661 Which addon? This video is about Rokoko AI.

[@maker2661]

@@CGDive auto rig pro

[@CGDive]

@@maker2661 so I'm a bit confused but I think you think that I am the creator of auto rig pro. I'm not :) I just make tutorials about it among other things. Make sure to ask the actual developer on Blender Market

[@llYuki0okami]

plask no free anymore? that is really bad, after little correction its result was perfect

[@CGDive]

They have a limited free version. Rokoko's results are similar IMHO

[@ScorgeRudess]

This is two minute papers with doctor karoly ;)

[@CGDive]

haha yes! :D

[@matchdance]

I have the suit and gloves and I really wish they can combine it with this AI. Arm placement for the suit is not as accurate as this AI.

[@CGDive]

Ah that's a good idea. Suit +ai could be a winner.

[@pawpotsRS]

now this is what you call an AI and not those uhm.

[@Pos44Dami]

freemocap ? i don't try the solution, but its look like in developement

[@CGDive]

I think you can use it but there is no user friendly interface. I could be wrong tho

[@fictionplus]

AI really doing its thing lol

[@CGDive]

Indeed haha

[@longpinkytoes]

suit or suite xP

[@CGDive]

I always mix them up 😂

[@THEWORLD64E]

I logged in to the site, and within two days, a security alert came from Google, clearly indicating that the site had tried to hack my Google account You must be careful

[@CGDive]

I highly doubt Rokoko tried to hack you. If anything they might have been hacked. Report the problem to them.

[@metachanneleducation]

This tool is not really realizable... It is constantly requesting updates... and updates...After installing it, I deleted it. Better using Autodesk Motion Builder or even Mixamo.

[@CGDive]

Did you use the beta? If you experience bugs, report them to the devs.

[@metachanneleducation]

@@CGDiveNo, I did not do so. I don't think so...I just followed the instructions on their website for how to install the latest version.

[@CGDive]

@@metachanneleducation Latest version of what?

[@metachanneleducation]

@@CGDive The Rokoko

[@CGDive]

@@metachanneleducation yeah, the latest version is currently a beta version.