Free Suit-less Motion Capture | Rokoko A.I.

[@JonathanWinbush]

Save 10% on Rokoko Products rokoko.co/WINBUSH ➜ Use Code "rkk_winbush"

[@jameslove8319]

Is that code good for a whole suit??? I'm in!

[@JonathanWinbush]

@@jameslove8319 yup yup on the Rokoko 2 suit

[@jameslove8319]

@@JonathanWinbush WINBUSH with the hookup! they took 10% off the sale price too! 👊

[@eyedesyn]

Came for the tutorial, stayed for the WinBush Boogie

[@JonathanWinbush]

🕺🏿

[@beMOTIONdESIGN]

Came for the Winbush Boogie and stayed fo tha tNice tut!

[@Omnicrola]

Really great rundown, I especially appreciated the visual side-by-side of the input footage with the output animation!

[@BlackMixture]

Insane! Super excited to try this out. Thanks for showing us another awesome technique!

[@JonathanWinbush]

absolutely 🤙🏿

[@motion.display]

Was pretty intrigued when I saw the pillow suddenly moving in the back. Great video, as always!

[@JonathanWinbush]

🤣 yea my dog snuck in there lol

[@Eroktic]

This is great. I wonder if there will be a pay-wall after few clips exported

[@JonathanWinbush]

Not to my knowledge only the 300mb limit is the only restriction so far

[@DLVRYDRYVR]

I'm concentrating on YOLOv7 Pose Estimation right now, but man Rokoko rokt this release just in time! Thx for sharing 🙏

[@blockmuse]

So cool! Great entry for folk with no mocap! Going to share this with my VISITORS OF IMMA DEGEN peeps in the discord. All this great content is so helpful.

[@JonathanWinbush]

Please do it's an great tool that anyone can use

[@Dspazio_3d]

Hey! Arturo Vazquez here! creator of that metallic buddy! Thank you so much for this impressive reel! That robot got some moves 😄🕺🕺

[@JonathanWinbush]

It's an honor I actually purchased the robot on the UE marketplace the first time I saw it just because it was so cool. Glad I finally got to use it for something cool! Love your work if you ever want to collab on a tutorial let me know! I'm not sure if you saw it but I used the Robot for Mix Master Mike too kzbin.info92CEAyNTSzA?feature=share

[@Dspazio_3d]

@@JonathanWinbush Aww! now I'm flattered :D - I'm fully booked until next Feb, but yeah, would be great to do some collab. I'll reach you by that time to keep talking about this! Cheers!

[@MikeMo1992]

Damn, that's amazing! Btw I follow your youtube channel and your journey quite some while and it's amazing to see how much followers you gained and how you constantly provide good quality content!! Keep it up!!

[@JonathanWinbush]

Thanks for being a supporters I really appreciate it. I'm enjoying sharing on KZbin I only wish I started way sooner

[@Movie_Games]

is there anything that can do this in realtime for VTubing?

[@GTV3D]

Winbush, I LOVE IT!!! This just what I needed. I jumped in on Day 1. Some good stuff coming!! Rokoko -- IClone(3DXchange--Iclone7)--Unreal5. Also, Unreal5 is working out for me!!! Thanks for all the tutorials!!!

[@JonathanWinbush]

Did you get to check out my latest tutorial

[@TheDripGodz]

Nice option for the FREE. Can’t even complain , thanks Wimbush! I’m gonna try now

[@JonathanWinbush]

Absolutely 🤙🏿

[@oscaroneill8222]

Woah, thanks for sharing! This looks great as a free, easy to use mocap software. Looks decent enough without having to use 4x cameras or spend $3k on a mocap suit

[@DeepMotionInc]

Nice! We'd love to see what you think about how we compare to this option (with face & hand tracking)! Let us know if you'd like to work on something 👍

[@JonathanWinbush]

Yea I'm curious to check it out can you all hit me up in email?

[@asetone]

result looks almost as good as with the suit... Really cool new AI concurrent. Thank you for the news and the nice dance :)

[@JonathanWinbush]

I'll be doing a comparison video I still think a suit is better but it's close I can see a suit less future for this stuff

[@ukmonk]

nah the smartsuit pro 2 is wayyyyyyyy better, but this is fine for a quick dirty capture with some clean up!

[@paulshelkov7956]

This seems great for me to get all the broad stokes for animation in my game. Having very little animation exp. it would take me a while to set up a rough animation like one of these... and I have other elements I'd rather be focusing on. I wonder if it would make a bit of difference to have a proper dark background and wear fully white. I could hang up my dark-grey blanket on the wall somehow and wear my long-sleeve white sweatshirt + white pants.

[@JonathanWinbush]

I did some more testing here with higher contrast clothes if you want to check out my results kzbin.info/www/bejne/n2i3c3efjLuoatk

[@KyleRuggles]

WOW!!! I'm glad this popped up in my YT suggestions, great! Thanks!

[@JonathanWinbush]

Welcome to the channel and thanks!! 🤙🏿

[@AGAPAH]

Most definitely my man

[@ukmonk]

yeah Winbush got those moves baby!!

[@JonathanWinbush]

🤣

[@Theo_Blackledge]

Bro has been hitting the gym hard! Looking forward to giving this a go, have you seen Sony Mocopi?

[@JonathanWinbush]

I have I'm very interested in seeing what it can do because if I remember right it's only 400 bucks which is crazy I wonder how good it really is for that price

[@arnoldsoko]

thanks Winbush - another great tutorial

[@blushbunny7954]

I've never seen a single video of yours. I thought you had a haunted pillow. I'm dead. 😂 Because of this you get a new sub. (Okay the review was excellent too but... haunted pillows!) 👻

[@JonathanWinbush]

Haha yea I didn't realize he was on the couch until I started to do the edit 😂

[@dulur-si-cepot]

that foot lock so cool

[@CabrioDriving]

It is a joy to watch your tutorials. Great knowledge sharing presented by a very nice person.

[@JonathanWinbush]

Thanks so much means a lot 🤙🏿

[@westleyleonstudios]

I wonder how much better if we used tight/stretchy motion capture clothing (just the clothing with the triangles and dots on it) on a well lit green screen. HOW Much better would it be then?? Also, can we add multiple angles/cameras?

[@JonathanWinbush]

yea that i'm curious about too but we can't add more angles at least not yet

[@DeepMotionInc]

We have been working on a similar service for years (with face & tracking included as well). It all depends on what the AI is trained on - for us, having the joints be completely uncovered by clothing is the best, but tight clothing with patterns on it also works well. The foreground and background have high contrast.

[@santoshwalwekar]

My Dude with the moves!!

[@JonathanWinbush]

😎

[@ChrisM541]

Huge thanks for the heads-up, I really appreciate this. I wonder if a good quality 1080p video (goos subject/background contrast) would do well too?...getting the max from the upload limit

[@JonathanWinbush]

I'm sure 1080 is fine I tend to over do things 😆

[@raulcardenas58]

Sabes mucho de este tema, gracias por compartir los conocimientos!! saludos

[@redbunnyclassic]

Straight fire content every time!

[@JonathanWinbush]

Haha thank you red and thanks for the continued support all this time 🤙🏾

[@llealloo]

these tutorials are so fkn real. thank you!

[@wolfwirestudios]

This was helpful but can you make a basic tutorial to clean up using Rokoko studio or Cascadeur ? Considering iClone is paid and not everyone might have it ?

[@TB-cq3tl]

ohhh super cool. thanks for bringing this to our attention

[@jorxcore]

Love the voice!

[@JonathanWinbush]

🙏🏿 thanks! 🤙🏿

[@JonathanCGI]

great video Jonathan!

[@JonathanWinbush]

Thank you 🤙🏾

[@bacharnahshon]

As always... So Cool!!!! Thanks for this Great tutorial

[@JonathanWinbush]

Appreciate it thank you

[@iamYork_]

How does on compare to Moves my Maxon? I feel Moves is a neglected yet powerful iOS app… I wish Maxon or anyone would develop it more… especially the facial mocap portion… i havnt tried the body mocap section yet… good to know rokoko offers a new option in this realm… great tutorials as always my friend… and liketh thine moves…

[@JonathanWinbush]

Yea I'm not sure I haven't tried Maxon Moves at all is it still in development? I feel like I never see anyone talking about or using it.

[@iamYork_]

@@JonathanWinbush they mentioned it briefly and added some features in the last build... I wish Maxon would keep up with it I feel it kinda fell into the shadows... But it has a ton of potential and works flawlessly in C4D without having to use multiple softwares... I guess there wasn't enough demand for it... It was my lidar camera focus until Unreal released metahumans and live link... Maxon is more profit based than Artist based in my opinion so maybe they didn't see much reason to push it further... Pyro, smoke and eventually fluid volumes forcing geezahs like me to finally pay for Redshift is most likely better for profit margins hahaha...

[@RyanSmith-cp5yl]

thanks for this info! is it possible to do a face placeholder but do the body movements, then LATER go in with face / lip sync? i'm basically trying to do a quicker run down of a scene with the later intent of dialogue.

[@JonathanWinbush]

I'm not sure using rokoko but if you use iClone you can totally add facial movements ontop of your mocap

[@prod.bycheese]

Great video!

[@JonathanWinbush]

Glad you enjoyed it 🤙🏿

[@danzmachinz2269]

winbush V pwnisher cg dance battle when?? that could be a nice challenge - dance battle world cup/playoff, each competitor is done by a different cg artists

[@JonathanWinbush]

I'll actually be doing something with Clint soon I'll bring it up 🤣

[@Maarten-Nauta]

Tested it, there seems to be a weird issue with the center of the character. Its constantly leaning too far forward. Also legs stretch too much.

[@JonathanWinbush]

Have you tried different areas and outfits? I know the higher the separation between the person and environment the better

[@HemisphereCinema]

This looks pretty good tbh the move ai looks way better ofc but its good when on budget too.

[@Kneichion]

Really impressive!

[@Director_S]

Always love the tutorials Brother

[@JonathanWinbush]

Thank you so much and thanks for the support 🤙🏿💯

[@mufasa2079]

My G is swole...good stuff bro, Rokoko is dope

[@JonathanWinbush]

🤣 thanks brother 💪🏾🤙🏾

[@innovational_dummy]

LETS GOOOO!!! Free motion capture !!! W video Imma make a rokoko account rn

[@JonathanWinbush]

Yea buddy! 🤙🏾

[@mariorodriguez8627]

Great work! Thanks for the info! :)

[@HighlightHeroesTV]

So cool !! Love the music too!

[@JonathanWinbush]

Thank you friend 🤙🏾

[@meow9874]

Hi i have a question! Can i integrate this motion capture rokoko software onto other applications? Where the user can in real time overlay their livestream video onto their model? (Is there a way where the model doesnt have to be rigged as well?) Thanks!

[@StaringAtAScreen]

“An I’m wearin basic clothes. I got my hat, my tee, my guns…” 💪

[@JonathanWinbush]

Lol no guns I'm not licensed to carry here

[@calebvaccaro]

If you had shorts on, I wonder if the algorithm would render your fee placement better. It might have issues with your pants, conflicting with your same-ish colored socks. Great work

[@JonathanWinbush]

I did I showed an example of me wearing shorts as well

[@calebvaccaro]

@@JonathanWinbush Ah missed that, just saw it. It looks great! Again, awesome work.

[@JonathanWinbush]

@@calebvaccaro no worries at all and thanks for even watching I appreciate it!

[@AsasinoManik]

0:35 M1 IPad proooo "Nothing Fancy"

[@JonathanWinbush]

😂

[@itsMBWAAA]

This is exactly what I need to get into mocap without spending a couple grand. There have been countless times I wanted to get into an expensive hobby, spent the money and then rarely, or never touch whatever it is again lol. Throwing this into Unreal and tweaking it from there to fine tune it def looks feasible. And if I like it and want more I’ll get a suit lol. So glad we live in this technological era where we have all these softwares available for free. Ps nice traps big dawg lol that is also inspirational hahaha

[@itsMBWAAA]

Oh yeah and I’m subscribed now

[@JonathanWinbush]

100% I can see a near future where we don't need full on suits anymore maybe just stuff like this and gloves for finger data 🤙🏿

[@wesley6442]

When I click on my animation clip recording nothing seems to happen, does anyone know what might be going on?

[@oscaroneill8222]

Also I wonder if you could use the rokoko suit and use this video capture at the same time and it could create even more accurate mocap data by combining the data sources.

[@JonathanWinbush]

Not as of now but on the live stream Sam at Rokoko did mention they could be working on a way do connect the gloves to the video which could be really dope

[@alan112223]

That was informative. Thank you!

[@JonathanWinbush]

You're welcome! 🤙🏿

[@CdeeqFilmmaker]

wow !!! Winbush got some moves lol

[@RM_VFX]

I wonder if your shoes being similar color to the carpet caused it to drop the feet capture. Maybe some red shoes would get better results?

[@JonathanWinbush]

Yea maybe because the more contrast the better

[@reliquary1267]

Would it help to wear contrasting decals/stickers located at various bones and joints, to get a better mocap output?

[@JonathanWinbush]

It might I'll have to try that out 🤙🏾

[@bizamotivation]

thank You ❤

[@FilmSpook]

Dope!! 👍🏾👍🏾Awesome Content, my Brother, much appreciate u!!

[@JonathanWinbush]

Thank you my man 🤙🏾

[@paulshelkov7956]

Is there a reason you chose to export as Mixamo when (I assume) you'd be bringing into Unreal Engine?

[@JonathanWinbush]

I never bring directly into Unreal I typcially use Character Creator and iClone then from there take to Unreal since I like their animation tools better and its much easier to use

[@paulshelkov7956]

@@JonathanWinbush ah right thanks.

[@NicolasSilvaVasault]

competition is getting intense right now, first sony with the new mocap device, and now this? wow

[@JonathanWinbush]

I love to see it because we as the end user always win when there is options out there for us to choose from 🤙🏿

[@frost1tube]

Great video-- thanks! I wonder if there's an easy way to raise your center of gravity so your legs straighten out and don't bend by default. Love the Captain America cover on your wall. :) (I'm a comic book creator)

[@JonathanWinbush]

I know rokoko is taking feedback as this is version 1 and that's something I've brought up. And thanks the wall art was a present it's signed by a few of the artist and writers. Which comics do you work on?

[@wonderland4301]

Amazing! So it's not super precise and captures motion data for smaller things like hands right, just the torso and limbs

[@LUXSON_Tech_Demos]

Great vid. How do you apply these to an Iclone 8 character?

[@JonathanWinbush]

Just export the fbx how i show at the end the unreal skeleton should work

[@LUXSON_Tech_Demos]

@@JonathanWinbush unreal skeleton doesn’t seem to work on my iclone character. And the mixamo one distorts him entirely

[@LUXSON_Tech_Demos]

@@JonathanWinbush It only seems to work in Iclone 7 with 3dx Change. Both mixamo and uneal skeleton causes messed up bones.

[@ulisespesa8862]

Something is odd when bring the FBX to Unreal and apply to my model. it breaks the model and looks so strange... I dont know how to fix it. It works fine with my others animations I downloaded, from mixamo. I tryed Mixamo and Unreal preset :(

[@JonathanWinbush]

I usually use iclone8 first then bring to UE5 that's how I did it here

[@snakeeyesdeclassified]

THANKS FOR SHARING

[@JonathanWinbush]

My pleasure

[@nikilragav]

How long a clip do you get at 4k@60? What quality level are you using in the iPhone

[@JonathanWinbush]

You get up to 300mb no matter the setting you use

[@nikilragav]

@@JonathanWinbush No I get that. The question is how much recording time does that translate to.

[@motionmaingi]

You are a beast bro.

[@JonathanWinbush]

Thank you 🙏🏾

[@GikePeterson]

Wow nice dance😅Need to try this mocap😏

[@rw7717]

What are the terms of use? I wonder what they’ll do with your image and video once uploaded to their server.

[@JonathanWinbush]

That i'm not sure of

[@rw7717]

@@JonathanWinbush i think they mentioned the data will be deleted in a few weeks. At least that’s what I heard from the livestream yesterday.

[@luxuryrapchannel]

What is Mike Tyson cousin doing?! 😂 I love it

[@JonathanWinbush]

Doing KZbin side hustle 😎

[@snowboundrecords]

Instantly subbed for the dance

[@JonathanWinbush]

🕺🏿🤣

[@markussfiedler8396]

thanks for the video! have you tried importing it in iclone8? i tried all the settings but couldnt get it to work. any clues? best wishes!

[@JonathanWinbush]

I imported this into iclone8 then UE5 I'll make a tutorial since people are having issues might be easier to show

[@macitseferi1843]

Does the software allow me to use more than one camera to get better quality results?

[@JonathanWinbush]

as of now just the 1

[@j.f.3104]

I think the carpet causes the problem for the feet. There is not enough contrast between socks colour and carpet colour.

[@nanopixel.studio]

This is good info bro.

[@JonathanWinbush]

Thanks man 👊🏿

[@jessicaweitzel4027]

Are you able to take the tracking data and add it to any character model you need?

[@JonathanWinbush]

Yup yup

[@jessicaweitzel4027]

@@JonathanWinbush I've never used this tool before and I wanted to test it before I buy, but I'm not impressed with the results I'm getting so far. I've been testing this literally all day and I cannot get anything close to a clean track. I've tried everything I can think of...Recording in high contrast clothing (yellow shirt, red pants, blue shoes) on a simple white background (empty wall) and complex background (office), One camera, two cameras. I've even tried leveling my tripod. It's just not working. Any suggestions/help would be appreciated!?

[@JonathanWinbush]

@@jessicaweitzel4027 you might get better results with move ai

[@Escelce]

Great video. Thank you

[@JonathanWinbush]

No problem thank you! 🤙🏿

[@DeepFriedGoblin]

Is this better than, say, Deepmotion? Or how is it any different?

[@JonathanWinbush]

I'm not sure never used deep motion

[@fisherman10101]

great tutorial, thank youi

[@JonathanWinbush]

Glad you enjoyed it!

[@JordanTessier-ll7zg]

Tried bringging it into Iclone on multiple characters and it completely breaks the model. Tried every single preset they have for the retargeter as well. can't seem to get it to work. any ideas?

[@hipHopiZlyfe]

to solve this problem when downloading rokoko motion check the body mesh box then import the motion directly into iclone (not onto a character ) then right click on the motion and save it as iclone motion file then reapply the motion to any character

[@JonathanWinbush]

That isn't working for me you did this with rokoko video here?

[@ichi4468]

You are the best thank you so much

[@sukebanichigo7331]

can this be used in live time and not within record time?

[@JonathanWinbush]

Not live no

[@sukebanichigo7331]

@@JonathanWinbush thats a bummer!

[@JonathanWinbush]

yea maybe one day though since it's still new this is phase 1

[@abhinowyt8564]

Is there any limitation for making animation ?

[@JonathanWinbush]

How do you mean

[@abhinowyt8564]

@@JonathanWinbush I mean, how many video can we upload?, can we use it unlimited or any limits to make video to animation conversion?

[@JonathanWinbush]

@@abhinowyt8564 to my understanding you can upload as many as you want

[@abhinowyt8564]

@@JonathanWinbush Nice, Thank you :)

[@TronikXR]

Love the dance moves bro! Thanks for sharing.

[@muhammadbiniqbal8049]

how do you clean it up

[@JonathanWinbush]

Just use whatever software you like to use for clean up like iclone unreal or cinema 4d

[@OnlyEricB]

DISCLAIMER: For Macs, this tutorial only works on M1 chips (Rokoko Studdio Beta)

[@icresoftgames]

Great tutorial and thank you. I guess your carpet and socks are in the same color that's why your legs are bent in the motion capture data.

[@JonathanWinbush]

I have a video coming up where I compare Rokoko Smart Suit 2 to the Rokoko A.I. and it picks up all black suit pretty well

[@icresoftgames]

@@JonathanWinbush I'm gonna look forward to that bro

[@Jackiroo14]

Does this work with 2 people being recorded at once ?

[@JonathanWinbush]

Actually I'm not sure I should try it out

[@Jackiroo14]

@@JonathanWinbush Yeab I would love a video if it's at all possible. Would love to make a fight scene with it like that

[@alwaysyouramanda]

Can this be used to create animations for VRChat humanoid avatars?

[@JonathanWinbush]

I haven't used vr chat but as long as you can bring fbx into it

[@sameh.blender]

wonderful, thank you so much :)

[@JonathanWinbush]

You're very welcome and thanks for the support!

[@medrelins]

super dope!!

[@JonathanWinbush]

Thanks 🔥

[@grimsk]

오 100% 영상 기반이네요 ㅎ

[@JonathanWinbush]

Yup no suit at all

[@jordantessier25]

Im guessing you had the same issue as most people where the feet tracking was just absolutely horrible, whish is why you frames this from the hips up?

[@FormerDeveloper]

hi winbush if i may ask..can you tell me which skeleton export for metahuman unreal Engine? thank you!

[@JonathanWinbush]

Probably the unreal one but I'm not 100% sure as I don't really use the metahumans I like character creator

[@25thfebstudio]

nice, i love your dance moves ☺

[@JonathanWinbush]

😎🤣

[@aaronsakhi]

bro is really jacked

[@AFtelinaGraphic]

Cool