Rokoko Blender Plugin - mocap livestreaming workflow w Smartgloves, Smartsuit Pro, and Face Capture

[@jasperbrooks2118]

I want this suit and, gloves, now . .

[@jasperbrooks2118]

this looks amazing

[@RokokoMotion]

We are very glad that you liked it :)

[@WW_Studios]

Any plans to get a Rokoko studio application for Linux???

[@cluelesspoko]

Can i Rig the character using Auto rig pro in blender for Mocap

[@iwein]

very cool you guys!

[@jasperbrooks2118]

this, is REALLY amazing, this is what I need, for the stuff, I'm trying to make, I need the suit, thanks, AMAZING job

[@RokokoMotion]

Your admiration means a lot to us!

[@celialopez]

Hi can we record the animation directly into Blender? I was thinking the live stream could allow us to do it

[@RokokoMotion]

Hi Celia! Thanks for your question, yes you can record directly by using the Rokoko Studio Live Plugin for Blender.

[@NADIMATION]

Hi , can I record motion from video not real time camera , for example I have video for one person dancing and I need to extract the motion , is it possible ?

[@virtual_intel]

There's a few tools/software out there that does that using a cloud based AI. DeepMotion and Radical. I personally like DeepMotion far more then the other one I mentioned. Hope this info helps. Rokoko is all about Mocap I believe via wearing a suit and using iPhone X for the facial mocap.

[@nicolajesteban9211]

any idea why I can't see the face showing up in the blender plug-in? It's not there so I can't select anything

[@derekalanrowe]

THIS IS INCREDIBLE! Is this Gorilla model rig available to the public? I would love to test using the same model.

[@RokokoMotion]

Hello Derek! It isn't, unfortuantely. However, you can find Rokoko's free Mime character here, which is rigged for facial mocap to play around with or use in your projects: bit.ly/33seO28

[@ukmonk]

if you're not streaming but just using the normal method, is it best to always repose your models hands when using the gloves to avoid problems? even though not streaming? i.e repose the thumbs?

[@RokokoMotion]

Yes! To get the most accurate retargeting, you always want to repose the thumbs so they lie flat alongside the fingers BEFORE you retarget the mocap.

[@ukmonk]

@@RokokoMotion thank you for replying :)

[@fatherfilmmaker1732]

Is it possible to capture the movement and the facial regognition seperately and then combine? Otherwise presuambly the motion captured will always include one arm holding the phone?

[@ukmonk]

yeah you can attach iphone to headmount and use it that way :)

[@ukmonk]

or separate, whichever works best

[@ukmonk]

CC3 models all have the face blend shapes correct? So they should work with the rokoko face capture?

[@RokokoMotion]

Hello and thanks for reaching out! If they have the essential 52 blendshapes required then yes. You can check it while importing your character to Maya, Blender, etc. 😀

[@Conspirator101]

Can you capture data with the livestreaming footage? Or you need to capture it through the studio and then import it into Blender?

[@RokokoMotion]

Hi Dandi and thanks for reaching out! In order to capture data you will need to do it through studio and then import it into blender :)

[@ukmonk]

@@RokokoMotion I just tried this though and it does capture through streaming, the body that is but the face does not? even though i am talking etc and the face moves in time with the streaming version it does not save it to blender.

[@ukmonk]

will a future update make this possible please?

[@SkyhawkJD]

Do we NEED a mocap suit?

[@metachat7482]

I've downloaded everything but It says I need to upgrade my plan to use the face capture Via Rokoko Remote ? Is that correct ?

[@RokokoMotion]

Hi! That is correct. You can find all info about the pricing options for Studio and add-ons here: www.rokoko.com/studio/pricing

[@MunbMe_Documentary]

Is it available for Android??

[@DynerusHD]

Is it possible to create looping animations with the Rokoko suit?

[@RokokoMotion]

Yes, it sure is :) Here's a tutorial that shows you how to do it in Rokoko Studio with our loop feature: kzbin.info/www/bejne/fInOloRmiK-EsKM

[@DynerusHD]

@@RokokoMotion Damn that's awesome, compared to other similar products you guys are so far ahead with easy of use and price. Keep up the amazing stuff! Can't wait to see what comes next.

[@RokokoMotion]

Hi Dynerus! Thank you for the kind words. It means a lot to us! :)

[@ukmonk]

my livestream has a locked icon, do i have to download another plug in please?

[@RokokoMotion]

Hey there, you need Studio Plus or Pro to livestream (unless you are on the 30 day free trial).

[@ukmonk]

@@RokokoMotion Ahh ok thank you. Was looking at the options, why isn’t face capture included in one of the packages? Or is it? Little confusing as it’s in the free trial but is this a separate package altogether?

[@RokokoMotion]

Hi! The facial capture is an add on to the Studio Plus, Pro or Enterprise software package. If you are interested in this, you would need to purchase a subscription to one of the studio plans, and then add the face capture on top of it. The free trial allows you to try out the Studio Pro plan and Face Capture for a month to allow you to see if it will be the right solution for you. If you are interested in seeing how the product works and the results you can achieve with it, you can always book a free online demo with one of our Product Specialists: www.rokoko.com/book-demo They will gladly answer all of your questions regarding our tools and show you how they can be integrated into your workflow. Have a great day!

[@shekiba.646]

I know Rokoko's smartsuit.. but what's name of phone face download ? Thanks.

[@RokokoMotion]

Hi there, it's our own facial solution that you can get as a software add-on to Rokoko Studio. It works with iPhone X and is using the ARKit framework. You can read more about it here: www.rokoko.com/studio/face-capture

[@NiteshKumar-cs4wo]

is rokoko live link plugin is also for cinema 4d

[@RokokoMotion]

We will be releasing it very soon!

[@beyolai8379]

Can you use this on any model in blender?

[@beyolai8379]

@@ryanbailey3176 thanks!

[@marcus_ohreallyus]

Does that thumb orientation thing you mentioned also apply if your chosen software is Cinema 4d? And I'm not talking about strictly for live capture, but for any motion capture coming from Rokoko to Cinema 4d (or Blender).

[@cezanneali]

you guys should really put up a tutorial on Retargeting Character creator models in blender! Retargeting isn't as intuitive and easy to follow up with. specially when the desired shape keys don't match the Retargeting output. i had to manually add more shape keys for the Retargeting. hope that is solved soon!

[@RokokoMotion]

Hi! Thanks a lot for the feedback. We shared it with our Content Team and we will take it into consideration for our next tutorials. If you are experiencing issues, you can always check out our Help&Community page, ask our users in our Facebook Group here facebook.com/groups/252832679299596 , or reach out to our Support Team at [e-mail].

[@cezanneali]

@@RokokoMotion thanks for the reply! i am loving the live streaming plugin for blender tho!

[@RokokoMotion]

@@cezanneali Great to hear! :)

[@LLLMuzical]

the face capture works only with iphone?

[@RokokoMotion]

At the moment, yes. But we are planning on releasing our face capture solution for Android very soon!

[@Dizcordum]

@@RokokoMotion When

[@Beaxim]

@@RokokoMotion I'm really looking forward to this

[@RokokoMotion]

Stay tuned :)

[@NiteshKumar-cs4wo]

I think if rokoko plugin work with daz3d then it will be amazing

[@virtual_intel]

It can if you get the Daz to Blender Bridge plugin/addon for Blender. I bhelieve you gotta activate it through Daz itself. Once your character is on Blender then you can work the Rokoko magic they show here. Hope this works for ya.

[@NoiecityHacking]

Can't they develop a helmet that holds the phone with plastic arms? ps: Incredible work

[@ukmonk]

yep they already have that :)

[@JoJo-xv8vj]

This video is just an introduction

this looks great, but iPhone 10...