Rokoko's Face Capture: Everything you need to know!

[@NipunShastri]

I don't have iphone. Is it also available for android users?

[@RokokoMotion]

Unfortunately, we don't yet have a version for Android. Working on it for later this year though - stay tuned! :)

[@skirmantaskvederavicius2417]

@@RokokoMotion Any news yet? Do I really have to buy iPhone for only one reason? :)

[@RokokoMotion]

@@skirmantaskvederavicius2417 Unfortunately, the company we collaborated with on the Android face cap solution got acquired by Epic Games just before we launched. So it will be a bit longer until we can release. Hope in the Spring. So iPhone X series only until then I'm afraid

[@harrykingsley7915]

Where would I find out what specific blend shapes I would need to setup so that it would work with the face capture blend shapes?

[@RokokoMotion]

Hi Harry, You can find that information here: developer.apple.com/documentation/arkit/arfaceanchor/blendshapelocation :) Best, RKK

[@vycmarty5136]

@@RokokoMotion Hi Rokoko! I wanted to ask you if it was necessary to use blendshapes for facial tracking, or is it possible to use facial rigs too? thankyou

[@RokokoMotion]

@@vycmarty5136 Hi Martina, in this version you have to work within the ARKit framework with blendshapes. Hope you can make it work! :)

[@KO28JOJO]

Is there any videos for Face Capture in Houdini ?

[@eddiemzale9085]

Can u make a video of 3ds max importing face data in max

[@oby1]

Maybe show it in action? So far I'm not impressed with the iPhone capture solutions out there, its all jittery and a nightmare to clean up in post.

[@MiroslavGeorgijevic]

Hi guys, I recently ordered the Smartsuit bundle, and started my subscription, to learn at least the facial expression animation before the suit arrives. Since I'm working in Cinema 4D, I'm struggling to find the tutorial on how can I rig my own character's face straight in the C4D without any third-party services. Do you have that kind of tutorial or can you make one? Thank you! Miroslav

[@RokokoMotion]

Hi Miroslav! Your character needs to use the 52 ARkit blendshapes that Apple has listed here: developer.apple.com/documentation/arkit/arfaceanchor/blendshapelocation I believe the term in C4D is morph tags. I recommend that you open up a model that already has the ARkit blendshapes configured, so you can use that as a naming and modelling reference when setting up your own. This one should do the trick: cdn.rokoko.com/assets/unity/bruno.zip

[@CanErduman]

Hey guys, I want to start sculpting the blendshapes needed for face cap. Is there a blendshape-list with exmaples or details?

[@CanErduman]

I found this one: developer.apple.com/documentation/arkit/arfaceanchor/blendshapelocation But a list with animated GIF Images would be awesome.

[@RokokoMotion]

Hi Can! Our facial mocap works with the Apple AR Kit 52 blendshapes, and you can find various tutorials for sculpting blendshapes depending on what program you'll be working in (ZBrush, Blender, etc...). Here is a list of the blendshapes themselves from Apple, which at least lists them all out: developer.apple.com/documentation/arkit/arfaceanchor/2928251-blendshapes

[@zebius4157]

"It's best to keep your polygons below 50,000" But why exactly? is that for the iphone, as in it has a hard limit in arkit, or is it for the iphone's ability to live stream? or the computer or what is it?

[@RokokoMotion]

Hi Zebius - it isn't any sort of hard limit, you might just start seeing some processing lag with more complicated models. Thanks!

[@AndrewJohnRevell2017]

At 3:08, it is Camera Neck Brace, where can i find them? regards andy

[@RokokoMotion]

Hi Andrew, it is our iPhone mount. You can find it in our shop but it's not listed separately there: www.rokoko.com/en/shop However, if you reach out at [e-mail] we can make you a custom quote. Best, Rokoko

[@ukmonk]

which 3d models already have these blendshapes included please? do the ones from real illusion character creator work please? daz 3d?

[@RokokoMotion]

Hi! We have a couple of characters that you can play around with. They are fully rigged and with blendshapes, ready for face capture. This material can be found here: www.rokoko.com/application/education#Edu-offerings iClone and Daz3D characters do have blendshapes, but not all the blendshapes needed for our facial capture to work. These can be made manually or by a 3rd party service like Polywink. Here you can see a list of all the blendshapes needed to properly work with our facial capture solution: developer.apple.com/documentation/arkit/arfaceanchor/blendshapelocation

[@MrZteiner]

Hi. So, just to be clear (i'm quite new): if i want to use a character i downloaded from EpicGames Marketplace, instead of Bruno... Do I need to create 52 facial blend shapes in order to use live link face mocap? Thank you!

[@RokokoMotion]

Hi Matteo! Thanks for reaching out :) That is correct. To use our facial mocap feature your character needs 52 blendshapes. We use Apples ARFaceAnchor API which requires 52 blendshapes to fully work.

[@talalmeshari9573]

Does the characters from Character Creator 3 software come equipped with the required blend shapes? Can i use them directly in rokoko studio for facial and motion capture?

[@seencapone]

I haven't checked it recently but I think CC3 facial blend shapes had unique shapes & naming conventions that used a viseme model. They are similar and there is overlap, but it's not exactly the same setup as the iPhone ARKit's standard nodes.

[@RokokoMotion]

Hi! Character Creator 3 uses a different naming convention, so you will have to remap the blendshapes. But as far as we are aware, it should have the required blendshapes to be able to work with Rokoko Face Capture. Here is the link for apple ARKit's documentation with visuals of how the blendshapes look and their names. Just to have a reference for when you need to remap. developer.apple.com/documentation/arkit/arfaceanchor/blendshapelocation

[@alipharma1942]

can I use rokoko with web cam

[@viktorshtam2104]

а это ро-ко-ко, что только с помощью iphone работает? Это очень странно. А если я не пользуюсь им, то тогда невозможно.? Это дискриминация. ненавижу apple, 5 лет им пользовался и хорошо, что купил потом другой телефон.

[@JimBimBum]

COSTS $40 for this feature. not worth it.

[@RokokoMotion]

Hi Jim, thanks for the feedback! We'd love to hear why you think it is not worth it - if you are keen to share. We always want to improve our products. :)

[@ShadowKingpin]

*Radio Silence*