📱 INSANE Face Capture UNITY 3D TOOLS

[@MarcioLima-ib9ep]

Hi Jeni Im not sure if this was already asked but what method did you use to to facial rig the face before importing it in to unity?

[@jenninexus]

Heya I should have taken better notes when I made this vid, but the way I'd do it today is by applying the facial morphs in CC4 (in addition to whichever other animations u may want), and then in Unity, import the AR Kit tools so they're compatible with Face Capture. I"ll try to make an update vid next time I'm in there. I love CC4 characters in Unity - it's been really fun :-D

[@AndreiShulgach]

Going through the auto set up steps and attempting ot set up ARKit Face Actor, it doesn't seem to be detecting all the blend shapes. In the CC preview inside of Unity it looks amazing, with all the example face expressions matching accurately, including facial hair, yet when I try to use Face Actor, it doesn't detect the jaw, facial hair isn't attached, and it's not accurately matching the blendshapes, even thought the blend shapes in the mapper are matched 1:1. Did you ever run into this? There doesn't seem to be any documentation on this nor other posts of users running into this.

[@jenninexus]

I'm having another look at the Face Capture tools this week & last night tried setting up my CC4 char in Unity 2022 but some things were broken so I had to revert to 2021. We left off where we were considering writing a script. I also tried the Salsa Unity Asset before but the AR Kit tools were still better last I checked.. I'll try to make an update if I learn anything new. Awesome work on your Metaverse character ! I'm having so much fun making avatars w AI and using Headshot in CC4 lately but will soon be trying to do more facial mocap 👍

[@FUNBBTV]

Hello Jeni nice video. I have some questions : what is the mapping you used to match the cc blendshapes and the one from unity?

[@jenninexus]

Hi there, thx for watching :) I used the Default Face Mapper from the Unity AR Kit asset & had to assign the blendshapes to bind them to the mapper. I tried using CC with the Salsa asset before as well, but liked the AR kit method better.. if you find a better way to assign all CC blendshapes to the phonemes / expressions, lmk bc I'm trying to find the best solution :-D

[@FUNBBTV]

@@jenninexus Thanks for your answer. I have to test more but the mapping was not good for me with the AR kit.