Mixamo + FaceIt: EASY Full Character Rigging & Mocap

[@CGDive]

The Mixamo addon needs a special version for Blender 4! ❖Mixamo Addon fix for Blender 4: gitlab.com/x190/mixamo_blender4 ❖Mixamo Addon for Blender 3.6 and earlier: substance3d.adobe.com/plugins/mixamo-in-blender/

[@bigheeno]

Absolute masterclass. It's like 6 hours of your previous content in 37 minutes! Thanks heaps ☕

[@CGDive]

Nice!

[@zemptai]

Insane value. Thanks so much for making these informative videos. You’ll probably be a big part of shaping the lives of many upcoming animators.

[@CGDive]

Thank you, I appreciate the positive comment!

[@IncredibleTech]

Dude is an absolute legend! Teaching all of this for free.

[@CGDive]

Nice, glad you liked it :)

[@luvyoutars]

we all appreciate it but is there any better alter for apple ARKit for pc or android , current process on android results in cartoonish expressions rather than real life ones

[@CGDive]

​@@luvyoutars Watch this video... Although, no ARKit system is particularly geared towards cartoony vs real expressions. They just capture the "face landmarks" as data. Whether your result is real or cartoony depends on your model and face shapes. kzbin.info/www/bejne/Z4rKomxmapeFic0&ab_channel=CGDive%28BlenderRiggingTuts%29

[@MdHabib-nl1xt]

I have watched about 50 videos on this topic but no one explained it so simply like you

[@CGDive]

Awesome, I'm glad you found it useful!

[@wguillaume98]

Audio 2 Face Tutorial Please!! Would love to see what your workflow looks like.

[@nevermoresoulkeeper6893]

first, you need at least 10gb graphics card

[@guruleinii]

exactly what i was looking for. you're a legend, mate!

[@maverick0531]

I've been following ur tutorial on facial rigs n its awesome and so simple to understand. thanks a lot for this video. i'm gettting stuck at 16:26 i dont know why maybe the becuz ive some ither version of faceit i cant seem to find the experimental tab... how do it go about to attach the head to the rig in this case?

[@Mirror-of-Darkness]

Thank you so much for your help CGDive. I will be using all these special techniques in my game. MIrror of darkness. You are all going to see some absolutely bombers cutscenes and chats!!!

[@CGDive]

Nice, looking forward!

[@Mirror-of-Darkness]

@@CGDivei was wondering, when i follow the entire workflow. It makes a very good result. I have one issue. When i record some face mocap, I turn my head to the left and the right. Process the video on landmaker and get the csv. I am using Anker Powerconf C300 I upload it to blender but on the character when the mocap is applied. The head goes up and down. Its like the axis are inverted. What would be your best guess as to why this happens.? :)

[@CGDive]

@@Mirror-of-Darkness I am not sure why it happens, but I covered how to tweak that in this video kzbin.info/www/bejne/Z4rKomxmapeFic0

[@Mirror-of-Darkness]

@@CGDive Amazing, thanks. I saw it. Must have missed the section about that. ;)

[@Slipdash]

Mixamo rigging is so simple! I should really use it sometime

[@famdomproductions]

Hi! Oh my goodness....I have to say that you are the BEST teacher and guru for blender!! After watching your last two tutorials on FaceIt, I took the leap and bought it. After successfully rigging the face, I managed to rig it with Mixamo (I did it the other way around than you show here...I did it with FaceIt first). I had great success until I started trying to re-use previously downloaded animations from Mixamo. So, with my newly rigged (Mixamo and FaceIt) character, I am having great difficulty using Mixamo animations that I previously downloaded, because the target skeleton is the WRONG SIZE. I see in this video, that at minute 26:00-27:00, you do a "thing" where you re-import your rigged character back to Mixamo in order to get new (unskinned) animations...is that why? Is it because the animations have to match your character or the sizing will be off?? So I guess that's my question...do I have to re-download every (unskinned) animation from Mixamo with each and every character I make, in order for the rig size to match? Or is there a magical way to scale the target skeleton animations? (If the target skeleton is a different size than the Mixamo control rigged character....the animation gets really weird looking). Thank you for making the best blender content EVER!!! (so helpful for us noobs :)

[@CGDive]

Thanks mate and sorry for the late reply. Hmmm, Generally character with close enough proportions should do the trick but.. if the retargeted animations look off then yes, try to re-rig the character.

[@tapacg1329]

audio to face pleaseee and thank you man for this content your are a treasure

[@CGDive]

gottcha and thanks!

[@ansems3309]

This is such a great tutorial! But I have one problem: I had a simple rig with one bone for the head. I chose this bone at 18:00 . But My head isnt moving at all. The face works great but I can't understand what I did wrong. :( Im using Live Link Face btw. (I just have a normal armature since Im making a puppet. Do I need to have those controls? Like the circle on top of the head) EDIT: ..... make sure to go into options in the app you are using and hit something like "record rotation". For a few days I am trying out everything in blender.... my mistake was that the app did not record the rotation of my head. oops

[@johanleion]

Such a great to the point tutorial!

[@jetcostudios]

Hi quick question, how come I don’t have access to these settings Head Setup> Head Object> Head Bone? 18:14 Face it only gives me the option for creating a Head Rotation or Create head target but those options haven’t worked. The face mocap works well but I have no rotation from my face cap performance. Please help!!

[@nabiluahmed]

Firstly thank you so much. This is extremely well explained. I was wondering about the animation that FaceIt produces. Its driving the ARKit shapekeys right? I'm aiming for a Blender to Unreal workflow similar to your tutorials. So I have a game rig inheriting the location and rotations of a rigify control rig. The actions are then baked down to the NLA of the mesh/game rig. Can I also combine the FaceIt shapekeys with this?

[@vectordexter5393]

this was so powerful!, thanks m8

[@xialah9047]

Thanks! At the end, it seems that the mouth does not move freely and does not have a huge range motion. It’s the same for me although I believe that I rigged everything properly? Any ideas?

[@CGDive]

It could be either that your face capture app is not detecting a lot of mouth movement or the mouth shapes are not pronounced enough.

[@xialah9047]

@@CGDive Thank you! I indeed tried with an iPhone 14 and the lips moved way better! Top lip even moved a bit too much (U shape, like a weird grin, when I accentuated my enunciation). I could correct that using the graph. What could be a more definitive way? Also, after applying a sitting mixamo animation, the head of my character didn’t follow and stayed at the same position so the neck skin was all elongated and distorted. Any ideas on how can I correct this?

[@bobkanza_]

Waaaouu! Merci

[@user999-y5c]

good video man, your channel is great

[@CGDive]

Thanks, appreciate that!

[@SweetSimena]

Subbed because you shared love towards us android users

[@CGDive]

Thanks and we have something much better now! Check out this vid: kzbin.info/www/bejne/Z4rKomxmapeFic0

[@rodcav3]

Absolutely great tutorials..would love to see a tutorial on how to facial animate a anthropomorphuc character with a snout

[@CGDive]

Great suggestion!

[@saddubhaiii]

Thanks a lot man! You made it a lot easier!

[@CGDive]

Nice!

[@pesindiafc9363]

Bro, Please help When I am using Blender 3.6 but there is nothing in Maximo Rig Setting - IK-FK switch.. In the non linear animation timeline - the Proprieties option (N) is showing empty..

[@CGDive]

This is too specific, it could be a myriad of things. Sorry, I can't help but drop by our Discord and share the problem with images etc. Maybe someone will be able to help discord.gg/j8SQCjFsXP

[@60secperday-wq3dd]

do you find a solution , i also experience this

[@julianezi]

Thank you, very useful tutorial❤️ How i can export all of these in unreal engine for example?

[@PRANIMATES]

Not working in blend| 4.0

[@CGDive]

Mixamo? That is addressed in the video description. Here is the fix for Blender 4 kzbin.info/www/bejne/i3-niZmcgdynp5Y

[@PRANIMATES]

@@CGDive no, faceit .... At the point of project landmarks it is throwing bunch of errors and no face rig is created after on.

[@CGDive]

@@PRANIMATES You should get the latest version from your Blender Market downloads. If it doesn't work, ask the dev by clicking Ask a Question on the product page. But I am pretty sure FaceIt is updated for Blender 4.0

[@manshah7]

audio2face tutoria please! thats what i've been waiting for

[@ilhamlux]

thankyou for great tutorial, really appreciated bro!

[@CGDive]

Glad you liked it!

[@ilhamlux]

@@CGDive i have a prob wen i want to conect my faceitcontrolrig to my mixamo character rig, i do the tutorial about set child of but it wont follow the head bone, pls help

[@ilhamlux]

always shows "No head bone specified

[@CGDive]

@@ilhamlux This is a separate setting, not the same as connecting the control rig to a body rig. See here: kzbin.info/www/bejne/gYKWY36IjtZpiKM

[@ilhamlux]

@@CGDive but it will be destructive? i wont same as the result that you do, parent to head bone like that

[@leekolb2027]

Excellent, thank you!!

[@OUTTHEMUDVISUAL]

This is amazing appreciate you

[@kaushikravi9898]

Thanks for video, how to download it and to play in the iphone with actions and voices.

[@ayaz1979]

Excellent, tutorial thanks

[@lowhorizons]

at what part of this process would you add a hair/cloth simulation?

[@CGDive]

It should be done from the start along with other types of rigging, ideally.

[@streamerman6885]

привет,я не могу выбрать Face Main так как у меня голова не отделена от тела в отдельный mesh и я не хочу ее отделать так как при движении головы будут видны разрывы между телом и головой,что делать?

[@CGDive]

Yes, you can select face main in Edit Mode by selecting one vert and pressing ctrl+L. Then press the Face Main button. Also the newest version of the addon has a special eyedropper that can select the face main geometry in Object mode.

[@Composit.Design]

Yo! Thanks for the amazing tutorial. I've successsfully been using ARkit to drive facial animation in Unity - Will these shapekeys/blendshapes translate into Unity when I export the FBX of my character?

[@CGDive]

Shapekeys do export with FBX. Did you test it?

[@Composit.Design]

@@CGDive Well I haven't purchased FaceIt yet, but based on this I will give it a go. Up to this point I've been using characters and avatars from other sources that come with the ARKit Blendshapes ready to go.

[@CGDive]

@@Composit.Design Well, faceit has nothing to do with the Export process. You can test the shapekey export with any model that has them.

[@Composit.Design]

@@CGDive Ok good to know, really appreciate you responding

[@kenzietownsend6644]

Face rigging starts at 7:00. Before 7 its setup

[@CGDive]

As indicated by the timestamps :)

[@kenzietownsend6644]

@ The descriptions are bloated with ads.

[@CGDive]

@@kenzietownsend6644 Why do you need to go to the description? 😕Timestamps are right there on the timeline.

[@kenzietownsend6644]

@@CGDiveI didn't-. You suggested it. Look. I know a 30 minute video has 5-6 KZbin commercials which you get a few cents for, maybe. I was just saving other users time and maybe keeping them engaged by pointing to the face rigging portion.

[@CGDive]

@@kenzietownsend6644 I have no problem with your comment. Just pointing out that I've done that work for you already. Not sure, maybe it does not show up on whatever device you are using. And no, I did not suggest anything of the sort.

[@onkelfurunkel4065]

Hi! I bought your rigify course a while ago, and I wanted to know if you're planning to do a video on the skin.stretchy_chain rigtype in more detail ?

[@CGDive]

Yes, I tested and learned the skin types a while ago and I am planning to cover them. Thanks for your support!

[@alocrisis]

How do I make my mixamonrig to stretch because trying to make something similar to luffa of one piece

[@CGDive]

Ah, I don't think it has squash/stretch...

[@re1]

It doesn't, even though you can unparent the bones that you want to squash and stretch you will need a proper rig to control the behavior in the DCC you are going to use it or in a game engine itself.

[@KobanWanko]

If you only use mixamo for animation retargeting of the deformation bones, you can use Auto-Rig Pro to generate a meta rig with squash and stretch and a whole host of features necessary for cartoonish or anime style animation. You can even connect the Face-it rig to the ARP rig should you wish to keep both rigs deformation bones for exporting(via setting all of the face-it bones as "custom bones" in ARP after generating all of the face-it shape keys, joining the two rigs, and parenting the face-it head head bone to ARP "c_head.x"). ARP plus "Voxel Diffuse Skinning" are the addons that I use as a character artist the most. From my experience, some parts of the body like the traditional Surface Heat skinning that comes with ARP(hands especially), while collections of disjointed or spiral bits prefer Voxel Diffuse for a better deformation.

[@blane8056]

I'm very new! Was wondering, would using mb labs to create a character cause any problems or can I follow this guide still?

[@CGDive]

I haven't used MB labs much. In general, it shouldn't be an issue.

[@Sheenah2015]

Nice one!

[@oni3910]

When i set child of it doesnt work, pls help

[@odntemagnus]

Excellent!

[@MarcV_IndieGameDev]

My character is stylised, I'm mainly just wanting the mouth to work. Will the addon hate it just wanting the mouth controls?

[@CGDive]

Which addon? FaceIt?

[@MarcV_IndieGameDev]

​@@CGDiveFaceIt, I am looking for a way to mainly mocap just the mouth shapes. Is this addon flexible enough to just focus on face parts? Another question is, I would have to Frankenstein this head rig to generated Rigify rig aye?

[@CGDive]

@@MarcV_IndieGameDev Yes, it has special features to mask out parts of the face such as brows, eyes, mouth. :) I haven't used that much myself but it's there. Also, if you don't have the eyes/brows shapes at all, that won't be a problem. It will simply apply the animation to the shapes that do exist.

[@MarcV_IndieGameDev]

@@CGDive Cheers for info! I will have to look into it, see if it gets included in the black Friday sale soon :D

[@CGDive]

@@MarcV_IndieGameDev Yeah, probably will be on sale so wait a week or whatever long it is until BF :)

[@rontarrant]

I'll be very interested if/when you find a free face rigging app/plugin/what-have-you. Thanks anyway for this vid.

[@CGDive]

Well, there is Rigify and I have a lot of stuff about it on the channel...

[@Dilroymotions]

But with this i could apply multiple animations in the NLA editor

[@CGDive]

sure

[@mominul3d]

Thanks a lot bro

[@scorobeat]

Which blender v, do you use because i use blender v4 and addon mixamo-in-blender dos not working

[@CGDive]

yeah, I know. I will try to make a video when it gets fixed. For now there is no properly fixed mixamo addon for Blender 4.

[@scorobeat]

Thanks, I'm waiting for... SO what's your version blender

[@CGDive]

@eat In this video it must have been 3.6. But I use 4.0 now.

[@scorobeat]

So how you do to animate without this add-on in blender 4.0 to generate rig?

[@CGDive]

@@scorobeat Mixamo addon is not something I use all the time so it's ok. If I did need it I'd use 3.6. You may be able to generate the rig in 3.6, then open it in 4.0 but I haven't tested that.

[@putinscat1208]

Would this work with non human heads?

[@CGDive]

To an extent, yes. But non-human could mean many different things so some cases may not work.

[@mayaamis]

my problem with faceit is it only works on perfectly centred character. I already have a character in a scene and I would like to rig his face but I can't because he's not enterer and I cant move him with the whole scene to be centred :(

[@CGDive]

At least in my book, not having the character centered is just such a bad practice practice that I won't blame the tool for not covering it.

[@mayaamis]

@@CGDive well I'm not talking about not having character cantered when it's the only thing in your project. I'm talking revisiting some previously done elaborate scenes with several characters and lot of other objects and trying to rig one. obviously they can't all be centred in that scenario

[@CGDive]

@@mayaamis right... I am not picking on you or anything but imho that is just a bad workflow. I can't think of a reason why you would be setting up a character that is being used in a scene. The character set-up should be done in a separate scene, in the center of the world. The character then should be either linked or appended into the animation scene. And if you only have the character in the complex scene, then you can isolate it and reset all transforms of the bones and armature object, thus creating a clean set-up scene. So my non-sugar coated opinion is that you need to follow better practices. Do what you like with it (with my opinion, I mean) :)

[@mayaamis]

@@CGDive ok I thought about it and you're right I've been doing in wrong.. still learning Blender but thanx for advice :)

[@CGDive]

@@mayaamis I am glad you are considering learning more about this. Most people will just stick to what they know. Keep it up!

[@bananacomputer9351]

awesome!

[@phalhappy8612]

can we create control rig like this in auto rig pro?

[@CGDive]

I am not sure about the exact workflow you have in mind. In general, yes. The control rig from the Mixamo addon is actually based on the Quick Rig extension for Auto-Rig Pro.

[@phalhappy8612]

@@CGDive Yes, I found out quick rig in your other tut. That is what exactly I want. Thank you for all the good work. Keep going 💪

[@nickfai9301]

Thank you.

[@CGDive]

No worries!

[@nimitverma3460]

Do this rig auto-convert with Transformer in Character Creator 4

[@CGDive]

no idea!

[@nimitverma3460]

@@CGDive plz send link of rigged model here

[@CGDive]

@@nimitverma3460 what? :D

[@nimitverma3460]

Plz send the character u rigged > I want to check in CC4> if it works> so I need your model rigged with mixamo and faceit

[@CGDive]

@@nimitverma3460 It's not part of the service, sorry :)

[@nimitverma3460]

Plz make same for unreal engine

[@jesuss196]

Thank you!

[@CGDive]

You're welcome!

[@valleybrook]

Interesting that free app Live Link Face creates better synch and animation than paid Face Cap.

[@CGDive]

Yeah although that is not always the case. Also Live Link Face is developed by Epic so it's not just a random free app. :)

[@valleybrook]

@@CGDive I have bought the full Face Cap and thought it was clearly the best alternative. Now I will try out Live Link Face

[@nimitverma3460]

Thnxx sir

[@BuildYourselfUpBYU]

set child of not wroking

[@CGDive]

oh no!

[@VisualistAyush07]

Thank you

[@CGDive]

Welcome!

[@ApexArtistX]

the amount of ads in your video is making it unwatchable

[@CGDive]

The ads are from KZbin.