Nvidia Omniverse Audio2face to Maya to Unreal Engine Metahuman

[@atlanteum]

JSFilmz - in Maya, turn off Select Polygons from the shelf, and you won't accidentally select your character when you're animating with the face rig. I generally turn off everything except Curves when I'm working to avoid nasty selection mishaps that you never notice until after you hit SAVE -

[@michaellaviola6540]

You are my angel man, I needed this so much!

[@Jsfilmz]

yea dude im as excited as u are this script legit opens up a whole new world with metas and best of all its free

[@thecfi2567]

You're right JSFILMZ. This is a game changer.

[@kuna6639]

big work!!!!!!!!!!!!!!! love you😘

[@DavidWinstead]

Wow man, great work and info

[@Jsfilmz]

dont thank me man thank NVIDIA be sure to show me if you try it

[@Saar58]

Awesome video 👍👍👍 I've subscribed for more of this kind of content, keep up with the innovative work! I've been trying to use this on a low poly mesh (non-metahuman) and import that fbx to unity but no luck as a2f is still in a very early stage..

[@Jsfilmz]

for sure check out their tutorial on generating blendshapes

[@crawlingking321]

wow this is amazing..thanks for sharing

[@Jsfilmz]

yw bro thank nvidia not me lol

[@kairu_b]

Awesome!

[@GuyPaddock]

BTW if you shift-right-click a file in Explorer on Windows 10 you can "Copy as Path".

[@Jsfilmz]

look at that ive been using windows since 98 and i didnt know that. thanks man!!

[@GuyPaddock]

@@Jsfilmz Happy to help. They're always changing things LOL. In Windows 11, sadly, I believe this is buried in another right-click menu elsewhere.

[@furynotes]

Oh. Its python. Maybe this can be adapted to blender with rigify perhaps. Its already adapted to iclone 7. Since reallusion implemented python to iclone 7. With their own scripts.

[@Jsfilmz]

i reached out to iclone peeps. imagine if u can edit acculips live face from iclone in maya kaboom

[@HadrienBasch]

Im trying to do it but it doesn't work with 2022.2.1 anymore any idea ? thanks

[@cloutcoin6427]

when i drag in male_bs blendshape is has no nested items, so no blue mesh or transferable properties?

[@YanyanLun]

how to edit ani from v2f to any rig in maya? coz i see your rig in maya already got certain rigging..

[@Franckie.G]

That's the tutorial i was looking for thank's for your work JSFILMZ , the only problem i got is weird : after retargating animation from Mixamo all my Metahuman's heads finish severed from their body in Unreal , floating heads in the air are kinda cool but if you know the solution please tell me ^^'

[@유제상-h9j]

Hello. I have a question. Do you know how to apply the csv file or json file from the live link face to the control rig in Maya?

[@Jsfilmz]

i wish it worked

[@C0MM0Nbeing]

Didn't softimage do this over ten years ago with face robot and the speech to animation function. I'm not really sure why you would ever use the speech to animation thing with metahuman unless you'd be going for an purposely non realistic metahuman like a robot or something, or maybe cutting corners and saving a few bucks, facial capture is pretty simple these days so makes sense using with metahuman.

[@Jsfilmz]

yea so ive had peeps contact me about this for bringing dead people to life like presidents n such, some scholars arent really tech savvy so audio to face animation can still find use. also yea for ai like toy jensen it works

[@C0MM0Nbeing]

@@Jsfilmz I see your point, if it's to get a job done quicker and cheaper, although I'd still go with a face capture of someone lip syncing myself, as soon as you start hand tweaking animation the uncanny valley widens, it would end up being quicker to do as little hand animating as possible, just for linking capture cuts with morphs and alike, but I guess whatever gets the job done. Anyway nice tutorial 👍

[@C0MM0Nbeing]

@@Jsfilmz i just can't wait to see what the cool3dworld guy does with metahuman, his stuff is freaky

[@SectorZeroGP]

Is this for free? Even in commercial purposes? (Because if it is… wow :o )

[@Jsfilmz]

yea its free nvidia creator studio or omniverse

[@NiteshKumar-ke6wy]

Does it work in amd pro render wx9100 card

[@ok3renutube]

is there a way that we could record eyes movement separately in unreal, just like in iclone?

[@Jsfilmz]

thats the next step

[@mazedurhasu961]

waw brother.......

[@kingskye7110]

Why is there nothing in my localhost folder

[@chrisg7663]

You could have just added the blink and changes with Control Rig in Sequencer, without the extra Maya step.

[@Jsfilmz]

hahaha bro i try to avoid cr in unreal also the controls are much different in ue. its just a value of 0-1 instead of being able to key

[@Amelia_PC]

you can't. Not with Audio2Face lip synch generated. When you import audio2face animation and add a Control Face Rig, Audio2Face animation is muted, losing the generated and imported lip-synch.

[@Aharon_I]

Do this script will work with blender?

[@attilakovacs8329]

for me not work script in maya 2023

[@music_creator_capable]

Hey!

[@Medwedius]

Oh. Audio2face require RTX card. =(

[@easternmind]

for those that have problem with Maya 2023 use this scripts instead drive.google.com/file/d/138-Pzb78Uz45wThYP9bzra80UNfQrj6F/view?usp=share_link and replace path whit yours

[@李小桃-o3e]

链接已损坏，请您再次分享吗？