Audio2Face to MetaHuman | How to Animate MetaHuman using Audio2Face Live Link | Unreal Engine 5.2

Audio2Face to MetaHuman | How to Animate MetaHuman using Audio2Face | Unreal Engine 5.2 ~ In this video I show you How to install the new Omniverse Live link Plugin, which you can use to animate a MetaHuman using the amazing NVIDIA Omniverse Audio2Face Real-Time Facial Animation | Thank you ‪@NVIDIA‬ Learn more about the Omniverse: www.nvidia.com...
Download iClone 8: bit.ly/2QUkwXr
Download Character Creator 4: bit.ly/3uoLtAe
Download the Free iClone Unreal Live Link Plugin at: bit.ly/3oZnDKb
Check out the ActorCore Mocap library at: bit.ly/3qLMYb4
Friends, if you wish to support me as I continue creating insights and tutorials to help you, my fellow dreamers and storytellers, kindly check out my Patreon Account: / solomonwjagwe
Do please Spare a minute to Subscribe to My KZbin Channel: / solomonjagwe
Visit and like my Facebook Page at: / art.of.solomon.w.jagwe
Follow me on Instagram at: / solomonjagwe
Follow me on Twitter at: / soreel
Check out more of my work at my website: www.sowl.com
Links to Character Animation Resources you can use for iClone:
Download iClone7:bit.ly/2QUkwXr
Download Free Plugins for iClone7: bit.ly/3hVdD39
iPhone Mocap in iClone7 with LIVE FACE app: bit.ly/3usNY4h
Lip Sync Animation in iClone7: bit.ly/3oWSebd
Download the iClone Unreal Live Link plugin: bit.ly/3oZnDKb
Download the Motion Live Plugin :bit.ly/34jMajB
iClone 7.9 Major Update: bit.ly/3hVsYAQ
iClone 7 Animation Pipeline: bit.ly/3bWNuwX
Get to Know Python in iClone7: bit.ly/34jTQCv
Links to Character Creator Resources you can use:
Character Creator 3 Pipeline: bit.ly/3uoLtAe
SkinGen Premium Plugin for Character Creator: bit.ly/3vsUidx
Headshot Plug-in for Character Creator: bit.ly/3fQyJgk
Links to Cartoon Animator4 Resources you can use:
Download Cartoon Animator 4 to create 2D animations: bit.ly/3p0jZzS
Turn Illustrations into Animations ~ Draw Animate Pipeline using Cartoon Animator: bit.ly/3yOxS8T
Motion Live 2D Plugin ~ Capture Body Mocap for 2D animation in Cartoon Animator: bit.ly/3fKr0k5
#metahuman #omniverse #audio2face

[@zenparvez]

Honestly, it needs more polishing, it just looks like she is just moving her mouth and the viseme is very lackluster, even an iclone acculips does a better job than this. I know i sound very negative but for now this can only be used for beta testing and just messing around !! Thank you for the video anyway Solomon, always a pleasure.

[@TronikXR]

I'd have to respectfully disagree. Acculips literally only animates the lips. I'd say Acculips offers more control as far as iClone facial expression customization, but out of the box Audio2Face is far superior. Especially with the expressions. It doesn't have that deadeyed look that most of us Animators struggle with.

[@FPChris]

Yep. Not convincing.

[@larabatech1200]

you are a life saver, I couldn't figure out the activation on my own, thank you so much

[@nitsuguareinrof7916]

Hey Solomon, thank you so much for this tutorial, it was soooo helpful ! God bless you mate :D

[@SolomonJagwe]

You are most welcome. I have uploaded a new tutorial for Unreal Engine 5.3

[@JoshuaLundquist]

Dude amazing, Metahumans have come such a long way, also what is your lighting setup? It looks so clean!

[@SolomonJagwe]

Thank you. I use a simple 3 point light system with rectangular lights, LUMEN

[@Elektrashock1]

I'm literally setting up my 1st test. Just "found" the plugin 😉

[@BongoEdits]

Thanks - What about streaming the audio into Unreal Sequencer using this workflow? Have you guidance for that?

[@TronikXR]

Hey Solomon! Thanks for sharing this! Is there an easy way to export the animation directly to Unreal without using Take Recorder? The same way we can export FBX from iClone to Unreal Engine without using LiveLink? That method just makes it easier for the audio to stay in sync with the animation. Thoughts?

[@Doctor-ts4le]

is it free to use for game dev team with only 1 developer for commercial purposes ?!

[@UpgradingOpenWorldGames]

Hey Solomon, may I ask what setup you have to run this? I have a AMD Ryzen 9 5900X 12-Core Processor 3.70 GHz with 64 GB RAM and RTX 3080 graphics card, but it stutters like hell in realtime.

[@andresbasso7264]

Thank you. Is there a way to make this work in real time and not through the sequencer? Would we need to use Audio2Face as some kind of server? What if we want to create something that works in real time and install it on a GPU-based server using pixel streaming, would that be possible?

[@A000803323]

meanwhile for cc4 I need to do like 100+ steps to get close to this lmao

[@cord.]

Hi, When I want to make a take recorder my metahuman turns bald how do you fix that?

[@Ajaydeep_Singh_Brar]

I have a GTX 1650 and Audio2face isnt working cuz my pc doesnt meet the minimum requirements, is there anything I can do? or is there any other way to animate metahuman without using an Iphone

[@belowdown7339]

Great, is there a way to make it run faster or include the head movement in the usd file?

[@sjebastinraja9090]

This is awesome and working well. Is there any possibilities to do the full body animation with facial expressions using this A2F and UE ?

[@supermattis108]

its called audio 2 face :D :D :D

[@jebastinraja3703]

@@supermattis108 what is that? Can you explain more about this? Or share some reference video or link?

[@supermattis108]

@@jebastinraja3703 not to be disrespectful but this video literally says " Audio2face to metahuman, how to animate Metahumans using audio2face" ..

[@ActionCopilot]

Has anyone obtained this result, but with the offline option? (Blendshape Export JSON) Those who experienced Audio2Face with Metahumans know that the quality you get with the offline option is not optimized: When you export the JSON animation and apply it to your metahuman, it looks different than Audio2Face: The mouth does not close, the eyes do not blink completely.... there are many bledshapes to fix and the animation is unusable :( With this online option (Live Link) it seems that this was fixed it, but I don't want to use Online Option , I want to use the Offline Option 😢

[@kingsleyadu9289]

Thanks man❤❤❤❤❤, how are u able to make ue to work when you are still using other software, am facing this issue when am live link and I tap on other software ue pauses.

[@michaelbishop813]

Is it possible to use daz characters or daz to unreal characters for this process?

[@sinanimacionnn-q3z]

Can the same be done for Audio2Gesture?

[@JDRos]

5:35 You didn't actually teach how to open the Live Link window.

[@stephenfalken7604]

Thx, I do not need an iPhone anymore! How to add it to sequencer`s timeline? I would like to render the whole sequence in UE 5.2, but I need to trigger the Metahuman`s speach in Omniverse, Audio2Face to make it work. Any help?

[@maxgenuine]

Is it possible to do Metahuman idle face animation when it's silent (no streaming audio incoming from A2F)?

[@GameAndJokes]

I have a question can we change the audio source in realtime like i want to keep on getting it an audio file Audio 2 Face through some code and i want it to lip sync it with expressions so is it possible?

[@Kaigozen]

but you didnt tell how to import the edited meta human to the project with zoomed face and clear background, (sorry im new to this)

[@danielbacsur]

Thats the "Metahuman Lighting" sample from the asset store. After install you just drop in your own metahuman into the scene.

[@Kaigozen]

@@danielbacsur got it, thanks brother

[@24vencedores11]

Can i use CC4 character in this workflow?

[@s.patterson5698]

Yes

[@jeanallien]

Any idea on how it can be done in Unity? Thanks.

[@granul555]

How to bake lips animation in unreal?

[@tayyabgul6795]

Does it work on GTX?

[@24vencedores11]

Salomon u did not answer my question. Does it work only for metahuman?

[@SolomonJagwe]

The new Omniverse Audio2Face live link works only with MetaHumans

[@ShevendelZeys]

hey salomon, can i ask why when i clicked the activate in NVIDIA A2F it doesn't work? this is the error "2024-10-23 03:08:33 [Error] [omni.audio2face.utility.scripts.utils] [StreamLivelink] the BLENDSHAPE NAMES input is empty. Please connect or enter a valid input before activating the streaming"

[@twilightfilms9436]

Can you upload your own audio files? Thanks for the video by the way……

[@SolomonJagwe]

Thank you. Yes you can.

[@chelo111]

can you use your own voice????

[@SolomonJagwe]

Yes

[@dazai4688]

why my metahuman bp don't show livelink session

[@twilightfilms9436]

How do you record the animation?

[@SolomonJagwe]

you add your MetaHuman to Take recorder, and then start the stream, and record

[@DLVRYDRYVR]

MH finals need to be rendered in UE

You should watch a tutorial about how to make a tutorial.

[@cinematicfilm6559]

AO AO AO AOOOO AAA AOOOO AOOAOAOOO AOOOO AOOO

[@BP-kc3dj]

Why in the world woud you do an Asian vocal then not play anything else like english for the rest of the tutorial so we can see how well this syncs?

[@moonstrobe]

Looks unrealistic. Might be OK on a 2d anime model, but not something that's supposed to be realistic 3d.