How to Use MetaHuman Animator in Unreal Engine

[@Raztal]

The way it creates a 3D-Model of my face, via the video capture.. Just tested it on iPhone 12.. Wow. You guys nailed it! Gamechanger. Holy moly :D

[@buraksozugecer]

Do we need Iphone or any phone works?

[@EnterMyDreams]

does your unreal 5.2 not crash using Metahuman Identities and processing the neutral pose? I get it crashing every time.

[@buraksozugecer]

@@EnterMyDreams hello, can we use other phone? Or we have to use Iphone?

[@Raztal]

@@EnterMyDreams No issues here so far. Sorry to hear you got crashes

[@Raztal]

@@buraksozugecer Only iPhone 12 or better

[@Game-Stepper]

Seriously guys, each time Epic comes up with new outstanding features on Unreal Engine, I'm turning myself into a rocket scientist mentality. The team at Epic Games rocks!

[@patrikbaboumian]

This is a huge game changer for indie devs and animators. Thanks, Epic! 🖤

[@danielyeh1627]

why there 's no metahuman plugin?

[@AlexisRivera3D]

Do you know if this can be exported to Blender?

[@edentheascended4952]

@@AlexisRivera3D most animation data and 3d model data can be exported from unreal engine as FBX. You'll have to find a tutorial but it should be possible, if not... it would be because unreal engine as a company set up something to keep this from taking place. considering the fact that unreal is more recently apart of many pipeline software, the chances of that being the case is slim to none.

[@naytbreeze]

Anyone know how to solve issue where the body becomes detached from the animation ? My head is animating and it separates from around the shoulder area .

[@AlexisRivera3D]

@edentheascended4952 I exported the Metahuman to Blender but has some issues, for example the hair is not compatible with Blender so I had to add a new one as hair cards

[@qaesarx]

Now the only thing we need in Metahuman is proper age. Its difficult to make very young and very old people physiques. Great work, thanks guys!

[@williamtolliver749]

Yeah best thing ive found is manually scaling down bones. Guess they dont want some freaky children stuff inthere, because im sure ppl would go that far for shock value....

[@nximusic]

Thanks, this will be a great help for my Unreal Engine music clips and trailers

[@sheraixy]

4:59 you must select a body type before „Mesh to Metahuman“ - otherwise you get an error do that by selecting „Body“ down at the left outliner

[@TheWillvoss]

as well as a bunch of other steps that this tut missed, heh. I mean, thank god for pop up boxes, but sheesh.

[@HoudiniEnjoyer]

always unreal what you guys bring to the table!! This is so awesome, cant wait to try !!

[@stephanedavi]

Thanks a lot

[@andreww4751]

oh yea it makes your games epic!

[@NickHeinOfficialPage]

When I bake the Face animation to the Control Rig like in the video, the animation freezes. Anyone have an idea what to do?

[@hamzaahmad9735]

Epic is just amazing ... Love how they open source every progress they achieve❤❤

[@stephanedavi]

Thanks a lot

[@warrenzechnas]

I am speechless.. This will shake the industry! A HUGE thank you to EPIC for this.

[@behrampatel4872]

Simple and straightforward process demo, Raff. Thanks & Cheers

[@marcusclark1339]

I'm reminded of something Siren devs did years ago, thinking of that old technique to create a realistic face to now is so surreal yeah it'll really help indies, they could use unreal for faces and probably still import to other places if need be

[@iamthenightshift]

Hot damn. I use Unity at my job, and Unreal at home. And switching from one to another feels like I'm traveling 10 years into the future. Completely ruined any chance for Unity to catch up in terms of graphical fidelity. And it's just as easy to use, if not more so in some instances. Insane.

[@hyperspace-films]

Thank you so much!!! This has given indie devs a way to compete with AAA titles!

[@antoni-yt]

Hihi. I was waiting for this plugin since you announced it. And I prepare 2min of videoclips for making a short film. So you published it in the exact right point and I want to thank you for making it possibil that I can do this stuff for free. :)) Thank you really much

[@entropicvibe]

It would be awesome if you add Webcam or Android camera support

[@davidedemurodominijanni9889]

Ain't gonna happen, unfortunately. I gave my hopes up on that. A lot of people, specially new solo-devs on a tight budget trying hard to finally start making profit from the struggles of learning and experimenting with all they've got, are looking forwards to seeing that finally happening... and while waiting for that other people remain one or two steps ahead. They say we can use an head-mounted camera but why not simply have the chance of using the smartphones we have? Evidently they do not agree or do not find that business-worthy and rather look at us as dinosaurs... ready for extinction! I love Apple, don't get me wrong, but their monopoly when it comes to some stuff is hugely annoying...

[@CarbonI4]

Honestly kind of confusing, is there some technical reason for the lack of support outside Iphone? What self respecting developer owns an iphone anyway, a difficult to modify, locked down system. There is a reason for the meme of graphic designers/artists etc using apple products, they aren't generally the technically minded ones, and I say that as an artist.

[@ed1726]

@@CarbonI4 It requires depth data. Hence you have two options, stereo capture or iphone (which uses lidar).

[@muviing5427]

It's a really really GAME CHANGER... Epic is gaming in the real world. Thanks for Epicgames and Epic developers!!!!

[@parralox]

Great tutorial! Also… P is for Plosive 🤓

[@TheNovaProspect]

You just unlocked so many doors for me, you have no idea.

[@Riptwo]

This tutorial is fantastic! I'm hoping that there's a follow-up about batch processing performances via the included python scripts. I have a project with around 300 takes, but I haven't been able to figure out the batch processing workflow yet!

[@MarisFreimanis]

So finally it’s out? Nice! Thank you!

[@synapzproductions]

HERE WE GO!

[@the-secrettutorials]

This opens a new world for people like me 🤩

[@TheNSproject]

Nice video! I wish I know where I am wrong. My BPMetahuman does not move with the animation...

[@bingzhou7970]

Finally ! Crazy work is comming! 😍

[@RavenWT]

Can't wait to try it! Tomorrow will be a busy daayyyyy!

[@stylezmorales]

question, does this require an iphone (aside from the stereo camera of course), or can the footage be from any camera at this point? Just curious, wasn't sure if it was using the iphone lidar data or something like that.

[@lexastron]

I double that question.

[@stylezmorales]

@@lexastron I did find out that it does use the data from the iPhone camera and that's why they use it. There's ways to use Android or a webcam, it's just not as accurate or articulate unfortunately, however, you can get close and then hand animate the rest to get it a lot closer to the performance. It'll take a little more work but I guess it's doable just would be a lot easier with an iPhone

[@lexastron]

@@stylezmorales Got it. Thank you 🙏

[@stylezmorales]

@@lexastron np I hope they start adding similar tech to androids, I'm not a big iPhone fan but I gotta admit iPhones do have the tech we need lol

[@IvanHalimau]

GREAT TUTORIAL! Thanks Epic Games ❤

[@MyChannel-l4w]

Fantastic I was waiting for this.

[@oldmatttv]

Really, really interesting. Great video making everything as simple as possible I'm sure, while still having enough detail. Lots of learning and experimenting to do, but will try to use this feature one way or another.

[@stephanedavi]

Thanks a lot

[@Amelia_PC]

3:29 What's the iPhone app we should download to record videos to import to the engine? could you show us the process with iPhone (a real step-by-step)?

[@SARAIEX]

Live link face

[@Amelia_PC]

@@SARAIEX oops! sorry!

[@PatrickCharpenet]

I must be doing something wrong, when applying the exposed face animation to my metahuman, it works but the head is detached from the body…

[@EthanCasner]

Metahuman is an excellent way to spend three weeks just trying to make a floating talking head actually attach to an animated body correctly. Even if they're literally "both metahuman" as of 5.3 there is still not official method.

[@RichardBoisvert]

Amazing tech, but not a good tutorial. I wish you would have started by saying you'll need your initial Live Link Face capture to have a Front, Left, Right, and Teeth pose. You don't realize these prerequisites until halfway through the video. Also, what's the best way to get the data from your iPhone to your pc?

[@tds_FrankOfficiel]

i'm sure it's possible with a simple camera, why need a iphone ? there are phones with 2 cameras allowing you to have depth and capture volumes, it is also enough to put dots on your face, I hope you will add that in the very near future if not it sucks

[@lievenvanhove]

Thank you for your very clear tutorial. I was wondering if it would be possible to batch-process 50 performances at once with the same Metahuman Identity? Is it possible, or do I need to manually set them up each time?

[@playSHRAPNEL]

At Shrapnel, we are thrilled to be leaning into Metahuman and the flexibility it provides through facial blends, diversity, age and the fidelity it gives you at the click of a button. This is a game changer and we are excited to see what it gives us. - Jay, Shrapnel's Art Director 😎

[@AzizSalokhiddinov]

in 7:48 (Process) I have problem.. please help me? UE 5.2.1 gives an error and crashes..

[@ruslan_3ddd]

Any luck solving the problem?

[@PrintThatThing]

Very helpful, thanks!!! Can't wait to try it out :)

[@JonathanWinbush]

👏🏿👏🏿

[@canndask]

Thank you very much for making this tutorial.

[@Leomerya12]

Can any HD camera do? Android? Streaming webcam? You guys are suspiciously quiet in answering this question.

[@myth0genesis]

You would need 3D capture data. iPhones come with depth cameras, which is why Epic mentions them. You can get a standalone depth camera pretty cheap from Intel (cheaper than having to get a phone you don't want). I think Intel's flagship depth camera is called RealSense and they start at about $100.

[@reinohvp]

It is necessary to have an IPhone or can I just upload a video?

[@yasmeensalawy9601]

help plz 1:56 i find my iphone their but iy don't show any of my captures even when i press start capturing bottom it shows that it is capturing but when i stop it doesn't show anything

[@보리타작-x9s]

solved?

[@Enchantaire]

Amazing! The head detaches from the body when imported into the sequencer though. Why is that?

[@martem000]

I am also looking for a solution

[@보리타작-x9s]

you should erase each control rigs in the sequencer

[@ISknne3D]

Cannot wait to start using this. Thanks. :)

[@DohaElwardaney]

WOW! Now I understand why actors and actresses worry about AI and Digital engines.

[@asntech4014]

can the video is saved locally from iPhone then sent it to the cloud for my colleagues overseas ?

[@oimob3D]

Sure! you send the zip file

[@asntech4014]

@@oimob3D great

[@norvsta]

Mind blown 😲

[@wywarren]

At 7:05 after Mesh to MetaHuman returns, the blendshapes all goto vertex count 0. Is there a way to preserve these after the solve? Standard Bridge MetaHuman downloads have both an embedded DNA as well as morph targets.

[@BadlerStudios]

Are these results much better than the prior LiveLink setup? I am excited to test out myself, but it does look like a more complex workflow than the offline CSV method that currently exists. Excited to test out.

[@Kevin-bc7wz]

Coming!!! Change the World!

[@ed1726]

Are there any guides coming for the stereo capture. I made a capture source, selected stereo archive, pointed it at my directory with stereo hmc. Went to the capture manager, selected the source and.... nothing. No videos to select. What formats are supported? I tried mp4 and mov (does the codec matter)? I assume I am missing some really simple step, but can't find it.

[@보리타작-x9s]

me too.. any advice?

[@LightningProductions-mt8oj]

Metahuman is finally on Unreal Engine 5!

[@brothercuber3288]

Is this possible with android? None of us have iphones

[@coalescence]

Excellent, can't wait to try it

[@3dart_es409]

Please add support to iPad Pro 2022. I used with Live Link and worked perfectly. Now I just updated the app and when I open it, shows two methods: -The old Live Link -The new Metahuman Animator, but it says in red color that my device is not supported. How is not capable an iPad Pro 11” 2022 4ºgen with M2 chip, and iPhone12 is capable?

[@CGeneralist92]

I am wodnering the same thing. Hopefully they will update the plugin to work with Ipad.

[@AlexiosLair]

It is listed on the blog that you need to use Iphone12 or higher.

[@3Dave666]

is working, I tried it on ipad pro 2022 and is fine

[@3dart_es409]

@@3Dave666 really? Don't have any inconsistencies? It gave me an advice that it can behave incorrectly and I didn't try it.

[@3Dave666]

@@3dart_es409 I tried with a 10 seconds video and it looks like is perfectly working, it uses 2 captures (video and depth) and ipad can do that

[@GlassboxTech]

Very exciting!

[@kurkista]

Hi, thank you for this. Is there a written documentation on this/these processes step-by-step? I feel parts of the video tutorial take for granted stuff, a noob like myself has a hard time following along. Oh and BTW. Something I do not understand. How come the Live Link app is available only for iPhone, but the Metahuman plugin in is not available for UE on macOS. Why is that?

[@karlbovski1656]

So I get it, you guys don't like Android, but what about other 3D-Cams solutions like Intel RealSense or similar? Anyway, amazing piece of software, congrats.

[@timothybarbarino3409]

Bit of an incomplete tutorial... GDC23 made it look like you could go from performance to photorealistic, animating metahuman within 10 minutes... This tutorial skips passed that you're using a stock metahuman, skips passed attaching hair and linking audio with the performance... Hopefully more complete tutorial to come.

[@wafi5576]

the photage , is it just a video or its taken with certain app

[@jasoncorganbrown]

I'm running into issues with connecting head to body. Could there be a conflict between the two animations?

[@sahinerdem5496]

can i use any adroid phone video capture?

[@_rider_1063]

When Android?

[@Rokinso]

When Android?

[@MakotoIchinose]

Never 🤑

[@LauranceWake]

Hardware limitations mean android can't

[@_rider_1063]

@@LauranceWake people already made livelink face analogs for android. Also, Epic Games announced live link for android too far ago

[@sheraixy]

when androids builds in a truedepth camera

[@Metarig]

Boom! Epic Games just dropped the ultimate mic-drop moment!

[@pharhillanimated]

Do I have to do a new identity for every project, or can I use the same identity with side views and just add a new performance?

[@caiohaar8452]

Release this beast!!!

[@EvanMapleMaggot]

Thank you guys

[@grmnt.studio]

Hey! I've managed to capture a performance but once I add it as a face animation to the Metahuman Blueprint, the head stays detached from the body. How can I merge them together and work on my body animation separate from the facial / head rotation?

[@SevenkTV]

welldone. thanks

[@jigneshghelani3559]

what about android people?

[@enrix00]

Maybe because Android manufacturers don't want to add the depth camera components that iPhones have and focus on other features

[@Zeno617]

I keep crashing on the prepare for performance step, anyone found a fix?

[@williamminnaar6311]

Good day to you. How would you add clothing items to a Metahuman please 🙏🏼

[@castilho-art]

make a video with the head moving, I can't attach the head to the body when the neck is moving

[@RikkTheGaijin]

yeah I want to know this too

[@davidfarr1839]

looks really good. dose anyone know a way to get access to footage that will work with this I don't have access to a iphone but want to try it out

[@madedigital]

You need at least 64gb of ram to process the animation at the end will this change to 32 at least

[@oimob3D]

I hit "Prepare for Performance" button and received the 64gb ram warning, it's training on 32gb right now with a GTX1080, and my PC is burning!

[@elliotplazinski2264]

New Robocop game needs this badly.

[@FPChris]

In 5.3.2 It looks like once I add the teeth pose, set the frame, and click "fit Teeth" the B view looks like there are two head meshes overlayed and you don't see the teeth result. Then Prepare For Performance fails. ??? REALLY frustrating.

[@adamc3607]

I appreciate the video but i'm 2 minutes in so far and it's missing important information: - I didn't have the Metahuman plugin in my project and there's no link in the video description so wasn't sure where to find it - It jumps straight into how to load in footage with no explanation of how to record it or even the app to download on my phone The rest of the tutorial was great though and worked really well!

[@AlexiosLair]

I'm curious about decoding with audio, can I add a separate audio track instead of using the one from recording?

[@Domm_Dynamite]

So I'm stuck at the part that is conveniently skipped in the tutorial. I have pulled the take files from my iphone and placed them in a folder and set that folder as the target for my capture source. But I don't see anything in the capture manager. :(

[@보리타작-x9s]

me too

[@KillerTacos54]

Outstanding

[@argonproductions]

Hi, i want to take the metahuman with the animation and put It on blender to add a couple of details and do the render there, and everytime i try the animation no longer works, what would be the proper way to archive that?

[@kurkista]

Is there a way to queue Processes for MetaHuman Performance under MetaHuman Animator? and while at it for Export Animation too? This would liberate time waiting for each Process to be finished before moving on.

[@blaszmogames]

what is the cable to connect iphone to pc? i know it can work on wifi but for speed some cable connection is used. what's the cable?

[@wokeupina]

when i press prepare for performance it says it needs 64gb of ram... it makes sense i guess.

[@supermattis108]

Can this be created from video footage from android?

[@MrKylePopovich]

3:52 these two additional left and right frames are IMPOSSIBLE using a head rig (Like the ROKOKO Head Rig) which rotates with your head rotation, giving a frontal view ONLY. You said the frontal should work, so I hope that is not an issue, as it seems to be where the industry is moving (frontal-locked head rigs only).

[@3rdDim3nsn3D]

So awesome! But i have master issue with bridge I create a metahuman with creator (for 5.2) but it is not showing up in bridge no matter what i do. Do you have a solution on that pls?

[@piorism]

You need to login multiple times if it doesn't show up, on both the Epic side and the Quixel side. It's a mess, but it works.

[@3rdDim3nsn3D]

@@piorism i got it to work- i was just very dumb i had to update bridge vie the epic games launcher. After that the metahuman from creator showed up in my quixel bridge. Thanks for your reply man 😄

[@piorism]

@@3rdDim3nsn3D Awesome :) Good luck. And yeah as said, if they don't show up at some point in the future, it'll likely be because of a login timeout.

[@3rdDim3nsn3D]

@@piorism aleight thx for the hint👍😃

[@ehtasham_ulhaq]

metahuman is an amazing tool. but i m mac user how can i install this plugin in my mac?

[@javilan666]

You need to create a hand and body movement tracker. I mean Vseeface can do it highly accurate. But I bet that you can do it better. Or not?

[@vivekanandhan555]

Thank you! Thank you! Thank you!

[@FPChris]

Tried again with 5.4 and it still fails. There was a new ID start screen about system specs. How about more info on that? The error message just fails with no help as to why.

[@valentinnist]

Can I animate the faces of characters created in Character Creator with Metahuman Animator?

[@dmartinr1xxxx]

hi, whats the workaround for when file can't be imported from queue due to audio file being too big? thanks

[@DRLarkin]

Unreal folks: Any recommendations for HMC rigs that work with Animator?

[@AzizSalokhiddinov]

@UnrealEngine in 7:48 (Process) I have problem.. please help me? UE 5.2.1 gives an error and crashes..

[@veith3dclub]

me, too ... could you fix it?

[@Kozlov_Production]

How to fix floating head?

[@Lukimuc]

I only see MetaHuman Identity and Capture Data (Mesh) as an option. The menu itself is called MetaHuman instead of MetaHuman Animator. What did I do wrong?