Metahuman Animator Tripod Mode Tutorial

Metahuman Animator Tripod Mode Tutorial
JSFILZM Mocap Helmet: • Cheap Mocap Helmet for...
Mocap Waitlist: JSFILMZMOCAP AT GMAIL DOT COM
Grab my new Unreal Engine 5.1 Course here! Be sure to share it with everyone!
Link to lighting course: www.artstation.com/a/25961360
Link to How to make a movie in UE5.1 www.artstation.com/a/22299532
jsfilmz.gumroad.com/l/lmaqam
My Realistic Warehouse VR Demo: www.artstation.com/a/27325570
My Fortnite Map: 3705-9661-2941
Join this channel if you want to support it!
/ @jsfilmz
Sign up with Artlist and get two extra months free when using my link below.
Artlist
artlist.io/artlist-70446/?art...
Artgrid
artgrid.io/Artgrid-114820/?ar...
‪@UnrealEngine‬ #unrealengine5 #metahumananimator #metahuman

[@Jsfilmz]

Tripod mode and livelink method per your request. Here is the rap video in case you missed it. kzbin.info/www/bejne/jKeTZ36Hm71pg8k

[@worldbas3609]

i like this steps but with out iphone! can i record video by gopro for example?

[@Insectula]

Been watching you for a while, and at first I thought you were fairly useful, but lately your videos have gotten so good and beat everyone to the punch, that I'm finding you indispensible. Kudos my man!

[@patrikbaboumian]

Totally agree! People are not appreciating what we get from Epic enough.

[@dreamzdziner8484]

Though I'm an android user I totally agree with your view .I just have immense respect for the Epic team for sharing so much of quality updates to the creative community absolutely free. 🙇‍♂

[@Jsfilmz]

Well said!

[@DLVRYDRYVR]

2:37 made me spill my ☕

[@Jsfilmz]

hahahahahah thats how i smile in family pics bro my wife loves it

[@m.labadi]

We are definitely blessed to have this for free. And the price of it is an iphone that we also can use in our daily lives then be it. Great Tutorial bro!

[@Jsfilmz]

agreed

[@scinematography6196]

I agree with your view, if my project was further in development I'd be jumping straight into getting an iLIDAR 😅 Just wish I could use a standalone system built just for this use, I imagine some enterprising folk will develop some work around. This is super good for working with actors too, being able to quickly showcase a demonstration after a take is going to be insane.

[@gregzambo6693]

Thankyou ! Great tutorial !

[@shamrocksessions4802]

Thank you so much again, best MHA tutorial so far!

[@nathanhackerbts9081]

Thank you so much!

[@612858]

This is great! If you can do a part 2 of this video show casing the body animation and dialogue, that would be super dope!

[@BadbitStudios]

The only reason I've been hesitant to pull the trigger on buying a cheap iPhone for LiveLink.. is that I was hoping an AI powered android solution would come out.. but you're right.. buying an iPhone (as much as I detest apple).. is a small price to pay for this kind of functionality.

[@DLVRYDRYVR]

14:10 Jae-Ye West

[@liammurphy3693]

"its going to be dark inside your hole" was my favorite part.

[@Jsfilmz]

LoL

[@QReviews412]

JSFIMLZ You are my hero fam!

[@Jsfilmz]

hey man that just made my day thanks man just dont forget bout me when u rich

[@khoudianis9650]

"we need to slap ourselves in the face, and really appreciate this tool", can't agree more on that

[@Jsfilmz]

❤ not too hard though

[@rosuckmedia]

Hi JSFILMS, thanks for your tutorial. you are the teacher Keep it up. Greetings Rob.👍👍👍👍

[@Jsfilmz]

hey rob!thanks for stoppin buy dude

[@ampgamedev6245]

Hello, this is a truly powerful tool that allows you to achieve results similar to professional ones at a minimal cost. Furthermore, I have already been using it with Unreal Engine 4 to animate characters in my projects using Livelink mode, with truly exceptional results. Great job, greetings to everyone! Anthony

[@lucianodaluz5414]

Great speech about complainers! By the way it works with Iphone 11 as well.

[@Jsfilmz]

yea works with x too :) just not officially supported

[@digitalfilmanimationkktmr]

awesome!

[@chipcode5538]

Great work, do you know if it is possible to capture a texture from the calibration video.

[@TheAvoidgodlike]

Very very very nice! eBay is gonna run out of stock on iphone 12 mini lol!!! I mean imagine a few years back the 3D animations in movies was a real pain. Great content man keep it up! People should smack that like button! Too bad I can only like this once...

[@Jsfilmz]

hey man u likin once is plenty enough i appreciate u

[@worldbas3609]

@@Jsfilmz can i use gopro compensate iphone?

[@kool-movies]

thanks for the vids

[@Jsfilmz]

yw bro bro

[@soncho.editz1]

Oh I forgot to say I understand what you mean , like people need to understand that it’s better to pay little for a better result than to start meshing or even complaining that androids don’t support , I got a 12 mini as well

[@shadyx6452]

Thank you for making this video. Mocap helmet are so expensive in India.

[@MADMOVIESINC]

Awesome video, as always! Question. Have you noticed that there is less sensitivity on eyebrows when using LiveLink? Is there a way to make them more expressive? I'm noticing that if I raise just one eyebrow nothing happens, but if you move both, it changes.

[@AlexiosLair]

To clarify, you CAN go backwards. But for this you will need to export the animation file and then import to your project. Migration won't work. And when building your mocap you need to make sure you will create the animation for your Metahuman, because the latest 5.2 Metahumans will have a bit more morphs. So to make it more consistent you can make it for your own.

[@Jsfilmz]

yea no i wouldnt suggest that to anyone bro that sounds like a bad idea 😂 ive been dealin with metas since beta i wouldnt suggest goin back

[@AlexiosLair]

@@Jsfilmz updating metahumans forward can be a headache just as much as upgrading your engine deppending on which version you have. I personally don't want to mess anything with my current project, so I prefer to keep it on current version while still using animations coming from Animator. Pretty sure there's plenty of people like that :)

[@aerospacenews]

Hey Jae @Jsfilmz, always appreciate your effort in bringing the latest about UE in your videos! Maybe I'm missing something but could you please do one showing the whole workflow with the new MH tools including the capture of production-ready dialog (voice) with lip synch? I've seen refs to a separate lip synch MH tool but I've not seen one tutorial that includes the full new workflow from face capture on an iPhone right through to a sequence that has the face animation running along with accurate lip synch to properly recorded voice performance audio. I mean, one does not use audio captured on the iPhone during the facial animation, right? Thanks!

[@Jsfilmz]

i sync in post like i taught in my course its basically same workflow

[@aerospacenews]

@@Jsfilmz Ah, thanks for the reply. Sadly, I've only been watching your KZbin videos since I've pivoted from AE to UE. Not been through your course. I think it was a tutorial on using a third party body/clothes with a MH head if you are curious what got that first view. Been subbed ever since. Again, really appreciate you putting in all the effort and hope your helmet is a mega success and you hit that 100K goal.

[@ThrillDaWill]

im having trouble with my facial mesh skinning correctly with the body in the sequencer, do you have and tips or videos on how to fix that?

[@Jsfilmz]

thats too broad bro 😂 wdym

[@612858]

Can you show how you can use this with a conversation mocap in sequencer? How do you merge the dialogue? Step by step pls. No iclone please. Thanks

[@akinmaya]

Hello Sir .Good job!👑

[@Jsfilmz]

Thanks and welcome

[@duddleypembere7079]

have you tried to use the metahuman animator to replace mesh to metahuman , i wonder how would it look like , if it its better or worse than mesh to metahuman

[@alimohamadpur]

Hey man can you make a tutorial on how to do body motion capture (using rokoko ai or wonder studio) and facial capture at the same time? there are tons of tutorials out there but either body capture or facial none of them are about full body and facial capture together

[@Jsfilmz]

man i made an entitr course on it 😂

[@DanielPartzsch]

Thanks. Can you transfer the calibration identity to other projects as well? So basically that you only have to do the calibration once for a certain performer and then use it later on in new projects where you only get new performance takes from this performer?

[@Jsfilmz]

thats tricky cos i feel like helmet placement moves

[@user-dx9lt6yy3c]

Where are the two videos you said you did (calibrating and take)? Not seeing them in your channel. Thanks :)

[@jamesgoodman2931]

Great tutorial. Any idea why my add teeth option to neutral pose are greyed our so I can’t create them?

[@jamesgoodman2931]

Realized I had missed a key stage!

[@theshizon]

yeah dude. WETA spent millions of dollars for Gollum. Digital Domain also spent millions developing Thanos and other characters for Marvel. Being able to do this with an IPhone is mind blowing

[@Jsfilmz]

exactly

[@computron5824]

Let's play devil's advocate to your devil's advocate 😄. Epic and Apple do not get along. With all the anti-Apple tweets from Tim Sweeney, you would think that Epic would not place itself in a position where it's completely reliant on those devices. Long term, I'm betting that this will become broadly available outside of a locked ecosystem.

[@Jsfilmz]

ill play devils advocate to your devils advocate of my devils advocate. I honestly think this is one of the reasons why Epic probably doesnt have a choice on what device they want to use but unfortunately its the only one. Many people who dont know the beef between epic and apple thinks epic just want to promote apple products 😂

[@castilho-art]

make a video with the head moving, I can't attach the head to the body when the neck is moving

[@Jsfilmz]

yea cos its prolly fighting since ur head mesh has data and ur body has data so its like wtffffff

[@MiguePizar]

Thank you for this tutorial, It was exactly what I was going to ask you before, how to use on our own metahumans. Really thanks for all these tips. Have great day.

[@Jsfilmz]

Glad it was helpful!

[@shahin8569]

Wow

[@ValentinoLaza]

Hey thanks for this tut! If "Methuman Animator" is missing when right clicking in the Content Browser, does that mean a plugin is not activated in UE5.4?

[@momomadi2]

thanks bro in 4:58 queue is spelled like the letter Q

[@Jsfilmz]

abh yea i didnt know thanks

[@snap-n-shoot]

Could you do a video if possible with the same process for the head and then add a body where it is attached and moves while the face talks?

[@Jsfilmz]

i did already

[@snap-n-shoot]

@@Jsfilmz ok, cheers, I will try and find it. another question. how is the speakers audio added to the render?

[@alexanderkingkwame241]

Iv been thinking 🤔, can we use a snoricam with DSLR fix to it , I mean literally can we use a DSLR camera?

[@OMGITSGB]

ok... so I literally got a mini cuz of this to, I watch some of your videos, and now im wondering if I shoulda gotten the pro for the LiDar... from your opinion, do you think the LiDar is worth the extra 200 dollars? or is photogrammetry just better? I realize this question is off topic, but I just want to make sure I dont spend more money for no reason. I am currently setting up 5.2 to see how good the animation comes out. But yah, the question of if the LiDar is worth it, has been really bugging me.

[@JonCG]

Great work as always bro. just asking,why i can't hear the sound when i play on the sequencer,any tips,thanks

[@Jsfilmz]

might have to add audiotrack manually

[@JonCG]

@@Jsfilmz thanks bro.MHA doesnt work on real time?

[@user-xh6kb2vt3v]

bro,how about optimization?

[@ArabicTechAILab]

when I play the level in a new window (PIE) the Metahuman character is moving his face with my motions very good, but when I click in any window other than the PIE window it starts to lag. and when I click again on the PIE window, the character moves normally ! what should I do ?

[@rudy552]

hello little question once the steps are done and I restart a facial performance do I have to restart all the manipulations on metahuman animator?

[@mucod2605]

Can I used my ipad 2019 for metahumans animator.😅😅

[@jonos138]

When I've completed an animation, I've noticed inbetween movements of my character head, there is slight jittering, i can see it shaking the hair too because of the head jitter. Is there a way of smoothing this out? I notice sequencer has some filters in the graph editor, but im not sure how to go about it. I used metahuman animator btw for recording.

[@realnickg]

Did you have any issues with the capture source asset when you started? I'm missing the drop down to be able to select the device and can't seem to find anything that needs to be specifically in place on the project to get the capture source working. No mention in the documentation 🤷‍♂️

[@Jsfilmz]

nah man i havent had issues what u see in these tuts is my xp

[@THIS_is_BRANT]

can i migrate the animation sequnce into unreal 5.1 projects?

[@RicardoLimaVFX]

Is it possible to use videos made by an android cell phone or PC?

[@sybexstudio]

My second take is not showing. Do they need a naming convention to work? I’m doing offline mode. Just subd

[@sathishapple5600]

Is it possible export facial animation from unreal Engine to iclone. 🙃

[@michalprzedlacki8382]

Do you need iphone to record face or you can do it on android phone?

[@Wellbeing_Kim]

Would it work if I filmed and exported facial videos of people in places like KZbin with the Unreal livelink app? If so, it would be very good for Likeness work.

[@Wellbeing_Kim]

I played the KZbin video of 3 sides of JS + teeth, filmed it with the App, and tested it. (Sorry JS😵‍💫) It works, but it comes out like a crushed person because it's a depth value plane (monitor). Still, it's amazing that the position of the eyes, nose and mouth fits with the frontal standard.

[@ManikandanRanjendran]

Is it possible to export 'blendshapes' animations to other software like Blender? What if I want to make characters like Gollum?

[@Jsfilmz]

cant render out of unreal

[@jj7pupu641]

Hey man, first of all thanks for this tut, I ran into a issue that when I click prepare for performance, the error showed up and said vulkan not detecting my gpu, it was all good last year but suddenly I couldn't do it. I'm using rtx 4070 laptop and I've tried to reinstall my graphic card, downloaded vulkan sdk, even reset my whole laptop but it remains error, do you have any solution for this? appreciated!

[@chelo111]

bow---do you know how to have your exr image sequences cast shadows????...can you please help....

[@Jsfilmz]

still not fixed? 😂

[@roopam-kp8bc]

Hey , bro the the metahuman animater option is not available in my project

[@user-tu4ec8sm7l]

What makes the iPhone 12 mini your choice over the 11-12-13?

[@Jsfilmz]

12 is min requirements official supported i think

[@LOL1423derp92]

Do you know if it’s possible to use move ai with a mocap iphone helmet? Or does it only work without a helmet

[@Jsfilmz]

i tried it with facegood it worked with moveai

[@OfficialCloverPie]

when you export animation with the head movement unabled, afterwards in the sequencer, the head/neck is detached from the body, it floats in free space while the body is still, how to attach them together or make only the neck and above move and not the whole floating neck...

[@Jsfilmz]

hmm so many people are having this issue i know how to get around it. whats a good keyword for a title of a video?

[@OfficialCloverPie]

@@Jsfilmz title..🤔 maybe.. “Fix for the floating head bug in sequencer | Metahuman Animator” something like this and a thumbnail of the head glitching out of the body??? Not sure..😅

[@Jsfilmz]

​​@@OfficialCloverPieetahuman Animator Floating Head Fix?

[@OfficialCloverPie]

@@Jsfilmz yeah, this works much better!

[@christiandebney1989]

did you ever looking into the skip filtering tab?

[@Jsfilmz]

yea i couldnt see diff lo

[@christiandebney1989]

haha@@Jsfilmz

[@graygrandeza6126]

Hello! I'm not sure if I'm doing something wrong here but when I go to the OSC server to check my phone's IP the Target IP Address just says "none" Is there a step I'm missing?

[@Jsfilmz]

wdym?

[@nbillinger2]

I NEED HELP! Unsure if anybody will see this now, but I'm in desperate need of help because I can't get this to work. The second I try and open Metahuman Identity, it just crashes. "GPU Crashed or D3D Device Removed. Check log for GPU state information". I can't find anything online, my specs are more than enough to be handling this and I'm not even getting the chance to use such an amazing tool. If anyone sees this or knows how to fix it, please let me know!

[@davidMRZ]

is there anyway we can use metahuman animator for a metahuman we created before? I have started a project and I took some photos from the guy who is the main character and turned it into metahuman using keentools in blender and now I wanna use metahuman animator to drive the facial movements. is that possible?

[@Jsfilmz]

yea watch my maya tutorial video its the same concept the animations can be applied to different metahumans

[@PhillipBerg]

I have now done several calibrations with two different people and for some reason the takes always end up super wobbly where the bottom side of the face dances around. I don't know exactly what could cause this and why I'm not getting any clean smooth takes ?

[@Jsfilmz]

your footage is not stable i dont have this issue with my mocap helmet tbh

[@PhillipBerg]

@@Jsfilmz Could it be the distance to the phone / camera?

[@377omkar]

I got an iPhone 11 for this but unreal can't detecte it , it's a problem

[@Jsfilmz]

try offline method u might have firewalls

[@cj5787]

do one with head movement man

[@Jsfilmz]

from the animator?

[@cj5787]

@@Jsfilmz yes

[@swinny_]

Android user here, I bought an iphone 12 today for this functionality. People getting the shits with epic over this have very little understanding of the tech behind it. ''Entitled'" comes to mind.

[@ViktorSzemerey]

Hi, I often watch your videos, thanks for all the work you put in. However, I have now run into a problem that I can't find a solution to. @10:09 when the process ends, my client simply quits and restarts. All my software are up to date, all my hardware are compatible. Any idea what could be causing this error? I can also send you my crash log, but I couldn't find a solution in there either. Thanks!

[@Jsfilmz]

not sure tbh man my cpu is older as well try unreal forum or discord they are the experts im just a dude with a 4090

[@ViktorSzemerey]

@@Jsfilmz i wrote a post on the dev forum. I’m blessed with a 4090+13900K Cheers

[@warrenzechnas]

Faceware just left the solar system.

[@Jsfilmz]

yea man this is gonna make alot of people sweat tbh

[@3dbrasiltutorials495]

Can you make the online version?

[@Jsfilmz]

only works offline

[@Goofy_Toons]

the real flex is doing it in your boxers 😆

[@Jsfilmz]

😂 avatar six with only my boxers

[@geteago]

Hi! This works with iPhone 11? And thanks for your videos 😄

[@Jsfilmz]

ive had people try it

[@geteago]

@@Jsfilmz Ok, thanks 👍🙂

[@arturito1994]

top

[@Jsfilmz]

down, wheel spinning < name that song

[@jonos138]

Not related, but I've searched everywhere for an answer and cannot find it. I have a custom metahuman. I created a new morph and sculpted in blender. Now I find back in ue5.3 when I bind the eyebrows they are a bit too high. I cannot find a way to adjust their height. If I don't bind them they won't work with expressions and animation. Help! Anyone have an answer???

[@Jsfilmz]

not best method to do custom metahumans. metahumans have 780 bones 800 blendshapes so the way your doing it would be a headache

[@jonos138]

I corrected it now with help from a creator on another channel.

[@Big788]

When ’Process‘ It crash！！！ I'm crazy，Help me！！

[@Jsfilmz]

cpu not fast? gpu?

[@music_creator_capable]

Hey!

[@precociouscurmudgeon937]

Resting b face at 2:22

[@Jsfilmz]

lol

[@ComanderJTC]

Android cameras don't have the right sensor so buying an iPhone is the cheap option then to go buy the cameras originally meant for it are like 10 or 20 times the price of an iPhone if android phones add what is needed then the app will get made for it but either way you would still need to buy a new device so anyone complaining probably just doesn't understand android just cant do it without some software advances for current android phones like linking 3 or more phones to have multiple angles to get proper depth data to make up for not having the right sensor now android does have a method with current hardware and software to try and mimic what the iPhone sensor does but its not as good I think the sensor is lidar or something but i forget either way a little research into it and understanding why android doesn't have something like live link is better then just complaining, people should try and find solutions to the problem and understand the difficulties in a solution and the time it takes vs buy a device that already has all the solutions and software to support....I think go with what works and keep making things better is better then finding a soloution to make everything as free or cheap as possible to please everyone if there's a solution its a waste of time to keep making more solutions to a problem just to make everyone happy if you need facial capture for games or animation make it part of the budget an iPhone is the cheap option if you look at any other option and for reference im also a android user i use Samsung note 10 plus i went and got an iPhone for this even though it wasn't really something I wanted to do but its cheaper then the alternative

[@Jsfilmz]

wan hundred percent

[@carlosrivadulla8903]

Isn't AI pictures to metahuman the next logical step?

[@Jsfilmz]

im sure eventually this already does it with one frame 😂

[@user-ym6gt8zz4v]

I don't have iphone...this is unreal 😢

[@Jsfilmz]

haahah yea not bad for $320 phone

[@ZeroBudgetLife]

sub for the pep talk.

[@Jsfilmz]

hahahs man i almost edited it out too much drama

[@rob9999]

I pooped my pants

[@Jsfilmz]

lol

[@realtyrone]

Just for a bit of insight, a second hand iPhone 12 mini will set you back 14,000 SOUTH AFRICAN RAND, okay? The average salary in South Africa is 5000 - 6000 rand a month, keep in mind that we need to pay rent... We don't live for free.. lmao. So fair enough if you live in a first world country. Most people only have android phones because they are cheaper.

[@Jsfilmz]

i mean bro i grew up in the philippines this is where priorities come in to play food > unreal engine

[@realtyrone]

@@Jsfilmz I do agree with you. 100%. Just keep in mind that South Africa has some of the highest unemployment rates in the world (actually, it's number 1 at the moment) and a lot of young individuals get access to Computer Science courses, free of charge. Most of them love game development and want to make that their main focus, some even enjoy making films with Unreal Engine. They see these kinds of things and wish they had access to it. About 80% of them never will. I feel that Epic should at least consider alternatives to make it accessible to pretty much everyone. Similar to what FACEGOOD has been doing. I also find it quite hilarious how they keep implementing these things on products made by a company they've been suing.

[@soncho.editz1]

How did I just notice behind you is a green screen 😂🤦‍♂️

[@Jsfilmz]

LOL

[@itscoldcoldwinter]

can someone put a iphone 14 torrent so i can get it for free 😅

[@Jsfilmz]

this guy

[@cthrower]

hahahaha...

[@thedevilhimself1728]

4:58 Sorry, but.. What the fuck is a "kwek-away"? ahahaha, it's pronounced "Cue" or just the letter "Q". 😂😂😂😂😂😂

[@Jsfilmz]

nah bro im pretty sure its kwey kwey 😂

[@rickh9908]

"promo sm" 🙃

[@3am_vdb]

When I import From Footage I just see a black take, no matter how I import the take, I have an iphone 11 it should work. Edit: nevermind, fixed it, just found out it does not work with Substrate, lol.

[@Jsfilmz]

dead

[@canaldemais]

hi Juan! how did you solve this? I get a black take also. But all the files are in the project! I can't seem to see the footage... only the depthmap footage

[@3am_vdb]

@@canaldemais No, just used a different project without Substrate enabled and it worked.