MetaHuman Animator + Move.AI experiments

A first test of a fully animated MetaHuman, using 3 iPhones with Move.AI for the body, and Live Link Face for the facial capture.

[@soncho.editz1]

I want to know how you made both your head movement and body movement without a suit

[@lubruz7164]

Looks very good! Maybe the only problem is the phone is to high and dont capture the details of the lips with more precision, or maybe its because of your dense moustache ;D

[@hyperbolicfilms]

You may be right! I think the movement is there, but might be hidden by the lighting. When I had him out in a blank scene with a big direct light shining, the lipsync seemed closer. I may try to also mount some lights on the iPhone next time, as that seems to be what's going on in some of the Epic BTS footage.

[@lubruz7164]

@@hyperbolicfilms Good idea!

[@petroglyphsentertainment8498]

Can I use an iPhone SE 1st gen for motion capture?

[@Strawhatshinobi]

Looks great! I feel like my beard was messing with the capturing my lip movements properly. What do you think?

[@hyperbolicfilms]

Could be. The first test I did seemed to have better lip movement, but I was also making bigger movements. Maybe overacting helps when you have a beard.

[@petroglyphsentertainment8498]

Which iPhone basic model can i use for motion capture?

[@hyperbolicfilms]

I'm not sure, MoveAI has changed what services are available now. Their MoveOne app needs an iPhone, but I think your best bet is to download the app from the App Store and test out if it works on your device. www.move.ai/single-camera

[@soncho.editz1]

I feel you would be able To pull off Dutch vander linde in rdr 2 🤔

[@soncho.editz1]

Please can you do a step by step tutorial on how you got all these working together

[@hyperbolicfilms]

Trying to do that now. It’s a bit tough because I lose a lot of the screen capture to dropped frames while Unreal is doing any heavy GPU stuff.

[@soncho.editz1]

@@hyperbolicfilms umm what system u using to run unreal engine ?

[@soncho.editz1]

@@hyperbolicfilms and what iPhones did you do for your move AI ?

[@hyperbolicfilms]

@@soncho.editz1 iPhones are two iPhone 8, one 11, and one 14 Pro. Face capture is iPhone 12

[@hyperbolicfilms]

@@soncho.editz1 It's an Alienware i9 3080 from 2020.

[@davidMRZ]

'great job mate, how many phones did you use?

[@hyperbolicfilms]

3. I shot with 4 (two 8, an 11, and a 14), but the 14 was too close and at a funny angle, so I removed it from the final mocap calculation. I’m glad Move lets you do that so you can salvage a bad calibration.

[@davidMRZ]

@@hyperbolicfilms thank you for explanation and great job my friend

[@aimadbennini279]

from where you get this helmet ?

[@hyperbolicfilms]

@@aimadbennini279 You can get all the pieces from Amazon. The breakdown of how it was made is in this video: kzbin.info/www/bejne/iHqtl4elj7uqn5I Fastforward to 7 minutes in. The hardest part is that some airsoft helmets have the NVG mount on the front, but they are not measured well, so it's very hard to get the GoPro mount into the mount.

[@soncho.editz1]

Did you pay for move AI sub for this ?? I’m hoping I can get it free for some quick projects

[@hyperbolicfilms]

I still have some minutes from when I was beta testing. If you want to do free mocap, check out Rokoko Studio.

[@soncho.editz1]

@@hyperbolicfilmsheyyy can you now share how you mixed them together both your head and body motion ??