Scan to MetaHuman Tutorial for Unreal Engine 5

[@egretfx]

This is mind blowing technology!!! A truly game changer!!!

[@BrentLeBlancCG]

Indeed!

[@slavakulishko3771]

Game changer.

[@TLabsLLC-AI-Development]

I owned a 3D Portrait Studio in 2017. We developed a pipeline to project and bake geometry and textures in various separate steps. It's amazing to see it get to this stage.

[@3djohnboy]

woah.. that is freakishly accurate for the amount of time you spent making it.. this is amazing technology wow..

[@BrentLeBlancCG]

Yeah, its pretty incredible. Still needs some work, but to get this far and the amount of time is nuts.

[@Amelia_PC]

Don't worry if he's using Maya in this video. It can be done in any software, even the free ones like Blender. And it doesn't need to be a scanned 3D. It works with any 3D humanoid shape mesh, sculpted or scanned. Great video!

[@BrentLeBlancCG]

All those things!

[@ethanbridglal2203]

People in the community that make these amazing videos and persons in the comments that assist are truly the most helpful thing one can ask for and I am forever greatful to you guys.

[@TheMaginator]

@@ethanbridglal2203 Incredible, we appreciate you!

[@fabianoperes2155]

Now any Indie dev can have AMAZING characters! WOW!!!

[@BrentLeBlancCG]

Agreed!

[@thejetshowlive]

Thank you for the Shout Out my man. This was amazing!!

[@BrentLeBlancCG]

No problem Jet!

[@IamSH1VA]

🤯🤯🤯🤯🤯 This is so crazy, my mind is blown, what indie devs/filmmaker’s will do with this kind of tech…. When UE5 launched, I bought PC just for that, now because this I am so happy with my decision, the things I can do/learn, my mind is exploding 🤩🤩🤩

[@BrentLeBlancCG]

I know right!? It's great ☺️

[@milagrose]

I modeled my character in blender. I have uploaded it to metahuman with your video. and I also tested it on unreal engine , which is great. I had a hard time rigging in Blender, but it's great to have such a feature in Unreal. especially the face gear is awesome!!!

[@BrentLeBlancCG]

Yeah, I'm sure people will find some very cool workflows that are not used as intended.

[@ericsvisuals5627]

Nice vid!! This is super interesting! + Cant wait to see the short film!

[@BrentLeBlancCG]

Thanks dude! Yeah, I'm excited to show all of you. It's been so much fun and a fantastic learning experience.

[@paulewey7457]

Great tutorial, I was able to import my fbx file and get it up and running. Was my first attempt and went through smoothly.

[@BrentLeBlancCG]

Awesome!

[@yuqinghuang6376]

Crazy technology! Good video as usual👍🏻

[@BrentLeBlancCG]

Thanks!

[@Soluchi-InfiniteCoCreatorGod]

Great job. You did so well. 😊👍

[@BrentLeBlancCG]

Thanks Soluchi!

[@CHAVEIROGOLDCHAVESCODIFICADAS]

THANK YOU!!! TNice tutorials is such an amazing tutorial. I just got soft soft today and was playing around on it but had no clue how to really use it.

[@RandomNoise]

Amazing walkthrough Brent. it looks very promising.

[@BrentLeBlancCG]

Thank you!

[@yanovsky62360]

when you’re in the channel rack, click on gms to open up the gms nu, in the light blue screen on the top left look where it says

[@andryowyeh3531]

where can i download that metahuman plugin, i have metahuman plugin in option but no like yours, and there is no option like this 2:35

[@TheFunDimension]

dude, how do you download and import it to unreal, danm it. Now i have to go to look for another tutorial

[@BrentLeBlancCG]

You just open the megascans bridge client, the same way as before to download and import.

[@Farao007]

i think that can be use to make Tom cruise faces or almost someone its amazing almost perfect

[@niKolasBedoya]

great video!!! ...keep the good work

[@BrentLeBlancCG]

Thanks, will do!

[@aweidenhammer]

That's pretty awesome man!

[@BrentLeBlancCG]

Thanks Andrew! Unreal is the future!!!

[@aresaurelian]

The future is taking form. Continue.

[@BrentLeBlancCG]

Indeed!

[@Monkey-fv2km]

Crazy stuff… btw, heads always look a bit wide with a narrow fov, we are only used to seeing faces from quite close up, particularly our own in a mirror or selfie.

[@greatcesari]

yeah, it looked like it was generated a bulge on the left side of his head. Made the whole thing look wonky, but it's fixable and the technology is scarily impressive.

[@allison552]

Awesome!!!! thank you for your sharing.

[@billielynploof9317]

What is the name of the photo viewer program you use that keeps your photo above what you are working on in the editor? I always have to do alt tab between my work and the editor and it's driving me crazy. Thank you for the video!

[@thegreatawakening3601]

I don’t know you’re eyes are more round in the photo .. and the lighting really help a lot. Close but not accurate

[@BrentLeBlancCG]

Yeah agreed that it isn't quite there yet, but close

[@alexzanderthegeek]

This is awesome!

[@Neo-cf5vd]

Great tutorial Brent💯, can the Macbook m1 air handle unreal 5 like this?

[@BrentLeBlancCG]

I'm not actually sure, but I would suggest atleast having a first generation RTX card or above

[@richiebricker]

Chunky jokes aside, Im here to give you the best compliment that one can give to another in this world. And that is Your voice has a very similar sound and quality to the god-like creature we all call "Andrew Kramer" of "Video Copilot". Dont get a bubble head cause no one else hears this cause you got your damn mic level too low. Im not gonna plug KZbin into my nice guitar amplification. Its a little annoying but then again Andrew Kramer has his mic set too fricken low as well

[@BrentLeBlancCG]

Thank you sir! 🙏

[@lucacarollo1460]

That's like the best compliment ever. And i couldn't agree more!

[@BrentLeBlancCG]

Haha, thanks! "WHATS UP GUYS IT'S ANDREW KRAMER COMING BACK WITH ANOTHER VIDEO TUTORIAL!"

[@ParabhdeepSingh]

This is really insane

[@BrentLeBlancCG]

Truly!

[@Tayvintra]

My unreal crashes every time I hit track active frame, or autotracking. I've tried reinstalling and using older versions to no avail.

[@shashankmittuchetan3999]

Hi, Hi it is to create my own mesh > Metahuman, And I can’t find “Metahuman Identity” (right click in Content Browser), nowhere nor in Metahuman Creator nor in Epic documention (5.4) nor on youtube. Plugin is already installed. Does someone know where, or how to mesh > Metahuman (if the how to process has changed…) ? Thank you, Shashank

[@etherplanetarium7281]

my metahuman doesnt show up in bridge, what can i do ? thanks for the tutorial!

[@BrentLeBlancCG]

You have to make sure you are signed in first

[@PrinceOfSlytherin]

This is unreal! What?!

[@alekseizolotukhin6367]

great video helped a lot. what program did you use for the 3d scan and what did you shoot with?

[@BrentLeBlancCG]

I've had a scanner for some time now, the EinScan Hybrid H. However, the scans you can get from just your phone are actually quite useable. Thanks Aleksei!

[@DesignsbyElement]

What app would you recommend for scan data?

[@BrentLeBlancCG]

@@DesignsbyElement I would try Reality Capture

[@matthew_brown]

WOW!! Incredible!!

[@BrentLeBlancCG]

Thanks Matthew!

[@JacoboRendon]

More test: My metahuman new plugin test : kzbin.info/www/bejne/mKS5ZGSdiJyNrtE

[@davebaer5699]

Cool stuff!

[@BrentLeBlancCG]

Thanks Dave!

[@sekimichy]

Why I cannot click metahuman identity Solve after I reack markers...? It's grey out...

[@kingderpygoat]

theres also a way (or was, haven't checked in awhile to see if it still works) to do the face mocap via an app, pretty mental what Unreal are doing... all... for... free

[@jonathandelgado2425]

What extension do you export your face mesh in Maya? OBJ? FBX? etcc

[@cloudsquall8624]

hi brent what program can i use t turn my picture to mesh 3d?

[@manateeburger]

How do you get your face scan data? Struggling to find good guides that aren't use this phone app

[@markbrittain4625]

So theoretically you should be able to do this if you have the computing power to bring a PC character from a earlier unreal engine/game say a Cmd Shepard from ME to life in Meta Human unbelievable.

[@BrentLeBlancCG]

Yeah, you should totally be able to do that if you could extract Shepard's head and input into MetaHuman engine

[@markbrittain4625]

@@BrentLeBlancCG so you can't just import the existing texture or mesh from the game

[@BrentLeBlancCG]

@@markbrittain4625 If you have access to the source files I'm sure you can. This isn't something I've tried before. I'm still learning alot about Unreal. I'm coming from an Anim/Film background.

[@markbrittain4625]

Looks like the topic of another video just a suggestion

[@mm-hl7gh]

what if you have a 3dscan body and want to keep that body ? is that possible ?

[@treverjohansen4218]

i cant seem to edit any of the tracking points it wont click on any of them

[@LindaBTP]

Nice :-) How did you make the scan of your face? I've always wondered what I would look like with a short haircut :-P

[@BrentLeBlancCG]

Einscan Hybrid H scanner, but there is some phone app versions available. Like PolyCam

[@GAMEDEV_PRO]

when i click track active frame engine is crashing

[@KS-hq3ci]

what do you use for 3d scanning? Using Polycam for iphone gives me errors in metahuman, no matter what subject. Thanks

[@BrentLeBlancCG]

I used an EinScan Hybrid H

[@Stereo_mike]

Thats serious wicked!! What did you use for the scan?

[@BrentLeBlancCG]

I actually have an IR scanner, but there is alot of options out there with your phone these days. You can also just input a sculpt or polymodeled mesh aswell.

[@sanketvaria9734]

When I created such heavy mesh in blender. it took 15 minutes to export an FBX.

[@BrentLeBlancCG]

Yeah, it's prolly best to reduce the poly count before export. Sometimes those exports can take a while

[@chameleon28]

What do you guys recommend for getting scan data?

[@juanecheyt]

5.4.1 here..... i cannot create metahumans.... installed plugin, enabled it..... no option for metahuman creation like that you have there.

[@4klife7]

Just amazing

[@lovedw]

Hi do u know if the plugin has mac version ? or only on window platform now? thanks

[@BrentLeBlancCG]

I'm actually not sure about that, I would just try it out. I've not used Unreal on a Mac, but worth a shot :)

[@WordOnWheels]

Why is it when i open metahuman that there is 2 characters meshed into one ? the face of one is on the neck of the other, and one set of arms is set underneath the other set of arms ? I literally just opened unreal engine and meta human and this is what comes up and it appears there is absolutely nothing that can be done. What am i missing ?

[@BrentLeBlancCG]

Sounds like a bug? Maybe try the process again. I would make sure that in your other DCC package that there is only 1 mesh.

[@WordOnWheels]

@@BrentLeBlancCG I do not know what a DCC is, but I did try closing and opening it up again multiple times, closed unreal engine, re opened, relaunched the launcher and selected the metahuman again, each time same result. There was no area or option to select a character or anything like that. Computer has been rebooted. What am I missing ? is there a step or something that I am missing or not doing right ? I downloaded unreal engine epic games launcher, from there i downloaded the launcher 5 and 4.27, etc, downloaded metahuman, selected the compatible launcher for metahuman and it opened, selected metahuman and opened that. Then all the problems and dramas of what I mentioned before displayed.

[@inftstudio5899]

Could you please share with me what kind of scanning method did you use? And thanks for sharing this tutorial

[@BrentLeBlancCG]

I was using an EinScan Hybrid H scanner, but I've seen Great results with phone apps

[@CihatUmut]

Amazing work! Lets say I would like to edit head mesh myself in maya or zbrush with preserving rig and animation compability can i somehow move the mesh out of UE5 and reimport it or it wont work?

[@BrentLeBlancCG]

I think you can do a bit of back and forth, but I wouldn't really know the entire workflow for it. I do know that you have to be careful about how far the bones move from the face surface. Let me know if you can get a good workflow working. Cheers!

[@hyh1411]

Man, you're hansome

[@Eduardo_Cavalcante]

How can I scan a photo of myself, for example? Would you recommend some software?

[@BrentLeBlancCG]

Reality capture is something you can try. @donalleniii on Instagram used that workflow.

[@drysengeoghegan8660]

if you have an iphone i’d try heges out, it’s like $8 1 time and then unlimited head scans, it’s pretty good too, used it today and got a meta human practically identical to myself

[@3dchick]

Very nice run-through. I just wish it transfered wrinkles and scars.

[@templeofleila]

There's no undo function? This is so awesome though

[@killerlifealbum]

can this be done on a Mac now, I tried in unreal and the option was there

[@BrentLeBlancCG]

Not sure, I don't have a mac

[@yohannesJas]

this is wild

[@vrtranscendentexperience9158]

What's an easy way to scan your face? Is there any reccomended app for android?

[@BrentLeBlancCG]

Not sure about apps, I know reality capture is pretty low cost. Maybe try that?

[@Backtrack3332]

I always wondered what the "copyright" on humans are. What if somebody decides to make a whole realistic movie with this?

[@BrentLeBlancCG]

Yeah I suppose this will be an odd path to traverse.

[@ismaeljoffroychandoutis508]

Great tut ;-)

[@BrentLeBlancCG]

Thanks Ismaël !! Good to see you buddy :D

[@ismaeljoffroychandoutis508]

@@BrentLeBlancCG back on game ha ha

[@ianj.4597]

What app is used during the prepping scan data section?

[@BrentLeBlancCG]

I was using Maya, but you could totally use Blender

[@paddotk]

I'm an absolute noob in 3d technology, but... When you say 'scan data', does that mean you can create a 3d model from a photo or does it have to be some kind of 3d scan? In other words, do you need skills with 3d modelling software or can you use this Metahuman software without?

[@MrDmadness]

You can use any app that captures light features, you can also scan a 2d image ( magazine photo eg. ) and transpose it go a 3d shell.. im new to ue5 but wow, it makes potential very broad

[@BrentLeBlancCG]

So, scan data can be aquired in lots of ways, but basically it means that the model was created from using data from a real world object/person. In this case I used a Lidar scanner to scan my face to use for this. However, you could hand model a face or sculpt in zbrush and use it in the same way with this program. It has to be within certain reasonable parameters for it to work though.

[@paddotk]

@@BrentLeBlancCG Ok, thanks

[@Joel-bg3cf]

What's a good way to do the initial scan?

[@RobWatt]

can you confirm that this is only available for windows ? I cant seem to locate metahuman identity with mac

[@BrentLeBlancCG]

I'm not actually sure if this useable on Mac or not. I would assume you can though, because its done through a web browser. If you can open Unreal 5, I assume it should be able to work. You just have to make sure all your software is updated. You have latest bridge installed via Unreal etc.

[@RobWatt]

thank you !

[@aresagathos2075]

wtf, the sideview at 13:43 ! :D

[@BrentLeBlancCG]

Hahah

[@stevecoxiscool]

What equipment are you using to get the initial scan data ?

[@BrentLeBlancCG]

I used a EinScan Hybrid H, however that is not needed at all. It's really not great for capturing faces to be honest. I would try some of the smart phone apps or the DSLR photo solvers out there. Photogrammetry can be quite affordable if you are willing to put in the effort. Cheers!

[@stevecoxiscool]

@@BrentLeBlancCG Gotcha. Makes sense. Been some time since I played with PG. Thanks for your insights and video

[@HyperGalaxyEntertainment]

nice work! which scan process did you use

[@BrentLeBlancCG]

I used my own hardware scanner, but there is apps out there to try and you can also do your own poly modeling aswell.

[@HyperGalaxyEntertainment]

@@BrentLeBlancCG thanks for the information

[@Metarig]

he looks like your big brother. now you can edit it a bit in Maya to make it totally like yourself

[@BrentLeBlancCG]

Yeah for sure!

[@APRICEPRODUCTION]

I have to say I can't see the likeness, it reminds more of actor Aaron Ashmore or his brother... I think it's the eyes, if the 3D model's eyes were bigger more rounded, then the likeness would have been more like you.

[@BrentLeBlancCG]

Yeah, I agree the eyes are a bit off. I'll keep tweaking it, I also have had better results after I made this. I'll make a follow-up once I've got the likeness closer and some animation going. Cheers!

[@NightShinerStudio]

How did you scan yourself?

[@waynefilkins8394]

can you do it with a selfie?

[@rufatmelikov3d]

how have you downloaded model with textures to UE5?

[@BrentLeBlancCG]

The model and textures were created from Metahuman creator.

[@davemauriello8088]

Do you think it would be better to edit the scan data down to just a mask of the face so you can avoid issues like incorporating the hair shape as part of the cranium?

[@BrentLeBlancCG]

Yeah, I was thinking the same thing. I think its likely it would give you better results. I would still include the ears though if you can. Cheers!

[@vuron8893]

That's exactly what the intro video from Unreal Engine suggested. Remove any hair or extra components to get a detailed head shape.

[@BrentLeBlancCG]

@@vuron8893 yeah, totally makes sense

[@iamgulnazzzz]

which app do you used for face scan?

[@BrentLeBlancCG]

I used my own Lidar scanner, but there are some phone app versions available. e.g. Polycam. I'm working with a company on bringing you a new scanning method that I can give out a few trials to some viewers.

[@username_62kcs9el0]

@@BrentLeBlancCG I’m currently working on an independent film and would be very interested.

[@R20xx]

Why i cant found metahuman identity can someone help me?

[@mikecarvelas4720]

which is the best app for a 3d face scan ?

[@BrentLeBlancCG]

I'm not sure what the best app is, but there is PolyCam and RealityCapture you could try

[@madgorilla4888]

wow!!! what software did you used to scan yourself ???

[@BrentLeBlancCG]

I used a hardware scanner called and EinScan Hybrid H.

[@thunderboys123]

How did you do the scan?

[@aryanpanhekar]

Is anyone interested in working on how we can programmatically create these metahumans in real time? Feel like there are wide applications for leveraging this.

[@BrentLeBlancCG]

Agreed

[@themightyflog]

Man it has been a whole year and they still don’t have the body figured out.

[@unrealhabitat]

Hello, Im not able to see my custom Metahuman in Bridge (Inside Unreal 5.0.2) can anybody help? Thx :)

[@BrentLeBlancCG]

Make sure you are opening up bridge from Unreal and that your bridge is downloaded to latest.

[@unrealhabitat]

@@BrentLeBlancCG Fixed it :D I want to make a little video about how I managed to make it work soon

[@BrentLeBlancCG]

@@unrealhabitat awesome!

[@jasko8140]

@@BrentLeBlancCG what did you do to fix it? I have the same problem, been trying for hours..

[@unrealhabitat]

hello I manage to make it work, I deleted all my epic games and quixel (app data files) then I made myself a new account (same epic games account for Metahuman creator app, Bridge and Unreal Engine) then I isntalled Bridge stand alone and Bridge plug in for Unreal 5.0.2 and after having the same library set up for Bridge stand alone and the plug in version, pretty painful but it worked for me haha

[@unijascha3005]

Hey how you made the raw scan?

[@BrentLeBlancCG]

Einscan Hybrid H scanner

[@madclowninc.4233]

how do you rotate in metahuman identity

[@BrentLeBlancCG]

I'm not sure I did anything special

[@cagnazzo82]

The 3D version of you is a pretty handsome fella 😁

[@BrentLeBlancCG]

Hah!

[@joshuacadogan5174]

My meta human isn’t showing up in the creator, any ideas?

[@BrentLeBlancCG]

Make sure you are launching Bridge inside Unreal 5.0.2. Everything is updated and good to go and try again.

[@joshuacadogan5174]

@@BrentLeBlancCG I actually managed to fix this, It was because I had two epic games accounts. My metahuman files got sent to my bridge but bridge sent them to a different account in the creator. I had to delete one of them and clear my browser cookies. Its all working now. thanks for you help and replying though.

[@BrentLeBlancCG]

@@joshuacadogan5174 Oh sweet deal!

[@christophcarle]

And when do we actually see this in a videogame? I have the impression that current games are still looking like 2010 upscaled to 4k.

[@MrDmadness]

This year several games will showcase this. Look for any 2022 game released after ue5, most will be using this

[@TGSuineg]

Surprised there's no color picker for the skin tone

[@BrentLeBlancCG]

Yeah, its there inhouse skin color formula

[@TrendingGamerTGC]

What did you scan the face with?

[@BrentLeBlancCG]

I used an Einscan Hybrid H

[@TrendingGamerTGC]

@@BrentLeBlancCG Ouch over my budget, any recommendations on affordable scanners? I've noticed a lot of these phone 3d scanners do a terrible job.

[@praveenb-xr]

will be great if MHC itself create like models just by uplloading a photo..

[@BrentLeBlancCG]

I'm sure we aren't far from that and it's likely to be the case in the future.

[@praveenb-xr]

@@BrentLeBlancCG Yeah like other Human creators..

[@VJ4rawr2]

Appreciate the video... But that model looked nothing like you.

[@BrentLeBlancCG]

Yeah, I have since had much better results. I made this video just a few hours after the release of this update. This was more a presentation of how the process is done, how good your results are will be based on how good your scan data is etc. I'll make a follow up video of an updated version. Cheers!

[@VJ4rawr2]

@@BrentLeBlancCG awesome. Will look out for it!

[@omnipop4936]

Am I the only one who doesn't see much resemblance (10:35)?

[@BrentLeBlancCG]

You're not the only one haha

[@Jellybeancracker]

What did you use to scan?

[@BrentLeBlancCG]

Einscan Hybrid H scanner

[@Jellybeancracker]

@@BrentLeBlancCG thank you! Subed!!

[@BrentLeBlancCG]

@@Jellybeancracker 🙏

[@संसारः]

this program is created for humans robots AI.

[@ANGEL-fg4hv]

How did you get your scan ?

[@BrentLeBlancCG]

I actually have a hardware scanner, but there is alot of Phone apps available aswell. PolyCam being one you could try.

[@ANGEL-fg4hv]

@@BrentLeBlancCG thank you !