Scan to MetaHuman Tutorial for Unreal Engine 5

[@thejetshowlive]

Thank you for the Shout Out my man. This was amazing!!

[@BrentLeBlancCG]

No problem Jet!

[@Llamu]

Hey the MetaHuman plug-in doesn’t exist anymore, you can only use the new editor in quixel bridge, is there still a way to do it?

[@yanovsky62360]

when you’re in the channel rack, click on gms to open up the gms nu, in the light blue screen on the top left look where it says

[@Grassill]

This is unreal! What?!

[@billielynploof9317]

What is the name of the photo viewer program you use that keeps your photo above what you are working on in the editor? I always have to do alt tab between my work and the editor and it's driving me crazy. Thank you for the video!

[@alexzanderthegeek]

This is awesome!

[@cagnazzo82]

The 3D version of you is a pretty handsome fella 😁

[@BrentLeBlancCG]

Hah!

[@killerlifealbum]

can this be done on a Mac now, I tried in unreal and the option was there

[@BrentLeBlancCG]

Not sure, I don't have a mac

[@chameleon28]

What do you guys recommend for getting scan data?

[@paddotk]

I'm an absolute noob in 3d technology, but... When you say 'scan data', does that mean you can create a 3d model from a photo or does it have to be some kind of 3d scan? In other words, do you need skills with 3d modelling software or can you use this Metahuman software without?

[@MrDmadness]

You can use any app that captures light features, you can also scan a 2d image ( magazine photo eg. ) and transpose it go a 3d shell.. im new to ue5 but wow, it makes potential very broad

[@BrentLeBlancCG]

So, scan data can be aquired in lots of ways, but basically it means that the model was created from using data from a real world object/person. In this case I used a Lidar scanner to scan my face to use for this. However, you could hand model a face or sculpt in zbrush and use it in the same way with this program. It has to be within certain reasonable parameters for it to work though.

[@paddotk]

@@BrentLeBlancCG Ok, thanks

[@Gamewizard71]

It looks like if You and Matt Damon had a baby. 🍼

[@Eduardo_Cavalcante]

How can I scan a photo of myself, for example? Would you recommend some software?

[@BrentLeBlancCG]

Reality capture is something you can try. @donalleniii on Instagram used that workflow.

[@drysengeoghegan8660]

if you have an iphone i’d try heges out, it’s like $8 1 time and then unlimited head scans, it’s pretty good too, used it today and got a meta human practically identical to myself

[@Catthyp]

OMG OMG OMG!!!!

[@omnipop4936]

Am I the only one who doesn't see much resemblance (10:35)?

[@BrentLeBlancCG]

You're not the only one haha

[@defaultname01]

Starts video tutorial then the creator skips straight to expert level....

[@TheFunDimension]

dude, how do you download and import it to unreal, danm it. Now i have to go to look for another tutorial

[@BrentLeBlancCG]

You just open the megascans bridge client, the same way as before to download and import.

[@egretfx]

This is mind blowing technology!!! A truly game changer!!!

[@BrentLeBlancCG]

Indeed!

[@slavakulishko3771]

Game changer.

[@Amelia_PC]

Don't worry if he's using Maya in this video. It can be done in any software, even the free ones like Blender. And it doesn't need to be a scanned 3D. It works with any 3D humanoid shape mesh, sculpted or scanned. Great video!

[@BrentLeBlancCG]

All those things!

[@ethanbridglal2203]

People in the community that make these amazing videos and persons in the comments that assist are truly the most helpful thing one can ask for and I am forever greatful to you guys.

[@TheMaginator]

@@ethanbridglal2203 Incredible, we appreciate you!

[@IamSH1VA]

🤯🤯🤯🤯🤯 This is so crazy, my mind is blown, what indie devs/filmmaker’s will do with this kind of tech…. When UE5 launched, I bought PC just for that, now because this I am so happy with my decision, the things I can do/learn, my mind is exploding 🤩🤩🤩

[@BrentLeBlancCG]

I know right!? It's great ☺️

[@VJ4rawr2]

Appreciate the video... But that model looked nothing like you.

[@BrentLeBlancCG]

Yeah, I have since had much better results. I made this video just a few hours after the release of this update. This was more a presentation of how the process is done, how good your results are will be based on how good your scan data is etc. I'll make a follow up video of an updated version. Cheers!

[@VJ4rawr2]

@@BrentLeBlancCG awesome. Will look out for it!

[@fabianoperes2155]

Now any Indie dev can have AMAZING characters! WOW!!!

[@BrentLeBlancCG]

Agreed!

[@Soluchi-InfiniteCoCreatorGod]

Great job. You did so well. 😊👍

[@BrentLeBlancCG]

Thanks Soluchi!

[@bassbeardiful]

I think it's time to stop paying lame actors and actresses and just use their likeness in movies haha. This is amazing tech

[@BrentLeBlancCG]

You will always need great actors, I suppose the way in which people act will change alot.

[@etherplanetarium7281]

my metahuman doesnt show up in bridge, what can i do ? thanks for the tutorial!

[@BrentLeBlancCG]

You have to make sure you are signed in first

[@spegss]

My unreal crashes every time I hit track active frame, or autotracking. I've tried reinstalling and using older versions to no avail.

[@juanecheyt]

5.4.1 here..... i cannot create metahumans.... installed plugin, enabled it..... no option for metahuman creation like that you have there.

[@3djohnboy]

woah.. that is freakishly accurate for the amount of time you spent making it.. this is amazing technology wow..

[@BrentLeBlancCG]

Yeah, its pretty incredible. Still needs some work, but to get this far and the amount of time is nuts.

[@sekimichy]

Why I cannot click metahuman identity Solve after I reack markers...? It's grey out...

[@andrzejflaga1958]

I appreciate the effort but this looks like a different person, and it's NOT pretty close. Anyway, keep it up.

[@richiebricker]

Chunky jokes aside, Im here to give you the best compliment that one can give to another in this world. And that is Your voice has a very similar sound and quality to the god-like creature we all call "Andrew Kramer" of "Video Copilot". Dont get a bubble head cause no one else hears this cause you got your damn mic level too low. Im not gonna plug KZbin into my nice guitar amplification. Its a little annoying but then again Andrew Kramer has his mic set too fricken low as well

[@BrentLeBlancCG]

Thank you sir! 🙏

[@lucacarollo1460]

That's like the best compliment ever. And i couldn't agree more!

[@BrentLeBlancCG]

Haha, thanks! "WHATS UP GUYS IT'S ANDREW KRAMER COMING BACK WITH ANOTHER VIDEO TUTORIAL!"

[@Urantia_]

this program is created for humans robots AI.

[@mrCetus]

woah.. that is freakishly accurate for the amount of time you spent making it.. this is amazing technology wow..

[@BrentLeBlancCG]

Yeah its crazy!

[@ahmetselcuk1400]

Bu teknolojiyi mukemmel lullanmamm ixin neler mumkun

[@themightyflog]

Man it has been a whole year and they still don’t have the body figured out.

[@ArthurBrasil-mv3lc]

Hi

[@lolmao500]

Metahumans would be so much better if it were open source with artists being able to provide textures, morphs, animations, clothes, etc... like Daz... but noooooo Epic wants to control everything.

[@MrDmadness]

You can edit source code in cpp.. your argument is moot

[@mm-hl7gh]

what if you have a 3dscan body and want to keep that body ? is that possible ?

[@richiebricker]

No, We're all too chunky. When Im in a room with other chunkies, I start to get a lil claustrophobia. Just one of us chunkies falling by an exit and were all trapped and without a "SawsAll" we aint going anywhere!!!!

[@BrentLeBlancCG]

Hahah

[@treverjohansen4218]

i cant seem to edit any of the tracking points it wont click on any of them

[@TLabsLLC-AI-Development]

I owned a 3D Portrait Studio in 2017. We developed a pipeline to project and bake geometry and textures in various separate steps. It's amazing to see it get to this stage.

[@alekseizolotukhin6367]

great video helped a lot. what program did you use for the 3d scan and what did you shoot with?

[@BrentLeBlancCG]

I've had a scanner for some time now, the EinScan Hybrid H. However, the scans you can get from just your phone are actually quite useable. Thanks Aleksei!

[@DesignsbyElement]

What app would you recommend for scan data?

[@BrentLeBlancCG]

@@DesignsbyElement I would try Reality Capture

[@R20xx]

Why i cant found metahuman identity can someone help me?

[@GAMEDEV_PRO]

when i click track active frame engine is crashing

[@DanielPabloSheng]

Mix this with deep fake and boom! Oh My!!!

[@paulewey7457]

Great tutorial, I was able to import my fbx file and get it up and running. Was my first attempt and went through smoothly.

[@BrentLeBlancCG]

Awesome!

[@shakaama]

I wanted that Black guy, in your first frame. but I went and couldn't find him, nor make him. To me all the people look Asian. That's great for an Asian game dev. I'm not Asian. I'm Black. I want a Black guy, that looks like a Black guy. Help me monsieur Le Blanc.

[@BrentLeBlancCG]

So, you will need to find a scan or model of a black person first. Maybe look around turbosquid or something like that. Or you can look into reality capture, that is a program that you can scan yourself and use that data for the metahuman. Let me know if you can get it working. Cheers!

[@MrDmadness]

Get a magazine.. scan black people in said mag.

[@NightShinerStudio]

How did you scan yourself?

[@WordOnWheels]

Why is it when i open metahuman that there is 2 characters meshed into one ? the face of one is on the neck of the other, and one set of arms is set underneath the other set of arms ? I literally just opened unreal engine and meta human and this is what comes up and it appears there is absolutely nothing that can be done. What am i missing ?

[@BrentLeBlancCG]

Sounds like a bug? Maybe try the process again. I would make sure that in your other DCC package that there is only 1 mesh.

[@WordOnWheels]

@@BrentLeBlancCG I do not know what a DCC is, but I did try closing and opening it up again multiple times, closed unreal engine, re opened, relaunched the launcher and selected the metahuman again, each time same result. There was no area or option to select a character or anything like that. Computer has been rebooted. What am I missing ? is there a step or something that I am missing or not doing right ? I downloaded unreal engine epic games launcher, from there i downloaded the launcher 5 and 4.27, etc, downloaded metahuman, selected the compatible launcher for metahuman and it opened, selected metahuman and opened that. Then all the problems and dramas of what I mentioned before displayed.

[@milagrose]

I modeled my character in blender. I have uploaded it to metahuman with your video. and I also tested it on unreal engine , which is great. I had a hard time rigging in Blender, but it's great to have such a feature in Unreal. especially the face gear is awesome!!!

[@BrentLeBlancCG]

Yeah, I'm sure people will find some very cool workflows that are not used as intended.

[@hyh1411]

Man, you're hansome

[@tiffypressstart3412]

The crazy part was the side of the faces always looked right first and easily resembled the person…as one orbits to the front of the face….meh not so much, mainly the eyes but still real cool. All the hair for females looked as if they were designed by a dude who has no taste in haircuts.

[@ayoCC]

That last sentence lmao

[@BrentLeBlancCG]

haha!

[@waynefilkins8394]

can you do it with a selfie?

[@rufatmelikov3d]

how have you downloaded model with textures to UE5?

[@BrentLeBlancCG]

The model and textures were created from Metahuman creator.

[@APRICEPRODUCTION]

I have to say I can't see the likeness, it reminds more of actor Aaron Ashmore or his brother... I think it's the eyes, if the 3D model's eyes were bigger more rounded, then the likeness would have been more like you.

[@BrentLeBlancCG]

Yeah, I agree the eyes are a bit off. I'll keep tweaking it, I also have had better results after I made this. I'll make a follow-up once I've got the likeness closer and some animation going. Cheers!

[@yuqinghuang6376]

Crazy technology! Good video as usual👍🏻

[@BrentLeBlancCG]

Thanks!

[@Azzazel_]

A usable fully rigged ready to go model that doesnt look like the original scan at all... so whats the point of this?

[@BrentLeBlancCG]

I've gotten much better results since posting this. I made this merely hours after this came out. It was due to user error, but you aren't going to get anything for free. Things still require effort to get the result you require. Cheers!

[@MrDmadness]

@@BrentLeBlancCG I've seen so many people commenting negatively about game engines. I'm pretty sure none have had to do matrix calculations in cpp to build,d a 3d object in a environment... literally 1000s of lines of code. Game engines make work flow better with getter results. These scans do show in game run environment, im unsure what the o.p. complaint is

[@JacoboRendon]

More test: My metahuman new plugin test : kzbin.info/www/bejne/mKS5ZGSdiJyNrtE

[@kingderpygoat]

theres also a way (or was, haven't checked in awhile to see if it still works) to do the face mocap via an app, pretty mental what Unreal are doing... all... for... free

[@philipsloth6600]

when i press metahuman indetity solve it says " Creating thread pool with 8 threads. (DnaDatabaseDescription.cpp, l40): DNA Database description does not contain blend_identity model. (DnaDatabaseDescription.cpp, l46): DNA Database description does not contain DNA database folder. (DnaDatabaseDescription.cpp, l52): DNA Database description does not contain archetype DNA. (ActorCreationUtils.cpp, l65): cannot estimate the rigid alignment as there are not sufficient triangulated landmarks (only 0) (ActorCreationAPI.cpp, l327): failure to rigid align: Critical error (ActorCreationUtils.cpp, l65): cannot estimate the rigid alignment as there are not sufficient triangulated landmarks (only 0)"

[@RandomNoise]

Amazing walkthrough Brent. it looks very promising.

[@BrentLeBlancCG]

Thank you!

[@BobDylanDP]

doesnt look like you

[@manateeburger]

How do you get your face scan data? Struggling to find good guides that aren't use this phone app

[@skippyzk]

Holy shit

[@imogenPsychic]

Scary

[@cloudsquall8624]

hi brent what program can i use t turn my picture to mesh 3d?

[@jonathandelgado2425]

What extension do you export your face mesh in Maya? OBJ? FBX? etcc

[@christophcarle]

And when do we actually see this in a videogame? I have the impression that current games are still looking like 2010 upscaled to 4k.

[@MrDmadness]

This year several games will showcase this. Look for any 2022 game released after ue5, most will be using this

[@nnnnnn3647]

even no close.

[@buster5661]

I think your thumbnail is fake

[@BrentLeBlancCG]

lol

[@yohannesJas]

this is wild

[@trannamanh8800]

how to scan

[@alkodjdjd]

Too fast man

[@Farao007]

i think that can be use to make Tom cruise faces or almost someone its amazing almost perfect

[@thegreatawakening3601]

I don’t know you’re eyes are more round in the photo .. and the lighting really help a lot. Close but not accurate

[@BrentLeBlancCG]

Yeah agreed that it isn't quite there yet, but close

[@starrex4829]

omg, good

[@Metarig]

he looks like your big brother. now you can edit it a bit in Maya to make it totally like yourself

[@BrentLeBlancCG]

Yeah for sure!

[@Monkey-fv2km]

Crazy stuff… btw, heads always look a bit wide with a narrow fov, we are only used to seeing faces from quite close up, particularly our own in a mirror or selfie.

[@greatcesari]

yeah, it looked like it was generated a bulge on the left side of his head. Made the whole thing look wonky, but it's fixable and the technology is scarily impressive.

[@unijascha3005]

Hey how you made the raw scan?

[@BrentLeBlancCG]

Einscan Hybrid H scanner

[@joshuacadogan5174]

My meta human isn’t showing up in the creator, any ideas?

[@BrentLeBlancCG]

Make sure you are launching Bridge inside Unreal 5.0.2. Everything is updated and good to go and try again.

[@joshuacadogan5174]

@@BrentLeBlancCG I actually managed to fix this, It was because I had two epic games accounts. My metahuman files got sent to my bridge but bridge sent them to a different account in the creator. I had to delete one of them and clear my browser cookies. Its all working now. thanks for you help and replying though.

[@BrentLeBlancCG]

@@joshuacadogan5174 Oh sweet deal!

[@RobWatt]

can you confirm that this is only available for windows ? I cant seem to locate metahuman identity with mac

[@BrentLeBlancCG]

I'm not actually sure if this useable on Mac or not. I would assume you can though, because its done through a web browser. If you can open Unreal 5, I assume it should be able to work. You just have to make sure all your software is updated. You have latest bridge installed via Unreal etc.

[@RobWatt]

thank you !

[@templeofleila]

There's no undo function? This is so awesome though

[@LindaBTP]

Nice :-) How did you make the scan of your face? I've always wondered what I would look like with a short haircut :-P

[@BrentLeBlancCG]

Einscan Hybrid H scanner, but there is some phone app versions available. Like PolyCam

[@JGCoolfella]

ha it looked a bit like matt damon

[@BrentLeBlancCG]

Hahah, True!

[@aresagathos2075]

wtf, the sideview at 13:43 ! :D

[@BrentLeBlancCG]

Hahah

[@vrtranscendentexperience9158]

What's an easy way to scan your face? Is there any reccomended app for android?

[@BrentLeBlancCG]

Not sure about apps, I know reality capture is pretty low cost. Maybe try that?

[@KS-hq3ci]

what do you use for 3d scanning? Using Polycam for iphone gives me errors in metahuman, no matter what subject. Thanks

[@BrentLeBlancCG]

I used an EinScan Hybrid H

[@Backtrack3332]

I always wondered what the "copyright" on humans are. What if somebody decides to make a whole realistic movie with this?

[@BrentLeBlancCG]

Yeah I suppose this will be an odd path to traverse.

[@3dchick]

Very nice run-through. I just wish it transfered wrinkles and scars.

[@Neo-cf5vd]

Great tutorial Brent💯, can the Macbook m1 air handle unreal 5 like this?

[@BrentLeBlancCG]

I'm not actually sure, but I would suggest atleast having a first generation RTX card or above

[@aryanpanhekar]

Is anyone interested in working on how we can programmatically create these metahumans in real time? Feel like there are wide applications for leveraging this.

[@BrentLeBlancCG]

Agreed

[@dick8997]

I was just messing around w this last night. Wana try n figure out how to do a scan of Jim Henson Donatello design action figure and mess with him in ue

[@sanketvaria9734]

When I created such heavy mesh in blender. it took 15 minutes to export an FBX.

[@BrentLeBlancCG]

Yeah, it's prolly best to reduce the poly count before export. Sometimes those exports can take a while

[@lovedw]

Hi do u know if the plugin has mac version ? or only on window platform now? thanks

[@BrentLeBlancCG]

I'm actually not sure about that, I would just try it out. I've not used Unreal on a Mac, but worth a shot :)

[@drvic5498]

Good news, but your scan mesh is not perfect! Bad result

[@BrentLeBlancCG]

Yeah there is alot of issues with the scan for sure. I actually took the scan with my own hand so it was super wonky haha. I'll try to get something much more proper after I have some more time with it. Cheers!

[@CHAVEIROGOLDCHAVESCODIFICADAS]

THANK YOU!!! TNice tutorials is such an amazing tutorial. I just got soft soft today and was playing around on it but had no clue how to really use it.

[@Fedebona]

14:26 lol

[@BrentLeBlancCG]

Hahah

[@praveenb-xr]

will be great if MHC itself create like models just by uplloading a photo..

[@BrentLeBlancCG]

I'm sure we aren't far from that and it's likely to be the case in the future.

[@praveenb-xr]

@@BrentLeBlancCG Yeah like other Human creators..

[@allison552]

Awesome!!!! thank you for your sharing.

[@Joel-bg3cf]

What's a good way to do the initial scan?

[@thunderboys123]

How did you do the scan?