Turn AI Images into 3D Animated Characters: Tutorial

The first AI to 3D Character workflow. In this video, I show you how to get headshots from your trained AI models and create a 3D Character that you can control with your iPhone.
Please find tutorial in writtern format and associated proodduct links here:
promptmuse.com...
Alot more info to be added :)
Chapters coming!!
Discord: / discord
Instagram: / promptmuse
TikTok: / prompt.muse
Twitter: / promptmuse
🖱️ As you know by now, I try and makes these tutorials as inclusive as I can.
There is one plugin that is paid for which is optional and not needed to complete the tutorial.
🖱️ I'm writing up the tutorial on promptmuse.com/ So if it's not there I am typing it up!
🖱️ Also, Tag me on any social media with what you have created using this technique for your chance to Win Amazon vouchers.
🖱️ This video DOES NOT contain any paid promos or features.
#aiactor #ai #midjourney #stablediffusion #aianimation #unrealengi

[@promptmuse]

I will be doing another tutorial on this which some may find easier BUT the software isn’t free…..So wanted to get a free work flow up before I show the paid for. So everyone can find what suits them and budget 👍 I’ll add chapters to the video and all info to description tomorrow. My brain is running on low so must sleep now haha. Thanks for watching and any questions I’ll be happy to answer1 Android users : here is an extension for live link for you 🫶 Somebody has created this on github 👍: github.com/justdark/UE_Android_LiveLink

[@KingsMoveSocialClub]

i find that most Ai artists have been super exhausted lately lol

[@promptmuse]

@@KingsMoveSocialClubI’m always tired 😅

[@KingsMoveSocialClub]

@@promptmuse story of my life lool, sleep is super important!! .... so im told lol

[@promptmuse]

@@KingsMoveSocialClub 😂

[@armondtanz]

@@promptmuse This needs pinning. Dont leave us android users in the lurch!

[@thebluriam]

Jesus! This is maybe the most concise, complete, and technically informative tutorial I've seen in like maybe a decade. Incredible work.

[@EternalResonance]

Don't let old people see this. Their heads might explode if they even try n see what this is about

[@thebluriam]

@@EternalResonance that literally makes no sense. Wouldn't you want to make their heads explode? Isn't that the point of developing new insane technology, to blow peoples minds?

[@MrDanieluy]

I am just seen this tutorials, and learning a whole bunch of new things in the process, to see you! You are beautiful and inteligent a rare and seductive combination... By the way...great tutorial. And...what is your IG ?

[@sirius-light]

Agree, she is very detailed explainetor :)

[@verence333]

Okay, this is a truly amazing tutorial. As a guy that's been using UE4-5 for almost 2 years (and other related tools such as Blender and Metahuman) I can recognise the sheer amount of work and hours that you must have put in place to get everything working smoothly. I salute you. You're already one of my favourite KZbin channels related to AI and I think I've only followed you for 2 or 3 weeks.

[@psychofactspinkninja]

Thanks for sharing. kzbin.info/door/a9vJ9lq_qNY_YM6kKUHhiQ

[@TechCarnivore1]

The sheer potential this will provide indie developers/short film makers.

[@B.BAKDASH]

I'm a 3d artist and I hope to get some talented people to make a short film or making a game. I do it as a hobby, so I will do it for free.

[@SantikusM]

@@B.BAKDASH I'm making a game which is halfway, but I still need to work on the 3d art, this has an amazing potential!

[@footage3914]

This is next level. Learning 3D for indie filmmaking projects. Definitely added production value if used well.

[@B.BAKDASH]

@@SantikusM sure man can you tell me how to contact with you

[@yarloo]

"This provides nothing. You do not understand. Don't get me wrong, i'll continue, 2d animation and drawing, Regarding 3d metahuman, 3d work like this,--this is the end of this kind of thing. Not a "unlocking of potential" as you're describing it.. Completely () over. Yeah sure it's depressing, i feel bad for other artists. Personally i'll be fine, i'm good enough at it. I'm not angry with you people. It's just that you're sad and pathetic. All of this had to die, because of you. "Stressful" I like doing things once in a while. You don't. Easy. Yeah i'm updated. Don't reply, it's pointless. I'm fine.

[@koronikarz-poczujtajwannaw8611]

Quick tip if you don't want to take photos of yourself: use that male default head, set blender camera to 512x512 square and position an area light in front of the model. Use lighter world background and set the head material to a color similar to your character's skin tone. Rotate the head accordingly and render it using the Eeve renderer (default one). Great tutorial as always!

[@WilliamVideoUT]

Thanks this is what I meant to send the first time. coming back to the tutorial I saw my mistake; this tutorial is so good!!!

[@alonsorojas3829]

Another gem of a tutorial. Really amazed how you linked all those tools together on a singular and very interesting project. Quality content.

[@promptmuse]

Thank you so much 🙏

[@3DElitePersona]

@@promptmuse very cool i'm getting there soon...tk

[@robertandrejevic350]

Thank you very very much! I think you have done a great job and are chowing it very nicely. I will try this. Thank you again.

[@jtudela1]

I only had a side interest in how this workflow process was done. I was only going to skim through. The sheer amazement I had in the AMOUNT of subjects/software/quick overviews you had in here had me glued. It was amazing really. Well done. You definitely deserve the views/likes after all that. I will admit the fire alarm was a blessing. It allowed you and me to breathe, take a break cognitively and refocus. The look you gave at 27:20 said, "REALLY?! I'm ALMOST DONE!" Haha. Thanks for leaving that part in. I was beginning to think you were a MetaHuman with how flawless everything was going without a blooper moment. Seriously, drop the mic moment right here.🎤

[@promptmuse]

Haha thank you so much, what a fantastic review ! I actually had a blue screen of death half way through haha Last why I look KO’d at the end :) Also I was very aware of the hard drive noise getting too load nearly had to set my desk fan on it haha Thanks again. That was really enjoyable to read! Haha

[@Allotropes]

Wow, not just a great tutorial, but an epic bit of engineering in the first place!

[@jazzlehazzle]

A master work of genius on every level- workflow, creativity, tech knowledge, digital arts, clarity & teaching. Brilliant!! As an art director and lifelong digital artist myself for 30 years, I've used it all, always working to stay fresh, and have been wondering about the specifics of this (free method) for the past couple years. This cracks it. What a GREAT one. Thank you!! 👏👏

[@promptmuse]

Oh wow, you do not understand how much that comment means to me. Especially from someone in the industry and more importantly an artist themselves. Thank you a thousand times.

[@joskun]

Lost my iphone recently and now I have to get a new one. Well done!

[@KrisStruble]

I love how concise the video is, everything is quick enough to keep the viewer's interest through the whole video. Providing the notes to follow after watching is a great touch. Thank you!

[@promptmuse]

Thank you so much 🙏🙌

[@Edilyon]

I spend an awful amount of time watching tutorials and I didn't know one coule teach this perfectly. You are a a really gréât teacher, thank you so much

[@forreal7403]

You’re shooting straight to the top. The best AI channel on KZbin hands down 🎉

[@promptmuse]

Thank you so much ! Thank for your comment and watching !!! Love the support

[@Enders]

Daaaayum This is so cool. Great work putting this method together for folks on here. Great job. I am blown away.

[@promptmuse]

Ahhh thank you !! You are welcome !

[@sitedev]

This is cool. I've been using Reallusion's Character Creator 4 to do something similar albeit with a different workflow. They have an extension called Headshot where you can import a high quality photograph of a face and it will automatically produce the mesh and apply the face image as the texture and produce all of the texture maps, normal maps etc too. You then have a wide array of tools to further enhance the 3d model before exporting it. A critical element required for a successful outcome is a high resolution, high quality, evenly lit colour, expressionless photograph with no facial hair of the face you are trying to create. A tall order when the person you're targeting is either dead (think historical figure, for instance) or where there is no opportunity to acquire such a photo. This "use to be" a problem until a few weeks ago when I stumbled across MidJourney and didn't end up getting much sleep for a few days as a result. We are truly living in the future :)

[@KaliCarter]

Same here. I'm using CC4 with Headshot and I imported photos from midjourney to create characters. However, I must do a better job of creating a photo that is evenly lit. But these are very exciting times...

[@sitedev]

@@KaliCarter That's awesome! I was wondering how many other CC4 user had arrived at the same conclusion. What really impressed me with MJ was when I created faces for Betty and Barney Hill - all I told it was their names (and the rest of the HD/Photorealistic etc etc prompt) and it knew that Barney was a black man. Blew my mind - looked nothing like him but, hey, the glass is half full.

[@vrwizard2616]

How does CC4 compare to CC3? Is it big improvement or more or less similar results? I own headshot with CC3 and was not very happy with the results and the upgrade price is quite a lot.

[@KaliCarter]

@@vrwizard2616 I'm fairly new to the program so I can't compare. I took advantage of their Christmas sales.

[@heycarlawhite]

Unfortunately Reallussion is only for PC. Is there a Mac equivalent?

[@WilliamVideoUT]

Thanks!

[@promptmuse]

Amazing, my pleasure ! Thank you 🙏

[@skunkwar7468]

If you plan on using face builder get as many reference pictures you can get before launching it because after 15 days you can’t use it anymore unless you get a license. The license cost $499

[@itsjxomusic]

Never knew AI could produce mock characters. This is helpful

[@MistereXMachina]

The quality of this tutorial+the calibre of content is pretty crazy, I don't understand how this doesn't have more views. Insane.

[@sifu2u_now]

KZbin just gave me this in my feed. Forever grateful to KZbin logarithm. 😄😁 And also grateful to you for this brilliant tutorial. 😁😆 Huge Thank you. 🙏

[@promptmuse]

Thank you for coming here, watching and adding this wonderful comment ! ♥

[@kasukanra]

This is incredibly creative and well-explained. I was trying a slightly different workflow that used textual inversion embeddings to learn character likeness and then generating stylized orthographic reference images with the help of my own custom DreamBooth style models. I would then project these reference textures onto base head sculpts using R3DS Wrap 3 for use in the UE5 Mesh to Metahuman workflow. Your method introduced FaceBuilder to me, which I had no idea about. Wrap 3 is time-consuming to use, so I'll definitely give this a try soon. On a slightly unrelated note, I also started making stable diffusion videos a few months ago. So, I know how insanely tiring it is to create new art, record the process, narrate over it, and compile everything into something digestible to the general audience, and I feel your exhaustion. Bravo and well done!

[@wital]

I can't believe you're doing such a magic on old PC with low internet speed! You deserve an upgrade!

[@promptmuse]

Hahah Yeap my PC is about to take off. Yes I really do, working very hard to get a better PC before this burns out 😂🫣

[@WilliamVideoUT]

Wow!!!! This is so professionally presented; it's outstanding. Truely you've spent a great deal of time making this tutorial and I admire this effort.

[@promptmuse]

Thank you so much. I really appreciate this comment. Really nice to hear. I do enjoy it, but sometimes it can take a while to get it all together haha

[@itaicarmeli1145]

Keep on the awesomeness, PM!!!

[@promptmuse]

Thank you! 👾

[@DanielPartzsch]

Really epic tutorial, covering so many interconnected topics. very well done and thanks a lot!

[@TacticalCastle]

Just...... WOW.... being a kid from the 90s, this is almost literally unbelievable.

[@dialecticalmonist3405]

This looks like a lot of work. I can't imagine how you figured out how to put it all together, much less filmed and narrated the process of it.

[@armondtanz]

Monster Hacks. There is a lot easier way but you gotta pay.

[@alicedeeper]

I love it how you pokerface through that silly alarm near the end. Just goes to show you are probably used to a lot of ... annoyances

[@promptmuse]

My computer blue screened mid way haha I looked like I had a bad day by the end it haha

[@andrewfrost8866]

I'm impressed by your ability to explain such a complex process; so clearly; I know it's a challenging task! But you did a fantastic job of making it understandable for everyone, and I appreciate your hard work and dedication. You are a true expert in your field; congratulations!

[@promptmuse]

Thank you! 🙏

[@kbrodeur]

Your tutorial is very cool. There is something lost in unity where most tutorials work for at most 6-9 months, then something in a build breaks, and all the tutorial scripting is gone as well, because most people are basically photobashing their knowing metaphorically. This does have fun aspects IF you state which build on EVERYTHING you are using. It'll get there one day, but holy rubber human, batman. It's mirroring is pinching in the center as well, that's what topology doesn't mesh with... mesh... with... in humans. Sliding and such. It's going to be a decade of really bad ai avatars that have uncanny valley from people who drop and drag without knowing the real mechanics of rigging and human creation. metahuman is very cool but it just looks like fallout 4 v2.0 of creating your own avatar for the game.

[@margames527]

Hey can you make a video how to create ai avatar of your self using stable diffusion in Google colab cuz I had some trouble with hugging face and thanks 😊❤️

[@Billary]

So sick to have all of this in one concise tutorial! It makes me wonder if it's possible to use Audio2Face to drive the mouth animation while the rest of the face is still controlled via live link. Then you could generate audio clips with your character's voice and have the mouth movements already synced up, while capturing a natural head/face performance. Idk if it could be done in real time, but it would still be pretty awesome.

[@promptmuse]

Yes ! You can indeed do this. It really deserves it own video on how to successfully combine these elements within the sequencer ! Great question!

[@Billary]

@@promptmuse oooh very interesting!

[@karelhoogendoorn]

I'm blown away by the apparent simplicity of this process and the unbelievable outcome of it. I cannot help thinking where this may go though... I had to record myself on my phone to become a customer of an online bank a while ago and it gives me a bit of the creeps thinking what might be done with this facial information. But I also love the progress of technology and this is just amazing. And thnx for a great, calm and informative video!

[@vrwizard2616]

That is a really good tutorial, amazing how you make these different complex tools easy accessible. Metahumans are great but Epic has still a lot to do. So far they very much focused on the head part. In future I hope the offer a complete body modification tool and most importantly clothing assets store.

[@promptmuse]

Totally. It had a lot of work. Metahuman seems to of stayed the same for the past 2 yrs (could be background dev) but I hope it continues to innovate and they do not get left behind.

[@armondtanz]

I had same issues i ended up using CC4 . Covers all them aspects brilliantly. Great tool for quick up n ready stuff with animations and poses and clothes. You can bring clothes in and attach them to characters etc.

[@promptmuse]

@@armondtanz I agree CC is fantastic ! Hopefully covering them in the tutorial :)

[@armondtanz]

@@promptmuse wow, u the hacksmith. So looking forward to sum juicy stuff...

[@thegiftedone]

Omg…sorry…I never compliment any one but I clucked to see your creativity on A.I. and was floored by your beauty! Sorry……..now back to the tutorial…..just wanted to say that! Lol……..

[@moneyjuice]

You are a gem for the AI art community, your tutorials are crystal clear and detailed with tons of new informations. Thanks for everything

[@promptmuse]

Thank you, that’s very kind 🙏

[@jameshughes3014]

the requirements right at that start are so welcome, thank you for that.

[@promptmuse]

You are more than welcome 👍🙏

[@mironr7272]

Love the content! Inspiring to create my own YT channel :)

[@doraromantini]

Omg... this is so well done!! The written version of the tutorial, the list on the start of the video... awesome!!!

[@hmyswonderland4532]

hi, i am a big fun of you, your video helps me a lot!!!🙌🙌but i met a huge problem when i tried to realize your video content because of lacking of base model🥺🥺i will be so appreciated if you could reupload your redhead.ckpt, thanks so much!!!🥰🥰

[@honurep1476]

Freakin" Amazing! Was feeling a little stagnant until I saw this. Mahalo!🤙🏽

[@promptmuse]

Ps I’d love to see your creations from this tutorial .so please @promptmuse so I can see them on any social platform. I’m giving Amazon vouchers to 1 winner. I’m hoping this inspires you.

[@michaellemon9183]

The best step by step breakdown I’ve ever seen. You rock!

[@lordeckogen6866]

Omg Like, Comment, Subscribe! I've been trying to figure out how to get this done for years and not only have you explained it expertly, you've put me on to tools that will make it so much easier! Thank you thank you thank you! This is now my go to channel.

[@promptmuse]

Thank you ! There is an easier way. Which I will show but it includes software that costs.

[@androoow]

rarely do i watch long videos on utube without seeing ahead what they leada to , but from the moment this one came on i was rivetted,. outstanding work and presentation and instantly subbed ..thank u

[@ArthurDaniel100]

Wow, the best tutorial for metahuman! Really good job. Just a question, there are a solution for android for the face capure?

[@EscrevoFilmes]

An ignorant question: what is the advantage of doing this via Midjourney instead of using metahumans from the start?

[@electrolab2624]

Excellent Tutorial - you are the champion of CGI and stuff! Much appreciated.

[@stevenkenney9473]

Impressive. I don't do this sort of thing but I love how the wheels are turning so fast with all the AI Art out there. It doesn't mean artists are out of work. It just gives them way more possibilities.

[@Pneumanon]

If you're not an artist, how do you know how it will impact their work?

[@stevenkenney9473]

@@Pneumanon Because some of the ai art out there is blowing regular artists out of the water. It can be produced, modified, riffed on, mutated into so many variations with the click of a button. The art is in programming the parameters instead of manually doing it. AI art is going to put a lot of people out of work unless they learn to adapt and use AI art.

[@Pneumanon]

@@stevenkenney9473 You just said the exact opposite of what you said in your original post.

[@stevenkenney9473]

@@Pneumanon No I stated what is perceived to be happening right now (perception is that ai art can and will replace humans). My counter argument is that learning to use and perfect controlling the AI to be more specific is an art in itself, and there will always be work for people who do that.

[@Pneumanon]

@@stevenkenney9473 So your argument is that artists will not be out of work because they will be forced to do completely different jobs- "programming the parameters" as you said- than what they trained to do, enjoy doing and are good at, which is actually making art?

[@maklog867]

Thanks, you change my life.

[@Вавилон-й5у]

one of my fav KZbin channel. Although I'm a just a beginner who struggles to make a donut in Blender

[@7ISABOVE]

its crazy that i used to dream about this type of stuff when i was like 12, now 30 the dream has become reality. thanks for the info😊

[@Very_Silly_Individual]

Fascinating how advanced these ais are getting

[@SuburbanPhilosophy]

idk I will try to that. but I love that tutorial. and I love how you explain everything, step by step and calm from your voice. thanks for sharing it :) This tutorial is an example for all yotuber who creating tutorial, they need to learn how to speak.

[@marinomusico5768]

Ur my muse. Perfect tutorial. Congratulations to you, great work!

[@LVX_]

0:44 I am already a big fan of your intro, down to earth nature and have already subbed! 👏

[@promptmuse]

Amazing !! Thank you ✨

[@safetyhomeloans950]

I'm so glad KZbin's algorithm recommend me to your channel!!!! This is by far an amazing tutorial in both execution and the amount of detail you've provided us with. Muchas Gracias :) Kudos!!! THUMBS UP & NEW SUB with all the bells and whistles!!!

[@harveytherobot]

You're so knowledgeable and going so fast that you actually set off the fire alarm at 27:15!

[@promptmuse]

Haha

[@KyokuCulture]

How to animate our body as well .. I want to create video like virtual spyac KZbin channel shorts

[@VisibleMRJ]

Wow this method is the most practical use for ai art that I have seen. Great job 👏

[@WeeZippy]

One of the best KZbin tutorials I've seen. Amazing.

[@promptmuse]

Wow, that’s incredible. Thank you so much !!!!

[@urbnctrl]

Wow from someone heavily working with Blender and UE and mocap for a long time, you laid it down very well, appreciated!

[@IdRadical]

Awesome. I wondered how complicated it could be these days, the future is truly now!

[@hugo_bart]

i got a headache while skipping through - thats a good sign your content is more evolved than my current understanding of the topic :) thanks for your effort and the state of the art experiments and solutions.

[@lordfuture1]

i am new to some of this and after this i feel confident in trying this myself. I was right in the middle of farming this job out, now i can save that money! can this work with an android phone?

[@promptmuse]

Fantastic! Yes it does, a link for the android live link is here github.com/justdark/UE_Android_LiveLink

[@lordfuture1]

@@promptmuse thank you soooo much. I really appreciate ur feedback. So rare to get that. I already subscribed but now u've earned my loyalty! :)

[@KO28JOJO]

Very comprehensive video. I like your workflow and your creativity you add to the workflow! Keep it up!

[@TheRoninRadio]

The look you gave when the fire alarm started going off 🤣 Incredibly helpful! Excited for more of your discoveries, sincerely, thank you.

[@mrcead]

I knew there was a way to do it, but I'm glad you've sorted it out and saved me countless hours

[@dar780]

The value in the tutorial is off the charts!! Looking forward to setting up my own character. Thanks

[@KhirbyReal]

holy moly this is an amazingly done tutorial! nice job!

[@johntnguyen1976]

Hands down the best ai-art focused channel. Thanks for everything you do! 🎉🙌🏽

[@promptmuse]

Thank you so much that is very kind 🦾

[@daisymaize]

WOW this is so crazy that this technology exists. thank you so very much for sharing this wildly eye opening tutorial!!! please keep making tutorials, you are a goddess!! 🙏

[@raphaelspector3682]

You are pretty badass! I thoroughly enjoyed how you explained step by step. Not many create content this detailed. Every step was explained (for a reason) and that sets you apart from all the other educational content creators. Fantastic video. I can’t wait to try this out. Thanks for the great work and many blessings to you! I subbed and like fyi. Just awesome.

[@tohupa8992]

I0ve just discovered your channel, and I must say its incredible! Congrats!

[@cluek9780]

Excellent! Been watching (similar? Dissimilar) tuts for decades and could only listen to yours for hours.

[@marjoriethompson24]

If I could turn back the clock 30 years, I would probably go down a similar career path. But, of course, 30 years ago I didn't know a thing about computers. It's really amazing what we can do with them now. Thank you for the demonstration - it's never too late to learn!

[@promptmuse]

It really isn’t too late to learn. It’s constantly evolving, so we are end up all becoming beginners every time there is a shift. I’m edging on 40 haha Not tooold but not young young either !

[@FVCK-]

Awesome tutorial. Welcoming and calm teaching voice, pleasant on the eyes all around. 10/10

[@AllensTrains]

Phew! I watched this video all the way through! It was fascinating. Although Blender is a free application, you gloss over the fact that proprietary apps are required to follow this tutorial. It would be good if you could make a video on what can be done with FREE tools as most students would not be able to install a proprietary application. Thanks for uploading.

[@trainer1kali]

finally used the AI to make your vids less bright? good. thnx. helped my eyes alot

[@peterxyz3541]

LOVE the direction on screen, easy to follow

[@CannaBusTeD]

Excellent tutorial, thanks

[@stuartjameswright]

Excellent tutorial. I can’t wait to get a bit of time to try this.

[@danielb.2873]

I've just discovered your channel recently and I already love it. That's exactly the stuff I need. Looking forward to seeing where you're going to.

[@sneezy1554]

It's absolutely insane how much knowledge this video offers. Thank you for sharing, hoping to see more in the future.

[@NeonXXP]

You have put a lot of effort into all of this so well done! but, iphone.... YUK. Any good android apps out there to replace the mocap?

[@promptmuse]

Yeap, here is one for android github.com/justdark/UE_Android_LiveLink . I'm a reluctant apple user :)

[@NeonXXP]

@@promptmuse Wonderful thank you :D

[@patrickmcmillan6025]

What a terrific tutorial. Thank you Prompt Muse! I'm a fan!

[@bogdandarizlo6097]

Hello. Very cool tutorial. I am delighted with the tutorial and so are you. You're beautiful. Can you share the amazon link?😀

[@majupiju2347]

great tutorial! Very detailed and well explained! Thx for sharing your knowledge :)

[@armartin0003]

Brilliant, thanks mate.

[@Paulinhox88]

Absolute superb tutorial. I did about 70% of this myself before i decided to junt metahuman in to the bin and just Ifacemocap my blender model straight up. it saves so much faff and computer space that despite the end result being majorly diminished form the unreal result, its still preferable imo. until metahuman becomes more straight forward its basically too much bloody work.

[@Andy_Shust]

That's quite a condensed and detailed tutorial! Thanks for you effort and for sharing your knowledge!

[@promptmuse]

Thank you so much! And you are welcome 🫶

[@leitecunha]

I've never heard of this channel before... But after this tut, Wow! Amazing channel and videos. Great job.

[@ohchristusername]

Very impressive to see such a complete workflow tutorialized, well done!

[@pentagramrecords3834]

Few times had I subscribed to a channel with this enthusiasm. Great video!!!

[@done.6191]

Amazing work.

[@Johvon1980]

Amazing video!!!

[@ivanbravo4786]

It’s Amazing. Great tutorial. You deserve a lot of subscribers.

[@gricchastain6506]

Awesome thanks. Now iv been trying to learn the idea. Of img to 3d environment.