AI to 3D Characters: Next Level For Blender, Unreal Engine and more!

I'm exploring the innovative app AI Character creator called 'Chat Avatar', a cutting-edge tool that has been in development since last year. Join me as I guide you through the entire process in blender, from the initial creation of your AI character to the intricate steps of re-rigging and implementing iPhone motion capture and body animation.
An Unreal version will be coming soon, just wanted to separate the videos.
Please note: This video is not sponsored, nor am I affiliated with the 'Chat Avatar' company. However, I did have an enlightening meeting with the developers to gain insights into the current state of their technology. Dive in to experience first-hand the blend of art and technology!
Chat Avatar:
hyperhuman.dee...
Accurig:
actorcore.real...
Mesh Data Transfer:
mmemoli.gumroa...
LiveLink for Blender (Face Mocap):
nickfisher.gum...
Any iOS device with a TrueDepth camera (iPhone X or higher)
Actorcore (Body Mocap):
actorcore.real...
Chatavatar Discord:
Discord forum / discord
Patron
/ promptmuse
🥤If you want to buy me a coffee, I'd really appreciate it:
ko-fi.com/prom...
FAQ
1. DreamFacev2 CURRENTLY at the time of posting will be the only model to provide Rigging and body options. Thanks @binyaminbass
2. Website may be slow (Its still in Beta) . Works fine for me atm, but there has been times it's been slow. Discord forum / discord
3. If packing fails and you have paid...It should be free to repack, this has been the case for me :) . It will display a 0 as payment when you redownload. If unsure just ask on their discord above
#aiactor #ai #midjourney #stablediffusion #aianimation

[@promptmuse]

I'll Pin an FAQ etc here when they come in :)

[@promptmuse]

1. DreamFacev2 CURRENTLY at the time of posting will be the only model to provide Rigging and body options. Thanks @binyaminbass 2. Website may be slow (Its still in Beta) . Works fine for me atm, but there has been times it's been slow. Discord forum > discord.com/invite/AhYWCT8WNH 3. If packing fails and you have paid...It should be free to repack, this has been the case for me :) . It will display a 0 as payment when you redownload. If unsure just ask on their discord above

[@DeltaNovum]

This is mind blowing! In a few years indie devs will be able to overtake AAAA studios. Being able to combine ideas will become more important than anything, every year. Thanks for sharing! Also great in depth, no nonsense tutorial 👌.

[@ahmedboshra7625]

would you please leave your emailaddress ? for business inquiries

[@davy4842]

When is the next vid about hairtools haircards and metahumans ?!

[@promptmuse]

@@davy4842 on its way!! Sorry for the delay!

[@herladion]

I didn't know this kind of add-ons exist. I was doing it the primitive way! thank you so much for this very informative tutorial. ❤

[@promptmuse]

It’s been around since last year, so kind of known, but not massively known. It’s nice we get a preview before launch in April 🙏

[@sigma_799]

this is so valuable. even with hand modelled characters we can use accurrig to quickly attach mocap

[@christophe2582]

just a question, did you write Robert di Niro on purpose, to avoid censor? because his name is "Robert de Niro", maybe the reason why you didn't have a "perfect" portrait of the actor

[@binyaminbass]

Good to mention that only the Dream Face style offers body, and blend shapes

[@promptmuse]

Will pin this 🙏 hopefully they are the bodies out for the other models very soon. I did find with the dream face, I could get a stylized version by prompting anime etc. I had to go in manually fix the eyes blend shapes in blender though, as they were slightly terrifying 🤣🤣🤣🤣

[@maxgenuine]

I guess you would have reached a better result if you had prompted Robert "De" Niro, instead of "Di" ;)

[@promptmuse]

Haha whoops Good catch 🤣🤣

[@RSProduxx]

Oh yes, Unreal version please :)

[@princematthew]

I wonder what graphics card ur pc should have for this. I got a 3070 but getting a 4090 soon. Does RTX help or make it more realistic

[@promptmuse]

Nice, to be honest nothing crazy is needed. I'm just running it all in blender. Have you looked the the 4080 Super? Might save some money if your looking for a new card but want to save some £££. RTX is great for 3D, I've just purchased a 4080 and loving it (Annoyingly got it before they annouced the 4080 super). NVidia's shares have gone crazy (up by 225% over the past year) as everyone is buying their cards for AI. Always been the go to for 3D in my opinion too.

[@princematthew]

@@promptmuse I"ll start creating as soon as I get my 4090 as well will try the Unreal engine too. I want a 4090 because I play games .... Thanks for the content you make 👍

[@promptmuse]

@@princematthew Awesome, getting a new PC is good times. Enjoy it when it arrives!

[@buster5661]

@@promptmuse something better gets released after you buy it? Welcome to the graphics card game 😛

[@CEODeliveryBoy]

idk if anyone else had this problem but every time i got to transferring the mesh it would transfer them all fd up. took days for me (newbie) to figure out but I had to transfer them manually by selecting a material on og, drop down arrow n hit copy then go to accurig select corresponding material and then dropdown arrow paste. repeat. i did all the eyelashes on og rig to the one spot on accurig.

[@sanaaijohnson]

This literally saved me! My eyes were messed up too and I couldn’t figure it out! Thank you!!

[@CEODeliveryBoy]

@sanaaijohnson for sure! I knew if anyone else had gone thru what I did, and are like me, would've gone 3 more days until you finally cried ur eyes out and gave up. So I wanted to try n help someone 😆 glad u understood what I was trying to say. Could've just said copy n paste all separately between rigs, even eyelashes. I don't actually know if only doing one of the eyelashes works for all but I wasn't gonna chance it

[@sanaaijohnson]

@@CEODeliveryBoy omg I copy and pasted all 12 eyelashes too lmao

[@ZimMabu_GameDev.]

thank you

[@promptmuse]

You're welcome 🫶

[@edoard3]

I have an issue when i try to copy the materials. In fact the eyelashes model explodes after accu rig. Great content keep it up!

[@promptmuse]

Hey did you find a resove at all? Just check in Accurig when you are placing the face joint that it’s on the mouth of the character as that will determine the eye joint positioning. Also that output is Blender(I’m sure you did that). Perhaps also try and select your character before exporting to accurig and Alt+ A > all transforms then export selected mesh to fix once again and run it through 👍 good luck

[@edoard3]

@@promptmuse Thank you so much for replying, but unfortunately it's not working :(

[@rodrigoreis7]

Thank you!

[@JuzoSan-pf1ep]

Please you didn't explain how you added cloth and the skin color

[@promptmuse]

I will be doing this is the next tutorials 👍

[@omega3productions-bj555]

@@promptmuse Where is that

[@lord_gillespie]

Do you know if live link is available for android?

[@kevinlopez-vo3wv]

mi muse

[@nicolasmarin-k7t]

oh great another job taken by AI geez

[@uroboros5939]

pretty girl, thank you

[@geoatherton5214]

Amazing workflow tutorial. Thanks for all the effort that went into producing it. With this new wave of interoperable tools, crazy to imagine how many indy projects and studios can suddenly bring their dreams into reality. Way to explore the frontier!

[@genepardy7884]

Thanks for the great content. How much did it cost to make this?👍

[@avnikadubey8979]

Hi Prompt Muse, Can you make a Video on using Metahuman with real world footage as composite background footage for metahuman animation. Also, Adding Jewellery and Clothes to Metahuman. Thanks in Advance. ❤❤❤❤

[@promptmuse]

That would be great just making a quick clothes ❤️*4

[@ian2593]

What did you do to get the clothes and body texture? Thanks.

[@MouthyProductions]

Hello, I really enjoyed the video & workflow shown but my only question is how we're you able to texture the rest of the body shown at 12:54. I'd appreciate any help or tips given, Thank you!

[@soa_so]

I have some problems with my eyes, when choosing a material, the whole eye is selected, and when transferring textures, the eyeball itself is crooked, I do not understand

[@samu7015]

In 10 years rip modeling... I hate this

[@SumNumber]

Interesting . Blender needs to address AI because AI is out doing all of the 3D programs . Krita image editing software has done this and it works great and , like AI itself , it is addicting . AI is such a threat to so many platforms . Art that has taken some years to complete can now be done in a single click . It is a mind bender. From my point of view AI is not our friend and will , eventually , take over everything . Thanks for the tips . :O)

[@promptmuse]

It does feel like it’s a Trojan horse. The speed it’s going at, does not seem to be much regulations. Which on one hand promotes innovations, but not all have good intentions.

[@wallacesousuke1433]

I for one fully welcome the massive advance in AI, I doubt it will truly replace all artists/creative jobs, and on the positive side, it will allow solo devs and artists/small teams to accomplish way more, since we will be able to allow AI to do most tasks, streamlining boring steps, create tons of assets and procedural stuff, and in the end, the artist can assemble them together into whatever they want, like, create an entire open world game or animation. I mean, if legions of cheap artists from third world countries haven't killed the industry, what makes you think AI will?

[@kevinyang3298]

when I install mesh data transfer into blender, it pops up an error saying "ModuleNotFoundError: No module named 'mesh-data-transfer-2'", any help?

[@promptmuse]

Hey! Which version of blender are you installing it to (I’m on the latest version) 4.0.2 off the top of my head. May be a version issue? Just checking are you installing as a zip? Needs to be a zipped files. Preference>addon>install the zip.

[@promptmuse]

Also if none of the above was an issue I’d redownload from the gumroad page in case the file was corrupted during downloading

[@thedaltlaplanaworld]

Hello Muse I love your videos, even with little time and I always use the translator, I love all the information. The daily changes and news that emerge are truly crazy, it is impossible to follow everyone, but always follow you.🤩🤩🤩

[@promptmuse]

Thank you so much! Yes I try not to post content too much but content I think could be useful to viewers. I am so glad you enjoy it. What language are you speaking and where in the world are you?

[@frescolaveen3139]

Wow this is so informative!!

[@promptmuse]

Thankyou tried to pack a lot in in under 20 minutes haha

[@citygxd9443]

Ok now im scared lol everything i spent so many years learning .. time to adapt😅

[@promptmuse]

I totally get it I spent many years learning 3-D and art like many others here. I get the worry from people, it is moving very fast.

[@fabersoul]

I tried the chat avatar and after using the credits, i got to "mine" and the status just says "packing". no option to download

[@promptmuse]

You should be able to repack for free once you’ve paid if that one has failed. However if there are issues just go to their discord on the bottom of the chat avatar page and let them know cause they’ll fix it for you.

[@fabersoul]

@@promptmuse cheers, thanks

[@jakepablojakepablomedia7593]

Blend shapes are completely not working at all and i followed all steps correctly. The mesh stretches crazy

[@promptmuse]

Just check that your models align exactly on top of each other. Otherwise the vertex order gets messed up (produces crazy results).

[@jakepablojakepablomedia7593]

@@promptmuse still not working after importing the fbx. what step do i need to make sure the models align on? specifically, the mouth opening gives some weird stretching thing where the lips are attached. the eyes also get distorted in shape and the teeth material dont transfer

[@Gr8dame666]

I couldnt get the mesh data transfer part to work unfortunately.

[@wrillywonka1320]

I also that the girl has eyeballs and the robert deniro face did not. Did you add eyeballs? If not, would the eyes not work good if they are part of the face mesh? If you did add eyeballs would you need to add them to the robert deniro face? And how would you do so?

[@Hunty.]

whenever I try to use this site it just doesn't even let me download the face I make, is there something wrong with it? is it a scam? Not your video, but the site that is.

[@EdVizenor]

Excellent

[@DannyOnateArt]

Great video. You are so beautifull and inteligent 🫶🏻 Cheers from Ecuador 🇪🇨

[@hannababy]

too bad its 12 credits to export it the way you do it on chat avatar when you only have 10 credits to begin with and you dont want to subscribe without knowing if its actually any good and useful for yourself :(

[@nickarthurnight1019]

Wow! Simpy Amazing! How did you get textures onto the body? And the dress? Thank you for sharing! Subscribed...

[@promptmuse]

Just making a video about clothes for the character 🫡 Also body wise I just took the face texture map into photoshop and colour picked it and made a new body texture. I’ll probably do a quick video on this and link in the description 👍

[@milkglass1863]

I've got problems with the eyelashes, while i want to select -> metarial for eyelashes it selects the eyes and the eyelashes. How to fix that?

[@ThegreatHera420]

Doing faces is honestly not that hard and you might more intentional and good decisions that way, but it seems it’ll be so good for background characters

[@FaithIgnitor]

Is it possible to export a character in a chosen pose for 3d printing?

[@Caveboy2011]

Great video! Will try this out for sure. What model iPhone will work I have an iPhone 8 Plus Thanks for the very good tutorial

[@promptmuse]

Iphone 15. Any iOS device with a TrueDepth camera (iPhone X or higher) should work

[@Tinfoil.Hatter]

There,s NO A.I. that can duplicate YOUR beauty Thanks

[@GradeMADE]

Do you still see this project as viable seeing as they should have now been up?

[@kamikazeeOG]

I love all your videos.

[@promptmuse]

Thank so much, that’s really kind ❤️

[@RosieBunny-wi9bf]

for some reason after transferring to the new rig, my eyes wont work they are still blurred and i dont know what to do

[@Riker20]

aaaaaaaaaah quicker than a quicky

[@apatsa_basiteni]

Amazing. This will come in very handy in my future projects 😁❤

[@promptmuse]

Awesome , would love to see your work when you are complete !

[@setanbelangdedelduel]

Do you have any alternative for android to motion /face capture?

[@kouroshpcsmgameng2269]

its very god tnx

[@promptmuse]

Thank you so much for comment 👏

[@davy4842]

Can you make some sort of half stylized hair for metahuman?

[@rosuckmedia]

Hi, PM you make really cool tutorials, thank you very much.👍👍👍👍 Best regards Robert

[@promptmuse]

Thanks so much, Robert!! 🙏

[@mkstudiop]

alem de ser muito linda mmaravilhos tambem é muito talentosa , parabens por seus tutoriais execentes

[@TeddyLeppard]

Why is this video edited in such a frantic manner? It's OK to take a breath occasionally. People won't flee the channel.

[@promptmuse]

Haha It’s true, wanted to get as much info in as possible 🤣 but might calm down on the next video. Was chugging coffee

[@thereaper3466]

I believe it's like she said to fit in as much information as possible and me personally as fan of her I truly appreciate the amount of information that she delivers in her video ❤

[@ifthenplay]

that frantic editing manner is pretty much standard operating procedure for most youtubers who make the effort to respect the viewers time. i always appreciate it, a lot.

[@CEODeliveryBoy]

You can airways get the transcript and after watching a segment pause and read at ur own pace...

[@jonos138]

Just go to settings and reduce speed of video. Her voice may sound a bit deep 😂 but you won't miss anything 😉

[@betz3000]

I love the fact that you use bing and search google😂😂

[@TV-pw1dd]

Nice!

[@promptmuse]

Thankyou ! 🥰

[@SaintAngerFTW]

What would it take to make you the mother of my child

[@lubospejchal498]

Is there variation of LiveLink for android ?

[@brooke1639]

You did that black woman dirty 😂😂

[@CamIsMac.]

Soo does this mean your done with Reallusion's CC4? I feel like Reallusion is losing more everyday to Metahumans, Ai, and now this.

[@promptmuse]

No wayyyy, I'm actually going to look combining getting this in and mixing it up. Reallusion seem to move fast with plugins etc so I will expect some nice stuff from them.

[@EdVizenor]

Wow. You are amazing.🎉🎉🎉

[@promptmuse]

Thanks Ed! Not amazing but just addicted to this life ha

[@EdVizenor]

@promptmuse love it. Well I am entitled to my own humble opinion and you can't change my mind... so there! :P P.S. I sent you a message on insta.

[@woolfwoolf-so2jl]

top

[@promptmuse]

Thank you Woolf 🐺

[@KYARTTUTOS]

Marry me !!! 🤩🤩🤩

[@omegablast2002]

my character didnt have his beard, and eyebrows were just painted on is that normal?

[@promptmuse]

Yeap, it doesn’t currently create hair. Developers say they will add this in at some point. I use Hair tools (blender market) Has beards and eyebrows etc but there is a bit of a learning curve 👍

[@itsjxomusic]

AI Really is saving us so much time.... There is so many pros and cons, but I see so many pros. It really will take time off the overall development. There's even world map AI now :O

[@Echoesofpositivity2]

Does LIve link work on android?

[@remonmichel2195]

do u have way to make that in MAC ?

[@IamSH1VA]

4:36 Is there any way to get like lower topography version? *to use in mobile app/ games, etc*

[@promptmuse]

In it's current form no, there are lots of plugin to do this in blender but you will lose you blend shapes...but that's pretty each to recreate. hopefully in April there will be this option as many users have requested this. I'll pop it on their discord as a suggestion and see if it's built into the release timeline.

[@AlexPlayerDigital]

Aweome tutorial!

[@ECHSBACHS]

Cool!

[@kallesamuelsson8052]

Omg, that more clicks then used during a starcraft2 gradmaster league match, but you sure explain it good! =)

[@promptmuse]

Haha 🤣

[@Skycers]

Like Fuse, but with prompts!

[@jack-spade5647]

Last time I checked this out it was a bit costly for being a beeta product.

[@promptmuse]

Yeah it's quite pricey. But depend if it will save you time.

[@MultiFlashone]

Ummmmm.......that was amazing!!! Thank you so much for your time and efforts regarding this!!

[@shrayrathore7011]

upload the hair part soon

[@BAYAGINPECKPECK]

You are so pretty.

[@wrillywonka1320]

Aaaaawwweeessoommee!!

[@aq-xe6oe]

Great video, like always!

[@promptmuse]

Thanks for watching once again 🫶

[@binyaminbass]

Is it possible to use these shapekeys in iClone for acculips and the like?

[@promptmuse]

Iclone and CC use slightly different shape keys. I’ll give it a go today and see if it works (but doubtful!) If you have headshot you can bring it in via that method as it will convert it to a CC character automatically with all their own blend shapes. However, I know that character are working on a plug-in for Iclone but unsure if that will create transferable lens shapes. It will be interesting if it does!

[@user-on6uf6om7s]

Not sure what I'm doing wrong or if you have access to different features but I didn't get any options for bodies, rigging or blend shapes, just 4k or 8k textures and then "Pay" which uses your credits. I don't even really need the body or rig (blend shapes would be nice) but it also comes in with most of the head being white like in the review which isn't great. Edit: I figured it out, only V2 produces anything other than the bust with the face texture. Wish I would have known that ahead of time so you might want to add that info somewhere.

[@promptmuse]

Currently (as it keeps changing day by day) you can only get those features with the Hero model V2. But I’m assuming they will roll it out to the other models by or before April ! Oh just read you edit as I write this 🤣 yes I’ll had it in the description or try and add text to the video 🙏

[@user-on6uf6om7s]

@@promptmuse Hopefully they do as the more stylized models do open up your options a lot. I just took a deep breath and bought the $120 commercial package which feels weird for a AI tool but you couldn't get a single head commissioned at this quality with all of the maps for $120. I guess there's Metahuman but there are all sorts of issues using those outside of Unreal.

[@promptmuse]

@@user-on6uf6om7s metahuman is great but simply adjusting the mesh is a bit long winded. I have to use maya and quite a pricey add on. Also the licensing seems very flexible with chat avatar. The body textures are on their list as well. For now I just use the Uvw map they supply as it’s all unwrapped and make my own in photoshop. I’m excited to see what other features they bring. They are also very active on Discord and if you have any suggestions they take them on board because I’ve been suggesting stuff 🤣

[@mertkayan3755]

what... the... fucc....

[@buster5661]

The website is either slow or doesn't work 😔

[@promptmuse]

It does work, however they are continuously developing it as it’s still technically in development and test. So when they update stuff it can crash/ slow. The launch date for release when everything is ironed out is April this year 🙏 try it again tomorrow it should hopefully be fine 👍 they are also very responsive on Discord as well so will let you know if they’re having issues on the site.

[@buster5661]

@@promptmuse oh ok thank you. The whole website just went black after logging in

[@davidbell6101]

Bravo!!

[@promptmuse]

Thankyou!

[@pongtrometer]

Thanks PM, Always such clarity in your tutorials, making 3D seem less daunting for newbie’s like me venturing into 3D/BLENDER creations. Cheers

[@Lisalopezze]

Do you take in clients?

[@promptmuse]

Sometimes I do, I have insta if you want to message there :)

[@Massinissa-AM3]

Hi Please I want to know how I could delete a model I created? And thank you very much

[@averellrios4511]

"Promo sm"

[@CuBixxx86]

Great stuff

[@promptmuse]

Thanks do much! Glad you enjoyed

[@jounalansman1769]

Amazing video. Got everything working except the hair library. I know you did another tut on it, but i think it would have been great to see how to install the things without having to go to find other tut. Keep up the good work! you are amazing :)

[@wrillywonka1320]

Is live link available for android?

[@promptmuse]

@@wrillywonka1320 as far as I’m aware not for blender.

[@sabatinodibartolomeo8518]

E con miXAMO??

[@deekay5487]

wow what a tutorial! Thanks so much for sharing your knowledge! i will spend some $ in the future...!

[@pulasthithennakoon5389]

Thanks

[@themightyflog]

What if I change out the body they provide? Will it still work the same way?

[@promptmuse]

You would have to redo the blend shapes for the face but that does take too long to adjust. If the vertex order changes the blend shapes will stop working. 👍

[@themightyflog]

so as long as I keep the face the same I can transfer over the facial blendshapes? Basically want to change the body out and adjust then use accurig to rig it like you did. but with a different body. @@promptmuse

[@joelankamah4633]

Did you make the body skin yourself

[@promptmuse]

Yeap I just slapped a colour png from photoshop 🤣 colour picked from the face texture. I did speak to them. They will be adding a body texture hopefully soon to the program. 🤞

[@AllenJonesabstractpaintings]

Very informative and entertaining can you use an android phone for this?

[@n0ahg1]

Take care

[@promptmuse]

Thank you, you too !

[@albiceleste101]

They will directly compete with Tafi

[@promptmuse]

Daz is working on something as well. I imagine there will be a bit for a space race.

[@aipsong]

Hello and thanks again for your clear and logical presentation of a complex process!!! The pace of your presentation is like a swift stream, and your mellifluous voice is mesmerizing!!!

[@RokoSoko]

No problem😅

Accurig is absolutely phantastic. Better than all these "AI thingies".