Consistent AI Characters in any pose: Tutorial

In this tutorial, I go through step by step, how to create a consistent character for your comics, books and creative projects. (▰˘◡˘▰)
✨Free Written tutorial coming soon on:
promptmuse.com/consistent-ai-...
🖱️Step 1: / discord
You can use any Text to img generator you like, I just choose MJ :)
🖱️Step 2:
Thin Plate Motion Colab Notebook (For adding animation to your character's face)
colab.research.google.com/dri...
🖱️Step 3:
Out Painting (Creating your character's features, you can us inpainting for this as well)
colab.research.google.com/git...
Get your Hugging Face Security Token (Make a free account first)
Hugging Face:huggingface.co/
🖱️Step4:
Dreambooth (Training a model based on your character)
colab.research.google.com/git...
🥤If you want to buy me a coffee, I'd really appreciate it:
ko-fi.com/promptmuse
🕹️Many thanks to Sixhaunt for his pipeline, advice and information and for letting me demo his Genevieve model, he's doing amazing things for the AI community.
Please check his website out here:
xanthius.itch.io
#aiactor #ai #aiart #midjourney #stablediffusion

[@promptmuse]

Hi, there is a great help forum here github.com/yoyo-nb/Thin-Plate-Spline-Motion-Model/issues.....but if you are not having any luck please try this alternative method: huggingface.co/spaces/CVPR/Image-Animation-using-Thin-Plate-Spline-Motion-Model

[@Arkhkalos]

the form no longer works :'(

[@texasfossilguy]

Can you redo this where its completely on a local machine?

[@EternalResonance]

I accidentally had this on loud as I was out in public, some old guys head exploded as this was too much for his mind to comprehend. Data overload. Thanks for the great content

[@IUSTITA]

You are a gem!

[@RoamGaming]

@@Arkhkalos she accidentally added the "....but" into the link. just copy the important part and paste it into the address bar for it work.

[@SS4DBZ]

It was nice to see such a complete, full workflow for using these new tools and putting them towards practical uses. Great video!

[@dogchaser520]

Love how you've broken down in easy-to-understand terms so many different tools here. This gives me real hope for the future of AI, where communities work together to build tools that work not just for techheads, but for anyone. You're fulfilling an important role in that chain, which is as a very experienced non-technical user explaining things to other non-technical folks who want to get started. That's a link often missing, so thanks!

[@DannyMack]

I was blown away just by the animation part alone. So many possibilities.

[@ansonh7495]

This is another level, didn't expect to see something like this on KZbin at all. I am blown away! Please keep it up!

[@Mattmovies]

Holy moly, this is so good! Thank you for this genius research and development. So many people looking for this.

[@pearlpospiech5562]

You are incredible. I, too, am obsessed with workflows but you're actually making videos about it and you're on another level.

[@michaelb.2113]

We’re in the early days of AI, this channel will likely have millions of subscribers with in the next 5 years.

[@promptmuse]

haha thanks, I just do it as a hobby as it’s really interesting and the best way I learn is by teaching 😂 so it’s a win win! But, thank you !

[@blender_wiki]

In Planet earth they are not 5 millions of people smart enough to understand what this channel speaking about

[@Instant_Nerf]

@@blender_wiki lol

[@beforeiknow]

Totaly agreed! Simply because she is a great tutor! I will defenitly follow and recomend!

[@sgct89]

Millions of subscribers where AI now wants to learn how to render itself?

[@EricZentner]

one the best, most thorough tutorial vids i've ever seen. . . what a game changer!

[@verence333]

Upvoted and subscribed. For the content of the video, for the lack of clickbait, for the written and easy-to-follow steps, for giving credits and visibility to people who helped you... This is quality content. Thanks a lot.

[@hybridroid]

Who else is amazed by AI yet at the same time feels like we've unlocked something forbidden and it is already way too late to prevent chaotic events from happening... our future seems crystal clear now

[@promptmuse]

Out universe is full of unpredictable chaotic events. This is just a small blip. It will be okay 🙏

[@damoncurrie7103]

I'm amazed childhood ideas I feel like I'm slipping behind it's like Star Trek holodeck you're only limit as your imagination and it's probably a good idea if you have a degree art history I feel like being 37 years old I'm too old. Do you have to have a desktop or can I do this on my iPad

[@hybridroid]

@@promptmuse Indeed, it will be okay in the long run. I'm still an AI enthusiast although I stopped posting my ai-generated visuals online ever since I realised how unethical Stablediffision deep learning models actually are... I feel guilty for contributing to the ai community lately, it's a conflicting situation since I am also an artist

[@Liz-with-a-smile]

@@promptmuse That's a dismissive and ingenuine response. Sure, blackholes are literal tears in space. catastrophic failures of reality to maintain time and reality in a way that's measurable or observable. But that has NOTHING to do with what is happening in our lives right here and now on Earth. Sure if the entire history of humankind was erased, it would be a little blip and all would be fine, but that's in the eyes of God and infinity, not the eyes of us right here. It would be catastrophic for us for our world to collapse. And saying that that doesn't matter because...oh universe be big....nihilism...yadda its fine... isn't just ignorant its dangerous. We can't ignore one dying or hurt person, because oh yeah, there are 8 billion more. We can't ignore our own planet because, the big old universe will get on fine without us. And we shouldnt ignore the potential horrors AI could cause....Just because it's fun to use...and yadda let's just say it will be fine when really it clearly won't be. Ignorance of the inevitable is what makes it inevitable. Knowledge and resistance is the key to mitigating the issues we see coming.

[@deamian65]

My inner battle was won when I realized I'm like a songwriter.. I can't sing, I can't draw or paint, but my imagination is 1000mph and I deserve to have it imagined into reality:) if not just for my own sanity lol.

[@digitus78]

I've been so addicted to learning and running my own stable diffusion I forgot there were other AIs out there. Going to have to try midjourney after I finish training my model. Nice to see alot of people getting interested in it.

[@SteveWarner]

Thank you for this incredibly detailed step-by-step guide. Exactly what I've been looking for. Thanks for distilling this convoluted process down and taking the time to put this tutorial together!

[@brainwithani5693]

This is the bright side of AI. Beautiful tools being explained by a competent and engaging person. Thank you for your hard work. It's channels like this that will teach the next generation to do amazing things.

[@giri.goyo_yt]

In all of this KZbin chaos, there are lights in the tunnel, your channel being one of them. Well articulated, no hokey lazy humor, deep demos and excellent instruction. If I had tons of money I would pour that into this resource, but alas, I'm here for the free teaching, so ahem, y'know. Keep rockin' AI artist sista!

[@promptmuse]

Haha What a kind comment! I do it because I’m passionate about it. Also I love sharing the info and being involved in the community :) Thank you for your comment, it made my day !

[@joshgiesbrecht]

Holy shit, now this is how you do a tutorial. I was intimidated af at first seeing all of this, but you made it so easy to follow along with and I had a successful first go. Can't wait to see where I can take this! You earned a new sub. Can't wait for the next vids!

[@castaliaspiruni6201]

I have followed the video with attention, and I can say you are a great teacher. Unfortunately today I did not learn how to create a character in ANY pose, but I have learned how to create a consistent character. I hope in the future your videos will reflect the title's promise. Thank you, PromptMuse!

[@FlawlessLIMA92]

love it very resourceful. NGL these kind of videos should go as viral imo

[@bubarules]

I have been working on a personal story that went from book, to unity, to UE and I've always struggle with being one person doing everything. I guess that after 15 years of starting my journey, I've finally found my perfect ally in AI. I can clearly see the path ahead and how I can finally make my vision real... of course there is always a caveat... we just got a baby and I can't put the free time in the computer hahaha Thanks for the tutorial, well explained and straight to the point! Subscribed!

[@frankhall401]

Finally! A video that doesn't assume I have any coding experience and goes slow enough for a numpty like me to follow step by step.

[@karmadrone6647]

Wow, amazing video!!! Thank you for taking all the time to create a tutorial. You are doing an awesome job!

[@adzer0_0]

This is a great tutorial! Can't wait to try it out myself. Thank you!

[@artkiko4460]

Wow. You are an awesome instructor. Thank you so much for putting this together.

[@ColinLevy]

Phenomenal walkthrough and results!

[@muratozdemir1812]

Your tutorials are inspiring. Keep the good work!

[@Hardts]

This is just brilliant! I've been using Stable Diffusion, but it looks like I'll have to get familiar with Midjourney, and come back for this awesome tutorial. Thanks!

[@r.davidsen]

Brilliant stuff! I'm a former art/media student who has had a bad spell of many years, resulting in a lack of creativity and slight depression. AI and videos like this have really kicked my creative energy back into 1st gear! I'm now making scripts for all kinds of projects, images and design, and now, thanks to you, even animations! Thank you so much!

[@promptmuse]

Yes, love that for you. So much to look forward to in this space, this is just the start :)

[@BlackMoridin]

So happy to see this comment, i've been having an ongoing discussion with a friend about AI and it's effect on creativity... My friend thinks i'll be the end of creativity, and i argue the opposite.

[@r.davidsen]

@@BlackMoridin Definitely the opposite. I'm still using it and creating stuff. To be honest, it is mostly for myself to create stories and characters. However, until now, I have never had an instagram page in my life. Now I'm running two channels and putting stuff in there. Also, have written an article for Medium, which I hope to publish soon. So, all in all, am doing much better than before regarding my creativity.

[@subatoistormborn5499]

I’ve watched several other videos trying to explain dream booth and just didn’t click for me. Thank you for this fantastic, concise and understandable tutorial!

[@linahinds6676]

I work in IT handling files with PHI. This stuff is so much more exciting. I am so amazed by your videos. Thank you so much!

[@woobeforethesun]

This does NOT help my obsession with wanting to create more "cool stuff" :). You've put together the most complete workflow I've seen. It's a credit to your insights and passion and I'm really happy for you. It's becoming a bit of a crowded space of KZbinrs already, but you're bringing something different and in my opinion, unique and better.

[@promptmuse]

Thank you very kind. I haven’t been outside due to these obsessions, is the sky still blues ??? Thank you for the kind comment, really nice. Cheers!

[@rne1223]

She showed us, but lets give some love to Sixhaunt for putting it together. Can't have one without the other. Both are helping the community immensely

[@promptmuse]

@@rne1223 Totally !! I wouldn’t of known this workflow without him!! Also he shared everything with me. A true asset to the AI community 🙏

[@paul_anderson6_707]

She could have saved herself a lot of time and trouble by just filming herself, as she has the look of an AI character.

[@Ebani]

That is how it works by design tho

[@pongtrometer]

Great tutorials, jam packed with clear info.

[@mikepearl6752]

This was FANTASTIC! Thank you so much!

[@Fourgees_4GS]

This was a really clever workflow. Great job.

[@zeeyannosse]

BRAVO! you are an amazing teacher! thank you very much for sharing those information in a very efficient way. I will try with a drawing, or a painting soon!

[@andrewfrost8866]

Wow! Again, excitingly helpful and informative! thank you!

[@zackrobat]

Thanks for the high density informative content!

[@jonasskjnnemann8462]

Glad to be able to say I was here at 4000-something subscribers! You are probably the best I’ve seen on YT teaching this stuff! And also someone buy this girl a 3090!

[@promptmuse]

Thank you for being here :) I hope you stay with me !

[@user-wz8zs6qo6x]

very complicated steps but they worth , thank you for that huge effort....and for this amazing tutorial

[@AzeAlter]

This is just the beginning. Insane

[@NexgenStudioSG]

Great effort. I can see it take a a lot of focus on the steps. Thank you. ❤

[@sanph6806]

Thanks for sharing! It's so well explained that I have no prompts for describing it😁

[@mateofoulkes499]

This is amazing! Perfectly condensed useful information and really well explained! This is going to be one of the top channels on this subject! Glad to be here from (almost) the start of the ride, when we were not millions of subscribers yet! XD

[@promptmuse]

Thank you so much!

[@CynicalWilson]

Awesome! Thanks a bunch for making the video, showing how to pull it all together :)

[@cagers9588]

just found your channel and wow i am impressed and THANK YOU so much for sharing. I really like your straightforward vids. Love from California !!

[@promptmuse]

Hey, thankyou 🙏

[@luis96xd]

Wow, amazing tutorial and video, I liked it so much! 🥺😄👏 It's so useful because I'm making a virtual assistant, and the results are beautiful

[@antonwinter630]

thanks for sharing these techniques. it is a very clear tutorial

[@MyLazyEye23]

This is ingenious. Good job and thank you. Subscribed.

[@segunda_parte]

Excellent video. Very complete and well explained. You are the BOSS.

[@Artishtic]

Thank you very much for this tutorial. It has given me a an idea for something that I hope works out.

[@LaAlquimista1111]

thank you so much my muse, amazing work

[@VonSolo5]

Incredible and so helpful 🙌💖💖💖 Thank you!

[@JeremyFeldmesser]

Great video and thanks for making it easier for more people to get access to these tools. Your manner helps make a daunting "techy" activity actually doable. Well done!

[@promptmuse]

Thank you ! I cannot even turn on a tv tbh haha

[@fabiano8888]

Hello! I just started learning about AI generated images, and I have to say that your KZbin channel has been incredibly helpful in my learning journey. Thank you for all of the valuable information and insights you provide! In addition to the great content on your KZbin channel, I really appreciate that you are willing to allow a FAQ in the comments section. Not many KZbinrs are open to this, and it has been a huge help for me as I am just starting to learn about the subject. I just wanted to let you know that this comment was actually generated by an AI, but it does accurately reflect my thoughts and appreciation for your KZbin channel. Thank you! :)

[@DONUTnews]

Bless you for this. BIG thanks.

[@lovinxaviee]

Thank you. That is A LOT of info but fortunately I can come back

[@GraemeHindmarsh]

What an ingenious way of creating a consistent character. It's certainly a lot quicker and easier than the way I've been doing it. Great work and subscribed! Thank you!

[@piersregan7586]

Very cool! Lots of great information simply and nicely explained. Thank you so much!

[@Plisko1]

I think I saw a tutorial on building a space shuttle that took less steps... but it was an amazing video and you did a great job presenting all that madness. Wow... I hope it's useful in a lot of ways after all that.

[@hishram]

Thank you for a well explained and useful material.

[@dead0barbie]

that is the vid that will let me do AI, thanks!! workflow is gold

[@ferbajoelcine]

Wow... You are amazing, please keep it going

[@amielpatrick2348]

What a video!!! Thanks for sharing so much knowledge 🫶

[@SolveForX]

I think what a lot of us are interested in is how to upload a posed image and have all those poses have the character rendered consistently using the reference images. Sort of akin to tracking data for animation.

[@Queenwraith]

Did you have any luck figuring it out? I'm still having trouble!

[@SolveForX]

@@Queenwraith nope.

[@drdca8263]

I would imagine that this could work for that, just with a lot more steps? Like if you can fine-tune it to have an “idea” of your character, then you could use controlNet to make it make images of your character in whatever pose? Though I would imagine that it would be possible-but-difficult for someone to make a model that would like, copy a character from one image and make it match another pose, instead of needing to fine-tune separately for each character?

[@marinomusico5768]

Your tutorials are perfect

[@blazearmoru]

OMG thank yeeeeeeeeeee :O I saw CS bloom while I was in my senior year of phil and wanted to jump on the train and I just started my first semester of CS but it's already gotten so far ahead of what interested me back then. O-O so cool

[@overtheedge23]

Great explanation! There should be a service to just address this task in one shot. Upload 10 perspectives and emotions of a character, hit submit and done. 🙂

[@user-bm9oy4gx2l]

Awesome way to do it! Thanks for sharing 👍

[@mrnevermind]

Omg thank you so much! I run these locally never thought using these tools together like this to get ref video!

[@jamiecropley]

Another great video! I was trying to work out how to do something like this the other day haha.

[@promptmuse]

Thanks Jamie, the pipeline was down to Sixhaunt - No one else has done it quite like this so far. It’s very quick once the model is set up to just churn out consistent character prompts!

[@28mmRPG]

Cool... subbed. Been using AI Images for my RPG livestreams. So many cool things computers can do.

[@prophetofthesingularity]

Very nice workflow!

[@cutout.pro.7230]

We are also working on Al Art recently, Al Art is the future! Thanks to the blogger for sharing.

[@kaziahmed]

This is Brilliant! Thank you for taking the time to explain the workflow clearly and precisely. Will Definitely give this a shot. I am thinking if I train a model using my own Pictures, then I can become anyone using the power of AI. I can create talking head videos of myself as an astronaut, a professional fighter, a Rockstar, a pirate etc. I think we are not too far from being able to create our own homemade AI-enabled animation short films. Soon we'll have motion tracking and such. What a time to be alive!

[@promptmuse]

That is very cool. I’d love to see the finished results ! For sure, exciting times are here 👍

[@JMSQA]

This is insane!!! In a good way of course, I have a Mac though….😅

[@christtianwodson]

This woman is simply my dream woman, what a personality and professional! Cheers!

[@yeastydynasty]

Yeah, we will be making ai driven short films here soon and I’m all for it. I tried learning 3D modeling but had a terrible time trying to model a realistic 3D character.

[@JosephAuslander]

These tutorials are gold. I'd be really keen to see what happens when you use 2 to 4 models in a prompt. What does it look like when you ask stable diffusion to create a scene with multiple models interacting with each other?

[@pierreboyer9277]

Thanks for the tutorial. I was curious how to get persistent characters usind SD and this shows well the potential.

[@Limmweb]

Good job, Amelia, good luck and freshy inspiration to you

[@Screamo_RC]

Great video, topic focus, informational. 👍

[@oskararnarson]

Very good demo and to the point. Subscribed.

[@promptmuse]

Thank you so much!

[@jbiziou]

Most terrific lessons:)) thank you

[@manecolooper]

thanks so much! turned great!

[@savagestudios1870]

Amazing, glad I found your video from reddit.

[@promptmuse]

Awesome, thank you 🙏

[@helenbar]

thank you very much, this is so cool!!!! You're great!

[@turkm3000]

Great job, you won a new subscriber.

[@ExosfeerRoleplay]

Lovely vid and very clearly explained. New subscriber ♥

[@OysteinFSaebo]

Amazing video! Keep up the great work! So in order to create a image with several persons, all consistent character, I would just repeat the process for multiple persons, 'naming' each one and then import all into my local stable diffusion?

[@obi-wan-afro]

¡Esto es muy creativo! Increíble

[@ROBBIEP]

this is exactly the type of thing i've been looking for. i wanted to make some music videos to my songs with characters that arn't me.

[@metageist666]

Legend. Thank you.

[@mrboofy]

Here are some tips (it has helped me for complex poses and it may not be the most practical but it helped me) with the clipstudio program I made the exact pose with the camera angle that I wanted, then I took it to photoshop and painted a little, I basic so that SD understands, then in SD with the cara model that I had trained, use img2img some mask and that's it, it might seem like a lot of work but it's actually quite fast.

[@JerzyAdams]

Thank you very much for this movie. It's genius ! 👍

[@brucebennett4274]

WOW! Amazing results - from a bleeding edge process map...

[@bzqp2]

That's actually pretty cool.

[@ericschrdr]

You should have more subscribers, really great videos! I do think someone will make it drop dead simple to 3D convert a photo/ai photo making it simple to drop into animation software(lots of steps here). I've seen some newer platforms making an attempt at this but wondering what you and others here have seen...

[@louiepecan]

You're doing incredible work for the space and we appreciate you infinitely!

[@manusartifex3185]

Using prompts from data models that we trained and really original art. Where artist didn’t get any consent ? Really?

[@TheAIBlueprint]

Great tutorial! I wish i had run into this 8 months ago, wow! Your stuff is incredible. Have you seen what the Corridor Digital guys did for their animated show using diffusion?

[@astralartz2478]

Really useful. I subbed and no idea how I didn't find you before.

[@promptmuse]

Thank you so much 🙏🙏 appreciated

[@CookingWithCreators]

Captivating. Interesting computery stuff, too. :)

[@geneoverride3725]

Genius!