3D POSING For PERFECT IMAGES In Stable Diffusion! ABSOLUTELY MAGICAL!

[@Aitrepreneur]

HELLO HUMANS! Thank you for watching & do NOT forget to LIKE and SUBSCRIBE For More Ai Updates. Thx

[@vi6ddarkking]

Yet another step on the road of 3D to 2D Animations now consistency is going to be the factor to work on.

[@AscendantStoic]

Enigmatic_e did experiment a lot with that (specially using img2img alternative script + After Effects) and manages to get very consistent results in his A.I videos, check him out.

[@GeenSama]

I'm so glad for this tools and for your tutorials man. Creative minds who have no drawing skills can finally start doing their own projects with no limitations. It's amazing

[@xxcommentator]

I find this useful for visual novels where you can make your character pose like they are fighting, doing something silly.

[@brandon1138]

"silly"

[@AscendantStoic]

Killing it with those back 2 back videos, these ControlNet models really are the next step we have all been waiting for since SD was released ;)

[@SnowSultan]

Canny is so powerful now in the new update, I changed an Asian pinup girl into a buff male Viking using it at 0.1 and not only did it make a great looking Viking, it kept the pose of the pinup almost exactly. Will be trying it on 3D models shortly.

[@EgenMugen]

An extra thought: if you use Blender or a more advanced 3d software, you can get out depth-map, normal map or even "open pose" render straight out of your 3d software, so it's that much more accurate than getting that data from a normal 3d render.

[@devnull_]

BTW - it's called inverse kinematics, when you are talking about 3D animation/posing 3d models by dragging from the extremities, instead of doing it joint by joint, i.e. using forward kinematics.

[@ahadmazhar4154]

Thank you for making these videos, you are the only person I actually look forward to seeing videos from every day, because ai is something I enjoy playing around with a lot. I did want to ask though, do you have any plans on creating a lora training video specifically for styles?

[@kirills5031]

Man, this is just magic. Thank you for all the tutorials!

[@Pauluz_The_Web_Gnome]

@2:06 Woehahahaha "Hello....." to Funny man!!

[@kudryavtsevandrey]

One day someone will make a script with 3D mannequins of people, horses, birds and other creatures with multiple limbs that will work directly in SD.

[@SnowSultan]

Interesting, I just updated ControlNet and there are new options: Guidance strength, Annotator resolution, and Thresholds, plus a "pidinet" model that I don't remember seeing before. Would you consider explaining these controls in a future video? Thanks.

[@wolfai_]

I haven't checked yet but probably there's an explanation on the github page. Usually when there's a new update they explain the new parameters there even if it's just a bit.

[@woszkar]

Yet another great tool! Thanks for sharing the knowledge! Looks like I can finally drop XNALara and Blender.

[@Artishtic]

Awesome tutorial! Even the part when you go through your process for inpainting to improve the picture's face.

[@pladselsker8340]

Thank you so much for this, I had the idea a while ago, but I wasn't able to find anything useful with my google searches. These software and 3D models are probably gonna be a game changer for me (and everyone else).

[@KolTregaskes]

That's a strange peace sign, lol. I hope no one else from the UK is looking at that "peace sign". 😜

[@Switch620]

lol, love the bit of humor you through in your videos

[@CCoburn3]

Great video. It's about time SD has a way to fix hands and feet.

[@AddlerMartin]

“And all that for absolutely free” The energy and internet companies: _Bonjour!_ 😂

[@Visual-Synthesizer]

wow, this will give people without art skill the chance to make good art and give those with art skills superhuman art! Its similar to what i've been doing the last couple years with igm2img and my drawing/painting ability but now its automated.

[@McVirriaZ4]

Absolutely fantastic!!!

[@Chazzvc]

can't wait till we can make 3d models using prompts and images. It's already in the making, I can't wait till it's introduced onto NovelAi. I think eventually we will get video to Animation where we can take video of something and the Ai will map your 3D model doing the actions in the video, Then it will render out all the frames of that 3d model into a 2D animation style.

[@SamNEllas]

12:53 Bro... that is not a peace sign, that is the sign you make before you run or fight 😂

[@1300thiago]

Expressions is missin, but this is already incredible

[@Loopa21]

omg. tnx a lot

[@Naundob]

Cool! Is there a benefit to use img2img instead of just txt2img with ControlNet? I mean the extension uses it’s own image for analysis so there’s actual no need to load the image twice, right?

[@cesar4729]

Hes doing it wrong. Img2Img don't need canvas. In the other hand, Img2Img mix the image + controlnet, while txt2img with the canvas use only the controlnet generation, meaning more randomness.

[@NoahtheAIPlayer]

By the way, you don't need that whatever program he was pointing at, Because Leonardo ai has a Pose to Image where you get any post from a character or the pose preset and give It the image and give it a prompt

[@kikeluzi]

Could you do a tutorial showing how to create consistent non-famous characters?

[@Aisaaax]

Just FYI it's inverse kinematics, not inverted kinematic. Great video!

[@chariots8x230]

Can we use our own custom characters here, or will this just generate random characters? 10:57 - I want to apply these poses to my own original characters, instead of random characters that the AI generates. - Can we pose two characters together in a more interactive pose, such as hugging each other? - Also, can we apply specific facial expressions to each of our characters? - Lastly, can we ask the AI to put our characters in a specific background of our choosing (based on a photo reference that we provide the AI with)? These are things that I’d like to be able to accomplish with AI someday.

[@takeuchi5760]

You can do all of those of things right now if you are skilled enough. The tech is ready. For the first thing you train an embed/lora/model. For second you use latent coupling and embeddings. Third you inpaint the expression you want (provided it is something the AI knows, or you'd need to img2img this as well. Fourth you do that in photoshop or img2img first then photoshop.

[@chariots8x230]

@@takeuchi5760 Thank you for the tips! For the facial expressions, I have my own reference materials that the AI can use. I have reference sheets where I have illustrated different facial expressions of my character in my own style, and want the AI to maintain that style when applying the facial expressions. I was wondering if the AI can just use my artwork as reference and apply the facial expression that I choose to my character, while considering the camera angle that my character is shown from. As for taking the image to Photoshop to add the background separately, I can’t say I’m a big fan of that approach. The reason is that the background & character are not separate from each other, and they both need to have the same lighting, shadows, and perspective. With Photoshop, it would take quite a bit of photo editing to make the background and characters match up with each other properly. Plus I don’t really use Photoshop. I use a different photo editor.

[@Thozi1976]

I cancelled my MidJourney Membership this week and switched to supporting Aitrepreneur via Patreon. After consideration, he offers more value for my money as the Stable Diffusion plattform is almost on par with MidJourney now; last but not least because of the fun and informative videos created here. For me it's money well spent - he's the first ever creator I decided to support via Patreon. Looking back at what I learned here over the last 4 months, I could not come to another conclusion that Aitrepreneur definitely deserves my additional monetary support! 🤗 (Don't forget to still "like" the videos on youtube though)

[@Aitrepreneur]

Thank you! Really appreciate it! ;)

[@relaxation_ambience]

11:45 when you pause the video, read the prompt and check result :) Most of the prompt didn't work, except that part "photo of 2 people" and "modelshoot style". I'm working with SD for few months and still see, that you can control something, but in reality everything related on lucky randomness. I've never got the result I wanted. But if I didn't want something special, I got quite nice results. BTW: I didn't find, that Magic poser works on Windows.

[@MrGTAmodsgerman]

Very interesting idea 🤔 This leads me to new ideas how this could be used, like making training data for other AI that fits

[@nerual_dreming]

I love u my neural bro!

[@isnimshchikov]

You can use openpose hands to save information about fingers

[@isnimshchikov]

Btw, "normal map" is better then midas in almost all cases, because it works very similar, but saves more info about the image. Also you can generate normal map directly from 3d software an use it without preprocessor

[@ysy69]

AI Lord! Thank you for making and sharing this video with us. We wonder if you could make a video that uses these latest methods to fix characters hands ?

[@atoscustomcontent6898]

Dear Aitrepreneur, that was NO peace sign. Try making that sign to a London cop and see what happens ;-)

[@momentomori1747]

Didn't realize that the peace sign was offensive in the UK depending on which way you face your hand. TIL

[@friendofai]

Really great video, thanks K!

[@Jagent]

Personally, I prefer the blender plugin that ties directly into stable diffusion.

[@thanksfernuthin]

Putting the same image at the bottom as you have at the top... is that new information? Or did I miss it in the last video? Can't wait to try it.

[@Amelia_PC]

11:59 It is still an AI limitation. There are some positions that no matter how hard you try, cannot be corrected. AI can not understand bodies in perspective very well. I could put a worm's view camera body in perspective, but the results were awful when it was a body lying on the ground. But I believe it will be solved in less than a year.

[@bonio999]

I had an image of a dog lay on it's side with it's head closest to the camera and almost upside down, no matter how good I got the edge detection the AI just found the pose hard to understand and generate a useable image; I guess its due to how the model was trained.

[@ubuntugraphy]

yeah this is crazy

[@flonixcorn]

Very nice!

[@athlonz1]

Thanks a lot for the tutorial!

[@hplovecraftmacncheese]

This looks like a lot of fun to try out. I hope my 6gb vram can handle it.

[@gerrydeleau7623]

What would be the best way to dress the characters with real Products? Any workflow idea?

[@livingsouloftimestudio2887]

your awsome brother

[@the_RCB_films]

BTW if you have your pose in control net, and then a character you want to use for that pose in the img2img tab you can mix both of those.

[@amj2048]

another great video Aitrepreneur! ... BTW that wasn't the peace symbol, it was the rude F Off symbol lol, you have to turn the hand around to make it the peace symbol

[@fasterscene4752]

I use Daz3d using pretty much the same process except that I get control of the environment too

[@TeachmeGin]

❤amazing vid thank you, Is there a software that includes clothing when animating?

[@aginbayu]

you are amazing and very helpful!

[@SaffsVids]

I love this!!

[@DJVARAO]

Great tutorial 😁

[@velly027]

Thanks that's useful and funny

[@ygg0231]

Why is my generated face always deformed with img2img when using a lora model character model

[@pkay3399]

Thank you. So there is no need to export the pose with transparency?

[@Mintaebeans]

creative way to make characters! is there a way to generate a whole entire novel with an ai model?i would love you to go over that and discuss about ai language models as well no force though

[@ohhSuki]

incredible thank you ;)

[@Ai_staBlitz]

wou wou wou wou wou wou wou wou wouuu hahaha nice video

[@ProfessorM]

do you need a really good graphics card to run SD on ur PC? is there a different way to do it, using some sort of cloud processing service?

[@RespectFalseIcons]

after installing controlnet, I dont have the Midas preprocessor, where do i find the midas preprocessor?

[@ks5889]

Oh, is magic poser only available on apple devices? Oh I see LITE version doesn't show on that link anymore but has separate link for browser one

[@mdowney14]

What if I wanted to create a storyboard and I wanted to use the same character over multiple frames, using different poses? Is there a way to save a character and then just re-pose it?

[@depthbyvfx9604]

Yes just use the same seed cfg and sampler settings but change the prompt accordingly

[@AscendantStoic]

Some of the models of ControlNet maintain the image details more than others, which would help with character consistency, only way to know for sure is to experiment with them.

[@XaYaZaZa]

WOOO!!

[@satoshidarikotamasara910]

where did you get Midas?

[@AnimatingDreams]

ControlNet is AMAZING but as far as I know it still can't be used to generate the same character over and over for making comics

[@Ch50304]

How can i get this version of stable diffusion, I tried everything.

[@jzilla1234]

How do you pose things like wings

[@Unnaymed]

Don't forget to tips him !

[@satoshidarikotamasara910]

if using the control depth of the hair from the image results will follow the reference pose. how to change the hairstyle?

[@Soupie62]

6:45 the frame you capture has themodel upside down. Every time I try to model someone upside down, I get terrible results. Really wish you kept THAT frame, and followed through to a final image. Maybe it's something missing in my prompts.

[@彩飘菲蕾丝]

that's another perfect turtorial! by the way, is there any possible using controlnet at inpainting? for example, fixing the hands of a image that was already been generated by previous model? also, I saw some very fatanstic 3d gif image generated by stable diffusion, will you make a shorts or video tutorial for making that?

[@ZeroCool22]

Can you link the MIDAS model?

[@wizenith]

What if I want to turn the posed images into an animation? How can I batch process the images before sending them to be inpainted and have the faces corrected for each individual frame, as instructed in the video? (edit: later I realized my question may be wrong because we can't mask the face automatically when the motion of the subject is moving unless we have a script for tracking the face, do we have the script or can we ? )

[@ARTIK.31]

Can you please advice me, in 'openpose' mode, instead of a "skeleton" pose, there is just a black picture. What could be the matter?

[@Detective97]

For some reason it's not making any pose for me, the pose image is just blank black and so the picture is just exactly replicated, any suggestions? I didn't downloads all the models, only the openpose, canny and scribble models

[@NamNguyen15294]

I have a question, what if I want to apply the pose of an image to another image (not using the same image like in video). How do we do that?

[@vanitygamer7817]

doesnt work for me ;/ idk why but it doesnt generate any image just keeps the original model and the openpose isn't working either.

[@tomburden]

I am not seeing the midas pre processor. Do you know where to get it from?

[@banzai316]

Cool! Is there any good .OBJ exporter? Right now, I am using Dephmap with the plugin.

[@LegendD112]

is it possible to use controlnet to process a bunch of images like img2img? to make animations, thanks for your videos king

[@RKspadelhi]

link to the screenshot software tht u use pls.

[@jblahut3591]

Uh... that's not the "peace sign" in Australia, New Zealand, and the UK. Palm out is a peace sign, palm in is similar to flipping someone off.

[@michamuller3451]

Maybe magicprose doesn´t work on browser anymore?

[@grahamthomas9319]

This could be used with simple 3d blender scenes and no textures. Way easier than texturing.

[@viktoriadimitrova877]

is this your real voice?

[@ThePiyarut]

can you tell me where to install Midas?

[@spookythevillain]

Can we get a copy of those negative prompts you use?

[@SaintMatthieuSimard]

I hate online softwares so much. It was easy before to find good utilities to perform small tasks like batch changing the bitrate of wav files, now it's super hard to find good utilities for all those small tasks, and they'Re burried down under stupid online services that gets your ISP and everyone in between to steal your data as you edit it. Then what? You send something dear to you and Disney decides to make a film out of it and to give you not a dime?

[@neamedia]

lol...making the peace sign palm facing inwards means "up yours" - but don't worry, Winston Churchill had gotten this also wrong :)))

[@grahamthomas9319]

I have 6gb Vram it dosen't seem to be able to do a lot of the models even with the low vram checked. anyone else have this problem?

[@zumbalexxo]

There is no Magic Poser Lite-option. Only download button for Android and iOS 🙄

[@leonzeee7573]

we have to dwload magicposes

[@HalkerVeil]

There is more hair options in this software than there are in $400 Character Creator software.

[@Eins3467]

Kinda sad this is hard to use with close-up portraits.I only keep on getting black squares from the controlnet. And since the poser model is bald, if you use the depth model, SD will have a hard time generating long hair for women.

[@boythee4193]

i'm even getting much better hands in open pose.

[@dk_2405]

can i copy your negative form please ?

[@wolfai_]

Oh so non real pose works? I've watched some video saying that only real human work. Nice