How to make an AI Instagram Model Girl on ComfyUI (AI Consistent Character)

How to make AI Instagram Model Girl on ComfyUI (AI Consistent Character)
🔥 New method for AI digital model • The "Secret Sauce" to ... 🔥
Learn how to make an ai model girl using Stable Diffusion ComfyUI. In this tutorial you'll learn how to create an aitana ai model looklike. You'll have full control on your model, a Consistent Face, Clothing and environment of your ai instagram model.
🌟 All Useful Links & Workflow Visit: aiconomist.cc/ai-model-workflow
#aigirl #aimodel #stablediffusion
🖥️ my PC setup:
GPU - amzn.to/3PAbjP6
CPU - amzn.to/4cngN9A
RAM - amzn.to/494I5ig
SSD Storage - amzn.to/3x739r4
Prebuilds PC for Generative AI - amzn.to/3TQDTOQ
For Business: [e-mail]

[@Aiconomist]

🔥 New method for AI digital model kzbin.info/www/bejne/pIfEeZykoKyheqM 🔥

[@gingercholo]

maybe itll look decent this time

[@BobDoyleMedia]

This was excellent. Thank you for showing people there are other and better options than the Midjourney face swap method which of course limits your flexibility tremendously. I'm actually in the process of doing this exact thing and was building my ideal workflow, but what you did with the outfit and masking is really fantastic. Very helpful.

[@rishabjain6076]

perfect video , only consistent and detailed video i was looking for . this is gem.thank you so much

[@r2Factstv]

This was Absolutely AMAING! I've watched countless videos, spent a good amount but nothing as detailed and as great as this.. Definitely subscribing to this channel

[@Thomas_Leo]

Great video. I find using the prompt, "staring directly into the camera" works well for portrait shots or using "portrait". I'm also glad you're using low quality prompts instead of high quality and cinematic photography. Most average phone users don't have access to high quality cameras. 😁

[@AnjarMoslem]

thanks for making this video, I just bought your workflow

[@mysticmango-fl3ej]

That's actually really incredible the psychology and systems that go into making that much money

[@spiritform111]

great tutorial... very easy to follow. thank you!

[@terrorcuda1832]

Fantastic video. Simple, straightforward and well explained.

[@Aiconomist]

Much appreciated!

[@NicholasLaDieu]

this is wild! Thanks.

[@fabioespositovlog]

Great video, one question: why if I change the initial checkpoint despite keeping or removing the LoRA and connecting the model directly to the IFAdapter the whole process stops working because of a different size of the matrices?

[@DarioToledo]

I wish I'd have watched your video sooner. Well, if you posted it earlier 😂😂 just today I have come to a similar solution in order to achieve this. And now I still have a question: what if you want to switch to full body figure, or want to have a profile or rear view of your model, do the masks and the images going into the IPadapters remain unchanged? Or do you have to switch IPadapter's image and mask accordingly?

[@alexmattheis]

Love it! 🤠

[@mikesalomon2695]

Woaw, it seems very difficult but great in the same Time. I will try tomorrow

[@DYYGITAL]

where do you get all the images for clothing and poses from?

[@RichardMJr]

Hey thanks for the video! I cannot find the Ultimate SD Upscaler. has it been removed? If so is there something else you would suggest in its place?

[@Blakerblass]

Excelente video hermano, bastante interesante.

[@ejro3063]

There's nothing comfy about ComfyUI

[@xviovx]

This 🤣🤣

[@EpochEmerge]

@@xviovxthen you should do it manually on a1111 to get the idea why it’s called comfy

[@AdrianArgentina-nd7rg]

Agree😂

[@FudduSawal]

The flexibility it gives us over other tools are justified

[@otherrings2887]

😂😂😂

[@JpresValknut]

How can I use multiple prompts at the same time? Say put 5 into the queue and then move onto the next one? So the same that with the stable dif default UI can be done by using the texfile or textbox on the very bottom?

[@temporallabsol9531]

This is great stuff.

[@Anynak69]

Cool, but what about a different perspective view of the face? it seems like the face always keeps the same perspective regardless of Openpose settings. is there any way to fix this?

[@Benny-or7fl]

Amazing! Any recommendations on how to optimize it for SDXL? For a reason I can’t explain if I update all the models I’m getting worth results with SDXL compare to 1.5… 🤔

[@shinkotsu6559]

load clip vision model. what model do a load ? where to find this model.safetensors

[@jonnym4670]

any idea what kind of graphics card you can pull this off with??? I have a rx 6700 xt and an old laptop with a Gtx 1050 so it's clear i will need to upgrade but what is like the minimal card so i don't have to spend a lot

[@thedawncourt]

IPAdapterApply node fails every time I try to use the workflow. I'm a noob help please :(

[@connorcro6741]

How can you increase the accuracy for retaining the face? The face, although quite subtle, was noticeably different in each generation, which is noticeable to a follower as I noticed just in this video. Thanks!

[@elleelle6351]

God bless you! Tysm

[@crow-mag4827]

Excellent video!

[@Aiconomist]

Glad you liked it!

[@Specialfx999]

Amazing content. Thanks for sharing. Is it possible to place her in a specific environment by providing a reference image of the environment?

[@Mauriziotarricone]

I have an issue with the load clip vision doesn’t load the safetensor

[@ewzxyhh6180]

it worked, thanks, where i find the openposes to download?

[@myemail1668]

Perfect tutorial, thank you.

[@otaviokina22]

my model is coming out with two heads all the time, do you know how I can solve it? I've tried several negative prompts but it doesn't help.

[@user-ef4df8xp8p]

Awesome......

[@lilillllii246]

I'm always thankful. Rather than first creating a female model as a prompt, is it impossible to import a photo of a female model?

[@Stellalife706]

If I get a Macbook M3 pro , can I easily install Comfy UI and work?

[@user-nd7hk6vp6q]

What if I just wanted to change the pose alone, no change of clothes or anything else, how do I go about that pls

[@davidsik2402]

Hey i have a question, how can i do all of this, if i have already generated model in stable diffusion?

[@zr_xirconio__3577]

hey, nice tutorial, really well explained in detail. I am getting an error when running Ksampler and i was wondering if you could help me with that: "It seems that models and clips are mixed and interconnected between SDXL Base, SDXL Refiner, SD1.x, and SD2.x. Please verify. " one thing that is different from my workflow and your workflow is that in the clip vision loader I am using "clip_vision_vit_h.safetensors" instead of "model.safetensors" because I couldn't fine the file you are using on the web, any chance you could post a link to that file or help me out resolve this error? thanks in advance

[@favrumo.design]

Eres grande!

[@Lenovicc]

Where can I download the model for clip vision?

[@guillemgonzalosilveira2277]

how do you do to see ksampler and upscaler progress ?? I'm searching for it and i can't find it PLEASEE

[@lilillllii246]

When I use a same phto of clothes, almost similar characters appear, but when the image of the clothes changes, a completely different character appears. What should I fix?

[@EvanKrom]

Cool video! Got my KSampler blocking (loading 0% over 25 steps) after IP Adapter, don't know why but maybe related to the AMD graphic card I am using? Generation of image and upscaling was working...

[@truck.-kun.]

This is a good tutorial. Face swap maybe is a more fitting title in general

[@ChristianKozyge]

Whats ur Clip vison model?

[@Rodinrodario]

Can u help me? Why is sometimes the facy ugly and sometimes perfect, depens which pose i take ?

[@ehteshamdanish000]

You have shared everything thank you for that. If you could also share the openpose image and the character dress one would be appreciated

[@ryutaroosafune8756]

Thanks for the great tutorial and the sample json files! I was able to do almost the same thing using the sample Json, but for some reason the face part is broken and does not show a beautiful face like your tutorial. For Automatic1111, Adetailer can be used to beautifully redraw face images as well, but currently Adetailer is not available for ComfyUI. Is there something I should do?

[@toonleap]

There is a plugin called Face Detailer but of course, it needs more nodes and connections making the workflow more complicated.

[@szachgr43]

does that work on Macbook machines?

[@TalZac]

New to this, why not combine with faceswap?

[@ehteshamdanish000]

So i tried and everything works. But the next type I open comfyui the character face is getting change how to fix that can you make a video for this

[@rezasaremi4090]

How can i make a fashion model?! I mean same person with different outfit that i choose. Thanks

[@TalZac]

Please make a video about the posing and where to get this, and how you make the outfits

[@caluxkonde]

How to consistent up to 3 character or more just style change with prompt

[@parthsit]

InsightFace must be provided for FaceID models. any one getting this error ?

[@johnjd9640]

Wow, this is nice, I wish there was an easier way to do this or this is too complicated to me :(

[@VaibhavShewale]

So what is the miimum system req?

[@CostinVladimir]

I am going to ignore that you took MKBHD's voice and thank you for the tutorial :P

[@chiptaylor1124]

Did anyone happen to figure out what Clip Vision model was used?⁉

[@Crysteps]

Hey thanks for the video, but I where do you download all the controlnets from and how do you install them in to ComfyUI as well as where did you get the Clip Vision model from ?

[@andrejsshewchenko7190]

huging face

[@melonso18]

Can u give is a link to this model?

[@DailyFactsDelight]

I have also struggle, have you found it yet?

[@stasatanasov4263]

I am trying to find a course on creating a virtual influencer, so if you can tell me when you make it will be great!

[@prashanthravichandhran5688]

How to add custom clothing of my brand

[@ilyesdz6360]

thank you for your content, Please make a video how to use stable diffusion for creating designs for merch by amazon

[@breathandrelax4367]

Hi, thanks for your content ! Great stuff and efforts I have a little request would it be possible to make a video to explore AI models with the Multiarea conditioning . it would a great asset Thanks and regards !

[@DeeprajChanda-vt7kc]

the ipadapter apply node is not found, can't figure out how can i fix this? any solutuons?

[@gammingtoch259]

I have the same problem, try use others but not work

[@DarioToledo]

And another question: what's the purpose of setting the denoise value to 0.75 in the ksampler at 7:45 with an empty latent?

[@JustFeral]

There is none. Cause an empty latent image is just pure noise. He likely meant to convert an image into latent space or something.

[@ehsanrt]

partially right .. however i think the latent isn't totally empty . there is openpose . and the generation after the first one gets seeds and clips from last one . less denoise = less changes ....

[@DarioToledo]

@@JustFeral indeed, this must be related to the IPadapter in some way or I can't see the point, as he's starting from an empty latent. What's the point of partially denoising the noise.

[@Rodinrodario]

where did u get the IPadapter, how did u config and install it, which CLIP vision did u use, where did u get it? where did u get the open pose? i tried to find all by my self, but the end result is that my faceswapping looks like dogshit, can u help?

[@ramondiaz5796]

I was the same when I saw the video, frustrated because it doesn't explain many details, but I was able to make it work, but it was on my own, I took the time to look for everything you mention separately and watch videos, and I was able to get what was missing.

[@alexalex9511]

Hey! Thank you for the video. Can you advice about one problem? I used your workflow, but I catch this error: size mismatch for proj_in.weight: copying a param with shape torch.Size([768, 1280]) from checkpoint, the shape in current model is torch.Size([768, 1024]). I don't understand where it comes from

[@gerardoperez6787]

Could you solve it? I have the same issue and don't understand how to proceed

[@tiggy4591]

So for that I had to get the correct clip_vision model. I don't know that it will let me post a link in the comments so here is how to find it: Go to his link to "All Useful Links & Workflow Visit:" in his description. Go to "IPAdapter plus Models HuggingFace Link" Go to the main directory, then the "Models" folder. Go to the "Image_Encorder" folder. Download "model.safetensors" From there you have to put the model you downloaded in your comfyUI, clip vision model folder. That same place also has alternative IPAdapter models.

[@sunnyandharia907]

@@tiggy4591 thankyou very much it worked like charm

[@tiggy4591]

@@sunnyandharia907 Awesome, I struggled with it a bit last night. I'm glad it helped.

[@xReLoaDKryPoKz]

@@tiggy4591 i love you! you are the GOAT

[@brandonyork9924]

why wont it show the preview image on my screen?

[@MrPupone27]

It look so complicated to start any easiest way to learn with all those arrows connected?

[@Draig1999]

Can you please do the same for A1111. PLEASE!!

[@conxrl]

cant get my characters eyes to look normal :( any tips?

[@matyourin]

Hm... i finally got all needed models and nodes and shit but it still does not work as shown... I get an error message "Error occurred when executing IPAdapterApply: Error(s) in loading state_dict for Resampler: size mismatch for proj_in.weight: copying a param with shape torch.Size([768, 1280]) from checkpoint, the shape in current model is torch.Size([768, 1664])." And then it goes on with execution.py line 85, line 78, ... but i think the cause is something with the resolution of the images I put in? Is that somehow relevant? Like all input images have to be the same resolution?

[@christophsch7839]

read the comment from @alexalex9511 someone postet an answer

[@elleelle6351]

I have a question, if we have a clothing or jewlery brand deal, how can we make the model wear that product?

[@Mauriziotarricone]

Where did you installed? Wich folder

[@Halil-fi3pq]

how download clip vision model ?

[@user-yb5es8qm3k]

Very good, but the face painting is not very like the reference, the clothes can not change the same, are generated a little similar, but still very different, what is a good way

[@MarcJordan-zn5wn]

Can you run this in chrome?😅

[@bordignonjunior]

video is great, but you did not provide the links to download the models. I have downloaded your worflow, tried to install all models same as you have, and always get an error. I'm sure the problem is on my side. but you could take more time to explain the details.

[@sculptrise]

can you do an advanced tutorial for automatic1111?

[@user-is8hm2zs7c]

the "model.safetensors" file at 5:07 is too large for the file system to install, what can i do ?

[@rpharbaugh]

i've been trying to find this

[@ewzxyhh6180]

i cant make IPAdapter work, make a video downloading pls

[@beastemp627]

i cant find ip adapter apply nodes , what should i do ?

[@Aiconomist]

I'm updating this workflow because a lot has changed since then. +++ IPAdapter version 2 is even more advanced now. Be sure to check out my latest videos for all the updates.

[@gammingtoch259]

@@Aiconomist Please update this, i try use other nodes and adapt something similar that you .json file, but nothing work for me :(, appear a error shows "copying a param with shape torch.Size([768, 1280]) from checkpoint, the shape in current model is torch.Size([768, 1664])" Please help us and update the .json file in the web, thank u very much

[@povang]

Still using a1111, I love the simplicity.

[@pavi013]

You can do more with comfy.

[@avidlearner8117]

Maybe you address this in another video, but to me, the faces were vastly different from one another, evolving on every pass and getting away from the original one (before adding the SMILE in the prompt).

[@ramondiaz5796]

good video but there were things left to explain, for example: installing the models, in which folder to install it

[@techvishnuyt]

please do on for automatic1111

[@rangorts]

please do a tutorial for automatic1111

[@pixelriegel]

Had an Error with the IPAdapter Apply any one an idea why it could be happening? Error occurred when executing IPAdapterApply: Error(s) in loading state_dict for Resampler: size mismatch for proj_in.weight: copying a param with shape torch.Size([768, 1280]) from checkpoint, the shape in current model is torch.Size([768, 1664]).

[@RagesmithFTW]

did you ever figure out the issue? I have the same thing happening to me

[@pixelriegel]

@@RagesmithFTW Yeah I think it was that there are two different clip for the IPAdapter and depending on the model you have to use one or the other.

[@RagesmithFTW]

@@pixelriegel alright thanks ill try to see if i can figure it out

[@Kifor98]

Any ideas how to fix it?@@RagesmithFTW

[@ewzxyhh6180]

how to install UltimateSDUpscale

[@sohiyel]

Are they really consistent? I don't see Jennifer lawrence in any of the final generated samples!

[@gerardoperez6787]

The face of Lawrence is only for reference to AI.

[@aindmix]

Whats the config to do the clothing swaps with XL models, or is that not optimal? Also, do you inpaint to remove defects? Is there a separate workflow in comfy UI that you use to do that?

[@Aiconomist]

you can get clothing images from amazon 😉

[@aindmix]

@@Aiconomist How do you deal with deformed hands lol.. do you inpaint or do you just keep generating till you get something decent, or do you crop them out of frame when you post the image on IG?

[@theriddler_official_]

try using a mix of controlnet to edit the fingers and a bit of photoshop to fix the nails @@aindmix

[@artisans8521]

Nothing in ComfyUI is beginner freindly. There is pain, there is frustration, there is lost sleep and then more pain. I miss Lawrence wont take this unkindly, these arrows looked rarher painfull 😂.

[@BunniesAI]

I was/am finding this extremely usefull. However, am I the only person who can't seem to find any reference to this CLIP Vision file? pls help 🙏🏻

[@melonso18]

I was looking for 2 hours yesterday no chance 😢

[@chaz_evans]

manager > install models > CLIPVision model (IP-adapter) if you used this guide exactly you want the SD1.5 version

[@wilmot5484]

Error occurred when executing KSampler: mat1 and mat2 shapes cannot be multiplied (154x2048 and 768x320) Can someone help me with that?

[@stephan935]

I think for the initial face generation SDXL is used, but then later when you use IP and ControlNet, you should use a 1.5 based model instead. Probably you get the error because you are mixing SDXL and 1.5 models.

[@wilmot5484]

It was a problem regarding mixing SDXL with sd...,my fault. By the way I still can't make the final image with clothes similar to the face one...Do you have any advice?@@stephan935

[@wilmot5484]

@@stephan935 fixed, thank you 🙏

[@wulfster1234]

@@stephan935 I have a bunch of models. How can I tell which are 1.5?

[@stephan935]

@@wulfster1234 I honestly can't tell you. Sometimes it's in the name. I mostly know it based on the information in civitai. There you find the model it's based on (e.g. SDXL or 1.5).

[@yamanayabkhil9446]

Great video, although i have followed the video step by step, i keep getting deformed faces that look similar to my target model but not even close to it. What can i be doing wrong?

[@melonso18]

Same here

[@stephan935]

Me too

[@wulfster1234]

Same. I feel like the input images/masks into IPAdapters must be super important.

[@stephan935]

@@wulfster1234 Yes, I realized the IPAdapter images must be of high quality too. Even the parts that are not included with the mask.

[@artisans8521]

Thanx, makes the pain a bit less.

[@WupsteR]

Can you make a proper video of how to set up the work space before following steps in this video? As the video you are directing to is missing heella lots of parts and nothing works?

[@AlexsForestAdventureChannel]

Would love this even more if, (IP Adaptor) Would function for me, No matter the install, Any tips. (btw fresh install) still not working

[@Aiconomist]

Make sure to install ComfyUI_IPAdapter_plus

[@AlexsForestAdventureChannel]

@@Aiconomist both were installed and still did not register that i had either one of them. Reinstalled the whole thing with a fresh download and new space for the install did the whole uninstall torch and steps to make sure no bugs are present. Still not showing anything during the launch it says its unable to import the IP-Adaptor and my guess is some other factor is in play that i cant see. Im also having trouble with installing (impact pack) from comfy. I'm not cmd _ git clone_ install from manager. Still no signs of life. Not to sure where to go next. Like I said I have did the whole uninstall - reinstall steps. Still no progress.

[@DaniPratikno-btj]

@@AlexsForestAdventureChannel I have same problem, stuck on IP-adaptor

[@AlexsForestAdventureChannel]

@DaniPratikno-btj months ago, when I first installed this, everything worked. Then, it reinstalled windows, and now nothing wants to work well 😆

[@MenGrowingTOWin]

I still have no idea how you do the shortcut search node .

[@grumpyorange129]

Just double click on the grid