IPAdapter for Flux - with ComfyUI Workflow

[@_SimpleSam]

I'll be waiting for Mateo to get a version out. He's the boss.

[@internetperson2]

Mateo doesn't actually train models tho, he could improve their wrapper but that's it

[@generichuman_]

@@internetperson2 saying "that's it" to what Mateo has built for ComfyUI is pretty ridiculous...

[@psionicxxx]

@@generichuman_ don't argue with baboons.

[@uv10100]

The two words I've been waiting to hear. Mateo is the MVP.

[@OlivioSarikas]

He is the IPA Nodes GOAT :)

[@starzilla2975]

the repo is actually already integrated into the comfyui manager, so you don't need to install it separately.

[@starblaiz1986]

Yay, another piece of the puzzle falls into place! We have Canny, Depth, and now IPAdapter! Just need OpenPose and Flux will really be cooking!

[@Elwaves2925]

That's why I'm hanging on for all the controlnet pieces. Things are moving and changing so quick, with so many variations of the base models that I'll wait until it settles then get everything. Until then I'm quite happy using Flux with the loras that are popping up.

[@tripleheadedmonkey420]

Great video! I've been waiting for this to drop for a little bit now. Really hyped to see it finally here!

[@eddiej.l.christian6754]

The Clip Model is no longer there. Where can I find it???

[@唐先生-x3h]

i can't find it too

[@berlindort]

still not there

[@Y1001]

Error occurred when executing ApplyFluxIPAdapter: 'FluxClipViT' object has no attribute 'parameters'

[@TyreII]

Was glad to see your vid! Thanks for the info. Unfortunately, I have gotten some pretty terrible results but I am hopeful that the process will get better in time.

[@MatthieuSanchez-m3v]

I can't find the VIT CLIP large where indicated, do you have another link? Thanks a lot

[@PimentelES]

one thing I wonder about flux is that since it uses and understands highly verbal prompts it seems that there is a better map from prompt to latent space, therefore the best option sometimes may be to ask a llm to describe the style image and use it as part of the prompt

[@Freeak6]

Is it possible to use IPAdapter without the XLabs Sampler ? For some reason the XLabs Sampler is using way too much memory (like twice as much as when I use a SamplerCustomAdvanced node).

[@DonovanHarshbarger]

Absolutely. The IPAdapter just modifies the model. Once that's done, you can plug the modified model into the model input on your KSampler (or the BasicScheduler if you're using SamplerCustomAdvanced) as usual.

[@13-february]

Hi, thanks for the video. I have two questions. First: why are there two prompt input fields in the node, and why is the prompt duplicated there? Second: what is the fox icon next to the node header?

[@RomanAlegria-h4i]

Hello friend, thank for sharing; do you know about a workflow that works with ip-adapter to "replicate" some colour palette or style, and then apply it to a controlnet openpose character? is it possible to combine this workflow?

[@adrianmunevar654]

Does it mean finally we can have something like (or better) than instantID in Flux? 💪🏻🔥

[@KINGLIFERISM]

no

[@Quantum_Nebula]

I love the way this guy says "copy"

[@TheSniperWho]

Same. Honestly, I'm surprised I don't see these kinds of comments more often. I just can't "cope-ee" without them! 😂

[@blasteekmag]

Hi it the clip vision file is deleted. What do i do?

[@LordLethris]

is that Clip Vision file, just a duplicate of one of the others? I'm finding with comfyUI recently, that a lot of Custom Nodes are downloading, or require you to download, large (some times upto 6gb) files and/or are renamed versions of the files you already have.

[@AkoZoom]

Also even is the clip directory in models of comfyUI.. seems confused as the file is model.safetensor then renames clip_L.safetensors.. sometimes precision is useful for all ;)

[@monah62rus]

It takes a hell of a long time to generate, about 30 minutes or even more, is that how it should be?

[@ogrekogrek]

Thanx, Olivio. Is it working only witch Dev?

[@yapyh2872]

Can you please provide an installation guide for pulid?

[@aryjawn]

Having an issue with my Xlabs sampler it just takes an incredibly long time I have the same settings as you (turned the steps down).

[@laurencecatalano2186]

Oli, I noticed you have a flux Lora just floating, is there some issue with hooking it up?

[@OlivioSarikas]

i was probably testing something and forgot to delete it before the video

[@gjohgj]

@OlivioSarikas Is this also for Flux Schnell? Or the noncommercial dev version?

[@OlivioSarikas]

only dev version

[@johndebattista-q3e]

Thank you so much I realized I have to make a file

[@CoconutPete]

Forge?

[@Tsathogguah]

I realize this is a bit more for advanced users, but for people learning this can you include a very basic explanation about what the IPAdapter does?

[@OlivioSarikas]

good point. The IPAdapter in this case is a bit like a style transfere, where it will try to copy the artstyle of the image you use as the input

[@李云-f1b]

The products of Da Hu Zi are of high quality.

[@jenesice]

유용한 영상 잘 보았습니다..감사

[@JamesRogersProgrammer]

Seems like the Nvidia GPU is hard coded into the flux sampler. Not working on my cpu only system.

[@edmosh]

wheres clip vision l ?

[@NestSresthabutr]

Can i use this method if I run ComfyUI through Colab?

[@blasteekmag]

I need help the preview image comes outblack

[@GarviHere]

Waiting for schnell model controlnet and ip adaptor

[@jairwen82]

how long it takes for one 1024*1024 image?

[@3lackdevel869]

depend of your graphic card. I take about 1 to 2 mins with 4060 TI 16gbs vram

[@Jaysunn]

no clip vision l

[@Deathshot_Official]

May be checking out "girls with talent" 😂 I still can't get over your comment😂

[@demondemons]

Does it work with nf4 version of Flux?

[@ernstaugust6428]

Didn't work for me, but maybe I am doing something wrong.

[@vernongriesel3910]

2:45 Simulation games before computers >.

[@jasonstetsonofficial]

How to in forge!!!!!!!!!!!!!

[@mirek190]

schmell model is abended by community because is nothing works with it ( control net, loras ), has much worse quality and is resistant on training.

[@fittersitter]

Why is everybody telling "to open the command window click in the address bar and type cmd"? That's way too much clicking and typing. You can simply right click in the folder structure and select "run in terminal". It does the same thing.

[@OlivioSarikas]

cool! I didn't know that. however my windows is in german, so the menu option would be in german too

[@Joseph_Myers]

Address bar opens CMD, run in terminal opens Powershell. They are very similar but CMD is different with permissions and overall appearance than Powershell. Hope this helps to clarify.

[@fittersitter]

@@OlivioSarikas Ich hab auch ein deutsches Windows und der Befehl heißt dann halt "In Terminal Öffnen"

[@fittersitter]

@@Joseph_Myers I am aware of this, but it makes no difference for the installation of custom nodes

[@Joseph_Myers]

@@fittersitter I agree with that on custom nodes. There is a custom node pack that uses Powershell method to run some python script.

[@Puckerization]

Thanks for this Olivio...but this is hideously slow. it took forever on a RTX3090 24GB.

[@Pawel_Mrozek]

Milion tutorials how to use FLUX it in Comfy UI and very few how to set everything to work in normal UI for ordinary people and none how to use Controlnet or ip Adapter without Comfy UI involved.

[@8eck]

Where is the picture from the thumbnail? 👿

[@DivinityIsPurity]

Baitnail looks it was made in A1111 using SD1.5

[@johndebattista-q3e]

If they find it red tell them to update it

[@OlivioSarikas]

good point

[@johndebattista-q3e]

@@OlivioSarikas Because I went through it that's why I want to help as well

[@INVICTUSSOLIS]

The picture was not popcorn. A land of fortune cookeys it seems

[@KINGLIFERISM]

Take forever just so you all know.

[@0A01amir]

Flux is not as good as they say. over a minute for just one pass, i can create 3 high quality 3pass images in that time with sdxl. generation time = more wasted energy aka heat = boring.

[@JDM-79-TF]

Flux is hella slow (thanks for the tutorial though!)

[@berlindort]

very slow , unstable, not even close to style of reference picture.

[@Avgur_Smile]

IPAdapter for Flux is veeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeery slow.

[@cncpts66]

I figured it out thanks for erasing my comment!

[@OlivioSarikas]

I din't erase any comments. Maybe you put a link or something else that youtube automatically hides

[@Elwaves2925]

It's not Olivio, it's YT. They seem to randomly delete or hide comments, even if they're perfectly innocent.

[@cncpts66]

@@OlivioSarikas Ok it might have been the setup python file I mentioned which I wrote the way that it is labeled in the file directory, anyway I already had “x-flux-comfyui” folder installed and to get this to work had to delete folder and reinstall it, because I had Red missing nodes after following instructions, for anyone with issues that has full dimension, delete it and re-clone it back into directory

[@OlivioSarikas]

@@cncpts66 or you could have used the "update all" function in the comfyui manager. I will point that out next time

[@cncpts66]

@@OlivioSarikas did the update all first from manager, didn’t fix, nor did the install missing nodes button, it’s a hit or miss with the manager

[@generalawareness101]

I despise the new Comfy as trying to make a new workflow is so rough now and a pain.

[@OlivioSarikas]

not sure what you mean. it works as it always worked

[@generalawareness101]

@@OlivioSarikas Slow, sluggish, and pull out a node. Ask Olga, or THM for clarification they will let you know the downfalls of it.

[@tripleheadedmonkey420]

It's true, though it technically works the same, it freezes and jerks. I normally build a new workflow every day from scratch. Yesterday it took me a lot longer to get it built because of how much the menu was freezing up and slowing down. Not to mention that it is really intrusive. It used to overlay now it fully blocks the screen with the search menu.

[@generalawareness101]

@@tripleheadedmonkey420 I tried to make a new WF and couldn't even find the nodes as the new popup is horrible. I gave up and started grabbing bits and pieces of other WF to paste in.

[@tripleheadedmonkey420]

I think the best way to describe it is that new users will have no idea what the images of the nodes represent anyway and more advanced users will already know in most cases what they're looking for. So at this point in time, while it looks like a cool update and whatnot, it probably needs another couple of community feedback revisions and some massive code optimizations before I would have considered it ready for mass rollout on the main branch.

[@DivinityIsPurity]

Now all we need is A1111 for Flux and were cooking 😊

[@politicalpatterns]

@@DivinityIsPurity try stable forge. It's there with bits and bytes FP4 model. Runs fine one 6gb Nvidia cards.

[@x_ye11owb00t_x]

no, very slow, veeeeryyyy-veeeeryyyyy slow

[@jorvax3744]

XDD SO REAL, i got a 3070 and r7 5700X + 16gb vram, it took 50 whole minutes for a single broken image, that's a joke

[@MillennialKiwiGamer]

can we start seeing more Forge content not Comfy because Comfy is NOT ACCESSIBLE

[@mirek190]

forge is ...meh - very static and new functions have to be implement by creator of that app ComfyUI is elastic and you can implement everything in seconds by yourself

[@hcfgaming401]

"not accessible" this has me rolling. What it not accessible about it? Just download it and click run kek

[@generichuman_]

It's accessible if you have a functioning brain...

[@metasamsara]

People actually use Flux? lol

[@hcfgaming401]

I know I partially wish it wasn't becoming the norm, but also that's just my own selfish reasons. I knew my hardware wasn't going to keep up forever and wishing for things not to progress is goofy. Still, it's sad to be out of the game for now 🥲

[@metasamsara]

@@hcfgaming401 i can run it but it's way too censored. and the lighting is a bit ridiculous too. it's all form, no substance.

[@DrSid42]

Meh, ComfyUI ..

[@renderartist]

@@DrSid42 No one is making you use it though.