IPAdapter for Flux - with ComfyUI Workflow

[@_SimpleSam]

I'll be waiting for Mateo to get a version out. He's the boss.

[@internetperson2]

Mateo doesn't actually train models tho, he could improve their wrapper but that's it

[@generichuman_]

@@internetperson2 saying "that's it" to what Mateo has built for ComfyUI is pretty ridiculous...

[@psionicxxx]

@@generichuman_ don't argue with baboons.

[@starblaiz1986]

Yay, another piece of the puzzle falls into place! We have Canny, Depth, and now IPAdapter! Just need OpenPose and Flux will really be cooking!

[@Elwaves2925]

That's why I'm hanging on for all the controlnet pieces. Things are moving and changing so quick, with so many variations of the base models that I'll wait until it settles then get everything. Until then I'm quite happy using Flux with the loras that are popping up.

[@starzilla2975]

the repo is actually already integrated into the comfyui manager, so you don't need to install it separately.

[@Freeak6]

Is it possible to use IPAdapter without the XLabs Sampler ? For some reason the XLabs Sampler is using way too much memory (like twice as much as when I use a SamplerCustomAdvanced node).

[@uv10100]

The two words I've been waiting to hear. Mateo is the MVP.

[@OlivioSarikas]

He is the IPA Nodes GOAT :)

[@TyreII]

Was glad to see your vid! Thanks for the info. Unfortunately, I have gotten some pretty terrible results but I am hopeful that the process will get better in time.

[@PimentelES]

one thing I wonder about flux is that since it uses and understands highly verbal prompts it seems that there is a better map from prompt to latent space, therefore the best option sometimes may be to ask a llm to describe the style image and use it as part of the prompt

[@Y1001]

Error occurred when executing ApplyFluxIPAdapter: 'FluxClipViT' object has no attribute 'parameters'

[@tripleheadedmonkey6613]

Great video! I've been waiting for this to drop for a little bit now. Really hyped to see it finally here!

[@eddiej.l.christian6754]

The Clip Model is no longer there. Where can I find it???

[@唐先生-x3h]

i can't find it too

[@13-february]

Hi, thanks for the video. I have two questions. First: why are there two prompt input fields in the node, and why is the prompt duplicated there? Second: what is the fox icon next to the node header?

[@aryjawn]

Having an issue with my Xlabs sampler it just takes an incredibly long time I have the same settings as you (turned the steps down).

[@RomanAlegria-h4i]

Hello friend, thank for sharing; do you know about a workflow that works with ip-adapter to "replicate" some colour palette or style, and then apply it to a controlnet openpose character? is it possible to combine this workflow?

[@李云-f1b]

The products of Da Hu Zi are of high quality.

[@heliaszografopoulos5254]

Is it just me or IPAdapter for Flux currently unusable? Tried everything on the web, different samplers, models etc. Can bring time down with Ksampler, but results on average unusuable. Great tutorial though!

[@Tsathogguah]

I realize this is a bit more for advanced users, but for people learning this can you include a very basic explanation about what the IPAdapter does?

[@OlivioSarikas]

good point. The IPAdapter in this case is a bit like a style transfere, where it will try to copy the artstyle of the image you use as the input

[@johndebattista-q3e]

Thank you so much I realized I have to make a file

[@jenesice]

유용한 영상 잘 보았습니다..감사

[@blasteekmag]

Hi it the clip vision file is deleted. What do i do?

[@adrianmunevar654]

Does it mean finally we can have something like (or better) than instantID in Flux? 💪🏻🔥

[@KINGLIFERISM]

no

[@LordLethris]

is that Clip Vision file, just a duplicate of one of the others? I'm finding with comfyUI recently, that a lot of Custom Nodes are downloading, or require you to download, large (some times upto 6gb) files and/or are renamed versions of the files you already have.

[@AkoZoom]

Also even is the clip directory in models of comfyUI.. seems confused as the file is model.safetensor then renames clip_L.safetensors.. sometimes precision is useful for all ;)

[@Deathshot_Official]

May be checking out "girls with talent" 😂 I still can't get over your comment😂

[@laurencecatalano2186]

Oli, I noticed you have a flux Lora just floating, is there some issue with hooking it up?

[@OlivioSarikas]

i was probably testing something and forgot to delete it before the video

[@Quantum_Nebula]

I love the way this guy says "copy"

[@TheSniperWho]

Same. Honestly, I'm surprised I don't see these kinds of comments more often. I just can't "cope-ee" without them! 😂

[@ogrekogrek]

Thanx, Olivio. Is it working only witch Dev?

[@Puckerization]

Thanks for this Olivio...but this is hideously slow. it took forever on a RTX3090 24GB.

[@JamesRogersProgrammer]

Seems like the Nvidia GPU is hard coded into the flux sampler. Not working on my cpu only system.

[@CoconutPete]

Forge?

[@NestSresthabutr]

Can i use this method if I run ComfyUI through Colab?

[@gjohgj]

@OlivioSarikas Is this also for Flux Schnell? Or the noncommercial dev version?

[@OlivioSarikas]

only dev version

[@vernongriesel3910]

2:45 Simulation games before computers >.

[@GarviHere]

Waiting for schnell model controlnet and ip adaptor

[@blasteekmag]

I need help the preview image comes outblack

[@mirek190]

schmell model is abended by community because is nothing works with it ( control net, loras ), has much worse quality and is resistant on training.

[@jairwen82]

how long it takes for one 1024*1024 image?

[@3lackdevel869]

depend of your graphic card. I take about 1 to 2 mins with 4060 TI 16gbs vram

[@edmosh]

wheres clip vision l ?

[@Pawel_Mrozek]

Milion tutorials how to use FLUX it in Comfy UI and very few how to set everything to work in normal UI for ordinary people and none how to use Controlnet or ip Adapter without Comfy UI involved.

[@demondemons]

Does it work with nf4 version of Flux?

[@ernstaugust6428]

Didn't work for me, but maybe I am doing something wrong.

[@fittersitter]

Why is everybody telling "to open the command window click in the address bar and type cmd"? That's way too much clicking and typing. You can simply right click in the folder structure and select "run in terminal". It does the same thing.

[@OlivioSarikas]

cool! I didn't know that. however my windows is in german, so the menu option would be in german too

[@Joseph_Myers]

Address bar opens CMD, run in terminal opens Powershell. They are very similar but CMD is different with permissions and overall appearance than Powershell. Hope this helps to clarify.

[@fittersitter]

@@OlivioSarikas Ich hab auch ein deutsches Windows und der Befehl heißt dann halt "In Terminal Öffnen"

[@fittersitter]

@@Joseph_Myers I am aware of this, but it makes no difference for the installation of custom nodes

[@Joseph_Myers]

@@fittersitter I agree with that on custom nodes. There is a custom node pack that uses Powershell method to run some python script.

[@jasonstetsonofficial]

How to in forge!!!!!!!!!!!!!

[@JDM-79-TF]

Flux is hella slow (thanks for the tutorial though!)

[@INVICTUSSOLIS]

The picture was not popcorn. A land of fortune cookeys it seems

[@KINGLIFERISM]

Take forever just so you all know.

[@Jaysunn]

no clip vision l

[@johndebattista-q3e]

If they find it red tell them to update it

[@OlivioSarikas]

good point

[@johndebattista-q3e]

@@OlivioSarikas Because I went through it that's why I want to help as well

[@8eck]

Where is the picture from the thumbnail? 👿

[@DivinityIsPurity]

Baitnail looks it was made in A1111 using SD1.5

[@0A01amir]

Flux is not as good as they say. over a minute for just one pass, i can create 3 high quality 3pass images in that time with sdxl. generation time = more wasted energy aka heat = boring.

[@Avgur_Smile]

IPAdapter for Flux is veeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeery slow.

[@cncpts66]

I figured it out thanks for erasing my comment!

[@OlivioSarikas]

I din't erase any comments. Maybe you put a link or something else that youtube automatically hides

[@Elwaves2925]

It's not Olivio, it's YT. They seem to randomly delete or hide comments, even if they're perfectly innocent.

[@cncpts66]

@@OlivioSarikas Ok it might have been the setup python file I mentioned which I wrote the way that it is labeled in the file directory, anyway I already had “x-flux-comfyui” folder installed and to get this to work had to delete folder and reinstall it, because I had Red missing nodes after following instructions, for anyone with issues that has full dimension, delete it and re-clone it back into directory

[@OlivioSarikas]

@@cncpts66 or you could have used the "update all" function in the comfyui manager. I will point that out next time

[@cncpts66]

@@OlivioSarikas did the update all first from manager, didn’t fix, nor did the install missing nodes button, it’s a hit or miss with the manager

[@generalawareness101]

I despise the new Comfy as trying to make a new workflow is so rough now and a pain.

[@OlivioSarikas]

not sure what you mean. it works as it always worked

[@generalawareness101]

@@OlivioSarikas Slow, sluggish, and pull out a node. Ask Olga, or THM for clarification they will let you know the downfalls of it.

[@tripleheadedmonkey6613]

It's true, though it technically works the same, it freezes and jerks. I normally build a new workflow every day from scratch. Yesterday it took me a lot longer to get it built because of how much the menu was freezing up and slowing down. Not to mention that it is really intrusive. It used to overlay now it fully blocks the screen with the search menu.

[@generalawareness101]

@@tripleheadedmonkey6613 I tried to make a new WF and couldn't even find the nodes as the new popup is horrible. I gave up and started grabbing bits and pieces of other WF to paste in.

[@tripleheadedmonkey6613]

I think the best way to describe it is that new users will have no idea what the images of the nodes represent anyway and more advanced users will already know in most cases what they're looking for. So at this point in time, while it looks like a cool update and whatnot, it probably needs another couple of community feedback revisions and some massive code optimizations before I would have considered it ready for mass rollout on the main branch.

[@DivinityIsPurity]

Now all we need is A1111 for Flux and were cooking 😊

[@politicalpatterns]

@@DivinityIsPurity try stable forge. It's there with bits and bytes FP4 model. Runs fine one 6gb Nvidia cards.

[@x_ye11owb00t_x]

no, very slow, veeeeryyyy-veeeeryyyyy slow

[@MillennialKiwiGamer]

can we start seeing more Forge content not Comfy because Comfy is NOT ACCESSIBLE

[@mirek190]

forge is ...meh - very static and new functions have to be implement by creator of that app ComfyUI is elastic and you can implement everything in seconds by yourself

[@hcfgaming401]

"not accessible" this has me rolling. What it not accessible about it? Just download it and click run kek

[@generichuman_]

It's accessible if you have a functioning brain...

[@metasamsara]

People actually use Flux? lol

[@hcfgaming401]

I know I partially wish it wasn't becoming the norm, but also that's just my own selfish reasons. I knew my hardware wasn't going to keep up forever and wishing for things not to progress is goofy. Still, it's sad to be out of the game for now 🥲

[@metasamsara]

@@hcfgaming401 i can run it but it's way too censored. and the lighting is a bit ridiculous too. it's all form, no substance.

[@DrSid42]

Meh, ComfyUI ..

[@renderartist]

@@DrSid42 No one is making you use it though.