Flux ControlNet - Easy Install Guide

[@OlivioSarikas]

Get my 3 WORKFLOWS here: www.patreon.com/posts/flux-controlnet-110607421 My Flux Install Guide: kzbin.info/www/bejne/qomyZ4aAYpt4mJo My IPAdapter Install Guide: kzbin.info/www/bejne/gYnbnJKYfKl2sMU Join my Discord: discord.gg/XKAk7GUzAW

[@LouisGedo]

👋 Thanks

[@GaijinGamerGirl]

Controlnets don't work in ForgeUI for those wondering, developer has a bias for comfyui and is toxic node network akin to blender nodes.

[@mattolsen5947]

This is great, very clear! Is it possible to combine ControlNet with IPAdapter to match the style of a reference image?

[@GreenAppelPie]

I still like 1111, but comfy is growing because of how you can load workflows

[@GenoG]

I hated the thought of ComfyUI, but after a couple of days I realized how much more intuitive it is than A1111... If something goes wrong during an A1111 gen, you have to be a "terminal genius" to figure it out... but Comfy shows you what's wrong and actually allows you to literally "connect the dots" better... Pun intended!! Yes, there are still some things missing (easy ADetailer!!) but I'm liking it and I didn't think I would. My 2 cents!! 🤓

[@leonardomonteiro298]

Thank you so much, especially for the GGUF, not having enough VRAM is like gambling, sometimes it renders in 2 minutes, sometimes it stucks loading because system is running out of memory

[@APOLOVAILS]

Hey olivio ! One question : is it possibke to have consisten character with flux and comfy ?

[@marcopineda9507]

Question: what's your GPU and its VRAM? as well as your RAM is 16gb vram on enough?

[@whittone28]

Thank you Olivio, this is just what I needed. ❤

[@guillaumegaudin596]

Hi! Thanks for the video ! How come we cannot choose the method + sampler like Euler + beta for example with the X labs sampler?

[@WillFalcon]

Does it work SD-Forge? No... it does not

[@TheGamingR]

Can you do a comfyui flux inpainting tutorial

[@antoinesaal2372]

Error : No module named 'controlnet_aux' (ControlNet) (I'm using Flux1-dev-Q4_K_S + comfyUI + Controlnet) There is a error during the node "Canny edge" : "Error occurred when executing CannyEdgePreprocessor : No module named 'controlnet_aux' I re-installed ControlNet auxiliary model manually several times, and updated everything. It didn't change anything.

[@KlausMingo]

Watching Olivio while I train my first SDXL LoRA :) How do you show the extension name above the node 6:20? I'm all in with ComfyUI, started with A1111 of course because it's easy, but Comfy is way better and more flexible.

[@mirek190]

you know SDCL is dead? You know Lora training for Flux dev is much easier and you are getting far more better results than with SDXL?

[@KlausMingo]

@@mirek190 For sure FLUX is establishing itself as the new supreme generator. But it's very demanding on the hardware. Don't diss SDXL yet, it still gives amazing results.

[@mirek190]

@@KlausMingo yes but how long ... is much harder to train , is different architecture so can not understand prompt as well as flux, Hardware limit is not a big problem (16 GB cards are getting standard for people who are doing something more than watching youtube) people slightly moving on ...

[@KlausMingo]

@@mirek190 I see. Well for now I'm stuck with 8GB card :(

[@mirek190]

@@KlausMingo I not blame you ;) Probably If you really wanted to play with AI more seriously you would buy some card at least 16 GB. For instance a years ago I changed my RTX 3060 8GB to used RTX 3090 24 GB for 700e ;)

[@kushalsv]

Can you make a video on Forge, now that its soooo much better and has a ton of new features?

[@Velanteg]

Forge control net not support Flux

[@Beauty.and.FashionPhotographer]

Silly Question: its been a while since anyone made an up to date update of which Checkpoint Models can render human faces and bodies the very best in august 2024. You have seen and used so many different ones, which one is your goto model to get 100% real Photos of human beings, disregarding all cartoon stuff in this quest /question. ? is it still juggernaut or realistic or pony? Pony seems to be 10% all cartoon anime in it i saw.... what model would You use? i have tried some Loras of a Singer friend of mine with different checkpoint models. but have not found a number one photo realistic one yet... with or without Lora applied to it

[@futrstory]

Thanks as always! Great information!

[@enespoyraz849]

Does it work with Multi Controlnet? Also does it work with Depth Anything V2?

[@rodrimora]

Isn't a v3 of the controlnets already available?

[@mirek190]

and IP adapter

[@ernstaugust6428]

I used v3 and it works.

[@CoconutPete]

I know this may sound dumb, but am still a huge fan of A1111 and SD 1.5... so many options now it gets confusing. Should I scrap A1111 and move to Flux? Will Forge controlnet work as well as with A1111? Just when you get things figured out, something new comes along lol

[@h4nio575]

Hi! I did everything like you said, but the xlabs folder is not showing up in my models folder

[@AliMzannar007]

same here, did you manage to solve it

[@hotlineoperator]

Word "ComfyUI" and "easy" should not use in same context. Nothing is easy in ComfyUI.

[@mik3lang3lo]

Exactly

[@VitaliyHAN]

Same. I can program using php, golang, js, python, but ComfyUI is much harder. It is better to be CLI than nodes. 😂

[@vannoo67]

I don't understand this sentiment. Comfy is arguably harder to setup, but once you have done so and gathered a repository of workflows, it's easy as cake.

[@hotlineoperator]

@@vannoo67 Until you get error messages.

[@Elwaves2925]

@@vannoo67 What's not to understand, you state the issue yourself - "harder to setup, but once you have it done..." Getting it done is where the problems lie ad the manager only goes so far. Even if you get all the nodes installed it doesn't cover models and errors after that. You've basically said that driving a car is easy once you have it built and running, while passing over that you start with a pile of parts on the floor. I say this as someone that uses Forge and Comfy.

[@MarkHuffman-q8m]

i started comfyui with all the recommended setting but still getting failed to allocate (low VRAM), despite have 16GB of VRAM on my 4070ti. Is there another method to resolve this?

[@manchumuq]

ComfyUI for FLUX, everything else Fooocus, especially inpaints. Tried Forge to work with FLUX, for normal use it works like a charm, but whenever lora and others kick in, it starts to mess up with VRAM which leads to being very unrealiable.

[@freneticfilms7220]

I am using Forge. But I have a question: Is Flux really slower than SD1.5 when aiming at higher resolutions? If i want to end up with an 2MP picture, i can render this directly in Flux, SD and SDXL would most likely need to be upscaled or similar techniques. So lets say 1920x1080 render in Flux vs. in SDXL...What is really faster i wonder. By the way no controlnet for Flux in Forge, right?

[@jeremiahmason6127]

so far I like A1111 the most, forge is a little faster but it wasn't working with some of the extensions so not really worth a few seconds faster. just now learning comfy ui and boy is it not comfy to learn lol, I can see it having lots of specific uses but not having images for the loras or models is annoying since many are named random things and looking at a picture, list of tags, and having a direct link to its civitai page is faster and more plesent to use in A1111 than trying to rename a bunch of loras to make sense in comfyui

[@ryusuikagaku]

can we combine it with inpainting?

[@mehmetalirende]

how can we control 2 loras, separately. especially if it is 2 person, and each of them has own lora?

[@siroandrearoncadin3028]

also interested to know this

[@asaassas1883]

I am not able to download or install controlnet for stable diffusion, neither on my PC nor on my laptop I also tried it on my friends laptop, and it didn’t work Is it because of antivirus? Have anyone faced similar problem? Need help

[@virtual5754]

With all this flux hype I would very much appreciate tutorial on how to easily install more vram to be able to run it at all.

[@craftygames]

lol. dude you need money to get more vram. you buy it, buy a better gpu. you can't install vram.

[@Elwaves2925]

The only way to get more VRAM is to buy a graphics card with more. There are tons of tutorials on YT about how to do this.

[@dbusmire]

@@craftygames we can download rrraaammm?

[@benoitcorvol7482]

Comfyui definitely !

[@unreal_unit]

So you cant Control the Denoising strength right?

[@jason_slab]

Thanks for the vid, anyone know how to use img2img and controlnet with the Xlabs sampler?

[@jasonstetsonofficial]

FORGE FOR THE WIN

[@angryox3102]

Just looked it up, looks so much easier. Will definitely give it a try this weekend

[@garen591]

Is this outdated now that Union Pro control net is out?

[@mirek190]

Can you test IP adapter for flux?

[@kesmeby]

I'm surprised how little I've heard about Swarm or Forge in the past 6 months. Does anyone out there use them for their daily driver?

[@4thObserver]

I use Forge Daily. It's been recently updated for Flux, It's new NF4 feature Marginally increases SDXL 1024x1024 generation speed. Flux is still kinda new and is why I haven't jumped on it, Too many caveats to Flux's usage such as being a bit dependent on ComfyUI.

[@SpikeColgate]

Yeah, Forge is great and being actively developed again. But, ControlNet for Flux not totally implemented as yet, but hoping that gets sorted very soon.

[@mirek190]

@@4thObserver nf4 is already outdated. Use Q4 or better Q4k_m

[@mirek190]

@@SpikeColgate ComfyUI has controlnet and IP adapter already for flux ;)

[@aivideos322]

Just need animate diff now and we have a new 1.5. :P

[@JDM-79-TF]

Everything seems to work fine for me, but I'm getting no image, just a black square. Any ideas...?

[@OlivioSarikas]

did you update comfyui and all custom nodes?

[@JDM-79-TF]

@@OlivioSarikas I did, and the issue was trying to speed things with the fp8 version of Flux. I switched to the full fat one and it worked!

[@choppergirl]

I never got ComfyUI to do anything... at all... not even run the demo project... so I just installed FLUX with Pinochio Not a whole lot of options with the web UI that way... like a way to pass it an image to base its generations on. Most of these AI user interfaces and installers... are incredibly... not well thought out, and getting more fractures and spreading out as tree branches to be abandoned... every day. They're all their little fiefdom isolated tools, and not building one big single AI, and then adding talents to it...

[@parthwagh3607]

can we use flux dev controlnet for schnell model

[@Dany-w3g]

Foocus and Forge!

[@cekuhnen]

AllI read is that this is Flux Dev controlNet and not Flux Schnell.

[@hugo_leveille]

For some reasons, its works but all results looks like a painting, not photo real

[@AlastorsNight]

I will have to see about installing the low memory models as I can not any renders to complete as I keep getting the "torch.cuda.OutOfMemoryError: Allocation on device" error. This is with a fresh install on a computer with a nVidia 3080 with 32GB of ram.

[@pieugedher257]

Thanks, unfortunately, I only have 6 VRM

[@MillennialKiwiGamer]

WHY are there 4 prompt boxes? What do they do? Ugh

[@Velanteg]

Is it possible to use control net without xlabs sampler? Its very bad and image looks fried like with very high CFG.

[@mirek190]

should works already stock controlnet from comfyui ...

[@noonesbiznass5389]

Just turn down the true_gs (true guidance scale) parameter to 1 or less...

[@Velanteg]

@@noonesbiznass5389 Than happens same what if set cfg to 1 in normal SD - image becomes pale and dark.

[@Kvision25th]

Input type (torch.cuda.FloatTensor) and weight type (torch.cuda.HalfTensor) should be the same error from MIdas Depth Map :( dont know how to solve this :(

[@Kvision25th]

NM restart fixed it...

[@jcvijr]

I use ComfyUI 30% of time, but still use A1111 70% of time.

[@HemantkumarSharma-n1s]

Rtx 3060 8gb vram.....flux won't even move forget about flux controlnet😢

[@Dany-w3g]

I'm using Forge. I have an rtx 3060 12 GB, all models work.

[@TBjunk25]

Flux is cool but it’s like 10x slower than SD 1.5

[@MayOkataChan]

uh what about a forge tutorial please?

[@ShadowWind82]

No folder, that shold be at 1:53 . Done, and redone couple times. Not work.

[@electronicmusicartcollective]

CUSHY with Comfyui

[@RayneBlood]

forge, its just faster and easier to use

[@MillennialKiwiGamer]

Ugh another Comfy tutorial. Dislike. ForgeUI is better

[@aivideos322]

lol

[@chrisbraeuer9476]

Comfy is way better, because you can sell workflows...

[@JieTie]

Next vid on how to train custom lora for flux? :) locally :D

[@perfectionatic]

ComfyUI