L2: Cool Text 2 Image Trick in ComfyUI - Comfy Academy

[@OlivioSarikas]

Update: I limited the Workflow to only what is shown in the video, so it is more focused on the Lecture

[@ceelentzpotter2110]

the ComfyUI can't find AV_ControlNetPreprocessor even after I fully install and update as the Manage tab said.

[@CoolSongsweekly]

Same issue! Even on the openart server@@ceelentzpotter2110

[@TheGalacticIndian]

@@ceelentzpotter2110 I have the same issue unfortunately🤷‍♂Solved it by and replacing AV_ControlNetPreprocessor with (right clicking on empty canvas space) Add Node/ControlNet Preprocessors/AIO Aux Preprocessor. Works like a charm👍

[@LunarFerns]

@@TheGalacticIndian thank you so much!

[@TheYules]

same here@@ceelentzpotter2110

[@jesterjunk]

(( 4:24 )) Preview images DO save, but they save to the /temp directory instead of the /output directory. The saved preview images also still include the Workflow metadata. They remain there until ComfyUI is restarted, then that folder is deleted with all its contents.

[@imagineArtsLab]

Thanks a Billion Olivio! Helping Artists and Creatives become more efficient in technology

[@nikgrid]

I'm starting to see the benefit of comfy. Thanks Olivio! Excellent stuff

[@kirillkhomenko_]

I like the way you explain it. It's very simple and straightforward. Thanks

[@Pguzpet]

This video is pure gold, thank you very much Olivio Sarikas.

[@madhudson1]

everytime i watch a video with added functionality for comfyui, in this case it was the control net stages, i'm blown away with the potential of these workflows

[@tyegold2020]

Nice! Really getting into this now, love how calm and easy your voice is, makes it so easy to follow.

[@Atreyuwu]

Definitely some assumptions left to be made by the people jumping in at this point, but I like learning that way. Rather than download the workflow, I challenged myself to fill in the gaps and figure it all out on my own and learned quite a bit in the process. Took me a while to figure out how to get the preprocessors and controlnet models installed - especially given my setup is a little different as I am running ComfyUI via the ModelSurge Auto1111 extension, and I have my models in a non-standard area outside of my WSL2 filesystem; but here I am 3 days later and I got it all working swimmingly, with extras!!! Thank you for the wonderful tutorials @Olivio. You are appreciated. :)

[@TheGalacticIndian]

Please share this apparently secret knowledge - how to get the preprocessors and install ControlNet models?

[@myhlow]

@@TheGalacticIndian Install the following custom nodes: Comfyui controlnet auxiliary preprocessor comfyui-art-venture

[@myhlow]

​@@TheGalacticIndianInstall the following custom nodes: Comfyui controlnet auxiliary preprocessor comfyui-art-venture

[@myhlow]

Install the following custom nodes: Comfyui controlnet auxiliary preprocessor comfyui-art-venture

[@myhlow]

@@TheGalacticIndian Install the following custom nodes: Comfyui controlnet auxiliary preprocessor comfyui-art-venture

[@alfanynicrose2191]

your way is simple to follow , thanks for making this easy to understand , your doing a great job , thank you Olivio .

[@sebastiansonntag9251]

Wow, I'm just informing myself about the functionalities of ComfyUI, but after just seeing this (without having it even installed) I can't wait to start. It's just fantastic - also the way your'e explaining this kind of complex canvas, thank you, man!

[@XuRZaL]

Thank you, this has been so helpful. ComfyUI is very user friendly once you get past the learning curve (which you have shown me), and you have absolutely made that curve so much shorter. On to L3!!!

[@jacobsmithps]

just learning comfy and went to the site, found you but can't find that workflow. I do find you a lot easier to listen to and learn from the most so thank you for making all of these i know i'm gonna be watching and re watching these a lot.

[@chiptaylor1124]

Olivio, thank you so much for your tutorials!

[@aivideos322]

If using aux preprocessors just use aio preprocessor and choose midas or the other depth maps. Olivio here is using default controlnet. They can both do the same thing.

[@SaavedraCG]

I don't think Node Preprocessor

[@MikevomMars]

4:00 - It'd be helpful if you explained WHY one should use a custom VAE instead of a checkpoint's built-in. Actually, NO ONE ever explained this so I am wondering about hat until today 🤔

[@ethanhorizon]

This. Anyone?

[@구원자님]

Custom VAE is by choise of course. Some models have baked VAE, so they don't require a custom VAE. But still you can use it. I'm new to Comfyui, but let's say you use Dreamshaper 6.31 VAE baked checkpoint in A1111; you can either use an additional VAE or you can set the VAE to Automatic.

[@MikevomMars]

@@구원자님 That should be clear to everyone - the question, however, is: are there any ADVANTAGES in using different VAE's and why not using the baked-in ones?

[@joskun]

​@@MikevomMars That's such a great question and my guest is for instance maybe you have a VAE trained specifically on Cyclops from X-men and also the style (realistic, cartoon, 3D etc.) so it would make obvious sense that the custom made specifically for Cyclops would actually be better give better results. Am wondering if that's when the Adetailers (specific in recognizing specific part of an image or removing them) would come in yet I think those maybe called embedding and maybe totally different thing

[@ocplan_dbo]

Amazing for beginning and understanding concepts, thanks :)

[@구원자님]

5:37 I wrote the same prompts and almost got the exact results like you, how cool is that 😄

[@SirMannyOfStyria]

Vielen lieben Dank für deine Videos. Du erklärst alles perfekt und sehr verständlich.

[@amarmayekar7795]

Thank you very much Olivio Sarikas

[@HermanOnof]

tanks Olivio for your free tutorial. But more than anything you´re describing what to do more than explaining what it does

[@Richard-x5y5k]

Thank you, your tutorials are great. I'll have to checkout controlnet videos next.

[@admireruk]

Nice vid, If you set the seed to the same fixed value on each sampler and set to progress by one each time. You are going to get more consistency between images.

[@fabiotgarcia2]

How can I add the Controlnet Preprocessor since its not appearing on the list of nodes?

[@Shisgara77]

I had the same problem. But I think I solved it - in Manager in Custom Nodes I uninstalled and reinstalled the Art Ventura Custom Node used in this tutorial and all preprocessors appeared after refresh)))

[@bonechieftain]

@@Shisgara77 this seemed to work for me as well. instead of double clicking and typing the search field for controlnet preprocessor, i right-clicked art venture,->loaders-.controlnet preprocessor

[@vannoo67]

@@Shisgara77 I had a tough time finding this node. I downloaded Olivio's workflow, expecting to have the node marked as missing, but no, it was there. It's just tricky to find in the AddNode dialog when searching for ControlNet. It's actually called 'AV_ControlNetPreprocessor' (I guess AV is Art Venture) Update: I also needed to install "ComfyUI's ControlNet Auxiliary Preprocessors" before I could see more than 3 Preprocessors in the drop down list

[@sethmunich4062]

What is Art Ventura?@@Shisgara77

[@sethmunich4062]

Oh Art Venture!

[@kuromiLayfe]

definitely recommend getting the anything anywhere nodes to help keep workflows clean (you connect a node output to the anything anywhere node and it will automatically connect that output to all inputs of the same type (very useful with assigning models and VAE without having a bazillion lines in complex workflows). Also recommend coloring the text-encode nodes : Green for Positive and Red for Negative (will make it a bit clearer at a distance which is what)

[@OlivioSarikas]

That's nice for your private workflows, but not good for when you want to share them or teach them, because then people can't see anymore where your cables are going. That's why i'm not going to use it in any of my workflows

[@kuromiLayfe]

@@OlivioSarikas It adds a toggle to show/hide the cables (even animates them depending in the type of node it is transferring data from and to) like i said it is for the much more complex workflows that have like a massive logic group going on using multiple ksamplers and controlnets etc)

[@Alex-yi3yw]

Thank you very much for the lesson!

[@tonyblack1981]

No no no! for this level of information I must both like, comment and subscribe

[@Jack_O_AllTrades]

Great tutorial so far. Just the right balance for me of being told what to do and having to look and research a bit to find out exactly what you did to get to a certain stage. My only question so far and probably quite trivial; in lesson one you said to keep everything within the blue outline; however, when building this, my Control Net Pre-processor line sits just outside of the blue outline. Is there a way to increase the size of the work area?

[@torquebiker9959]

a lot of great tipps and hints, thank you!!

[@madsnylarsen]

ohh man, i wish you had shown the entire build flow, the suddenly jumping in progression it's very confusing, especially when you are learning, while you point at a node and explaining what it does my focus is struggling with figure out how we got there, how i can get to that point, where each of the lines goes, what is an VAE, what is a controlnode etc. meaning there's very little attention on what you are trying to teach, if you instead had build it together with us,, isolated the function like explaining controlnet before using it in a larger setting, it would be way easier to follow along and learn... sorry if i am a bit harsh in my critique, i am just a little dissapointed since i looked forward to follow this series, i enjoy your work and have a ton of fun following how you explore the realm of AI :), now i'll watch the video again a few times.

[@RachelESmith-dj3dq]

Did you watch the first lesson of the series before this one? He starts with a blank slate there.

[@DerrickDJ]

@@RachelESmith-dj3dq I agree, I watched the first video and I don't have the Preprocessor option.

[@myhlow]

Install the following custom nodes: Comfyui controlnet auxiliary preprocessor comfyui-art-venture

[@vpakarinen]

Very nice, i learned the basic use pretty quickly.

[@cemilhaci2]

Thank you for an understandable and fluent education. How can I preview the recorded images in the interface? They appeared in the section below in some of the trainings I watched.

[@majinvegeta5393]

Thanks for your lesson, it helps a lot, thanks !

[@gwcstudio]

Super useful, Olivio!

[@Fiercesnake1994]

It would be really helpful if you would show how to set up comfyUI properly. Like install the models and comfyUI itself. :)

[@Bullitain]

this is the 2nd lesson, he did all that in the 1st

[@arieldrach809]

@OlivioSarikas I followed the first video and I'm trying to follow this video building the node but I don't have any checkpoints. What I'm missing

[@universesson2007]

@@arieldrach809 I have the same issue, not sure where and how to install new models outside the Manager.

[@Blaqk_Frozste]

@@universesson2007 did you work it out yet?

[@universesson2007]

@@Blaqk_Frozste Yes I found a KZbin course where the teach you how.

[@wolf63tot]

Merci pour ce partage !!!! Vous êtes génial !!!!

[@phaylali]

this video explained perfectly the superiority of comfy ui , and made me give up on vladmandic automatic

[@zizhdizzabagus456]

great course, thank u so much. i was alright with autmatic 1111 but comfy was not easy to understand

[@dxnxz53]

Thank you for the video! Where can i get the ControlNet Preprocessor Node ?

[@myhlow]

Install the following custom nodes: Comfyui controlnet auxiliary preprocessor comfyui-art-venture

[@annavendemia9127]

Thank you for these lessons Olivio , they are very clear and quite easy to follow for a beginner. There is a problem with the ControlNet Processor in the workflow, both launched on the clud and run locally. It doesn't seem to be working anymore, so after the first generated image the othes can not follow. can it be reaplced with something else?

[@shtogie5972]

I'm following along but running into a speedbump @9:00. I can't figure out which node to load in place of the "Controlnet Preprocessor" Node. That node does not exist in my environment and I instead have a package called Controlnot Auxillary Preprocessors, yet I still can't find any node similar to the Controlnet Preprocessor Node with the CNET_Name output.

[@freakyninjaman3]

I ran into the same problem. With ControlNet Auxiliary Preprocessors installed, search for "MiDaS Depth Map" (or right click the workspace > Add Node > ControlNet Preprocessors > Normal and Depth Estimators > MiDaS Depth Map). This node will accomplish the same result as the tutorial (I just kept the default settings). I'm not sure what Olivio used to get that ControlNet Preprocessors node. Let me know if you figure it out :)

[@sunl3583]

use MiDas Depth Map as substitute for the ControlNet Preprocessor, the rest is the same

[@moky4mido]

@@sunl3583 and where the output goes?

[@nowerameditationmusic3256]

@@sunl3583 Thank you, this worked for me. Note that you also need to google the control depth fp16 model safetensors and download it to get it to work.

[@fabiotgarcia2]

MiDas is not connecting with the VAE Decode@@sunl3583

[@jccluaviz]

Thanks for your awesome video, my friend. Just playing around with nodes. Connected the latent output from the first Ksampler to the input latent from a second Ksampler and lowered a bit the denoise from this second Ksampler.Found that gives me some similar results to use contronet adapters. The question is ... using those contronet adapters gives us more consistency making the result look more similar at the original image ?. Thanks for all

[@evertonfagner]

fantastico. obrigado por compartilhar conosco.

[@swanidhi]

Very structured and practical. Thank you Sir!

[@LunarFerns]

Thank you for the video! It was tricky to understand how to install everything, but I did it

[@sethmunich4062]

How did you install Controlnet preprocessor and the control_depth-fp16 model?

[@LunarFerns]

@@sethmunich4062 to instail model you need to put the file here ...\ComfyUI\models\controlnet and for controlnet preprocessor you need to open manager and find custom node ComfyUI's ControlNet Auxiliary Preprocessors from Fannovel16 Let me know if this doesn't work

[@myhlow]

Install the following custom nodes: Comfyui controlnet auxiliary preprocessor comfyui-art-venture

[@akashkarnatak6581]

Doing gods work

[@canehoyer]

Where do I get the dreamshaper models? Can't find them in the manager. And what models would you suggest today?

[@MysticEthereal]

A silly question, How do you download the Dreamshaper 8? A - Inside comfyUI >>> Install Custom Nodes B - Inside ComfyUI >>> Install Models C - By visiting the Civit A.I D - None of the above *Please reply honestly 🙏✨

[@pepschp5355]

There is another instance, where your workflow may be very important. Sometimes seemingly small prompts can change your image in a way you don't want to, because the model was trained that way and has some prejudicess. With your workflow you can circumvent the models prejudices and can approach your imagined outcome step by step.

[@dimitrilucy]

I love your tutorials, thanks for that ! sooo Useful ! I have a issue and I don't know how to fix it : When I try to open your graph, I have a error : When loading the graph, the following node types were not found: AV_ControlNetPreprocessor This 3 packages are installed : ComfyUI's ControlNet Auxiliary Preprocessors ComfyUI_Comfyroll_CustomNodes ControlNet Auxiliar

[@edwassermann8368]

very useful. thank you.

[@maxcoteclearning]

Great stuff. Thankyou :). my comfyUI loadCheckpoint is empty. I do not see any dropdown options in there. Do i need to install any dependency?

[@ogrekogrek]

Thank you Olivio for tutorial. What is difference between Batch_size and batch count.

[@lefourbe5596]

Batch size : generate images in a all in one batch. Use more VRAM but is faster. Batch count : generate a number of image one after the other. Use the same amount of VRAM but is slower. You can combine them both.

[@ogrekogrek]

@@lefourbe5596 thank you

[@workplaydie]

It says I don't have the AV_ControlNetPreprocessor node when I load the workflow? Edit: It might be really nice for the beginners for you to note that you are using custom nodes & that openart lists custom nodes and links the repositories. It took me a while to it figure out!

[@MeowCatPaw]

Sorry, I failed initially, ckpt_name is always "undefined". I have step by step previous L1 to install both ComfyUI and ComfyUI Manager and also those modules you suggested are very useful. I have also edited the "extra_model_paths.yaml" base_path to sync my ComfyUI folder path. Should I install some new "Custom Nodes" from manager? Thanks.

[@myhlow]

Install the following custom nodes: Comfyui controlnet auxiliary preprocessor comfyui-art-venture

[@helloRick618]

so cool

[@postnuka]

As an Houdini, blender, and fusion user I kindly advise you to flow your node left to right. It is very hard to read what connect what with top to bottom workflow.

[@FashionProduct731]

Hi, thanks a lot, this is so helpful! Who else is getting this error "mat1 and mat2 shapes cannot be multiplied (154x2048 and 768x320)" K Sampler when trying to do the controlnet depth image variations? Can someone please help 🙏

[@vpakarinen]

Problem i been having is not only to get consistent face but also a body, i guess depth map can help with that 👍

[@greathawken7579]

Thank you

[@PlayerGamesOtaku]

Hi, I would like to copy a photo via comfyui, how do I do it?

[@OrlovIV]

i have a list of checkpoints and how do i guess next time wich resolution and aspect ratio for each model?

[@_carsonjones]

Following along with this and the Controlnet Preprocessor seems to be obsolete. Any suggestions for an updated workflow that achieves the same / similar output?

[@matale66]

Same here. Trying to install comfyui-art-venture custom nodes but install is failing. Did you find a solution?

[@zeezo34]

At 0:58, when i let go of the cable, there is no drop down available.

[@detleff.artist6534]

Hello, what means this.lastNodeErrors is undefined?

[@Lucas-vc7xq]

How important is the spelling of your keywords when it comes to generating your desired output? I noticed in the video that you misspelled "digital paiting" but it did seem to work anyways?

[@martinhoneves]

I am using comfyUI inside Stability Matrix. I do not have installed ControlNet Prepocessor and I can't find it on the custom nodes manager. Is there anyway I could find the missing nodes?

[@anshulkshirsagar8200]

How can the workflow be used for marketing purposes?

[@youtubeccia9276]

excellent

[@Vestu]

UPDATE: It started working when I uninstalled some Aux...somethingsomething... preprocessor custom node I had installed some time earlier. Then restarted ComfyUI, then REINSTALLED it, restarted ComfyUI and now it works. I get an error saying "Error occurred when executing AV_ControlNetPreprocessor: 'resolution' is not in list" on the lower-most workflow.

[@WilliamNordmann]

that helped thanks

[@Vestu]

​@@WilliamNordmannthanks for letting me know it helped

[@tconmonreuf]

Hey! where can I find the different images if I queue multiple at once on the cloud application?

[@samwalker4442]

Might be a dumb question as just learning...Why would you use a different VAE and not the one within the model? Just for variation?

[@samwalker4442]

p.s. great lecture...thank you

[@YING180]

don't know why the image is strange, eg: the car has more than four lights or wheels. is it the problem for the prompt text? appreciate for your kind reply ...

[@HypeStrike]

Got stuck at the dreamshaper part it's just greyed out. Not sure how to get the model.

[@kevinwang7340]

I can not find contronet Preproccessor in my comfy UI, can you please explain how that part is done ?

[@pastuh]

Someone mentioned, install extension by: comfyui-art-venture And choose: AV_ControlNetPreprocessor Also required: ComfyUI's ControlNet Auxiliary Preprocessors It will allow to choose preprocessor models

[@ZaindTV]

hey! i love youre content and channel! Thank you for work and keep going!

[@dschony]

Do you have any hints for us, where to get the Controlnet Preprocessor? In my Model Manager there is nothing with this name available. I'm using ComfyUI within A1111 v1.9.4

[@dschony]

Yeah found it: comfyui-art-venture

[@myhlow]

Install the following custom nodes: Comfyui controlnet auxiliary preprocessor comfyui-art-venture

[@dschony]

@@myhlow Thank you. In the meantime I'm using the standalone portable installation, which is much more reliable. I don't know, why I didn't had the controlnet auxiliary preprocessor in the managers list while using the A1111 ComfyUI extension. Now I've got it.

[@nuejidub]

i can't find the controlnet preprocessor - instead i sent it to MiDas Depth Map directly. The preview image looks similar, but it won't work after that.

[@OlivioSarikas]

you need the preprocessor, otherwise it is useing the color image and not a depth map. if you have the comfyui manager installed, you can install missing nodes with it very easily

[@ist1jano]

@@OlivioSarikas The ControlNet Preprocessor got a red border indicating an issue, which is "depth_midas" is missing. How to fix it please? I run it in the cloud. Thanks and for the great tutorials too !

[@nuejidub]

@@OlivioSarikas thanks! that worked for me!

[@bobacks]

@@OlivioSarikas I just can't get this to work. It shows RED in the manager.

[@neema2117]

For people who have problem installing "ComfyUI's ControlNet Auxiliary Preprocessors" in comfyUI with this error: "install failed: ComfyUI's ControlNet Auxiliary Preprocessors" Solution: I disabled 'comfyui-art-venture' (if installed), then I installed 'ComfyUI's ControlNet Auxiliary Preprocessors' and re-enabled 'comfyui-art-venture'

[@shshsh-zy5qq]

hey Olivio thank you for the amazing tutorials! I am following this tutorial and I keep getting Error occured when executing CheckpointLoaderSimple: Error while deserializing header : HeaderTooSmall

[@TwoStepToHeaven]

I pressed control shift V but it just copied out but can't have these wire connections? Tell me why it doesn't work

[@CsokaErno]

Unfortunately I don't have any "checkpoints" and I have no idea how to download or install them :/ So, it simple doesn't work for me.

[@VanJeans]

I've installed the workflow and am attempting the controlnet part of it, it generates the first image but then does nothing else, have I missed a step before the controlnet part of it? Nothing shows up in the ControlNet Preview image

[@ethanhorizon]

9:37 Apply ControlNet - the strength is tone down to 0.83, any special reason? What if I use 1 or more than 1?

[@MrKairot]

I downloaded your workflow from OpenArt, but the images are coming out very blurry. I didn't change any settings.

[@warlord8106]

I tried this, but ran into an error. After it loaded the first image, the process stopped and I got a message saying Ksampler "nontype" object has no attribute shape.

[@samsaraAI2025]

How can I do the Shift+Crtl+V in Mac is not working.

[@iulianbabulea4997]

I do not have the manager option visible, how can I fix this?

[@sntshkmr60]

I can't find the ControlNet Preprocessor node. What am I missing?

[@sntshkmr60]

I downloaded the image, installed missing plugins, but now I'm not getting different image with different prompts. All appear the same.

[@RadTechDad]

My KSampler keeps showing the preview. How did you hide it?

[@ChristopherLensing]

I had the problem with the preprocessor but solved it via reinstalling art venture. But now, the only preprocessor I am able to select is "tile". I installed the models, also linked my A1111 controlnet-models and also copied them into "models/controlnet". Nothing helps. No preprocessors. Any ideas?

[@lennoyl]

I had the same problem. I solved it ( thanks to the guys in the comments on Olivio's workflow download page). you have to install, in addition of the art venture node you installed, the 'ComfyUI's ControlNet Auxiliary Preprocessors' all the controlnet models will show after that.

[@sethmunich4062]

Worked for me too. this needs more likes!@@lennoyl

[@GogiRizhvadze]

I did it yeee!!!

[@shubenoprod]

hi! I got an error whe i use the control net " deth-fp-16" 😢😢

[@israeldev9939]

how can i download and use controlnet preprocessor, i'm unable to find it

[@myhlow]

You can try installing the following custom nodes: "Comfyui controlnet auxiliary preprocessor" and "comfyui-art-venture".

[@myhlow]

You can try installing the following custom nodes: "Comfyui controlnet auxiliary preprocessor" and "comfyui-art-venture".

[@walidflux]

how can i add my own lora to the workflow

[@ArifHidayat21]

when i render it,,, why in my comfyui... result is the woman holding bag, and when i render again she is holding smartphone... why it is?? pls help me sir :)

[@daniellykke5725]

man i really dont like you dont show how to get to the ControlNetPreprocessor

[@64kernel]

As a side comment, it's useful to use a different seed for every instance of the Ksampler or you'll get practically identical results.

[@evertonfagner]

so frustrating. I'm stuck trying to get any ControlNet Preprocessor to work, and to no avail. one error after another, several installations and solutions, and nothing.

[@myhlow]

Try installing the following custom nodes: Comfyui controlnet auxiliary preprocessor comfyui-art-venture

[@myhlow]

Install the following custom nodes: Comfyui controlnet auxiliary preprocessor comfyui-art-venture

[@myhlow]

You can try installing the following custom nodes: "Comfyui controlnet auxiliary preprocessor" and "comfyui-art-venture".

[@acezgaming2793]

how can i install checkpoint? I have a mac