Advanced AI Sketch to Image: Style transfer with comfyui and IPadapter

[@paafuglify]

at 3:30 you say download a control net and go to the link, but its not the file you use in the video ? Where can i get the control net line art ? thansk for a good vid.

[@Jeanschwarz_]

Very good tutorial, my friend! A question: some lines in the final drawing come out crooked or erased. Is there a way to fix that? Thank you very much!

[@eduardorodriguez9277]

mind sharing the Workflow file?

[@Nibbarese7]

i get an error saying Clip vision model not found

[@АлександрКушниров-я3к]

Please share your workflow. Thank you!

[@artemnikolski3197]

Only issues using this manual. Lineart model, inadaptee etc. Any début UPD ? Please

[@shamsfx]

I have inatall contrelnet model but its not showing f16_lineart model not showing

[@mrmuffyman]

does the controlnet input image have to be a sketch? i saw u uploaded a sketch and then turned it into lineart. can u upload a photorealistic img and turn it into lineart?

[@shamsfx]

Hello Brother can you please provide the workflow to download.

[@filipposcalisi5805]

THe ksampler is outputting a black image if I use juggernaut xl and realistic lineart controlnet for sdxl, but it doesn't if I use sd 1.5 models, why?

[@centner86]

Can you place link to chekpoint model, please?

[@Urban_Decoders]

I have added all the links to the models, ipadapters and controlnets now in the description. For the Model checkpoint i used the juggernaut xl as it is one of my favourite but you can use any SDXL model: civitai.com/models/133005/juggernaut-xl

[@alejandrogalindocruz]

@@Urban_Decoders Thank you so much 🙂

[@simonmcdonald446]

My computer gets so slow half way through that its impossible to complete, without waiting hours, maybe days... Not sure whats to hogging the VRAM. Stuck now.

[@tigerlee-kz3if]

ControINetLoader Error while deserializing header:MetadatalncompleteBuffer

[@Lveddie]

can share this workflow, pls

[@midiablackbox6316]

Error occurred when executing IPAdapterUnifiedLoader: IPAdapter model not found everything is already updated. I checked the paths. it's nothing ;(

[@content1]

This maybe because you need to download the model but place it not in the Checkpoint folder but in a folder named "ipadapter" If this folder dont exist in your folders, you need to create it.

[@edumaganto]

Thank you for the tutorial. I have installed the Ipadapter Plus node that you mention, but then I cannot find them within Comfyui, Ipadapter Advance, and Ipadapter Unified Thank you very much

[@Urban_Decoders]

Try updating the ipadapter plus node and also try installing the "comfyUI essentials" custom node too from the manager. In the manager you can also go to install models and install CLIPVIsion models for the ipadapters there.

[@edumaganto]

@@Urban_Decoders thx it works! ^^)

[@caramelizedtofu3079]

Tried it on juggernaut xl lightning but the results were not realistic, sort of like a clay. Can we have a chat for this? Thanks!

[@Desleiden]

Amaizing!! Thank you soo much!!

[@hamzehalthweib8931]

Thanks for the tutorial, i made same workflow but i got error by executing Ksampler ( Shaps cannot be multiplied) , have you any idea what it could be? thank you

[@Urban_Decoders]

It may be to do that you are mixing SD1.5 models, controlnets, ipa adapters and checkpoints with SDXL ones. Could try double checking that all the models loaded are for the SD 1.5.

[@hamzehalthweib8931]

@@Urban_Decoders thanks for the hint , i used a wrong Controlnet model. thanks for this tutorial keep it up

[@ilgaraziz]

Hi, I'm getting the error "Error occurred when executing IPAdapterUnifiedLoader." I've followed all the instructions and read through the comments, but I'm still unable to resolve the issue. I would appreciate your help. Thank you!

[@Urban_Decoders]

The nodes regularly get updated and sometimes causes the nodes to break unfortunately. Could be a few possible fixes. You could try Update All in the manager, and re- download all the IP Adapter files making sure they have correct names and locations. Make sure to have a folder named "ipadapter" inside the "model" folder.

[@itskittyme]

@@Urban_Decoders I have the same issue as everyone else, and I do have an "ipadapter" folder in my models and it's filled with all models I could find, so it has 10 files inside it... But I still get the error: "Error occurred when executing IPAdapterUnifiedLoader: IPAdapter model not found." I don't understand.

[@itskittyme]

@@Urban_Decoders I've finally managed to fix the error. Apparently, I was missing 3 more of the required models in my ipadapter folder, once I've installed them as well, the error went away.

[@shamsfx]

@@itskittyme Can you please send ipadopter model link

[@itskittyme]

@@shamsfx Sorry I only played around with this AI image generator stuff for one day and I have NO idea anymore what any of these comments, even my own comment here, even means >.< so can't help you sorry

[@shamsfx]

Can share link to download workflow.

[@АлександрКушниров-я3к]

Please share your workflow. Thank you!

[@felizberto12]

I’m having trouble with the Line Art Preproccessor, an error message shows saying it cannot find such file or directory. I’ve already uninstalled and installed again. Do you have any idea on how to fix it?

[@Urban_Decoders]

You will need to download the sd1.5 line art preprocessor and paste in into comfyui/models/controlnet or you can go the the manager, custom nodes search control nets and select control net preprocessors. It will download it into your directory.

[@azadarhussain4808]

@@Urban_Decoders from i can download it link please

[@Valgrum]

@@Urban_Decoders Where can we download the sd1.5 line art preprocessor,? I am unable to find anything to download with that description.

[@Демьян-к3п]

Is it suitable for clay render instead of sketch?

[@Urban_Decoders]

yes, same workflow just would recommend using a different control net (maybe depth) for voumes if you don't need details from your input image.

[@billkage4279]

I'm mainly use ComfyUI (local) for FLUX. But when I saw you video, I tried this IPAdapter SDXL workfllow. I encountered some node errors when executed (Queue Prompt) the workflow - Clip Vision error, Controlnet Preprocessor errors, and IPAdapter errors. Did some troubleshooting for a while but eventually solved the issues.

[@ibrahimdahab6037]

I have this problem: IPAdapterUnifiedLoader ClipVision model not found.