ControlNet GAME-CHANGER: Reference Adain BEATS Reference Only - THIS IS SO GOOD

Discover the power of 'reference_adain+attn' in ControlNet! This video reveals how 'reference_adain+attn' outperforms reference_only in image generation. Witness the superior performance of this new preprocessor in creating stunning images that closely resemble the input inside stable diffusion
Socials 📱
- Instagram: / lemonscript.io
- TikTok: / lemonscript
- GitHub: github.com/lemonscript101
Timestamps ⏳
00:00 | Introduction
00:11 | Updating to newest ControlNet version
00:44 | General Stable Diffusion settings
01:08 | ControlNet settings
01:41 | Prompts
02:20 | First render with new method
02:55 | reference_adain+attn vs. reference_only
04:51 | reference_adain+attn settings
The reference image is a Photo by Andre Sebastian: unsplash.com/@andreonbrand?ut..." on Unsplash: unsplash.com/photos/3_I3GXWld...
Negative Prompt
((((ugly)))), (((duplicate))), ((morbid)), ((mutilated)), [out of frame], extra fingers, mutated hands, ((poorly drawn hands)), ((poorly drawn face)), (((mutation))), (((deformed))), blurry, ((bad anatomy)), (((bad proportions))), ((extra limbs)), cloned face, (((disfigured))), gross proportions, (malformed limbs), ((missing arms)), ((missing legs)), (((extra arms))), (((extra legs))), (fused fingers), (too many fingers), (((long neck)))
#ControlNet #stablediffusion #AI #Technology

[@w1nterblind]

Automatically subscribed when I heard you be the only StableDiffusion KZbinr to pronounce "Euler" correctly

[@vixenius]

Cheers bro

[@SungJinWooh]

thank you! I have been using reference_only but this one has helped me!

[@lemonscript]

I'm glad I could help you out! 💛

[@nicolaslascar215]

thanks bro. keep it going!

[@JusZish]

Nice one. Thnx for the highlight.

[@lemonscript]

You're welcome! Always happy to be helpful !💛

[@mik3lang3lo]

I like your enthusiasm, just like a child playing with his new toy

[@makers_lab]

Thanks for showing the reference feature, yet another feature to explore! Maybe you tried them and preferred without (the results were certainly nice), but the model creator suggests orangemix, kl-f8-anime2 or Blessed2 vae's, so worth a look if you didn't. For initial generations I find restore faces generally worth enabling too.

[@lemonscript]

Hey and thank your for the advice! I will certainly try and experiment more 💛

[@ApathetikkNZ]

if u get ur settings just right when using 'reference_adain+attn' - u can create something very close to ur input image, i havnt managed to perfectly replicate faces but u can get a close likeness

[@suma-xx4jf]

can you share your setting?

[@NowOrNeverAI]

yes please share

[@bunnystrasse]

Share it

[@TheYules]

what is the theme you are using on your interface? it looks so clean!

[@lemonscript]

Hey im not using a specific theme, just basic control net in dark mode

[@lioncrud9096]

what does Clip Skip do? I keep seeing people use it but haven't heard anyone say what it does

[@lemonscript]

Check the comments under the comment of @alonso garrote in this video, @Артем Суворов explained it pretty well!

[@alonsogarrote8898]

Hi there, nice video!, what does that clip skip do? i tried ref only on fantasy cars but could only get blurry nonsense, any ideas?

[@lemonscript]

Hey, thank you! To be honest im not to sure what clip skip exactly does, but I feel like im getting consistently better results with clip skip set to 2. Less wonky eyes etc. About the blurryness, im not to sure if clip skip can help there, did you try out the preprocesser I showed in the video? Maybe that might help. Also try playing with the style fidelity To have the clip skip bar at the top, go to settings -> user interface and search for [info] Quicksettings list. Inside there type CLIP_stop_at_last_layers. Hit save and restart UI

[@JusZish]

Clip skip removes last X iterations of sampling of image. Different X gives really different results. Often the realistic models batter with clip skip 1, when more animated models are batter with x = 2. Anyway, I suggest to try it by yourself to fill on fingertips.

[@ksafan838]

Can you share what your pc specs are?

[@pumanuclei8204]

You never actually added the negative prompts

[@roiyg19]

I mean...nice result but it didn't even get the poster right. It ignored the hand on the face completely...not sure what were you trying to showcase. Still, thanks.

[@lemonscript]

I was trying to showcase that with the new preprocessir its possible to get good results with very short prompts, nevertheless thank you!

[@Wow88z]

@@lemonscript it was a good showcase, most people want a bit of diversity and different ideas anyways. If commenter wanted to keep the hand on the face, they can also use a 2nd control net preprocessor like OpenPose

[@GunnyNinja]

You should try it with no prompts and let it use the source image as your template.

[@wagmi614]

you fooled me with the intro thinking it's going to go from anime to photorealistic and now I'm disappointed so now you owe us a video actual doing that ;)

[@lemonscript]

Hahahaha I can certainly see why you got fooled 😂 Not a bad idea, Im getting lots of recommendations of people take lets say ruffy from one piece and displaying them in a different style e.g realistic or studio ghibli. I will play around with it and maybe release a video if I manage to do it!

[@jragon355]

A bit confused why you would demonstrate with animated characters rather than demonstrating by creating photos more similar to the original

[@lemonscript]

Good point, I tried using realsiticvision, but the results were kinda messy when trying out this preprocessor, similar but werid faces, weird hands etc. So I just gave up on that Idea and went with anime style, but yes you are right, going with a realistic style would be better

[@jragon355]

@@lemonscript tbh I’ve noticed the reference pre processors don’t work too well at recreating people. Sometimes they get close but you need to run through a ton of batches to find ones that really do it. Maybe for animated characters it works better though.

[@otofuefofinho3375]

I didn’t quite get the purpose, you used a photo to generate a painting. Good video nevertheless

[@TanvirsTechTalk]

sorry but i dont see the similarity

[@lemonscript]

Hey, I did not aim for 100% similarity. I'm only showcasing that with the new preprocessor, just providing a single short sentence like "woman with brown hair" is enough to get a pretty similar results. You can of course improve the result by a ton by providing a better description of what you want. Event better, if you try to mimick a picture that you previously generate (say you have the original prompt) you can just take it, plug it in again, change it, and have almost the same character in lets say a different scene

[@TanvirsTechTalk]

@@lemonscript okay cool. But you can create similarity. I tried it. It's really cool. Much like image prompt in MJ

[@Alex-vc8kc]

No similarity. It's a bite.

[@lemonscript]

Hey, thanks for the reply. I think the results are pretty similar, considering I only provided the positive prompt "woman with brown hair"

[@lonesomealeks4206]

i got bored with ai so fast...

[@lemonscript]

Why is that? I find it fascinating