How to make AI Faces. ControlNet Faces Tutorial.

[@sebastiankamph]

Download prompt styles here: www.patreon.com/posts/sebs-hilis-79649068

[@RobShocks]

I've been waiting for this one, epic. This space is moving so fast. Thanks for all the content!

[@sebastiankamph]

You're very welcome 😊🌟

[@sarpsomer]

Because of the advancements in AI; lots of youtubers skipped the control net v1.1. Thanks to you; I have just downloaded some of the control net models that I skipped.

[@sebastiankamph]

Happy my content is helping you. I'll continue to focus on the art aspect of generative AI for now 🌟

[@romac9516]

Thank you for choosing to speak normally and teaching so brilliantly.

[@sebastiankamph]

Thank you for the kind and valuable feedback.

[@KlausRosenberg-et2xv]

Wow, the results are stunning.

[@nothappyz]

Watching this before falling asleep. Good night my dudes ❤

[@ChunkeeMunkee]

I wish I could give you two thumbs up per video - one for the incredible, in-depth content, and one for the supreme "Dad joke"-tier puns!

[@sebastiankamph]

Hah, thank you! 🌟

[@唐秋-s4v]

That's a very detailed tutorial. That's great. Thank you!

[@ObscurelyTitled]

Please make video showing your hardware/software setup

[@Patrick-mg7vv]

Thanks for great info. Btw, people in Dubai don't like the Flintstones, but people in Abu Dhabi do.

[@vincedodge321]

I love all these new tools. It really helps what you want to generate easier instead of just depending on what the AI gives you.

[@preddyshite6342]

Honestly, it feels like owning a car for 7 months then the manufacturer makes a tyre update. AI Art feels unusable without controlnet now.

[@polynightingale3969]

Your tutorials are good and so are those jokes love it.

[@sebastiankamph]

Glad you like them! Thank you very much :) Got a favourite joke?

[@winkletter]

Oh man! When was the last time I remembered to update ControlNet? So many preprocessors!

[@sebastiankamph]

Scroll list is huge now!

[@steinscamus8037]

4:58 yoo, what are these styles? How did you make them?

[@lyonstyle]

another technique added to my workflow!! wooohooo

[@sebastiankamph]

Sweet! Happy to have you aboard the hypetrain 🌟

[@ufukzayim6689]

I don't know How to add more models to Stable Diffusion checkpoint and how to add more styles.Could you please help.Thank you

[@McDowell666]

Bro, this is just what I needed 🌟

[@sebastiankamph]

Glad you enjoyed it! Keep consuming those cereals. But mix in a little fiber in your diet too 🌟

[@McDowell666]

@@sebastiankamph hehe yeah .. I dig your dad jokes at the start of your videos

[@PShi]

Is there a workflow where you can generate a character (and face) to reuse across many poses and settings? And avoid creating a slightly new person each time?

[@sebastiankamph]

Dreambooth + Lora. Or a prompted character sheet.

[@hatuey6326]

great tuto i have only one issue : when i trained a model with a real face and when i want to put the face on a son goku face shouting for example it doesn't work the mouth of my trained model keep closed if you have i trick it would be fine plz !

[@steffen_r]

Great video. But after watching your latest video on ControlNet ReferenceOnly I wonder, if we still need openpose_face. Have you compared the results of both? I could imagine that openpose is more trained/ specialized..

[@randomlyproject]

when i click the explosion icon the preprocessor preview just blank (black) no stick figures, any suggestion?

[@るくるく-d8v]

Thank you for useful information. When I use openpose face, a lots of faces are made for each face dot... How do I solve this problem?

[@sebastiankamph]

Make sure you have both preprocessor and model set correct. Not just 1 of them

[@JM_Traslo]

Could we get this updated to explain what's changed with this? Since there's no face models to download anymore, just the base OpenPose, so I assume it's handled differently.

[@gameofbitcoin5869]

Imagine that you are famous and know person. Then imagine what AI can. You will get answer why face models are less in development

[@timbacodes8021]

More of these please, I subbed and All Bell button hit

[@sebastiankamph]

Glad to hear it! I got lots of ControlNet videos. Check my ControlNet Playlist :)

[@SouthbayCreations]

Great video! Thanks!

[@sebastiankamph]

Thank you for your support my friend! 🌟

[@horus4862]

Another great tutorial

[@SteakOSaurier]

I'm super new to all of this. Are you using A1111 for your personal use or are you using the newish vlad you showed us some days ago?

[@sebastiankamph]

Honestly, both of them. I have a1111 setup the way I want to for videos. Then I play around with Vlad on my own time.

[@IgorDyx]

Hello what are "SD WAE", "ADD lora to prompt" and "add hypernetwork to prompt"? I don't have such options. They are at the top of the window

[@gameofbitcoin5869]

You can enable/disable options in settings, or download SD Web UI Forge

[@MrJohnSnow]

I only ever get multiple heads trying to form a single head or a "The Thing" type of monstrosity... The preprocessor makes the right mask based on the input image, the output images don't seem to care though

[@m.ghazianhindami5834]

@sebastiankamph please answer this, I also got the same problem and have no idea on how to fix it

[@philli7006]

@@m.ghazianhindami5834 I also get the multiple heads. Please help!

[@craigburton4447]

same, doesn't work at all

[@mizuki4155]

for me the openpose_face preview turns completly black.. and doesnt work

[@dziku2222]

same here

[@silfrasjoeld]

Friend, how do I control the direction of the eyes? . Ex: the character is facing the viewer, but the eyes are turned to the side.

[@KentSteinhaug]

Are all the old models for ControlNet now obsolete and can be deleted? Thanks for great tutorials :)

[@sebastiankamph]

Pretty much, yep!

[@mexmax1657]

Is it possible to have a reference-pose-picture and then apply this pose to a picture of my choice? I started with all this AI Image stuff a few days ago and can't wrap my head around all these bars, options, settings, prompts and so on. You really need to have a master degree in programming to make something useful out of it. ^^

[@mostafamahmoud8099]

how u get same face every time?

[@ShayVidas]

great video !

[@sebastiankamph]

Thanks!

[@UyHeangTe]

Your opening dad's joke is just..... 🤣👏

[@sebastiankamph]

Glad you enjoyed it :D

[@HaohmaruHL]

How to work with two sources for ControlNet that have different resolutions? For example Unit 0 source is a portrait of a person sitting, but Unit 0 source is a square photo of a face looking the other way I want to imitate? How do I make it only read the direction of the face from Unit 0 photo and not the whole composition of it being a square with face in the middle? Because I end up with a square portrait of a face instead of a sitting photo I facing the direction I wanted.

[@Great.Milenko]

I couldnt get control net to work, I got it installed, and it gave me the controlnetm2m script but the actual controlnet UI didnt show up. any ideas?

[@leftisthominid2028]

I just can't this to work. I generate an image, I load a face into openpose, and then I re-run the same prompt, seed, etc. The result is identical.

[@otaquid]

it doesn't generate anything once I press "run preprocessor", it just keeps loading with no result. It says "AttributeError: 'NoneType' object has no attribute 'model" in the CMD. Is this because my PC is too weak to process this?

[@chriscodling6573]

I wonder if there is a way to use batch image processing on control net?

[@Artazar777]

Great video, but I have a question. I have the following problem: I have a base image of a girl whose face I want to save, and an emotion of another girl that I want to apply to my base image using image2image. Have you had any luck applying the emotion from one image to the base image, via image2image and using the tools in your video? I'm having trouble with this.

[@sebastiankamph]

Check out my reference only video. It's two faces on the thumbnail that says "same face easy"

[@Neowave40]

guys if you are using brave and all the output of the preprocessors are white or black images, you can fix it disabling brave shields

[@云马-f4s]

Hello, can you send the link of the plug-in for CALC1:1, 3:2, 4:3, 16:9? Thank you very much!

[@MrErick1160]

Goddamn this was greatly needed improvement!!!

[@sebastiankamph]

🌟🌟🌟

[@PrincessLatifa_Art]

so mediapipe is better than openpose or is it the other way?

[@KDawg5000]

Now we just need a controlnet for eyeballs. I still haven't found a great way to control where the characters are looking.

[@garrulousskeptic6616]

This +1, lol i used ahegao lora to cludge them to look up sometimes.

[@fdimb]

Any reason you went back to A1111 instead of vlad?

[@sebastiankamph]

I had more stuff installed in a1111 that I wanted to use. Some days it's the flip of a coin. Icons are next to each other.

[@steinscamus8037]

I am using controlnet 1.0, i never used the face model or w.e extra you got. Do you have videos talking about the rest?

[@sebastiankamph]

A couple, yes! 😂

[@MrFedemoral]

YES

[@user-uh4zd9tu3b]

9:30 the workflow to make the icon for a modern mobile game app

[@Distty]

Great, thank you.

[@mk500]

The preprocessors do an amazing job at capturing the openpose framework for face or full body, but then I cannot edit them. I often want to just adjust a leg or arm segment a little. I have the openpose editor and posex extensions, but I can’t get editable frameworks into them from the controlnet preprocessor.

[@ovum]

You have no choice but to use multiple ControlNets

[@Alukardo11]

i can generate images 512x512 in 5 seconds, but when i use any pose or face, i get Cuda out of memory error, do you know how much controlNet vram consume?

[@edsonmatheus7976]

Hey Sebastian, do you have any videos on upscaling?

[@sebastiankamph]

I have a comparison in my ultimate stable diffusion guide. But nothing on the latest ones yet.

[@bentp4891]

What models do I need to download please? I can't seem to find ones with names that match the ones in the video

[@sebastiankamph]

See previous video, also linked in description

[@ConsolasEight]

0:25 - Ah, but did you hear the one about the *three legged dog* that walks into a saloon and says "Ah'm lookin' fer the guy that shot ma *paw* !"

[@jahhe2611]

is there a way to keep the face character the same on the end result? so it looks like the original person instead of changing to a complete new person?

[@sebastiankamph]

With reference controlnet also, kinda.

[@NikitaBirukovich]

Great job, thank you! How about creating a weapon made up of different parts? For example, a shotgun made from parts of hockey equipment.Its real in SD control-net?

[@Lefiath]

Now, that's very interesting, but what if I actually want to change facial expression on a picture I've made? When I take photos with cinematic tools in various games, one of the biggest struggles is that you usually can't set up the emotions how you would like to. I've tried Photoshop's neural filters and they results are laughable.

[@tsentenari4353]

I have the same question. Photoshop's Liquify Tool does a little better, but still isn't great. I am sure this will change soon, but in spite of all the cool AI options out there, the best way to do it is still manually by putting the eyeballs on a separate layer, and using Krita's Liquify Tool to adjust the eyelids and eyebrows by hand. (On a transform mask, so that it's non destructive.)

[@yongliu2918]

you are great!!!

[@sebastiankamph]

😘

[@StudioBleenk]

Hi Sebastian! Could you please help me? Openpose doesnt work since updating. I have the properly named .yaml files and cldm_v15.yalm for the config. Anything else I should check for?

[@pastuh]

Many games will use generated avatars like this :))

[@sebastiankamph]

For sure! :)

[@fjccommish]

When I do this, it doesn't match the face expression - ever.

[@1000trilliondollars]

Awesome

[@IshioRamo]

well that openpose_face is good when the face is close to the camera but when the face is small, mediapipe will do a better job at keeping face details. I really like that Openpose_full option though, just a little bit of inpainting and its a done deal. very interesting option to use.

[@noahsplayground2564]

Would you use mediapipe and open pose together? I guess what I’m after is recreating the subject with face clarity from a full body image.

[@IshioRamo]

@@noahsplayground2564 it could work not sure how you would use them in a different position then the one used to make the annotator

[@jon2478]

Is there a way to make the rendered face the same as the one used in controlnet?

[@sebastiankamph]

If you use it both in img2img and controlnet, you will get the same one.

[@gameswownow7213]

bro i like your vids a lot, but the recording of audio has a hiss every time you speak. mby u can get rid of it from the settings?

[@sebastiankamph]

I'll look it over

[@nicolasreta2248]

How do you make is work so fluid? My image render speed is the same, but each time I change the preprocesor it takes a couple of minutes at least.

[@sebastiankamph]

The first time you change, it will download new files. After that, it should be faster.

[@punkshit120]

will you make a tutoriol for the tia models?

[@therookiesplaybook]

Can you please do a video on the hundreds of new preprocessors they added in 1.1. I'm very confused.

[@sebastiankamph]

With one video at a time, we'll get there eventually! 😅

[@McApplebees_does_not_exist]

please consider using RTX voice i can hear a slight buzzing in your audio when you speak

[@sebastiankamph]

Please check my latest video and see if you feel I fixed the audio 😘

[@michail_777]

Hi all. I have a question. Why does ControlNet give an error when working with SD2.1 based models? Already in the line in the "settings" CN wrote the model name 2.1yaml. Just the other day everything was working, now it's not working. I have a local station.If anyone knows the answer please advise, may be a specific format you need, for example 768x768? Although I tried it.

[@sebastiankamph]

Are you sure you're using a 2.1 ControlNet model? They're specific to 1.5 or 2.1

[@kraitFPS]

Why you selected the styles but didnt applied them ?

[@sebastiankamph]

They are still applied even though you don't click the little button. Makes for a cleaner prompt.

[@xXSpaceCowsXx]

tbh i only come here for the dad jokes haha that was a a good one

[@sebastiankamph]

Glad you're enjoying them! 😊

[@fabiano8888]

The good thing about not getting your jokes instantly, is that my potato GPU doesn't feel that slow when upscaling an image. 😊

[@coda514]

Thanks for the tips. BTW, why do horses have low divorce rates? They have stable relationships.

[@sebastiankamph]

That was one of those "I'm not laughing but I'm nodding and approving of this one."

[@kroanosm617]

I came for the Stable diffusion and stayed for the dad jokes.

[@sebastiankamph]

Real mvp right there

[@mrhoangpro]

thank you very much, 1 sub

[@fjccommish]

Is there a controlnet model that can remove bad jokes from these videos?

[@sebastiankamph]

You misspelled dad jokes.

[@tylerpilgrim9348]

I'm ashamed to admit I've laughed at most of these jokes lmao🤣

[@sebastiankamph]

One of us, one of us!

[@ceyhundemircan8654]

This thing must be fun to use. However, from now on we can't trust any recording I guess.

[@roseydeep4896]

First!!! How's your day going? :)

[@sebastiankamph]

Boom!🏆 Sun is shining, so excellent! What about yours?

[@roseydeep4896]

@@sebastiankamph I'm doing amazing!! About to go to japanese class and then to the park for a walk :)

[@GauravSharma-gt2gp]

If you notice, prompters are learning art 😂

[@lazygamer6191]

You must make video tutorial for dad jokes to.

[@sebastiankamph]

"This one trick dad jokers won't tell you"

[@hilamontenegro8861]

fix your Audio buzz sir..

[@---Nikita--]

Немедленно добавите этот риг в блендер.

[@asciikat2571]

Ive been shouted at by women, I relate

[@asciikat2571]

Great tut btw , many thanks legend

[@sebastiankamph]

😂

[@insuranceaes256]

Once you see a guy do a paywall on stable diffusion prompts its time to unsub

[@sebastiankamph]

They're free. I just hosted them there.

[@simulasyon01]

stop using AI that makes you look directly into camera all the time! I am scared. (I am kidding btw)

[@androidgamerxc]

PLEASE FOR THE LOVE OF ALL THINGS HOLY CAN YOU MAKE A NOTEPAD FILE AND TELL ALL YOUR styles the negatives positives and add ons it would save all of us a lot of time please broo .

[@sebastiankamph]

All my styles are available in the description and top pinned comment on almost every video :)

[@TheAiConqueror]

Plsss nooo crying here 🤣😜