Master Inpainting with Stable Diffusion & Automatic 1111

Welcome back to 'Alchemy with Xerophayze' where we're taking a deeper dive into the art of inpainting using Stable Diffusion and Automatic 1111. In this video, I unveil advanced techniques for manipulating images, adding new features, and achieving unparalleled control over AI-generated content. Whether you're looking to add intricate details or transform your images entirely, this tutorial is your gateway to mastering the subtleties of AI-driven art. I'll also cover essential tips on what to watch for to enhance your image generation process. Join me on this journey of discovery and let's push the boundaries of AI art together. Don't forget to subscribe for more insights into AI image generation.
Links
RPG Artist tools Models: civitai.com/models/8124/a-zov...
VAE: huggingface.co/stabilityai/sd...
Other 🔗 Links:
🛒 Shop Arcane Shadows: shop.xerophayze.com
🔔 Subscribe to our KZbin channel: video.xerophayze.com
🌐 Explore our portfolio: portfolio.xerophayze.com
📱 Follow us on Facebook: www.xerophayze.com
💼 Xerophayze Google Share: share.xerophayze.com
check out these other videos on inpainting:
• Inpainting Tutorial - ...
• How to Inpaint in Stab...
• How to change ANYTHING...
• Inpaint whole picture,...

[@slaypidin]

Much appreciating the demo of suffering, and that you did it till the end, like with the red dress. Not for your pain but because it's 100x more informative than the other dude who comes with pre-configured settings and showing off "look bro', you just push this one button and magic!"

[@AIchemywithXerophayze-jt1gg]

I appreciate that. I don't have a lot for production and honestly I don't have a lot of time to try and make everything perfect. And I would like people to see an honest representation of how difficult this can get. You don't always get the perfect result. I do try to get it right the first time, man sometimes the thing just does not want to do what you want it to do.

[@GryphonDes]

What a clear and concise little walk through! Love these so much!

[@AIchemywithXerophayze-jt1gg]

Your welcome

[@jankvis]

Fantastic ! Very useful tutorial. Looking forward to your next video :)

[@AIchemywithXerophayze-jt1gg]

Thanks a lot!

[@Shabazza84]

A lot of valuable info here. Your tutorials are always quite long, but it's nice to see exactly what happens and even when things fail until they don't.

[@AIchemywithXerophayze-jt1gg]

I know that's something I'm working on. I'm trying to keep them to at most 30 minutes. Sometimes they go over. I'm doing better with my newer videos. I tend to get verbose in my dialogue as well. These are unscripted, raw. And I really don't have any time for production. I wished I did. But I also have two businesses that I'm working on besides this KZbin channel.

[@Artazar777]

Hello, the reason why there was a green dress is that you selected the "original" option in the "Masked content". SD took the original color that was under the mask (green) and tried to make it red, which was very difficult. Use "fill" or "latent noise", then you should get better

[@AIchemywithXerophayze-jt1gg]

Thanks.

[@renwar_G]

Great content G

[@AIchemywithXerophayze-jt1gg]

Thanks

[@benaubrey2410]

Great tutorial, really helped me! Turns out I had the mask blur up higher than the width of most of my mask, so those parts of the mask effectively weren't there! I also like how you showed your errors and your process of solving them. Now I just need a new PC so each render doesn't take around 17 minutes for me! I'm running on CPU only right now.

[@AIchemywithXerophayze-jt1gg]

I'm glad it helped. Ouch That sucks about the speed.

[@benaubrey2410]

@@AIchemywithXerophayze-jt1gg Haha yeah it does! I'm getting a new PC soon, is it cool if I email you the build when its done so you can tell me if what you think of it? Want as many opinions as I can get before spending like 2k on one haha

[@CoconutPete]

one thing I've noticed with many tutorials is not many offer practice files so people can follow along - although not necessary in this particular tutorial, I think it's a good opportunity to think about

[@AIchemywithXerophayze-jt1gg]

That's not a bad idea. It would at least help with the people who have similar setups and models. Really just comes down to making the picture that I'm working on available. It's hard to offer practice files because there's no saved configuration file or project file that you're working with.

[@CoconutPete]

@@AIchemywithXerophayze-jt1gg I think just practice images to start with might be good.. but of course not everyone would have the same models so I suppose tutorials would have to use a common/popular one. Another idea that might be popular is try to create photo realistic versions of video game screenshots. I've seen several threads on Reddit with people struggling with this.. some successful, some not. Might attract audience from the game

[@johnclapperton8211]

What's the best way to create an arbitrarily different background around a masked-out subject whilst taking account of the subject's perspective and lighting?

[@AIchemywithXerophayze-jt1gg]

When you mask out the subject you're going to select the option it says everything but masked, and then make sure you select whole image when you're doing the render.

[@gohan2091]

Very useful. How does this differ from controlnet inpainting mode? What are the pros and cons for each?

[@AIchemywithXerophayze-jt1gg]

When it comes to using the control nut in painting, the only thing I've ever used it for is outpainting images and extending them. I haven't actually done it to do any actual end painting. I'll have to look that up and maybe do a comparison

[@gohan2091]

Been trying to get good with inpainting. It seems that Mask Blur, Masked Padding and Denoise Strength are the three parts of the triangle that I need to adjust to get good results. I just don't really know which to change and when. Could you go more into these three settings? Masked Padding determines how much of the surrounding area the AI takes into consideration when it inpaints? Is that correct? Mask blur would blur the inpainted area thus having a similar effect to raising the denoise strength since it's blurring and ignoring more of the inpainted region?

[@AIchemywithXerophayze-jt1gg]

So on the mask padding you are correct. The more mass padding you add the more it takes into consideration when doing the in painting. That's the primary one you want to focus on if you're trying to add new stuff you need to reduce the mask padding, the mask blur just determines how much it's going to blur the edges of the mast area blending it in with the surrounding area. Denoid strength determines how much the AI is going to change the area that you've masked out. The lower the number the more it's going to adhere to the original image if you're using original and not replace. The higher the number the more it's going to change the mask area

[@gohan2091]

@@AIchemywithXerophayze-jt1ggThanks :) I am trying to fix a hand holding a sword, I have inpainted the hand and the whole sword. I am trying to get it looking corect. I've improved the fingers but the sword handle is bent and doesn't look good. How would you approach this?

[@onepercentile]

Great info .. Love to see the struggle so we don't bang our heads too hard being noobs. I'm curious though. I have an item the AI will not be able to generate; an image. Can I input the image into the mask instead of the prompt?

[@AIchemywithXerophayze-jt1gg]

If you mean input your existing image into the created background image. Yes you would need to do this through a photo app, then you could bring it back into SD and touch it up. Check out my video on storybook creation. I touch on this. kzbin.info/www/bejne/qXPCY2iZhrNrpdE

[@onepercentile]

@@AIchemywithXerophayze-jt1gg Thanks!!!

[@jemyt6466]

how to inpaint multiple at the same time sir? is it possible?

[@AIchemywithXerophayze-jt1gg]

If you're talking about in painting separate individual areas, you can but it treats those individual inpaint areas in the same frame. Which causes the AI to not be able to focus on any one individual area enough for it to be detailed. You tend to lose details that way.

[@WesTheWizard]

I recently saw a left/right Lora on Civitai - I wonder if that would work for your green dress girl

[@AIchemywithXerophayze-jt1gg]

I'll look it up and see.

[@jemyt6466]

hello sir is the a way Batch Inpainting in Automatic? i will create a video with the same dress in 1 minute

[@AIchemywithXerophayze-jt1gg]

Yes I believe you can, what you would want to do is create a mask file that masks out a specific area, as long as that area stays the same in all images, then yes you can do that

[@tr1pod623]

For some reason this does not work for me. Does this not work in Forge. I lowered The masked padding, messed wiith all the settings, it does not allow to me add anything new.. it just turns into something random by changing the background,

[@tr1pod623]

nevermind.. it started working when the resolution was set to 768 x 768

[@tr1pod623]

or it depends on the position of the inpainting?

[@tr1pod623]

now it doesnt work... i am confused.

[@AIchemywithXerophayze-jt1gg]

I saw your other replies and it sounds like you're getting some hit and miss results. I just did another video because I think this is a big thing for a lot of people being able to get consistent results when doing in painting. It'll be uploaded and I'll have it out later today.

[@tr1pod623]

@@AIchemywithXerophayze-jt1gg awesome! thanks. I realized one of the issues was apparently that when the mask touched an edge of the image, it did not really work.

[@thepleasureroom9646]

why doesn't my 1111look like yours?

[@AIchemywithXerophayze-jt1gg]

I customized a few things through the settings. There are some things you can add and remove along with some of the extensions will change how things look a little bit. Join my discord, I will do what we can to help you out with that. discord.com/invite/2ayGGaPu

[@LouisGedo]

👋

[@AIchemywithXerophayze-jt1gg]

✌️

[@milos_slav_sky]

you didn't understand, she was going to jump down

[@AIchemywithXerophayze-jt1gg]

Not sure what you mean.

[@moonduckmaximus6404]

I INSTALLED REPLACER WHEN U DID YOUR EARLIER VIDEO BUT IT ONLY SHOWED UP IN MY TAB AREA ONE TIME.. IT STILL SHOWS IN THE ''EXTENTIONS'' AREA BUT IT WILL NOT SHOW UP ON THE TABS... PLEASE ASSIST

[@AIchemywithXerophayze-jt1gg]

Best thing to try would be to delete the extension directory, and then try reinstalling it.

[@moonduckmaximus6404]

i just deleted it from my extentions folder , reinstalled and restarted the UI and its still not showing....@@AIchemywithXerophayze-jt1gg