Full Body Character Creation Mastery with Stable Diffusion!

Рет қаралды 17,872

Күн бұрын

Пікірлер: 63

@AIchemywithXerophayze-jt1gg 6 ай бұрын

***UPDATE*** Make sure you check out my GitHub for a new Python script that I created that gives you a nice interface for splitting these character sheets up. you can find it here: github.com/Xerophayze/splitter

@mattwhitehead32 9 ай бұрын

You can use the open pose preview images. Just turn off the pre-processor.

@AIchemywithXerophayze-jt1gg 9 ай бұрын

Good to know!

@daroniousmaximus 6 ай бұрын

Needed this so I can make some references for Blender. Thanks, gonna try it out.

@AIchemywithXerophayze-jt1gg 6 ай бұрын

Glad I could help!

@-Belshazzar- 9 ай бұрын

Great tutorial thank you! Where did you get the turbo scheduler (dpm++ 2m SDE turbo) though? Can't find it anywhere online

@AIchemywithXerophayze-jt1gg 9 ай бұрын

Not sure but I believe that it's only available if you're using automatic 1111 forge edition.

@gremigi 9 ай бұрын

First of all, thank you for this tutorial, this is something I was looking for a while. Have you tried generating a small rotation around you character, full body or portrait? If there is enough consistence, you can probably create a character that can be displayed in a 3D display. I want to try this technique with Instant ID to see if it is possible to generate a 3D portrait from a 2D photo.

@AIchemywithXerophayze-jt1gg 9 ай бұрын

I haven't yet

@LadiesFS2024 6 ай бұрын

Great Tuto

@SejalDatta-l9u 5 ай бұрын

This is excellent. Do you have something for : a) comfyui (and or) b) uses an existing character to build on?

@AIchemywithXerophayze-jt1gg 5 ай бұрын

Sorry neither

@marilynlucas5128 9 ай бұрын

I think you'll love using stable swarm ui

@AIchemywithXerophayze-jt1gg 9 ай бұрын

I've heard of it. Haven't watched anything on it yet. I'll look into it. Gotta finish the updates to XeroGen first.

@marilynlucas5128 9 ай бұрын

@@AIchemywithXerophayze-jt1gg I thought you'll love it since you're into using interfaces like A1111. Stable swarm ui is comfy ui but with an A1111 like interface. You can also use comfy ui nodes in it

@NewbieGamersoRus Ай бұрын

What if I want to just generate single fullbody but SD making too much background for portrait aspect ratio? Like how can I make just fullbody from the top of the head to the feet without extra background? Any usefull key words for prompt?

@AIchemywithXerophayze-jt1gg Ай бұрын

So if you want full body from head to toe, you need to add details into your description about the whole body. The AI's focus is derived from how important you're putting your focus on different aspects. If your including details about every part of the body or clothing that's being worn including shoes, the AI will pull the picture back so that you can see the whole character. As for the background, typically all use terms like, solid white backdrop, solid black backdrop

@friezaniger5178 9 ай бұрын

Can you also make a tutorial to use these workflows and make a unique character lora using onetrainer?

@AIchemywithXerophayze-jt1gg 9 ай бұрын

I've never used onetrainer before. Honestly I've never trained my own littl Lora before either. Maybe this is a good opportunity to jump into that and see.

@dwainmorris7854 2 ай бұрын

Yeah but can you change small details like belts and holsters and piping like you can with Krita AI in your character creation

@AIchemywithXerophayze-jt1gg 2 ай бұрын

Yes within painting you can change a lot of that. As for being specific when you're rendering these character sheets out, not really.

@revisited-edm 6 ай бұрын

I’m having trouble with installing the comfy-UI on my computer to work properly.

@AIchemywithXerophayze-jt1gg 6 ай бұрын

I would recommend using stability matrix and then use that to install comfy UI.

@TheLobsterWrestler 4 ай бұрын

I keep trying to apply the poses from an openpose sheet, but SD keeps acting like it's not even picking up controlnet even with the 'controlnet is more important' selected. Any ideas?

@AIchemywithXerophayze-jt1gg 4 ай бұрын

Yeah usually if it's doing that, the controlnet version or the model are not compatible. So whatever model or checkpoint you're using, you need to change it to something else that will be compatible with the controlnetmodel you're using

@thetrailawaits498 4 ай бұрын

Can these character full body and face sheets just be created unclothed in order to train a character embedding or lora so then the clothing and poses can be added later with openpose and prompting?

@AIchemywithXerophayze-jt1gg 4 ай бұрын

I don't see why not, it's just a matter of how you prompt it

@lilillllii246 8 ай бұрын

Thanks. I have a question, how do you extract the characters from such different angles and then use them?

@AIchemywithXerophayze-jt1gg 8 ай бұрын

You would want to render the image initially as a PNG, then you can use a background removal tool to remove the background and convert it to a transparency, which means that it's a PNG with an alpha channel. That way you can import the image into another image and overlay it on top of another image.

@lilillllii246 8 ай бұрын

@@AIchemywithXerophayze-jt1gg Thanks. Can I use that to make my facial expressions and poses more diverse with a consistent character like Lora

@JadeEmperorTales 7 ай бұрын

What is the recommended to use? I only have juggernaut and the default one. I am trying to generate a minotaur but i keep getting a full body human 😅

@AIchemywithXerophayze-jt1gg 7 ай бұрын

I just used my prompt generator to generate this prompt and it works great with Juggernaut. Wide view digital fantasy illustration, (Enormous Minotaur standing amidst ruins:1.2), Rule of thirds composition, Strong horns, Massive axe, (Ancient temple backdrop:1.3), Crumbling columns, Overgrown vegetation, (Eerie atmosphere:1.2), Moody lighting, Weathered textures, Dramatic shadows

@JadeEmperorTales 7 ай бұрын

@AIchemywithXerophayze-jt1gg thanks but I am trying the minotaur in a character sheet

@AIchemywithXerophayze-jt1gg 7 ай бұрын

Ok make sure you watch my new video, it may help

@zZwowAi 9 ай бұрын

which openpose model are u using? i cant get openpose to work on SDXL

@AIchemywithXerophayze-jt1gg 9 ай бұрын

I'm using the openposeXL2 model. huggingface.co/thibaud/controlnet-openpose-sdxl-1.0/blob/main/OpenPoseXL2.safetensors

@luckyducky7819 5 ай бұрын

How do you get characters to have good faces in these model sheets? Whenever my caracters are created far away for model sheets, the faces are always warped.

@AIchemywithXerophayze-jt1gg 5 ай бұрын

Whenever I generate these, I always include adetailer for the faces.

@luckyducky7819 5 ай бұрын

@@AIchemywithXerophayze-jt1gg Sorry, I should have mentioned that I'm following the instructions on the video. Maybe I'm just getting unlucky if my results are so different. Could it be because you're using that A1111 forge and I'm using the standard A1111?

@AnimatedHorror666 7 ай бұрын

can the character be positioned in "A POSE"?

@AIchemywithXerophayze-jt1gg 7 ай бұрын

That would require utilizing an original character that's already in the pose and then using control nets open pose

@chrisgreenwell3404 9 ай бұрын

Great video , template link is not working though :)

@AIchemywithXerophayze-jt1gg 9 ай бұрын

Try now. Someone else pointed that out as well. It should be fixed now.

@JadeEmperorTales 7 ай бұрын

how did u get the openpose xl2?

@AIchemywithXerophayze-jt1gg 7 ай бұрын

huggingface.co/thibaud/controlnet-openpose-sdxl-1.0/blob/main/OpenPoseXL2.safetensors

@JadeEmperorTales 6 ай бұрын

I forgot to ask how would able to use that negative prompt?

@AIchemywithXerophayze-jt1gg 6 ай бұрын

Which negative prompt? Are you talking about the one I have in my styles drop down? You can find it at share.xerophayze.com

@JadeEmperorTales 6 ай бұрын

@@AIchemywithXerophayze-jt1gg yes

@OPPAI560 3 ай бұрын

um hi may i ask how do i install it it look like so confuse?

@AIchemywithXerophayze-jt1gg 3 ай бұрын

I would start by going to and installing stability matrix, and then installing the latest version of forge. I believe you can grab my templates from my Google share.

@lugotorix6911 8 ай бұрын

Hi there, I installed Forge after watching your video, but I get an error like "TypeError: 'NoneType' object is not iterable". Do you have any suggestions for a solution?

@AIchemywithXerophayze-jt1gg 8 ай бұрын

You know I was getting that error message but only in specific situations. I can't remember exactly what it was though that was causing me to get that error. Join my discord and give me a few more details about your settings. discord.com/invite/F38wKFgP

@divye.ruhela 7 ай бұрын

This stuff seems helpful, but not exactly sure about who uses them. I hope you understand that beginners are watching this because they assume such models can help them with LoRA training. I mean, I can only imagine someone producing character rotation diagrams for training, but not inside such 'photo frames'. It would be helpful if you instead make a video about using the same seed to create full-resolution character datasets (diff. background, diff. cloths, but the same character in each individual image) that can be fed into Kohya or OneTrainer for training. I mean, some people are already doing that, but info on how to easily produce those can be hard to find or is available in bits here and there.

@AIchemywithXerophayze-jt1gg 7 ай бұрын

You inspired me. I did a whole other video today similar to this one and my other character sheet one, but this I go into detail about how to set it up and split the images so that you have an image set that you can use to train LoRa's. check it out later today: kzbin.info/www/bejne/d2KsqoCDbruCbKM

@nikoletbunet 9 ай бұрын

Hello! Can I do this on google collab?

@AIchemywithXerophayze-jt1gg 9 ай бұрын

I know a lot of other people do it, I don't know how to set it up and I've never done that before.

@heysoygiovanni6616 5 ай бұрын

program? name

@AIchemywithXerophayze-jt1gg 5 ай бұрын

If you're talking about what program I was using to create those, it's called WebUI Forge. It's like automatic 1111

@FrostySMW 7 ай бұрын

I'm confused, your advertising character consistency but your only showing a method on how to make character sheets instead of showing examples on how you can use these sheets to make your characters actually consistent in regular generations

@AIchemywithXerophayze-jt1gg 7 ай бұрын

This was more for character generation and keeping the characters consistent. In a normal generation with an entire scene, that is an entirely different process honestly.