Just a few clarifications because you can't possibly cover everything in 20 minutes video 1. "bad hands" has never worked unless maybe the model is somehow trained for it. I used it in the video just to prove that it just generates noise and you might have better luck with just "aaaaaaa". 2. A SAI engineer suggested me to not use negatives at all, because of the way SD3 is trained they have no meaning. From my tests very strong negative concepts seem to have some kind of effect, to be proven if it's just coincidence / placebo, but seems consistent. 3. Changing the resolution to weird numbers (1040) is a bit like running a different seed. It doesn't fix the model, for some reasons I get less oddities at weird latent sizes, which is of course not recommended anyway. The point is: the training was meh 4. Give SAI the benefit of the doubt. If things won't change I'll be the first to stop using it (and actually paying for the creative license)
@denisquarte71773 ай бұрын
From SD2 to SDXL one might have guessed they learned something, apparently they did not. And honestly who read forbes story about emad and didn't at least expect something like this? They are done, it was always a question about when not if. With comfy's blog post my hopes are up again. If SD3 doesn't work out, something else will.
@havemoney3 ай бұрын
A SAI engineer suggested me to not use negatives at all. >>> When I needed to draw a bathyscaphe at the bottom of the Mariana Trench, the bathyscaphe should be in darkness, I used the negatives “Light from above, refractions, surface”, it didn’t always work, but it never worked without negatives.
@latentvision3 ай бұрын
@MichaelLochlann technically speaking the model should be able to do exactly what we ask without negatives... but yeah we are not there yet
@ChinaFilm-v6f3 ай бұрын
"Since at Stability AI they only do the missionary"...damn bro, fatality! 😆😆😆
@richgates3 ай бұрын
"Let's confuse the little bastard." I got a good laugh out of that. Thanks Matteo.
@le0t0rr3z3 ай бұрын
Best cover of the subject so far. 100% informative. No time waste. No drama. No bs. Yet somehow humble. 👏👏👏
@PimentelES3 ай бұрын
I can't stop watching SD3 videos. It's like a beautiful house the community loved but the owner set it on fire for safety reasons. So bizarre
@latentvision3 ай бұрын
it's more like the owner stumbled while installing the fire extinguishers and accidentally set the house on fire with the cigar
@MikevomMars3 ай бұрын
Right - it's like watching a horrible road accident. You don't want to look, but you can't look away either 😐
@Cara.3143 ай бұрын
Safe for the consumer market. Not for the actual users
@Macatho3 ай бұрын
They didnt have enough money to build the model up to what it has to be to be able to be very commercially viable. People don't care enough about generating pretty images to pay for it. You need businesses to use the workflow in their production. And SD2/3 without a severely good trained LORA isn't enough. They had to have bankroll for rand recognition, and then they could probably live off SD5 or SD6. Blender gets decent amount of funding, that software is 30 years old, yes you heard me, it was created in 1994... They got about fuck all for the first 10 years.
@4rrxw7943 ай бұрын
What 'safety'?🤔
@tamatlt74693 ай бұрын
I know you are not considering yourself a youtuber, but what a great summary! As a someone semi casual it is cool to learn what's good about it, what's strange about it, how to wok with it in comgyui, and some glimpses on what might happen next with the license without a drama. Observations >> Opinions. To me your channel icon under a thumbnail is a bigger clickbait than a thumbnail itself. Well done!
@latentvision3 ай бұрын
aaaw thanks :)
@Darkwing87073 ай бұрын
"Carried by ants" This guy is a comedian
@dadekennedy97123 ай бұрын
I absolutely love watching your videos, I learn so much! That's for staying on point with what matters!
@JustFeral3 ай бұрын
Dude, you're fucking hilarious.
@Jackassik3 ай бұрын
I chuckled when you said "Whispering to it like a lover" but when you said the second part I almost spilled my drink :D Great video as always.
@AIPixelFusion3 ай бұрын
Lmao. Same. Totally unexpected and hilarious
@hidroman19933 ай бұрын
No spoilers
@rhaedas90853 ай бұрын
@@AIPixelFusion I've become to expect exactly one hilarious quote. I think it works so well because he's good at dragging your attention into the details he's explaining, and then slips a small grenade into the mix. Almost like a classic jump scare, only funny.
@Jackassik3 ай бұрын
@@hidroman1993 you mean I shouldn't discuss the video I just watched in the comments to the said video because I'm spoiling it?
@hidroman19933 ай бұрын
That was a joke geez
@tomschuelke79553 ай бұрын
Thanks.. as always one of the best places to get information. For me never the less SD3 medium isn´t anything more but a playground. I won´t suggest it in my company on legal images, as long as there´s no real benefit, i could allready get from good trained SDXL Models. If i as an Architect could see great advantages in prompting and generating very detailed and subtile and architectural correct Architecture, esp. in very big cityplaning scenes, it would be worth thinking about a payed license.. Thats a weakness of nearly all Models out there.. People dont care about architectur to much.. there you need by far better precisiion , because you often allready have a concept and architectural drawings and CAD screenshots to start of from. But i think thats for the future to be seen.
@latentvision3 ай бұрын
controlnets work very well on SD3 so that might come handy in architectural applications. Also I'm pretty sure image conditioning will be good, so an SD3 IPAdater might save us all
@lefourbe55963 ай бұрын
i like that grounded take 👍
@javierzzz45563 ай бұрын
Controlnet and IPadapter are the only reasons I would try agaim SD3
@ArielTavori3 ай бұрын
If you consider the implications of some of the recent papers regarding the Platonic hypothesis, as well as groking and other related concepts, it seems fairly expected that teaching these things anything untrue ("safety training"), is going to be devastating to the model's capabilities, and likely result in permanent shortfall relative to the technical potential. I suspect community models have gotten so good because of some cracking and overcoming some of the toxic false training, but I'd bet even those models never reach the potential the architecture would allow, because they are fundamentally salted with falsehoods. "If you make a delicious sandwich, and then put some dog p00p in it, no matter how good the rest is or how many other ingredients it contains, what you've got there is a p00p sandwich!.." - someone smarter and funnier than me oh I can't remember or find with AI LOL
@chriscodling65733 ай бұрын
Wasn't going to download sd3 but this video definitely changed my mind so I'll give it a try
@MarcSpctr3 ай бұрын
the negative prompt doesn't affect much cause sd3 needs higher weights for keywords. like in sd1.5 and sdxl we did stuff like (keyword:1.5). here we need to do stuff like (keyword:15) for it to show significant effect. so increase keyword weights in negative prompts does make a difference.
@javierstauffenberg34143 ай бұрын
I came for the insights, stayed for the jokes 😎
@APrettyGoodChannel3 ай бұрын
The difference between the negatives which seem to work and those that don't seem to be because of the negative prompt cut-off at 10%. Words like blonde might be set in the image in the first 10%, words like artefacts would not. I accidentally finetuned an SD3 model with blank prompt negatives instead of zeroes, and it worked fine in samples when the training setup was testing it that way, though not in comfy which uses zeroes, so it seems you could retrain the model to use classical negative prompts if you wanted.
@michaelknight37453 ай бұрын
Your are the best. Very well explained. I see you using that RESCALE CFG node, but i cannot figure what it is doing. If it's a multiplier, why not just put the result in the CFG of the ksampler?
@latentvision3 ай бұрын
rescaling is gradual based on the sigma, not fixed
@Art0691p3 ай бұрын
Excellent, informative video. Thanks.
@baheth3elmy163 ай бұрын
Thank you very much for the video!
@roberamitiku58443 ай бұрын
As always amzaing vid , so if s3d is good with small details can we use it for upscaling will be better compared to 1.5/XL
@latentvision3 ай бұрын
tiled upscaling seems to be working, but at the moment it seems very much optimized for 1024x1024 so you can't go crazy with the resolution
@GyattGPT3 ай бұрын
This is great. I wonder what was specifically impacted by the safety alignment. If just removing a word or changing conditioning is able to get some good output, it might not be as big of a deal with some fine tuning to explicitly have train away the censorship. More research is needed. Let's not fall into doomerism folks!
@latentvision3 ай бұрын
your conditioning must prompt a very simple composition. If you have people standing doing nothing it works very well. When the pose becomes more complicated the model just goes bonkers
@JayPeaTea3 ай бұрын
"avoid sentive material", but that's all I... nevermind.
@latentvision3 ай бұрын
I see where you are going...
@styrke92723 ай бұрын
the best youtube video about SD3 is from someone that dont consider himself a youtuber, thanks for the info
@blackcloud82183 ай бұрын
very informative as expected of you, i rushed here right away when i saw that you posted about SD3 and i was not disappointed, appreciate your efforts
@Billybuckets3 ай бұрын
What a rational and informative video. A+ as usual. I hope people get a handle on training soon and SD3 takes over as the dominant base after fixing what SAI messed up in the training. It’s like a fantastic car except for a bad transmission. Just replace the transmission and the car would be top notch.
@Difdauf3 ай бұрын
Well, if they fucked up the transmission on your new super car, you should start wondering what else is fucked up.
@AB-wf8ek3 ай бұрын
@@Difdauf Yea, but this car is free
@volcanowater3 ай бұрын
Have you taken a look at the perturbed SD3 model?, according to some it gives better results
@ArielTavori3 ай бұрын
"bad hands" and other arbitrary concepts like that never worked in any version. The concepts come from the training, and things like "extra fingers", are simply not significant labels tha occur in any training data sets. Many experts have tried over and over to explain this idea since the early days, and I wish more KZbinrs would take the effort to grasp and explain this to viewers. I am amazed how many workflows I still see posted with 400 words in the negative prompt. There may be edge cases where some of that logic works out, but in general most of the time with most models, you are better off with no negative prompt or very little specific concepts relative to what you're trying to achieve. Fwiw, you are looking for opposing concepts. For example if you're prompting for a vivid photo of a beautiful princess, you might try a "ugly sketch of Dusty box of rocks, dim, faded" If you are prompting for a dystopian Urban landscape, leaving your standard 'copy and paste' negative prompt with a bunch of words like "ugly, distorted...." Is going to dramatically limit your ability to achieve that, as well as drastically reduce the variety of your images.
@latentvision3 ай бұрын
just to be clear, I've never used "bad hands" in my videos. I used it here because they are often used and I wanted to demonstrate that you are only adding random noise (it works the same way with "aaaaaa"). In the case of SD3 the negative are randomly zeroed during training, making them virtually useless. Lykon said that SD3 doesn't listen to negatives at all and to just leave them empty, but from my testing something (very little) is actually understood (if the concept is strong enough).
@ArielTavori3 ай бұрын
@@latentvisionabsolutely! And thank you, and sorry if any of that sounded accusatory, I was simply reminded of this common issue with it I think is one of the single biggest issues as far as how many people are affected by it, how few people realize it, and how easy and effective it would be for influencers to finally address this elephant in the room. I was just trying to do my part for the handful of people who might end up reading my comment and permanently improving their process. 🙏🏻 I frankly wasn't thinking about sd3 at all, as I'm lucky to be able to run 1.5 + IP Adapter on my 6 GB 1660ti lol
@latentvision3 ай бұрын
@@ArielTavori it's all good man 😎 Just wanted to clarify because it's hard to concentrate everything in a 19 minutes video especially when there are so many things to cover.
@ImmacHn3 ай бұрын
I don't use negatives much, not even in 1.5 🫠, I feel the "usual" negatives are mostly placebo.
@Jackassik3 ай бұрын
Same here. I did a lot of testing and it seems placebo to me when it comes to things like "ugly, bad hands" etc. But it works well when you're trying to avoid things like "hand, blond girl, child" etc. But still, I usually I just use a positive for this - "hands behind back, brunette, 30yo". I usually generate using LCM or Lightning so it's 2x faster when I set cfg to 1 (which also ignore the negative).
@MilesBellas3 ай бұрын
Hu-po analyses the SD3 technical paper: it's really advanced..... in his opinion. The developers abandoned it without full completion ?
@carleyprice31383 ай бұрын
thank you for sharing your work, knowledge and experiences. very appreciated!
@beveresmoor3 ай бұрын
Hope you are right on this. I hate it when they spoil the chance of their own product success before it can catch on. 🤣
@KennylexLuckless3 ай бұрын
1.4 was not good, 1.5 was good, 2.0 wan not good, SDXL was okay, SD3 not loved. It like the models are on a good-bad-good-bad shedload, so will we all keep use SDXL now until a new model will come, or did Stability fook it up so much that this will be the last large AI model we can get?
@sherpya3 ай бұрын
ok Matteo, I was just waiting for your tech informations about sd3 😂
@generichuman_3 ай бұрын
It would stand to reason that words like blurry and artifacts wouldn't work as well, because these are features that only become visible at later steps when we're zeroing out the negative embedding. Concepts like blonde, asian, etc. are things that would be visible at the first steps and are thus affected.
@322ss3 ай бұрын
Stability AI seems to be in a messy situation, nevertheless - really informative video, thanks!
@alyia96183 ай бұрын
Okay at this point it is clear that stability has gone crazy and SD3 is crap! It would be a very good thing if the community started focusing on fine-tuning Pixart and even more Hunyuan.
@synthoelectro3 ай бұрын
whats with the newer version of SD, why is it becoming soon smooth faced and skinned? I don't get it. 1.5 isn't like that.
@swannschilling4743 ай бұрын
Thanks so much for this one, I hope things will be sorted out and change for the better! 😊
@Lorentz_Factor3 ай бұрын
So I am not so sure that it is because of the censorship. I believe that it is yes due to how it was trained but not for why people have thought. With some testing I can consistently get women in the grass or men in the grass or men or women laying in the bed without getting the lumpy ball of flesh and limbs in all directions. And how do you do that you ask? Well you use those negatives that sd3 is not so fond of. If the woman is laying in the grass, then in the negatives try inputting standing, sitting, crouching, and other poses which are not laying. I find that this works very consistently. Furthermore, utilizing L and G inputs in a different form, than the t5. Also handle this well. For the L and the G something like a woman laying down, and then in the t5 describe the grass and where she's at and so on. You can also describe the grass and such in the L section while the G maintains only the description of the subject herself. Other variations of this work as well. In the t5 section, describe it much more explicitly in detail. The position of her arms and legs and so on. Also further refine the output. But ultimately without the negatives listing the poses which are not laying It still seems to fail. What I believe is that the vector associations between poses might be a little bit stronger then they should be. In certain aspects. This may be due to the censorship training and unintentionally. So yes, but what I noticed on examining the outputs is that it seems for example that the woman is in a standing position with her shoulders in the grass while her abdomen is attempting to lay down while her legs are crisscrossed as if sitting. It often will seem like a multiple set of poses that has been mushed together. I think this may have disconnected some preferences for the various poses and not properly distinguishing that you can't sit stand while laying down. Oddly enough, another negative which I found oddly to work, is birth defect and even more so, spina bifida, yes, I know that's strange, but at one point the output reminded me of a friend of mine who was born with a severe case of spina bifida that could not be operated on and it reminded me of that. Yes, it's wrong and kind of a messed up way of thinking, but oddly enough that negative includes some things up. Of course that might just be confirmation, bias and unintended embedding output from the term but it nonetheless seems to help. Though. Falling back on just negating the poses that what you are describing is not. Works quite well
@murphylanga3 ай бұрын
Thank you, as always a great video from you. I am still a big fan of SDXL. The correct use of Clip G and Clip L and additional control via condition nodes and/or controlnet makes a lot possible. I have now automated a lot with the great nodes from Rgthree... and before I have a closer look at SD3 I still have to "explore" the many great possibilities of your IP adapter and incorporate them into the automation.
@Latentnaut3 ай бұрын
"The correct use of Clip G and Clip L" I always use the same. Is there a difference? Where can I learn more?
@robadams24513 ай бұрын
Thank you interesting, factual and undramatic. It's always easy to accuse a company of making a poor decision, but Stability is in a difficult place, there might have been only bad options to choose between. I suppose they need a buyer for the company but the plausible buyers will likely sit back and wait.
@latentvision3 ай бұрын
I'm still hoping huggingface will chime in
@AstroMelody_TV3 ай бұрын
BROOOO, I CRACKED SO HARD at 13:55, thanks for that xDD
@vitalis3 ай бұрын
The real “safety trigger” should be the warning that all user prompts related to grass will create the most horrendous creatures. Those images would get a R18 warning at cinemas. In my opinion horror is more traumatic than nudity.
@fingerling6133 ай бұрын
"Since at Stability AI they only do the missionary" lol
@latentvision3 ай бұрын
😉
@paganiriccardo3 ай бұрын
I bet that it's the woke culture's fault, they started shouting that even monsters have the right to be sampled and they trained the model that way!
@OpenArtVietNam3 ай бұрын
Don't know what content it is, but surely like it first
@cristitanase61303 ай бұрын
I really hope we get new open source models because this one is going to hell extremely fast...
@MushroomFleet3 ай бұрын
11:00 hahaha excellent
@latentvision3 ай бұрын
😛
@somebodyrand0m2803 ай бұрын
just a small note to make (which ive seen in many other videos), is that "Euler" is correctly pronounced "oi-ler", rather then "yoo-ler" which is incorrect and a mistake often overlooked. just something to keep in mind when making future videos.
@madrooky13983 ай бұрын
One is just closer to an English (American) and one closer to an European (German) pronunciation. As a German native I don't see a mistake using either way.
@latentvision3 ай бұрын
📝
@Ratinod3 ай бұрын
By the way, this model (probably thanks to the new VAE) is capable of generating pixelart with an ideal grid with a pixel dimension of 4x4, i.e. 1024x1024 -> 256x256! (the previous basic models could not do pixel art with the correct grid at all, and the additionally trained ones could only generate with a pixel size of 8x8 (1024x1024 -> 128x128))
@latentvision3 ай бұрын
right! I did some pixel art and it's amazing! Thanks for the heads up
@voxyloids87233 ай бұрын
I persenally skip 3.0 and wait for 3.5
@MilesBellas3 ай бұрын
Nvidia could buy Stabilty Ai, Autodesk and The Foundry to create a new free media development platform, to compliment the massive hardware profits, that harnesses pre-exiting CG development paradigm of points, models, particles textures, compositing etc ..... as an interface to AI rendering through Comfyui etc.... ? Image Control = Essential to Output Professional clients usually operate by specifics. 😊👍
@latentvision3 ай бұрын
nvidia would never make it open 😅
@LuniSqАй бұрын
You should cover the new Flux models, they're everything SD3 should have been and then some!
@latentvisionАй бұрын
it's coming out today
@michail_7773 ай бұрын
I still think that for animation input video is the best is SD 1.5 model. But for regular XL animation. Maybe SD 3 will be very good for video? We have to wait for АimateDiff for SD 3. And for the generation of images, vazmozhno will need a small algorithm, which will begin to adjust SD 3 for better generation.
@latentvision3 ай бұрын
well let's try to fix the images before thinking about animations :D
@michail_7773 ай бұрын
@@latentvision 😄
@97BuckeyeGuy3 ай бұрын
I appreciate the hacks you've found and all the work you do, but SD3 is just a garbage model. Not because of its architecture, as you mentioned, but the absolute trash training SAI did for it and how they just dumped it into our laps in this completely broken state. It's not worth the effort to hack just to get it to maybe work. The original employees at SAI maybe would have deserved the benefit of the doubt, but this new leadership group doesn't deserve any of our good will. I would love to see you give your thoughts on some of the alternative models, ie. Pixart Sigma and Lumina Next.
@latentvision3 ай бұрын
Lumina is my next project
@ooiirraa3 ай бұрын
I'm just in love with you and every your video
@hindihits92603 ай бұрын
nice video, where can I find the fp16 version?
@taucalm3 ай бұрын
huggingface
@toshchakfox2 ай бұрын
This is actually useful for a change. Thank you!
@mithrillis3 ай бұрын
Honestly I am not convinced with the "censorship" argument. From what I have seen, the model freaks out when trying to generate upside down or heavily tilted faces, just like the older SD models, just more broken than they usually do. I do not see anything that cannot be explained by under-training, over-tuning or other training failures. I think they just rushed the 2B model to buy time for 8B training and it lacked the tuning needed to generate anything other than upright humans. To prove it is really "censorship", we need to do a lot more tests, like "does it matter if we generate human or animals in unusual orientations", "can it do astronauts in space correctly", "does the gender of the subject matter" etc.
@latentvision3 ай бұрын
it's not the "censorship" per se. It's the lack of data and the censorship doesn't help. the thing is that the model tries to do things it is not trained to and it fails.
@antoineberkani97473 ай бұрын
Thank you for explaning things really well without getting sucked into the dumb reddit drama. Looking forward to see how this model evolves, although i've heard rumors it may be tricky to finetune.
@latentvision3 ай бұрын
Really? I've heard the opposite, the problem is that there's very little official documentation. Controlnets for example were developed in record time and they work pretty well... so maybe it won't be that bad
@vanyakapetanovic40182 ай бұрын
I have been trying ComfyUI for a while now with established protocols and models and never gotten one picture/video out of it that it wasn't hideous glitchy low res mess. idk how you guys get anything out of SD. To me it is the absolute worst product on the AI market at this moment by a long shot.
@latentvision2 ай бұрын
no worries, you'll find the one for you
@ChinaFilm-v6f3 ай бұрын
I did a git pull to update and also used the comfy manager to update the ComfyUI_essentials nodes but SD3 negative conditioning node is not available?
@latentvision3 ай бұрын
mh try to delete the directory and reinstall
@zerorusher3 ай бұрын
Hi matteo! I wanna try to make a sort of guide to guide Llama 3 70b to rewrite/enhance text prompts in a way they make SD3 happy. From your experience, what are the things SD3 struggles the most with? Your video gave me great insight about what kind of prompt works well with SD3.
@Kryptonic833 ай бұрын
great info as always, thanks
@IndieAuthorX3 ай бұрын
Maybe I should wait for a bigger model. I need lineart controlnet and an ability to use negative prompts because I almost exclusively convert my hand drawn landscapes into different variations with SD. SDXL generally works great for me, but it does not have a good lineart controlnet. To create animations I usually just use SD 1.5 still.
@Bakobiibizo3 ай бұрын
i got out of the art for money game back when sd1.5 killed my digitial art side hussle so i dont really care to much about license as long as i have weights to play with. in my experiment's ive found that Ip adapters are completely ineffective and that you can get a bit of work out of control nets but they are not perfect. one weird thing i found is that there is some kind of laying going on with the way the model is generating. if you drop the cfg all the way down to .9-1.1 with a generation of a woman you can find a completely different clear image of a woman wearing what looks like a potato sack or something. tick it up a few more and it resolves into a complete different image. its like they took prompts they considered sensitive and included pictures of women in potato sacks in the data set to confuse the model. i think it happens early in the generation and then relaxes. but thats just anecdotal observations on my end nothing rigorous
@blacksage813 ай бұрын
Years ago, a popular joke was that Capcom could not count to three, when it came to the Street Fighter franchise. Now, I'm thinking that the new joke is, "Stability AI should avoid whole numbers, and stick to the .5's" Jokes aside I hope Stability gets something figured out, because if they don't I don't know what's going to happen to their earnings potential.
@TheFutureThinker3 ай бұрын
Yes Matteo, I have feel the same. This model have good potential, when I tested it. It does follow prompt instruction pretty good and as a base model. It just Stupidity AI have not put enough human body in the training dataset.
@latentvision3 ай бұрын
I still have faith! Hopefully 3.1 will be out soon :) Otherwise Lumina to the rescue :P
@TheFutureThinker3 ай бұрын
@@latentvision hehe... I hope so, if their company loan of cloud usage money can be pay off. Then it can go back to a normal Stability AI. I was looking at Lumina ,and Pixart for images, and OpenSora for video. :)
@leolis783 ай бұрын
Matteo, Thanks for the video, it is very very interesting. I really like the inference of objects from the model, the handling of light and textures (as long as they are not of human figure it works excellent). I felt very bad about the licensing issue, Stability should change them, I understand that they want to make money but this decision was very wrong.
@hashshashin0003 ай бұрын
Now I'll have nightmares for the next couple of weeks. Thanks Matteo for the cursed pictures.
@runebinder3 ай бұрын
I've watched a few SD3 videos so far and this has been the best one by quite some distance. Very informative and balanced, thank you :)
@D3PR3C4T0R3 ай бұрын
My primary interests in SD, since November 22, were in trying to achieve actual photorealism, and it has always been difficult. SD3 is quite remarkable in this regard, and I am enjoying finding its strengths and limitations.
@alekmoth3 ай бұрын
How to copy nodes with links??
@shiccup3 ай бұрын
what an amazing video
@koctf38463 ай бұрын
Want to see some analysis of the text encoder difference between fp8 and fp16 version
@latentvision3 ай бұрын
I can give you the TL;DR: use 16fp
@XxXnonameAsDXxX3 ай бұрын
Give it a couple months so we get custom models and other workarounds rolling. Sdxl was the same, and I only started using it when lightning came out then hyper is my go to choice. I appreciate all the people jumping in to test it and it looks very promising
@CarlHemmer3 ай бұрын
I'd love to see how IPadapter plays with SD3.
@latentvision3 ай бұрын
wouldn't we all?
@moon47usaco3 ай бұрын
Thank you for the laugh. Like always, tellin it like it is… As for the anatomy problem. I think it is just poorly trained. Asking for a person swimming will result in horrors. Why would it try to censor swimming people. I think the training just did not allow for uncommon poses. Perhaps all the synthetic training data was in normal portrait, etc poses. ??
@latentvision3 ай бұрын
this version of SD3 is a demo, let's keep it at that. Hopefully we'll get a 3.1 soon
@moon47usaco3 ай бұрын
@@latentvision I am more excited about the CN working in Comfy and an AD model for what we have... =] I do not normally generate women in the grass any how... =p
@LouisGedo3 ай бұрын
19:35 Zzzzzzzzzzzactly! The irrational pitch forks raising is not warranted.
Informative and occasionally hilarious. Love it. Hope you're doing well.
@makadi863 ай бұрын
is there a tile controlnet model for sdxl that works in comfy?
@latentvision3 ай бұрын
yes there are a few options, one is TTPlanet's. Check huggingface
@afrosymphony82073 ай бұрын
please when will prompt injection nodes officially drop??
@adriantang58113 ай бұрын
Very rational and informative video as usual. Thank you!
@goodie2shoes3 ай бұрын
first! Been waiting for your view on things.
@tomschuelke79553 ай бұрын
Naaa.... i am first
@goodie2shoes3 ай бұрын
@@tomschuelke7955 I'll share my trophy with you ;-)
@MrSongib3 ай бұрын
Weird model indeed. ty
@rajahaddadi22743 ай бұрын
از آموزش های بسیار جذاب شما بسیار سپاسگذارم شما باعث ارتقا سطح روابط میان کاربران و مهندسان نرم افزار هستید و برخورد شما خوب و منطقی بود ممنون
@sirmeon12313 ай бұрын
Finally a video showing the potential in SD3 as well, thank you! I like the great parts of the model and hope it can be fixed...
@cowlevelcrypto23463 ай бұрын
" less floating and now carried by ants" Lol
@latentvision3 ай бұрын
🐜🐜🐜🐜
@Homopolitan_ai3 ай бұрын
Thanks, love ❤️
@latentvision3 ай бұрын
sorry, I'm taken 😛
@Homopolitan_ai3 ай бұрын
@@latentvision Lucky them, I can still love you tho 😉
@mikerhinos3 ай бұрын
Thanks for the indepth testing ! I also had a day of testing with SD3 and at first I was amazed by the quality of my benchmark prompts, then I had this "girl on the grass" challenge thing and it's pretty much doable, but you have to go in the deep misty jungle of tinkling every setting one by one, and depending on the image you want it's a total nightmare because a slight change on one setting can totally destroy the image when you just wanted to correct a tiny detail. For some images like this challenge I had better chances using DDIM sampler and DDIM Uniform scheduler, with a high CFG between 7 and 9, and a LOT of steps, between 75 to 125... For other images it's better with a CFG of 2, but globally I have better images with at least 50 steps, which makes it a pretty slow model, with nothing more than what Cascade is already doing. Cascade deserves so much love to me... Anyway with its actual license/TOS for me SD3 is a complete no go, so I didn't digged this much into it.
@latentvision3 ай бұрын
it's so true, cascade passed completely unnoticed. maybe because it was released too close to SD3. I wish I had the resources to do some decent training
@brianckelley3 ай бұрын
@11:01 I had to rewind this to hear it multiple times to make sure I was hearing correctly. Damn, that's funny stuff!
@latentvision3 ай бұрын
😛
@timothywells85893 ай бұрын
Thanks I put off trying SD3 after waking up on release day to a s show on reddit. I will give this a go tonight, just hope I can find the model now civit has taken it down 👀
@blackcloud82183 ай бұрын
It's actually sad, because stability AI is nothing without the the stable diffusion community who trains and refine their base models, which they are mostly at civityAI
@PaulFidika3 ай бұрын
Serious question; is SD3 better than SDXL in any way, other than prompt-comprehension? The T5-XXL text-encoder results in much better prompt comprehension, but are there any advantages other than that? In terms of quality it feels like a downgrade compared to SDXL.
@latentvision3 ай бұрын
the thing that I like the most is how it handles fine noise, more than prompt comprehension
@D3PR3C4T0R3 ай бұрын
I've trained about 50 SDXL LoRAs and have probably 400,000 image generations in it. The photorealistic backgrounds are better in SD3 by every possible metric.
@latentvision3 ай бұрын
@@D3PR3C4T0R I really see the potential of this thing. We need better models
@iraklipkhovelishvili12523 ай бұрын
Since at Stability AI they only do the missionary that means removing the line from the prompt. What a line!