Stable Diffusion 3 IS FINALLY HERE!

[@MuckoMan]

So much for the early release email I was supposed to get when SD3 came out. Thanks Sebastian!

[@sebastiankamph]

I think I beat the email by 30 minutes, give or take. Happy to help!

[@mastertouchMT]

Great introduction. Cant wait to see what the community models bring to the table now

[@mauriciolee7349]

Thank Sebastian for comparing Stable Diffusion, Midjourney and Dalle3 in such details. Your video helps me a lot in making an informed decision of selecting the app that meets my needs.

[@BoyanOrion]

Thank you. I tried it and it works really well. Waiting on A1111 to do a patch update so we can also test the models there as well.

[@MrDvneil]

some sd1.5 paint/drawing styles, can do landscapes with a lot more detail per resolution than current sdxl models, at the end you use them all, for the parts they excel. i suppose sd3 will take some months to lift off, see how people use them and some good models appear, maybe in 6 months, will see.

[@JustArtsCreations]

Yeah I agree. I see far too many people comparing sd3 with fine tuned models like its a fair comparison. (I like how Sebastian compared to base models here. Much better IMO Will take time to see the true strength of the new stuff )much the same happened with SD1.5 too) Great comment yo!

[@Eleganttf2]

​@@JustArtsCreations i agree just like how SDXL first came out its rough especially lots of great 1.5 fine tuned models out there at the time

[@szach-i-mat]

But problem is with license - no commercial license in version 3

[@JustArtsCreations]

@@szach-i-mat you must have missed the new license the other day. its exactly the same as the other models now.

[@jameshughes3014]

That mid journey character cracked me up.

[@skycladsquirrel]

Love his cinematic lighting! lol

[@goodie2shoes]

he needs his own show

[@Chyrre]

"Heay guuys i can doo perrtty imagess"

[@fly_goku]

rofl *_*

[@Catdevzsh01]

great now do it for flux

[@TheSnakecarver]

2B or not 2B?... that is the question.

[@sebastiankamph]

Best comment

[@Elwaves2925]

Damn, I just posted that myself. I guess I should have checked first. 🙂

[@SkullModder]

no 2b nier :( gotta stick to pony xl for that

[@nunads]

Kudos on the roleplaying the different models scene! That was great, definately left me laughing 😆

[@sebastiankamph]

Glad you enjoyed it! Wanted to try something different and I had fun doing it :D

[@bankenichi]

The midjourney bit at the end cracked me up xd

[@AdonhiramSD]

I have been watching your videos since I discovered Stable Diffusion in january, many thanks for all the info you are bringing to the community. The first part of this video with the role-playing was awesome and so funny, well done :) On reddit and on the UD Discord, people seem quite mad at Stability AI though, regarding the performance of SD3 and its absurde license.

[@justinwhite2725]

Missing from the tests: actually trying the examples from the resesrch paper in SD3 to see if it can actually do those things.

[@peterr6595]

Sebastian, SD3 is GREAT …for text interpretation. I use AI to build graphics/posters for my screenplays. I need to describe more than one person in my prompt. In SDXL clothing A would ‘bleed’ in to clothing B. Characters were always wearing the other’s clothing. I had to submit multiple prompts - I mean a lot - just to get close. SD3 fixes that. Last night I started resubmitting all my graphics for my show bible. Accurate characters every time.

[@JustArtsCreations]

Running the medium version on my 1070 just fine here. Love it! By the way you were by far the first to upload a video about this so ty

[@sebastiankamph]

You're welcome! How's the speed?

[@JustArtsCreations]

@@sebastiankamph Its not actually all that bad the step count is 9 seconds on average for me so really not far off from SDXL

[@azuki2919]

@@JustArtsCreations Running on 1070ti pretty much the same

[@Eleganttf2]

​@@JustArtsCreations what's the Vram usage while generating with SD3 2gb if i may ask can you check it while its generating in task manager ? Thanks!

[@JustArtsCreations]

@@Eleganttf2 Oh its maxed it out at 8 GB i should also say other than my GPU at 1070 its a beast of a machine so the rest of the system is doing alot of heavy lifting (i9 1490k, 64 gb ram) but VRAM 8 GB

[@Airbender131090]

3.0 is horrible. Its broken. Censored. No comercial License. Noone wil fine-tune it. This is 2.0 all over again. All they shown on twoter was 8b. Bot this one. So sad :(((

[@eliparrish9145]

Spread the word about what is in the terms of agreement. They are insane.

[@Airbender131090]

@@eliparrish9145not obvious for now. We need to wait for their answer.

[@thinghy3]

xl is the only way still.

[@szach-i-mat]

​@@thinghy3 Exacly 🎉

[@MikkoRantalainen]

I guess it depends on what kinds of prompts you're looking for. If you go with more accurate description such as "transparent acrylic pig statue, a small opaque pig statue inside the bigger arcylic statue" you'll get much better results with Dall-E. A very short description is more like "I'm feeling lucky".

[@zephilde]

I liked the fact you explained a bit the new tech behind the version number, but it could be interesting (in future though) to get info on the 3 clips, wtf is t5, model files specificity and more technical stuff than just how to install (there's READMEs). Hope you have to try it a bit before 😇

[@sub-jec-tiv]

Finally here, and horrendous corporate garbage license! Go away SD3!

[@thejbot]

I appreciate the download information at the end of the video.

[@thejbot]

rather than up top.

[@mistercapitale]

Love the skit. Great work.

[@sirmeon1231]

We can all hear the cooling fans of GPUs in the whole world run wild! Happy generating, folks!

[@sebastiankamph]

My little office is already much warmer. Yours too?

[@joechip4822]

SD 3 has now officially made all concerns about climate change obsolete - Chapeau :-)

[@sirmeon1231]

@@sebastiankamph Absolutely! I am experimenting with it as much as I can without things like pcm, lcm, hyper, turbo etc. out yet...

[@peacefusion]

That SD3 license is a slap to the face to all those that supported SD for the open source community. Sd3 or Adobe? I cant tell them apart now. The license is a bill and a cuff combo

[@Maisonier]

Excellent video, what great news! Now I'm going to wait for you to release a video on how to make a LORA with SD3 so I can create my LinkedIn profile picture 😅

[@TheBagOfHolding]

Great video. I like the skit.

[@SnoochyB]

LOL, that was a good laugh, you should do more stuff like that. 😀

[@neuraldee]

This new format is fire!

[@sebastiankamph]

Glad you like it! Do you think actor Seb should make a comeback for future videos?

[@neuraldee]

@@sebastiankamph Definitely! 👌🏼

[@MilesBellas]

Hooray ! 😊👍😁🙂 Emad, Robin Rombach, Andreas Blattmann, Patrick Esser and Dominik Lorenz & team = Amazing!

[@GAMINGGEEKzzz]

lovely cant wait to try it out thank you

[@Yoshi92]

I really liked the comedy part as a good explanation of the differences. Thank you for this video! :)

[@yu-gg]

Lets goooo I waited for your video!! thanks bro :D

[@phoenixfire6559]

The problem with SD3 is you can't make LoRA's or checkpoints with it for commercial purposes, even with the paid Creator's licence - the ToC for enterprise is not visible. Here's the relevant part of the Creator's License: In Section 2(b)(ii), except as expressly permitted in the agreement, You cannot "modify or prepare any derivative work based upon the Stability Technology or any component thereof". Additionally, the definition of "Derivative Work(s)" in Section 1(d) includes "any modifications to a Core Model, and any other model created which is based on or derived from a Core Model or a Core Model's Output(s)." So based on these provisions, you are not allowed to train or refine Stability's existing models to create derivative works. So let's say someone puts a checkpoint or LoRA on CivitAi, every single one will be for non-commercial use only - even if you have a paid licence. Afaik, nobody uses the base models so unless something changes, I don't see much use for SD3 even if we get the 8b param model.

[@davidm8966]

SD3 is an absolute joke! :D even my standard pony models create better limbs. holy shit this release is so scuffed

[@matthallett4126]

I just generated some images locally using the same prompt set I've used to test since 1.5 and they're better than even the SD3 API version. Beautiful lighting, better faces, but hands are still a problem. I just posted my results on the facebook SD page.

[@swannschilling474]

Thanks a lot!! Cannot wait to get my hands on it! 😊

[@Airbender131090]

Have you seen cascade finetunes? No? Wanna know why? No comercial license. Pony Guy already said there will never be Pony 3.0 ( 2b) with this license.

[@lifemarketing9876]

Woah SD3 is here! Heck yes

[@killergod1419]

you are unbeliable good actor...

[@MadazzaMusik]

i been using sdxl and generating 1080x1280 fine no bad hands or weird things excellent quality too

[@Avenger222]

I'm so sad... They completely gutted anatomy because they repeated their mistake from 2.x with an overagressive filter. At least it can do landscapes...

[@fabgeb667]

vote for leftism, get this

[@Avenger222]

@@fabgeb667 Bro... this is non-partisan around the entire world. This has nothing to do with "leftism". Both the left and right are in favor of regulating AI around the entire world. Who do you think nudity offends? 🤣

[@beetwing]

@@Avenger222 censorship means the end of the the free world, which has started since couple of years.

[@adamjenkins3065]

found out about the release from your vid. Thanks!

[@hjups]

You will probably have to use T5+CLIP to get the prompt adherence from the paper.

[@midjourneyman]

I am excited to give this a try but I am very looking forward to AD model! :D

[@goodie2shoes]

you the guy in the video?

[@quantumangel]

Wooooo!, It's here!

[@ai.research]

I would like to point out, that the license for the SD3 is completely useless at its current state. This need to be sorted out before people will invest ANY effort into SD3. This is very, very dissapointing. Just an example exerpt from this mess: Creator License $20 per month, the number of Images generated is limited to 6,000/month. I wonder what Stability wants to achieve with it. How they even plan to control this? Too many nasty questions.

[@peacefusion]

all while using the open source community as thier personal honeybees.

[@ScottLahteine]

A little off-topic, but when and where do we still find SD 2.0 and SD 2.1 useful? Are there specific use-cases where one of these is a better choice than 1.5 or SDXL? As mentioned, 1.5 can still accomplish a lot, has great speed using LCM, uses fewer resources, and has more complete tools and models. Seems like the most facile workflow today would use SD 1.5 for speedy exploration and near-realtime painting, then apply a newer larger model for image refinement. But maybe the 2.x models have specific talents that make them worth including…?

[@sebastiankamph]

Sadly not really. They're now dead. What they could do better than 1.5, sdxl now does (and now sd3).

[@ESFAndy011]

The Dall-E pig-inside-a-pig generations remind me of that jontron episode where he checks out cursed Frozen flash games (Disney bootlegs episode for anyone who's curious).

[@moonstrobe]

You should have done more comparisons with actual SD3 :)

[@tex1297]

Sir you are the winner

[@zephilde]

That MJ bleu/red light !! 🤣

[@TheCynicalNihilist]

wait, is it only for Comfy? is there no automatic1111 version yet? im running forge. how do i install??

[@IceMetalPunk]

There's a GitHub issue opened on the WebUI Forge repo for SD3 support. This is the last comment posted 8 hours ago as of the time I write this reply: "@huchenlei could help with this on the dev branch, when he'll have time." ~dan4ik94 So people are working on it, but it might take some time.

[@Eleganttf2]

Lol same using Forge here

[@149315Nico]

Comfys almost always quickest to adapt changes and the devs working on sd3 are using it themselves to test their shit, support was out before sd dropped, probably lots of people working on automatic support rn, forge is always really slow in updating but will probably deliver a great efficient implementation if they do someday. if you can’t wait, you’ll have to deal with the spaghetti I guess

[@cihiris2206]

Really excited! So many even better models to come for the community. Now how do I run this? :D

[@jopansmark]

StabilityAI is so back!

[@dontrez8412]

That kinda didn't age well.....but then again, in the near future, it may have..... Great video regardless. It still helped me understand the differences between the different models a little better.

Was expecting a tutorial on how to install and setup SD3.

[@sebastiankamph]

See my "How to install comfy" in the description, then download the model from SD3 video and use the workflows provided.

[@SiCSpiT1]

Incase you're too afraid to download the 8B and 16B encoders, they both have a low VRAM mode that I've ran on a 3070 (8GB). I've 32GB of system memory that gets maxed out when loading the 16B encoder, so if you've less RAM you may not want to bother. They both produce similar images, at least in low VRAM mode, so I'd sick to the 8B encoder.

[@Pawel_Mrozek]

I checked this four prompt examples in Ideogram and it smashed all four ot them. Moreover the frog and the pretzel it has done better and more accurate than Dalle or SD3.

[@guns1inger]

Running the Medium version on a 3060ti. 1024x1024 in under 25 seconds at 28 steps. Still does weird things with limbs . . . . . . .

[@sebastiankamph]

What was your speed with SDXL?

[@AgustinCaniglia1992]

Why are they still releasing a +20 steps models when we have 5 step models

[@godlesschannel7730]

@@AgustinCaniglia1992 faster= usually worse quality and loras rarely works with them so less variety,less unique art

[@AgustinCaniglia1992]

@@godlesschannel7730 i have been using dreamshape or reavix and juggernaut lighting versions and quality is amazing. Loras work good in my experience as well..

[@spawnv2]

try comparing between models that they benchmark themselves in their paper. SD3, dalle3 and Ideogram, specially in typography ideogram 1 is king. (page 10)

[@WillPeters22]

Bro your best video yet. 😂🎉

[@GAMINGGEEKzzz]

will you make video for automatic 1111 as well in the future ?

[@sebastiankamph]

Once a1111 updates you can just drop the file in the /models/Stable-diffusion folder

[@Lv7-L30N]

Thank you

[@sebastiankamph]

You're welcome!

[@ngshighlites7507]

Here’s a money idea! Just remember me whoever hits it big. Once AI can continuously generate hands it will be even more difficult to distinguish AI from non AI art. The idea make something that can analyze images in-depth and can easily tell the difference between the AI and real art.

[@DisgustingJustinAD]

I hear that it's free to download, but hearing many others saying it's going to cost $20 a month to use.

[@pastuh]

Wow, there is so much salt on Reddit about SD3. It looks like 2B of data is not enough.

[@enthuesd]

HAHAHA hilarious video thank you

[@とふこ]

It just cant generate people at all. Maybe pixart sigma needs more support.

[@testales]

Gave it a quick shot, worked out of the box to my suprise.But it has a hefty bias, not as extreme as the google one but there seems to be a strong preference for "people of color" . I also already got twisted limbs basically instantly, deformed hands and even people without face which my due to some censorship effect though. But we'll see what comes out of this. As long as there's no control net support its usefulness is limited at best anyway I'd say. Otherwise a 2B model also seems to be a good choice considering that's right in the middle between SD 1.5 with about 1B and SDXL with 3.5B.

[@Bone-studio]

Please, talk about the license and the limitations it suppose for any kind of use other than hobbyists, even for you as a youtuber.

[@BT-vu2ek]

Yeah, but 3.5 will print money! Out next week!

[@xilix]

I can't wait to train this.

[@sebastiankamph]

What are you going to train it on first?

[@goodie2shoes]

@@sebastiankamph bwoops?

[@jasonhemphill8525]

@@goodie2shoesbobs and vagene

[@xilix]

@@sebastiankamph People's faces and royalty free photography as well as my own. I do stable diffusion photoshoot packages and I have a feeling these extra layers are going to provide precisely the boost in flexibility I've been looking for.

[@Airbender131090]

@@xilixsory to disapoint. Ot sosnt work woth humans. They destroyed anatomy. Not sutavle for lora/dreambooth of humans

[@udonpraguypanya2992]

Can we use in normal A1111, I don't really comfortable with ComfiUi at all...

[@Eleganttf2]

Yeah same, just wait for A1111 to patch it

[@madrooky1398]

SD3 in this release state is really not good. Too much effort went into censorship which hurts the quality even when not trying to create nude images. It can do text and objects and is better to understand complex prompts, but when it comes to humans it can't compete with fine tuned sd15 models. Far from it.

[@maikonpagani1222]

I'm getting "Error while deserializing header: HeaderTooSmall" with any of the models, do you know if I have to update something? (RTX 3080 10Gb). Thanks!

[@AerisRG]

Try other UI for SD3, it called StableSwampUI or smt like that

[@20xd6]

reddit is crapping on sd3 since it sucks at making people.

[@oneanother1]

It was highly anticipated and hyped up, I mean with all that was going on internally with stability ai. It might as well be the last base model we'd ever get from them. The community is built around stable diffusion. Stability ai keeping the good model behind a paywall pretty much ends community development. Sd3, no one will care anymore for it if the quality isn't better than older models. I know they need to make money somehow, so I get it. If they can make their paywall sd3 better than what the community can do, than make it so. So far it doesn't look promising.

[@FluorescentApe]

I really hope they implement SD3 for A1111, because i like the UI better on it. ComfyUI is such a mess and has few settings.

[@jac001]

Super disappointing release. SD 1.5 Mods are still wayyyyy better, and Midjourney is still king by a mile.

[@A.polon.i.a]

Hey Sebastian, what's the best version to download for general use please.... normal, with clips, with clips & t5? I'm still fairly new so I'd appreciate your advice.

[@sebastiankamph]

Probably the normal ones and then use clips separately, and running CLIP only (no t5). So basically what I did in Swarm at the end.

[@A.polon.i.a]

@@sebastiankamph Thank you... so the 4gb model then?

[@SkullModder]

rip to the coomers no pony for sd3

[@divide0011]

I've downloaded the file and put it in the models folder but its not working when im selecting the checkpoint

[@sebastiankamph]

And the clips in the clips folder? (Unless you use swarm). What's happening?

[@pavi013]

It's crazy that SD 1.5 is still the best one. I was testing SD 3 before and it looked very good.

[@monamibob]

a bit disapointing that the SD3 results miss the mark by so much and that you didn't include them in the side-by-side comparison. Also whats the point of snarky comments at MJ? it clearly had the best results in your own tests...

[@genAIration]

Fast. Thank u 🙏

[@sebastiankamph]

I got you!

[@happycollapse6348]

My English is bad I may have missed something but I did not understand the point of comparing the images of SDXL, Midjourney and Dall-E, knowing that the video talks about SD3. . Why not compare with SD3 ? I don't understand this video.

[@happycollapse6348]

But thanks for the good news

[@tomschuelke7955]

he showed SD3 images before from the 3D3 webpages, and afterwords tried the same prompts for the other models

[@happycollapse6348]

@@tomschuelke7955 Oh ok thanks !

[@Onsearching]

So far tested and it is not even close to what was promised... It will require controlnet and other things to get prompt adherence, so it is just like 1.5 and xl...

[@MrSongib]

Two years for a good jump for AI stuff since sd15. (assuming sd3 is easy to use and had more people using it in the future)

[@dibbidydoo4318]

Prompt Adherence? SD3 Anatomy? SD1.0

[@illuminat_empire]

Midjourney the best👍

[@stefanb.8462]

I installed SwarmUI to test SD3, but I just get terrible results with the same prompts that worked in older models. I guess there are some aspects in SwarmUI (I used ForgeUI previously) or in SD3 that I overlooked.

[@BeastLT]

No.. the model is just dumpster fire. Just look at the r/StableDiffusion

[@McxgamecasterYT]

Fr

[@tails_the_god]

hey do you know which EXACT version of stable diffusion perchance ai art plugin uses?

[@Elwaves2925]

2B or not 2B? That is the question.

[@Elwaves2925]

Just saw that someone beat me to it. Oh well, I'm off to write with my 2B pencil while I wait for the install to finish.

[@jamesclow108]

Now......how do we train it?

[@CoconutPete]

Taking a wild guess this won't work on A111

[@sebastiankamph]

Sadly not yet as their last update was 2 weeks ago. But I'm sure it won't be too long.

[@CoconutPete]

@@sebastiankamph surprised I was able to get sd3 running on comfy with a GTX 1660 ti

[@Modozenmusic]

these tree nodes are missing for me : TripleCLIPLoader ModelSamplingSD3 EmptySD3LatentImage

[@McxgamecasterYT]

Gotta download the models and place in folder yk

[@hoodooguru1450]

You have to update ComfyUI. They were added on Monday or Tuesday.

[@seandonnelly5338]

I've already discovered that it REALLY hates some samplers. Like DPM++ 3M.

[@paulpardee]

If we're personifying the models - SD1.5 is boomers, SDXL is Millennials, SD3 is Zoomers.... so that would make SD2 Gen X because everyone forgot about it :D

[@rickyneeter69]

Older stable diffusion lets me render over 100 images at a time while 3 makes my memory crash at 15 pictures

[@silhoutte81]

Waiting for Automatic 1111 version.

[@97BuckeyeGuy]

I understand that you wanted this video to come out immediately, but I think you really missed the big story of the SD3 release... it's absolute garbage with human anatomy. I mean, it is truly, truly horrible. Unusable, even. Really sad.

[@ayrengreber5738]

The big story is they have shown they no longer will create stuff that can be used to make money without paying them.

[@richardadonnell]

🎯 Key points for quick navigation: 00:00 *🆕 Introduction to Stable Diffusion 3* - Overview of Stable Diffusion 3 release, - Instructions for downloading and starting usage, - Comparison of the 2B model with the 8B model. 02:00 *🛠️ Key Features and Enhancements* - Enhanced text prompt understanding and resolution capabilities, - Introduction of the 16-channel VAE for better detail retention, - Compatibility with various image sizes. 04:00 *💻 Performance and Requirements* - Differences in resource requirements between 2B and 8B models, - Benefits of the 2B model for most users, - Explanation of diminishing returns with higher capacity models. 06:00 *📊 Research Insights and Comparisons* - Summary of research findings on improved autoencoders, - Comparison of FID scores across different channel configurations, - Examination of perceptual similarity metrics. 08:00 *🖼️ Image Quality and Generation Comparisons* - Visual comparisons between SDXL, MidJourney, and DALL-E models, - Discussion on text rendering and image detail differences, - Analysis of various prompts and their outcomes. 12:00 *📥 Downloading and Using Stable Diffusion 3* - Steps for downloading models and setting up, - Overview of different download options and encoders, - Initial generation examples and settings configuration. 15:00 *🎮 Final Thoughts and Next Steps* - Encouragement to start using Stable Diffusion 3, - Mention of future content and continued exploration, - Closing remarks and invitation for viewer feedback. Made with HARPA AI

[@darkman237]

Have to sign up with hugging face- won't let you d/l otherwise...

[@CamoPeng]

I'm new to this, i didn't understand what you did in the interface and how you're supposed to configure ComfyUI. I managed to follow the docs but I get the following error when trying to "Queue Prompt" AttributeError: 'NoneType' object has no attribute 'tokenize'

[@TE-qu4jz]

Hmm, how would you be able to see the translucent pig, if it were inside the smaller pig? ;)