Reviewing & Rating 50 SDXL models

I've tested and rated 50 different Stable Diffusion SDXL models in a structured way, using the GoogleResearch PartiPrompts approach, by assigning 107 prompts for each tested model to a Classification and Challenge Matrix, which resulted in rendering more than 5.000 images.
I believe that this method - though rather time-consuming - can give a more concise view on the strengths and weaknesses of a model and helps evaluating and comparing models in a more structured way, rather than using just random prompts. But, of course, it's still a subjective view to some extent.
You can download my whole evaluation paper from Gumroad for free (donations welcome):
goblenderrender.gumroad.com/l...
Google Parti Paper:
sites.research.google/parti/
PartiPrompts Github Repository:
github.com/google-research/parti
Chapters:
00:00 Intro
00:22 Evaluation method (Google Parti-Prompts Matrix)
01:32 Render Settings in Automatic1111
01:59 Download my Evaluation Paper from Gumroad for free
02:20 SDXL Base model / explaining the evaluation
03:29 Copax Timeless XL
03:44 SDXL Unstable Diffusers ☛ YamerMIX V7 Electric Mind
03:57 ZavyChromaXL v2.1
04:12 Dreamshaper XL1.0 alpha2
04:28 [Lah] Mysterious | SDXL v4.0
04:45 ProtoVision XL
05:03 DucHaiten-Aiart-SDXL
05:20 DynaVision XL
05:36 LEOSAM's HelloWorld
05:53 NightVision XL
06:10 Juggernaut XL
06:27 SDVN7-NijiStyleXL
06:45 blue_pencil-XL
07:00 SDVN6-RealXL Detailface
07:17 SDXL Yamer's Realistic
07:33 CounterfeitXL
07:50 Realities Edge XL
08:07 WoW_XL
08:24 RealVisXL V2.0
08:41 [SDXL] RongHua
08:56 XL6 - HEPHAISTOS SD
09:15 XXMix_9realisticSDXL
09:32 RealCartoon-XL
09:49 Anime Art Diffusion XL
10:08 Formula XL
10:25 Realistic Stock Photo
10:42 SDXL Yamer's Realism
10:59 MorphXL
11:16 TQ - WonderfulWorldXL
11:34 RealMix XL
11:50 SDXL Unstable Diffusers ☛ YamerMIX V8 Heaven’s wrath
12:07 TalmendoXL - SDXL V1.1 Beta
12:25 WyvernMix XL v1.1
12:41 SDXL YAMER'S PERFECT DESIGN V3 Definitive Sketch
12:58 Realism Engine SDXL beta
13:15 Acorn is Spinning
13:32 SDXL Nuclear - General Purpose v2
13:49 SDXL FaeTastic V1.6
14:06 CanvasXL
14:23 EnvyExpressiveXL01
14:40 Tdg8uU_SDXL_MIX_V2
14:56 DEMON CORE
15:11 Copax Avatar Cute
15:28 nijiGameXL
15:44 Colossus Project XL
16:01 MOHAWK
16:19 Ultrium.V3.1.VAE
16:35 The Ally's Mix X - SDXL
16:52 Sassy Girls SDXL
17:09 Model Rankings, Top Models, final thoughts
For downloading the models, please get my Evaluation Paper from Gumroad - all links included there!
#stablediffusion #automatic1111 #sdxl #partiprompts

[@yeetmcyeetson8822]

I'm here from the subreddit, I just want to say i appreciate you so much for taking a scientific approach, especially as it's a small channel, and I can see how much effort you must have gone thru, handpicking every model generation and giving each model a chance. AND then making your findings free to download? Ridiculous how much effort you put here. Lots of love mate. Keep up the good content and I can see you making it big in the ai scene. Thanks for the wonderful analysis!

[@bigdon2802]

Really interesting work , congrats. There is so many models out there to test and you making this research def help the community.

[@SpeedTravelTH]

Best models review I have seen so far. Great job!

[@arturabizgeldin9890]

wow! that's huge! I like your structured approach! Go on :)

[@arnaudcaplier7909]

Fantastic and very impressive work. This is so helpful !!! Thanks a lot for producing and sharing it !

[@RayDusso]

Really good analysis. This is a gold mine of information. Thank you for your hard work.

[@danielwiemann1210]

Really nice and informatic Video. Havn't really done a deep Dive into the sdxl Models so a good starting Point. keep Up the good Work :)

[@Afr0man4peace]

Thanks for testing my models (Colossus Project XL and DEMON CORE). Really good comparison. Thanks for all your work.

[@tripleF33]

Wow, I can truly appreciate the immense effort you've dedicated to creating this video. Admirable work👏👏

[@letitiadominica2588]

Only criticism on this method of ranking is that it should have made multiple generations with specific seeds for each prompt (like how many where successful on 10 out of 10). And perhaps the recommended settings for each checkpoint (like clip 2 or etc). You will notice that it will make a huge impact on your specific type of ranking and you notice that a lot of models will almost generate the same results (specific seed will expose what base it is using).

[@kairemv1484]

bro... I just know the channel and I can not do more than thank you and subscribe to continue learning from this, it's amazing the amount of effort, work and hours you invested in this research, and above all what I admire most is that you like to share this to everyone who sees you. It's an incredible job, thank you.

[@viktor4405]

I just changed from 1.5 to SDXL and this has helped me lots, many thanks for the good work!

[@jibcot8541]

I wouldn't have used "Euler A" sampler as it is not a convergent sampler and you could end up with a very different image with a few more or less steps either way, other than that it looks good.

[@oliviermoebius7306]

Congrat ! What a nice job ! I have my own set of test but I think I will integrate your prompts. I noticed that many models change drastically from one version to another (Juggernault XL 9 to 10 for instance, classic or Turbo/Lightning versions)

[@coloryvr]

WOW! Very cool! Very helpful! Big fat Fanx and Happy colored Greetinx!

[@tripleheadedmonkey6613]

Thank you very much for covering my model. WoW, I'm chuffed to say the least. Yours isn't the first model compare list I've graced the top tiers of, and I hope it won't be the last. But I still love the work you put into this!

[@Pooriel]

thanks for awesome info!

[@fadilabn9832]

Thanks for effort and share

[@techvishnuyt]

saw ur post on reddit! great video

[@djflusterduck]

Thanks very much for the comparison. I find it very balanced and useful. Do you have any plans on a follow up comparison with some of the newer models?

[@ghostsyscoco]

It's a very real evaluation. I also simply tested a lot of SDXL, and I have the same agreement as you. It seems that you also missed an excellent model: Crystal Clear XL. I think it can be rated B. Isn't it the champion of the civitai competition?

[@vilainm99]

Fantastic job! Well done and thanks. But like you said,, it is getting a liitle bit stale… I would really like an small update on your A and B models and maybe some other up-and-comers. I mostly use Juggernaut, but you have given me nice pointers on other, maybe better models. Thanks again.

[@intermatrixnaut1]

I came across this also some how and have Yamer in DM XDHe was curious, and shared the url to your pdf

[@MysticHaven_Ai]

I would love to see your review for starliht animated!

[@gamingchamp2424]

make a same kind of video for loras and can you make video about 1.5 models