How Stable Diffusion Works (AI Image Generation)

Get NordVPN 2Y plan + 1 months free here ➼ nordvpn.com/gonkee It’s risk-free with Nord’s 30-day money-back guarantee!
Support me on Patreon: / gonkee
Kaggle fish dataset: www.kaggle.com/datasets/croww...

[@Gonkee]

Get NordVPN 2Y plan + 1 months free here ➼ nordvpn.com/gonkee It’s risk-free with Nord’s 30-day money-back guarantee!

[@jungervin8765]

Could you do more videos about 2D soft bodies, 2D physics simulation? Your videos super helpful.

[@algee2005]

that was an interesting experience... i've seen some videos on this topic, most left me with more question marks then i had before. but this was somewhat like opening my brain and pouring a full book in there. like in matrix. i can't really tell what i've just learned, just that it was alot, and that it will be helpful later on. you surely are some dark magic ninja teacher :D

[@ahumon9947]

It’s insane just how informative this is. When I watch a Gonkee video, I expect a funny video, but this has taught me more than any wikipedia article ever could.

[@treasureking8142]

Agreed 👍

[@dreamyrhodes]

To be fair WP articles are mostly pretty shit on anything unless you already bring basic knowledge in the methodology a certain science field uses, it's pretty hard to make anything of a detail out of it.

[@KBRoller]

An important aspect of this that a lot of people misunderstand is that the things which are learned are kernels and visually semantic text embeddings. Which are very different from just memorizing/copying the training data, despite so many people insisting these models are, in fact, just copying/stealing training data. This is much more akin to how humans learn to make art: studying existing works, extracting those observations into features and techniques (kernels), learning how words describe visuals by... learning to talk, basically (visual semantic embeddings), and then combining it all to make new images. Although the diffusion model is more like "learning to remove stuff that doesn't match the requested visuals", there's a famous quote attributed to Michelangelo about how his sculpting is just "removing the marble that is not David" from the block -- very similar.

[@algee2005]

yea, by that logic every artist is basically stealing art, because he learns on and from already existing art and have that art influence his own work. those thinking ai is stealing art need to reconsider the way art is actually made. people don't understand the concept at hand, and they are afraid of things they don't understand, and that is the actual problem here.

[@KBRoller]

@@algee2005They're afraid of the consequences of capitalism, but they either don't realize that or they don't want to blame capitalism, so they project their fears onto the AI that's making them face it and make up rationalizations for why they think we should fear the AI. Capitalism is what enforces the idea of "if you can't sell it, then it's not worth doing and you deserve to die"; AI isn't what says that.

[@Katatonya]

@@algee2005Yeess! That was exactly what I was thinking when I saw artists say I demand to get payed for these models trained on my art. But duude what about all the people that like your art and are learning how to replicate it, should they pay you as well? NO, lmao. You put it up for the public. One consequence of that is that other people (meat or machine) can learn your style. And I'm pretty sure he himself learned from others.

[@ujjwalkumar-uf8nj]

Buddy, youtube needs more creators like you, I watched a lot of videos on stable diffusion but non of them made this much sense, please upload more deep learning content like this, the way you summarized computer vision is just amazing.

[@danieljunginger]

21:01 yo I had to stop the video just after you said 'if you don't get anything from here on now don't stress out...', to tell you that I think you are amazing for daring to making videos like this, where you maybe don't have the biggest audience (yet), but provide people who actually care with so much value. I feel like you really stand out with this combination of explaining it in easy terms (in relation to the complexity of the topic) but sufficiently enough to give others an actual grasp of the topic and enabling people to make more advanced research afterwards. I think that in some weird sense the saying: "Give a Man a Fish, and You Feed Him for a Day. Teach a Man To Fish, and You Feed Him for a Lifetime". describes pretty well how I think about your content. Thank you very much for your efforts Gonkee and keep it going!

[@andrewstephens9787]

please make more videos like this regarding AI. I've learned so much from this in 30 min than the past 3 hours I've been studying. Informative, entertaining and hilarious. You sir a gem 🙌

[@dexterathferth]

Excellent, excellent video. So refreshing to have someone who pulls back a bit from the camera and doesn't talk in an obnoxious, gamer way, and instead explains very clearly and precisely, using helpful accompanying materials. Definitely one of the best deeper SD explanations.😃

[@NotTofuFood]

I found your channel close to 3 years ago off a reddit post and commented on your very first video. I did not know this was the same person going into this video, and I was absolutely MIND BLOWN. Insane progress and I am so proud of your videos. This video was incredible and actually blew my mind. Great job.

[@CrushedAsian255]

Same

[@naytron210]

This is, by far, the best explanation I've come across in my search to understand how SD is doing what it does. Bravo sir, and thank you!

[@SombreroMan716]

Before watching this video, I had no idea how any of this stuff worked. You were able to explain these concepts to me in a way that many other videos failed, and in only 30 minutes as well. Wow.

[@BinaryDash]

I should note that if you are having trouble connecting to a wireless printer (or a chromecast in my case) check that you're _not_ connected to a VPN

[@CrushedAsian255]

Lol

[@allygg]

I've spent the last few weeks consuming 10s of hours of content on deep learning from neural nets through transformers and found this when trying to get into stable diffusion. Honestly, this is some of the best informative content I've ever consumed - totally outdoes everything else on coursera/youtube/wherever for visual explanation. Plus you got bants as a bonus, what a guy, please keep it up!

[@BiosensualSensualcharm]

27:51 break; literally 😂 ❤love your style. Congratulations

[@3KnoWell]

Excellent presentation. I especially like your statement, "If you have made it this far in the video? That's already pretty impressive." What is truly impressive is the level of detail that you deliver in a short amount of time. Thank you, ~3K

[@Nuwiz]

Thanks for the video! The receptive field of each convolution is also effectively enlarged by doing several convolutions in sequence, not just by pooling operations.

[@chemaguerra1635]

Absolutely wonderful effort. Much liked and appreciated, Gonkee.

[@DruidpathXo2]

This is an amazing video, I've been struggling with the concept, well, and laziness but this video has inspired me to continue ny project which contains some aspect of stable diffusion, thank you

[@notanengineer]

Yay Gonkee video

[@JohnJCB]

Yay Gonkee video

[@Omsip123]

Yay Gonkee video

[@mister_meatloaf]

Yay Gonkee video.

[@MrRobot-xs5jf]

Literally the BEST video on this topic on the sight, everyone else fills too much jargon but you keep it straight forward and break down concepts Very well

[@saeidanwar8587]

One of the best video tha I have ever seen about AI.

[@rahulpant9807]

wake up babe new gonkee vid just dropped

[@WebGrrrlToni]

Gonkee, you are a gifted trainer/explainer! This video makes so much sense (even though I am a total noob) because your visualizations walk through the concepts so beautifully. I am so glad I found this!! I now follow you and look forward to reviewing your other vids. Thank you for helping me (not a math person, but an artist and visual learner) become more familiar with how AI image generation works.

[@greenrabbit4075]

the "2 hours to connect to a printer" got me! Yesterday I tried it for the 4th time with my super smart hp knobhead. The little smart effer finally made it ^^

[@Zylop6]

Congratz on the 110.000 my dude, absolutely crazy!

[@ManderO9]

bro god bless you for how much effort you put into this, you have learned what people study in uni for years, i look up to you, thank you so much for the educational content

[@nintishia]

This is the first video I have watched on this channel and I am absolutely wowed by the way you have explained it all. Thanks a ton.

[@hurtjonnegut]

Thank you for the encouragement, I’m at the 21 minute mark and I’ve struggled despite your clear and straightforward explanations thus far. Great video.

[@CrushedAsian255]

This is such an impressive video, I remember you from your first videos and it’s so impressive how far you’ve come

[@ingyukoh]

very impressed by Gonkee's intuitive grasp of semantic segmentation and U-net. One of the best lecture

[@pcguidelk]

Appreciate your work. Although I could not grasp many things explained, I realized this is a darn lot of processing & amazing to just being able to type and get a video clip or an image!

[@pharos640]

Finally, you didn't make the video too informative or too funny. I like this kind of videos. Keep up the good work! (im waiting for 1M subs)

[@arnavjain7564]

This was a fabulous explanation! Makes it way more trivial to wrap my head around!

[@JasemMutlaq]

Stable Diffusion finally make sense. I watched many other videos and they always talk about "denoising" an image which makes absolutely no sense when it comes to image generation (by itself). This is exactly when some creators explain generative AI as just "next-token-predictor" as if this is sufficient to explain how it really works. Thank you for the wonderful video and the geniuses behind these technologies.

[@robbysun3137]

Bravo! Well done. The right dose of mathematics and the mention of U-Net make it really easy to understand the basic concepts of how stable diffusion works.

[@thrillscience]

Thank you! I've read half a dozen blog posts where it was clear the author had no idea how it all worked, then finally I saw your video and got a great overview of the whole thing!

[@endgameyt7735]

Simply the best video to stable diffusion I found so far. Thanks a lot! I like your humor.

[@pretzelbat.m]

Amazing job breaking this down, highly comprehensible!

[@OgatRamastef]

It clarifies a lot about how these generative ais works. Thank you!!

[@greenlight2k]

The "London - England + Japan = Tokyo" example really blew my mind, because it makes totally sense, yet I never saw this logic approach this way before. Think of "London" and every aspect of it: This is the Vector (Mind-Map). Now remove the Vector of "England" from that London-Vector, and you will be left with the most prominent aspect of it: "A Capital City". Add the "Japan"-Vector to that and you basically end up with "Capital City of Japan"

[@chunji2321]

Love your hoodie

[@thefellowbreather]

This is next level! I owe my understanding of these fundamentals to you. Keep up the amazing work bro!

[@meeradad]

You have an amazing ability to teach with visuals to make intricate concepts accessible.

[@TheGamingHungary]

Even though I probably won't make use of the knowledge in the close future, I watch your videos in general becase the topics and your explanation are top notch. I really wish we had uni teachers/tutors like you. Straight to the point, no bullshit, keeping it interesting, maintaining the attention of the viewer, well done! 10/10

[@svg98]

Awesome explanation, really clear and excellent visuals. Sure to be a source of information for many in the future, thanks!!

[@dirtandpines]

Thanks for making this! Learned a ton and didn't need to get a computer science degree first to understand it!

[@PaperpapaSmurf]

this blew my mind! But was totally digestible. Thanks for making this!

[@inzaynclasses7129]

the best video on stable diffusion out there , that deserve so much more what it gets now , i can see how much efforts he put frame by frame

[@jamesli6875]

This is really good！ Deep，conceptually accurate, and clear! Thank you for sharing!

[@lukerobertson01]

This really made a lot of sense. I understood self-attention before, and now I magically know cross-attention! Thanks

[@DrDaab]

Terrific Explanation, Thanks ! Now I understand how clicking a button will give you a verbal description of an image (just the reverse of the text prompt).

[@RohanVetale]

Damn the video is detailed but at the same time easy to understand for a beginner person like me. Thanks for the video!

[@thomas.milburn]

Great video very well explained. Would love to see a similar video on LLMs

[@dexterman6361]

Wow this video is amazing, really well made, and informative, thank you

[@imKaku]

Thanks a lot for the video, this was really informative overview of the things i feel that i need without diving into the direct math, since there is a few years since ive done it by now ... Definitely went quite a bit into things ive budget into and have had questions on how they work together in a conceptual level.

[@seyedmatintavakoliafshari8272]

I've seen your previous videos and, as a grad student majoring in AI, I'm very impressed by how you delivered! Learned a lot here, so definite thumbs up and share!!

[@goodbrainwork]

Is this taught in your university program?

[@seyedmatintavakoliafshari8272]

@@goodbrainwork no

[@goodbrainwork]

@@seyedmatintavakoliafshari8272 what they teach instead of this?

[@pranavarora1799]

Great explanation for people of all levels. Keep it up!!

[@TupacsStepSisterlocoman]

awesome video, helped me grasp a pretty complex concept

[@rishiktiwari]

Excellent Explanation, fully worth the time. Thanks a lot 🙏🏼

[@Gamamaha]

Wow your explanations are brilliant, thank you.

[@laura-gm5ur]

thank you very much for this video. It was so informative and soo well made. Thank you!!

[@Grow_Channel]

The only explanation which I was looking for, Ausome Brother❤

[@Eswarramesh2428]

Love your channel bro

[@gameofpj3286]

Amazing! Thank you so much for making this :D

[@ThankYouESM]

I'm working on a very new approach I call Focus-Select-Image-Generation, which is an image-evolution process from often clicking real-time generated thumbnails almost like the image-enhancing process. Main difference is... we can have full control to get what results we want, although not as a text-to-image generator. My version will still require A.I. for it to capture important details such as correct light refractions, correct proportions, correct shadowing... etc.

[@neonelll]

Insane explanation. One of the best.

[@connor4440]

Crazy good video nice job gonk

[@cekuhnen]

Super detailed video - very much enjoyed it!

[@MohamedKrar]

A great self explanatory video full of information...

[@FunGuyInDFW]

@Gonkee This is a great video. However, I've watched a lot of videos on Stable Diffusion recently, and I've found that there are a few important questions that none of them have addressed. Perhaps you could make an addendum and address these questions because I'm sure many people want to know. 1. Is the "seed" for Stable Diffusion the same as an image containing maximum noise? 2. Does Stable Diffusion use a randomly generated image with maximum noise as the starting point for the new image it will generate? 3. If so, are the pixels in this maximum noisy image truly random, or do the pixels already have a pre-chosen mathematical relationship to adjacent pixels or to images from the training library? 4. The training of the neural network appears to work in 2D with the pixels of the training images, but the images are usually 2D representations of 3D objects. Does the network develop an understanding of the 3D characteristics of the objects in the images, or does it strictly build up probabilities of pixel colors (or something else) based on pixel color patterns from the training images? 5. When building a new image, does Stable Diffusion just find ways to insert the pixels of components or subcomponents from objects in images from the training library into the new image, or does it build the images strictly based on the likely pixel colors (pixel by pixel) deduced from the neural network, or some other process entirely? 6. Do you think the way Stable Diffusion builds new images is similar to how the human brain can see objects or animals in a Rorschach inkblot test or in the shape of clouds in the sky, or would you say the process is not similar?

[@sallami6627]

Thanks for asking these questions as many of them have perplexed me and I cant find any resources that give an explanation.

[@FreePal334]

Finally, i have some intuition of what query key value might mean 🙏

[@hendrysconovianus8546]

This is very informative!! Thank you very much!

[@davidniquot6423]

Very good explanation .. ! Thanks.

[@StonerSquirrel]

Basically like traditional painting using the ala prima method, but instead of handling brush strokes everywhere in the canvas evenly, it's a handles every damn pixel in the screen.

[@evaar440]

bruh .. I can't describe in words how amazing this video is!

[@musthavechannel5262]

Great explanation. Thank you

[@lebronjames635]

I understood like half of it, can’t wait to start with CSE 👍 great video regardless

[@Sebastian-lw1ei]

Excellent primer!

[@itssoaztek4592]

Thank you for this masterpiece of STEM education. Incredibly well made.

[@feztrath9470]

best explanation i've watched

[@ALDUIINN]

excellent video, i'm ready to go in the most absolute techinical part of it, thanks

[@sizex1966]

Thankz 4 uploading, I'm having fun with these Ai generators, I saw a Diffusion footage a month ago & said 'how' funny enough I shot some footage 2day that I hope I will b able 2 put Diffusion 2 work, thankz 4 the explanation, it makes sense 2 me cause I'm a computer geek from college dayz 1984 when I left & I've been working with them until now, the future is Ai like your self I'm not concerned about Ai taking over, cause u can just pull the plug. Guidance & Protection Mannerz & Respect!!

[@FergalByrne]

Sure you’re not some future tech AGI sent to help us get to your timeline? No other explanation for such an extensive lossless compression into 30mins. Bravo!

[@glitchy_off]

Cool, Ilike this informational video format

[@pedrogorilla483]

I’m revisiting this video after having learned ComfyUI. Much easier to understand Stable Diffusion now.

[@haedrichowen]

This is one of the best videos on ai

[@carlovonterragon]

Very good explanation ☺️ thanks

[@alaad1009]

This man has an IQ of 200 and explains complex stuff like a champ !

[@MikeSieko17]

query key and value are just SVD, they correspond like query = U, key = Sigma and value = V 26:12

[@RandomZzzz]

This is pure quality this is insane.I want you to explain transformer architecture for next

[@billy.n2813]

Thank you very much for this.

[@yehonatan8371]

Great video, thanks!

[@UliTroyo]

Shovel == sold. Subbed.

[@theworldsco-creators7073]

Amazing video. Thanks

[@adrianfels2985]

17:28 - What Input did you gave the network here? Just noise? Because the network denoised images which didn't exist before didn't they?

[@bakedbeings]

Best statement of AI-shock so far. 0:20 P.S. I'll listen hard. Yeah, I've added this to my Sleep playlist , but that doesn't mean anything.

[@laucoinna2415]

Such a wonderful explanation. Bravo! I learned a lot from you. I wish i could find your personal website or google scholar😅

[@ianbryant]

Dude you are a G.

[@stati5tik]

no, he is not.

[@sawantbhardwaj6111]

Very well explained , i feel lucky to have clicked your video

[@Angel-vc3bw]

Gonkee VIDEOO LETSS GOO!!!

[@1218omaroo]

To me, the base processes now make sense. Thank you, very much-appreciated.