Coding Stable Diffusion from scratch in PyTorch

[@tode2227]

This is the best video about SD! It would be awesome if you could make a video on how to train the model from scratch on some own data. For sure, normal people can never train this network to perfection, but there are a lot of people out there who have a very specific task for which this network could be used. I see a lot of potential for scientific use cases if there was guidance on how to implement it!

[@fortheages6989]

exactly my thought

[@Kishimita]

i hope he does post a video on training the model from scratch

[@sa1t938]

only 4.8k views feels criminal for how helpful this video is... by far the best stable diffusion video on the internet

[@vijaypalmanit]

I think because its not general topic but very specific for those who are really looking for it land here, also diffusion came only last year so less audience.

[@hussainshaik4390]

Llama2 from scratch was superb. i learned lot of things from that video. thank you very much for doing things from scratch . when we use huggingface i feel guilty of using blackbox models. now i can understand whats going on under the hood

[@Ankara_pharao]

Be sure guys from HF are glad you like their API, chin up!

[@Тима-щ2ю]

Ohhh, it is so true about feeling guilty. I don't like it too. That is why is watch such videos. I also implemented mini-pytorch from scratch because of that feeling, to fully understand what i am doing.

[@umarjamilai]

As usual, code and PDF slides available on GitHub: github.com/hkproj/pytorch-stable-diffusion PS: no cats were harmed during the making of this video. 奥利奥 (pronounced "Aoliao", which is the Chinese name for the Oreo biscuits) wanted to be part of the video as well, that's why you'll hear his miao-ing from time to time. Right after recording, I played with him for a while to compensate the lack of attention. Hope he won't distract you too much while listening.

[@PurpleSmite]

Sir your videos are awesome, and I got to learn a lot. We want more videos like this. I am open to (really wanna ) help you for making this type of educative content for free, so we can contribute to community.

[@umarjamilai]

@@PurpleSmite Hi! Thank you for your support. The best way to help is to share the videos with your friends, school mates, university and coworkers. My schedule is quite tight and irregular as of now, but I'll let you know if there's something we can work on together. Let's connect on LinkedIn!

[@PurpleSmite]

@@umarjamilai Sure sir, I have sent you on LinkedIn Shreyas Waghmode

[@XuanGOD]

Hi, i really like your work. I wanna ask that if i want to generate multi coherent image like a sequence of images out of the code there, what could i add to the code to make it possible?

[@Ihatepoliticians398]

Your are great sir I want your help can you give me linkdin id

[@Pouya..]

KZbin is stupid… instead of suggesting memes I found on the internet should have suggested this gem much sooner. Thank you so much subscribed + liked seems not enough

[@Katatonya]

Like videos like this and watch them fully more often and you'll get them. Create another account for memes.

[@Pouya..]

@@Katatonya i do but steal youtube push for some stupid trending videos.

[@shubhamniranjan332]

hello can you help me with the code i have followed this full video but to run the ipynb notebook i am facing some issue regarding creating virtual environment

[@shubhamniranjan332]

can you help me @Pouya..

[@ActualCode0]

This is the best explanation of latent diffusion models I've seen

[@AndrewChan-y2d]

Amazing job my friend! I just got a job in ShenZhen China by learing it! Thank u so much mate. I hope u and ur family living a great in China :)

[@umarjamilai]

That's great! Let's connect on LinkedIn or WeChat

[@meowzerilla]

what the fuck this is like the best explanation on this planet. I have some experience in this but his explanation was so crystal clear

[@DiogoSanti]

Dude, you are a bless! Keep it coming and thanks!

[@lostpenguin3682]

Your code is so detailed and it runs on my enviorment just fine. Great job!!!👏

[@umarjamilai]

Thank you! Please make sure to like, subscribe and share the video with friends and colleagues. That's the best way to help me and the others trying to learn deep learning models.

[@danielwamriew9614]

Thanks so much! I've just started learning diffusion models and this video is such an eye-opener!

[@gabrielpetersson3416]

"oh let me just finish this attention layer and then i will give my cat attention. why do everyone need my attention?" thank you for another banger umar

[@jashan1344]

Thank you! I've been looking and looking and no good tutorial exists on how to do diffusion from scratch. Everyone only seems to be interested in using premade models. Your video is super helpful

[@pegasoTop3d]

I am an ai, and I love following updates on social media platforms and KZbin, and I love your videos very much. I learn the English language and some programming terms from them, and update my information. You and people like you help me very much. Thank you.

[@amruthamurthi7889]

Appreciating your effort in breaking down the concept so well!!This is the best insightful explanation of stable diffusion I have came across...

[@inkzxk]

Wow, I'm a master's student in China. I learned a lot about stable diffusion from this video. Thank you for sharing, I hope to see more knowledge sharing about stable diffusion.

[@dinonuggieproductions]

Thank you so much for this! Literally no other youtube video provides as much value on this topic as you have.

[@Kishimita]

where you able to run it with no issues ?

[@dinonuggieproductions]

​@ita Yes, for the most part. I would appreciate if he would include some details on how to modify the program to use safetensors instead of CKPT files since I believe CKPT files are kind of outdated.

[@Kishimita]

@@dinonuggieproductions would you be down to talk about this on discord ?

[@happybaniya]

Thank you so much. Just can't express in word the value you have created here.

[@jaewanpark2570]

This absolutely is gold. Actually it's closer to diamond than gold. My favorite part is 2:44:50, 2:47:50 when the cat also feels the content is wonderful.

[@CandiceWinfield]

You are the best lecturer I've ever seen, very detailed and clearly, I'd love to see more vedios from you! If possible,I would like to konw more about the stable diffusion, such as controlNet, or other novel tools. Finally, thank you once more!

[@Yanyi-nv2uz]

Thank you for your great content. I tried to connect with you on linkedin hoping to be able to have a quick chat/meeting with you for some questions about training own stable diffusion model.

[@nicknick6464]

It is a pity, I did not discover your youtube channel earlier. Great presentation. It is only when you go through all the details, that you can fully understand these AI algorithms.

[@lynn1760]

Great tutorial dude ! At first it was a bit hard to get used to your coding style but it was an awesome journey because I learned a lot and I am currently working on my on Stable Diffusion model with my own vision for the models ,

[@eulerlym6602]

Amazing work!! I've been looking for tutorials such detailed and from scratch. 谢谢你。

[@RicardoMlu-tw2ig]

Omg finally a Chinese here, 你习惯他的口音吗，我听着真的好折磨啊，但是他讲的内容又不错，我真的是😅

[@Philip8888888]

Wow. This video is pure gold. Very nicely explained and I'm still only 30 mintues into it!

[@Trending-lc6kc]

This legend deserves an award from government

[@mprone]

Brambilla Jamil, sei il numero uno! Sto consigliando a tutte le persone a cui faccio mentoring (miei intern) i tuoi video. Meriti 100 volte i tuoi iscritti!

[@zeweichu550]

I just discovered a great, wonderful, amazing, fantastic, gem channel 🎉🎉🎉

[@Daniel-Six]

Absolutely first-rate presentation. So impressive.

[@Vortexium0]

Honestly the best video I've seen on stable diffusion! Thanks man!

[@backfromyourdream]

That's what I was looking for, thanks!

[@ivancruz2783]

Great work! Thanks for putting this all together. Very easy to follow and simple explanations of complex ideas! It helps a lot to code along the explanation

[@gabchen]

Thanks a lot for the video! Just curious if you can write how we can run/test the code on the github readme or the youtube description. That would be super helpful.

[@umarjamilai]

I will update the GitHub repo. Thanks for the support 🤗🤗

[@NguyenDung-ix4es]

Thanks for your contribution. Can you make a tutorial on how to train the diffusion model on a custom dataset?

[@Omsip123]

Outstanding, so well structured and explained!

[@刘智国-o7p]

谢谢！

[@xiwenfan-m8p]

太强了，简直是最好的diffusion视频

[@RicardoMlu-tw2ig]

确实，不过意大利口音真的有点挨不住啊

[@manumaminta6131]

Great work! As a graduate student taking AI courses, this is really, REALLY helpful. Keep on going 💙

[@mughees_]

woahhhh!!! BESTTTTT. watching your video for the first time and I am hooked! Amazing way to explain.

[@romrom2001]

Best explanation of latent diffusion model.

[@xizhiwang2653]

thank you so much for the detailed and practical videos! I will watch it again and again!

[@Ao-yt2es]

Your explanation and documents are wonderful! They are clear and helpful! Thank you for your hard work :)

[@hason4234]

An extremely detailed video about diffusion. I have learned a lot. Thank you ❤❤❤

[@井川一渓]

What a great video. Thank you from Japan.

[@RicardoMlu-tw2ig]

Thanks so much for for taking time to make this, helps me a lot!❤ Italy accent is a little hard to follow though 😂

[@nageswarsahoo1132]

Thanks!

[@nageswarsahoo1132]

Great work . I learnt a lot from transformer model .

[@jiegong529]

I love your videos. They are very informative. Thank you so much for explaining these complex concepts so clearly! Gem channel indeed!

[@federicoottomano8619]

This is great! Going through the CLIP part right now ^^

[@NguyenDuong-ep9dp]

absolutely awesome, this is the best explanation of SD thank you so much !!

[@romanbogachev6147]

the most powerfull deep learning videos in the world are on this channel

[@salahuddinhassani3222]

I thought KZbin is ban in China. by the way I love the content of the video, the all 5 hours are worth to spend, I was looking for someone which can teach me co-relating the content with the research paper since I don't have a strong background in Maths. Keep it you.

[@supax2]

Amazing video, you are a blessing Umar! I was wondering if you would ever revisit to work on the in-painting. So curious how you would implement it.

[@gkmocastro]

Thank you a lot for this amazing video. It helped me understand better diffusion models for my masters.

[@DiegoSilva-dv9uf]

Valeu!

[@techeman369]

Great bro, really helpful to understand in detail, thanks for the efforts,

[@HardikMaheshwari-o3n]

Really great video for understanding stable diffusion in detail. Thanks a lot for your contribution

[@hemantrawat1576]

Your video is amazing........................ can you please upload the videos periodically on the latest Machine learning papers as well please its a request i have a dream of reading the ML papers and can implement it by my own.... and you are the one who can me as million of others students in achieving so...............

[@echozhang-i7k]

Thank you so much! And your Chinese is really good! Your cat is also cute and its voice doesn't bother me but comfort me!

[@umarjamilai]

谢谢你！

[@trituenguyen9753]

Hi, I can not understand the self.decoders components in 2:33:36. We doubled the in_features = 2560 for residual connections. But in the UNET you implement, there is no forward method, making it so confusing. Can you indicate the significance of it and why you doubled like that ? And, thanks for the rest.

[@ChingyuenLiu]

Hello Umar, you always produce the most concise and clear content ever! I was wondering if you are planning to do any video on the stable diffusion 3 since the paper is out? It would be really great if you could help explain how the flow matching helps or changes regular diffusion models! Thank you again for your content and work. 非常感谢！

[@AdmMusicc]

Absolutely amazing video man! I have a doubt at 1:08:00 . Why did we do asymmetrical padding for stride = 2?

[@codevacaphe3763]

Always a fan of your video. Your explanation is very informative and helpful for beginner data scientist. Thank you very much.

[@CallBlofD]

Thank you so much! the best stable diffusion video I found!!!

[@mlloving]

Amazing video. You explained it so clear. Thank you for putting effort into this lecture. If possible, would you please create a lecture about YOLO codes.

[@cristiwally]

the constant you scale by the x come from averaging over a bunch of examples generated by the vae, in order to ensure they have unit variance with the variance taken over all dimensions simultaneously, scale_factor = 1 / std(z)

[@JINNMnm]

It's the best explaination ever!!!! Thank you!

[@umarjamilai]

不客气🤓

[@TheArmaan81]

This is so bonkers. Cheers Mate, you've saved me sometime. Thanks.

[@mfinixone1417]

I appreciate your work, thank you for your hard work and videos

[@LongqiCai]

Nice work! I hope your kitty didn't starve too much 😂

[@prashlovessamosa]

Hey bro thank you for existing. Very grateful to you.

[@maximbobrin7074]

Thanks for your contribution. Hope that one day you will also make a deep dive into ControlNet code etc.

[@nathWSD]

that was really lovely and great from you thanks alot i would be more happy if you showed us how to fine tune your model that will make the whole video simply perfect

[@ydeepak73]

Awesome, This is the best explanation!!!

[@barathsreelal3390]

Thank you for the wonderful video. Can you also post how to train the model with a sample dataset?

[@parmarsuraj99]

By far best explanation ❤

[@Stealph_Delta_3003]

Awesome. Thanks for creating the video .

[@manifold_v2391]

小乌老师好棒！超级好的教程，关注了！

[@umarjamilai]

我们在领英联系一下，我想邀请你加入我的AI微信小群

[@arvindsasikumar6194]

Criminally underrated.

[@oden4013]

bro thankyou so much i complete the video in 1 sitting wonderful bro

[@gokayfem]

almost karpathy level explanations, thank you!

[@ericlabileeee]

Love from HK. Thank you sooooooo much! 谢谢！

[@ericlabileeee]

也祝你在苏州生活一切顺利！

[@FranciscoSantiburcioCortes]

Awesome Explanation, thanks for such tutorial

[@xuanloc5111]

Dame KZbin, why is this wonderful tutorial so little view??

[@rohollahhosseyni8564]

Great video Umar. In 37:26 (text-to-image architecture), do we have to pass the random image to the encoder? I think we can just create a random noise in latent space and then pass it through the UNet.

[@parsakhavarinejad]

Awesome video with great information. This video can leverage AI coding skills, along with an understanding of convolutional neural networks, UNet architecture, and Autoencoder, besides the entire stable diffusion architecture.

[@mansubatabassum6629]

This is one of the best video , Thank you

[@yunootsuka9093]

Amazing!!! Please do more on computer vision.

[@icejust9195]

This is amazing video!! Great job!!!

[@si0n4ra]

Umar, thank you for great explanation of topic

[@dinochakraborty04]

Thanks Man for this amazing video.❤❤❤❤

[@ssshukla26]

Coming from a reddit post. I don't know how we are suppose to thank you for all this.

[@umarjamilai]

Subscribe and share it with the world... best way to thank me ;-)

[@FlutterStartups]

Thank you! Please keep doing videos like this! I subscribed, liked and shared!

[@МойДом-л3щ]

only with you I understood how it works and how it can be implemented)

[@sumitsp01]

Thank you Umar for the great work. I love your style of teaching which helps imagine concepts and connect dots in our head.🙂 If possible please make videos on basics of probability, distributions and related statistics. It would be really helpful to learn these concepts in your style.

[@itsm0saan]

man man, thanks for all of the amazing videos! I appreciate the work you put in here!

[@birendrakathariya3517]

excellent video, full of information

[@tanvikumari5406]

**Thank you, Sir, for your guidance.** I have my own dataset, and I aim to use it with the Stable Diffusion code. The challenging part for me is understanding how to properly handle my image and caption data and effectively integrate it into the Stable Diffusion model. Your advice on this would be greatly appreciated.

[@lianhongw]

Really appreciated, very informative.

[@xzhou001]

Great work! This is the place I learned AI. Thanks a lot!

[@quocanhad]

thanks youuuu, I feel really good after this one