The U-Net (actually) explained in 10 minutes

Want to understand the AI model actually behind Harry Potter by Balenciaga or the infamous image of the Pope in the puffer jacket? Well.. diffusion frameworks such as DALL-E 2, Midjourney, Imagen or Stable Diffusion seem to get a lot of credit, where as the true unsung hero of the story is the underlying U-Net architecture that they all actually use under the hood. Don't get me wrong Diffusion models are awesome but the U-Net is an absolute STAPLE when it comes to computer vision and this video aims to break it down in an easy way. Originally used for image segmentation the U-Net has developed into so much more. Happy watching!
U-Net paper: arxiv.org/abs/1505.04597
Many thanks to numerous online resources that helped me create this video.

[@salmanzafarsatti1346]

man, this video is such a great explainer. I was confused about the use of skip connections since a long a time, but he explained the intuition behind it very nicely.

[@rippingmyheartwassoeasy]

Thank you for creating this video! Its the best explaination of how a U-Net works that was easy to understand. The visual animation is superbly done!!

[@mayankukani9600]

Why didn't I find your channel before. Please upload more content, the best content on Deep Learning I have seen.

[@rupert_ai]

Thanks a lot :)

[@Anton_Sh.]

This architecture is one of the truly brilliant ones in the world of deep learning in terms of its simplicity and efficiency.

[@Natstranaut]

Oh my god man. Awesome videos. Keep it up, I'm really enjoying them!

[@thebakareview8009]

This channel deserves more subss!! Great content and delivery :)

[@pushkar9021]

Continue this series, very helpful

[@jacobidoko3924]

Yooo...this is quality content right here. Thank you so much for putting this out

[@user-kv2pi9mf8r]

Extremely useful for beginners like me. This is very good

[@mridulsehgal7773]

The best ever video you can get on Unet explaination

[@LucaBovelli]

dude thankssssss i thought this was another one of these things thatll take me 2 hours of youtube to *not* understand, but u saved me

[@jsparger]

This was extremely helpful. Thank you

[@jayhu2296]

your explained under 10 minutes videos are goated

[@JohnZakaria]

This was the best unet explanation I have ever seen

[@ubanaga]

Very nice my friend, this has been most helpful

[@shubhamarle96]

thanks for the video, I am trying to use U-net for anomaly detection in time series and your video gave me the idea.

[@transcendingvictor]

Thank you very much for the time put on doing thisvideo. Interesting and helpful :)

[@user-ux4st6hh2d]

Woooooow! Finally I understood it , really great explanation, thank you

[@jaybrodnax]

I feel like this is more a description to experts than an actual explanation of how and why it works. Questions I'm left with: What is the purpose of downsampling/upsampling (I'm guessing performance?) How is segmentation actually done by the u-net? How is feature extraction actually done? What are max pooling layers? What does "channel doubling" mean, and what does it achieve? How does the encoder know "these are the pixels where the bike is"? Why is it beneficial to connect the encoder features to the decoder features at each step, versus in the last step? How does unet achieve anything other than downscaling/upscaling performance efficiency? Where are the actual operations to derive features? How is u-net specifically applied for various use cases like diffusion? What does diffusion add or change, for example.

[@abansalah4677]

(Disclaimer: I am a beginner, and this is not intended to be a complete answer.) You should read about convolutional layers and pooling layers to better understand this video. At any rate: A colored image has three channels: R, G, and B. A convolutional layer is specified by some spatial parameters (stride, kernel size, padding) and how many filters are there - the number of filters is the number of channels of the output. You can think of each filter as trying to capture different information. Doubling the channels, therefore, means using double the number of filters when using a stride of 2. The segmentation is done just like any ML task - the training data consists of pairs of images and their annotated versions. I think it's often hard to decipher the inner workings of a particular neural networks, and your question can/should be asked in a more general way - how do neural networks learn?

[@TheHopeOfTruth]

Thank you for great explanation.On basic level it helps better understand unet

[@hexeldev]

This video has been extremely useful. I subbed.

[@willlowtree]

i love your presentation style

[@sakethsreeram6981]

Great presentation!, Easy to understand

[@gokulsaisrinivas5312]

very good explanation of U-NET

[@nikhilchouhan1802]

You might not find my comment since the video is too old, but man I just want to thank you for this video. I am a student who has always been interested in computer graphics and related fields like game engines, physical rendering, ray tracing, etc, and jst didnt get the ML/AI hype everyone was on the past 2 years. I only ever managed to study ML basics for 2 weeks before I left it for good. But recently I got in a team where my friends were working on CNN based projects, and that made me learn about many basics about NNs and DL. This explaination for Unet seals the deal for me, and I will strive to work on integrating my two interests into one and hopefully create something I love.

[@aligreen786]

Very nice explanation. Thanks a lot.

[@niralpatel5889]

This was great, would love a video on diffusion transformers! It looks like they are taking off and replacing U-Net's as the backbone to new diffusion models.

[@pratyushsahoo4948]

Absolutely amazing work 🎉

[@coffeestudi0s]

Yooo the effort haha. Amazing Video!!!

[@xarisalkiviadis2162]

Amazing video, cleared everything!

[@amolkumar1538]

This is Just awesome, great video

[@TechHuntBD]

Nice explanation

[@gregorioosorio16687]

Thanks for sharing!

[@user-ef7je7yw7r]

wow awesome video and explanation

[@vijaykumarb9622]

Great Explanation.

[@nagham96]

Thank you that was so helpful and cute! 🤩

[@usaid3569]

Great video champ

[@Topninja6]

Thank you so much. Now I just need to figure out how to implement this for my project lol

[@LautaHillkirk]

nice video, very helpful

[@r.walid2323]

thanks, good explanation

[@kiraqueenyt5161]

such a well made video

[@miguelxplayer9641]

Dude, you're great. I'm from Portuga 🇵🇹 🟩🟨🟥🟥and I'm learning Machine Learning and Neural Networks. Thank you very much! I loved how you teach. You are intuitive and dynamic. A person is learning a difficult subject and still manages to laugh when watching the videos. I loved. I already subscribed and liked. I'm going to watch more of your videos now. Hugs from Portugal😉

[@s4lome792]

Clearly explained. What caused my consfusion in the first place is, in the graphic in the original paper, why does the segmentation mask not have the same dimensionality than the input image?

[@PAHADIBABAJI]

Very helpful

[@Grapemaid]

Thanks a lot lot. I understand it!

[@Nerthexx]

If downsampling works by max-pooling, how does upsampling work? In traditional image processing, we would just interpolate image colors, but how does the network apply it's "convolution" in this process? I would understand "deconvolution", but in my mind it wouldn't work here.

[@AyushGupta-fv1lx]

May be Transpose Convolution

[@ny8828]

hi its very helpful, how can I reach the PowerPoint of it?

[@dfparker2002]

This explains inference (I think) by decomposition (dividing) and recomposition (adding) images. Is that accurate?

[@sisami2109]

very nice dude thank you so much

[@BooleanDisorder]

What's the background music called in this video?

[@_the_one_who_asked_]

Hi, thank u for this video. can u pls do a video to explain YOLO?

[@ingenuity8886]

Thank you very much bro...

[@alirezasaberi6383]

awesome! can you calso make similar (actually) for Unet++ and Unet3+ please??? thank you so much.

[@rupert_ai]

Glad you liked it! Its not currently on my list of to-do videos as I like to cover the most popular fundamentals at the moment, but I'll let you know if I get around to it! :)

[@ajipboy]

bro , immediate subscribe!

[@poggiesgw]

good stuff

[@JohnVinchi-bk2dw]

this is extreeeemely helpful,and funny

[@rupert_ai]

Thanks John!

[@Ngochi-ff7hk]

I still don't understand that the output is x2 or x3 or x4.I don't understand why that is the case?

[@user-xm1zy3pj5k]

Hi. I find the video very interresting. As I'm at the begining, i'm little confused. please, can you also propose a pdf file ? thank yu. Nicely

[@abhishekkanojia2816]

cool videos

[@puekai]

Still don't know how it works

[@Englishwithshima1993]

Perfect

[@MacProUser99876]

nice explanation. but why distracting background music?

[@endlesshybrids]

Agreed. Good explanation but I wish people would stop using background music.

[@1.4142]

Dalle 3 is coming to gpt 4 and it can write text!

[@notrito]

If anyone wonders how to concatenate the features if they don't match the size... they crop it.

[@007bindass007]

Nice Comment: Useful 👍👍😎😎

[@timanb2491]

goodgood

[@MrMadmaggot]

Now how they coded it?

[@rupert_ai]

Hahaha well there are actually plenty of online code implementations available but I will see if I can get round to a code tutorial on the u-net sooner rather than later!

[@rishabhbhardwajiitb178]

@@rupert_ai can u provide one

[@linamallek6900]

nice video, but ideo i hate the music in the background ( so disturbing )

[@LucaBovelli]

bro why did u stop making videos i need you lmao (its a painful lmao.)

[@leoyu6400]

hope you can come back to life

[@c.e1187]

Is he dead?

[@BooleanDisorder]

​@@c.e1187nah, just busy I imagine. He was active on github in December so

[@truck.-kun.]

​@@c.e1187maybe yes. Only on KZbin

[@user-mn2bj1hw1vdtfhgh]

Me seeing the video at 1.5x 😂😅

[@jonathangallagher3116]

TIGHT TIGHT TIGHT

[@yyww4267]

Really impressive vedio! And fun work at the end!!!!! LOVE LOVE LOVE!!!

[@rupert_ai]

Thank you very much! :)

[@jcpouce]

music is too distracting... :(

[@alteshaus3149]

no

[@SarraAissaoui-sp3sm]

I clicked on thumb down for wasting one minute of my precious time in the intro. Get to the F point !!

[@websterfenoff8936]

Promo_SM ✅