ResNet Explained Step by Step( Residual Networks)

Explained Why Residual networks needed? What is Residual Network? How Residual Network works? What is the logic behind ResNet?
If you have any questions with what we covered in this video then feel free to ask in the comment section below & I'll do my best to answer your queries.
Please consider clicking the SUBSCRIBE button to be notified for future videos & thank you all for watching.
Channel: / @codewithaarohi
Support my channel 🙏 by LIKE ,SHARE & SUBSCRIBE
Check the complete Machine Learning Playlist : • Machine Learning Tutorial
Check the complete Deep Learning Playlist : • Deep Learning Tutorial
Subscribe my channel: / @codewithaarohi
Contact: [e-mail]
ResNet50:
ResNet, short for Residual Networks is a classic neural network used as a backbone for many computer vision tasks. This model was the winner of ImageNet challenge in 2015
ResNet50 is a variant of ResNet model which has 48 Convolution layers along with 1 MaxPool and 1 Average Pool layer.
In 2012 at the LSVRC2012 classification contest AlexNet won the the first price, After that ResNet was the most interesting thing that happened to the computer vision and the deep learning world.
Because of the framework that ResNets presented it was made possible to train ultra deep neural networks and by that i mean that i network can contain hundreds or thousands of layers and still achieve great performance.However, increasing network depth does not work by simply stacking layers together. Deep networks are hard to train because of the notorious vanishing gradient problem as the gradient is back-propagated to earlier layers, repeated multiplication may make the gradient extremely small. As a result, as the network goes deeper, its performance gets saturated or even starts degrading rapidly.
Skip Connection - The Strength of ResNet
ResNet first introduced the concept of skip connection. The main innovation of ResNet is the skip connection. As you know, without adjustments, deep networks often suffer from vanishing gradients, ie: as the model backpropagates, the gradient gets smaller and smaller. Tiny gradients can make learning intractable. It allows the network to learn the identity function, which allows it pass the the input through the block without passing through the other weight layers!
#Resnet #ResidualNetwork #CNN #ConvolutionalNeuralNetwork #PifordTechnologies #AI #ArtificialIntelligence #DeepLearning #MachineLearning #ComputerVision

[@saravananbaburao3041]

Easily one of the best video in Resnet . Crisp and clear explanation. Good job

[@CodeWithAarohi]

Thanks

[@duen-shianwang378]

Thank you so much for your excellent explanation of Resnet!!!

[@CodeWithAarohi]

Welcome

[@tejasbankar3136]

thank you mam for this. I saw almost 4-5 videos on youtube, but didn't get ResNet. You make it very simple. Thanks!

[@CodeWithAarohi]

Glad it was helpful!

[@eliashossain4327]

What an explanation! This is a masterpiece tutorial, and thank you, Ma'm, for making such mesmerizing video.

[@CodeWithAarohi]

Thanks a lot 😊

[@coolandhot2006]

Great explanation! Thank you so much, I know what ResNet now. ^^

[@CodeWithAarohi]

Glad this video is helpful

[@muhtadirshihab]

Thanks, Ma'am for your easy explanation. I spent almost entirety day to catch some things. It's all clear for me now. Keep updating such materials related to CNN. I am also interested in learning Data Science related to mathematics from you.

[@CodeWithAarohi]

Glad this video is helpful. And i have a playlist named “statistics for data science” there you can learn maths . I have few videos in it , rest will update soon

[@muhtadirshihab]

@@CodeWithAarohi Thanks so much for kind information. I will obviously check cause I need to learn maths.

[@_sonu_]

you can't believe I minimise the video for giving 👍 likes, but I found I already had liked@@CodeWithAarohi

[@codebite3951]

This is an excellent description of resnet50 architecture. You earned a subscriber. 👍

[@CodeWithAarohi]

Awesome, thank you!

[@ThamizhanDaa1]

This is the best video on this topic!! Thank you so much, Aarohiji.. Your help is greatly appreciated for my research.

[@CodeWithAarohi]

I am glad my video is helpful.

[@raajproduction9462]

Love you mam,,,,,I really love your explaination....Thank you very much for making such a video

[@LucyRockprincess]

i've watched 10 videos explaining this and yours was the best

[@CodeWithAarohi]

Glad to hear that 😊

[@ayay9423]

This video is very helpful! Thank you so much for explaining this :)

[@CodeWithAarohi]

Glad it was helpful!

[@hulkbaiyo8512]

back to this old video, and get back and review, just realize how beautiful Resnet it is. how those ppl come up with those cool ideas

[@chandrasenpandey5108]

Well explained maam thank you so much for explaining this 🙏

[@CodeWithAarohi]

Welcome

[@widdalightsout]

Thankyou so much, this was really helpful.

[@CodeWithAarohi]

Welcome

[@supritodeysarkar4094]

You make deep learning easy!

[@CodeWithAarohi]

Glad to hear that!

[@durgarani9573]

Thank you very much mam for your good explanation about ResNet.

[@CodeWithAarohi]

You are most welcome

[@ariouathanane]

Thank you for this video. Excellent work

[@CodeWithAarohi]

You are welcome!

[@mahadrashid2794]

Amazing step by step by explanation!

[@CodeWithAarohi]

Glad it was helpful!

[@yaqubshuaib5060]

this is the greatest explanation i have ever seen upon this topic. thank you

[@CodeWithAarohi]

Glad it was helpful!

[@yaqubshuaib5060]

@@CodeWithAarohi Mem i want a certificate course on AI, ML,DL .If u make any course on this topic i wanna enroll under u .

[@RanjitSingh-rq1qx]

Mam, you are to good. Really trust keep going on your way. Your content is really very helpful. I didn't see such a content on KZbin.

[@CodeWithAarohi]

Glad to hear that.

[@QingyuanYang]

I appreciate the patience and very useful repeat in the presentation!

[@CodeWithAarohi]

Glad it was helpful!

[@abbas19852000]

Thank you Ma'am for your great and amazing explanation

[@CodeWithAarohi]

It's my pleasure

[@afnersirait]

Thankyou so much. This explanation is really helpful

[@CodeWithAarohi]

Glad it was helpful!

[@jibinjohn1530]

Explained very well. Good work

[@CodeWithAarohi]

Thanks

[@MohitKumar-zh9en]

much much thanks mam , very very much far better from my college professors

[@CodeWithAarohi]

Glad my video is helpful! Keep watching and learning 😊

[@rahulchaubey8988]

Very detailed explanation. 👌👌👌👌

[@CodeWithAarohi]

thankyou

[@csabarikannan]

Really Worth of my time to watch the video. Great explanation Madam.

[@CodeWithAarohi]

Glad to hear that

[@munnaram8527]

Thanks ma'am for such nice explanation.,🙏🙏

[@CodeWithAarohi]

Most welcome 😊

[@yashsonar9400]

Great great Explanation. Thank you so much mam

[@CodeWithAarohi]

Most welcome 😊

[@manikhossain5697]

Thank you so much.

[@CodeWithAarohi]

You're welcome!

[@vinaymurthy4388]

Very well explained. Thanks

[@CodeWithAarohi]

You are welcome!

[@sorymillimono5931]

thank you very good job and explanation.

[@CodeWithAarohi]

Glad it was helpful!

[@user-fl5qv7ce6e]

thank you much , so helpful video

[@CodeWithAarohi]

You are welcome!

[@balagurugupta5193]

thanks a lot for the neat explanation

[@CodeWithAarohi]

You are welcome!

[@manojexpert]

Thanks... very helpful...

[@CodeWithAarohi]

Glad it was helpful!

[@lukmanahromi8295]

Great explaination thanks!!

[@CodeWithAarohi]

Glad it was helpful!

[@ananyabhattacharjee4217]

The best resnet video explained in so much detail. Thank you Aarohi.

[@CodeWithAarohi]

You're so welcome!

[@bhargavram860]

Thank you Aarohi 👍🏻. I have doubt - So does the residual networks play their part only while updating weights?

[@niluthonte45]

thank you mam ,please explain implementation like this

[@CodeWithAarohi]

Noted

[@user-mp9uk8se6i]

Very friendly explanation . I clear my problem by help of your presentation. Love u mammmammmaaa❤❤❤❤❤❤❤❤❤❤

[@CodeWithAarohi]

Happy to help

[@MATHEMATICSGURU21]

Super explanation

[@CodeWithAarohi]

Thank you 🙂

[@emirhanbilgic2475]

Thanks alot ♥ Greetings from Istanbul Technical University

[@CodeWithAarohi]

Welcome 🙂

[@deepsingh274]

thanks for explaining

[@CodeWithAarohi]

You're welcome

[@rabailrana9916]

Thank you

[@CodeWithAarohi]

Welcome!

[@ajaysivasaitangella1717]

This video is very helpful! ,one of the best video in Resnet, thankyou mam, it would be helpful if share the slides

[@CodeWithAarohi]

I don't have those PPT's now

[@arulgnanaprakasama.samjosh733]

super akka 👏

[@CodeWithAarohi]

Thank you 😊

[@raj4126yt]

Great tutorial

[@CodeWithAarohi]

Glad you think so!

[@kanikagupta2806]

amazing and detailed explaination

[@CodeWithAarohi]

Glad my video is helpful!

[@irfiali199]

Well done, very nicely explained. Keep it up

[@CodeWithAarohi]

Thanks a lot

[@Areeva2407]

Very Good!!

[@CodeWithAarohi]

thankyou

[@VEDANSHUDHAWANI]

Best Explanation ever...Can i get this ppt ?

[@ed21b006]

Thank u so much dii

[@CodeWithAarohi]

You are welcome!

[@pifordtechnologiespvtltd5698]

Amazing

[@CodeWithAarohi]

Thanks

[@rickharold7884]

Very nice!

[@CodeWithAarohi]

Glad you like it

[@Fatima-kj9ws]

You are the best

[@CodeWithAarohi]

Thanks

[@sajedehtalebi902]

useful and simple:)

[@CodeWithAarohi]

Thank you 🙂

[@amintaleghani2110]

@Code With Aarohi , thank you for your effort making this informative video. I wonder if we can use ResNet for Time Series data prediction. If so, Could you pls make video on the subject. Thanks again

[@omkarsargar5375]

Can you PLEASE make a Attention model in deep learning video just like this one step by step and detailed explanation it will be a great help.

[@CodeWithAarohi]

I will try to make it soon

[@salmanahmedkhan3979]

Great explanation Ma'am Aarohi. You made all the concepts very easy and clear. Lots of love from Pakistan.

[@CodeWithAarohi]

Glad my videos helped you 😊

[@RanjitSingh-rq1qx]

Mam, i am following your playlist. Really it is very helpful content. But mam your playlist is short.please make more videos. Because now I don't want follow the playlist from any youtuber except you mam. 🥰🥰🥰

[@CodeWithAarohi]

Sure, I will update the playlist and also try to add more videos soon 😊

[@SehanobishDipanjan]

good explanation

[@CodeWithAarohi]

Thanks for liking

[@divyanshubse]

Nice explanation mam

[@CodeWithAarohi]

Thanks a lot

[@gaganmalhi1229]

How to manage a big topic in short video....👍🏻👍🏻

[@CodeWithAarohi]

Gagan Malhi thankyou for appreciation

[@shidharthrouth]

Ok so what I understood about the identity and convolution block is that their result is added to the output of a normal block of convolution and pooling in a network to generate a residual block and then the result of the residual block is fed to the next residual block in line... I.e., we are changing the value of activations of a block explicitly Please correct me if I am wrong

[@praveenprakash143]

Fantastic

[@CodeWithAarohi]

Thanks

[@mohammademdadulislam5432]

Excellent mam, keep it up

[@CodeWithAarohi]

Thank you!

[@DevanshShukla11]

Mam I understood in detail about the Resnet 50 architecture, but there is one question, like I am right now making a project on LDW system it has to detect the lanes, so how do use this model? What should be my approach?

[@ernestbeckham2921]

superb explanation. if you explain nlp series (transformers), it will be also superb

[@CodeWithAarohi]

I will try

[@jaivalani4609]

We track FX such that it gets as min as possible and hence Y becomes as close as possible to Input. FX is acting like a Regularisation function also

[@CodeWithAarohi]

correct

[@jesmithathoras2572]

Thank you for the good explanation.. I have one doubt. What will the filter matrix will contain I mean values??

[@CodeWithAarohi]

Those will be some pixel values from image

[@user-lo2tg7mh7y]

nice explanation @Aarohi can you please explain that convolutional block how the output size(28*28*128) matches the input size (56*56*64) once again there is a little confusion for me

[@ashishmohite803]

thanks mam....great explaination 1 doubt: in lung disease detection our image of xrays will be in grayscale format so, while giving size [224.224] +[3] what will be in place of 3 as 3 is used for colored image?

[@CodeWithAarohi]

no replace 3 with 1

[@blacknwhite5875]

great explanation on architecture and I am not able to understand channel change from layer to layer

[@CodeWithAarohi]

Channels are changing layer to layer because all these channels are already fixed as per the paper of Resnet. See Resnet is an algorithm and all the parameters like how neurons in a layer, padding, pooling size and channels are pre defined. So we are using those parameters. If you want you can change the number of channels and play around.

[@siddharthmodi2740]

Best explanation on internet , Thanks Aarohi 🧡

[@CodeWithAarohi]

Glad it was helpful 😊

[@wahyupriyowicaksono4900]

is the number of layers in ResNet50 the same as those in ResNet50V2?

[@poojakabra1479]

4:50 you say we avoid vanishing gradient by skipping layers, back propagation however does not travel through the skip connections. Can you explain how the vanishing gradient is exactly solved?

[@farhinezha7898]

from my understanding, back propagation does travel through the skipped layers but stack them as a single one. So a set of stacked layers have one common weight that the gradient travels throught. simply put you have a direct weighted connection lets say between layer 1 and 10 for example. in the end the gradient goes through less connections and thus remains stable

[@ajilisaaliyar3156]

Hello Maam...Very Good Explanation, Can you explain attention gate mechanism in a video?

[@CodeWithAarohi]

Will upload soon

[@ecemiren6600]

Dear I couldn't understand the logic of usage of identity block in the first convolutional block. Because input is 75x75x64. But in the last convolutional layer as 1x1x256, the output should have dimension of 256. Therefore we can not add input and output, could you please clear this with an example ? Thank you very much for the video.

[@harishdasari5545]

can you please explain How this res-net 50 applied to speech

[@meklitmesfin5968]

great explanation thanks a lot. but I have a question. after 2 convolution layers our input dimension changed in to 75*75*64. this will be the input after the next three convolution layers. to add this with the output of these three convolution layers their dimensions must be the same but the third convolution has 256 filter size which makes the output x dimension*y dimension*256 which can't be added to the 75*75*64 dimension and we used identity blocks even though their dimension is different. can you please explain to me this? thanks once again😊

[@naimafarooqi1403]

where did the formula come from? please explain.

[@user-mv5bz1zt6c]

Good Explanation. But 301/2 can never be 150. So how do we correct it?

[@pusuluriaditya1369]

Does the skip layers get trained during forward propogation?

[@CodeWithAarohi]

skip layers are skipped from training. This is the logic of resnet

[@user-vg5hb5tt8m]

can anybody write answer of my question after of maxpooling layer we have 64 layer that connected to slip connection this input will add to the other input that has 256 layer??? what is happening in there

[@arjunbansal674]

M'am i have used resnet50 for a project but my guide asked me to do changes in the algorithm,so mam what changes i can do in the algorithm without disturbing accuracy to large amount.

[@CodeWithAarohi]

You can remove 1 or 2 layers from the algorithm or you can change the filter size in any of the layer or you can change the pool size . You can change the stride in 1 or 2 layers of the algorithm. When you will do changes in 1 or 2 layer that will not impact the accuracy much.

[@VinothKumar-hw7ud]

Hi.. great video... have a small doubt regarding identity block..let consider 1st skip connection where identity block works. X=75*75*64 to add this o/p of 1x1 conv, 256. But the size of X (input) is not matching with o/p of 1x1 conv, 256. Then how identity works???? pls comment..

[@CodeWithAarohi]

Hi.. thanks for appreciation... Please provide me the output size also. Because we apply identity block when input size and output size is similar. And as per your comment, x=75*75*64 and you are applying 1*1 conv,256 in the shortcut path. But what is the size of output image then only we can compare whether 1*1 conv,256 is giving us correct size or not.

[@poojakabra1479]

@@CodeWithAarohi The 75*75*64 has depth=64 and after the 1*1 conv,256 layer, depth = 256. How can you add them?

[@dhivyaakumar]

@@poojakabra1479 Correct.. you cant add 75*75*64 with the output of the first convolution block (1*1*256). If you see the resnet architecture code, we use a 1*1 con with stride =1 in the first skip connection and the filter 64 is multipled by 4 = 256; so the shortcut size would be 75*75*256 which can then be added with the output from the 1*1*256 conv layer which is also 75*75*256.

[@niluthonte45]

Can we use this resnet50 model for mri brain tumor image classification having 4 classes in the target feature,?

[@CodeWithAarohi]

Yes, you can

[@niluthonte45]

thank you@@CodeWithAarohi

[@jayanthikkumari7454]

Hi mam please make videos on SkNet and DieT

[@CodeWithAarohi]

Noted!

[@jayanthikkumari7454]

@@CodeWithAarohi mam I have phd interview I have some doubts can I contact you mam please if possible to you mam

[@deepikasingh3122]

How would we get f(x) if we won't pass through the layers

[@anuragshrivastava7855]

You have so much of knowledge about AI then why you not working in big brand, MNC

[@CodeWithAarohi]

I like to work the way I am working now 😊

[@santiagogomez8354]

You can put subtitles in English, I appreciate it.

[@CodeWithAarohi]

Sure, I will do

[@tarasaber4525]

hello dear if we want to change the input of pretrained network Resnet50 224 * 224 to some higher value what should we do ?

[@CodeWithAarohi]

You can write your own resnet model and change the input size. Check this link: github.com/AarohiSingla/ResNet50/blob/master/3-resnet50_rooms_dataset.ipynb Here I am using the input size 64. and you can replace that 64 with your customized image size.

[@YBMWY]

Do you have any code for modulation classification?

[@CodeWithAarohi]

no

[@shubhamchoudhary5461]

Well done aarohi

[@CodeWithAarohi]

Thankyou

[@vinothsomasundaram9519]

I have serious problem with doing resnet model, please let me know

[@CodeWithAarohi]

what is your query?

[@ajanthaalakkshmanan5854]

Plz explain red deer optimization mam

[@CodeWithAarohi]

I will try to do after finishing my pipelined videos

[@ajanthaalakkshmanan5854]

@@CodeWithAarohi Thank u mam plz try to do that

[@MuhannadGhazal]

if we want to make f(x) equals to zero. then why dont we just remove these layers? if their output is zero, why dont we just remove them? i didnt get this point. anyone please explain what did i miss.

[@shidharthrouth]

I am pretty new to the whole deep learning thing but what I understood from the explanation was, it is not that we are trying to achieve a fx = 0 but more appropriately we are trying to achieve y = fx + x for each residual block... Now we know that traditionally we try to bring SGD to a local minima and we can only do that if fx is close to the original output but here we are changing the activations explicitly to do so by adding x to fx rather than relying on the network to bring the network to a local minima... Now to answer what u asked according to the paper the identity x is not considered as an extra hyperparameter so it is kinda non existent so during back propagation the network still adjusts the weights of the original layers so we can't remove them... Hope this was helpful

[@utkarshnamdev441]

mam please provide the link of ppts

[@shubhamchoudhary3580]

Very nice explanation. Mam can u share the ppt..

[@CodeWithAarohi]

Thanks for liking my work and I am sorry, I dont have this ppt with me. But yes if you want resnet code that I can share.

[@shubhamchoudhary3580]

Okk mam plz share

[@CodeWithAarohi]

@@shubhamchoudhary3580 github.com/AarohiSingla/ResNet50/blob/master/3-resnet50_rooms_dataset.ipynb

[@swethanandyala]

Mam can you share the ppt