Building a Neural Network with PyTorch in 15 Minutes | Coding Challenge

[@andyweb7779]

The amount of calculating a Terminator has to do just to work out if someones boots, clothes and motorcycle will do him is wild lol.

[@FleiX664]

Imagine Skynet.

[@mesembria95]

Nick, we appreciate your work so much. The way you offer your knowledge so graciously, you're helping so many people who are newbies in the field.

[@NicholasRenotte]

Knowledge is one of the few things you can give away and not lose, so why not share?! Thanks so much for checking it out @NeonCone!

[@baguette184]

youre literally the best, i genuinely appreciate all the work youve put out for us. you have no idea how much help your channel has given me, without you i wouldve been completely lost in everything, thank you so much, i love you 😭♥

[@sadra2637]

Good job man. I feel more and more in love with ML and DL as I watch your videos. Keep it up. 👊

[@NicholasRenotte]

YESSS, love that you're getting into it!

[@mansoorbaig9232]

Great explanation of all that is need in 15 min. Keep up the good work, your tutorials are a great help to DS community.

[@thealmighty9]

Wow this was so good! I can't believe you still take time to explain things throughout the challenge lol. I am loving this series, super fun :D

[@jinparksoul]

"I can't believe you still take time to explain things throughout the challenge". I can't literally can't believe it either. Drink a shot every time he typed a line with no explanation and you'll be dead half way through the video. There is no freaking way a beginner understands wtf just happened by the end.

[@thealmighty9]

@@jinparksoul This video isn't a tutorial for beginners though, it's a challenge he made for himself. If you want a tutorial look through his countless videos where he explains every little thing that even you can understand.

[@jinparksoul]

@@thealmighty9 Nonetheless its still true that most of the lines are written without any explanation regardless of who it is targeted towards in contradiction to what your comment "you still take time to explain things" implies. Although not really done here taking time to explain everything is typically something you would not need to do when you target experienced AI researchers and pytorch devs.

[@thealmighty9]

@@jinparksoul So there is only explain everything or nothing? Only beginners and experienced professionals? "Take time to explain things" is not saying "takes time to explain every little thing" I'm not sure what you're trying to get at here, I don't know if you're upset that he doesn't explain enough or upset that he explained anything at all.

[@erfanelmtalab1615]

nick you are my hero for real , thank you for your tutorials man !

[@NicholasRenotte]

Ayyyy, thanks so much @Erfan!

[@gustavojuantorena]

This is awesome Nick! I'm amazed by the way you can also explain while coding really fast 😂

[@NicholasRenotte]

I have no idea how I pulled this off 😂

[@petegrapentien4147]

This is the most fun I've ever had watching a coding video

[@gabrielj.9028]

Great job! Your videos have really helped me with project ideas and application examples. Looking forward to seeing more!

[@NicholasRenotte]

YESSS, go getem @Gabriel!! Plenty more to come.

[@qybl]

So entertaining, yet so educational. this format is awesome! Thank you Nicholas

[@primeq]

great job Nick. It's impossible to overstate how powerful speed, clarity are when it comes to learning/teaching. 🌟

[@vincentmarkiet]

Awesome stuff. Keep at it mate.

[@NicholasRenotte]

Cheers Vincent!!

[@nicky6917]

This is the longest 15 min ever in my life

[@TheCopernicus1]

Awesome content as always mate! well done :)😀

[@NicholasRenotte]

Cheers @Bass Azayda!!

[@AsherNoor777]

Yo! that is EPIC! Super intense! and SUPER helpful! thank you so much for sharing, this is giving me hope for my ML project for sure! And yes, I TOTALLY take this as a Win. Amazing job!

[@Ragul_SL]

why are we giving (1,32,(3,3)) in conv2d and then (32,64,(3,3)) , how is it decided? can someone explain

[@fizipcfx]

Do you plan to make another streams.

[@NicholasRenotte]

OFC, normally aim for two a week. This week was a bit of an exception.

[@fizipcfx]

@@NicholasRenotte i got you, thanks for the reply

[@omarkhamismohamed9563]

Super underrated .. Amazing explanation during challenge !!!!

[@anshverma2820]

Thanks Nick! That was an amazing video.

[@NicholasRenotte]

Thanks a mil for checking it out @ansh!

[@robotbugs]

When I did it with the same code, the loss went down and then back up again - why is that?

[@dasamlan9874]

Great vid. I started ML a year ago and I could understand approx 70-75% of the vid.... can u do a vid on audio processing or provide some resources for the same. Audio processing, noise classification and similar stuffs. And once again a BIG thank u for these vids.. really helpful!!

[@NicholasRenotte]

Heya @Das, check this out: kzbin.info/www/bejne/kH2sgZ6joql9d8U

[@dasamlan9874]

@@NicholasRenotte once again.. Thanx a lot. 😁

[@harshraithatha]

Hey Nick, I have sensitive data in my dataset. I need it to train my model. But also want to mask it. What to do?

[@NicholasRenotte]

I deal with this a lot at work, check with your privacy policies but the model itself won't contain the raw data just what the NN has learned.

[@papakamirneron2514]

Finally, a tutorial for just the useful stuff

[@ganesh-uc2ft]

This was fun! Thank You for the amazing tutorial.

[@Markom3D]

Hey, i might have to take this format for my live streams…. Subscribed good sir

[@lakshman587]

So you won!! Congratulations!!!!

[@NicholasRenotte]

I have never written 50+ lines of code so fast in my life!! Thanks a mil @Lakshman. Was looking close towards the end there!!

[@lakshman587]

@@NicholasRenotte Noice! You did it!!

[@mishmohd]

11:17 don’t u need to put it in eval mode when predicting and train mode when training?

[@irugal8964]

😎 We always appreciate your content Nich

[@NicholasRenotte]

Thanks a million @Irugal, means a ton!!

[@bguerrae]

That was incredible! thank you so much for making it look so easy to implement. you are great!

[@domillima]

what rig do you have for your two curved monitors? :D

[@armaaanziyad2772]

Nick amazing work you really are a pro!

[@NicholasRenotte]

You're too kind, thanks @Armaaan!

[@saleemmuhammed5133]

This is what I exactly wanted.. Awesome stuff!!

[@nerualbrain]

Love this video It actually helped me start using pytorch

[@cagataydemirbas7259]

Hi, Im confused about cross validation. I looked videos they just use cross_val_score. I want to train data using cross validation and predict test daha how can I do it with cross validation. I want train cross validation and apply other datas how can i do it

[@NicholasRenotte]

Take a look at GridSearchCV in sklearn

[@cagataydemirbas7259]

@@NicholasRenotte thank you. gridsearh tests some parameters after tested when we predict it uses best parameters ? or should we trained again by best parameters

[@ChrisOndrovic]

Man awesome video, do you have or could you do one doesn't have to be a timed coding challenge but instead if you want to create your own dataset as opposed to using an existing one

[@shyamvai]

Pls explain the layers

[@gadmuhirwa5226]

oohh my God you made proud and happy you build my confidence brother @ Nicholas I can't stop laugh for your celebration

[@einsteinsboi]

Legend! That was epic!

[@NicholasRenotte]

Thanks a mil @maryml

[@krale9970]

Csn you tell me on which learn platforms i can learn this clearly , because for a beginner I dont know what you write in general there . Where should I start to beginnt with to understand this ? Thank you for help in advance

[@ravenbao3334]

i added another pic of a number 5, but I get this error - Given groups=1, weight of size [32, 1, 3, 3], expected input[1, 4, 28, 28] to have 1 channels, but got 4 channels instead; how can I make it work

[@choz8358]

Thanks for the content, as a newb I learned a lot here 👍

[@justinbenavidez1985]

great video and amazing coding!!

[@MichaelMacedoDiniz]

Very nice content, congratulations !!!!

[@rverm1000]

Glad you got it deploy. No one seems to get that far

[@akandee]

Great! Nicholas, thanks for sharing. Please how would one handle labels for classification, is this method foolproof to using LabelImg? Thanks.

[@chiragparmar3678]

one question i have is why did u not defined your yhat as clf.predict(x) instead you took only clf(x)

[@vladrask]

Hi What VS Code theme are you using?

[@fairyroot1653]

Can this model predict a sequence of numbers in captcha based images with digits and/or letters?

[@NicholasRenotte]

Would need to be tweaked to do that!

[@fairyroot1653]

@@NicholasRenotte can you demonstrate how?

[@Warley.Araujo]

Great Video bru!!

[@kamalakannank2741]

Sir, Which document you read to write this code?

[@dadanny661]

Instead of printing the epoch loss, didn't you print the loss of the last batch of the epoch ?

[@georgebassemfouad]

Hi I have a question.. what is the difference between tensorflow and pytorch

[@NicholasRenotte]

Similar, just different implementations TF: from Google, PT: from Facebook

[@chiscoduran9517]

Hi, there is something that always confused me when working with conv networks, when you set the input layers in the nn.Linear(), you set it as 64*(28-6)*(28-6), why is that? how to know how many inputs and outputs you have to have when combining conv nodes with linear nodes, thanks great video :)

[@NicholasRenotte]

Look under the shape section here: pytorch.org/docs/stable/generated/torch.nn.Conv2d.html , the formula for calculating the height and width of the output are shown there (see Hout and Wout)

[@NicholasRenotte]

If I adjusted kernel size, padding or stride then the output shape would’ve changed accordingly @Chisco!

[@nikitaandriievskyi3448]

If you have an image of let’s say 28*28 shape, and you pass it through a 3by3 filter with a stride of 1, and 0 padding, then ur output Shape would be: 28-3 + 1 by 28-3+1. The general formula for shapes after passing through a conv layer is ((input_shape +2*padding size - filter size) / stride) + 1 and then floor the results, so if it’s 3.5 you should round to the bottom, and you will have 3

[@NicholasRenotte]

What Nikita said is bang on!

[@alexzan1858]

does pytorch have better/faster training compared to tensorflow?

[@sergioquijano7721]

Shortcut of the video? Toggle/Hide command line inside VSCode: ctrl + J (command + J in mac) Hope you remember my shortcuts

[@NanoCreator]

This is a good teaching!!! you are great!!!

[@undokat]

6:08 i don't know what you are doing what are those?

[@SimpliSave-h2o]

Could this be used to bypass Robot image validation ?

[@GX-uq1hm]

Nicholas, what monitors do you use there for coding? your workplace looks fantastic !!

[@MatthewOrbuch]

If this were not a rushed challenge but a proper tutorial explained a bit more calmly, it would be pure gold

[@sanketdongre369]

Put the code in chatGPT and ask for explanation. 😇

[@epistemicompute]

You have no pooling layers

[@Spacesparx-h7q]

Can you put a video about creating a AI for beginners including all mechane learning code like computer vision and more in one video

[@Michal2SAB]

Why sometimes in accuracy, loss or whatever, one of these.. weird letters are present? Like a big number 0.12202020202-e545. Is it a problem? I found that to be confusing when predicting cause then the model inaccuratly predicts for some reason. Or perhaps it's not a problem and I just can't do simply "if accuracy > 0.5" in that case and THAT's the issue

[@Connecttechaarushenglish-ox111]

No it is not a problem. Sometimes, when accuracy or loss or both are very small or big then it uses some words like 341e78

[@toni3124]

Love your vids! could you maybe make a video about a TTS system based on the LJ Speech Dataset?

[@NicholasRenotte]

Will take a look!

[@philtoa334]

Great ! but... This time I especially learned that I could have bad thought for you . For a gift card ... 🤣

[@NicholasRenotte]

LOL I think the code that series isn’t ending anytime soon. might just need to start making some ridiculous challenges.

[@JasR-b2r]

I am brand new in learning python code and neural nets etc and I feel the exact same way as you did @ 9:45 LOL

[@billal2731]

I can finally ad Machine Learning to my resume

[@gplgomes]

Nocholas, you are the guy.

[@NicholasRenotte]

Cheers @Geraldo!

[@julianchambrier2401]

Good job and Congratulations ! Is it possible to make a video on lip sync with Tensorflow from a video file and a text/audio file generating a deepfake? For example a video of you with speech of Martin Luther King (with your voice) ? I think it could interest a lot of people

[@NicholasRenotte]

Oooooh, I'll dig into it!

[@adamblack2255]

IS it just me or is pytorch incredibly slow? Or am I misunderstanding the difference between this and a simple conv model with tensorflow/keras?

[@NicholasRenotte]

Hmmm, might need to do a comparison, tbh I've always used tf and never had performance issues. I didn't check how many samples were in the MNIST dataset for this though.

[@sitrakaforler8696]

Dam dude !!!!!!!!!!!!!!!!!!!!!!!!! You are wild ! Bravo

[@arjunbali2079]

Hi Nicholas I started following your channel after your series on siamese network. Like this can we build multiple language OCR for example in a sentence there is english, hindi and german together written the classifier translate them all together and give us the result in the required language

[@sridhardornadula3913]

hello bro...how to install pytorch in windows 11 or any alternate apk

[@dubble_g]

i have way more detailed images that are 128x128 and my NN is really bad at predicting, any tips what i should try to adjust besides the learnign rate?

[@Michallote]

Use yolo

[@AndersAlsDieAnderen9]

Hey! Noob here: How does he comment multiple lines at 16:50? I always use ''' text ''' but that is just shit. How do I use # Infront of multiple lines at the same time.

[@AllenThomasVarghese]

In VSCode, you select multiple lines and press Cmd + / (on Mac) to comment the lines out similar how to you do for a single line

[@mahsakhoshnoodi2972]

Nice challenge 🤩

[@NicholasRenotte]

Thanks a mil @Masha!!

[@neilrenaud5962]

Job well done .Way to go

[@adityashukla7849]

Phenomenal!

[@NicholasRenotte]

Cheers @Aditya!

[@murataavcu]

That was truly amazing

[@NicholasRenotte]

Thank you so much @Murat!!

[@MrSanselvan]

Nice. The loss is increasing after the 3rd epoch. Is it good sign or bad ?

[@danielpaul8734]

It is not. Notice that the loss will be written in scientific notation after the 3rd epoch

[@OvettaSampson-vz4en]

This was fun to watch.

[@danny9642]

How long does this take to train on a CPU and how can I optimise the code for it to train faster when using CPU?

[@Connecttechaarushenglish-ox111]

It will triple the time that the gpu takes to train😅😅. You can just remove .to("cuda"). Now you understand it.

[@thiagosnelli138]

Hi mate, I'm using the CPU, what should I type on line 57?

[@thiagosnelli138]

Well, answering my own concern, for the CPU guys: line 58 change for: clf.load_state_dict(torch.load(f, map_location='cpu'))

[@ifthikhanmohamed1681]

it throws a runtime error

[@dactoanho6026]

Thank you very much for your video. it's very helpful

[@andyweb7779]

Is the tensor mathematics involved in neural networks the same as the tensor mathematics invented by Albert Einstein for his work on general relativity?

[@coolsai]

God level

[@johnnovotny4286]

well done, appreciated

[@ajaykumar-rh2gz]

Amazing bro love the way teach

[@shaunpx1]

hey if you eve want to do a race id be down for a challenge

[@sebastianrothe]

awesome & fun , at least if you don't try to follow typing :) thx alot

[@NicholasRenotte]

LOL, yeah it was a little fater than my usual pace

[@sebastianrothe]

@@NicholasRenotte but it was Fun trying :) Maybe you can do a series like this From tiny world problem to live solution? That would be cool to See the process and thoughts

[@fulltimefrontend]

Tell how to build my machine ! I want to setup just like you have.

[@jamesderiter4370]

This dude is an irl character from bigmouth

[@dsc40sundar18]

preety amazing and big fan bro

[@varadpatil3715]

How 64*(28-6)*(28-6) ? Also u didn't applied max pool , is it ok ??

[@libeamlakbekele6345]

This is because he didn't use padding on any of its conv layer, in general the formula is ⌊(n + 2p - k)/s⌋+1 where n=Image size, p=padding, k=Kernel_size, s=stride. So in his case image size = 28*28(n*n) For Conv1 n = 28, p=0 which is the default value, k=3, s=1 which is also the default value, ⌊(n + 2p - k)/s⌋+1 = ⌊(28 + 2(0) - 3)/1⌋+1 = 26 For Conv2 n = 26, p=0 , k=3, s=1 , ⌊(n + 2p - k)/s⌋+1 = ⌊(26 + 2(0) - 3)/1⌋+1 = 24 For Conv3 n = 24, p=0 , k=3, s=1 , ⌊(n + 2p - k)/s⌋+1 = ⌊(24 + 2(0) - 3)/1⌋+1 = 22 After this when you feed it to the fc layer you multiply the output channel by the size of the image which is 64*22*22 That is how he got 64*(28-6)*(28-6)

[@vinsmokearifka]

Haha very interesting show

[@wgb-10]

Good job Nick! Huge W. I was wondering as to why the loss was increasing after every 4 epochs, is it because a new batch is fed in to the model?

[@NicholasRenotte]

Heya Wesley!! First one finally!! Probably getting to the point of overfitting but we're only printing out after every epoch not per batch. Loss bumps up in epoch 4 but still drops in epoch 8 (take a look at the power e-6 as opposed to e-5)

[@wgb-10]

@@NicholasRenotte Oh right. I completely missed the e-6 😂

[@hlslaughter3]

You've got 5 minutes to write hello world. Me: .... (◉▂◉ ) ..... (⊙.⊙) .... 5 mins later .... .... ¯\_(ツ)_/¯

[@shishya]

And you didn't skip commenting 😅

[@HussainAyed-y3s]

This dude is an O.G.