Gradient Descent, Step-by-Step

[@statquest]

NOTE 0: If want to learn more about The Chain Rule, see: kzbin.info/www/bejne/rZ2Unqyup9mEfrM NOTE 1: The StatQuest Gradient Descent Study Guide is available! statquest.org/studyguides/ NOTE 2: A lot of people ask why we are using Gradient Descent to estimate the parameters in this video when we could just use least squares. We use least squares to produce a "gold standard estimate". This is the best possible estimate. We then attempt to derive the same estimate using Gradient Descent. This shows 1) how gradient descent works and 2) that the estimate is pretty good compared to the "gold standard". NOTE 3: A lot of people ask how I found the slope value, 0.64. In the example in this video, we can compare the estimates from Gradient Descent to those that come from another method called "least squares". For specific problems, we can plug the data into the least squares formula and the output is the optimal parameters. To learn more about the specific least squares formula see: en.wikipedia.org/wiki/Least_squares If you're wondering why, when we have least squares, would we want to use gradient descent... the answer is that least squares only works in specific situations and gradient descent can work in many more. Support StatQuest by buying my book The StatQuest Illustrated Guide to Machine Learning or a Study Guide or Merch!!! statquest.org/statquest-store/

[@emperorcyber509]

StatQuest with Josh Starmer you are the best

[@statquest]

@@emperorcyber509 Thanks! :)

[@lordoftranceaa]

it was driving me crazy, but thanks! it was an error

[@BeksKazama]

Thank you so much! I have a qn. It has to be SSE instead of SSR, right? SSR is (y predicted - y bar)^2, where SSE is (y pred - yi)^2

[@jojotheyorkie3157]

Thanks. Was looking for this. This should be pinned.

[@Android-cm5gn]

I cannot believe how many teachers get paid in schools and in universities to make students feel stupid just because they cannot explain a very important topic in a similar way like you! So much respect!

[@statquest]

Thank you! :)

[@wirito]

M AK that’s not the problem man. Problem is we have to pay them thousands of dollars when in reality, many people in KZbin deserves that money instead. My education wouldn’t be complete without KZbin. Thanks Josh for your videos :)

[@srtghfnbfg]

Everyone upvote this comment please. And 100% respect to Josh !

[@Android-cm5gn]

@@tilkesh I don't understand why it needs decades of hard work to explain topics in a decent way. I had teaching assistants who were totally fresh to a topic and yet they explained it way better than my professor.

[@jaliu]

and you end up studying for years without learning anything!!

[@greatmanokonkwo656]

I love how this guy cares to explain every single detail, not assuming any prior knowledge whatsoever. I was genuinely shocked when he started calculating the derivatives in the video. Most resources will skip over such minute details and calculations, only focusing on the concepts. These videos are the most beginner-friendly resources on the web for ML, simply amazing.

[@greatmanokonkwo656]

And also the fact that he doesn't scare is viewers with conventional mathematical notation. He really just gets to the core of the topics.

[@statquest]

Thank you so much! I'm really glad you like my teaching style. :)

[@EagleYin]

I really enjoyed this video but it's lack of code. I got a great video here implement sgd using Python!!! Feel free to check it out!! kzbin.info/www/bejne/q4nYc4ihjMRjqqM

[@kevindave277]

@@statquest You are HIM.

[@izzatulummah1594]

@@statquestI really like your teaching style. I will adopt this to my class. Thank you very much.

[@knightganesh]

" If you can't explain it simply, you don't understand it well enough" - Albert Einstein Can't get much simpler than this explanation. Thank you so much awesome work keep it going 👍👍👍👍👍👍👍👍👍👍👍👍

[@statquest]

Thank you very much! :)

[@clementt3940]

La vraie phrase est : "Ce qui se conçoit bien s'énonce clairement, et les mots pour le dire arrivent aisément." de Nicolas Boileau. Einstein coupable de plagiat ? ;)

[@Frostbyte-Game-Studio]

i think that's from Richard Feynman. anyways I agree

[@John845]

In 5 minutes I FINALLY fucking understand WHY theres this hill shape and why we are optimizing for this "hill" every time I read or look at a visual representation of gradient descent. NO ONE ON THE INTERNET explained how this step works or why its always a hill in 2D or a series of hills in 3D. Jesus Christ. Thank you StatQuest. Just bought 4 copies of your book by the way, giving it to all my friends.. You deserve it.

[@statquest]

Wow! Thank you very much! :)

[@RandomGuy-hi2jm]

there are real institutes which takes 4000-5000$ to teach you this and then comes statquest which saves your tons of money and provide u better explanation...... SUPER BAMMMMMMMM!!!!!!!!!!!!!!!!!!!!!!!!!!!

[@statquest]

BAM! :)

[@shreejanshrestha1931]

@@statquest it's not just BAM, The BAM is really big. Bigger than the bam that killed the dinosaurs. Cause u r best bam bam bam bam

[@sdc8591]

When ever I feel I am not able to understand any concept after reading any book or any literature available on internet, I open Statequest. This channel should be awarded as the best ever tutorials on Machine Learning concept. You are unbelievable Josh Starmer!!! Thank you

[@statquest]

Thank you so much!!!! :)

[@thongnguyen1292]

Clearest explanation in this universe, as always! Thanks a lot!

[@statquest]

Thanks so much! Glad you like it. :)

[@ai-touch9]

Give this man the highest medal in teaching. Thanks a lot for all the effort you made to explain this.

[@statquest]

Wow, thanks!

[@anujsaboo7081]

So let me see, you taught this like teaching a kid by repeating the same thing over and over again and covered such detailed calculation in 20 minutes. It is just amazing how you make short videos and even revise prior concepts at the beginning and still manage to keep everything short. The songs, the BAMS! everything unique about this channel. Amazing learning experience. THANK YOU!

[@statquest]

Thank you very much!!! :)

[@kawishabbas7254]

Oh man you are a great. How clearly you explained everything. Thanks

[@voltaire8828]

i have struggled quite a lot in my optimzation course as there isnt as much resources i could find that explain the topic clearly.Today by chance i search up the gradient descent and you cant imagine how fast i click when i see a video about gradient descent by the lovely, omniscient, compassionate, insightful and and life-changing statquest

[@statquest]

BAM! :)

[@kartik_exe_]

to be honest i never ever saw a teacher like him which teaches us and after the sessions we don't have any doubts to even ask. Kudos to him and also thank you StatQuest

[@statquest]

Thank you!

[@j8ahmed]

One of the absolute best educational videos I have ever watched. Based on your explanations I have been able to: - walk myself through coding a gradient descent algorithm - understanding the concept of tuning the learning rate (alpha) - how to handle multivariable problems, - and more. I'm studying machine learning right now and this has helped me so much. I can't say how great this was. Thanks a million!

[@statquest]

Wow, thanks!

[@xx-jk1iq]

would you be able to share what you did with the algo

[@mohamedaitahmed2842]

Of all the explanations I've watched, this is, by far, the best explanation of gradient descent. Thank you for existing !

[@statquest]

Wow, thank you!

[@taraprasadmishra3839]

This man can teach ML to a 5 years baby 😅

[@statquest]

Thanks! :)

[@sparkartsdistinctions1257]

👶🏻 🍼True.

[@krshah2008]

im 5 and i can confirm this.

[@sparkartsdistinctions1257]

@@krshah2008 No you are too young to confirm. 🐶

[@kunthoopi]

exactly 😂

[@wei2674]

“it sounds fancy, but it’s really no big deal” Thank you for marking me feel the same way about those fancy named methodologies after watching the videos!! I do feel more confident now in learning new stuff! If I don’t get it, it’s not because Of me, it’s simply because the book/paper/course note is not as good as statquest :)

[@statquest]

Awesome! :)

[@whyareugae5528]

I wish I saw this video before I attended a 3 hour lecture on GD. Professors have no idea how to explain the basics. Thank you so much, now it all makes sense.

[@statquest]

Glad it was helpful!

[@anur749]

You are a saviour! Whole University wasn't able to make this so simple..you should be given highest honorary award in Data Science

[@statquest]

Awesome! Thank you so much! :)

[@geetanjalighatak3913]

I've been trying to understand gradient descent algorithm for months but all I could find were videos filled with jargon and now i finally understood it within 25 minutes. I love how you simplified the whole thing! This is literally the best explaination I've ever seen! I loved every second!

[@statquest]

Thank you very much!

[@phoneix24886]

You are a gift of the Gods. You should not be lost in the crowd. We need more teachers like you.

[@statquest]

Thank you!

[@dejau85]

Brilliant! 2 years into ML and I still find this the best explanation of GD.

[@statquest]

bam!

[@laslodes2550]

I usually don't comment under youtube videos, but I had to it this time. Currently working on a robotics project and I have to use the gradient descent method to solve inverse kinematics. I didn't understand the method as explained during my lectures and I ended up watching this video. Seriously, I could even explained it to my prof and submit a request so that this video is shown to students during the teaching of this topic. You're amazing and your explanation is so much easy to follow and understand. Thank you so much for this masterpiece.

[@statquest]

Thank you very much and good luck with your robotics project.

[@yeparthepirate]

I'm struggling so much in Machine Learning right now. After watching just two of your videos I am feeling so much more confident. Thanks so much!

[@statquest]

Hooray! Good luck with your studies. :)

[@Alan-qb9qt]

the most intuitive and detailed in every point gradient descent tutorial i've ever watched

[@statquest]

Thank you!

[@bbow4972]

Normally I don't like when tutorial vids try to be funny or cute in their vids but this video was great. It was just enough to make the lesson not feel so monotonous or droning without getting away from the lesson at hand. It was also surprising easy to understand. Thanks for the vid.

[@statquest]

Awesome! Thank you. :)

[@kartickdhali4352]

This is the best video on Gradient decsent on internet. I wish I could have a teacher just like you in my college.

[@statquest]

Thank you!

[@TheFolkRevival]

What's really golden about this video is that you don't assume the viewer knows f.e the Chain Rule (even though it's good) and also show all the steps clearly. A lot of Math "tutorials" skip some crucial steps that might not be obvious to someone new to an area/idea, which make the material inaccessible. For comparison, even if your videos lack the great animations of f.e 3Blue1Brown, I think some of your explanations are much easier to understand.

[@statquest]

Wow! Thank you very much! I really appreciate it.

[@kalanagayan5283]

I'm currently proceeding to my Final year of Bachelors degree, This is the minimalist most clear , interactive and funny session I've seen , Love your work, its been a great help for the studies. Love and respect all the way from Sri Lanka !!

[@statquest]

Thank you very much! Good luck finishing your degree! :)

[@AlexSanchez-i7w]

After watching my professor's lecture and then watching this I can confidently say that you sir are the best.

[@statquest]

Thanks! :)

[@Thekingslayer-ig5se]

This man is an icon! He should be celebrated much more! You have no idea of how well he teaches stuff! Way to go my man

[@statquest]

Thank you!

[@aanya8834]

I've never come across a clearer explanation for gradient descent,this is so cooool! Love this channel! Thank you so much for making us fall in love with ML!

[@statquest]

Awesome, thank you!

[@AryaNalluri]

Your videos are so well put together. Thanks for all the time you put into preparing them!

[@statquest]

HOLY SMOKES!!! Thank you so much for supporting StatQuest! BAM! :)

[@merebhayl5826]

Josh, You are a beautiful creature and gift! glad you exist! your thought process, your explanation, your positivity in teaching this to us, your creativity through art, and your music and albums. Be glad you exist to us all. I am also an electrical engineer, working primarily in software engineering, with a passion for music, numerous instruments, and painting. I am glad I came across you as a person, besides the great education!!

[@statquest]

Wow, thank you!

[@SachinRaneTheSKR]

This has to be, without a doubt, the most understandable and clearly explained video on Gradient Descent on the internet! Thank you so much!

[@statquest]

Wow, thanks!

[@AshishBangwal]

when you explained all the steps to find derivative i laughed but after realising you do all this just to make sure everyone understands i felt so blessed to have people like you ❤

[@statquest]

Thanks!

[@999Stergios]

StatQuest. You're Gold, my friend. Pure Gold. 1000 Thanks and bravo. The way you explained it and the graphics was brilliant. Super simple super easy, very educational! Bravo, Bravo!

[@statquest]

Hooray!!! I'm so happy to hear that you like this video. :)

[@kk10-]

You did what Andrew Ng failed to. Explaning me THE GRADIENT DECENT algo.

[@statquest]

Hooray! I'm glad the video was helpful! :)

[@DixitGokhaleEngineer]

Completely agree. In fact I just look at the Andrew's course for the topics that needs to be learnt in order. And for the detailed explanation 'BAM' does a fantastic job. Thanks a lot Josh.

[@karisc.anoruo2212]

@@DixitGokhaleEngineer what is BAM please? I'm taking Andrew Ng's course and I want to learn from as many sources a possible!

[@darksideofthemoon3185]

​@@karisc.anoruo2212 8:51

[@yassertalebi1026]

Exactly , that's why i was searching for something else to understand it since Andrew Ng failed

[@nikhilpradeep336]

Hi Josh, I an a new entrant to the field of Machine Learning and was really struggling to get a hold of the topics; understood the concept of Gradient Descend by watching this one video. Thanks a lot Josh , you are the best!

[@statquest]

I'm glad I could help! :)

[@Patrick-jm9rq]

this series is by far the best detailed deep-learning course on youtube

[@statquest]

Thank you!

[@krbvivek]

I’m feeling a bit down realizing I found this amazing lecture series 5 years late! I came across this channel while I was halfway through a 30-hour Gen-AI course, which didn’t go in-depth on RNNs. This playlist, though, dives so deep, and I really appreciate how clearly and thoroughly he explains everything. Thank you man! This is my fastest subscribe to a channel till date!

[@statquest]

Thank you very much and good luck with your course!

[@FrequentC88]

Love humor you've added to what can usually be such a dry topic. The "squiggle" for logistic regression made me laugh. Keep up the great content!

[@statquest]

Thank you so much! :)

[@xiangzhang7355]

I have never seen anyone explain gradient descent as clearly as you!

[@statquest]

Thank you!

[@Frost571]

Thank you for explaining this in a simple way I can understand. I'm almost in tears right now 🥲

[@statquest]

Glad it was helpful!

[@ratnakarbachu2954]

Finally lots of search on the internet , again I reached to the same place where things are explained easily with heart. Really you are good hearted as like the concept. Thank you sir, we owe you.

[@statquest]

You are most welcome!

[@TheClockmister]

I really wonder why professors like to explain things as complicated as they can? This video gives an example & indepth calculation. There is just no room to have any questions. The example helps connect this maths to Machine Learning. Perfect as always.

[@statquest]

Thank you!

[@gix111]

You explain complex things to me better than my professors. Thanks for saving my semester. ❤️

[@statquest]

Happy to help!

[@samskyverareddy3135]

I remember what gradient descent does but your explanation on slopes and derivatives gave me a big 'AHA!' moment. Thank you! Instant Subscription! Looking forward to more videos.

[@manuelplank5406]

This video is just perfect to gain an intuition of gradient descent (what math heavy lecture slides fail to deliver)

[@statquest]

Thanks! :)

[@shivakumarjadipalli6823]

I have took a data science bootcamp of $4000 but even they didn't explain it like you did great work , Please don't stop doing this

[@statquest]

Thank you!

[@Anonymous-fr2op]

I have no words to say how amazing you are. Not only are your videos super easy to grasp, but also, wth, even after 4 years you're replying to your comment. Wow! Amazing

[@statquest]

Bam! :)

[@adolfomotanavarro6553]

Boop beep beep boop boop (Translation: Excellent explanation, 5 out of 5)

[@statquest]

Awesome! :)

[@jaelbutler7966]

So helpful!!! Thank you so much! The imagery and step-by-step walk-through were just what I needed! It makes so much more sense now!

[@statquest]

Hooray! I'm glad the video was helpful. :)

[@syedmustahsan4888]

Aaaaamaaazing Explanation. I've got a great teacher. Alhumdulillah. Hurraey

[@statquest]

Thank you! 😃

[@Leonardo-jv1ls]

You explain things so slow and step-by-step as it was being explained for chimps. Exactly what i needed. Thank you a lot.

[@statquest]

Glad it was helpful!

[@brandolosaria9611]

Thank you for your video, I've been using this for years already and didnt really understand the mechanics behind, all i know is that I have a general idea that it's used for. With your video, can now understand and even explain it to other people without saying "it just magically works"

[@statquest]

Bam! :)

[@НикитаЦеханович]

I envy modern young math students in colleges all over the world since they can easily choose best explanation of complex things on KZbin( Your channel seems the best I found!). It;s not like studying in the beginning of 2000's when the teacher was drawing some ugly formulas with chalk. making so great thing as maths boring to us. Who knows may be someone who will treat cancer or colonize Mars will pick up some missing brick of understanding from your videos. Pretty much thanks for your effort!

[@statquest]

Wow! Thank you very much! :)

[@yugix901]

Great explanation! Really glad this video was the first one to pop up when I searched for gradient descent, thanks:)

[@statquest]

Awesome! :)

[@AdityaFingerstyle]

There couldn't be any better explanation for Gradient Descent !

[@statquest]

Thank you! :)

[@Ceyhus]

One of the coolest explaining of such important and not easy (at the beginning) topic. Spent at around 4 hours doing all in parallel in excel and rechecking all my steps with huge notes... Now, will shift to the Python to code all my notes Thank you very much!

[@statquest]

Wow, thanks!

[@waleedalmarshidi3494]

I swear this is the most clear and FANTASTIC explanation I've ever found

[@statquest]

Wow, thanks!

[@diencai1812]

OMG this is pure gold !!! Thank you so much for the time in compiling the video and sharing the insight

[@statquest]

Thank you! :)

[@diencai1812]

Love your work Josh; a lot of planning and sequencing have gone into the video production - you deserve a KZbin 'Oscars'. Your channel is making an impact to my learning journey👍🙏

[@123gregery]

I'm following Andrew Ng's Machine Learning Course. I thing he should give a reference to your video for an explanation. That is superb, provided that we know some elementary calculus.

[@statquest]

That would be awesome if he did that. A lot of people come to my videos via Andrew Ng's course, but they have to find it on their own, just like you do. Perhaps you could suggest it to that class. Regardless, I'm glad you like my videos. :)

[@baruchschwartz819]

@Beyond Oblivion me three

[@jaliu]

you accidentally taught me how to take derivatives in a few seconds which i never understood for years... mind is blown.

[@statquest]

That's awesome!!! :)

[@victoro8295]

really? It took you years to apply the chain rule?

[@aakidatta]

I watch several videos and pretty much everyone explained conceptually well but not the math part. This material is gold.

[@statquest]

Thanks!

[@alexchang4582]

I learned gradient descent before. This is by far the best 24 minutes I spent to grasp the essence of this topic. Triple like!

[@statquest]

Thank you very much! :)

[@hunters.dicicco1410]

i gained new intuition on gradient descent that i never realized during university because of this video. thanks a MILLION josh!

[@statquest]

Hooray! I'm glad the video was helpful. :)

[@elgabotb1]

Me encanta! Eres todo un tezo como decimos aquí en Colombia. Love it, you are such a "tezo" (brilliant) like we used to say here in Colombia

[@statquest]

Muchas gracias!!! :)

[@simetric6551]

Hola soy nuevo en esto. Me podrias decir de donde salio el 0.64 del slpoe o pendiente al principio del video. Gracias

[@viniciusdeoliveira7637]

@@simetric6551 I think that it probably came from the previous calculation upon the example data.

[@ghosh5908]

This channel is awesome...It should have millions of subscribers....I have become a fan Josh...big fan...

[@Immerz]

I love that you always put the entire script in the slides. This way we can pause and really let the things you just said sink in. My teacher is probably a good teacher, but sometimes the things he says go into my left ear and leave through my right. Would be nice if I could pause and replay him aswell lol.

[@statquest]

bam! :)

[@janilayturatkhankyzy1321]

I will pray for your health. So much hard work put into this channel. God bless you

[@statquest]

Thank you very much! :)

[@hashiska.5358]

I will summarize what's written in the comments section: WE LOVE YOU.

[@statquest]

Hooray!!! Thank you very much! :)

[@hajhouj]

THE CHAIN RUUUUUULE !!! :-D ...... I Love your videos, best courses I ever seen

[@markusvonderluehe5468]

Great explanation starting with the basics and explaining it step by step! Brilliant!!!

[@statquest]

Thanks! :)

[@aditilangar278]

I was in pain because of the concept of gradient descent and its relationship with the line of best fit. I just can’t believe that someone can explain it so well. Keep it up!

[@statquest]

Thank you! :)

[@RoshanMore04]

I had searched tons of books to understand this concept, but none explained the way you did ...BAM!!!!!

[@statquest]

Thank you!

[@ramsunil4317]

Loved the way your teaching, u made mathematics my favorite subject

[@statquest]

Hooray! :)

[@fishermanwithfishes2286]

Teacher: "what we knew about Gradient Descent?" Me:"THE CHAIN RULE!!!!!!!!!!"

[@statquest]

YES! :)

[@carlosmorenom.122]

Bup bup bip bip bup bip bup

[@ghaliahmed]

best of the best explanation in this word !!!!!!!!! Thanks a lot!

[@tahmidakter2034]

I believe no other teacher can teach as good as you.You are a great teacher.I was trying to understand linear regression & gradient descent's theory but couldn't understand properly after watching so many videos.But after watching your video it has became so easy for me.I request you to release a machine learning course.I believe you can prosper in life.

[@statquest]

Thank you very much! :)

[@mohsen865]

i wonder how you have understood math concepts so deeply that enables you to express and explain incredibly clearly. many thanks professor

[@statquest]

I spend a lot of time working on these videos and go through many drafts before I have something that works.

[@omnesomnibus2845]

Great presentation as always! One note, at 18:53 I believe you forgot to take out the ^2 for the second and third slope-derivative terms of the residuals. But the idea is clear anyway. I'd like to see this implemented for clusters and logistic regression as well, and what loss functions are best for them and why. Maybe also a bit more detail about why the slope multiplied by the learning rate is the best way to find the step size. You mentioned it, in terms of the desire to approach a slope of zero (therefore it makes sense to have a negative multiple of the slope be the penalty, since a large slope would lead to subtracting a large amount and a small slope would lead to subtracting a small amount). As I said, you mentioned it, but perhaps a bit more visual demonstration would be good. Great though! P.S. As an additional source of revenue, you might 'sell' a zipped version of all your videos for a donation, or perhaps put it into a book that can be downloaded for a donation.

[@statquest]

Ah - there are always a few typos. Darn. I thought I'd caught all of them. But, like you say, the point is clear, so I won't lose any sleep over it, I hope! If you're curious about how gradient descent works for t-SNE, just look at the original manuscript for it (simple google search). They show the gradient that they use.

[@omnesomnibus2845]

@@statquest Okay, thanks for the pointer!

[@mariuszwilk4718]

​@@statquest Also at 11.05 you say that the step size is "negative five point seven".. I presume you meant to say -0.57, as it is written on the slide.

[@a_sun5941]

Agree that the presentation is really really great! And just one more note besides the typo at 18:53: there are two pairs of concepts slightly a bit confusing in this video -- (a) weight for linear regression vs the x variable of human weight (b) slope of the linear regression fit and slope of the sum of squared residuals vs intercept. For (a), as slope of linear regression fit is often referred as 'weight' of the function y^ = w* x+b, using a variable of human weight could be a bit confusing, it might be better if you call it 'human weight' to distinguish with function weight, or find some other variables instead of human weight. For (b), when you talk about 'slope' in gradient descent, I sometimes thought you were talking about the slope of the linear regression, and then realized it's another slope. Maybe it will be good if you use 'gradient' for the second slope?

[@hai7263]

The beep boop really caught me by surprise. Laughed out loud in front of my computer...

[@statquest]

Bam! :)

[@albertding9700]

Hi Josh this was really helpful. Can you do deep learning and neural networks next?

[@statquest]

Those are definitely on the to-do list, but right now I'm working on Gradient Boosting, so that's next.

[@samiulsaeef2076]

@@statquest Any chance to get the Gradient Boosting video withing a week? That would be specially helpful due to some personal urgency!

[@justinli19901027]

can't appreciate enough how clearly the concept is explained. thank you

[@statquest]

Thank you very much! :)

[@toyl6727]

I am doing a academic research project, and I thank you for really showing me the significance and utility of Gradient Descent!

[@statquest]

Glad it was helpful!

[@neptunesbounty1786]

Andrew Ng needs more songs at the beginning of his lectures

[@statquest]

That would be awesome! :)

[@neptunesbounty1786]

@@statquest in all seriousness, this was an excellent video to really cement the idea. Staaatttquessst.

[@bakrianoo]

Like before watching. Is there any option for DOUBLE likes to append an extra like after watching

[@statquest]

Thank you! I'll put a request in to KZbin for the Double Like button. :)

[@ravitejavarma1307]

Double BAMMMM........ Please post more videos sir....

[@statquest]

Thanks! I'm working on new videos as fast as I can. :)

[@leoncheneyon7317]

Please someone give this guy another stimulus check. I deem your teaching essential to America. Stay available!! Thanks, now I know how to find alpha and beta using Gradient Decent algorithms based on the loss(cost function).

[@statquest]

BAM! :)

[@ツァイチェンシュン]

I have no idea what gradient descent for a year, and now i finally know what it is. Thank you so much.

[@statquest]

Awesome! I'm glad the video was helpful.

[@youtubevanced8291]

I'm final year student (Master degree in Mathematics) and this is my Project 🤮 . Now little bit clear what gardient decent is.

[@TremendousSax]

Gardient is quite decent

[@rotters2556]

How did you get to a masters in math and find that kind of stuff uninteresting?

[@nriezedichisom1676]

Beautifully explained. For the very first time, I understand this

[@gaurangpendharkar6324]

This is insanely helpful Josh!!! I'm trying to understand neural networks and made the mistake of resorting to academic papers which use complicated language and unhelpful explanations. I read those for hours and only understood bits and pieces but a 25 minute video on this youtube channel helped me understand better than ever!

[@statquest]

Awesome! I also have a bunch of videos on Neural Networks that walk you through each part step-by-step: kzbin.info/www/bejne/eaKyl5xqZrGZetk

[@shrirangphadke6156]

Please give Josh the World's best teacher award for the video content, Nobel price for the noble work he's doing and Oscars for the song! Triple BAM!

[@statquest]

Thank you!!!

[@datoubi]

so you know often people say how a channel deserves more attention even though already having millions of subscribers. This channel, however, is one of the few channels i know where I would actually agree with such a statement.

[@statquest]

Thank you very much!!! I really appreciate your support.

[@musabayr1580]

Whenever I get hung up about some hard to understand topic, I remember Josh waiting you in StatQuest; so be relax and enjoy learning something new with him; without any doubt.

[@statquest]

Thank you! :)

[@permagoalie1439]

I'm a circuit designer. I'm an idiot when it comes to anything computer science related. You made an idiot understand a daunting concept in AI training. Thank you.

[@statquest]

Thanks!

[@400bc..]

What all do u do as a circuit designer and how do you integrate Machine learning concepts in circuit design? I am curious to know

[@BackToBackSWE]

Bless your soul to its very core my good sir, may the internet flourish.

[@statquest]

Thank you! :)

[@Hosain_Ahmed]

Thanks a lot. I'm from Bangladesh. It means English is not my native language but I have learnt many things from the video. All the visually representation was really amazing.

[@statquest]

Thank you! I'm glad the video was helpful.

[@farukbulut5319]

A fluent, plausible, logical explanation. Thanks a lot.

[@statquest]

Thanks! :)