The full Neural Networks playlist, from the basics to deep learning, is here: kzbin.info/www/bejne/eaKyl5xqZrGZetk Support StatQuest by buying my book The StatQuest Illustrated Guide to Machine Learning or a Study Guide or Merch!!! statquest.org/statquest-store/
@motherisape2 жыл бұрын
Bamm
@gbchrs2 жыл бұрын
@seanleith5312 Жыл бұрын
Quit the singing, please
@statquest Жыл бұрын
@@seanleith5312 Noted
@dcscla3 жыл бұрын
Man, your promotions are not shameless! Actually, what you do is a gift for us, for the price that you charge and for the level of the content, we are being gifted and not a buying something. You are far better than a lot of paid (and expensive) courses. Just check out your video comments to see how people few happy when they discover your videos!! Great work as always. Thank you so much!!!👏🏻👏🏻👏🏻👏🏻
@statquest3 жыл бұрын
Thank you very much! :)
@Luxcium Жыл бұрын
He is using the concept of reverse psychology by presenting great stuff at a good price and as you mentioned theses promotions are not shameless… They are shameful, as you hinted he should indeed be ashamed of giving us such a good and advantageous offer… 😅😅😅😅
@jonforce3603 жыл бұрын
You released this video just in time for my AI exam! Thank you. Sometimes I think professors use really complex notation just to feel smarter than students, it doesn't help learning. I love your content.
@statquest3 жыл бұрын
Thank you very much!
@sarazahoor91332 жыл бұрын
I want to copy-paste this comment! :D
@puppergump41172 жыл бұрын
Ain't that right. They must be mad that they don't understand the actually smart people so they don't want to be understood either.
@zhongtianjackwang5346 Жыл бұрын
lol, that is exactly what I want to say
@katwoods85143 жыл бұрын
omg yay! I just discovered that you've made a million videos on ML. I'm going to go binge all of them now :D
@statquest3 жыл бұрын
Hope you enjoy!
@motherisape2 жыл бұрын
Bamm
@juliocerono_stone53652 ай бұрын
I am already 65, and your videos have helped me understand the basics behind NN. Thank you so much!!!!
@statquest2 ай бұрын
Bam! :)
@iskrega2 жыл бұрын
I just want you to know your channel has been instrumental in helping me towards my Data Science degree, I'm currently in my last semester. I'll be forever grateful for your channel and the time you take to make these videos. Thank you so much.
@statquest2 жыл бұрын
Thank you and good luck with your final semester! BAM! :)
@hamzasaaran3011 Жыл бұрын
I am studying for a Master's degree in bioinformatics now, and as someone who knows little about statistics, I really can't thank you enough for your videos and the effort that you have put into them.
@statquest Жыл бұрын
Thank you!
@ksrajavel4 жыл бұрын
Finally. The wait is overBAM!!!
@statquest4 жыл бұрын
TRIPEL BAM!!!
@mariolira92793 жыл бұрын
F I F T H B A M!
@syco_Rax3 жыл бұрын
SUPER BAM!!!
@evangeliamm3 жыл бұрын
You have no idea how much I appreciate your work. Your explanations are so fun and simple, I'm just so grateful!
@statquest3 жыл бұрын
Thank you very much! :)
@akeslx11 ай бұрын
I finished business school 25 years ago where I studied statistics and math. So happy to see that neural networks are fundamentally just a (much) more advanced regression analysis.
@statquest11 ай бұрын
BAM!!! Thank you for supporting StatQuest! Yes, neural networks are a lot like regression, but now we can fit non-linear shapes to the data, and we don't have to know in advance what that shape should be. Given enough activation functions and hidden layers, the neural network can figure it out on its own.
@advaithsahasranamam6170 Жыл бұрын
This is excellent stuff! As a visual learner, your channel is a BLESSING. Thank you so much for your fantastic work on breaking down concepts into small, bite-sized pieces. It's much less intimidating, and you deserve so much more appreciation . You also gained my subscription to your channel! Keep doing a great job, and thank you SO MUCH for having my back!
@statquest Жыл бұрын
Thank you very much!!! :)
@katwoods85143 жыл бұрын
Love this! You've explained it far better than anywhere else I've seen, and you made it entertaining at the same time! Thank you so much for making this.
@statquest3 жыл бұрын
Awesome, thank you!
@mot73 жыл бұрын
You are the best. I wish every ML learner find you first. I am going to do my part and tweet about you. Thanks for making these videos! Wish you more success.
@statquest3 жыл бұрын
Wow! Thank you very much! I really appreciate the support. BAM! :)
@mohammadrahman11263 жыл бұрын
Amazing explanation! I've spent years trying to learn this and it always went too quickly into the gory mathematical details. Aha moment for me was when green squiggle equal blue plus orange squiggles lol Thank you for this Josh!!!
@statquest3 жыл бұрын
Glad it was helpful!
@amandak13963 жыл бұрын
Kind of like how Feyman reduced gory math in physics to actual squiggle, double bam!
@ML-jx5zo3 жыл бұрын
Now Iam reading backpropagation, I worried about this vedio didn't came for long time , And finally I got a treasure.
@statquest3 жыл бұрын
bam! :)
@yasameenmohammed4366 Жыл бұрын
My Machine Learning exam is tomorrow and re-watching your videos to review concepts is helping me so much! Thank you!!!
@statquest Жыл бұрын
Good luck! BAM! :)
@Amir-gc8re2 жыл бұрын
Finally a proper, detailed, step by step explanation. This guy is absolutely AMAZING ! Thank you so much for all the hard work in putting these videos together for us.
@statquest2 жыл бұрын
Thank you very much! :)
@raunak53447 ай бұрын
I just iterated on a gradient descent and found that this is the best possible way to teach this topic and no other lecture in the entire existence is better than this one
@statquest7 ай бұрын
bam!
@jays95912 жыл бұрын
May I say .... You are such a good teacher that it is most enjoyable to watch your videos. I am proficient in statistics (via university econometrics 101) ... and I did not realise all those fancy terms in machine learning are actually concepts that are common items in the stats that I learned in the 1970s, e.g., biases and weights, label, activation functions etc. Anyway, I can see that a lot of viewers appreciate your work and teaching. I have also 'updated' myself. Thank you.
@statquest2 жыл бұрын
Thank you very much!
@babarali43132 жыл бұрын
Its the teacher who makes the Subject easy or difficult and the way you explained Neural Network, I am speechless
@statquest2 жыл бұрын
Thanks!
@edphi10 ай бұрын
It should be made a crime for anyone to see other videos on backpropagation before they reach Statquest. The world is confused by teachers who tell the big story before the basic. Learn the basic and the picture fall into place like the chain rule 😊
@statquest10 ай бұрын
bam! :)
@mashmesh3 жыл бұрын
Omg, protect this man at all costs, this was pure gold!!! Also, thank you, sir, for talking so slowly because if my brain squiggles need to work faster they will burn up x)
@statquest3 жыл бұрын
Glad you enjoyed it!
@tagoreji21432 жыл бұрын
Teaching such complicated topics in a simple, Easily Understandable way.👏👏👏.Thank you, Professor
@statquest2 жыл бұрын
Thanks!
@edrobinson82482 ай бұрын
simply brilliant. Learning is indeed a quest. A quest for someone who understands and can present understandably. Thanks.
@statquest2 ай бұрын
Thanks!
@subusrable3 ай бұрын
this video is a gem. I had to watch it a few times and like in gradient descent, I went closer to the target level of knowledge with each step :)
@statquest3 ай бұрын
BAM! :)
@manalisingh11282 жыл бұрын
Wow Josh way to go!!!! You have the concepts so clear in your own head that it seems a piece of cake for us 🍰♥️ Love from India! 🇮🇳
@statquest2 жыл бұрын
Thanks so much!!
@AhmadAbuNassar2 ай бұрын
Thank you very much for this comprehensive yet simple explanation
@statquest2 ай бұрын
Glad it was helpful!
@dinara85713 жыл бұрын
JUST WOW! Thank you so much, Josh! I cannot express the feeling I had when EVERYTHING made sense!!! TRIPLE BAM! Never thought I would be extremely excited to pause the video and try to solve everything by hand before I look at the next steps
@statquest3 жыл бұрын
BAM! :)
@NadaaTaiyab2 жыл бұрын
oh that's a good idea!
@jennystephens32153 жыл бұрын
Josh, this is amazing. You really make things so easy to visualise which is crazy considering the hidden networks are meant to be so hard that they are referred to as black box! Thanks for all your videos. I have used heaps over the last twelve months. Thank you again.
@statquest3 жыл бұрын
Hooray!!! I'm so glad that you like my videos. :)
@codeman23 жыл бұрын
I searched neural net and again your video popped that too just 4 month old, love to get your helpful videos right before my semester
@statquest3 жыл бұрын
:)
@wong43592 жыл бұрын
I found your explanation is far more easier to understand than the edx online course I am taking, BAM !!!
@statquest2 жыл бұрын
bam!
@jblacktube Жыл бұрын
I didn't even get through the jingle before I gave a thumbs up. Thanks for the chuckle, can't wait to watch the rest of this!
@statquest Жыл бұрын
BAM! :)
@user-re1bi2bc8b3 жыл бұрын
Incredible. Sometimes I need a refresher on these topics. There’s much to remember as a data scientist. I’m so glad I found your channel!
@statquest3 жыл бұрын
Bam!
@ABCEE100011 күн бұрын
have no idea how can i thank you as you deserve .. thank you so much
@statquest11 күн бұрын
Thanks! :)
@lukasaudir8 Жыл бұрын
I am really glad that people like you exist!! Thank you so much for those incredible lessons
@statquest Жыл бұрын
Glad you like them!
@sarazahoor91332 жыл бұрын
For the first time ever in history, I have understood the concept behind Neural Networks! BAM!!!! :D Thanks Josh, so grateful :)
@statquest2 жыл бұрын
BAM! :)
@perhaps467 Жыл бұрын
Thank you so much for this series! I haven’t been able to find any other videos that really break down the mechanics of neural networks like this.
@statquest Жыл бұрын
Thanks!
@TheClearwall3 жыл бұрын
Who else is using these videos to put together a semester project? So far, I've put Regression Trees, K-fold CV, complexity pruning, and now Neural networks as my final model construction. Josh is worth a double bam every time.
@statquest3 жыл бұрын
BAM! Good luck with your project.
@mjcampbell11832 жыл бұрын
Wow! This is an incredible video. Thank you SO MUCH for making this for us. This is one of the best videos I've seen to explain this concept. The hard work you have put into this is something that I am incredibly appreciative of. Thanks, man.
@statquest2 жыл бұрын
Wow, thank you!
@BlochSphere8 ай бұрын
The level of detailing in this video is just 🤯 I hope i can try to make my Quantum Computing videos this clear!
@statquest8 ай бұрын
Good luck!
@iliasaarab79223 жыл бұрын
Best explanation that I've seen so far on backpropagation!
@statquest3 жыл бұрын
Thank you! :)
@maliknauman35662 жыл бұрын
How amazing is the way you convey complex concepts.
@statquest2 жыл бұрын
Thank you!
@O5MO2 жыл бұрын
I never understood backpropagation. I knew some things from other tutorials, but as for beigginer, it was very hard to understand. This video (and probably series) is the best i could find. Thank you.
@statquest2 жыл бұрын
Glad it was helpful!
@nojoodothmanal-ghamdi1026 Жыл бұрын
I . JUST . LOVE . YOUR . CHANNEL !! you literly explain things very clearly and step by step! I just cannot thank you enough really
@statquest Жыл бұрын
Wow, thank you!
@ucanhnguyen47513 жыл бұрын
Thank you for this video. I have been waiting for this all the time. Finally, it appeared just 1 day before my exam. You are a life saver!!
@statquest3 жыл бұрын
Good luck with your exam! :)
@deepanjan12343 жыл бұрын
This is really awesome. I thank you for your effort in developing this highly enriched content. BAM !!!
@statquest3 жыл бұрын
Thank you!
@David5005ful2 жыл бұрын
The type of in depth video I’ve always wanted!
@statquest2 жыл бұрын
Thank you!
@knt2112 Жыл бұрын
Hello sir, Thanks for such an simple explanation, never understood back propagation in such a depth at this ease. 🎉
@statquest Жыл бұрын
Thank you!
@yiliu5403 Жыл бұрын
Best Neural Networks Lectures! Just ordered the book from Amazon to support!
@statquest Жыл бұрын
Wow! Than you very much! :)
@madghostek3026 Жыл бұрын
9:00 at this moment I realised I'm watching the best math content on earth, because you never see simple stuff like this being given attention to. Luckily I already know how summation symbol works, but I didn't know it in the past, and nobody cared to explain. But it's just not about the summation symbol, imagine the other 1000 small things somebody might not understand, and doesn't realise they don't understand, because it's been skimmed over
@statquest Жыл бұрын
Thank you so much! I really appreciate it! :)
@aryabartarout569711 ай бұрын
You have cleared my doubt on back propagation, gradient descent and chain rule. Triple Bam !
@statquest11 ай бұрын
:)
@viethoalam99585 ай бұрын
give respect to my math teacher, but this is so much easier to understand.
@statquest5 ай бұрын
bam! :)
@terrepus98563 жыл бұрын
The time couln't be more perfect ... 3 hours before my machine learning exam !! Thank you!!!!
@statquest3 жыл бұрын
Good luck with your exam! I hope it goes well.
@evie389 Жыл бұрын
I was reading an article based on Backpropagation and I did not understand a single word. I had to watch all your videos starting from Chain Rule, Gradient Descent, NNs...I re-read the article and understood everything!!! But now I can't get the beep--boop and small/double/triple/ bam out of my head lol.
@statquest Жыл бұрын
BAM! I'm glad my videos were helpful! :)
@josephif Жыл бұрын
Lecture was awesome,more affective and easy to understand Thanks
@statquest Жыл бұрын
Thank you! :)
@CHERKE_JEMA55752 жыл бұрын
You rescued me from the unknown!! Much Love from Ethiopia
@statquest2 жыл бұрын
Bam! :)
@mrglootie1013 жыл бұрын
I've been waiting for this all the time checking the notification haha
@statquest3 жыл бұрын
Hooray! The wait is over.
@d_polymorpha9 ай бұрын
Hello, thank you for the video! This series has been really helpful to learn about deep learning. I have a couple of questions. 1. When using gradient descent and backpropagation, do we always use SSR to measure how good a fit the parameter we are estimating is? Or are there other ways? 2. The second question is when using chain rule for calculating derivatives. The first part is d SSR/ d Predicted. In that first part @ 11:25 are you using chain rule again within that first part? And when deriving the inside Observed - Predicted @ 11:34 where do you get 0 and 1 from?
@statquest9 ай бұрын
1. The "loss function" we use for gradient descent depends on the problem we are trying to solve. In this case, we can use the SSR. However, another commonly used "loss function" is called Cross Entropy. You can learn more about cross entropy here: kzbin.info/www/bejne/bHLVhKypatZ7d7c and kzbin.info/www/bejne/rnOomWlsi56akNE 2. You can learn how the chain rule works (and understand the 0 and 1) here: kzbin.info/www/bejne/rZ2Unqyup9mEfrM
@aviknash3 жыл бұрын
Excellent job Josh!!! Just loved it!!! Thanks a ton for your fun-filled tutorials :)
@statquest3 жыл бұрын
Glad you like them!
@aminmoghaddam76246 ай бұрын
I wish our lecturers watched these videos before trying to make their own teaching slides! (With acknowledgement of course!)
@statquest6 ай бұрын
bam!
@royazullay7556 Жыл бұрын
That Josh guy is just awsome !! Definitely will support !!
@statquest Жыл бұрын
Thank you!
@superk90592 жыл бұрын
Thank you very much for your video~ Your videos make me feel that studying English make so much sense, otherwise I can't enjoy such beautiful thing~ 👍👍👍❤❤❤
@statquest2 жыл бұрын
WOW! Thank you very much!!! And thank you for your support!!! :)
@chrislee45312 жыл бұрын
I learn more from four of your videos than 200 pages of textbook gibberish
@statquest2 жыл бұрын
Thanks!
@ElNick092 жыл бұрын
I have been a student my entire life and have taught college level courses myself, and I must say you are one of the finest lecturers I have ever seen. This statquest is a gem. Your work is so succinct and clear its as much art as it is instruction. Thank you for this incredible resource!
@statquest2 жыл бұрын
Thank you very much! :)
@alexissanchezbro3 жыл бұрын
Your getting better and better. Thank you
@alexissanchezbro3 жыл бұрын
BAAAAAAAMMM
@statquest3 жыл бұрын
:)
@epistemophilicmetalhead945410 ай бұрын
Back propagation (aka finding w's and b's) start with b_final=0. you'll notice that error = (actual - predicted)^2 is really high. so you find the gradient descent of squared error wrt b_final and find out the value of b_final for which the squared error is minimum. that is your optimal b_final. gradient descent: derivative of sum of squared errors wrt b_final = derivative of sum of squared errors wrt predicted value y * derivative of y wrt b_final. d(y observed - y predicted)^2/d(y predicted) = -2*(y observed - y predicted) d(y predicted)/d(b_final) = d(sum of all those previous curves obtained through each node of the layer + b_final)/d(b_final) = 0+0+0....+0+1=1 take the predicted curve ke x values and find the derivative/slope. step size = slope*learning rate. new b_final = old b_final - step size. keep repeating until slope touches 0. this is how gradient descent works and you've found your optimal b_final.
@statquest10 ай бұрын
double bam
@willw4096 Жыл бұрын
Thanks for the great video!! My notes: 7:23 8:11 8:48 10:00 10:22❗,11:13 - 11:48, 11:56 12:08 13:30❗,
@statquest Жыл бұрын
BAM! :)
@cthutu8 ай бұрын
Excellent content, excellent delivery - just bought your book!
@statquest8 ай бұрын
Thank you so much for supporting StatQuest! BAM! :)
@marpin61623 жыл бұрын
Thank you. Now everything is more clear.
@statquest3 жыл бұрын
BAM! :)
@preetikharb82833 жыл бұрын
This video made my day, thank you so much, Josh!!
@statquest3 жыл бұрын
Thanks!
@Luxcium Жыл бұрын
Wow 😮 I didn't knew I had to watch the *Gradient Descent Step-by-Step!!!* before I can watch the video related to *Neural Networks part 2* that I must watch before I can watch the *The StatQuest Introduction To PyTorch...* before I can watch the *Introduction to coding neural networks with PyTorch and Lightning* 🌩️ (it’s something related to the cloud I understand) I am genuinely so happy to learn about that stuff with you Josh❤ I will go watch the other videos first and then I will back propagate to this video...
@statquest Жыл бұрын
Getting warmer...
@amirhossientakeh55402 жыл бұрын
perfect you explain complicated things very underatandable it's amazing
@statquest2 жыл бұрын
Thank you very much! :)
@jieunboy Жыл бұрын
insane teaching quality, thanks !
@statquest Жыл бұрын
Glad you think so!
@JamesWasTakenOhWell Жыл бұрын
Thank you for the amazing effort you put into this video and BAM!!! as always!
@statquest Жыл бұрын
Thanks!
@VishalKhopkar1296 Жыл бұрын
you taught this better than professors at CMU, not kidding
@statquest Жыл бұрын
Thank you! :)
@SPLICY3 жыл бұрын
The understated BAM at 4:40 cracked me up 😂
@statquest3 жыл бұрын
SPLICY in the house!!! BAM! :)
@alhaanali2502 Жыл бұрын
You got the best way to teach thank you❤
@statquest Жыл бұрын
Thanks!
@ge13r4 ай бұрын
Saludos desde San Cristóbal, Venezuela!!!
@statquest4 ай бұрын
:)
@douglasespindola51852 жыл бұрын
If statistics were a religion, Josh would be it's pope.
@statquest2 жыл бұрын
bam!
@zombieeplays31465 ай бұрын
I come to this channel for the intros tbh!
@statquest5 ай бұрын
bam! :)
@sivanschwartz38132 жыл бұрын
Josh thank you so much, great as usual :) Im having a question, would it be more "fully explained" to say: dSSR/db_3 = dSSR/dResiduals * dResiduals/dPredicted * dPredicted/db_3 ? Thanks!
@statquest2 жыл бұрын
I'm not sure. It doesn't change the derivative, so perhaps it's just a matter of taste or preference.
@DanielRamBeats Жыл бұрын
This is finally all making sense to me thank you
@statquest Жыл бұрын
Thanks!
@utkugulgec55083 жыл бұрын
These videos should be protected at all costs
@statquest3 жыл бұрын
:)
@harishbattula26723 жыл бұрын
great explanation sir. Tripple BAM........kudos to your presentation.
@statquest3 жыл бұрын
Thank you! :)
@pranjalpatil96592 жыл бұрын
Perfect explanation!
@statquest2 жыл бұрын
Thank you!
@vokoramusyuriy106 Жыл бұрын
Thanks a lot, Josh!
@statquest Жыл бұрын
My pleasure!
@miriza23 жыл бұрын
BAM! Thanks Josh! You’re the best! Got myself a pink T-shirt 😍😍😍
@statquest3 жыл бұрын
Hooray! And thank you for supporting StatQuest!!!
@harshpahade2703Ай бұрын
Hey, thanks for this playlist, it was a great find. Just pointing out a typo at 1:44 where the Note says 'spit' instead of 'split'.
@davidlu10032 ай бұрын
I think I understand the neural network clearly now.😁😁😁
@statquest2 ай бұрын
bam! :)
@richfilms63076 ай бұрын
Unbelievable! Thank you!!
@statquest6 ай бұрын
Thanks!
@Morais1153 жыл бұрын
I'm buying the shirt! Kudos to you sir.
@statquest3 жыл бұрын
Awesome! Thank you!
@RumayzaNorova9 күн бұрын
Day 2 of leaving the comment and studying with statquest :)
@statquest9 күн бұрын
double bam! :)
@richarda16303 жыл бұрын
Where were you 5 years ago???!?!?! :D Awesome work man! Keep it up :)
@statquest3 жыл бұрын
Thanks! I have 4 more neural network videos coming out in the next month.
@richarda16303 жыл бұрын
@@statquest awesome! can't wait :D
@mahmoudkhadijeh48852 жыл бұрын
You did a great job!. Thank you so much
@statquest2 жыл бұрын
Thanks!
@abhishekm49963 жыл бұрын
Much waiting.... Finally came..
@statquest3 жыл бұрын
Bam! :)
@SPLICY3 жыл бұрын
This is what she said
@יהונתןקרסניי3 жыл бұрын
so good. can't wait for the next one!
@statquest3 жыл бұрын
Bam! It should be out soon.
@anasmomani6473 жыл бұрын
you make me regret taking any online course .. just wait your next videos