Gradient Boosting : Data Science's Silver Bullet

A dive into the all-powerful gradient boosting method!
My Patreon : www.patreon.co...

[@ew6392]

Man I've discovered your channel and am watching your videos non-stop. No matter which topic, it is ALL as if a stream of light shines and makes it all understandable. You've got a gift.

[@zhenwang5872]

Agreed! You've got a gift to shine the light over topics.

[@sELFhATINGiNDIAN]

No

[@soroushesfahanian5625]

The last part of 'Why does it work?' made all the difference.

[@javierperezvargas9132]

totally agree

[@shnibbydwhale]

You always make your content so easy to understand. Just the right amount of math mixed with simple examples that clearly illustrate the main ideas of whatever topic you are talking about. Keep up the great work!

[@KameshwarChoppella]

Non math person here and even i could understand this tutorial. Probably have to see it a couple more times because I'm a bit slow in my 40s now. But you really have a gift. Keep up the good work.

[@mrirror2277]

Hey thanks a lot, was literally just searching about Gradient Boosting today and your explanations have always been great. Good pacing and explanations even with some math involved.

[@marcosrodriguez2496]

your channel is criminally underrated. Just one question. You mentioned using linear weak learners, i.e. f(x) is a linear function of x. In this case how would you ever get anything other than a linear function after any number of iterations? at the end of the day, you are just adding multiple linear functions. it seems this whole procedure would only make sense, if you pick a nonlinear weak learner.

[@jiangjason5432]

Great video! A bonus for using squared error loss (which is commonly used) as the loss function for regression problems: the gradient of squared error loss is just the residual! So each weak learner is essentially trained on the previous residual, which makes sense intuitively. (I think that's why each gradient is called "r"?)

[@samirkhan6195]

Yeah, squared error is easily differentiable compared to others like root squared error, and is not dependent upon number of observation like mean squared error or root mean squared error does , if you want gradient exactly equal to residual , you can choose to take (1/2)(squares error) as loss function.

[@nikhildharap4514]

you are awesome man! I just love coming back to your videos every time. they are just the right length, and the perfect depth.. Kudos!

[@АннаПомыткина-и8ш]

Your videos on data science are awesome! They help me to prepare for my university exam a lot. Thank you very much!

[@MiK98Mx]

incredible video, you make understandable a really hard concept. Keep teaching like this and big things will come!

[@alicedennieau5459]

Completely agree, you are changing our lives! Cheers!

[@hameddadgour]

This is a fantastic video. Thank you for sharing!

[@ritvikmath]

Glad you enjoyed it!

[@honeyBadger582]

Great video as always! I would love If you could build on that video and talk about XGBoost and math behind it next!

[@pgbpro20]

I worked on this 5(?) years ago, but needed a reminder - thanks!

[@arjungoud3450]

Man U r the 5th person, none has explained as simple and clear as you, thanks a ton

[@MiladDana-b7h]

that was very clear and useful, thank you

[@ToughLuck808]

Unbelievable variety of topics in this channel! What is your daily job? You have an amazing amount of knowledge

[@luismikalim2535]

Thanks for the effort u put in to help ur watchers understand, it really helped me understand the concept behind gradient descent!

[@rajrehman9812]

Can mathematics behind ML be less dreadful and more fun? Well yes, if we have a tutor like him... amazing explanation ❤️

[@jakobforslin6301]

You're an amazing teacher, thanks a lot from Sweden!

[@Andres186000]

Thanks for the video, also really like the whiteboard format

[@Matt_Kumar]

Any chance your interested in doing a video on EM algorithm intro with a toy example? Love your videos please keep them coming!

[@Sanatos98]

Pls don't stop making these videos

[@adityamohan7372]

Finally understood it really well, thanks!

[@jonerikkemiwarghed7652]

You are doing a great job, really enjoying your videos.

[@Halo-uz9nd]

Phenomenal. Thank you again for making these videos

[@Ranshin077]

Very awesome, thanks for the explanation 👍

[@GodeyAmp]

Great video brother.

[@markus_park]

Thank you so much! You just blew my mind

[@ritvikmath]

You're very welcome!

[@ИльдарАлтынбаев-г1ь]

Man, you are amazing!

[@jeroenritmeester73]

In words, is it correct to phrase Gradient Boosting as being multiple regression models combined, where each subsequent model aims to correct the error that the previous models couldn't account for?

[@domr.2694]

Thank you for this good explanation.

[@joachimheirbrant1559]

thanks man you explain it so much better than my uni professor :)

[@ritvikmath]

Glad to hear that!

[@bassoonatic777]

Excellently explained. I was just reviewing this and was very helpful to see how someone else think through this.

[@dialup56k]

well done - gee there is something to be said about a good explanation and a whiteboard. Fantastic explanation.

[@ritvikmath]

Thanks!

[@garrettosborne4364]

Best boosting definition yet.

[@ganzmit]

nice video series

[@EW-mb1ih]

let's talk about the first word in gradient boosting..... boosting :D Nice video as always

[@kaustabhchakraborty4721]

Just asking that is the concept of gradient Boosting similar to Taylor Series functions. Each term is not very good at predicting the function but as u add more functions(terms), the approximation to the function gets better.

[@benjaminwilson1345]

Perfect, really well done!

[@ritvikmath]

Thanks!

[@zAngus]

Thumbs up for the pen catch recovery at the start.

[@ritvikmath]

😂

[@Sam-uy1db]

So so well explained

[@rickharold7884]

Hmmmm v interesting. Something to think about. Thx

[@estebanortega3895]

Amazing video. Thanks.

[@ianclark6730]

Love the videos! Great topic

[@sophia17965]

Thanks! great videos.

[@emirhandemir3872]

The first time I watched this video, I understood shit! Now the second time, I studied the subject and learn more :), it is much more clear now :)

[@tobiasfan5407]

You're the man. Thank you!

[@lashlarue7924]

Bro, it's late AF and I'm not gonna lie, I'm passing out now, but I'mma DEFINITELY catch this shit tomorrow. 👍

[@ritvikmath]

😂 come back anytime

[@lashlarue7924]

@@ritvikmathWell, it's been a year, but I came back! 😂

[@user-xi5by4gr7k]

Great video! Never seen gradient descent used with the derivative of the loss function with respect to the prediction. Not sure if I understand it 100% but If the gradient were, for example, -1 for ri, would the subsequent weak learner fit a model to -1? Or would the new weak learner fit a model to (old pred -(Learning Rate * gradient))? Would love to see a simple example worked out for 1 or 2 iterations if possible. Thank you! :)

[@xmanxman1527]

Isn't gradient the partial derivative with respect to feature(xi), not with respect to the prediction(y^)?

[@sohailhosseini2266]

Thanks for sharing!

[@mitsuinormal]

Yeiii you are the best !!

[@m.badreddine9466]

move on so I can get screenshot 😂. brilliant explanation ,well done

[@chiemekachinaka5236]

Thanks man

[@7vrda7]

great vid!

[@chocolateymenta]

great video

[@arjungoud3450]

Can you please make a video on XGBoost and its advantages by comparing. Thank you.

[@jamolbahromov4440]

Hi, thank you for this informative video. I have some problem understanding the graph at 5:27. How do you map out the curve on the graph if you have a single pair of prediction and loss function values. do you create some mesh out of the give pair?

[@gayathrigirishnair7405]

Come to think of it, concepts from gradient boosting apply perfectly to less mathematical aspects of life too. Just take a tiny step in the right direction and repeat!

[@ritvikmath]

yes love when math reflects life!

[@VictorianoOchoa]

are the initial weak learners randomly selected? If so, can this initial random selection be optimized?

[@adinsolomon1626]

Learners together strong

[@saravankumargowthamv9338]

Very good content but then it would be great if you can stay at the corner allowing us to have a look at the board for us to understand otherwise great session

[@ritvikmath]

Thanks for the suggestion !

[@ashutoshpanigrahy7326]

after 4 hrs. of searching in vain, this has truly proven to be a savior!

[@regularviewer1682]

Honestly, StatQuest has a much better way of explaining this. First he explains the logic by means of an example and then he explains the algebra afterwards. I'd recommend his videos on gradient boosting for anyone who didn't understand this. Without having seen his videos on it I would have been unable to understand the algebra.

[@BettyBarry-u2m]

Martinez Barbara Moore Edward Thompson Maria

[@SimplyAndy]

Ripped...

[@sharmakartikeya]

Hello Ritvik, are you on LinkedIn? Would love to connect with you!

[@NedaJalali-tz7vw]

That was amazing. Thanks a lot.