Regression Trees, Clearly Explained!!!

[@statquest]

Support StatQuest by buying my book The StatQuest Illustrated Guide to Machine Learning or a Study Guide or Merch!!! statquest.org/statquest-store/ NOTE: A lot of people ask why, at 20:37, when we show the full tree that has Age > 50 as the first split in the tree, why the next split is Dosage >= 29 instead of Dosage >= 14.5. The reason it is 29 is that 29 is the best threshold after first splitting people on Age > 50. 14.5, the original threshold, was only shown to be optimal on the full dataset, prior to splitting the people into small subsets.

[@pralhadkulkarni7520]

Who came here after paying for ML courses on Udemy???? This explanation is far far better than those paid courses.

[@statquest]

Thank you! :)

[@Apurvsankhyadhar]

Me lol. That tutorial instructor is a real jackass

[@claudiusandika5366]

shhyitt you got me bro lololol.. since i can't just move on on some technical aspect without clear understanding

[@as4end]

true story here

[@sumanthreddy8829]

Absolutely u r correct

[@altus3278]

Screw Udemy, this guy explains better than my Machine Learning professor. You are the Bob Ross of statistics.

[@statquest]

BAM! :)

[@Kaelovision]

whos is Rob Boss, the painter?

[@user-sb5rj6mi4y]

Couldn't agree more, Love you Josh

[@MarkLambertz]

That’s the most beautiful I have read today.

[@rdebnath]

This comment should be taken very seriously! Please don't spend money on Udemy - they sell crap! I am a victim of Udemy myself. Josh rocks!

[@LMessii10]

Added more value than a fricking Harvard or Standford course in less than 15 minutes. Great job, I am forever greatful Josh !

[@statquest]

Thanks!

[@carlossouza5151]

Dude, you are a gifted teacher... well done, keep it up!

[@statquest]

Thank you! :)

[@dvirginz4001]

You are just something else, I just can't believe how every time I return here, things that I used for years become suddenly clear.

[@statquest]

Thank you very much. :)

[@BrunoGarofalo-s3c]

John, I just bought your book. Not because I need it, but because you deserve it. God bless you, you are godsent. you explain ML 10 times better than my professor

[@statquest]

Wow, thank you!

[@aggelosdidachos3073]

Honestly, after every video I watch, I feel like I want to express gratitude. Clearly, you know how to explain clearly.

[@statquest]

Wow, thank you!

[@dtn6000]

A picture (or video) is worth a thousand words. After scratching my head from looking at written formulas of how regression trees are created, this instantly cleared things up. Thank you!

[@statquest]

Hooray! :)

[@jcatlantis]

This is the best channel ever! I am a postdoc enjoying every single video ;)

[@statquest]

Hooray! Thank you very much. :)

[@sandeepbhatti3124]

Same here!

[@siddharth2438]

I have completed the whole series on Trees till XGBoost! These are real treasure in teaching ML and trust me I have read a lot of books, ESL, Gilbert Strang, Larry Wasserman to name a few. I truly appreciate what you are doing and I will join your patreon!

[@statquest]

Thank you very much!!!! I really appreciate your support and encouragement.

[@kobeyang8828]

Are there any books recommended for an ML beginner? Thank you!

[@breopardo6691]

In Josh we trust! What an awesome video Josh, you make ML understanding a pleasure...you are a gifted person and I am so happy you actually share.

[@statquest]

Thank you very much! :)

[@tanuj05]

This has got to be one of the most entertaining educational videos ever made! You're just fabulous!

[@statquest]

Thank you very much! :)

[@asdkazmi]

OMG, I don't have words to appreciate this lecture. This is an impressive lecture I found for the Decision Trees algorithm. Thank you dear for your effort. I'm pretty sure you would come to need a lot of work to prepare for this lecture.

[@statquest]

Thanks!

[@jamesang7861]

The search ends here. THere is no need to watch multiple videos to understand regression trees. this is the perfect video. Thank you JOsh!

[@statquest]

Thank you very much! :)

[@innocentlord7985]

Josh, you are a blessing. I am filling all my gaps that my uni education thus far failed to do so and in that regard thank you for filling it in with something concrete that hopefully will stand for long and might grow strong by time. Stay happy man and the songs they kinda grew upon you, they are catchy.

[@statquest]

Thank you very so much! :)

[@RS-fe1hk]

The best video ever i have seen.. Trust me I was searching for random forest as regression concept all over internet and couldn't find as best as this one.... ❤️❤️

[@statquest]

Thank you!

[@jjlian1670]

Oh My God, Josh! Your channel is pure gold. I can not express how I like ur channel about all the explanations on complex ML concepts!

[@statquest]

Thank you very much! :)

[@TheAmeer3881]

Yes same n I'm noob lol

[@rohitnath5545]

man i know that decision trees are easiest machine learning concepts but you made them way easier than what it actually it is. Hats off

[@statquest]

Thanks!

[@jeternity1656]

This was a better explanation by like 100 folds compared to explanation in my data science course for which I paid money.

[@statquest]

I'm glad you like the video! :)

[@joejekpenyong]

name your course please.

[@siddharthmodi5908]

God level of explaination. This guy is doing marvolous job. You are a treasure for us, your channel is a one stop shop for us. Hats off for your efforts.

[@statquest]

Wow, thank you!

[@thehoangnguyen9985]

Just found this channel recently, your explanation is better than any videos on youtube, it helps me a lot on my Data Science journey. Keep it up bro!

[@statquest]

Thanks! :)

[@VishalVerma-gc7pr]

I have almost never commented or liked any videos on youtube but you are the one who made me proud to like your videos. you have beaten up all those paid and much-marketed course on machine learning and statistics A very thank you josh Starmer and tbh those bams do stick into people's head no lie.

[@statquest]

Wow! Thank you very much! :)

[@COMREdesign]

Today only I got to know "why decision trees". Your teaching is the best. blessings!

[@statquest]

Thank you! :)

[@abhiashu1]

Omg I can't believe the teaching has been done by real human. It feels like Robot is teaching. I will recommend this channel to all my friends, Thanks you so much!!

[@statquest]

Thanks for sharing!

[@ruslanjabrayilov7363]

Immaculate teaching style. I love how you give a detailed intuition behind these otherwise complex topics!

[@statquest]

Thank you very much! :)

[@MingChen0919]

BAM!!! I am addicted to these videos! Thank you so much, sir!

[@statquest]

Bam! :)

[@Himhim455]

I love how you sound like computer and make animation sounds too :D Your explanation is so much better than almost 90% of the rest .

[@statquest]

Thank you! :)

[@upam_sarmah]

This is the best explanation of "Decision Tree regression" on youtube.

[@statquest]

Thank you very much! :)

[@6471917]

You've a talent for explaining things nice and clear. Wonderful. Thank you so very much!

[@statquest]

Thank you! :)

[@ManojKumar-qd2mx]

No one explained regression trees more clearer than him. Thank you 😊😊😊

[@statquest]

Happy to help!

[@paramjeetsingh3444]

never stop making videos and saying BAM!

[@statquest]

Thanks!

[@ragabmousa8794]

Excellent video for understanding all Regression Tree details. Did not believe it when I read "Clearly Explained", but it turned out very clear. Thank you

[@statquest]

Thank you very much! :)

[@mrunmayeejog5413]

I tried reading so many examples but your explanation is so good!! Keep teaching awesome concepts so that beginners like me can keep learning :D

[@statquest]

Glad it was helpful!

[@casualpasser-by5954]

The most clear explanation imaginable! Thank you, professor!

[@statquest]

Thank you very much! :)

[@kalebnegussie8140]

This is extremely well explained. I feel like I can explain clearly now too. Well done!!!

[@statquest]

Glad it was helpful!

[@alienmathology6251]

Treasure for anybody , interested to learn statistics and statistical learning.... thanks a lot josh the effort you put behind the lucid explanation ...

[@statquest]

Glad you enjoyed it!

[@yogeshbharadwaj6200]

Tks a lot for the SUMMARY at the end sir, very much helps to quickly connect all the details explained in overall video, especially when the concept is in-depth and results in long video. Only a person with full understanding of concept (i.e only MASTER like you) can create such a simple perfect summary. My kind request to have summary section for all your upcoming videos as well please..... Thanks in advance and Thanks for this awesome content as well.

[@statquest]

I'm glad you liked this summary!

[@taochen746]

Best channel ever for the stats and machine learning concepts!

[@statquest]

Wow, thanks! :)

[@Sripooja.Mahavadi]

Statquest! Statquest! Can you note that you are the best! I have always hated statistics But now I love it coz of your tricks standard deviation and standard error After you taught it's no brainer I know these lines are cheesy But somehow you have made life easy :)

[@statquest]

This is the best poem ever!!!!! Triple BAM!!!

[@vikranttyagiRN]

Absolutely Amazingg

[@jamesang7861]

BAM!

[@klam77]

@@statquest Hey cut back a bit guys.....I'm diabetic.

[@sandracanella5180]

I'm having an exam in less than two weeks, these videos are super helpful! I wish I found you sooner. I'm actually understanding something, I feel less hopeless now lol. A big thank you!

[@statquest]

Good luck with your exam! :)

[@samerrkhann]

I just can't believe someone can teach me ML in this greater depth for free! you really are super awesome Josh! Thank you for all the hard work you put

[@statquest]

Thank you very much!

[@amazing_human_slash_genius1492]

I usually don't comment youtube vídeos, but I gotta say: this was very helpful for my data science study. Thanks for sharing your knowledge in a way that everyone can understand. Keep the good work!

[@statquest]

Thank you very much! :)

[@shivamsehgal9120]

why is he taking 14.5 as the root node???

[@statquest]

@@shivamsehgal9120 Can you tell me what timepoint (minutes and seconds) in the video where you are getting confused?

[@FelipeSagan]

How can anybody give dislike for this series of videos? 1) Other teachers from paid courses or from another channel 2) Egocentric people- "That´s too simple, you are insulting the statistics" 3) Naturally born haters 4) The ones that accidentally press the thumbs down instead of thumbs up QUADRUPLE BAM!

[@statquest]

BAM! :)

[@daissyherrera8613]

This is the best channel for machine learning beginners. This help me so much, thank you alot! i will recommend your channel with my friends!

[@statquest]

Thank you very much! :)

[@raghavkhemka14]

BAM!! Now I know Regression Trees without having to watch any other video.

[@statquest]

Bam! :)

[@erfanmoosavi9428]

This is the best channel I've seen in youtube!!

[@statquest]

Thank you!

[@kwangnamyu1813]

Hooray! I finally understand what is trees. Thanks for the explanation.

[@statquest]

Hooray! I'm glad the videos are helpful. :)

[@cesarp1940]

Wow…This is by far the best explanation about this topic. Thanks Josh

[@statquest]

Thank you!

[@paperpaper7812]

Nice man, really nice. Unfortunately, I live in a hostile country and I could not pay for joining.

[@statquest]

Just thinking about supporting me means that you are awesome! BAM! :)

[@karthiks1157]

Honestly josh , After completing Machine learning in Coursera and Udemy , never got as much satisfaction after watching your videos , Iam redoing entire Machine learning from your videos.

[@statquest]

Wow, thanks!

[@glowish1993]

my lucky day because I was searching for regression tree and was wondering if statquest made a video on it already :)

[@statquest]

YES! I'm glad you found my latest video. Support Vector Machines is next...

[@chillpillgamer4980]

I'm the type of person who want to know true meaning behind all concept and if the statquest was not here I don't how much time would I waste to find all these. I can't thank u enough sir

[@statquest]

Hooray!

[@prashant4814]

i feel luck that i found this channel .god bless you

[@statquest]

Thank you! :)

[@Targearean]

Wonderful lecture! I liked the way you taught.

[@statquest]

Many thanks!

[@Kenny-bk5rf]

Thank you for your great explanation! I have a question: In your example of "building a regression tree with one variable" (i.e. dosage), the tree had several layers of branches split by different thresholds of dosage. Then moving on to your example of "building a regression tree with multiple variables", only one threshold of dosage was used (

[@statquest]

Regardless of how many variables we have in our data, when we try to decide how to split the data at a branch in the tree, we always check every single one, and every single relevant threshold, and select the one that results in the lowest SSR. So, at any branch in the tree we check dosage, sex and age with a bunch of different threshold and use the one that gives us the lowest SSR.

[@kofsphere]

@@statquest I think he meant "So, at any branch in the tree we check dosage, sex and age with a bunch of different threshold and use" MORE THAN ONE that gives us the lowest SSR, just like those you used in the example with single variable dosage.

[@profmo]

Best video ever. I am going to become Patreon supporter. We need people like you to continue making videos.

[@statquest]

Wow, thank you!

[@rishabhjain1418]

I feel like, why can't I cite this in my dissertation!!! Instead of citing those non-sensical papers and textbooks!!!

[@statquest]

Bam!

[@nairrahul]

Dude you made these topics bingeable! Great explainations!

[@statquest]

Thank you!

[@Ownedyou]

Using Sex to predict Drug effectiveness is missing one component: Rock and Roll! :-P

[@statquest]

It's true, Rock and Roll is very important in this situation. ;)

[@tamarapetrova8440]

Thank you so much! Very well explained! And the pace is just right, not too slow and not too fast :)

[@statquest]

Thank you! :)

[@akshaymahale6521]

Loved it ! Read several blogs, but no one can explain it like JOSH !!!

[@statquest]

BAM! :)

[@kamranabbas2438]

I am currently trying to implement some regression ml methods to the data and these videos by Statquest are so simple and at the same time so informative, that if I don’t understand something, I come to find an explanation on Statquest. Thank you very much!

[@statquest]

BAM! :)

[@SuperShogee]

Great video, love it, finally understand sum of square residuals and that it's not just a random number from a stat output. Keep up the good work!!

[@statquest]

Glad it helped!

[@prajaktai3292]

Amazing explanation Dr.Starmer, and the sounds you create while calculating values...they are indeed funny .. thanks

[@statquest]

Bam! :)

[@troy_neilson]

Some of the best descriptions online...!

[@statquest]

Thank you!

[@thankhashem]

you have saved me so much time in life, i could cry

[@statquest]

bam!

[@amitsingh-ox4uo]

Hey Josh your videos are truly amazingly couldn't wait for the video to end so I always hit the thumbs up before that.

[@statquest]

Bam!

[@DED_Search]

Great content! I am reading ESL these days. And it can get really abstract and esoteric. Your videos make it much easier for me to understand the book. Thank you so much. And I bought your study guide too.

[@statquest]

Thank you very much!! :)

[@aounhaider8335]

Please upload lectures on deep learning subjects especially computer vision. You have visualized all the concepts very effectively and deserves more than a typical university instructor.

[@statquest]

See: kzbin.info/www/bejne/eaKyl5xqZrGZetk

[@leeenkelly3569]

Thanks. Cant get better than this. Very likely that nowhere in the internet has this topic been conceptually explained so well and surprisingly in extremely simple terms. Because the other links are mostly just cryptic mathematical formulae, at best with a scratch on the underlying concepts.

[@statquest]

Glad you enjoyed it!

[@ryuzakace]

BAM! Watched first video, subscribed, watched 4 more videos that were not relevant to my current quest ;) DOUBLE BAM! I think this is going to be my second home!

[@statquest]

Hooray!!! Thank you very much :)

[@April-td2rb]

He is the greatest teacher in the world.

[@statquest]

Thank you!

[@hsl2916]

the best machine learning youtube video I have watched. Thank you statquest~

[@statquest]

Thank you! :)

[@Bennilenny]

Man, your videos are really helping me through my econometrics classes! Thanks!

[@statquest]

Awesome! :)

[@amitabhasingha2093]

Awesome explanation! Kudos!! I would repeat what others have said. You are an expert at simplifying complex concepts!!! Triple Bam!!!

[@statquest]

Wow, thanks!

[@HDelTrueno]

BAMMM!!!! from Perú, tnks a lot!! I´m a candidate of a Master degree and your videos make my day

[@statquest]

Hola Perú. I'm glad my video was helpful. Good luck with your master degree! p.s. I have always wanted to go to Perú since I was a child and am trying to learn Spanish so I can go.

[@HDelTrueno]

​@@statquest Hey, Thanks for your wish, It will be an honor to show you my country if sometimes you come; my family and I will be pleased to host you if you want. My girlfriend and I speak english, perhaps we can be helpful.

[@statquest]

@@HDelTrueno BAM! That would be awesome.

[@yuridialeyva8954]

BAAAMMMM! This is such a great video! I'm so glad I encountered Stat Quest!

[@statquest]

Glad you enjoyed it!

[@yasarmehmood4055]

Brilliant teacher. Impressed by the energy and passion

[@statquest]

Thank you! 😃

[@tymothylim6550]

Thank you very much for this video! It was fun to watch and I learnt a lot from the whole step-by-step process of building the simple regression tree :)

[@statquest]

Glad it was helpful!

[@tiago9617]

Josh Starmer, man... YOU ARE THE BEST FUCKING TEACHER ON THE PLANET! INFINITE BAM!!!!!!!!!!!!!!!!!!!

[@statquest]

:)

[@sanjayb6173]

BAMMM!!!!..This is so perfect and Precise. Thanks a lot Josh

[@statquest]

Thanks!

[@hosseinaboutalebi9998]

You are awesome man! I really like your videos and especially the way you make a complex concept very simple. The only thing I would like to see in the future is more videos on deep learning and machine learning.

[@lightspd714]

You are an awesome teacher. Really appreciate the wonderful content. Also, the BAM’s never fail to make me laugh.

[@statquest]

BAM! :)

[@aasiralikhan7205]

Simply brilliant explanation Josh! You make this so easy! TQ

[@statquest]

Thank you! :)

[@SameerParadia]

Really excellent way of explaining the complicated concepts. Keep it up the great work!!

[@statquest]

Thanks! :)

[@yuliu1739]

Thank you for making these videos! After days of struggling ... Finally I am starting to get it 😭

[@statquest]

Bam!

[@anhbui8822]

I like how you BAM your explanation, it does help me feel smarter :D

[@statquest]

bam! :)

[@sanathdas4071]

You have really relieved me. Thank you so much. God bless you.

[@statquest]

Thank you! :)

[@gracealexandragonzalez7022]

omg this is so gooood! can't believe I didn't find this earlier... thank you!!!

[@statquest]

Glad you like it!

[@dickyr4437]

Josh, great explanation! It would be nice if you give the data values also on one of the screens so those who want to try them out can do so. Thanks!

[@statquest]

Noted!

[@Thomas-wx1sh]

十分感谢，相对于书上的抽象理论 这给了我更加清晰和直观的理解。

[@statquest]

Thank you! :)

[@rex3616]

You did a really great explanation. It's an easy way to learn ML algorithms. Thx a lot man!

[@statquest]

Glad it helped!

[@bhaumikmehta7718]

Clear and effective presentation. Great job!

[@statquest]

Thank you!

[@shu5011]

Thanks for existing man, Love you and your statquest

[@statquest]

Thank you very much! :)

[@АнастасияКошелева-з2х]

God I love this channel so much, it makes complicated things which I couldn't understand during university so simple

[@statquest]

Thanks!

[@nitinkhatri9966]

Best And Simplest Explanation ever. THANKS.

[@statquest]

Hooray! Thank you! :)

[@jogeshnanda7704]

How can these 10 people dislike this video. Kind of never satisfied soul. BTW, very well explained, thank you very much. I am becoming fan of your explanation... BAMMMMMM!!!!!!!!

[@statquest]

Thank you very much!

[@tank821]

A great explanation about the regression decision tree!!

[@statquest]

Thank you! :)

[@mansoorbaig9232]

Awesome explanation Josh, you make it look so simple.

[@statquest]

Thank you very much! :)