Corrections: 3:18 I should have said the same feature (or variable) can be selected multiple times in a tree. Every time we select a subset of features to choose from, we choose from the full list of features, even if we have already used some of those features. Thus, a single feature can appear multiple times in a tree. 9:28 I say "square" when I meant to say "square root". Support StatQuest by buying my book The StatQuest Illustrated Guide to Machine Learning or a Study Guide or Merch!!! statquest.org/statquest-store/
@monishaathikesavanpremalat75874 жыл бұрын
StatQuest with Josh Starmer - Can you explain more on this? I mean how does it work when same variable is selected more than once... Let’s say for example., we have our root node as Good blood circulation - if it is true then it goes to left node and if is false it goes to right node Then let’s say our internal node on right side is chest pain and then next internal node below it is weight Then as you said we have again selected good blood circulation randomly ... how does it work because right side nodes have bad blood circulation already Selecting variables multiple times makes sense when it is continuous variable because it can used again with different threshold values but how come it works with categorical variable
@lprashanthi72984 жыл бұрын
For the same bootstrap data set we can make different trees with randomly picked variables?
@statquest4 жыл бұрын
No, you only make one tree per boostrapped dataset. What I was trying to say was that all columns/variables/features in that bootstrapped dataset are considered at each node.
@statquest4 жыл бұрын
It’s true. There’s no use in visiting a boolean variable more than once. However, as a general rule, all variables, at least in theory, can be visited more than once in a single tree. The actual implementation may optimize this by omitting boolean variables if they have already been visited.
@lprashanthi72984 жыл бұрын
@@statquest so here randomly 2 is picked at each node without taking into account gini ? Is that right
@Themojii4 жыл бұрын
Please continue what you're doing. KZbin users are blessed to have you here. Your contents are not long, right to the point, clear and your way of teaching is amazing. If there will be a heaven you will be right in the middle of it.
@statquest4 жыл бұрын
Thank you very much! :)
@2DReanimation3 жыл бұрын
Beats the Wikipedia articles on these subjects by miles! Perhaps if I was more versed in math, I could just read it like the daily newspaper, but as it is, having this clear visualization and examples is a waay superior learning method!
@lashlarue79244 жыл бұрын
This video is so well made and so well explained that I comprehend the subject matter even while sitting here drunk AF at my keyboard... *hic*
@statquest4 жыл бұрын
Dang! :)
@hichamsalimlyoussi85394 жыл бұрын
Well said ! Understanding a subject is more relying on the teacher's skills to explain clearly than to the student's efforts to trying to understand.
@My_messy_garden3 жыл бұрын
I have no background in Machine Learning and was attempting to understand random forests. Watched a bunch of videos but this was the one that actually made it clear to me. Thanks a lot!
@statquest3 жыл бұрын
Glad it was helpful!
@mayconmarcao45544 жыл бұрын
Your "BAM!!" always bring me back to the reality when, eventually, my brain takes a nap during the class haha. It makes me go back and rewatch the issue. I really appreciate your art, sir.
@statquest4 жыл бұрын
Awesome! :)
@DEEPAKSV992 жыл бұрын
Very true. He is so good at teaching!
@acdundore Жыл бұрын
Your videos are unbelievably simple to follow and intuitive. You know that someone is a master of their craft when they can explain it to someone else in a concise and easy-to-understand way. Well done, and thank you for all of your videos!
@statquest Жыл бұрын
Wow, thank you!
@mosama222 жыл бұрын
I'm studying Data Science at MIT, you really can't imagine Josh how much StatQuest is helping me, and a couple more channels, before I start any topic I like to tackle it first or just take a general idea, and you can't imagine how much your videos helped! Short, concise, and to the point! I even started to like mice man for god sack! Thank you Josh 🙂
@statquest2 жыл бұрын
Thank you! I'm glad my videos are helpful.
@jarosawszyc82872 жыл бұрын
Hello, can you share what other channels you watch? I'm a student too, and I wish to gain as much knowledge before looking for a job. Have a wonderful day!
@mosama222 жыл бұрын
@@jarosawszyc8287 No one is perfect in everything! Look up by the topic, not by the channel, you'll ALWAYS find someone who explains what you looking for in a very simple and very straight forward way.
@mosama22 Жыл бұрын
@@atharvambokar573 Massachusetts Institute of Technology 🙂
@mosama22 Жыл бұрын
@@atharvambokar573 I wanted to change my career to a Data Analyst, and got accepted for post graduate at MIT. I literally started from scratch. Plus what is wrong in creditting people for their efforts.
@vishalmandhani95712 жыл бұрын
Your service to the data science community is very very much valuable...!!! Your videos on basics leaves a long lasting memory..!! Thank you..!!
@statquest2 жыл бұрын
Thank you!
@utkarshkumar165 жыл бұрын
I was required to give a ppt on random forest in my class and after going with such a lucid video I am a felling great. Thanks STATSQUEST
@statquest5 жыл бұрын
Hooray! :)
@knowledgeexchange4284 жыл бұрын
dont forget the BAAMMM!!!
@sadhana26192 жыл бұрын
I found this on top of the list while searching and now I don't need any other video to understand it. Thanks
@statquest2 жыл бұрын
Glad it helped!
@kkomment21525 жыл бұрын
"Sir, after your examination we found that you've got heart disease. BAAM"
@phan99955 жыл бұрын
"All 100 trees of the random forest predicted that you have a heart disease. HOORAY! "
@ГадирАхмедов-ъ2г8 ай бұрын
It is actually "BAAM?" :D
@jayeshparmar26034 ай бұрын
@@phan9995Double baam!!
@atakanekiz4 жыл бұрын
Your videos deserve a million kudos. They should be a legit applied statistics class for biologists like myself. Please continue your amazing work! I invite everybody to support Josh with as little as $1 a month.
@statquest4 жыл бұрын
Thank you very much for supporting StatQuest! It means a lot to me.
@mariebonduelle47165 ай бұрын
OMG you saved my day ! I am currently preparing a phd exam, and I was lost about random forest, now I can easily breath thanks to your amazing video ! Thanks a lot
@statquest5 ай бұрын
Good luck!
@martinotanasini37164 жыл бұрын
Heavily relying on these videos to understand the techniques relevant for my Master Thesis in experimental particle physics. Thank you so much, you are the best!
@statquest4 жыл бұрын
Thank you! I'm glad the videos are helpful. :)
@KamiK4ze2 жыл бұрын
I'm also using this for my Master Thesis :D
@jjj408_2 жыл бұрын
Words cannot express how much I love StatQuest!!!!!! Thanks Josh for the amazing videos! I'm definitely gonna recommend StatQuest to my classmates!
@statquest2 жыл бұрын
Thank you very much! :)
@sasss70604 жыл бұрын
i searched for so many tutorials but no one explained it like you. Thank you!!
@statquest4 жыл бұрын
Thanks! :)
@heart328mind4 жыл бұрын
easily the best channel for data science/machine learning. respect
@statquest4 жыл бұрын
Thank you very much! :)
@simonweppe7131 Жыл бұрын
@@statquest agreed 100%
@sfundoy5dube592 жыл бұрын
You're so cool Josh, by only first listening to your song, I knew you'd nail this topic just as usual. You're much appreciated Sir Starmer
@statquest2 жыл бұрын
Thanks!
@emmagarland4 жыл бұрын
I really like the pace of these. It helps me get around the terms and have chance for my brain to keep up
@statquest4 жыл бұрын
Awesome! :)
@aristide_F7 ай бұрын
Thank you so much Statquest. in my "quest" to build random forest from scratch in C++, I found this resources soooo usefull. Including the video on the decision tree classifier
@statquest7 ай бұрын
Glad I could help!
@robertdiniro88815 жыл бұрын
This is absolutely awesome and so clearly explained. I wish all textbooks were like this. Keep it up !!
@2DReanimation3 жыл бұрын
Indeed! Wikipedia is usually a way to get the information more simply than textbooks, but they bombard you with math formulae right from the beginning on these subjects! ^^ So this is so much more intuitive!
@a7med7x79 ай бұрын
I'll keep saying stat-quest is the best stat tutorials channel ever
@statquest9 ай бұрын
bam!
@yodhakei6 жыл бұрын
Isn't it 'square root' of the number of variables at the end, instead of 'square'?
@statquest6 жыл бұрын
You are correct. I make a slight mistake.
@AshisMohanty875 жыл бұрын
Absolutely, thats what I was breaking my head to understand and thankfully got it clarified from this comment !!!
@rajeshs28404 жыл бұрын
Yes You are absolutely Correct..
@ugomuohtochukwu11054 жыл бұрын
I was just about to write up this query. Absolutely correct
@MikhailGavryuchkov4 жыл бұрын
@@statquest I am pretty sure StatQuest will be canonized as a "Video Bible of Machine Learning" some time soon. Sooooo, any slight mistake will have a probability (or likelihood?) of huge changes in the course of humankind history. :))
@MontahaAlriQa5 жыл бұрын
Your channel has saved my research career
@statquest5 жыл бұрын
Hooray! :)
@shreshthasarkar9915 жыл бұрын
One of the best tutorial channels. Keep up the good work and helping us all who are in need.
@statquest5 жыл бұрын
Thank you so much!!! :)
@vidyasurbhi82742 жыл бұрын
You are the cutest stat teacher i have came across in my life . Lots of LOVE and Respect.
@statquest2 жыл бұрын
Wow, thank you!
@high_fly_bird3 жыл бұрын
the presentation is so simple and adorable, and what's more the topic is truly clearly explained! Thanks!! I love this animation and color choice
@statquest3 жыл бұрын
Thank you very much! :)
@karenpedraza99992 жыл бұрын
thank you very much for this well-crafted and excelllent video!! finally understand bagging
@statquest2 жыл бұрын
bam!
@shwethavasudevan17885 жыл бұрын
I've seen multiple videos and articles explaining Random Forests and I must say this is the best so far. Awesome work!
@statquest5 жыл бұрын
Thank you very much!!! :)
@alisavictory29693 ай бұрын
Thank you so much for a very easy-and-nice-to-walk-through video! I really enjoyed the explanations and well-prepared slides! Also you made it very nicely paced. Thank you :))
@statquest3 ай бұрын
Thank you!
@azizlarabi19415 жыл бұрын
Can I say BAAM in an interview after explaining what is Random Forests?
@imrankhanissm4 жыл бұрын
Yes but then interviewer will also say DOUBLE BAAM after kicking you out
@prat-man4 жыл бұрын
@@imrankhanissm XD
@shihyusung4 жыл бұрын
@@imrankhanissm lmao
@roh_954 жыл бұрын
@@imrankhanissm 😂🤣😁
@leetbytes4 жыл бұрын
haha lol
@frederiktolberg80022 жыл бұрын
It just hit me that its called random forest because its a forest of random trees. This channel is pure gold for bioinformatics students
@statquest2 жыл бұрын
Thanks!
@neelamj85346 жыл бұрын
I must say,this is the best video! You made it so easy to understand. And the way you explain it is perfect!
@statquest6 жыл бұрын
Thank you!!! :)
@mgo19932 жыл бұрын
I enjoy the tutorial and your album a lot. Math + music, what a combination. thanks for the content this helps me more than my couple hundred dollar textbooks.
@statquest2 жыл бұрын
Thank you very much!!!! :)
@saifhakeam85993 жыл бұрын
Man you're a legend. LOVE Your content especially the music.
@statquest3 жыл бұрын
Glad you enjoy it!
@feedtowin13092 жыл бұрын
I love your opening song, it makes the content less stressful!
@statquest2 жыл бұрын
bam!
@mehdiaiyad78403 жыл бұрын
The "Oh no! Terminology/Jargon alert !" always gets me
@statquest3 жыл бұрын
:)
@mohammadaljumaa5427 Жыл бұрын
I just love your videos. Im attending a bootcamp about Datasceince and all the concepts that the instructor is not explaining as i would understand them, i come to your channel to learn them better. Thanks man ❤❤
@statquest Жыл бұрын
Glad to help!
@LilyMyLolita6 жыл бұрын
You are the only one who clearly explains how the *size of bootstrap* can be the same as the *size of the original train data* . Thanks!
@statquest6 жыл бұрын
You're welcome!!! Hooray! I'm glad it was clearly explained. :)
@adosub5 жыл бұрын
very good approach, genious simplicity and to the point, helps anyone learn(even me). I even stopped skipping the "music" to pay my respects to you Josh!
@statquest5 жыл бұрын
Thanks so much! I love that you put "music" in quotes. That cracked me up. As long as I get to have my fun, I'm happy to make these videos. ;)
@melakuhailelikka4 жыл бұрын
Thank you, Josh, for making things much easier. This 10 minutes tutorial is almost tantamount to reading one whole book about random forest decision tree. I heard the piece at 9:39 as '.... square root of the number of variables...."
@statquest4 жыл бұрын
Thanks! Yes, I made a typo at the end of the video and it is mentioned in a pinned comment.
@big_snake4317 ай бұрын
my project is about using random forests on accelerometer data from goats, but Josh is the real goat
@statquest7 ай бұрын
bam! That sounds like a pretty cool project!
@aristide_F7 ай бұрын
Oh Really, This is somewhat what i am working on. I am studying different speedup processes and strategies and I am specifically working on stroke prediction..
@big_snake4317 ай бұрын
nice. I am working on an activity tag to classify behavior automatically without observing the animal directly@@aristide_F
@pratyushsharma66554 жыл бұрын
Your channel is like a course in ML and Stats but better than most !!!
@statquest4 жыл бұрын
Thank you! :)
@guillaumegiroux94254 жыл бұрын
I'm in grad school and I'm supposed to "quote" litterature, yet I just watch StatQuest's videos because they are easy and fast.
@statquest4 жыл бұрын
BAM!
@rickb_NYC3 жыл бұрын
This makes it so easy. I understand it well enough to explain it to others. Thanks.
@statquest3 жыл бұрын
Thank you!
@rickandelon93744 жыл бұрын
After learning so much from your videos and then listening to your beautiful sentimental songs makes me cry! ;)
@statquest4 жыл бұрын
Thank you very much!!!! :)
@tymothylim65503 жыл бұрын
Thank you very much for this video! It was a great use of visuals to explain the progression of various aspects of this topic (e.g. eventually using the out-of-bag samples to calculate accuracy)!
@statquest3 жыл бұрын
Glad you enjoyed it!
@jonathancomputer6 жыл бұрын
Great video. Very simple and easy to understand. Nice job!
@statquest6 жыл бұрын
Thank you! I'm glad to hear you like the video. :)
@bibhunanda4805 жыл бұрын
Respect ,The way you have present Random forest
@statquest5 жыл бұрын
Thank you! :)
@praveerparmar81573 жыл бұрын
This video is totally "Out-of-Boot" among all other Random Forest videos on KZbin 😀
@statquest3 жыл бұрын
BAM! :)
@NguyenTran-eq2wg2 жыл бұрын
I am saved. This is what my professor struggles to explain for more than an hour. It is so simple.
@statquest2 жыл бұрын
bam!
@seanhickey414 жыл бұрын
In grad school and am planning on applying the RF method to my air quality data. Your videos have been a life-saver!
@statquest4 жыл бұрын
Awesome and good luck! :)
@MrSpiritmonger4 жыл бұрын
@@statquest Hi, I am doing my PhD, I am inspired to do a project just because I learned so much from your video. I learn more from one single video than an entire year of my coursework.
@myaimine39213 жыл бұрын
Oh my god you made it easy to understand. Please keep this process.
@statquest3 жыл бұрын
Thanks!
@daddychill69252 жыл бұрын
This guy is a living legend, giving us quality content for free
@statquest2 жыл бұрын
Thank you!
@anurajjaiswal46094 жыл бұрын
You are a boon to humanity...Hope you make a lot of money:)
@statquest4 жыл бұрын
That would be awesome! Maybe one day that will happen. :)
@L.-..4 жыл бұрын
I love StatQuest. You really make statistics enjoyable. BAM!!!!!!!! Thank you for your time and effort in making these videos. You have helped out a lot of students. Please keep up the good work. Keep them coming.
@statquest4 жыл бұрын
Thank you very much! :)
@L.-..4 жыл бұрын
@@statquest hello there.. could you please clarify the doubt that was asked in your pinned comment.. about choosing the same features again at different level in the decision tree..
@nevermindshort35 жыл бұрын
Everytime he starts "Bo pi do pi do pi doo" i inadvertently start laughing
@MohammedBakheet4 жыл бұрын
I trust the information you provide so much, to an extent that I press the like button even before I watch the video
@statquest4 жыл бұрын
Awesome!!!
@urjaswitayadav31886 жыл бұрын
Great tutorial, as always!
@hoaile22893 жыл бұрын
great video, great voice, easy to listen, it's helpful for people who are not native English speakers like me.
@statquest3 жыл бұрын
Wow, thank you!
@Charles-rn3ke6 жыл бұрын
Finally found an ML tutorial without accent.
@digit4326 жыл бұрын
He has an American accent
@fiddinyusfida53565 жыл бұрын
@@digit432 lol
@Pongant3 жыл бұрын
For everything, there's a statquest episode.
@statquest3 жыл бұрын
bam!
@khanhtruong32545 жыл бұрын
In evaluating the random forest, you mention: use trees to classify samples that are not used to build the trees. As a result, the number of trees to test an out-of-bag sample is different from one sample to another, aren't? E.g. a sample can be tested by 4 trees (there are 4 trees that do not use the sample to build), while another sample can be tested by 10 trees.
@oluseyiakinboade1673 Жыл бұрын
Just this video was enough for me to subscribe, Thank you Josh!!!
@statquest Жыл бұрын
Awesome! Thank you!
@flikkie724 жыл бұрын
9:36 Typically we start by using the square [root?]
@nataliag50453 жыл бұрын
Was wondering the same thing. If we have 5 features we can't bootstrap with 25. It makes more sense if we have 25 variables, to start with 5 for bootstrapping.
@bakulpatil84784 жыл бұрын
This is the best video that very well explains random forests.Very Helpful!
@statquest4 жыл бұрын
Thank you! :)
@danielm7935 жыл бұрын
3:37 looks like a warning on a cigarette pack
@chaimaa86423 жыл бұрын
the way statquest Channel makes learning Maching Learning easy is just B.A.M
@statquest3 жыл бұрын
Bam! :)
@myceliumbrick14095 ай бұрын
double bam!!
@statquest5 ай бұрын
Thanks!
@roshanipatel13076 жыл бұрын
You're the best! Out of many tutorials on Internet...this best explains Random forest and its working! Thank you so much :)
@CarlosEduardo-je7ns6 жыл бұрын
Double out-of-bam
@statquest6 жыл бұрын
I like it! :)
@ezfinvest27176 ай бұрын
I like it, it's clearly easy to understand. Thank you so much
@statquest6 ай бұрын
bam! :)
@scorpion74346 жыл бұрын
There are 7 idiot heaters who down-voted this amazing video... They probably live in pain!!
@statquest6 жыл бұрын
:)
@hlpan33016 жыл бұрын
Wow! Thank you Josh, only after watching your videos about decision tree and random forest, I really get the concepts of them!
@statquest6 жыл бұрын
Hooray!!! I glad you like the videos and that they were helpful! :)
@KingArthurxD4 жыл бұрын
This patient has heart disease. BAM!! Congrats
@statquest4 жыл бұрын
:)
@noamills1130 Жыл бұрын
I love your content! It's super helpful to have all the information presented verbally and written at the same time. I usually use captions, but those often cover up the content which is annoying and the way you do it is so much better. Plus your intros make me giggle. Thank you so much!
@statquest Жыл бұрын
Hooray! I'm glad you like my style! :)
@ariani866 жыл бұрын
This is the best video I've ever seen to explain Random Forrest! Thanks so much for making this!!Please keep making videos! Love the humor also :)
@statquest6 жыл бұрын
You're welcome!!! I'm glad you like the video (and my silly jokes)! :)
@saiyesaswymylavarapu61706 жыл бұрын
Excellent tutorial! His tutorials are underrated.
@statquest6 жыл бұрын
Thank you!! I'm glad you like this one! :)
@xiaohanwu74642 жыл бұрын
My second time commenting on your musics, they are also the best part of the video, watching a study video and a comedy at the same time, I'm so motivated everytime watching your videos very much cuz of the musics lol. You should consider a music PHD as well :)
@statquest2 жыл бұрын
BAM! :)
@lingyahu46452 жыл бұрын
You guys are amazing!!!! So clear and easy to understand especially for me who hate math!!! Thank u!!!
@statquest2 жыл бұрын
Thanks!
@peiwang32235 жыл бұрын
sir, you are always so helpful, when I have problems, the first thing came to my mind is to search the relative topic in your videos, looking forward more videos from you, thank you very much!
@MrPilz282 жыл бұрын
Just discovered your channel. I really like your work. Love the funny moments you add in it. Thank you for clarifying those concepts!
@statquest2 жыл бұрын
Awesome, thank you!
@baselkhateeb4 жыл бұрын
Wow man,, best explanation on earth,, we love you,, I watched and read alooooot about it but was ending up more confused,,, I wish your way of explanation becomes the standard
@statquest4 жыл бұрын
Thank you very much! :)
@matrix47764 жыл бұрын
I read lots of blog on Medium app..none of them clarify its so well the you do Mr. stramer. Thanks for your effort to make is so easy
@statquest4 жыл бұрын
Glad it was helpful!
@nmana97594 жыл бұрын
I wish more medium writers explain more in detail just like statquest's videos
@gurjanl87096 жыл бұрын
probably these best video fora beginner on the internet. Thanks!
@joeyzalman82543 жыл бұрын
Thank you for another great video, i love how you are to the point and explain everything in such an easy way
@statquest3 жыл бұрын
Glad you like them!
@hmna_bujs_bhjl3 жыл бұрын
Thank you Josh, have a good day
@statquest3 жыл бұрын
You too!
@abdullahak22044 жыл бұрын
This is explained brilliantly it's so simple and makes the concept clear
@statquest4 жыл бұрын
Thank you very much! :)
@abdullahak22044 жыл бұрын
@@statquest it is helping me a lot Need to make a tutorial on random forest and need to make a presentation so I am using your video as a guideline and explaining it in my own words 😊
@statquest4 жыл бұрын
@@abdullahak2204 Explaining it in your own words is the best way to learn. I hope the presentation goes well. :)
@abdullahak22044 жыл бұрын
@@statquest thank you ! I'll let u know how it goes !!!
@Why_I_am_a_theist10 ай бұрын
If I ever do some teaching , you will be my inspiration
@statquest10 ай бұрын
Thanks!
@michelef4062 жыл бұрын
This is incredibly useful and, yet, hilarious.
@statquest2 жыл бұрын
bam!
@mafiamustafa5 жыл бұрын
I must say I went through a few mathematical books in order to understand it, but this explanation is just BAMMMM!! :)
@statquest5 жыл бұрын
Hooray! :)
@bishwasapkota96216 жыл бұрын
Really good tutorial. It's always the best to explain using real examples. Good job!!!
@ireneylhsiao4 жыл бұрын
I literally didn't understand what the professor was saying in the class, but after watching this video......BAM!!!
@statquest4 жыл бұрын
Hooray! :)
@nematgholinejad36685 жыл бұрын
Oh good..! I understood random forest concept after watching this video. Thanks so much
@statquest5 жыл бұрын
Hooray!! I'm glad the video was helpful. :)
@AradAshrafi3 жыл бұрын
Your songs are also amazing. I loved the last album you shared on Bandcamp. It motivates me to continue my passion for music as well as my studies in Computer Science.
@statquest3 жыл бұрын
Happy to hear that!
@Govindyatnalkar4 жыл бұрын
The best explanation for Random forests!
@statquest4 жыл бұрын
Thank you! :)
@srinivasvalmeti1505 Жыл бұрын
I am loving all these videos. The clarity and simplicity in explaining the concepts. Just want to highlight a small error. I guess it is the square root of number of variables (and not the square) that are typically started with.
@statquest Жыл бұрын
Thanks! That error is mentioned in a pinned comment.