ROC and AUC, Clearly Explained!

[@statquest]

Correction: 12:00 The confusion matrix should be TP = 3, FP = 2, FN = 1, TN = 2. The displayed matrix should be for the next point. Support StatQuest by buying my books The StatQuest Illustrated Guide to Machine Learning, The StatQuest Illustrated Guide to Neural Networks and AI, or a Study Guide or Merch!!! statquest.org/statquest-store/

[@GauravSharma-ui4yd]

Professor please make videos on Gaussian mixture models, quantum Gaussian mixture models and deep learning related models like cnn, rnn, lstm etc.

[@Music_Engineering]

@@GauravSharma-ui4yd I would very much like that too! Your videos have really helped me in my machine learning and stat courses! Thank you :)

[@sebastianwiesendahl5348]

Josh, you are a life safer! I can't express how much I appreciate your content and overall approach.

[@maheshjungkshettry6266]

Lolol😭😍😭😭😭😁

[@beastfromeast-w2d]

replace ebola with corona

[@Skandar0007]

There’s a special place in heaven for those who make complicated things seem easy. Thanks for the explanation

[@statquest]

Thank you so much! :)

[@shilpishankermishra]

@@statquest You are simply awesome!

[@statquest]

@@shilpishankermishra Thanks! :)

[@adolfocorrea3569]

Awsome squared

[@ramkotha7982]

@skandar This is the best response so far! Triple BAM!!!

[@albertyao6181]

I am a data scientist and I have never really understood ROC/AUC curve fully before, but this video is so well that I immediately get it. Thank you OG!!!!

[@statquest]

BAM! :)

[@rajshah7734]

Hey Albert, do you professionally work as a Data Scientist??

[@albertyao6181]

@@rajshah7734 yes

[@azilazil3017]

@@albertyao6181 hi,

[@deepakmehta1813]

I am binge-watching statquest. Josh Starmer has lifted the bar of teaching too high. He is singing, he is playing guitar, and explaining technical concepts in a way that anyone can understand. What a unique combination!!!

[@statquest]

Thank you very much! And thank you for your support!

[@xinzhou3744]

The funny "BAM" points exactly match the moments I feel something learned. Thanks for the great visualization!

[@statquest]

Awesome!!! :)

[@samarthsoni4267]

Now I finally know what to think whenever he says "BAM" XD

[@lowerbound4803]

​@@samarthsoni4267 It's kind of like catch phrases of kid shows. I love it.

[@franciscochacon1194]

double bam!!!!!!!!!

[@SundayMarkets]

bro you just did what my lecturer couldnt do the entire semester, in 15 minutes. props.

[@statquest]

Thanks! :)

[@sajalagrawal1430]

May be he could not understand well

[@op711]

So your professor was teaching ROC for the entire semester

[@Loachie90]

@@op711 yeah “bro”

[@engineering_data]

@@op711 lol ;)

[@andrewdurand8756]

This guy is no joke the best at taking concepts and making them easy to understand. Props to you and thank you for doing what you do!

[@statquest]

Thank you very much! :)

[@multiversityx]

This man deserves a nobel prize

[@statquest]

Thanks!

[@Proffagelle]

If I ever pass my PhD comprehensive exam, it will be because God guided me to find your videos :D Thank you man!

[@statquest]

I hope it goes well! Let me know! :)

[@Alikiller5]

Lolol same here! I have my exam on Wednesday!

[@emmakefford8327]

I cried about this for hours and watched this video and understood everything. You are amazing

[@statquest]

Thank you!

[@stephendeferrari4563]

Studying ML and classification right now and this helped connect so many dots in a way that was easy and repeatable! Thank you so much for the time you take to make these videos.

[@statquest]

Thank you very much! :)

[@colca8900]

This is a random comment from Japan. Thank you for your amazing contents !! Studying data science is super hard for me even in mother language,Japanese. But your contents are awesome. Your are a lifesaver for data-science-leaners all around the world!

[@statquest]

Hooray! Thank you very much! :)

[@NikolazRoa15]

Hey Josh, I'm learning Data Science in a Bootcamp and it's a headache. But every time they send me to your channel, I know I'm gonna understand. I really appreciate your labor and the high quality of your content. Keep it up!

[@statquest]

Thank you and good luck with your bootcamp!

[@AnuragBhattacharjee07061]

I have never felt so lucky to find a KZbin channel before. Double BAM!

[@statquest]

Hooray! :)

[@douglasespindola5185]

13:48 "BAM?" I laughed a lot! 😂😂😂 You're one of the best teachers on YT, Josh! Thanks a lot!

[@statquest]

Thank you!

[@anishd7187]

Million BAM's , I can't thank you enough for being the teacher I never had!!!

[@statquest]

Thanks!

[@dino0930750]

I’m a guy from ROC (Taiwan) watching this ROC tutorial and understanding ROC. Thank you!

[@statquest]

Rock on!

[@maruthiprasad8184]

With this video my search for ROC-AUC stopped. Thanks a lot for awesome explantion

[@statquest]

BAM! :)

[@AndreaAKAPB]

If there is someone with the gift of teaching, it's you! Kudos!

[@statquest]

Thank you!

[@RaynerGS]

Content = ok; Presentation = ok; Explanation = ok; Pronunciation = of => Perfect Video! Again, Salute from Brazil!

[@statquest]

Thanks!

[@saragiordano8853]

The world needs people like you! I love your extremely simple and clear explanations, style and of course your voice

[@statquest]

Thank you! 😃

[@annoyinger2001]

I think this is the first time I trully understand the ROC and AUC. Really, thanks!

[@statquest]

Hooray!!!

[@pivand]

Man your channel is a hidden gem. Thank you for the time and effort you put into statquests!

[@statquest]

Thank you!

[@chrissanchez1891]

I've never understood the ROC and AUC curves until now...BAM!!! I was so impressed that I just joined the StatQuest membership, thanks Josh Starmer!

[@statquest]

BAM! Thank you very much for your support!!! :)

[@minhazu2850]

Spent an hour trying to understand ROC and AUC using other online resources, glad that i finally found this tutorial! You are the best, thanks so much

[@statquest]

Thanks!

[@wopmf4345FxFDxdGaa20]

Thank you! It is incredible how well you are able to explain complicate concepts so simply. This is by far one of the best channels in youtube.

[@statquest]

Wow, thanks!

[@vithaln7646]

every time i watch his videos i felt very relaxed and feel like there is something heavenly , divine in the world

[@statquest]

:)

[@bigpoppy]

You are the lecturer no one has but everyone needs.

[@statquest]

:)

[@khurdulaharshavardhan2112]

I was drinking my morning coffee, took a sip and this is the first video of yours that I just clicked on, and that intro! bruv! took me back to days in undergrad struggling. Legit spew coffee on myself. Such a well explained video. My respects.

[@statquest]

That's awesome! BAM! :)

[@medicinalvl-up862]

dude you ROC!!

[@statquest]

I love it! :)

[@sheafsmash142]

Best comment

[@ug1880]

😂

[@Phantom_Blox]

Double Bam!

[@BigAsciiHappyStar]

@@Phantom_Blox Dude you rock! Ay, you see what I did there? 😆

[@ulyanaisaeva7303]

My God! If this is not THE BEST video about ML algorithms, then I don’t know which is! Thank you so much! Maximum share among classmates! Hope you dude always be happy!

[@statquest]

Thank you for sharing! :)

[@ahmeddebit2394]

Great Josh, I really like the step-by-step explanation of so called "complicated" things

[@statquest]

Thank you very much! :)

[@acidic_ph]

I've read so many Medium articles about ROC and AUC, but none describe it as good as your video!

[@statquest]

Thanks!

[@dario27]

Some teachers make simple things complicated... you, however, make complicated things seem simple. Thanks so much!

[@statquest]

Thank you! :)

[@arpitarora293]

Coming back to these after all these years and im still in awe, you're a legend dude !!

[@statquest]

Thank you!

[@amitkehri]

My mind says ..."TRIPLE BAMMMMM !!!" and "HURRAAYY" after grasping this complicated concept. You are a GEM Josh. Thanks for explaining it so slow and so perfectly like water going inside my throat.

[@statquest]

Thank you so much!!!! I'm glad the video was helpful. :)

[@miriamross4622]

This absolutely saved me as I finished a final project! Thank you so much for making these clear & helpful videos

[@statquest]

Hooray and congratulations on finishing your final project!! BAM! :)

[@mohitshrivastava4967]

I wouldn't be able to express how easy it was to understand through the explanation. I wish I could like the same video 1 million times.

[@statquest]

Thank you very much. :)

[@randomforest3007]

That's blowing my mind!!! I'm 31 years old and I finally get it!!! Many thanks to author!!!

[@statquest]

Thank you!!! :)

[@1985flight]

I am so happy that this best video got 801k likes, whenever I need to review the content, this one float up to the top as always.

[@statquest]

Thank you!

[@1985flight]

@@statquest YW

[@Raven-bi3xn]

7:05 "a confusingly large number of confusion matrices." Classic! :)

[@statquest]

Thanks! :)

[@pradyutshukla7852]

I clicked on this video as it appeared on my feed thinking it was an old one (also, I needed to revise my ROC concepts). Little did I know that it was uploaded literally minutes ago. *When youtube recommendation engines read your mind, TRIPPLE BAAMMM*

[@statquest]

That's totally awesome! :)

[@abodegods5522]

And after this video I got all the answers after wandering one resource to another. Thanks a lot for such amazing videos...🙏

[@statquest]

Thanks!

[@stanleydukor]

I have had a very unclear understanding of this for about 3 years now. This video just solved my problem in approx. 15 mins. Great job! Thanks a lot for this!

[@statquest]

Thank you!

[@saurabhchdry3825]

dude, you keep things so intuitive, you have a gift, please keep teaching us

[@statquest]

Thanks, will do!

[@FamFitFun]

you are simply out of the universe , thanks for making my and other learner life easy.

[@statquest]

Thanks! :)

[@hddlheme]

OMG, I was trying so hard to understand this and finally I found this. U totally ROC!!!!

[@statquest]

Awesome! Thank you! :)

[@jessicasoares9613]

I love this channel! It is fun and make dense subject way easier. Thank you for sharing high quality material with us!

[@statquest]

Thank you very much! :)

[@aishah8398]

Josh, you have taken teaching to the next level. Keep explaining and simplifying the complications., it is really really very helpful. Thank you for your contribution in spreading the useful knowledge.

[@statquest]

Thank you! :)

[@aishah8398]

@@statquest I always found "confusion matrix" very confusing.... but you solved the confusion 🙂

[@statquest]

@@aishah8398 BAM!

[@GreenEyesVids]

The goat of ML explanations online. If only all teachers were half as passionate/explained half as well. Thanks for your amazing work.

[@statquest]

Wow, thank you!

[@vithaln7646]

after watching this video i felt there is someone in the world who can save me, thanks to Joshua

[@statquest]

:)

[@peregudovoleg]

Thank you, sir. You are a gentleman and a scholar.

[@statquest]

Thanks! :)

[@654987ify]

Congrats on these series of videos!! Im currently doing a compressed introduction course on ML methods in my university, and watching these videos in paralel really helps my understanding of the given concepts!! Really good summarize!!

[@statquest]

Awesome! I'm glad to hear the videos help. :)

[@Music_Engineering]

@@statquest They do! Very much so! :) Thank you for making them :)

[@MLA263]

I love this channel so much. Every time I start a video, the musical introduction cracks me up

[@statquest]

BAM! :)

[@Timbochop]

I think this intro is honestly one of the best knee slappers out of your tunes. Well done!

[@statquest]

bam! :)

[@subhashreepanda5307]

ohh god at last i understood this concept through ur vdo .thanx BAM!!!!!!!!

[@statquest]

Thanks! :)

[@malvikachandhok8571]

Thank you so much for all the BAMs and the easy explanation ! Love it :)

[@statquest]

Glad you like them!

[@ismaeo1]

14:25 DOUBLE BAAAAM!!! XD Because of those jokes I'll never forget what I've learned in this video. Great way to use humor, dude

[@statquest]

Thank you! :)

[@sachinkaushik4655]

TRIPLE BAM!!!

[@АнтонЛаушкин-ф1у]

I admire your videos. So clear reasonable explanation on the complicated topics. Worth thousands of written papers!

[@statquest]

Thanks!

[@richiefarrell4726]

Thanks so much for the great explanation!

[@statquest]

WOW! Thank you so much for supporting StatQuest!!! BAM! :)

[@niranandkhedkar3681]

BAM!!! truely an amazing video Many thanks........

[@statquest]

Thank you! :)

[@pankushkukreja3101]

Josh you nail stats in every video, great. This confusion matrix evaluation will be completed if you add one video on precision, recall, f1 score and precison recall curve Thanks and waiting for it.

[@gokeadekunle]

Arghhhhhh. Thank You for this. I was losing my mind already.

[@statquest]

BAM! :)

[@geosylvatalks5537]

Such a lucid explanation of such a bootstrapped concept, which I had a feeling of having understood , but never clearly. Thanks

[@statquest]

You are welcome!

[@ericd.gououi4912]

What your explanations just did to my brain is a work of art. Thank you very much for breaking down ROC/AUC that good

[@statquest]

Thank you!

[@wayneqwele8847]

This is just incredible

[@volodymyrkepsha2123]

immediate like for the intro !

[@statquest]

Hooray! :)

[@ngerih17173]

Me *understand ROC and AUC because of watching this video*: TRIPLE BAM!!!

[@statquest]

BAM! :)

[@atalwar00]

I have so much love for this explanation!! University studies are dead in front of this!! Thanks, from India!!

[@statquest]

Thanks! :)

[@abhay9994]

Dear Josh Starmer, Thank you for your insightful lecture on ROC and AUC. Your explanations were clear, and I gained a better understanding of these concepts. Your dedication to simplifying complex topics is commendable.

[@statquest]

Thank you!

[@shwethavasudevan1788]

This was so helpful, could you also make a video about transformation functions like Box Cox and arcsine? Would greatly help. :)

[@julistanleyA]

“Little bam” and “Bam?” 😂

[@statquest]

:)

[@noorameera26]

hahahahahaha I got so amused with the bam! and double bam! xD

[@statquest]

:)

[@tanishadas9420]

I have been trying to understand this for soo long. Can't describe in words how amazingly simple you have made this. Thank you so much

[@statquest]

Hooray! :)

[@kylelau1329]

It is my lifesaver to watch this video by studying natural language processing! I can't stress enough to appreciate this compared with other content creators on the Internet!

[@statquest]

Glad it was helpful!

[@phannhat3485]

The theme song today: "wait till u see, ROC" so cool.

[@statquest]

Thanks! :)

[@Tggfredcsawsdfgbhhhhu]

I felt that double BAM in my soul

[@statquest]

Awesome!! :)

[@wolfisraging]

Gazillion bam

[@statquest]

Hooray! :)

[@dingusagar]

This is the best explantion i have ever found online for roc. funny how many people complicate simple concepts by throwing in lots of jargons. the examples walkthrough made it super simple and intuitive to understand this. Triple BAM Indeed!

[@statquest]

BAM!

[@RajKumar-vm2kr]

Hello Josh, I am from India. I just started watching your machine learning videos, want to say you are amazing. Thank you for your simple way of explanation.

[@statquest]

Thank you very much! :)

[@mohammedamaar2156]

bro you deserve the happiness of the whole world for providing such helpful videos for us

[@statquest]

Thank you!

[@yahyaelghandour9855]

Thank you so much! I didn’t quite understand what the points and the curve meant, and then... BAM! Insight/understanding came down from the heavens! You seriously have ROCed the world of a young medical student May your channel get more and more viewers and you get more and more love

[@statquest]

Thank you very much! :)

[@stephentan9523]

Yow I'm just stunned how well you explained these things. Every minute is a euphoria for me. It all makes sense now AAAAAAAAA

[@statquest]

Thank you!

[@alexsanders6753]

Thank you for explaining this at 11.20pm before my supervision at 9am tomorrow morning! Needed it!

[@statquest]

Good luck! :)

[@maniaclel8736]

i know its been 4 years but damm the way u explain it is sooooo freaking good

[@statquest]

Thanks!

[@bommijn]

I'm studying for my machine learning finals and your video's (not only this one) help me allot. Thanks for taking the time to make these!

[@statquest]

Good luck with your finals! :)

[@ankeshsingh2576]

The magic starts right after you said, Precision. That was a BAMM Moment. Loved the explanation, Thanks !

[@statquest]

Awesome!!! I'm glad the video was helpful. :)

[@RG-sl6ix]

How to select optimal threshold in PR curve?

[@statquest]

@@RG-sl6ix It depends on how you prioritize the true positive rate vs the false positive rate. If you want to limit false positives, then you want to first select the range of thresholds that limits the false positives to a number that you are comfortable with. Then, within that range of thresholds, you want to pick the one that gives you the highest true positive rate.

[@pur4selife]

I've learned both Statistic and English from this Channel. Double BAMMM!! Thank you all the time for your Awesome video :D

[@statquest]

YES! That is a Double BAM! :)

[@adityanrajendran591]

This is literally the best and the most clear explanation to ROC and AUC ! Thanks for doing this ! Bam !

[@statquest]

Thank you! :)

[@ahmedismail1018]

respect, i don't have seen in my life so easy explanation like yours. millions greetings

[@statquest]

Wow, thanks!

[@victorreloadedCHANEL]

I had stop the video in the minute 3 just to comment how F*** good this video is. May the force be with you.

[@statquest]

Thanks! :)

[@kinsung85]

I really enjoy the thought processes drawn and presented so vividly and clearly!!! Thank you so much for the video. Reading tons of materials but still couldn't understand but understood ROC and AUC the moment finished watching your video. Really appreciate that.

[@statquest]

Glad it was helpful!

[@krishnakarule3708]

It is the first time i am learing this and your teaching is just amazing!!Thank you.

[@statquest]

I'm glad you found it helpful!

[@nikhilhagroo3858]

you are the only reason I understand anything in machine learning

[@statquest]

bam!

[@iriizb]

Thank you so much. Sometimes in advanced epi I feel just overwhelmed with all the details. Your videos really help keep the over all picture in mind. Love them!!

[@statquest]

Hooray! Thank you very much! :)

[@perseusgeorgiadis7821]

Your best video I've watched so far. Now I understand perfectly how specificity and sensitivity are obtained

[@statquest]

bam! :)

[@hommevide]

man u just saved my life i cannot tell how grateful i am, just wish u happiness cuz u a damn good man

[@statquest]

Thank you!

[@sandeepmandrawadkar9133]

Simplest possible explanation for a relatively complex topic. Hats off 👏

[@statquest]

Thank you! :)

[@amirhosseinrahimi3964]

best ever explanation in the history of Model evaluation and scores! for sure!

[@statquest]

Thanks!

[@7rd8]

This is the clearest explanation of the ROC curve I've yet seen. Kudos to you for developing this!

[@statquest]

Thank you very much! :)