Making sense of the confusion matrix

[@OrcaChess]

Now the Confusion Matrix is less confusing to me! Appreciated it :)

[@dataschool]

That's awesome! Thanks so much for watching :)

[@OrcaChess]

@@dataschool Thanks for giving the world a good start into machine learning!

[@dataschool]

You're very welcome! It's my pleasure.

[@echozero31]

Hands down, the best source for Confusion Matrix: Explained. If you are stuck, no matter how long you have been doing this for - I highly recommend you take a 35min break to watch Kevin's video. A+

[@dataschool]

Thank you so much! 🙏

[@julieye2260]

This is my favorite video of explaining what confusion matrix is. Thank you so much for your great work!

[@dataschool]

Thank you!

[@geekyprogrammer4831]

Truly the best video on Confusion Matrix!

[@dataschool]

Thank you!

[@gubben02]

Thanks for this video! I'm sure, I'm not the only one who appreciates what you do for the community.

[@dataschool]

You are very welcome! And, I'm happy to contribute to the community :)

[@ryan22351]

Thanks Kev, inserting "predicted as" helps me remember it - false (predicted as) positive | false (predicted as) negative

[@dataschool]

Glad that is helpful to you! :)

[@haneeshhaneesh5105]

This is the first video i have seen from data school, really impressed with the concept and explanation. I think i should not go back to check for another confusion matrix videos or tutorials. This is really helpful. Thanks

[@dataschool]

Thanks so much for your kind words!

[@dariuszspiewak5624]

Hi Kevin. This exposition of yours is a real gem. A splendid explanation. I think one of the best things you've done here is pairing the terms with the questions they should answer. This is truly helpful. I'd like to take this opportunity and recommend your course on ML to anyone that would like to dive into the field. I have taken it and come back to it regularly. Thank you so much for your effort and dedication to the subject. They are unmatched.

[@dataschool]

Thank you so much, Dariusz! You are so kind and I really appreciate it! 🙏

[@borjaatp501]

Thank you Kevin for your time to prepare, record and share the video. Now I have a better understanding about the Confusion matrix topic 😀

[@dataschool]

Great to hear! You're welcome!

[@ejkitchen]

Best video I have seen so far on all of the topics you covered. No wonder it's #1 in Google search.

[@dataschool]

Thank you!

[@praveenchaubey7018]

Thanks for helping with confusion matrix, i am a beginner in this field and your video helped me a lot to understand this.

[@dataschool]

Great to hear!

[@chaimaelaissaoui6870]

wow videos like this make me understand that some people are just so much better at explaining things than others. Thank you so much for this wellput video. u saved my grades haha

[@dataschool]

You're very welcome! Thanks for your kind comment!

[@manogyapulivendala2504]

Thank you for this amazing video and specially for inserting the words "predicted as". It helps us all remember!

[@dataschool]

Awesome! Glad that tip was helpful to you 🙌

[@skviknesh]

Awesome Bro!!! Great Work! Appreciate your patience & detication in explaining something really confusing in depth- layman terms. Keep Rocking!!!

[@dataschool]

Thanks very much for your kind words! I appreciate it 🙌

[@eturkoz]

Your explanations are really really great. You are the master of terminology and give fluent and concrete examples to clarify any subject you know about.

[@dataschool]

Thanks so much!! :)

[@williamzheng5918]

29:00: "Choice of metric depends on your business objective." I approve this message!

[@dataschool]

Thanks!

[@rbr951]

Hey Kevin, you are an awesome teacher. Not everyone is gifted like you are. Keep it up.

[@dataschool]

Thanks very much for your kind words!

[@mudolee]

this is it! it just saved me from many confusing posts so far.

[@dataschool]

Great to hear!

[@IbrahimOgunbiyi-s4x]

This is really impactful Kevin. I gained a ton lot of information's.

[@dataschool]

Great to hear!

[@shaikayub8922]

i really loved the way you explain the confusion matrix ,finally i am upto it ,much thanks for the video.

[@what594]

Amazing video... Really explained in detail with real examples.

[@Diamond_Hanz]

Amazing Video!

[@dataschool]

Thank you!

[@lucassudo9857]

Man, thank you for your KZbin's channel. Your videos helps a lot.

[@dataschool]

Great to hear, thanks!

[@stevemackay8082]

Thank you so much Kevin for a brilliantly meticulous dissertation. C'est magnifique.

[@dataschool]

Awesome! Thanks so much for your kind words :)

[@SayantanSenBony]

Great presentation,clear explanation :)

[@dataschool]

Thank you!

[@reibalachandran4775]

Thanks a lot Kevin! Things just cleared up after I watch your video! Great work, please keep it up!

[@vivekagrw]

I have seen many of yours video...must say all of your are very helpful....👍

[@dataschool]

Thanks! :)

[@Digitabe]

No more confusion! Thank you friend..

[@dataschool]

You're welcome!

[@sushant6295]

whoever named this confusion matrix must be genius.

[@dataschool]

😂

[@floweast]

the best video about this topic after watching several other video!!!

[@dataschool]

That's awesome to hear!

[@nowhere5111]

Great video 👍👍

[@dataschool]

Thank you 👍

[@jaid7811]

Actually, I love your teaching and your panda's course help me a lot....., I have a small suggestion for you especially in this one if you use the pen while your explanation, it might be easy to understand

[@dataschool]

Thanks for your suggestion!

[@preetisrivastava1624]

Wow thanks for this wonderful and easy to understand approach towards this concept.....sir do you have any course also would love to join

[@dataschool]

I do have offer courses! See here: courses.dataschool.io

[@gandtakwadi69]

Beard will suit you.Keep up the good work Kevin.Your videos help a lot...

[@dataschool]

Ha! Thanks Dean :) That's great to hear!

[@panagiotisgoulas8539]

Kevin, do you have any example of out of sample data that I can measure the true values and not an estimate via my classification model? You mentioned so on 2:00 . Thanks

[@satishchhatpar]

Thank you. Very good explanation.

[@saranyachimirala8351]

This video was really helpful. But can you also explain what exactly base rate and test incidence are?

[@knageswarareddy]

Superb explanation

[@dataschool]

Thank you!

[@special3070]

thank you so much ,sir what reference you use i need to read in pls

[@shahmainurrahman8510]

The number of predictions (n) depends on what?? If we have 5000 test data, what will be the number of predictions(n) for confusion matrix?

[@saddamalikhanpathan8020]

now no confusion on confusion matrix.. thank You

[@dataschool]

You're welcome!

[@yasmin_jsmn]

Thank you, it's really helpful.

[@dataschool]

You're welcome!

[@goodman9585]

How to calculate average precision and average recall?

[@Uma7473]

From classification rules can we derive at confusion matrix? is my question weird or wrong?

[@bevansmith3210]

Thanks Kevin. How do we construct a confusion matrix if we use k-fold cross validation? I understand using a single train test split, but not sure how to do it with multiple cross validation. Thanks.

[@dataschool]

I think you can accomplish this with cross_val_predict. Hope that helps!

[@pialatour3600]

Hey there, thank so much for this video! I was so confused with true and false positives and so on but you have clearly cleared my mind! But I have a problem: What do I do, if I don’t have any reference data to compare my classification with? I’m using SNAP for a random forest classification of Landsat images. I just have 2 classes: urban and non-urban I made training samples for these two classes and after my classification I made new training samples for a new class called urban-validation and another class called non-urban-validation. As I don’t have any other data than my self-made classification of the satellite image, I guess my training samples for the two validation classes would have an accuracy of 100 %. That’s why I don’t know if it’s even necessary to do a confusion matrix? But if I would still want to do a confusion matrix, which classes should I use? Do you or someone else have an idea what I should do? I would be so greatful!! Have a good day!

[@rohitbhosale8755]

You ara a champion.

[@dataschool]

Thank you!

[@DunedinNZ09]

Thank You! Awesome video! :D

[@dataschool]

You're welcome!

[@houyao2147]

Excellent!

[@dataschool]

Thanks!

[@emmaekstrom5169]

Hey great stuff! How can missclassification errors be calculated for multiple-case confusion matrixes? And what does it really mean?

[@dilipgawade9686]

Your videos are so much simple to understand. I have been trying to learn TensorFlow but do not find any good videos for beginner level and practical examples. Would it be possible for you to start Tensorflow session on your channel ?

[@dataschool]

Thanks so much for your kind words, and for your suggestion! I'll consider it for the future :)

[@Priya_dancelover]

Excellent

[@dataschool]

Thanks!

[@adeogunpradel6631]

Thank you!!!!!!

[@dataschool]

You're welcome!

[@vijaykumar-yq7sf]

great explanation. thank u

[@dataschool]

You're welcome!

[@khafidakbar1103]

from that condition, how to calculate misclassification cost ?

[@nagnathsatav9978]

Just awesome

[@dataschool]

Thanks!

[@ankitakushwah9121]

Hii. can you please explain me how to calculate classification results on the basis of various attributes from multiple Reviews. if there is 5 clases and each classes includes various reviews. according to that reviews we find unique attributes and we have to find how many times that attribute is occur in the reviews. and also to find that the attribute is belong to which class.

[@dataschool]

I'm sorry, I don't understand your question. Good luck!

[@AvinashKunamneni]

Hey can i apply the confusion matrix for the risk assessment of an e-learning website based on the key factors of participants, technology, information, infrastructure, technology ??

[@dataschool]

You can use the confusion matrix for any classification problem, regardless of the subject. Hope that helps!

[@AvinashKunamneni]

@@dataschool But I have a dataset with a classification of 5 how could i proceed with the confusion matrix? I'm a bit confused could u pls help me out ?

[@mkumar4059]

@@@AvinashKunamneni ,Firstly choose one coloumn as your response, and corresponding to that response select best among other 4 columns (1 already chosen as response).Then You can use confusion on each.That's it.Keep learning.

[@AvinashKunamneni]

@@mkumar4059 sorry I didn't get you... I have the classifications as agree, strongly agree, neither agree nor disaggree, disaggree, strongly disagree for 20 questions for each factor mentioned in the above reply

[@dataschool]

Based on my understanding of your problem, it doesn't sound like a confusion matrix is the tool you are looking for. Good luck!

[@muhammadnasrollahi1307]

Hi teacher At first, let me appreciate you for this awesome tutorial but here I have question. I've used classification app in Matlab and calculated the confusion matrix but I can't calculate some factors like Accuracy, Misclassification Rate, Precision, Recall and etc I'm wondering I you help me Thanks King regards Muhammad

[@BwithGadgets]

Hello Sir..in your video the Predicted class is shown on x axis but per wikipedia n some other experts the predicted class is on the y axis of the matrix. Plz let me knw if m correct.

[@dataschool]

Right, there are different ways that the confusion matrix can be displayed. None of them is the "right" way. Hope that helps!

[@Shripadsmail]

Learning the confusion matrix with Actual classes on left side will be useful if you are using sklearn output

[@username42]

this is the literally the meaning of confusion :D

[@mannankohli]

hi there, i m working with election predictions. i have developed the model using 2018 election data-set and test it on 2013 and 2008 election data-set. now my question is that how to get the mean of all confusion matrix for three elections in one single model.

[@dataschool]

I don't quite understand what you are trying to do, I'm sorry!

[@Shripadsmail]

Sum all the values from the three models and report.

[@mannankohli]

@@Shripadsmail thanks a lot But how to sum all the values of three different model Will u please elaborate with some examples

[@Shripadsmail]

@@mannankohli Ideally for one model, there will be one confusion matrix. If you have three models, three confusion matrix. That way we can compare these models. But if you want only one confusion matrix for some reason, may be you can treat these three models as one model and construct a confusion matrix (which is not advisable). If you are still not unclear you can email me.

[@leavedrakealone1801]

Little confused here. First you said that the classifier predicted 'No' 55 times. Then you said that the classifier predicted 'No' 50 times which was the Actual value as well therefor its a True Negative. Does that mean it predicted No 50 times or 55 times?

[@dataschool]

It predicted "no" 55 times. 50 of those times it was a correct prediction (which is called a True Negative), and 5 of those times it was an incorrect prediction (which is called a False Negative). Hope that helps!

[@adityarajora7219]

Love you bro!!!!

[@dataschool]

Thanks, Aditya!

[@awakenedspirit6397]

Hello @Data School can you drop the slides of the tutorial

[@dataschool]

There are no slides, but this is the main resource: www.dataschool.io/simple-guide-to-confusion-matrix-terminology/

[@dataschool]

Hi everyone! Join me for the Premiere of this 35-minute video on October 31 at 11:00 AM Eastern Time! I'll be hanging out here and answering your questions LIVE while we watch the video together :)

[@faisalliaqat5735]

Tell me how tu calculate matrix value. you are already written these value

[@dataschool]

See here for how to do it in scikit-learn: kzbin.info/www/bejne/n6OrmXeDl9xmrtE

[@coxixx]

would you make a video about inverted index?

[@dataschool]

Are you referring to the inverted index data structure? Thanks for the request, but I'm not the right person to teach that subject... I'm sorry!

[@NiranjanBallal]

You defined the equations and did not give the definition. For example, how exactly should we perceive Sensitivity or Precision?

[@dataschool]

Does this help? www.dataschool.io/simple-guide-to-confusion-matrix-terminology/

[@ChandraveshChaudhari]

thanks man, if anyone want to know about Mnist confusion matrix go to 24:42

[@dataschool]

You're welcome!

[@goldenmonkey9085]

I come from China, and start to learn python for half year. can you teach me visualization in matplotlib or seaborn ? I can't find a very perfect videos about visualization in python and maybe it is very tough to teach. I don't know , maybe you can do it haha~

[@dataschool]

Thanks for your suggestion! I'll consider it for the future :)

[@ziyadmoraished6097]

Thanks a lot for explaining it !! ConfusionMat.com is a website that explains it in an interactive way :)

[@dataschool]

Thanks for sharing!

[@hadiali5922]

Hi sir! I was wondering and imagining if we could get some videos on how to make use of different machine learning models along with some examples for each model. I'm really getting used to your videos as I've already finished pandas and scikit learn playlists. So please can you upload some videos on it? Or atleast upload some vidoes on unsupervised learning models

[@dataschool]

Thanks for your suggestions!

[@Vatuify]

I think the accuracy is only meaningful for classifications that have three or more classes.

[@dataschool]

No, accuracy is often very meaningful for binary classification problems (2-class).

[@fisherh9111]

That background looks like the “Leave Brittany (Spears) Alone!” guy’s background.

[@arjungoud3450]

No more confusing...w

[@dataschool]

Great!