StatQuest: Hierarchical Clustering

[@statquest]

Support StatQuest by buying my book The StatQuest Illustrated Guide to Machine Learning or a Study Guide or Merch!!! statquest.org/statquest-store/

[@Aemilindore]

You're a person who saved me lots of time and pain. Thank you. I wish you the best

[@statquest]

Thank you very much! :)

[@anamulmbdu]

The intro song removed my fear of clustering. Thanks for the awesome video.

[@nemothekitten3994]

going on a statequest😌

[@w花b]

​@@nemothekitten3994 aww...

[@kristinomalley4519]

You are, and I cannot stress this enough, a national treasure!! The ease in how you explain things that have eluded me for over a decade and make it click is truly a gift. Thank you so freaking much!!!

[@statquest]

Wow, thank you!

[@julieboissiere4553]

I used to watch your videos while I was a student. It’s been 3 years since my graduation and I’m still here (I’m changing jobs and need to review some stuff). Thank you a lot for your incredible work

[@statquest]

Congratulations on the new job! BAM! :)

[@fadikhattar290]

I still don't believe how this content is free. Thank you sir!

[@statquest]

Thanks!

[@KL1_Khaled]

Even after 7 years, you still the saver

[@statquest]

Glad I could help!

[@yamikag8363]

your videos help me see the "big picture" of concepts. after your videos, I can actually understand what is going on and why we are doing something. Thank you!

[@statquest]

Happy to help!

[@stephenwood9252]

Love your videos. The fact that you make it so simple shows the depth of your understanding.

[@statquest]

Thank you!

[@loftyTHEOWNER]

I would like to add that: - single-linkage (comparing the closest points of 2 clusters) tends to form more elliptic clusters; - complete-linkage tends to form more globular clusters. So, that means that not scaling your data, scaling with a StandardScaler, or with a MinMaxScaler will affect your clustering.

[@statquest]

Noted!

[@rajshrestha9484]

I can't thank you enough. Such clear and helpful explanations. Great.

[@statquest]

Thanks! :)

[@EthosDemerzel]

you can, with patreon

[@chikken007]

I already watched some of your videos. This one I watched because I want to apply hierarchical clustering in my thesis. It is about time I buy one of your sweaters. I hope this supports you. Thanks for all the truly great explanations.THANK YOU!

[@statquest]

Thank you very much!!! :)

[@liranzaidman1610]

Very nice. I use this in Python and it's a really good way to cluster. Another thing - from coding aspect, it's only 1 line of code in Seaborn, very easy.

[@statquest]

Thanks for sharing!

[@brunomartel4639]

this video proved that "hard" stuff =badly explained stuff

[@sindhujas7807]

so fuckin true. Not sorry for swearing. Happy learning guys

[@gummybear8883]

if you can't explain something in simple terms, then you don't understand it that well.

[@julius4858]

@@gummybear8883 or you've been a professor for 20 years and are so deep into a topic that you completely forgot how people approach new problems. Your sentence really only applies to novices trying to be teachers.

[@MungoBootyGoon]

@@julius4858 We could just change it to: if you can't explain something in simple terms, then you can't teach it that well.

[@julius4858]

@@MungoBootyGoon Yeah, that is absolutely true. Many of my professors for theoretical computer science are experts on various fields but man do their explanations suck. That's why I have to watch youtube videos for stuff like this.

[@HiasHiasHias]

StatQuest never disappoints

[@statquest]

BAM! :)

[@nnnyin6967]

I am preparing my actuarial exam and you saved me a lot❤

[@statquest]

Good luck! :)

[@jingsilu5568]

Thank you for clearly explaining the details at a moderate speed! You save me lots of time!

[@statquest]

Thank you!

[@jonathanlam7204]

Thank you. Better than university teaching

[@statquest]

Thanks!

[@vishk123]

Thank you for allowing me to ascend the stats hierarchy!

[@statquest]

bam! :)

[@websciencenl7994]

StatQuest is the Best! Teaching is an art...and these are master pieces.

[@statquest]

WOW! Thank you very much! :)

[@pragyamishra9083]

The visualizations and simplicity of explanations as well as great examples motivate me to keep learning. Thank you so much for making it so interesting. I'll try to do my bit by buying a t-shirt. 😊

[@statquest]

Wow! Thank you very much! :)

[@The_TusharMishra]

hi pragya

[@marahakermi-nt7lc]

ohh my god thanks josh u are so brilliant i think marvel should add another new superhero "josh starmer the life saver"

[@statquest]

:)

[@farzanaferdousi9885]

Your explanation is very clear to me and i see all your video, you are very friendly to me. I like you very much.

[@statquest]

Thank you! 😃

[@scraps7624]

This channel is a treasure! Absolutely incredible job my man

[@statquest]

Thank you so much 😀!

[@davidescobar4449]

I have to congratulate you for this video, it gives the basic notions of the hierarchical cluster easy and fast. Bravo!

[@calebsawe8307]

I am super grateful for this video. You are such an excellent teacher! Thank you for being such a "you"

[@statquest]

Wow, thank you!

[@mountainsunset816]

The opening is always funny

[@statquest]

:)

[@KasperRasmussen-z3y]

This channels is truly a treasure trove! I was wondering if you could do a video on consensus clustering? I.e. how to evaluate clustering across multiple models and parameters. You are awesome!

[@statquest]

I'll keep that in mind.

[@gurkanyesilyurt4461]

you saved yet another day Josh. Thank you

[@statquest]

Bam! :)

[@hamidkiangaikani]

4.4 K likes, zero dislikes! You're awesome. Thanks very much

[@statquest]

bam!

[@2327853]

@StatQuest please explain probability and Naive Bayes. Thanks in advance! I am a huge fan of your way of teaching and your small songs creations. Keep up the good work!

[@statquest]

Thanks! Naive Bayes is on the to-do list.

[@createyouridea8602]

@@statquest waiting. plz .

[@abhayjoshi2121]

You are simply amazing !! I love your style and simplicity and the word is BAM! .. your videos are very informative and worth going through... thanks for all your hard work in simplifying the complex topics

[@statquest]

Thank you so much!!

[@Paulamiz]

Watching this after watching your more recent videos. Missed your 'BAM's a lot!!! You should remake these old videos again! Thanks :)

[@statquest]

bam! :)

[@Paulamiz]

@@statquest 😍

[@vakarthi4]

Found this gem of a channel today. Agreed on the fun rhymes and puns.

[@saipanchajanya5980]

This is Awesome...... Please Make a session on K Modes, KNN and K Prototypes

[@statquest]

Here's a complete list of my videos so far: statquest.org/video-index/

[@congchen170]

Joshua's video is always helpful. Next time, probably k-means clustering.

[@옹늬야아]

You saved my life😇 Thank you very much. And I think the link for the sample code in R isn't available right now...

[@statquest]

Yep, that's a really old link. Here's a new one: statquest.org/statquest-hierarchical-clustering/

[@proggenius2024]

awesome content and delivery

[@statquest]

Glad you think so!

[@kurniadi-5492]

it doesn't define if it's must be from the shortest Euclidean or what and basically what makes the dendogram become shorter from another

[@statquest]

I'm not sure I understand your comment. Can you clarify?

[@anastasiyakuznetsova8797]

The best as always! Love this channel! It's super easy to understand

[@statquest]

Thanks!

[@99harshini]

Absolutely brilliant..Thank you sooo much for your time and effort!

[@statquest]

Thanks! :)

[@eamiller12]

THANK YOU! This is has been SO HELPFUL!

[@statquest]

bam!

[@shamanthrajreddy1230]

Excellent explanation!

[@statquest]

Thanks!

[@isha996]

Please add a video on Latin Square design, Joshua! I am going to pass my stats final tomorrow, only because of your videos :D your students are lucky.

[@isha996]

The CPA and clustering question was worth 30% of total marks on my exam today, and I managed to write them so well only because of your videos. you're a savior. Thank you!!

[@davidcartwright337]

great videos, I like the way you explain these topics

[@oliviagallupova9199]

You saved me a week

[@statquest]

Awesome! :)

[@balajicanchi5538]

Explained in a simple manner.

[@MihirSriramVadali]

Great channel. Clearly explained all most all the topics i watched on ML. Here one question what does gene stands for is it features of the data ?

[@statquest]

Yes, it's a feature.

[@robertogff]

Congratulations! your video is so great! you explain is a very clear and simple way.

[@statquest]

Thank you! 😃

[@jovanmampusti4025]

Thank you so much sir! This is very helpful and very informative.

[@statquest]

Glad it was helpful!

[@CapoeiraPiper]

Man your videos are soo super helpful! THANK YOU (ps consider the color library viridis to make it easier for the colorblind)

[@statquest]

Thanks!

[@preranadas4037]

Hello Josh! The videos are soooooooo goooood! These are BAMMMMM Good!! 1 request - Could you please create a video on LCA - Latent Class Analysis? Maybe by comparing it to k-means clustering? I cannot be more thankful!

[@LoriSchomp]

would like this too

[@alyssawang144]

fantastic explanation, thank you so much for this video.

[@statquest]

Thanks!

[@fellsantfernandoargentin2072]

Congratulations from Brazil!

[@muhammadiqbalmarzuki]

This video is super duper bam bam double double bam! Will you cover more advanced clustering techniques such as model-based clustering (MCLUST) and weighted gene co-expression network analysis (WGCNA)? I'm learning about these things now for my research, and will be very grateful if you can cover these topics for me. Thanks! :)

[@statquest]

Thanks! :)

[@rodrigohaasbueno8290]

I love this channel so much

[@statquest]

Thank you! :)

[@subhabrataghosh9831]

Excellent Sir

[@statquest]

Thanks!

[@ankitabhavsar886]

the intro.......nice one bro🖐

[@statquest]

bam! :)

[@mojtabasardarmehni453]

Great as always! Thanks.

[@statquest]

Thank you! :)

[@MrKingoverall]

I LOVE YOU JOSH !

[@statquest]

:)

[@python_information601]

Nice explanation 👍👍

[@statquest]

Thanks!

[@LetWorkTogether]

I love this. Your video is wonderful!

[@statquest]

Thank you! :)

[@surbhardwaj1721]

Amazing explanation. Please make a video on Cluster evaluation. :)

[@statquest]

I'll keep that in mind.

[@sandipansarkar9211]

finished watching

[@statquest]

bam! :)

[@zzzluke8906]

Hi Josh, amazing video as always. Think you can come up with video on how to determine the best number of clusters to have? I get the Elbow method, but I really struggle with the inconsistent method. I was looking at the inconsistency coefficients, and I am confused to do they include singleton clusters, or are singleton clusters excluded. I am also confused about what exactly is the "jump" in the inconsistent coefficient that we are supposed to look out for.

[@statquest]

I'll keep that topic in mind.

[@Sean-lz2dh]

great video. thank you very much

[@statquest]

Thanks!

[@lazyboy7521]

Great video! There is a minor mistake around 8:21. You should replace "sample" by "gene" in calculating the distance, i.e., |difference in gene #1| + |difference in gene #2| +...

[@statquest]

I believe the video is correct. For details, see: 6:01

[@khawlaou5385]

You're THE BEST

[@statquest]

Thanks!

[@cfonsecaparis812]

Hi Josh, I am really enjoying your videos specially the wha whas and bam !! , you make stats sound easy but also fun! Thank you! I wonder if you could please do a video to explain the different uses of PCA and HCA, when do you use one or the other? In the mean time I will watch your videos on PCA and HCA :) hooray!

[@statquest]

BAM! Thank you very much! I'll keep that topic in mind.

[@saikiranjajula2033]

Thank You Sir, It was awesome to learn from you.

[@statquest]

BAM! :)

[@manuelsokolov]

Dear StatQuest! Thank you for the explanation. 1. What is the best would you would evaluate the algorithm (silluete score,...) to decide which clustering method and distance to use ( i undestand that silluete score is good to choose the number of k but not to decide between algorithms)? To decide the best algorithm i have been ploting PCA and color label by clusters created this way understanding if the clusters make sense or not? (however it is known by literature that PCA does not work well to evaluate binary data) 2. In the case that the data is binary, (e.g instead of expression data, genomic alteration data) what kind of distance would you use? Best Regards, Manuel

[@statquest]

1) I guess it depends. If I had "training" data, with known categories, I would compare how many times the data were correctly and incorrectly grouped. Otherwise, it really just boils down to subjective preference. 2) If you measure a lot of things, the euclidian distance will still work in this situation.

[@fabiomaia3433]

Hey Josh! Your videos are great! Thank you for the effort you've put on it! If you allow me... have you considered making videos explaining DBSCAN and HDBSCAN?

[@statquest]

Yes, I've thought about those topics and may make a video about them.

[@RadicalRed0]

Thank You

[@statquest]

:)

[@kanacaredes]

Hi Josh!! We need a DBSCAN tutorial please!!!!

[@statquest]

I'll keep that in mind! :)

[@tymothylim6550]

Thank you very much for this video! It was really well done :)

[@statquest]

Glad you liked it!

[@sonakshigarg4273]

You can explain the same concept with may be some other datasets and better visualisation other than heatmap

[@urjaswitayadav3188]

Great explanation. Thanks StatQuest!

[@LBsCuriosity]

really awesome video! This will help me with my test. Thank you!

[@setareht7546]

Thank you for all your videos clearly explaining complex concepts. Can you also make video(s) on different bi-clustering methods?

[@statquest]

I'll keep that in mind.

[@samhobbs4996]

Great video

[@statquest]

Thanks! :)

[@ardaugurlu8673]

Good job mr josh.

[@statquest]

Thank you!

[@12bjab]

just beautiful!

[@chuxbouch2793]

You're amaaaaaazing

[@statquest]

Thanks!

[@iranziemiler8135]

Thank you

[@maikfranke2303]

Amazing! Your Videos are so much comrehensible. I really enjoy watching!!!*_*

[@statquest]

Thank you!

[@locdaikathegreat3689]

So cool the video!

[@statquest]

Thanks! :)

[@madmocro8076]

You make my data science minor achievable lol, thanks!

[@statquest]

Hooray! :)

[@snay6869]

thank you so much!

[@statquest]

:)

[@paulbu6003]

Why I didn't watch this video before my exam!

[@statquest]

:)

[@anthonychan4478]

Hi Joshua, can you do a video on Gaussian Mixture Models? Also, your videos are awesome! Keep it up.

[@statquest]

The good news is that is already on the To-Do list. I'll bump it up a notch since you requested it as well.

[@jordanmakesmaps]

@@statquest, make that two requests! Thanks!

[@statquest]

@@jordanmakesmaps Cool! It's in the top 10 things for me to do, so hopefully I'll get to it soon.

[@jacobmoore8734]

@@statquestYes! Anytime people start talking about gaussian mixture models, EM, "sampling the posterior", and MCMCs - I get cold sweats.

[@daminithandele7237]

Hi Josh! Can you please make a video on DBSCAN, if possible? Especially the parameter tuning part of it, I'm sure that would be of great help to lots of people.

[@statquest]

I'll keep that in mind.

[@danielwikstromshemer5947]

You are amazing

[@statquest]

Thanks!

[@naturelove9396]

Hey you explain this very well and in very simple form thanks for this, I request you could you please make one video on DEGseq2, means finding DEG gene between the time points and then drawing the heatmap, volcano plot and cluster lines. Thanks

[@statquest]

I'll keep that in mind. I already have a few videos on DESeq2 here: statquest.org/video-index/

[@MultiAli80]

Please I wish more application of clustering in cancer Thanks

[@statquest]

I'll keep that in mind.

[@AdnanGora]

Awesome video

[@statquest]

Thank you! :)

[@2000starlines]

love the video:) I'm currently deciding whether to use hierarchical or k-clustering for my data though both work I really do not know which one is more suitable for protein abundance in two different biological conditions. If anyone has a suggestion I would be glad :)

[@statquest]

Both methods are relatively subjective - so pick the one that gives you the better insights into your data.

[@botang9960]

Nice！！

[@statquest]

Thanks!

[@solibozorgmehr6524]

Thanks for the explanation. Can you please make a video about consensus NMF clustering?

[@statquest]

I'll keep that in mind.

[@vedant6460]

thanks

[@statquest]

:)

[@lukehebert6207]

Very helpful, thank you!

[@statquest]

Thanks! :)

[@emamulmursalin9181]

Great explanation Josh! Just one question, are we clustering samples(data points) or the Genes(features)? If we are clustering Genese, does not it mean that we are just clustering the correlated features?

[@statquest]

In this video we are clustering the genes, and yes, the idea is that correlated features are brought together. We could even just calculate the correlation coefficient for each pair and cluster based on those values.

[@emamulmursalin9181]

@@statquest Thanks for your reply. But I have seen some other blogs where authors are plotting 2D data points and using hierarchical clustering. So in real life we use hierarchical clustering for data clustering or feature clustering?

[@statquest]

@@emamulmursalin9181 I'm not sure what you mean by "data" clustering, however, we can cluster the rows or the columns with similar ease. It doesn't matter if one is features and the other is samples.

[@emamulmursalin9181]

@@statquest Sorry for using an unclear term. Actually I meant "samples" by using the term "data". So, can hierarchical clustering be used for "feature clustering" (for example, finding correlated features and remove the redundant features) and also as "sample clustering" (e.g. just like K means clustering ) ?

[@statquest]

@@emamulmursalin9181 Yes. We can cluster the rows just as easily as we cluster the columns.