TFIDF : Data Science Concepts

[@vinson2233]

I'm really glad to choose this video instead wasting my time watching 30minutes explanation of tf-idf. Great job for explaining this

[@pohkeamtan9876]

This is really good. Concise , straight to the point, and there is no need to show a line of code !

[@akshikaakalanka]

always the best place to look for a concept explained. Always grateful.

[@stanlukash33]

I started googling tf-idf and then I was like "Hey, maybe that guy has a video on it", and you do! Thanks!

[@ritvikmath]

😂 "that guy" says you're welcome

[@stanlukash33]

@@ritvikmath haha sorry, Ritvik!

[@rt58528]

Being a math lover, within a minute of your explanation I became your fan, was always in a search of videos like this

[@mango-strawberry]

true. his channel hasn't been picked up by KZbin yet.

[@hemantsah8567]

Your videos before sleep... Keep nightmares away...

[@ritvikmath]

aww, thanks !

[@summerxia7474]

Such a clear explanation!!! Much better than my teacher in the class. Why can't they just make it this simple? Thank you so much.

[@ritvikmath]

no problem!

[@mosca-tse-tse]

Excellent teaching! Perfectly designed, clearly explained and not even one sentence that would be redundant. I’m your fan my friend 👍🏼🙏🏼

[@ritvikmath]

Wow, thank you!

[@leod1740]

@@ritvikmath Yes excellent explanation

[@gunbac74]

I read this explanation in a book, but not as clear as this video. Well done!

[@ritvikmath]

thanks!

[@Scar_]

Thank you for this! You saved me much time! Your explanation is legit!

[@ritvikmath]

Thanks!!

[@imdadood5705]

I wish to have your coherence when explaining. Awesome explanation as always.

[@BhuvaneshSrivastava]

I like your videos first and then start watching your Data Science videos because I am sure that after I am done watching it, I will like it anyway. Keep it up.. 🙏

[@ritvikmath]

Wow, thank you!

[@luuz_study_yt7123]

Thank you for the video, we are working at a Movie recommender System and this helps a lot for NLP.

[@elsywehbe2897]

Your examples are excellent! Thank you!

[@ritvikmath]

You're very welcome!

[@michaelhaag3367]

Lucid explanation, my man back at it again!

[@David-nw6rz]

When using the whiteboard, your videos are even better than with pen and paper! Thanks for your videos!

[@alexfeng75]

great video with depth and simplicity at the same time!

[@maefiosii]

that explanation was so smooth and clear.. great job

[@ritvikmath]

Thank you :)

[@martand_05]

What a classy explanation. So good man!

[@ritvikmath]

Much appreciated!

[@hariharvyas4741]

What if the word we are checking does not appear in any of the document, then in the denominator it would be 0 which is not possible

[@butterfly34457]

So simple and concise! Thank you so much!

[@mila4real1]

Cool! Loved your simple but extremely efficient explanation

[@srijitbhattacharya6770]

Excellent , simply briliant

[@_instanze_]

Youre an excellent explanar man. And I don't mean that lightly (I rarely compliment people wallah). You got a knack. Truly! Subscribed!!

[@ritvikmath]

I appreciate that!

[@cesarreinoso2203]

Awesomeeee Simple and Clear

[@balaganesh3440]

Outstanding explanation!

[@hannahb.9454]

This came in clutch, thanks

[@VishalKhopkar1296]

if the word 'healthcare' did occur in all 3 speeches, but occurs in the Obama speech 26 times, but only once in Clinton's and Bush's speeches. Using this mechanism, the IDF of healthcare would still be 0, but since the word has been used a considerably large number of times in the Obama speech, it is definitely important

[@redpz]

in a more realistic situation the # of D would be much larger so cases like this would be extremely rare

[@TheTranscending]

Good point

[@hameddadgour]

Great presentation!

[@amadios9874]

That was crystal clear, thanks

[@ericzhang5987]

Excellent explanation !

[@mohamedshatarah7264]

Thank you so much for explaining this clearly sir

[@nehimomo]

veyr great explanation, much better than my lecturer

[@vaibhavmourya65]

Great explanation buddy🙌🏻

[@MrKqsami]

Great Job sir!

[@bananalord8575]

Sweet and simple!

[@adrianramirez9729]

Amazing explanation!

[@pallavijog912]

Nice explanation. Thanks!

[@eramy1]

Good explanation in a simple way... keep doing well man

[@ritvikmath]

Thanks a ton!

[@athena9357]

You saved me! My professor explained this in 3 hours, I watched it 2 times and I don't get it. This guy explained the same concept in 7 minutes and I get it!

[@Justrelaxx101]

Perfectly explained

[@warislthong3149]

Excellent !

[@dalvirsingh4070]

Explanation was awesome!

[@devidurga392]

clear cut explanation. Thank you

[@Shaan11s]

YES! I get it now, much love bro

[@RedditFam]

Very useful! Thank you Sir!

[@user-or7ji5hv8y]

Clear and concise.

[@ernestanonde3218]

Powerful...Thank yoiu

[@robertodigiacomo3910]

Great explanation

[@sebastiancamilopuertogalin4478]

For any given word/term, we want to know how important is that term for a given document, relative to the entire corpus of documents. E.g. for Clinton these subset of words is really important in his inauguration speech, relative to the other inaguration speeches. TF-IDF is simply a multiplication of the metrics TF (term frequency) and IDF (inverse document frequency).

[@AKapich]

Very succinct explanation, thank you very much

[@ritvikmath]

You are welcome!

[@22malman]

Superb!!

[@fustigate8933]

Nice explanation!

[@chaitu2037]

Very well explained

[@cleansquirrel2084]

Awesome video!!

[@ritvikmath]

Thanks!

[@k_anu7]

If anyone dislikes this explanation god will have to come down to explain him/her.

[@almonddonut1818]

Thank you so much!!! 🤩

[@emna143]

Hi, first of all, thanks for the great explanation. I have watched your videos about Word2Vec and TF-IDF, and I need help, please. I'm a student working on a project about binary classification of SQL injection attacks. The dataset I have contains two columns: 'sentence' and 'label.' I need to extract features, but I'm confused about which technique to use: Word2Vec or TF-IDF. Can you help me decide?

[@mariapazherrera4306]

Amazing!!!!!

[@mupetman1214]

Would you advise to take out stopping words and run tdidf on the new set of documents?

[@ralphhennen5769]

How do you model multiple objects associated to a term class: Dental Care: United Health Care, Blue Shield, ..., by state? This becomes contextual and local within the text - how close is the word dental care in the text to UHC, for instance. The result would show which states address dental care in their health insurance regulations and which insurance companies make it available - both in a positive and negative way. Understand that this is a narrow example. Thanks

[@mango-strawberry]

damn.. that was a solid explanation

[@mitadrubanerjeechowdhury9092]

Amazing stuff, thanks man for letting me pass the exam.

[@MYanton1994]

thank you very much

[@Begooder]

many thanks

[@negusuworku1871]

iT IS REALLY NICE. KEEP IT UP

[@ritvikmath]

Thanks a lot 😊

[@MultiRockxD]

Is this a good tool to create a top of "important" words in a dataset? or it just helps to see the relevance in a particular document, I want to use it so I can maybe sum all the tdidf of all the documents and create a top words but I don't know if this is the best approach/solution to what I want, thank you in advance

[@superbatman1462]

Nice Explanation

[@ritvikmath]

Thanks!

[@pushkarparanjpe]

This is a great explanation. Thanks. I have a question about differences between the implementation described in this video and another implementation commonly found on the web. Can you explain how these two details would impact the final representation: 1) Term frequency simply calculated as term count 2) Applying vector normalisation (L2) to the document vector obtained in this video Another question which is more open-ended: why is TfIdf still relevant ? Or less provocatively - is there a sweet spot where one would prefer TfIdf over the modern dense vector representations (such as word2vec, doc2vec, etc.) ?

[@zephyrsurfteam]

Great video! Thanks! I would love to see more content on TFIDF.

[@ritvikmath]

Noted!

[@sia-watsonlee]

amazing

[@ai-force3792]

very Good

[@ritvikmath]

Thanks

[@Soutehkeshan]

Useful :)

[@ritvikmath]

Glad you think so!

[@0xjrr]

love that in this alternative timeline the last speech is from Obama

[@skeletonrowdie1768]

a certain president would really bias the vocabulary data

[@swagatggautam6630]

I wonder why my teachers couldn't explain so simply.

[@sepideh1111]

Thanks , great teacher if I could I would have given you 3 thumb

[@vasundharasingh8216]

in cases where all the 3 documents contain the word, even if 2 of them contain the word only once and the 3rd doc contains it a 100 times, tf idf would be 0 as idf would be 0. isn't this misleading then?

[@xxxxxx-wq2rd]

but if healthcare appears 100 times in one document, and only once in each of the other 2 documents, then the result will be zero!

[@nicholasdavis9529]

This was my question. If you found out let me know.

[@nicholasdavis9529]

Great video btw, best explanation.

[@durasaksham]

It was that easy

[@aleynapolat1545]

Bro, you are a good narrator but a bad organizer. It would be better that the next time you write on the board more regularly in order to make it easier to follow what you sayin

[@australianperson2582]

Thanks for politicising education with that exclusion with that example, unsubbed - so partisan.

[@ritvikmath]

Sorry to see you go, it was not my intention to politicize but rather just to use this as an example.

[@abdulbasit0123]

That was a great explanation, Thanks 🤍

[@jb_kc__]

your explanations are great bro cut to the heart of the issue + ensure conceptual understanding 🫡🫡

[@ritvikmath]

Thank you so much 😀