Word Embeddings, Word2Vec And CBOW Indepth Intuition And Working- Part 1 | NLP For Machine Learning

[@parmoksha]

this is first time i actually understood how embeddings are generated using word2vec. In most other tutorial on word2vec this exact thing was missing

[@bhesht]

Excellent series, wonderfully explained mechanisms - you won't see this elsewhere. Thank you!

[@aszanisani]

i love your explanation, can't wait to the next part🤩

[@raviv1752]

Thank You Krish for wonderfull explaination

[@amiralikhatib4843]

I can't wait for the next part which the SkipGram approach will be discussed

[@devkumaracharyaiitbombay5341]

45:07 sir it is not window size which represent output vector dimension otherwise then why vector parameter is 100 by default and window size present as two separate parameter when you train word2vec model from gensim lib.

[@apurvaxyz]

Please teach in FSDS May batch also

[@nandansadiwala4113]

The videos are very helping for me. Thanks Krish. Waiting For Some More Adv. Conceptual Videos Related to Deep Learning.

[@apoorva3635]

41:49 - What is the point of initializing weights when all the 0s (which are n-1 in number) multiplied with any number will anyways remain the same?

[@rachakondaeshwar4129]

Great video

[@shriramdhamdhere7030]

you said that window size defines the length of vector to which a word is transformed but in the next video while training you had a window size of 5 but got a vector of 100 dimension ?? pls clarify

[@AI-Brain-or-Mind]

grate sir i leaned so much thing from your videos thanks lot sir sir can you show us where to to download pretrained model of word2vec

[@rafsankabir9152]

Amazing!!!!

[@farbodzamani7248]

thanks a lot

[@dineshshelke631]

Sir FSDS Batch mai bhi padhao please

[@HarshPatel-iy5qe]

why does number of hidden neuron should equal to window size , it can be anything , right? our window size decides the inputs words neuron layer which is window size-1. Correct me if i am wrong

[@mehdi9771]

you are correct , there is no error in your explanation. one note in window size is it is a hyperparameter that can be fine tuned based on results.

[@shudhanshushrotriya6931]

As for the hidden layer size, it also is a hyperparameter. Even in the paper Google published, they used 5 as a typical window size. And for the feature they experimented with embedding sizes of 100 to 1000 dimensions.

[@khaderather]

Hope your Dubai tour was good.

[@wenzhang5879]

is the number of hidden neurons equal to the window size?

[@luffyd9724]

Sir in Hindi batch there are 5 video already uploaded but in english batch there is only one video .why this difference are there ??

[@ameybikram5781]

the same word can be present in differnt sentences !! so we calc the vector for thtat word in every sentence and take the averge?????

[@mudumbypraveen3308]

I think towards the end the explanation of window size is wrong. if you multiply (7x5 )* (5x7) you output is basically a 7x7 matrix. so for each vocab word you have one vector of size 1x7 representing it. Also I believe window size does not mean feature vector it just means that how many words you are sampling before and after the context word. It is ultimately the final layer output dimensions which would have the embeddings. For e.g. last hidden layer is of size (7x512) you would get (7x7) * (7*512) which would give you embeddings of 7x512.

[@BenASabu]

I am not sure , but i think its not a matrix multiplication , if its analogus to matrix multiplication then what you said seems to be correct,

[@mudumbypraveen3308]

@@BenASabu it is always matrix multiplications in deep learning unlike classical ML algos.

[@BenASabu]

@@mudumbypraveen3308 bro could you please explain me how the initial 7*5 matrix come for each input word and , like how does the machine is able to attain the concept of feature representation in training

[@abhisheksharmac3p0]

yup even i didnt understood the last segment, it became hotch potch

[@swagatsanketpriyadarsan6231]

Can you please put out videos for computer vision. DL_CV

[@booksagsm]

Is this the first video lecture on nlp

[@raviv1752]

kzbin.info/aero/PLZoTAELRMXVNNrHSKv36Lr3_156yCo6Nn

[@apurvaxyz]

No

[@booksagsm]

@@apurvaxyz do you have the entire nlp link by any chance

[@everythingprohd1270]

@@booksagsm Here's the playlist kzbin.info/aero/PLZoTAELRMXVMdJ5sqbCK2LiM0HhQVWNzm

[@venkyramakrishnan5712]

Like your videos and earnest style of speaking, But I was confused about king - man + queen = woman Logically this seems more correct ? King - man + woman = queen ?

[@encianhoratiu5301]

Window size doesn't give the embedding dimension.

[@cricjack9076]

Hello sir please reply every video I put a comment about data science course but you don't reply?

[@CARevanthkumar]

i want ML models more efficiency that project link

[@abhisheksharmac3p0]

last portion was confusing

[@frankstern5270]

This is not a good content to learn word2vec. His conception is not clear

[@naveenkuruvinshetti6610]

Too many ada

[@prateekcaire4193]

wrong in many ways. window size and feature dimensions need not same. word2Vec is 2 layered NN. here only one layer is shown. Overall poorly explained

[@KushalSharma]

I do agree brother! It is wrongly explained

[@Umariqbal-kp1nz]

Deep learning road map