A Complete Overview of Word Embeddings

  Рет қаралды 115,014

AssemblyAI

AssemblyAI

Күн бұрын

Пікірлер: 184
@originalmianos
@originalmianos Жыл бұрын
There are maybe 30 videos on this topic and this is the only one that does not suddenly make a massive jump across whole concepts that the presenter knows but the watcher does not.
@impracticaldev
@impracticaldev 2 жыл бұрын
Would love a video on ELMo further. Thanks for all this!
@ozgurak1840
@ozgurak1840 2 жыл бұрын
Thank you. It is very clear and informative, though i really think you (AssemblyAI) should lose the music on the background; it is distracting and it gives the whole thing an infomercial feeling.
@nirash8018
@nirash8018 Жыл бұрын
Somehow the music had a motivational influence for me. I caught myself vibing to it a few times
@rangi500
@rangi500 6 ай бұрын
I would love the no-music option too.
@marten9334
@marten9334 11 ай бұрын
amazing video. Perfectly clear speech, good explanations, logical visualisations and the background music makes it a lot easier to focus. Thank you!!
@manojjoshi1102
@manojjoshi1102 2 жыл бұрын
Excellent explanation. I did some study on this topic before coming here and the reason was because so many terms and concepts were quite overwhelming. I generally understood those but still missed the fine tuned clarity. After watching this video, most of what I read before started making a lot of sense. I highly recommend this video. Thank you so much.
@AssemblyAI
@AssemblyAI 2 жыл бұрын
This is great to hear! You are very welcome!
@deepaksingh9318
@deepaksingh9318 10 ай бұрын
Amazing Content.. Exactly what a learner wants .. to Have all the concepts in a single Video with easy to understand way in minimum time..
@KidistAmde
@KidistAmde Жыл бұрын
Excellent ! Thank you so much for making an absolutly clear explanation.
@husainahmed-w4w
@husainahmed-w4w Ай бұрын
Very informative and clear explanation
@TuhinBhattacharya
@TuhinBhattacharya 2 жыл бұрын
Awesome overview.. Loved it.. Waiting for videos explaining GloVe and Elmo..
@AssemblyAI
@AssemblyAI 2 жыл бұрын
Great to hear you liked it!
@johnpuopolo4413
@johnpuopolo4413 4 ай бұрын
Thanks for the explanation of word embeddings. Nicely done!
@Arriyad1
@Arriyad1 6 ай бұрын
Great explanation! Thank you! Pls. drop the music for next videos.
@ehichamu
@ehichamu Жыл бұрын
Very Good video. I second the other comments. PLEASE drop the music completely. It would increase the quality of the experience by at least 70%. I had hard time finishing the video because of the music
@AssemblyAI
@AssemblyAI Жыл бұрын
Thanks, will do!
@Kmmc2011
@Kmmc2011 2 жыл бұрын
Thanks for taking the time to break this down and share!
@AssemblyAI
@AssemblyAI 2 жыл бұрын
You are very welcome! - Mısra
@tanvirmahtab5931
@tanvirmahtab5931 Ай бұрын
Why are you so good? Where where you all this while? God bless you
@lavanyaseetharaman
@lavanyaseetharaman Жыл бұрын
simple and clear explanation. please explain Elmo, thanks
@augurelite
@augurelite Жыл бұрын
Wow such a good presenter. I really like the examples super clear. This stuff is amazing
@aayushregmi4334
@aayushregmi4334 2 ай бұрын
Simply the best 😊
@berkk1993
@berkk1993 Жыл бұрын
çok teşekkürler, bu kadar iyi anlatan başka video yok
@sajjaddehghani8735
@sajjaddehghani8735 2 жыл бұрын
great explanation. please explain elmo and other approaches. also please make a video about efficient ways of clustering the embeddings👍
@AssemblyAI
@AssemblyAI 2 жыл бұрын
Thank you Sajjad for the suggestion!
@glowwell4292
@glowwell4292 Жыл бұрын
Thanks dear. Nicely paced intro. Good for recap.
@AssemblyAI
@AssemblyAI Жыл бұрын
Glad you liked it
@diegovnoble
@diegovnoble 9 ай бұрын
Thanks for the video! I've enjoyed watching and liked the format and pace. I'd add the retrowave background to my playlist if I knew the name. I guess that people would note it less if the volume was lower.
@hadiloghman1572
@hadiloghman1572 2 жыл бұрын
great explanation. Please explain ELMO and GloVe. it was really great
@AssemblyAI
@AssemblyAI 2 жыл бұрын
Thank you for the suggestions!
@cimmik
@cimmik 11 ай бұрын
​@@AssemblyAII'd love to see those videos too
@cigdemtas997
@cigdemtas997 4 ай бұрын
Thank you for great explanation! Would love to see pre-trained word embeddings for sentiment analysis.
@captainmustard1
@captainmustard1 Жыл бұрын
top video for embedding introduction
@altantoksoz5999
@altantoksoz5999 Жыл бұрын
Great tutorial. She speaks like a native speaker. She looks like a Turkish girl, beautiful one :)
@tommyhuffman7499
@tommyhuffman7499 11 ай бұрын
The absolute best video I've seen on this topic!!
@draziraphale
@draziraphale 2 жыл бұрын
Excellent presentation. I will be teaching this topic to students shortly and will recommend this material.
@AssemblyAI
@AssemblyAI 2 жыл бұрын
Great to hear, thank you!
@estelitaribeiro4196
@estelitaribeiro4196 8 ай бұрын
Thanks! Great information in a very objective way!
@yuanjunren5220
@yuanjunren5220 10 ай бұрын
amazing video!!!❣❣❣ Thanks for sharing
@AhmedKhaliet
@AhmedKhaliet Жыл бұрын
Thank youuuu it's my first video but I guess I should make your video my periorties I'm NLP thanks alot❤
@lahiru954
@lahiru954 Жыл бұрын
Great explanation! I went through the topics hours of hours. But this channel saved my time. And on target.
@AssemblyAI
@AssemblyAI Жыл бұрын
Great to hear!
@idrissnguepi7842
@idrissnguepi7842 Жыл бұрын
Very nice explanation of embedding concept, Would love to see pre-trained word embeddings for sentiment analysis.
@michaelng3126
@michaelng3126 Жыл бұрын
This was awesome. Would love to see Elmo video and sentiment analysis video you mentioned possibly making!
@bibhutibaibhavbora8770
@bibhutibaibhavbora8770 Жыл бұрын
Great and very illustrative video
@TravelWithSalsa
@TravelWithSalsa 6 ай бұрын
Thank you. Very good and complete explanation.
@ShubhamDasCoder
@ShubhamDasCoder 2 жыл бұрын
Great explanation in less amount of time. Really liked the video.
@AssemblyAI
@AssemblyAI 2 жыл бұрын
That's great to hear!
@nogur9
@nogur9 Жыл бұрын
It's a really good explanation, thank you very much :)
@AssemblyAI
@AssemblyAI Жыл бұрын
You are welcome!
@whifflingtove
@whifflingtove 2 жыл бұрын
Very interested in an in depth explanation of ElMo
@leo-phiponacci
@leo-phiponacci 6 ай бұрын
Thank you, I want to ask if there are any techniques that use Hidden Markov Models to represent the embeddings?
@emandiab9524
@emandiab9524 Жыл бұрын
Thanks that helped a lot.
@AssemblyAI
@AssemblyAI Жыл бұрын
Glad it helped
@maysammansor
@maysammansor 6 ай бұрын
would love to see a video on building Elmo Embedding model. Thanks for this one
@dalehu5606
@dalehu5606 Жыл бұрын
Clear explanation! 👍
@AssemblyAI
@AssemblyAI Жыл бұрын
Glad you think so!
@jeremymarkson1423
@jeremymarkson1423 2 жыл бұрын
Would be great to see a video on Elmo!
@AssemblyAI
@AssemblyAI 2 жыл бұрын
Thank you for the suggestion, noted!
@nikitamalviya692
@nikitamalviya692 Жыл бұрын
Very well explained!! Thank you so much
@AssemblyAI
@AssemblyAI Жыл бұрын
You're welcome!
@soheiltehrani3792
@soheiltehrani3792 2 жыл бұрын
Great visual, Great Voice , Good pace of presentation . Everything is awesome in this video. thanks for sharing :D
@AssemblyAI
@AssemblyAI 2 жыл бұрын
Thank you for the nice words Soheil! Glad it was helpful!
@danielcanedo5240
@danielcanedo5240 Жыл бұрын
I'm your fan already, please make an ELMo video....!!!
@AssemblyAI
@AssemblyAI Жыл бұрын
Thank you for the suggestion!
@Harduex
@Harduex 11 ай бұрын
Great videos there, thank you for your content and keep up the good work!
@kfirgollan
@kfirgollan Жыл бұрын
Great explanation! Thanks for sharing
@MohamedElGhazi-ek6vp
@MohamedElGhazi-ek6vp Жыл бұрын
Excellent Explanation. I have one question please how could I fit my model with this embedding vectors cause for Example in one of my projects for extracting informations from fils. instead of using texts for training my models I thinked of using embedding but I don't know the best way to represent them to my model . I hope u understand my question and thank you.
@toshyamg
@toshyamg Жыл бұрын
Great job 👍
@vigneshpadmanabhan
@vigneshpadmanabhan Жыл бұрын
Well explained ! Thanks a lot
@hileamlakyitayew9450
@hileamlakyitayew9450 Жыл бұрын
Awesome video!!
@yusufkemaldemir9393
@yusufkemaldemir9393 Жыл бұрын
Interested in “Creating your own embedding before doing binary or multi label classification prediction”! Thanks for the clarity.
@JayTheMachine
@JayTheMachine Жыл бұрын
thnak you soo much, amazing explaination and you beautiful
@investime247
@investime247 Жыл бұрын
Thank u very clear. Need to know how to use word embedding for text classification
@shubham-pp4cw
@shubham-pp4cw 2 жыл бұрын
nice video on word embedding keep it upp.............
@AssemblyAI
@AssemblyAI 2 жыл бұрын
Thank you!
@mreddy7356
@mreddy7356 2 ай бұрын
you are very fast to capture for brginners
@dessiabdelkerym5612
@dessiabdelkerym5612 Жыл бұрын
Thanks for the explanation please try to make a video about how ELMOS works
@AliZaki1401
@AliZaki1401 Жыл бұрын
Great work !! Can you make a video on Elmo and Transformer-based word embeddings ???
@AssemblyAI
@AssemblyAI Жыл бұрын
Great suggestion!
@r.walid2323
@r.walid2323 2 жыл бұрын
Great explanation
@AssemblyAI
@AssemblyAI 2 жыл бұрын
Thank you!
@ali75988
@ali75988 Жыл бұрын
8:15 i am having problem with the sentence "no of neurons in hidden layer = size of embedding". i am confused what is size of embedding?
@iravkr
@iravkr 2 жыл бұрын
Your pretty face holds my concentration, and thus I understand anything taught by you, especially transformer, more than any other youtube video..Thank you so much for such videos...indebted!
@HashimWarren
@HashimWarren 8 ай бұрын
Very clear, thank you
@lbognini
@lbognini Жыл бұрын
From the embeddings of your name, I removed those of "work", added "great" and "relationship" and I came up with the embeddings of my own name? How come? Mere coincidence? 🤔🤔 Great video, btw!
@bahadrcaya625
@bahadrcaya625 Ай бұрын
Much appreciated for the awesome cristal clear explanation. However, (just a little detail) could you lower the background music ? It's kinda distracting for me.Actually I feel like waiting for a customer service on the phone. If there is anyone who feel same way, please let me know guys!
@AnthonyForde-l6o
@AnthonyForde-l6o Жыл бұрын
Brilliant video, as always, thanks so much. Would love to see your suggested follow on using pre-trained word embeddings for sentiment analysis if you ever have time 🙂
@RiccardoCarlessoGoogle
@RiccardoCarlessoGoogle Жыл бұрын
This is amazing. Can you share the python notebook you show at 12m33s?
@smudgepost
@smudgepost Жыл бұрын
Yes - to all videos you suggest making! Great guide thank you.. was struggling to see value in lemmatization and concerned a bout a loss of coherence. Seeing several worked examples are great. Interested how the final results were all different but all had similarly high percentage match. How do you tackle this?
@davidheilbron
@davidheilbron Жыл бұрын
Great! Thanks
@AssemblyAI
@AssemblyAI Жыл бұрын
You're welcome!
@Abdullahkbc
@Abdullahkbc 8 ай бұрын
finally, somebody proved the king-queen thing :D
@hamitguner
@hamitguner 11 ай бұрын
Thank you
@PaulFishwick
@PaulFishwick 5 ай бұрын
Do you have a link to the Python notebook you go over at the end?
@praveenbehara
@praveenbehara 2 жыл бұрын
Hi.. thank you for the video.. great introduction and also a practical example.. One request is to drop or reduce the intensity of the music. It was distracting.
@AssemblyAI
@AssemblyAI 2 жыл бұрын
Noted! Thank you for the feedback Praveen
@javidjamae
@javidjamae Жыл бұрын
Yes, great video but music is definitely too loud and distracting! It's really hard to concentrate on what you're saying.
@HikmetYolcusu
@HikmetYolcusu Жыл бұрын
Why is there a background soundtrack during the lecture? Does it help with learning or focus? I find it kinda distracting and feel rushed.
@jtauber
@jtauber Жыл бұрын
I love that all your examples are Lord of the Rings quotes because I run the Digital Tolkien Project which applies computational text analysis techniques to the works of Tolkien :-)
@AssemblyAI
@AssemblyAI Жыл бұрын
That's amazing! Nice to meet you! Huge Tolkien fan here. :)
@jtauber
@jtauber Жыл бұрын
@@AssemblyAI you should join the Digital Tolkien Project!
@SidIndian082
@SidIndian082 Жыл бұрын
@@AssemblyAI Pls provide the notebook code .. thnx
@mariussame9357
@mariussame9357 Жыл бұрын
Thanks for the video I do have a question when you said that for instance in the CBOW there is only one layer it means that the ouput of this layer should be a vector of size dimension of the embedding but in order to train the model we need to compaire this output with the word in the midlle which is actually a one hot encoded vector of size dimension of the vocabulary so it migth have another layer and a softmax.
@automatster
@automatster 2 жыл бұрын
Great video. Thanks for sharing it. It would be great if you do a task like train sentiment analysis model with word embedding and share with us.
@ShaikRaasikha21
@ShaikRaasikha21 11 ай бұрын
Video on Training a sentiment analysis model please
@user-wr4yl7tx3w
@user-wr4yl7tx3w Жыл бұрын
Can the embeddings from Transformer be used elsewhere, like with Word2Vec?
@MartinJohannesNilsen
@MartinJohannesNilsen Жыл бұрын
Great video! As for your analogy, I would guess that changing cocktail to bar would indeed give you cocktail. The analogy of having dinner at a restaurant, is not matching to having bar at cocktail.
@j0nrages
@j0nrages 2 жыл бұрын
Is there a sentiment training model video that builds from this? Trying to build a recommendation system based on candidate sentences and a job description
@AssemblyAI
@AssemblyAI 2 жыл бұрын
We don't have that video yet but thank you for the suggestion!
@abdelazizkhalid4231
@abdelazizkhalid4231 Жыл бұрын
is there a video about sentiment analysis yet?
@user-wr4yl7tx3w
@user-wr4yl7tx3w 2 жыл бұрын
be great to see a video on Elmo.
@jenot7164
@jenot7164 Жыл бұрын
How large should data for a custom embedding be and is it possible to utilize a GPU for the creation of a word embedding vector space?
@lemoniall6553
@lemoniall6553 2 жыл бұрын
if we have a sentence "vishy eat bread". then we vectorize the word "eaat"(misspelled word), why does fasttext see that the word "eaat" is more similar to the word "eat"?. How is the architecture?, is it possible for fasttext without using skipgram to be able to classify words?. Thanks
@cimmik
@cimmik 2 жыл бұрын
Would it be possible to use word embedding to ask if a text is about a certain topic (or rather to what degree a text is about a topic)?
@HappyDataScience
@HappyDataScience Жыл бұрын
i would surely like to learn elmo guessing that chatgpt used the same correct me if i'm wrong 🙇🏻‍♂️
@TuhinBhattacharya
@TuhinBhattacharya 2 жыл бұрын
How do I know which embedding will be best choice for a specific use case? How do I know which distance measure will be best?
@pathikghugare
@pathikghugare 2 жыл бұрын
Depends on your use case, cuz lets say if your use case contains more in general words like tea, king, actor, etc. then you may try different embeddings and see for yourself which ones are working well for particular examples from your use case OR If your use case is quite specific, something like say representing skills as a vector then you may need to train your own word2vec model on your data since pretrained embeddings may not cover what you need
@m1k3ga
@m1k3ga Ай бұрын
I like how you present the topic and your way of explanation. But the background music is quite disturbing
@yigalirani308
@yigalirani308 Жыл бұрын
super helpful, but is there a version of this without the music?
@AssemblyAI
@AssemblyAI Жыл бұрын
Sorry about that! We got a lot of feedback in this. Let me see if we can upload without the music. :D
@YuhJerChang
@YuhJerChang 2 ай бұрын
Would like a video on elmo thanks
@joergbieri9701
@joergbieri9701 Жыл бұрын
Great content thanks. Due to a hearing problem I would appreciate it, if you could remove the backround music. Ok? Thanks
@hashemipeyman
@hashemipeyman 2 жыл бұрын
Great!
@AssemblyAI
@AssemblyAI 2 жыл бұрын
Thank you!
@__________________________6910
@__________________________6910 2 жыл бұрын
Noice !
@tamoghnamaitra9901
@tamoghnamaitra9901 Жыл бұрын
New crush added to life
@user-wr4yl7tx3w
@user-wr4yl7tx3w Жыл бұрын
Be interested in seeing a python example of Word2Vec.
@davidswearingen7571
@davidswearingen7571 Жыл бұрын
Another good video marred by the inclusion of unnecessarily loud music.
@lexflow2319
@lexflow2319 2 жыл бұрын
Do transformers from scratch. I heard they can be written in 50 lines. I would like to understand how bert encodes words
@EkShunya
@EkShunya 2 жыл бұрын
nice and crisp, just one suggestion "please remove background music", It is reductive to the viewers experience :)
@AssemblyAI
@AssemblyAI 2 жыл бұрын
Thank you! And noted!
@brunam7908
@brunam7908 Жыл бұрын
Waiting for the ELMo video.
How Language Models Choose the Next Word
9:00
AssemblyAI
Рет қаралды 1,3 М.
Transformers for beginners | What are they and how do they work
19:59
Word Embedding and Word2Vec, Clearly Explained!!!
16:12
StatQuest with Josh Starmer
Рет қаралды 354 М.
OpenAI Embeddings and Vector Databases Crash Course
18:41
Adrian Twarog
Рет қаралды 516 М.
What are Word Embeddings?
8:38
IBM Technology
Рет қаралды 23 М.
[1hr Talk] Intro to Large Language Models
59:48
Andrej Karpathy
Рет қаралды 2,3 МЛН
Vectoring Words (Word Embeddings) - Computerphile
16:56
Computerphile
Рет қаралды 300 М.
Transformers (how LLMs work) explained visually | DL5
27:14
3Blue1Brown
Рет қаралды 4,1 МЛН
Word Embeddings
14:28
macheads101
Рет қаралды 157 М.
The Biggest Misconception about Embeddings
4:43
ritvikmath
Рет қаралды 21 М.