BERT Neural Network - EXPLAINED!

  Рет қаралды 370,713

CodeEmporium

CodeEmporium

Күн бұрын

Understand the BERT Transformer in and out.
Follow me on M E D I U M: towardsdatascience.com/likeli...
Please subscribe to keep me alive: kzbin.info...
PLAYLISTS FROM MY CHANNEL
⭕ Reinforcement Learning: • Reinforcement Learning...
Natural Language Processing: • Natural Language Proce...
⭕ Transformers from Scratch: • Natural Language Proce...
⭕ ChatGPT Playlist: • ChatGPT
⭕ Convolutional Neural Networks: • Convolution Neural Net...
⭕ The Math You Should Know : • The Math You Should Know
⭕ Probability Theory for Machine Learning: • Probability Theory for...
⭕ Coding Machine Learning: • Code Machine Learning
MATH COURSES (7 day free trial)
📕 Mathematics for Machine Learning: imp.i384100.net/MathML
📕 Calculus: imp.i384100.net/Calculus
📕 Statistics for Data Science: imp.i384100.net/AdvancedStati...
📕 Bayesian Statistics: imp.i384100.net/BayesianStati...
📕 Linear Algebra: imp.i384100.net/LinearAlgebra
📕 Probability: imp.i384100.net/Probability
OTHER RELATED COURSES (7 day free trial)
📕 ⭐ Deep Learning Specialization: imp.i384100.net/Deep-Learning
📕 Python for Everybody: imp.i384100.net/python
📕 MLOps Course: imp.i384100.net/MLOps
📕 Natural Language Processing (NLP): imp.i384100.net/NLP
📕 Machine Learning in Production: imp.i384100.net/MLProduction
📕 Data Science Specialization: imp.i384100.net/DataScience
📕 Tensorflow: imp.i384100.net/Tensorflow
REFERENCES
[1] BERT main paper: arxiv.org/pdf/1810.04805.pdf
[1] BERT in google search: blog.google/products/search/s...
[2] Overview of BERT: arxiv.org/pdf/2002.12327v1.pdf
[4] BERT word embeddings explained: / why-bert-has-3-embeddi...
[5] More details of BERT in this amazing blog: towardsdatascience.com/bert-e...
[6] Stanford lecture slides on BERT: nlp.stanford.edu/seminar/deta...

Пікірлер: 327
@CodeEmporium
@CodeEmporium Жыл бұрын
For details and code on building a translator using a transformer neural network, check out my playlist "Transformers from scratch": kzbin.info/www/bejne/h3Stgnpqedp7ipI
@AmandeepSingh-xk4yv
@AmandeepSingh-xk4yv 4 жыл бұрын
Just watched a video on Transformers, and now this. Am astounded at how you explained such complex notions with such ease! Hugely underrated channel!
@CodeEmporium
@CodeEmporium 4 жыл бұрын
Thanks a lot! Glad you liked it 😊
@brilliantdirectoriestraining
@brilliantdirectoriestraining 3 жыл бұрын
I have studied for several years AI, NPL and Neural networks. But the way you explained this was lovely, friendly and very simple which is why I am pretty sure you are BERT
@andrewlai3358
@andrewlai3358 3 жыл бұрын
Thank you for the explanation. You really have a knack for explaining NLP concepts clearly without losing much fidelity. Please keep posting!
@jeenakk7827
@jeenakk7827 3 жыл бұрын
I wish I had come across this channel earlier. You have a wonderful skill in explaining complicated concepts. I love your "3 pass" approach!!
@mauriciolandos4712
@mauriciolandos4712 11 ай бұрын
Best explanator on youtube, you have a good mix of simplifying so it can be understood, but not overly simplifying so we learn deeply enough. The idea of having 3 passes going deeper was a great idea as well.
@ankit_khanna
@ankit_khanna 3 жыл бұрын
One of the best videos on BERT. Great work! Wishing you loads of success!
@dannysimon2965
@dannysimon2965 4 жыл бұрын
Wow, thanks!! I tried watching many videos and couldn't understand a single thing. But yours was truly concise and informative.
@maverick3069
@maverick3069 3 жыл бұрын
The multiple passes of explanation is an absolutely brilliant way to explain! Thanks man.
@rashmikuchhal5339
@rashmikuchhal5339 3 жыл бұрын
I always watch your videos and appreciate the efforts you put to make the complicated topics so easy and clear. Thankyou for all your work. I really like the way you explain in 3 passes.... great work
@MarketingLeap
@MarketingLeap 3 жыл бұрын
Loved how you explained BERT really well. Great job!
@user-qx3jn9ii7s
@user-qx3jn9ii7s 3 жыл бұрын
Hey, your explantation and presentation on complicated concepts made me clear about TF and BERT. I will expect you to upload more exciting videos.
@abhikc8108
@abhikc8108 3 жыл бұрын
Great explanation, I really like the three pass idea it breaks down a lot of complications to simple concepts.
@BogdanSalyp
@BogdanSalyp 3 жыл бұрын
Extremely underrated channel, didn't find any other good explanation on KZbin/Medium/Google
@madhubagroy
@madhubagroy 2 жыл бұрын
The BEST explanation on BERT. Simply outstanding!
@Kumar08
@Kumar08 3 жыл бұрын
Fantastic explanation, Covered each and every point in the BERT. Looking forward for more videos on NLP.
@usamahussain4461
@usamahussain4461 2 жыл бұрын
Phenomenal the way you condense such a complicated concept into a few minutes, clearly explained.
@CodeEmporium
@CodeEmporium Жыл бұрын
Thanks so much for the compliments:)
@amreshgiri
@amreshgiri 3 жыл бұрын
Probably the best (easiest to understand in one go) video on BERT. Thanks ❤️
@NadavBenedek
@NadavBenedek 2 жыл бұрын
I love the "pass1" "pass2" concept of how you explain things. It's great.
@healthertsy1863
@healthertsy1863 8 ай бұрын
Don't hesitate, this is the best video of BERT explanation for sure!
@aruncjohn
@aruncjohn 3 жыл бұрын
Excellent explanation!. Will never miss a video of yours from now on!
@NachoProblems
@NachoProblems 7 ай бұрын
Do you realize you are the only good description of how exactly fine tuning works I have found, and I've been researching for months. Thank you!!!
@CodeEmporium
@CodeEmporium 7 ай бұрын
You are too kind. Thank you for the donation. You didn’t have to bug it is appreciated. Also super glad this content was useful! More of this to come
@noumaaaan
@noumaaaan 3 жыл бұрын
This explanation is pretty amazing! I have a presentation on this soon. Thank you so much!
@krishnaik06
@krishnaik06 3 жыл бұрын
Amazing Explanation :)
@doyourealise
@doyourealise 3 жыл бұрын
big fan sir
@richarda1630
@richarda1630 3 жыл бұрын
hear hear! so agree!
@User-nq9ee
@User-nq9ee 2 жыл бұрын
To teach us , you study and explore .. really grateful for your efforts Krish .
@indgaming5452
@indgaming5452 Жыл бұрын
Where there is krish sir... I will come there. .... Sir I found u here also... We are learning together 😇
@itsme1674
@itsme1674 Жыл бұрын
Nice to meet you sir
@AbdulWahab-cy9ib
@AbdulWahab-cy9ib 3 жыл бұрын
Was struggling to understand the basics of BERT after going through Transformer model. This video was indeed helpful.
@prasannabiswas2727
@prasannabiswas2727 3 жыл бұрын
I read many blogs on BERT but they were more focused on how to use BERT rather than what actually BERT is?. This video helped me clear all my doubts regarding how Bert is trained. Clear and concise explanation.
@ziangtian
@ziangtian Жыл бұрын
OMG!!!! This vid is a life-saver! just elucidated so many aspects of NLP to me (a 3 month beginner who still understands nothing
@josephselwan1652
@josephselwan1652 2 жыл бұрын
Amazing stuff. For visualization purposes, when you get into a deeper pass, I would recommend always adding the zooming effect for intuitive understanding. I am not sure about others, but when you do that, I instantly know "OK, now we are within this 'box' "
@CodeEmporium
@CodeEmporium 2 жыл бұрын
Good thought. I'll try to make this apparent in the future. Thanks!
@LoLelfy
@LoLelfy 3 жыл бұрын
Omg your videos are so good! So happy I found your channel, I'm binge watching everything :D
@CodeEmporium
@CodeEmporium 3 жыл бұрын
Glad you found my channel too! Thank you! Hope you enjoy them!
@xJFGames
@xJFGames Жыл бұрын
I'm honestly amazed of how you managed to transform a complex algorithm in a simple 10 minutes video. Much thanks to you, my final thesis appreciates you.
@CodeEmporium
@CodeEmporium Жыл бұрын
Hahaha anytime ):
@Deddiward
@Deddiward 3 жыл бұрын
Wow I've just discovered your channel, it's full of resources, very nice!
@mohamedsaaou9258
@mohamedsaaou9258 4 жыл бұрын
Wonderful, and the best explanation of BERT ever :) , Good Job , and big thank you !
@ruyanshou805
@ruyanshou805 3 жыл бұрын
Well explained! I have been looking for something like this for quite long!
@sajaal-dabet148
@sajaal-dabet148 3 жыл бұрын
This is amazing! Crystal clear explanation, thanks a lot.
@ydas9125
@ydas9125 Жыл бұрын
I am very impressed by the clarity and core focus of your explanations to describe such complex processes. Thank you.
@CodeEmporium
@CodeEmporium Жыл бұрын
You are very welcome. Thanks for watching and commenting :)
@andymoses95
@andymoses95 4 жыл бұрын
The one which I was looking for the past 6 months.! Thanks a lot for making this.
@CodeEmporium
@CodeEmporium 4 жыл бұрын
I'm late. But. Here now!
@bidyapatip
@bidyapatip 3 жыл бұрын
After reading lot of blogs, videos, I understood its so difficult network. But after going through this, I feel so easy to understand BERT(and its varient available in transformer library)
@felixakwerh5189
@felixakwerh5189 3 жыл бұрын
great video, i like the 3-pass method you used to explain the concepts
@michaelherrera4450
@michaelherrera4450 3 жыл бұрын
Dude this video is incredible. I cannot express how good you are at explaining
@CodeEmporium
@CodeEmporium 3 жыл бұрын
Thanks for watching! Super glad it is useful
@path1024
@path1024 Жыл бұрын
Good try though!
@akhileshpandey123
@akhileshpandey123 Жыл бұрын
Always come back to your explanation whenever want to refresh bert concepts. Thanks for the effort.
@CodeEmporium
@CodeEmporium Жыл бұрын
Thanks for the super kind words :)
@pathuri86
@pathuri86 Жыл бұрын
Excellent and concise explanation. Loved it. Thanks for this fantastic video.
@rohanmirchandani9726
@rohanmirchandani9726 3 жыл бұрын
This is one of the best resources explaining BERT available online.
@somerset006
@somerset006 9 ай бұрын
Nice job, man! Especially the multi-phase approach of explaining things, top to bottom.
@CodeEmporium
@CodeEmporium 9 ай бұрын
Super happy you liked the approach. Thanks for commenting
@keyrellousadib6124
@keyrellousadib6124 Жыл бұрын
This is an excellent summary. Very clear and super well organized. Thanks very much
@CodeEmporium
@CodeEmporium Жыл бұрын
Thank you so much for watching ! And for the wonderful comment :$
@naveen6630
@naveen6630 3 жыл бұрын
Hey. Your playlists are great. Also, the BERT explanation was excellent by the way. I am having a thought of working with farm-haystack using flask, dockers, and BERT. So I wonder whether if it's kind of the same you have explained, if not could you share your knowledge on that with me. Thank you.
@erfanshayegani3693
@erfanshayegani3693 Жыл бұрын
Every time I watch this video I gain a better understanding of the procedure. Thanks a lot for the great content!!!
@CodeEmporium
@CodeEmporium Жыл бұрын
Anytime! Look forward for more
@arvindvasudevan45
@arvindvasudevan45 3 жыл бұрын
Excellent articulation of the concept. Thank you.
@TSP-NPC
@TSP-NPC 11 ай бұрын
Thanks for the great explanation of Transformers and the architecture of BERT.
@CodeEmporium
@CodeEmporium 11 ай бұрын
My pleasure and thank you for the super thanks :)
@pallavijog912
@pallavijog912 3 жыл бұрын
Wow.. just switched from another BERT explained video to this.. stark difference.. excellent explanation indeed.. thanks..
@jx7433
@jx7433 2 ай бұрын
Excellent Explanation! Thank you!
@pratyushnegi4082
@pratyushnegi4082 2 жыл бұрын
Thanks for explaining this in such a simple way :)
@urd4651
@urd4651 2 жыл бұрын
thank you for sharing the video! very clear and helpful!!
@deepeshkumar4945
@deepeshkumar4945 Жыл бұрын
dude , you are amazing , you explained the state of the art NLP model , in such a well explained and concise video . Thanks a ton for this video !!!!!!
@CodeEmporium
@CodeEmporium Жыл бұрын
You are super welcome. Thanks so much for commenting this!
@agustindiaz3361
@agustindiaz3361 3 жыл бұрын
Your videos are great! Amazing work
@TheMehrdadIE
@TheMehrdadIE 3 жыл бұрын
Awesome! How simple you explain these models :)
@gauravsahani2499
@gauravsahani2499 3 жыл бұрын
Loved the explanation, Sir!
@akashsaha3921
@akashsaha3921 3 жыл бұрын
Well explained. Short and to the point
@mays7n
@mays7n 10 ай бұрын
this must be one of the best explanation videos on the internet, thank you!
@CodeEmporium
@CodeEmporium 10 ай бұрын
You are very welcome :)
@magelauditore333
@magelauditore333 3 жыл бұрын
Such a underrated channel. Keep it up man
@20.nguyenvongockhue80
@20.nguyenvongockhue80 Ай бұрын
wow AMAZING EXPLAINATION. Thank you very much
@ilyasaroui7745
@ilyasaroui7745 4 жыл бұрын
Good touch to put the references on the description instead of on the slides
@seeunkim4185
@seeunkim4185 Жыл бұрын
Thank you so much for the clear explanation, I get the grip of the BERT now!
@prathyusha5393
@prathyusha5393 3 жыл бұрын
Thanks a bunch for these wonderful videos!
@harshavardhany2970
@harshavardhany2970 3 жыл бұрын
Simple and clear explanations (which shows you know what you're talking about). And cool graphics. Will be back for more videos :)
@CodeEmporium
@CodeEmporium 3 жыл бұрын
Thanks! Keep tuning in!
@arturjaroszewicz8424
@arturjaroszewicz8424 2 ай бұрын
Beautiful explanation!
@aitrends8901
@aitrends8901 2 жыл бұрын
Very nice high level understanding of Transformers...
@jan-rw2qx
@jan-rw2qx Жыл бұрын
First half is exactly how much I need to understand right now, thank you :)
@CodeEmporium
@CodeEmporium Жыл бұрын
Awesome! You are very welcome!
@themaninjork
@themaninjork 3 жыл бұрын
Your Videos are very well explained !
@rizwanulhoqueratul4811
@rizwanulhoqueratul4811 3 жыл бұрын
Thank you for the reference links!
@snowglade1
@snowglade1 3 жыл бұрын
Hey this is an exceptional training video.
@goelnikhils
@goelnikhils Жыл бұрын
Excellent Explanation. Main thing to note is the finer point around explanation/mention of the loss functions that BERT uses. As not many other videos on same topic cover this. Tood Good
@CodeEmporium
@CodeEmporium Жыл бұрын
Thanks so much :)
@nooshnabi9248
@nooshnabi9248 2 жыл бұрын
Great Video! So easy to follow!
@mohsennayebi86
@mohsennayebi86 2 жыл бұрын
Amazing Explanation! I am speechless :)
@JP-gk6pi
@JP-gk6pi 3 жыл бұрын
3 pass explanation is a really good approach to explain this complex concept. Best video on BERT
@beteaberra631
@beteaberra631 2 жыл бұрын
Great video! But what is pass 1, pass 2 and pass 3?
@BiranchiNarayanNayak
@BiranchiNarayanNayak 4 жыл бұрын
Best explanation i have seen so far on BERT.
@CodeEmporium
@CodeEmporium 4 жыл бұрын
I thank you kindly ;)
@dipanjanghosal6164
@dipanjanghosal6164 4 жыл бұрын
Thanks for such a nice overview .. Very well done animation which augments the understanding further.. Maybe you could have touched on Roberta here and the differences. May be a separate video for that?
@CodeEmporium
@CodeEmporium 4 жыл бұрын
Thanks! Roberta is on my list. Wasn't kidding when I said there is a lot on Bert. Will make that in another video
@maryamaziz3841
@maryamaziz3841 3 жыл бұрын
Thanks for wonderful explanation for bert architecture 🍀🌹
@aashnavaid6918
@aashnavaid6918 2 жыл бұрын
thank you so very much! one video was enough to get the basics clear
@CodeEmporium
@CodeEmporium 2 жыл бұрын
Glad! Welcome!
@beingnothing34
@beingnothing34 3 жыл бұрын
Amazing. Thanks a lot. You really **demystify** !!
@dhananjaysonawane1996
@dhananjaysonawane1996 3 жыл бұрын
@11:08 Please go on forever :):D... the best explanation I have seen so far, Thanks man!
@ngavu8750
@ngavu8750 Жыл бұрын
So simple and easy to understand, thanks a lot
@CodeEmporium
@CodeEmporium Жыл бұрын
Super glad this was useful :)
@nehccc
@nehccc 7 ай бұрын
very good explanation! thank you!
@gauravchatterjee794
@gauravchatterjee794 3 жыл бұрын
Best Explanation by far!
@renosyaputra
@renosyaputra 3 жыл бұрын
Thank you, clear and direct explanation
@dupontremi5638
@dupontremi5638 Жыл бұрын
great explanation, I understood everything ! thanks a lot
@CodeEmporium
@CodeEmporium Жыл бұрын
Thanks so much for watching and commenting :)
@jeflee2787
@jeflee2787 3 жыл бұрын
Thanks man! Great work!
@caoshixing7954
@caoshixing7954 4 жыл бұрын
Very good explanation, Easy to understand! Come on!
@She_cooks2023
@She_cooks2023 3 ай бұрын
Amazing explanation !!
@rodrigomaldonado5280
@rodrigomaldonado5280 3 жыл бұрын
new subscriber, amazing explanation!
@srinivasanthiruvengadathan2177
@srinivasanthiruvengadathan2177 4 жыл бұрын
Excellent Explanation. Thanks
@alidi5616
@alidi5616 2 жыл бұрын
That's it. The best explanation i came through. Receive my upvote and subscription 😁
@CodeEmporium
@CodeEmporium 2 жыл бұрын
Many thanks. Join the discord too :3
@venupunna9940
@venupunna9940 3 жыл бұрын
Thank you for the wonderful content...
@fahnub
@fahnub 9 ай бұрын
Thank you so much for these videos.
@CodeEmporium
@CodeEmporium 9 ай бұрын
You are welcome! Thanks so much for commenting! Really appreciate it :)
@namanbhayani1016
@namanbhayani1016 3 жыл бұрын
Very well explained!
@MrsMarsis
@MrsMarsis 3 жыл бұрын
this is amazing, thank you very much!
@findingx152
@findingx152 9 ай бұрын
great explanation.. Thanks !!
@AhmedHefny--
@AhmedHefny-- 3 жыл бұрын
that`s really amazing explanation thanks a lot
@pushkarparanjpe
@pushkarparanjpe 11 ай бұрын
Excellent top level view! Thanks.
@CodeEmporium
@CodeEmporium 11 ай бұрын
You are very welcome :)
@yunlongsong7618
@yunlongsong7618 Жыл бұрын
Excellent explanation
@sathyakumarn7619
@sathyakumarn7619 2 жыл бұрын
Not bad! Loved the video. Please add a little bit of more explanation for upcoming vids if preferrable.
GPT - Explained!
9:11
CodeEmporium
Рет қаралды 39 М.
Transformer Neural Networks - EXPLAINED! (Attention is all you need)
13:05
Sigma Girl Education #sigma #viral #comedy
00:16
CRAZY GREAPA
Рет қаралды 7 МЛН
Como ela fez isso? 😲
00:12
Los Wagners
Рет қаралды 9 МЛН
ХОТЯ БЫ КИНОДА 2 - официальный фильм
1:35:34
ХОТЯ БЫ В КИНО
Рет қаралды 1,3 МЛН
Stupid man 👨😂
00:20
Nadir Show
Рет қаралды 29 МЛН
Sentence Transformers - EXPLAINED!
17:51
CodeEmporium
Рет қаралды 25 М.
BERT for pretraining Transformers
15:53
Shusen Wang
Рет қаралды 11 М.
How I'd Learn AI (If I Had to Start Over)
15:04
Thu Vu data analytics
Рет қаралды 655 М.
Transformers, explained: Understand the model behind GPT, BERT, and T5
9:11
Embeddings - EXPLAINED!
12:58
CodeEmporium
Рет қаралды 4,3 М.
But what is a neural network? | Chapter 1, Deep learning
18:40
3Blue1Brown
Рет қаралды 16 МЛН
What is BERT and how does it work? | A Quick Review
8:56
AssemblyAI
Рет қаралды 44 М.
Sigma Girl Education #sigma #viral #comedy
00:16
CRAZY GREAPA
Рет қаралды 7 МЛН