What is BERT? | Deep Learning Tutorial 46 (Tensorflow, Keras & Python)

What is BERT (Bidirectional Encoder Representations From Transformers) and how it is used to solve NLP tasks? This video provides a very simple explanation of it. I am not going to go in details of how transformer based architecture works etc but instead I will go over an overview where you understand the usage of BERT in NLP tasks. In coding section we will generate sentence and word embeddings using BERT for some sample text.
We will cover various topics such as,
* Word2vec vc BERT
* How BERT is trained on masked language model and next sentence completion task
⭐️ Timestamps ⭐️
00:00 Introduction
00:39 Theory
11:00 Coding in tensorflow
Code: github.com/codebasics/deep-le...
BERT article: jalammar.github.io/illustrated...
Word2Vec video: • What is Word2Vec? A Si...
Do you want to learn technology from me? Check codebasics.io/?... for my affordable video courses.
Deep learning playlist: • Deep Learning With Ten...
Machine learning playlist: kzbin.info?list...
🔖Hashtags🔖
#bertmodelnlppython #tensorflowbert #tensorflowberttutorial #bert #bertneuralnetwork #bertdeeplearning #whatisbert #bertnlp #bertindeeplearning #bertmodel #bertmodelnlp
🌎 My Website For Video Courses: codebasics.io/?...
Need help building software or data analytics and AI solutions? My company www.atliq.com/ can help. Click on the Contact button on that website.
🎥 Codebasics Hindi channel: / @codebasicshindi
#️⃣ Social Media #️⃣
🔗 Discord: / discord
📸 Dhaval's Personal Instagram: / dhavalsays
📸 Instagram: / codebasicshub
🔊 Facebook: / codebasicshub
📱 Twitter: / codebasicshub
📝 Linkedin (Personal): / dhavalsays
📝 Linkedin (Codebasics): / codebasics
❗❗ DISCLAIMER: All opinions expressed in this video are of my own and not that of my employers'.

[@codebasics]

Do you want to learn technology from me? Check codebasics.io/ for my affordable video courses.

[@riselikeaphoenix451]

Hi.. Could you please upload a video for RoBERTa?

[@pateelhs7105]

😊😊😊😊😊😊😊😊​@@riselikeaphoenix451

[@meenakshimishra6111]

Thank you for explaining BERT. The pace and progression was extremely well executed.

[@EduljiBharucha]

Great stuff! You have a real knack for breaking down complex topics into simple, intuitive concepts. Thank you!

[@Manojrohtela]

they way you teach it is just awesome. I tried to learn topics from multiple source but your way is out of the box. Thank you so much.

[@azuriste8856]

I seldom watch programming videos with so enthusiasm.. that I don't realize it has come to an end ... good content.. keep it up.. and thanks..

[@korkmazkagan]

One of the best tutorials about BERT I've seen so far thanks :)

[@codebasics]

Part 2: Text classification using BERT: kzbin.info/www/bejne/emrcqqdsd8uad68

[@MurariMahaseth]

why private? if any error in the video then you can mark them in comments or edit even after published.

[@luiscao7241]

your effort and time for creating good videos are highly appreciated!

[@ankurkaiser]

absolutely brilliant video, had gone through several videos where they either show a general documentation and then move to some coding, or simply go deep into theory without making any sense, but this video cleared all of my doubts on Bert. The last 3-4 minutes makes the most sense, depth needed to crack any interview.

[@shih-shengchang19]

Very nice video! Shortly introduce the concepts, then jump into coding practice with detail explanation. I learned a lot during my following and experimenting the coding. Thanks. Can’t wait to explore more about the coming classes.

[@siddharthabhakta3261]

Very well explained. You really posses the ability to simplify the topics. Thank you s9 much.

[@meowpowervalorant]

Can't be much easier or better than this. Thank you for such a greare video and awesome explanation.

[@AashutoshGhimire]

Clear, practical, and essential insights. Thanks for the valuable information!

[@sowmyavivek4952]

Very simple and concise explanation!! Thanks so much :)

[@cryptoinvestigator5650]

YES!! DL series is being continued!!!! I can tell this is gonna be good.

[@sagarpadhiyar1943]

Superb Dhawal........By explaining with code, all doubt has been cleared now. Thank you so much

[@ahmetdikbayir6518]

Thank you so much. It is really great to help to newbies in NLP.

[@dineshjothiram3677]

Excellent Explanation Sir! Learned a lot. 👏Expecting more sir.

[@tarunjnv1995]

So helpful for quick understanding, thanks a lot!

[@yassienmasoud3822]

Thank you so much. I love the way you explain the codes.

[@SushantaKPani]

Thanks for this series on deep learning. Please consider having NLP deeplearnig series with PyTorch too.

[@sshubam]

Thank you so much Sir ! Your videos are very informative in a understandable way :D

[@mr.ashwinperti2150]

Really learning what is BERT. Great going

[@stylersimon1]

Everybody asking "What is Bert" but noone asking "How is Bert"

[@jagadeeshkumar7724]

Where is BERT

[@yakkalurusathvik2169]

Why is BERT

[@Ram_jagat]

who is bert

[@Mr.AIFella]

To whom is Bert concern?

[@sarmee7510]

Brilliant, made me understand the concepts at a go.

[@lpac8272]

Great video, filled many gaps I had in how BERT is used. Thank you!

[@codebasics]

Glad it helped!

[@timwetterau6168]

This video was key for me to understand the functionality of bert, its inputs and outputs. Keep that stuff on! You're amazing!

[@codebasics]

Glad it was helpful!

[@tylerpoore1487]

@@codebasics Love your stuff. Just an FYI @9:21 under the How was it trained slide, you have a typo (mased language model instead of masked language model) .

[@kmnm9463]

Hi Dhaval, This is the best Bert based text classification tutorials . Thanks from Krish

[@emmanuelakash8868]

Your teaching style and methodology is awesome. God bless you.

[@codebasics]

😊🙏🙏

[@wzyjoseph7317]

super consice explanation, ultra satafying while watching it, keep going!

[@satishb9975]

Sir, Thanks a lot, for this wonderful explanation on the BERT MODEL, no words to explain, your explanation is just awesome, 🙏

[@RHONSON100]

Great job. Nice and clear explanation.

[@sigangsabaglari3606]

Thank you so much, loved it. Very well explained.

[@idk____idk6530]

To the world, you may be just a teacher but to me, you are a hero! Wishing you a Happy Guru Purnima! I bow to the one who has inspired me and taught the right way of life! You are the inspiration who made me overcome every hurdle in python ❤️

[@codebasics]

😊😊 happy guru purnima 😊😊

[@yesimkocoglu2402]

Very nice video. You explain clearly and I have found solutions to questions in my mind

[@saeid8113]

Such a nice concise work. Thanks

[@Ch-br5cv]

Lo pondré en mi dedicatoria de tesis cuando lo termine, gracias por el video

[@moni1122331]

great explanation, easy and fantastic.

[@nitinvasava1421]

Informative and easy to learn ..... Keep adding videos

[@freedmoresidume]

This is awesome sir. I can't thank you enough

[@pankajaphalari1462]

You are my guru. Please keep guiding us.

[@mahalerahulm]

Hi Dhaval You are master !! Thank you very much for your teaching !!

[@addictivepuzzler]

You are the best... Thanks a ton for such a nice tutorial :)

[@ManishSharma-gp5ev]

Really so helpful. Thanks a lot Sir. 👍

[@mudsky]

i owe you for this. so well explained.

[@poojapatila5233]

Excellent explanation about BERT. The article which you suggested is awesome. Thank you soo much sir :)

[@codebasics]

yup that article is awesome.

[@EpicEatsZone]

Sir you made this look so easy

[@yohanesalbertlauwoto535]

Thankyou for your Explaination 😀😀😀😀, it's easier to understand from your video

[@dholakiyaparth]

Great Work. Thank you. Kudos to you man.

[@izelcavusoglu3539]

Thank you a lot, it simplified everything to me so well.

[@codebasics]

Glad it helped!

[@debabratasikder9448]

Thumbs up and subscribed. Thank you very much!

[@pratikshirbhate8026]

Very well explained. Thanks

[@ahmedelnahas2277]

You still my favorite instructor

[@jatayubaxi4553]

Excellent video.

[@bdoriandasilva]

Great video! thank you!

[@badiyabhargav8597]

Great Video sir Thank u so much❤️

[@vanshsamaiya431]

thanks sir for this great series

[@user-by8lo1my7k]

nice vidéo man ! thanks alot! the article from alamar too ! love from canada

[@yohannesbairu8299]

I really, really learn many new techniques from your video continue appreciate

[@codebasics]

Glad to hear that!

[@Breaking_Bold]

Very nicely explained !!!

[@joy2000cyber]

Exactly what I need!

[@palakbhatia2243]

Well explained 👍

[@arumoysaha4449]

nicely explained, thank you!

[@codebasics]

Glad it was helpful!

[@mohammedelsadiqbarmati8730]

THaaanks alot, it was a very helpful tutorial.

[@codebasics]

Glad it helped!

[@Sumonms]

Need a kind of teacher like you in Engineering university, Most of them can't trach properly. They judge by only exam.

[@manikant1990]

Great video super explanation this is useful for classifying sentences, what if I have conversations to classify, Where is conversation has multiple sentences, so how to classify a conversation into a particular class where a conversation has multiple sentences inside. The documentation of tenser flow explains how to classify sentences But not how to classify conversations in to a particular class

[@ChrisHalden007]

Great video. Thanks

[@neto212]

Congrats from Brazil! :)

[@quranmalayalam4dailylife]

super happy to give you a massive 👍🏻

[@aproperhooligan5950]

Great stuff, Sir.

[@rajm5349]

Thank u sir for explaining in sch a simple language

[@codebasics]

Glad you liked it

[@maheshreddy6871]

You are teaching in Nice manner. Can we have NER task Architecture explanation for Bert & How it is Working and some code for implementation of NER

[@md.rifatanwar3536]

Really helpful brother!!!!

[@AnuragKhareOracle]

really great content. It was really helpful.

[@codebasics]

Glad you think so!

[@pnaryozgatlozbilen445]

perfect tutorial

[@expoundingaboutmicrosoftaz8612]

👍Awesome explanation

[@raselkarim2731]

Really inspiring.

[@sMENDALAXMINARAYANA]

The G.O.A.T of teaching 😍

[@HabiburRahamaniit]

Respected Sir your videos are very good. I request your sir please cover the concepts of Attention Model and Transformer Model.

[@abdussamad9399]

Thank you so much.

[@kusicmusic]

You are awesome - have you covered Transformer architecture in any of your videos. Looking forward.

[@aditya.g6418]

code basics: I'm going to explain in simple language as if you were a high school student me( a high school student) : I see this as a absolute win

[@spider853]

Hey, very imformative video! Could you please make a video on how to use the BERT model for text question and answering locally? Thanks

[@yl95]

Dank je wel!

[@haithemkassem1306]

great work

[@skystars2091]

Excellent

[@trendyjewellery1987]

Superb

[@MrBapujinakka]

great effort

[@gsimore]

Thank you!

[@oftherecord5582]

I really appreciate your efforts. Kindly tell me BERT is supervised or Unsupervised machine learning method.

[@AI_Financier]

a great video! can we get an embedding for a corpus (as well as their word and sentence embeddings) out of Bert?

[@pseudounknow5559]

Yesss Deep Learning is back

[@codebasics]

🔥🔥🔥😊🥳

[@tejasshinde7236]

Its still relevant 👍🏻👍🏻

[@405dinesh]

Amazing explanation. Can you plz build a model using BERT fine tuning

[@arjunbali2079]

thank you sir

[@TechGuru98769]

well done

[@gundlanagaraju6282]

Good explanation sir , tq

[@codebasics]

You're most welcome

[@namansethi1767]

thanks sir for these videos

[@codebasics]

Glad you like them!

[@bruceWayne19993]

great explanation.

[@codebasics]

I'm glad you liked it.

[@bruceWayne19993]

@@codebasicscan you pls tell me which model is good to do machine translation task?

[@mobasshirbhuiyanshagor3611]

You are amazing.