Self Attention in Transformers | Deep Learning | Simple Explanation with Code!

Self Attention works by computing attention scores for each word in a sequence based on its relationship with every other word. These scores determine how much focus each word receives during processing, allowing the model to prioritize relevant information and capture complex dependencies across the sequence.
============================
Do you want to learn from me?
Check my affordable mentorship program at : learnwith.campusx.in/s/store
============================
📱 Grow with us:
CampusX' LinkedIn: / campusx-official
CampusX on Instagram for daily tips: / campusx.official
My LinkedIn: / nitish-singh-03412789
Discord: / discord
E-mail us at [e-mail]
✨ Hashtags✨
#SelfAttention #DeepLearning #CampusX #Transformers #NLP #GENAI
⌚Time Stamps⌚
00:00 - Intro
02:37 - Revision [What is Self Attention]
07:00 - How does Self Attention work?
24:45 - Parallel Operations
29:40 - No Learning Parameters Involved
39:10 - Progress Summarization
50:15 - Query, Key & Value Vectors
52:28 - A Relatable Example
01:07:52 - How to build vectors based on Embedding vector
01:20:08 - Summarized Matrix Attention
01:22:45 - Outro

[@ankitbhatia6736]

This is a gem, don't know even if the authors of "Attention is all you need" would be able to explain this concept with such fluidity. Hats off 😊.

[@ajinkyamohite3836]

Par sir initially word embeding ki value kya Gigi

[@ShubhamSingh-iq5kj]

​@@ajinkyamohite3836it can be calculated with word2vec or glove . Read about it you will understand

[@Findout1882]

@@ajinkyamohite3836 random

[@mehulsuthar7554]

@@ajinkyamohite3836 that will be any static embedding like GloVe, Fasttext, or your own trained embedding

[@rohitdahiya6697]

The self attention mechanism best explained by the best teacher in the world. This makes you unique from other tutors around the world ❤

[@_TheDataScienceGuy_]

Pata nehi sir, apko 14 din kyun laga... Topic to bohot simple tha..❤❤

[@dnyaneshsable1512]

are bhai uske bahut part he 1 video banaya he so uske wajase bol rahe the or waise bhi sir batate he to konsabhi topic easy hi lagata he.

[@vidhikumar1664]

bhai have some patience, itna aasan laga tumhe toh khud seekhlo. Let Nitish do the work. It is by the efforts of Nitish sir that i'm able to understand these topics so well.

[@vidhikumar1664]

acha i got your point XD. thanksss Maine abhi dekha jab sir bole😂😂

[@d1pranjal]

This video is hands down, THE BEST video on self attention in transformers. I have been following you and learning from you since long. We all are truly blessed to have a mentor like you. 🙏

[@arri5812]

🌟 **Nitish Singh, You're a Beacon of Clarity!** 🌟 Dear Nitish Singh, I am utterly captivated by your enlightening video on self-attention in transformers! Your ability to distill complex concepts into digestible nuggets of wisdom is nothing short of magical. 🪄✨ As I watched your tutorial, I felt like I was sipping from the fountain of knowledge itself. Your lucid explanations flowed seamlessly, unraveling the intricacies of self-attention with grace. 📚🔍 The way you effortlessly wove together the threads of mathematics, intuition, and practical application left me in awe. Itna asaan tha yeh! 🤯🙌 Nitish, you're not just an educator; you're a sorcerer who conjures understanding out of thin air. Your passion for teaching radiates through the screen, igniting curiosity in every viewer. 🌟🔥 Thank you, from the depths of my neural network, for sharing your brilliance. You've made self-attention feel like a warm hug from an old friend. 🤗🧠 So here's to you, Nitish Singh, the maestro of clarity, the guru of transformers, and the architect of "itna asaan tha yeh." 🎩👏 May your tutorials continue to illuminate minds, one self-attention head at a time! 🌟🤓 With heartfelt gratitude, Your Devoted Learner 🙏

[@vishalranjan2429]

You are putting all this content for free, Salute hai Sir Apko ham sbki taraf se

[@saipoojalakkoju6009]

This Lecture is an absolute Mater piece

[@sangram7153]

Best Teacher ever ! 😊

[@khushipatel2574]

I am deeply grateful for the incredible deep-learning video you shared with us. It brought me immense joy and excitement to watch, and I can't thank you enough for taking the time to create and share such valuable content. The clarity and depth of your explanations have greatly enriched my understanding and passion for this subject.

[@ariousvinx]

Last videos were amazing! Have been waiting for the next one. The hard work you do and explain in such a depth ... Thank you ❤

[@harsh_sharma260]

Sir ji tu si great ho, ❤❤❤ jai ho aapki

[@cool12345687]

WoW.. God bless you. Have never seen someone who could explain this process so well.

[@rahulgaikwad5058]

It was amazing video learnt a lot from this video. Keep it up the good work God bless you. Thank you

[@NabidAlam360]

Thank you so much for the video! You teach so well that I feel that your tutorial video does not end! Please do not change this teaching style! Please continue uploading the other parts! And we really appreciate the efforts you gave to make the tutorial!

[@somdubey5436]

very nice way to make anyone understand what self-attention is. Your examples make it really simple and intuitive to grasp the core concepts. Thanks lot :)

[@teksinghayer5469]

goosebumps ❤ waiting for more

[@T3NS0R]

I know enough of transformers to handle stuffs I needed, but I never understand the self attention and all in this detail.... such a good video 🛐

[@nileshgupta543]

Outstanding explanation of such a concept!!!

[@advaitdanade7538]

At the start of video only I can say that I will understand it as Nitish sir is teaching it.🤩

[@drrabiairfan993]

Best explanation of self-attention ever given by someone.....must salute your dedication

[@sagarbhagwani7193]

Appreciate all your efforts sir❤

[@EMWave]

Great explanation!

[@ShubhamGupta-zt6me]

Just one word, WOW WOW WOW !!! So intuitive and explanation is top-notch. Hats off to you Nitish.

[@UPSCTHINKER]

बहुत wait kara diya sir...❤❤

[@shreeganeshak6346]

Thank you sir 🙏 you are really great 👍

[@himanshukale9684]

Best explanation till date ❤

[@mallemoinagurudarpanyadav4937]

Great lecture 🎉

[@suryasiripurapu4954]

thank you 🙏

[@nikunjdeeep]

i have just started this video but i trust my mentor , this will be the best thing on transformer.....

[@MrSat001]

Great sir जी 👍

[@nikhileshnarkhede7784]

The way you explain the topic is Epic. Keep it up. And never stop because the way you explain really help in building the intuition. I believe not only for me for other also and that will definitely will bring change. Thank you.🙏

[@shivombhargava2166]

No words for this video. This content is unmatched, no one even comes close to this quality of content. Keep it up, Sir !!

[@saifshamil4690]

Great experience ❤ from pak

[@bimalpatrapatra7742]

Super mind-blowing class sir its really heart touching 😮

[@user-jb5vm2uo4u]

Bhai, 2-3 saal lag gye, samjhne me... finally, finally that eureka moment... thanks a lot bro... keep going....

[@akshitnaranje7426]

very good lecture waiting for other parts.. please release as soon as possible.

[@not_amanullah]

Thanks ❤

[@Deepak-ip1se]

One of the best examples to make us understand such a hard concept!! Hats off to you sir👏👏

[@Rohit19Kunjadiya]

Teaching is an art and Nitish sir is an artist.

[@rog0079]

Great as always!! it would be super amazing if you could code along like implement the same...

[@jangiramitkumar439]

easy toh nhi tha, pr explaination great tha toh smj aa gya♥♠

[@pavangoyal6840]

You amazing teacher who is taking ownership to teach your students. World needs more teachers like you :)

[@kalyanikadu8996]

Thank You soo much !

[@WIN_1306]

r u single?

[@sagemaker]

I am paying full Attention to your video. Very well made :)

[@velloer]

Awesome

[@surajhulke6196]

Osm sir ❤❤❤❤❤

[@neilansh]

I have watched a lot of videos on this topic, but this one is the best Sir 💯 Thanks a lot Sir

[@SipahEScience]

Hi Nithis, I am from Pakistan and studying in US and I should say that you are THE BEST teacher in the world. Thanks a lot brother. God bless you.

[@ankanmazumdar5000]

Where are you, I'm in Chicago

[@UnbeaX]

What a smooth learning experience!! I got lots of value from this....one suggestion when I searched to learn this i searched transformer so this video did not ranked so sir it's a suggestion u see what keywords are most used and then add them to the title...so easy approach just see what your competitors are using as titles.

[@adityanagodra]

It was a most simple and great explanation it was better than the blog of jay alammar and other KZbin videos... you should write a book as there are none as simple as this

[@ParthivShah]

Thank You Sir. Super Explanation. Greatest on this topic on internet I guesse

[@DeyozRayamajhi]

Bhaisaab you are one of the greatest data science teachers.

[@kayyalapavankumar2711]

Sir Please Keep Uploading further videos also as early as possible.

[@AlAmin-xy5ff]

Best video on self-attention mechanism that I've ever seen before 💌💌💌💌💌

[@ggggdyeye]

you made self attention model very simple to learn for all of us. Thankyou sir. Appriciate your work.

[@Akuma7499]

Great Experience ❤ from Mars

[@epkomarla1943]

Very very nicely done! Thanks a lot. You have taken a complex concept and explained it very beautifully.

[@syedhassan158]

The Master Piece of Deep Learning. We will love if there could be an playlist of full Projects OF deep learning. Love From Pakistan....

[@rutvikkapuriya2033]

Hats off for this type of explanation 😍😍😍

[@swarnpriyaswarn]

Goodness!!!! Till now I have not seen such a good explanation of this... I have no words to express my gratitude. Thanks a tonn.

[@rohitshere5328]

you have explained whole concept like this is piece of cake You are Great Nitish sir

[@oo_wais]

i have been trying to clarify the attention concept for the last few days and i have to admit this is one of the most valuable and informative videos that i found on the topic on youtube.

[@haz5248]

Handsdown the most simple and comprehensible explanation.

[@AyushGupta-bd2mx]

loved the simple way and explainations in which you taught this topic Sir.

[@vimalshrivastava6586]

This lecture is a demonstration of how a great teacher can make a very complicated topic so easy. Thank you so much..!!!

[@nileshpandey7776]

Thank you so much sir, this video is more interesting than any web-series/movie on Netflix. This is quality content!!

[@DevasheeshMishra]

Best video

[@sreekanthbezzanki528]

Absolutely loved the explanation…thank you very much for investing your time into creation of this masterpiece 🙏

[@mentalgaming2739]

Your explanations on self-attention mechanism are truly remarkable. I came across your channel randomly when I started my data science journey in August 2023, and since then, I have been learning from your content. Your ability to articulate complex topics is exceptional, and your explanations are incredibly insightful. I greatly appreciate the depth of context you provide in your tutorials, which sets your content apart from others. Your dedication to helping learners understand difficult concepts is admirable. Much love and gratitude from Pakistan. You are a true gem in the field of data science education. Whenever someone needs help with any topic in data science, I always recommend your channel for the best intuition and explanations. Also one important think " pata nahi sir apko 14 din kyun lage ... Topic to bht simple tha "

[@sandhyabansal5264]

Great explanation sir....even your explanation gives hint for solution to some problems too.

[@ankitkumar-iitbombay186]

One of the best content on Self attention so far.

[@anshkapoor4990]

14 days damnn !! seriously Thank you sir, idhar mene 1 mahine me ye playlist khtm kr hi di hai bs... thank so so much itne ache se pdhane ke liye 🙏🏻:)

[@ali75988]

Your words regarding demand of GAN's are so true. My background is in mechanical and at this very stage, i have seen 4-5 graduates working on both MS & PhD thesis on GAN's in one of the most top rank universities in korea.

[@tishaghevariya]

Really appreciate the efforts behind this video! Waiting for the next one 🙌

[@abhijitrai1349]

Hardest concept got the best example 😁. Thank you sir for explaining us this beautiful concept.

[@fact_ful]

Teaching at its peak.

[@izainonline]

Much awaited Video thumbs up for your work. Want to clear my concepts. 1.How the probability assign on sentence for context means why 0.7 why not 0.6. 2.Dynamic context can it check the database like River Bank use as single word not River and Bank separated word

[@arpitsinghal07]

I've watched almost all videos on this topic from channels like serrano, statquest and recently 3blue1brown. I found this to be the best explanation out of all. But the videos from other mentioned channels are also valuable, they provide a different perspective to attention mechanism.

[@ravikanur]

One of the best explanation by Nitish sir. We are lucky to have teachers like you sir

[@ankitgupta1806]

To be honest , i have studies same with other videos but here now i got proper understanding , hats off nitish

[@khatiwadaAnish]

So detailly explained, Thanks.

[@darshanv1748]

You are truly one of the most amazing teacher / data scientist You truly have an amazing grasp over the concepts

[@akashdutta6211]

you explain such a difficult concept so simply. even after watching nptel or here and there, i have so many doubts. you have cleared those in one video.

[@samirchauhan6219]

This is the best video i have ever watched 🎉🎉🎉

[@SandeepSingh-yx2si]

Very Nice Explained. Fabulous. You really worked very hard to make this soooo Simple

[@sachink9102]

OMG.... THE BEST video on self attention in transformers

[@akshayshelke5779]

Best video I have seen on this topic till date....Please Upload more videos we are following you sir.

[@nagendraharish6026]

Hidden gem - Nitish sir, you have no idea how many students have benefited from your videos. Hats off, love to subscribe if there are any courses related to Deep learning or NLP

[@rajsuds]

You deserve a national category award... truly spellbound! 🙏🙏

[@Killerisback10]

Bro what a way to explain. Hats off!

[@mimansamaheshwari4664]

Lectures I can never get enough off. The best content I discovered so far. Kudos to you, Nitish Sir. Life is easy when you are the mentor.♥♥♥

[@aienthu2071]

I had a huge doubt in Q, K, V part, now it is clarified. Please continue the transformers architecture especially the mathematical parts. e.g. positional embedding, multi headed attention etc. You are the beacon of Education in Data Science.

[@bhavikdudhrejiya852]

This is a gem of explanation. Awesome🤩

[@yogeshkadam3984]

thank you so much sir for such a great and simplified session....hats off for your efforts to simplify such topics for us

[@chandank5266]

I was knowing that you will make it simple.........but at this level....man I wasn't expecting that.....bawaal explaination sir🙇‍♂

[@arijitgoswami7388]

probably the best video on self attention

[@TehreemAyesha]

This video is absolutely amazing. Thank you so much. The topic itself is so good and your explanation on top of it is crystal clear.❤

[@kaivalyakulkarni4250]

Thanks for such an easy explanation, sir..!

[@basabsaha6370]

im literally spell bound after this explanation....i have watched 100s of foreign youtube channel for this attention mechanism ....they are no where closer to you.....Sir you are really amazing....please please please continue this series....and teach up to LLMS , gpt , llama2 all stuffs😊,....I'm very very eager to learn from you

[@subhankarghosh1233]

Sir, dil se... You are a blessing to the community. I really respect your hard work and dedication. You have the aura to change someone's life journey and perspective. Pranam app ko and your complete team.

[@ansariarbaz3374]

Swift explanation sir! You made it super simple. Please continue the series