This is one of the best explanations of not just ViT, but transformers in general that I have watched. Excellent video
@aakashsharma31792 күн бұрын
I have never been so HOOKED while watching a video which is going fairly "deep" into such topics. Very well presented. Keep up the good work man.
@capsbr21007 ай бұрын
Goodness, what a remarkable video. This is by far the best explanation video I have watched about vision transformers.
@whale2710 ай бұрын
Unbelievable quality. Happy to be here before this channel blows up.
@SamuelAlbanie110 ай бұрын
Thanks!
@newbie805111 күн бұрын
Took an Image Processing course last semester and one of the topics the prof suggested to learn about was ViT's I knew about the basics of Deep Learning and over the summers explored more about autoencoders Starting from August, I dwelved into the Transformer architecture, and now ViT seems very simple It's just that we divide input image into patches, line these patches up in a sequence and convert them to embeddings, add positional vectors and boom feed it to the transformer module
@thetechnocrack8 ай бұрын
This is one of the cleanest explanation of ViTs I have come across. Amazing work Samuel! Inspiring.
@jesusalpaca71707 ай бұрын
for a beginner like me, I would say, this is the introduce video that we were waiting for :')
@srinjoy.bhuiya4 ай бұрын
One of the greatest explanations of the concepts of transformers to a Computer Vision Reserach
@continuallearning836610 ай бұрын
Excellent video! Honored to be here before it goes viral 🙏🏾
@RayWang-m6b10 ай бұрын
Thank you for making this wonderful video. So clear! Please continue your awesome video work!
@thecheekychinaman67137 ай бұрын
I was studying up on Transformers and ViTs half a year ago, and recently checked back to find this (to my surprise). Great clear explanations, can tell CAML is in great hands!
@이연우-i2n10 ай бұрын
🎯 Key Takeaways for quick navigation: 00:00 🧠 *The Evolution of AI and Computer Vision* - General methods leveraging computation prove most effective in AI development. - Evolution from handcrafted features to Convolutional Neural Networks (CNNs) and then to Transformers, showcasing a reduction in inductive biases and an increase in data-driven approaches. 01:09 🤖 *Neural Network Architectures* - Importance of network architecture in building intelligent machines. - Distinction between network architecture and network parameters, focusing on resource limitations and efficient design. 02:32 💡 *Introduction to Transformers* - Transformers' dominance in AI, initially in Natural Language Processing (NLP) and then in Computer Vision. - Discussion on why Transformers took time to transition from NLP to Computer Vision. 03:57 🌐 *Understanding Transformers: Encoder and Decoder* - Explanation of the Transformer architecture with its encoder and decoder components. - Different variants of Transformers: Encoder-only, Decoder-only, and Encoder-Decoder architectures. 05:33 🔍 *Applying Transformers to Computer Vision* - Vision Transformers (ViT) process images by slicing them into patches, using position embeddings and Transformer encoders. - The methodology of transforming images into a sequence of embeddings for the Transformer encoder. 07:08 🔗 *Multi-Head Attention in Transformers* - Detailed explanation of the multi-head attention mechanism in Transformers. - Role of queries, keys, and values in facilitating communication between different embeddings. 09:12 🧩 *Transformer Encoder Blocks and Scaling* - The structure and function of Transformer encoder blocks, including multi-head attention and MLP. - Importance of residual connections and layer normalization in optimizing Transformer models. 11:05 🚀 *Scaling and Hardware Influence in AI* - The impact of scaling and hardware advancements on Transformer model performance. - Discussion on the exponential increase in computational resources for training large models. 13:50 🛠 *MLP and Optimization in Transformers* - Role of the multi-layer perceptron (MLP) in Transformer architecture for independent processing of embeddings. - Importance of non-linearities like ReLU and GELU in Transformer models. 15:00 ⚙️ *Residual Connections and Layer Normalization* - Implementation and significance of residual connections and layer normalization in Transformers. - These components facilitate gradient flow and stable learning in deep network training. 17:05 🌐 *Positional Embeddings in Transformers* - Explanation of positional embeddings in Transformers, necessary for maintaining spatial information in sequences. - Different methods of implementing positional embeddings in Transformer models. 19:27 🔄 *Cross Attention and Causal Attention in Transformers* - Discussion of Made with HARPA AI
@abhimanyuyadav268510 ай бұрын
Your weekly ai news was really useful Please bring it back
@PotatoKaboom10 ай бұрын
I've held guest lectures on the inner workings of transformers myself, but I still learned a bunch from this! Everything after 22:15 was very exciting to watch, very well presented and easy to understand! Very well done, I dubscribed for more :)
@251_satyamrai4Ай бұрын
beautifully explained.
@vil93868 ай бұрын
Wow, this video helped me a lot in understanding Attention and ViT. Packed with all the logics needed to design a solution using the latest as of this day.
@amoghjain10 ай бұрын
Thank you so very much for sharing your insights and intuition behind soooo many concepts.
@SamuelAlbanie110 ай бұрын
Glad it was helpful!
@piclkesthedrummer64394 ай бұрын
This is by far one of the most accurate, yet understandable and intuitive explaination of such a hard concept, you did a better job at explaining it than the authors! very impressive!
@mattsong687510 ай бұрын
Thanks for such a informative and educational video
@MdAkmolMasud4 ай бұрын
The best explanation of ViT..
@sbdzdz10 ай бұрын
Very well presented!
@ShravanKumar1473 ай бұрын
Beautifully put together. Keep it going @Sam
@aminkarimi10685 ай бұрын
The best video to easily understand VIT
@soylentpink784511 ай бұрын
Very good video - contents & it’s presentation!
@rmmajor6 ай бұрын
That is a masterpiece of a video! Many thanks for your work!
@plutophy12429 күн бұрын
excellent contents and slides!!!
@SamuelAlbanie17 күн бұрын
Thanks!
@gnorts_mr_alien5 ай бұрын
man, what a video. thank you!
@shyb80794 ай бұрын
Thank you for ur content.
@minute_machine_learning53625 ай бұрын
great explanation
@zainbaloch55416 ай бұрын
Thank you so much!
@flamboyanta499310 ай бұрын
Excellent and clearly communicated. Thanks. question in 20:05 when discssing positional embeddings, the legend of the waves says dim 4,....dim 7. Here, does dim refer to the length of the pathch D? as in, we'll get as many sine waves as D dims ?
@EigenA7 ай бұрын
Great work!
@tomrichter90218 ай бұрын
Great video
@geomanisgod7 ай бұрын
A+++ quality from other planets.
@flamboyanta499310 ай бұрын
Another question: in 30:00 discussing how early attention layers tend to focus on local features and deeper ones on more global features of the input. I didn't understand the significance of the x-axis (sorted attention head). is this just a count of how many attention head there are in the respective block? Which suggests that in the large data regime, even early attention blocks with 14+ heads will also tend to observe the features globally? Is this correct? And thank you in advance!
@miraclemaxicl7 ай бұрын
More Compute Is All You Need
@capsbr21007 ай бұрын
So for someone approaching this now, working on resource-constrained devices, both for training and inference, it makes more sense to just stick to CNNs?
@iez7 ай бұрын
any ViTs that are open source?
@felipesuarez50412 ай бұрын
Crazy how transformers are beating all these other classical architectures like CNNs, that have been used since ancient Greece times.