Attention and Transformer Neural Networks: A Pedagogical and Detailed Explanation

In this video we break down attention based layers and transformer neural networks. We cover how information flows in detail, the inductive bias of the network, intuition behind why it works, and so on.
Further Reading:
lena-voita.github.io/nlp_cour...