What are the Heads in Multihead Attention? (Multihead Attention Practically Explained)

The purpose of this video is to explore how multihead attention works in more detail and to understand how extending from single-head attention to the multihead case works in practice.
Code:
github.com/BrandenKeck/pytorc...
Helpful Repos:
github.com/CyberZHG/torch-mul...
github.com/pytorch/pytorch/bl...
Attention is All You Need:
arxiv.org/pdf/1706.03762
Music Credits:
Midnight Room by | e s c p | www.escp.space
escp-music.bandcamp.com
Synthetic by | e s c p | www.escp.space
escp-music.bandcamp.com
Please, Don’t Forget Me by | e s c p | www.escp.space
escp-music.bandcamp.com
Light Rain by | e s c p | www.escp.space
escp-music.bandcamp.com

[@mohamedkassar7441]

Wonderful thanks