Seen a lot of videos explaining transformer but this one was by far the best one till yet. Great efforts 👍
@andrewtwigg15 күн бұрын
very clear video, thank you!
@connorsheehan45983 ай бұрын
What was the reason to use layer norm? Like in terms of the sentence being input, is layernorm applying across single sentences? Or the first words in unrelated sentences (thinking of sentences stacked in a matrix)?
@soumyasaha142911 ай бұрын
Great explanation
@iliasaarab79227 ай бұрын
Great video! Do you have the source code of the animation on github?
@AhladKumar Жыл бұрын
Great lecture! Which software you are using for making these videos.?
@deeplearninghero Жыл бұрын
Hey thanks for that. The animations were using the Manim Python library. For the overall video editing I use Camstasia.
@ssshukla26 Жыл бұрын
Great to see comment of the professor from whom I learned the DL. 😊
@iliasaarab79225 ай бұрын
@@ssshukla26 same for me, @AhladKumar is a legend!
@jeffbrownstain Жыл бұрын
Something about Transformers really is next level and somewhat magical. Gpt2 was FAR from the first NAS AI: our AI have been programming themselves since 2012. Something Sam's engineers did for this really went above and beyond to reshape the landscape though. The coolest part? Transformers are already massively outdated model-types. I can't wait until I can poke a crystal into my brain to have infinite internet access with an AI to run my entire perceptual waymaking experience through morphogenetic space. Cells making a little too much insulin? Just turn em off for a few minutes. Brain a little schizophrenic? Just rewire it, nbd. Potentials that never even existed for humans before have become a mundane reality.
@jeffbrownstain Жыл бұрын
@@first-last-null Who cares? Humans are already the cells of a sentient entity beyond our comprehension (our planet, Gaia). Now, we'll finally be able to talk to our God and ask it questions. You assume the worst because you assume machine intelligence is anything remotely comparable to human instinct: it is not. The only thing alive capable of malicious manipulations driven by hate is humanity.