Gail Weiss: Thinking Like Transformers

[@mathforai-j5y]

very clear and concise!💯

[@vandarkholme442]

Awesome analogies for really understanding what is happening under the hood. Thanks!

[@swim3936]

fantastic presentation!

[@stevenshaw124]

this was an excellent presentation! thank you!

[@alexanderkyte4675]

Could I please have the slides? They’re partially obscured by the listeners here. I’d like to use them for a reading group.

[@formallanguagesandneuralne5578]

hey, not managing to respond from my own account so positing from here - the slides are on my website, which is hosted on github - gailweiss dot github dot io

[@GodofStories]

This is great

[@haksasseeducation9565]

I don't agree with the slide presented at 21:35 about the input of each head. Actually, each head receives the same output from the previous embedding and positional layer.

[@homeboundrecords6955]

I'll bet this reply will not be read, but... isn't the "subject" = "I" and the "object" = "dog" ?

[@LGcommaI]

Yes, that's correct. The terminology is confusing though (IF one knows Latin): the 'subject' literally is 'that which is (thrown) UNDER' while the 'object' is 'that which is (thrown) on top' . Everyday sensibilities thus would expect that the object is the one who does sth. and the subject the one which has sth. done TO it. The standard convention is the OPPOSITE however.

[@RaviAnnaswamy]

@@LGcommaI object generally refers to inert things and the 'subject' is used as English word for persons (King asked his subjects to pay more tax during the drought years...). This could be the reason for English grammar using subject for the actor and object for the acted upon (victim).

[@poutinez1688]

dude This is EXACTLY how ELON MUSK thinks dude

[@asrahussain8642]

are you implying that he has less than human intelligence?

[@poutinez1688]

@@asrahussain8642 no dude I am NOT ... I AM implying that it is Slight Variation AND that ELON MUSK has greater human intelligence dude YOU are NOT your Mind AND you are NOT your body dude