Illia Polosukhin On Inventing The Tech Behind Generative AI At Google

[@velo1337]

with how easy his explanations are, you can clearly see that he was one of the first ppl who coded it.

[@thinkingcitizen]

the primary author of the paper and lead inventor, Ashish Vaswani, is an Indian

[@blackbrute2504]

​@@thinkingcitizenHe wouldn't get PR. And neither is Niki Parmar. Credits will be given to whites again.

[@komodo_04]

The future is $NEAR

[@aberba]

These Russians are killing it in the AI space

[@gyahoo]

Proper crisp precise and upto point conversation by illia co inventor of transformers. No doomerism opinions like what researchers do

[@Nickspizza413]

Seriously Bullish on Near.

[@TommyChong677]

I recently read an article about a man who identified AI stocks before the AI boom, highlighting the importance of information and insight. I believe AI is poised to enter a new phase, and I aim to position my $200k investment portfolio to capitalize on significant gains.

[@FraserRyan-oz2bj]

Absolutely crucial in the stock market: information, insight, and predictability. As an early investor in NVDA, AMD, ANSS, and LRCX, my advisor's guidance was invaluable.

[@Cynthia-mm1cv]

People often underestimate financial advisors' importance. Over 50 years of data reveal that those who work with advisors typically earn more than those who go it alone. I've been fortunate to work with one for 13 years, resulting in a $1 million portfolio, largely from early investments in AI and other growth stocks.

[@tinsleyLuna]

How can i reach this person?

[@Cynthia-mm1cv]

I'm cautious about giving specific recommendations as everyone's situation varies. Consider independent financial advisors like "LUCIA ALICIA CRUZ" I've worked with her for years and highly recommend her. Check if she meets your criteria.

[@tinsleyLuna]

I looked up her name online and found her page. I emailed and made an appointment to talk with her. Thanks for the tip.

[@RyuuOujiXS]

The fact that this is considered a breakthrough proves to everyone how stupid most people are, including Google employee's. "Duhhhhhhhh, maybe we should make it read the sentence instead of just a word." "OMG, that's a breakthrough, derp derp!"

[@ichoudhury007]

Great discussion, a lot of great question. However, I would’ve preferred some near protocol specific questions. I liked understanding the synergy between near AI versus near protocol 😊

[@elmermarko5126]

Near should make great gains the next few months. Near is at the forefront of Ai and crypto.

[@___________02]

Hi Katie, Congratulations to you for giving birth to a new life. 🎉🎉

[@MelonHusk7]

The curation and importance of data is highly underestimated. He explained it really well.

[@BornAndErrorOccur]

Vitalik Buterin's Older Brother.

[@afterthesmash]

Katie Tarasov does a decent job here.

[@Merciful_servant06]

She is. 😂

[@DmitryVinogradovjr]

Катя и Илья

[@RealSmall]

Um, interesting

[@sputnik8543]

I think what we learned is you have to be named Ilya or Illia to lead the AI race; so I’ll be changing my name to Ilya or some variant

[@auro1986]

this technology may have been from darpa

[@littlebrit]

They are both Ukrainians. Ukraine has done so much for blockchain.

[@attilapataki6639]

Ok! While I don't necessarily like how he describes AI in the beginning (and this is just a matter of taste and subjectivity) I do appreciate him for how he answered the doomsday question. Congrats 👏🏻and for humanities sake: I do hope there are more Ai devs like him.

[@JohnDoe-mx3rr]

The doomsday saying there no economic has not seen industrial war machine

[@donson3326]

Contributed the least to the paper. Another rug pull.

[@cryptomotivation2639]

Near is the top Ai blockchain and will be a top 5 coin this crypto cycle. Easy 10X from here.

[@KorathWright]

Brawndo - its what plants CRAVE!

[@urbanstrencan]

He is the one who started our next revolution with AI.

[@ricnyc2759]

I have a question: are the transformers based on software or hardware? Is it like an "if - else statement"?

[@anb4351]

If else but more complex, i.e if probability of x happening given y based on training data set is greater than z then find the most plausible next token

[@pacanosiu]

God will .... you up for this

[@sputnik8543]

I think what we learned is you have to be named Ilya or Illia to lead the AI race

[@Pawnsappsee]

😂😂😂😂

[@Pawnsappsee]

It's a name thing, wtf

[@kfique]

Great interview, tks!

[@mizan05h]

❤

[@dad.things]

The title makes it sounds like he was almost a cofounder 🤷🏻‍♂️

[@NadimShaikh-qv7zj]

He was the co-author of the monumental paper, so more important for the specific tech than any other co-founder or ceo.

[@tjm0112]

What the heck u talking about ? He is the cofounder.

[@NadimShaikh-qv7zj]

@@tjm0112 I think op probably mean to say that the he is not the co-founder of Google or OpenAI or one of the other big AI companies that are building these foundational models.

[@dad.things]

Look at the thumbnail. It says Near cofounder. Sounds like he was almost a cofounder. It’s a joke tech bros!

[@NadimShaikh-qv7zj]

@@dad.things Oh, I interpreted it in a totally different way. I'm sorry, my bad!

[@anipacify1163]

Ashish Vaswani goat 🐐. The main guy behind the transformer paper

[@sha_la007]

This is great! I would love to understand how they handle words like: hill, heal, and heel. They all sound alike but have different meaning depending on the context of the sentence. How are they training to understand meaning, considering English has a lot of ambiguity in the language. It's often one of the hardest languages to learn because of this.

[@yashraghuwanshi931]

The computer are reading it , and not hearing it so it can understand the meaning using the spelling

[@muzehack]

When he talks about "attention" in AI models that is basically the mechanism that determines the context based on its training. It works very much like humans do. When he talked about the cat and the wall and whether "it was tall" referred to the cat or the wall, the AI develops weights that relate to the probability that "it was tall" was referring to the cat, because in the examples it was trained on it was more likely that the cat was the subject of the sentence and "it" referred to the cat.

[@chillfluencer]

No. They only sound similar. Don't you recognize the differences with all three? At least hill and heal or heel.

[@romanyelisov4710]

Слава Україні

[@mshark2205]

He should’ve focused on AI rather than crypto. A huge missed opportunity

[@chillfluencer]

Russia wins again. Hahaha! Uraaaaaaa!

[@beng4647]

This guy thinks he owns his work. How cute.

[@thinkingcitizen]

the primary author of the paper and lead inventor, Ashish Vaswani, is an Indian

[@menachempike4489]

Actually it was Ilya and Noam shazeer lol it says it in the paper

[@thinkingcitizen]

@@menachempike4489 authors of papers are listed from Left to Right, in order of contribution. The leftmost author is Vaswani. Also, I was doing my PhD in the field in 2017 and we all know that the primary author is Vaswani. Often, the paper 'Attention is all you Need' is cited as Vaswani et. al.

[@menachempike4489]

@@thinkingcitizen it literally says in the bottom of the paper that the order was random and it explains their contributions

[@menachempike4489]

@@thinkingcitizen The authors of the paper are: Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan Gomez, Lukasz Kaiser, and Illia Polosukhin. All eight authors were "equal contributors" to the paper; the listed order was randomized. The Wired article highlights the group's diversity-from wikipedia

[@invisiblian]

so glad illia didn't do a joe biden on this interview. lol

[@afterthesmash]

Do you mean the lucid Joe Biden from most of his life, or the sad, sick Joe Biden from the recent 90 minute debate?

[@invisiblian]

@@afterthesmash who can forget his plagiarism in 1987. he was always a sad joke, brain damage or not.