Gemini 1.5 Pro With 10,000,000 Tokens Is Absurd

check out my cool lil leaderboard website!
leaderboard.by...
Gemini 1.5 Pro
[Blog] blog.google/te...
[Technical Report] storage.google...
Large World Model
[Paper] arxiv.org/pdf/...
[Project Page] largeworldmode...
[Code] github.com/Lar...
OpenAI Sora
[Project Page] openai.com/sor...
This video is supported by the kind Patrons & KZbin Members:
🙏Andrew Lescelius, alex j, Chris LeDoux, Alex Maurice, Miguilim, Deagan, FiFaŁ, Daddy Wen, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams, Tien Tien, BIll Mangrum, owned, Janne Kytölä, SO, Richárd Nagyfi
[Discord] / discord
[Twitter] / bycloudai
[Patreon] / bycloud
[Music] massobeats - chamomile
[Profile & Banner Art] / pygm7

[@krishp1104]

I actually thought this was the code report when i clicked on the video lmao

[@foresterchristensen2486]

Same haha

[@mubeensgh]

And you know Code Report can’t sue for copyright infringement since he admits that his videos are AI generated. 4d chess move.

[@thespencerowen]

Same

[@munirahmadahmadi2087]

Same(kinda)

[@staminadaddy]

Sameeee looool

[@BarcelonaMove]

The code report joke was nuts 😂😂😂😂

[@_zeeblo]

I had to check I was on the right channel lmao

[@_.nuke_]

lol literally@@_zeeblo

[@Chaminox]

Wow. The Ai videos Look insane please make a video on them. Love your Content!

[@conall5434]

Nice to find another creator who does analysis without silly clickbait

[@tapu_]

I thought this was a fireship video when I saw the thumbnail

[@Leech926]

"This has been the code report", you had me, I had to double check who I was watching

[@Solruc_]

When did fireships voice change

[@hundvd_7]

Oh my god, the last video looks so good I was confused for a second. Like, it just leapt over the uncanny valley without even trying

[@zhevox]

I genuniely thought this was Fireship's Code report 💀

[@quazar-omega]

Bro think he fireship ong 💀

[@nicdemai]

0:39 This was not the actual performance of Claude 2.1 on the Needle in a Haystack (NIAH) Benchmark. The Original Performance of the benchmark was published by: "Greg Kamradt - Claude 2.1" The original creator of the benchmark. The one you got was a derivative with actual instructions to remember a specific point in the text. That is not indicative of real-world performance as people won't encode a sentence saying "This is the most important line in the document:....." just to retrieve it again in the model when asked about that line. The Claude 2.1 Test in the video was Flawed!

[@michmach74]

Thanks for doing a video on Gemini 1.5 Pro lmao, everyone else was too busy hyping about OpenAI Sora. Which is no doubt mind blowing, but ya know, other news. Looking forward on your video about Sora tho!

[@Virbox]

You know progress happens too fast when the next major breakthrough happens before the video even ends 😂

[@ankk98]

You really had me with the code report thing 😂😂

[@soul_slayer707]

bro tried to sneak fireship, and thought we won't notice

[@bastianlipka2406]

The quality of the video is amazing it feels like the Classic code report ❤️ Keep it going

[@DerTechNick]

Man... this is going so fast I fear for falling behind

[@lautystrike1]

We should totally go more faster than that

[@VisionaryPathway]

I feel you brother. The best thing you can do is this: Imagine life 1, 3, 5, and 10 years from now... Or at least the general future... And think: what should I be learning about which will be highly relevant then? What skills will be the most in demand? What am I currently learning that may become irrelevant in the future? Reflect on this long enough, and consistently, and you shall start to live your life (in skill acquisition and information gathering) in accordance with the future Hopefully this helps

[@YT-gv3cz]

​@@VisionaryPathway I know that's what I should be doing, at least what's good for my mental health, but I couldn't help but imagine how irrelevant these personal skills would be in face of strong AGI or even ASI. If it really comes to that, I guess everyone would just be forced to create his own meaning...

[@VisionaryPathway]

@@YT-gv3cz I completely understand where you’re coming from. However, after comprehensive analysis of my own, I disagree. First of all, you must consider the massive amount of compute power required for the SCALE OF DEPLOYMENT you’re referring to. To replace 8 billion humans, you need A LOT of compute power. Why do you think Sam Altman mentioned we need $7 trillion..? That’s the compute power required just to support general commercial AI usage over next 5-10 years. Believe me, you’re not becoming “obsolete” anytime soon. What’s going to happen is everyone who has the digital means to subscribe and use any tool will become superhuman. AI augments and enhances our productivity. It only replaces certain archaic hard-skills (even then, to some extent for now). ------------------ I stumbled across a quote a few months ago by someone in the comment section. I’ll never forget it, and I’m living by it daily (and will for remainder of my life): “Creativity is the new literacy. Nonlinearity is the new numeracy. AI-centricity is the new operacy.” I’ll reply to this comment with GPT’s analysis of what that means. - Identify this is the future, modify your actions and skill acquisition, and you’ll not just “be fine” like everyone else. You’ll be in demand.

[@VisionaryPathway]

@@YT-gv3cz VisionArchitect GPT: “Your interpretation is quite accurate. These phrases indeed reflect a shift in the perception of essential skills and competencies in the modern, technologically advanced world. To elaborate further: 1. Creativity as the New Literacy: - In historical contexts, literacy, the ability to read and write, was a cornerstone of education and a primary indicator of intellectual capability. Today, as automation and artificial intelligence handle more routine tasks, the uniquely human trait of creativity is becoming as fundamental as literacy once was. It signifies a shift from valuing rote knowledge to valuing innovative thinking and the ability to create something new or solve problems in novel ways. 2. Nonlinearity as the New Numeracy: - Traditional numeracy centers around linear, algorithmic thinking, which is well-suited for predictable and sequential problems. However, in a world characterized by complex systems and rapid change, nonlinear thinking - which involves understanding complex, dynamic systems and their unpredictable interactions - becomes crucial. This kind of thinking is essential for navigating modern challenges in economics, climate change, social dynamics, and more. 3. AI-Centricity as the New Operacy: - Operacy, a term less common in everyday language, relates to the skill of effective operation or action. In the past, this might have meant mechanical skills or basic computer literacy. However, in an era where AI is pervading every aspect of life and work, understanding and leveraging AI becomes a fundamental skill. AI-centricity means not just using AI tools, but thinking in ways that leverage AI's strengths, such as massive data processing, pattern recognition, and predictive analytics. These statements collectively point to a redefinition of what it means to be skilled or educated in the 21st century. They suggest a transition from traditional, often more linear skills to those that are more adaptive, creative, and integrated with advanced technology. This shift reflects the evolving demands of a world where complex problems, technological integration, and rapid change are the norms.”

[@rpanda_old]

wait this is not the fireship channel .

[@user-qr4jf4tv2x]

imagine google going back to google glass

[@poupeuu]

What are these comments??? Wtf

[@kernsanders3973]

I was scratching my head looking at those comments, almost seems like AI generated comments. But must be some super random low effort generation. Average LLM can actually generate more coherent comments than those

[@alphar9539]

@@kernsanders3973nah bro let the bots cook

[@Gio_Panda]

I will not trust google until I try the model myself. They've been way too shady with their previous announcements. They always try to picture themselves as better than OpenAI but haven't been even close to GPT-4's level of utility yet. We'll see.

[@raymond_anderson]

This is like watching Fireship slowed down to 0.25. 😂 Great video btw.

[@iguatemigarin]

4 months after this video, and we have Gemini 1.5 Pro with 2M tokens. It's insane

[@seebarnes6588]

ask it for pictures of a knight, a priest, a cowboy and indian

[@juanjesusligero391]

I feel frustrated. Every time one of your videos ends, I'm all set to hit that like button, only to find out my sneaky hand beat me to it right at the start.

[@tedchirvasiu]

Those videos look better than real life videos

[@ReflinWulf]

this has been the code report was too funny

[@Lyoishi]

It makes a ton of sense that the (probably years) of ai research google has done would focus on working massive datasets just like google search.

[@VaibhavShewale]

ooh man this gemini is so fast! i hope someone use this to translae language in live with less delay and also someone study communicaion with animals well at start we can test o mouse and monkeys

[@Soosss]

For a second I thought fireship got a new host, good video though I liked it

[@MostachoIrregular]

Do your own thing. This is embarassing.

[@gsus7125original]

Are we just supposed to pretend that AI suddenly advanced this fast in 1 year and that they haven't had top secret AIs better than this for 15+ years?

[@not_hehe__]

lmao I actually thought I clicked on a fireship video from the thumbnail

[@memzo_getR]

They are improving AI so hard, you can't know what will happen in next month.

[@DylanWong-y4t]

Here's a question for you if you'd like to answer it: If there really is no moat, when do you think Open source models will catch up to the 1M token limit? I hear that Mamba is promising.

[@bycloudAI]

I have an upcoming video about Mamba that is in the works, so stay tuned:))

[@reececrook7021]

it would be nice if they did catch up, but honestly my potato has no chance of ever running it, i can barely run the dumbest of models

[@Itsneil17]

the code report joke was funny lol

[@NewSchattenRayquaza]

the code report bit got me hard 🤣

[@raki13]

1:38 papuan mentioned🎉🎉🎉

[@MiguelangelVasquezlopes-bc1zj]

Enterprise AI's LLama never ceases to amaze me, truly the best bang for your buck.

[@user-qr4jf4tv2x]

in case we ever talk to aliens this will be the method to learn their language fast

[@danielmartinezdev]

Bro I clicked thinking this was a @fireship video

[@michael6955]

Three.js = Abstraction hell is such a fabulous way to put it 😂

[@LucTaylor]

I'll say, token length limit was annoying when I was writing a novelette. I ended up needing chapter summaries and synopses and then a n^2 algorithm for comparing chapters Do you see any contradiction between {CH 1} and {CH 2} .. now chapter 1 and chapter 2. Now chapter 1 and chapter 3. Although token based billing does still scare me. I dumped my entire story into GPT4 32K and it gave me a useless answer that alluded to revisions it had made, but never actually did. I contemplated requesting a refund for that one request (yes it was big enough that that made sense), but it's a little hard to prove the response was wrong or malfunctioned :( I annoyed me enough to switch to Mistral for the rest of revisions lol

[@patrickcarpenter6258]

the code report at the end GOT ME. insta subbed

[@Levi_Ackermann0_0]

I thought it was fireship code report 😢 I have been scamed , my day is ruined 😞

[@georgy.design]

Mates, this shit is insane. Mind boggling even. I’m not a coder (learning JS really slowly, haha), but I’m like, nah, champs, I gotta cook! I GOTTA COOK an app with my own custom trained ML model, so I can generate web pages with AI. I’m like, this is astounding! So much content is droppin’, and I’m not fast enough to catch all of it. Now I need to figure out how to cook, ahem, I mean use Gemini Ultra 1.5 properly lmao.

[@pley56.]

With great power comes great electricity bills.

[@isaacfloressantacruz3382]

Saving those tokens for a makeup tutorial?

[@Vifnis]

0:20 Sir, that is actually a grown man known as Habibi...

[@IgorPodgorny-o5l]

Yet, can't draw a picture of a white male...

[@rise6955]

And in some hours OpenAi pulled out their Sora😂😂

[@ethanwmonster9075]

Absolutely crazy, i thought we were slowing down for a moment there turns out i second guessed myself.

[@mautkajuari]

3:56 😆

[@frenches1995]

AND THIS HAS BEEN THE CODE REPORT..... uhm I mean.... simply a funny move but would be nice if you could shoutout to fireship as well, since videostyle and thumbnail are abviously inspired by him

[@ech0o0o0o0z]

Bro called Hasbulla a toddler 😂

[@NinetooNine]

Pretty sure they said the 10 million tokens was only accomplished in the lab as an experimental thing to try. I would assume it wasn't very stable when they tried it hence why they won't offer it yet. But they probably pulled off some simple things with it which allowed them to claim they had achieved 10 million tokens. Honestly though, even if they only achieved a 1 million token length and its functional that is still impressive.

[@ابوعبداللهحسن-ك6د]

أكثر من رائع ويستاهل خمسه نجوم

[@aiiasense]

Gemini Models: Google has mentioned a preview of 'Gemini 1.5 Pro' that uses a 1,000,000 token context window (the amount of text the model looks at to generate a response). However, this refers to its ability to process information, not the size of the model's entire training dataset.

[@ravenragnar]

As AI continues to evolve, what are the potential long-term risks to humanity?

[@justsomeonepassingby3838]

Yes.

[@JonDoe-uq1mk]

I think the one risk would be an unstoppable ai virus that launches nukes because it thinks that's the easiest way to get rewarded

[@zeppie_]

Sorry, but as an AI language model, I cannot answer your question. However, you might find insightful perspectives from experts in the field of AI ethics and futurology.

[@reececrook7021]

the risks are luddites working them selves up into a frenzy, but that happens every time some thing big is invented, and the world becoming a better place, with higher quality products can be produced cheaper than ever, and the barrier of entry to expressing ones creativity getting ever lower and while i do honestly beleive that, i think there are gonna be a lot of growing pains, and a point in the future will come when the vast majority of humans are unemployable, at that point i believe that either the luddites win and revolt to destroy this new technology, returning the world hopefully to how it was a few years ago, but probably to the stone ages. or the people revolt and society moves to a model where people are paid just for existing and we live lives of luxury with near limitless incredibly cheap products and services as ai and robots do all of our hard work for us. and then we will all need to find hobbies to entertain us without jobs. i think those are the only two options that will work, but the first is almost impossible to happen because getting all of the world to obstain would be impossible when using ai would give your nation a leg up. but who knows maybe something surprising will happen. i just hope the transition will go smoothly. ai could make all our lives much betterm but fear and the neccesarry changes to our society leave a lot of room for revolution and bloodshed

[@v-sig2389]

Since our lizard masters only want one thing : mastering their slaves to maintain a comfortable life while avoiding revolts, they had the idea to give us crumbs of those ai technologies until someone makes unsollicited p*rn of public figures, or worse, generate p*dophilia, in order to justify an electronic identity, under the reason to "track the origin of generated content". Progressively, those who wouldn't use that electronic id, would not be able to open bank accounts anymore, and things like that. They are also working on removing paper money. After that, powerful people would be able to freeze the bank accounts of anyone they don't like, with the press of a button. Don't want to let your teen remove her breasts ? Sanction ! Have a doubt about new miraculous pharma products ? Cancelled ! As usual, you take a great technology (the internet, the cloud, ai ...) and lizard people manage to use it the worse way possible : adds infested depressing social medias, tiktok, spying society, ...

[@VictorxavierMartinezadan]

Boy that's a lot of tokens!

[@alexijohansen]

Remember when Google misrepresented the capabilities of their previous version? I remember.

[@Solomonov8912]

When it's going to be released for the public? Gemini Ultra 1.0 is quite bad somehow

[@abdelmananabdelrahman4099]

😂 bro, for a minute there I thought it was the code report

[@mmmar7317]

It sucks

[@macreator9497]

lul i thought you are fireship when clicked the vid

[@DK1213]

bro thinks he’s fireship 💀

[@diga4696]

WOW. SHOCKING

[@LuisEdGm]

This is terrifying because Google owns it

[@GraveUypo]

Poor google, a video about their cool new thing and chat gpt completely stole it from them.

[@abitw210]

Sora for real used a regular graphic designer to make this videos, they are not ai, it's just a marketing catch

[@YOUR_MOMS_HP]

didnt understand anything frfr

[@mercerwing1458]

The video performance makes sense since they have experience with it thanks to YT

[@Cube_Box]

ohhhhhhhhhh right these sneaky mfs trained their AI on all of these YT videos Wait no actually OpenAI doesn't own KZbin, Google does

[@mercerwing1458]

@@Cube_Box My man this is a video about Gemini. Not chat GPT. Gemini does belong to google.

[@Cube_Box]

@@mercerwing1458 I was referring to Sora by OpenAI mentioned at the end of the vid

[@wizaaeed]

*students preparing all their savings for a subscription* 😂

[@635574]

This is first time the AI vidoes at the end are so good they have to be labeled AI generated.

[@alphar9539]

mfw AI ripoffs of code report but it’s better

[@PICubing]

dont be a fireship clone lol

[@oowaz]

bro what the fuck is that text to video????

[@piteshbhanushali1140]

No...

[@oowaz]

i haven't been this impressed by anything in a long time, it's thrilling and a scary thing to think about... open AI has amazing tech like this planned and they're just waiting for the right timing to drop

[@mindacid3274]

this isnt the code report? XDXD

[@gameXpoosed]

The code report really !!

[@timo6335]

1 mil tokens, not 10 mil

[@SebastianSipos]

too bad it's Google

[@AndreaDavidEdelman]

so what we can't use it.

[@michaelcharlesthearchangel]

Sora just dropped.

[@antongrekov7710]

bro thinks he is fireship

[@Hari-du6pt]

How does it cost to run???

[@Osanosa]

Holy shit

[@schweeeeeeeeeeeeeeee]

Straight up stole code report 👍🏻 continue doing that

[@adolphgracius9996]

Why you need 10M tokens?😂😂, you writing a book per prompt?

[@Garbhj]

Massive codebases, in-context learning (look at it learning kalamang). It's actually a really big deal.

[@mrrespected5948]

Nice

[@zentrans]

contrast these developments with the barbarity being unleashed at the same time

[@sebastyanpapp]

Gemini advanced uses what?

[@DarkSchneider7]

pearl or pro?

[@DrSid42]

Does it mean that Gemini source code finally fits into Gemini ? Just saying .. As for Sora .. we're so fucked ..

[@R2Bl3nd]

With AI generated video we're going to literally have infinite AI generated interactive real-time worlds, like The matrix.

[@oowaz]

i remember discussing about that with my friend years ago, we thought it was so far away from happening. crazy how these ideas that used to represent something beyond our lifespan are now so close to become tangible experiences

[@R2Bl3nd]

@@oowaz I know, right? I was also thinking just a few years ago about how the different personality cores in Glados in Portal 2 were like some kind of futuristic concept. Now it's practically feasible.

[@oowaz]

@@R2Bl3nd i find it thrilling and terrifying at the same time. i feel like we could be heading towards a future where the wealth disparity will just keep escalating, the super rich will become even more out of touch because they can just simulate genius supermodels to keep them company, who needs real connection when you can live like a god in vr

[@R2Bl3nd]

@@oowaz that sounds like the opposite will happen, where it doesn't matter if you're rich or poor, we will all have access to the same experiences, which will be more enriching and fulfilling than any earthly ones.

[@oowaz]

@@R2Bl3nd sounds extremely optimistic

[@itsmelukario5969]

🔥

[@AuntBibby]

when i saw openAI say "Sora doesnt do sexual content" what i heard was "Sora wont do content involving furries or trans ppl becuz it thinks theyr porn"

[@tahunuva4254]

You think that's bad, bing's out here flagging black skin as sexual lol

[@AuntBibby]

@@tahunuva4254 oh holy geez thats fucked up

[@crescentmoon256]

what is gemini?

[@Noicer_wastaken]

Bro, it's google's ai.

[@NotYoutube-cp3qg]

It's youtube

[@christianremboldt1557]

My mind is blown. That's actually more then just crazy to think about

[@seththedeveloper2212]

code report clickbait?! aww man

[@john23232]

No argument at all here, don’t watch !

[@Lubossxd]

thanks for the AI report lmaoooo. hoping for the sora summary sometimes soon, also with related papers