Problem solving across 100,633 lines of code | Gemini 1.5 Pro Demo

[@underestimator6764]

Love it when developers are building their own replacement.

[@Osjey]

These guys wouldn't do it if they were not making more money developing it.

[@vectoralphaSec]

Not only are they building their own replacement, they're building everyone's replacement. Because if they can replace developers then they easily replace everyone else. Pretty good.

[@statuschannel8572]

nothing is gonna replace developers, who is gonna write the prompt ? my clients? no way!

[@eyescreamcake]

@@vectoralphaSec Replacing everyone's jobs would be fantastic if we all benefited from it. But in a capitalist system only the owners of the means of production will benefit and the rest of us will be screwed.

[@vectoralphaSec]

@statuschannel8572 yes your clients. Developers will be replaced one day to believe otherwise is being in denial.

[@firesoul453]

Its going to be an interesting year.

[@theeternalnow6506]

The next 5 years will feel like a science fiction movie.

[@Bobcoolyoung]

Facts!!! 😂

[@RiwenX]

@@theeternalnow6506 yeah, a very dystopian one

[@GeekProdigyGuy]

​@@theeternalnow6506 unfortunately we don't know if it's the dystopian kind or not...

[@Danuxsy]

I said that by the 2030s neural nets will be able to make 3D games like Starcraft 2 by itself. I think I might be spot on.

[@LordKelvinThomson]

Excellent example of real world usage. I will definitely try this.

[@Ewakaa]

It’s hypothetical 😂

[@ElclarkKuhu]

​@@Ewakaa No, it's available to some people, You can also request for Early Access I think?

[@laser4beam430]

@@ElclarkKuhu I have access to Gemini after requesting early access it was not hard at all

[@danilo3009]

Finally Google is a real player on the AI future, I was sceptical when Bard was released, then somehow satisfied with Gemini 1.0, but Gemini 1.5 is very exciting, well done.

[@santhoshreddy2571]

They were more worried about ai safety, but openai pushed them to corner 😂

[@error200http]

Let's rephrase it: Finally workers at another company made a LLM with extraordinary use value. I was sceptical when this company's employees made a little out-of-date LLM, then somehow statisfied when workers at this company made a better product than other for-profit company, but current product looks very exciting, well done.

[@majectic-berry]

That's Demis Hassabis for ya

[@loveboat]

Too woke to do anything useful with though.

[@JanTusakovsky]

​@@loveboatnahh it does most tasks with no problems

[@TheDarkOneSC2]

Man what a time to be alive! I'm not so impressed with the demo but with the honest and transparent presentation. Good job on the presenter and the higherups that approved this raw demo instead of doing an elaborate lie

[@helix8847]

Someone hates Google. lol

[@mofik26]

@@helix8847 To be fair a third of their income comes from selling users data to advertisement agencies.

[@wlockuz4467]

This is still kind of a lie because its running on an open source codebase that's meticulously maintained to be easy to understand. I would be really interested in knowing how it performs on large codebases in general. Especially in large custom codebases where the code is not structured as well.

[@chriswiles87]

I need this as a vs code plugin to learn my codebase

[@santhoshreddy2571]

At the moment google is working on their own vscode replacement - project IDX

[@spooky4655]

It will definitely increase their sale if they make vscode extension

[@gavinderulo12]

Why wouldn't you use standard embeddings for that? You don't need a large context length.

[@battatouile8135]

@@gavinderulo12 Maybe he's the manager of a company's technology employees. This company may have several legacy codes, and migrating something, correcting an error or maintaining the code is quite costly in terms of time. In this case, it would be useful for him to have 1 million tokens as he would just need to place the file containing all the source code of the software that his team needs to work on

[@gavinderulo12]

@@battatouile8135 what? Just embed the document. Then the model can access and search the entire code even if its way longer than the context window.

[@AMA14700]

What a time to be alive

[@தமிழோன்]

I am already impressed that Gemini can understand and write Tamil language much better than ChatGPT. I am hopeful that Google continues to support non-English languages like Tamil so everyone can benefit from the LLMs - not just English language speakers.

[@spectrotsu6629]

Try gpt 4

[@blkscreen15]

punjabi and hindi are meh so far. Need equity of accuracy and excellence across all languages else languages will die off soon as people become reliant on English for LLMs

[@Choto160]

😂❤

[@Dex4Sure]

@@blkscreen15 English will always be the best language for LLMs. Its the same thing with things like Google translate. Translation to English is always best.

[@ramlozz8368]

This is crazy stuff, waiting for open AI response, what a time we are living ladies and gentleman 😀

[@holthuizenoemoet591]

its interesting and really cool now, but we won't be so happy after it has ruined / deflated the job market and destabilized the economy i a few years time from now. Mark my words, generative AI cause more problems than it solves

[@bjg6056]

To quote 2 minute papers:" what a time to be alive!!!"

[@maximusasauluk7359]

We love competition. Work Google, work. Work OpenAI, work, who wants my money? 💰

[@thaakeno5187]

OpenAI definitely responded and overshadowed this ngl

[@ramlozz8368]

Hahah I know they did fast, I have no words this is insane 🤯🤯 crazy times a head! I’m just worry for the average person, critical thinking skills will be the skill of the century

[@srinivas7876]

Google is always the king 👍

[@xIronWarlordx]

The king of violating user privacy, squashing consumer rights, and shoveling money into failed products.

[@Elmimoh]

عمل جبار حقيقة، تذكرت شخصا كان يقول أيام ما كان chat gpt جديدا، ما تقوم به هذه الشركة هو مجرد ورقة بحثية واحدة مقارنة مما توصلت به جوجل في هذا المجال، وأن ما ستقدمه جوجل سيكون شيء لم يسبق له مثيل. شكرا لجوجل.

[@hamzan5422]

هل لديهم عملة رقمية خاصة بهذا المشروع

[@lucilaci]

nice that you showed the chat and did not make a video like when you first introduced gemini ("The capabilities of multimodal AI | Gemini Demo")! :)

[@PseudoProphet]

I think they will make that demo a reality in their next phone, 100%.

[@vidal9747]

​@@PseudoProphetwishful thinking is not a good enough reason for deceptive marketing

[@PseudoProphet]

@@vidal9747 you think that is wishful thinking?

[@carloareaser]

Imagine what their confidential models are capable of. These are just versions open to the public.

[@vidal9747]

@@PseudoProphet don't know. That is what they want to happen. If they couldn't make it happen with their best models, it is wishful thinking and it's not sure to happen soon.

[@horsey8516]

Professional thinkers making professional minds = next-gen AI 🐴

[@samgodse5824]

I don't want to call this out but I personally feel like this demo is a bit flawed, here's why: The codebase is actually set of examples based on three.js modelling --> in simple words the codebase is actually a collection of **independent** code files. A more accurate demo would be possible if they did it on a codebase with integrated units and functions. I know this is actually showcasing power of large context handling but then if the sub-context are independent of each other then it can be achieved by iteratively going through the small subcontexts. So in general the AI doesn't see the whole intermingling since there is none.

[@Slav4o911]

Correct, they probably did it with RAG, the actual context is not 1 000 000.... and even that will probably be only available for corporations, so we will never see it. They've basically used the AI as a "search engine". The AI didn't actually comprehend the whole context. I'm very skeptical to what they've shown.

[@LynnKereluik]

The Gemini Google assistant should be an asset ruled by mercury the planet of communication of all signs 😊

[@FloWoelki]

looks really interesting. 2024 is going to be wild :D

[@gonzalobruna7154]

this is actually awesome. I'm truly excited to try out gemini 1.5, and looking forward to the Ultra version coming soon! that's going to be wild.

[@maxvankekeren3443]

If they can manage to actually pull this off this is going to be wild!

[@sjwimmel]

Ooohhh, that's a lot of tokens!

[@IntensePeppers]

What is a "token"?

[@captin_popsicle9374]

@@IntensePeppersThe college of computer science. This is an example sentence. Each word is a token in that sentence. Im not sure if a period or a comma is a token though

[@danielbigham]

So encouraging. Great work!

[@trippyabsolute]

I’m impressed and scared at the same time. Wild.

[@advance512]

This can be a game changer for coding, if made 20x faster

[@driftedsun]

It doesn't need to be 20x faster to be a game changer. The big sell here is the context window and accuracy. 60 seconds is nothing. Prompting with a smaller context window should still be quick.

[@othercryptoaccount]

If you can ask where something is in your companies massive codebase that would be one of the biggest things yet. I’ve wanted this for so long.

[@nicegui87]

🎉?​@@driftedsun

[@lambo3383]

​@@driftedsunか

[@AbdurRahim-sg1jg]

​oooo

[@Words-.]

Seriously impressive

[@MdkobirMdkobir-xk4st]

😅 1:19

[@omarguerrero2814]

Insert *Willem Dafoe looking up meme*

[@HYRULE10]

"I am unable to engage in discussions that could be construed as biased or offensive. I am an AI chatbot designed to provide information and assistance in a neutral and unbiased manner."

[@staticmind1872]

The beast of Mountain View has awoken

[@ycombinator765]

Awoken, wow!

[@ycombinator765]

wait, that IS a word, wow! my bad

[@wlockuz4467]

This is very easy when the codebase is as clean as threejs's. If it tried to understand one of my code bases it would decide to self destruct.

[@badchuckle]

Those who might be confused with the naming. Gemini Pro 1.0 (free) Gemini Ultra 1.0 (paid $20/month) Gemini Pro 1.5 (exclusive) Gemini Ultra 1.5 (didn't come out yet)

[@unimposings]

proof that this is not fake again, like your last promotion!

[@GeneralKenobi69420]

Ilya Sutskever: "You destroyed everything I know" Demis Hassabis: "I don't even know who you are"

[@web3global]

WOW! 🤩 We're in the future! 🚀

[@chessstumble]

Very very very very very very very very good, helpful, useful, and beneficial.

[@falklumo]

These are all examples of tasks a human programmer would find easy to perform and wouldn't turn to an LLM for help. What about the hard tasks, like refactoring the codebase for cleaner and less redundant code? Any examples for this? Even failed examples would be interesting to share!

[@matthewdignam7381]

I'd say it could definitely pull it off

[@javierflores09]

I mean, that's pretty much the point. If LLMs get accurate enough that we can leverage menial tasks like these to them, then we can center our focus to the more complex problems such as architectural and efficiency/performance issues within the codebase. It's all about being able to improve DX

[@helix8847]

Yeah if you knew wtf your code did, have you ever gotten a project that is a total mess and spent hours going over it... its a nightmare. This will help greatly with that.

[@falklumo]

@@helix8847 I actually used 'grep' previously to search the exact same codebase for code snippets. Not that hard really ...

[@AyushKumar-f5y3l]

Crazy to see what competition can make you do. From so called "AI Assistants" to this within like a year in a blink

[@andregustavolr2k22]

No more netflix! Reality is becoming my source of entertainment! Thanks Google!

[@MrAmad3us]

Good to see Google can counterpunch. Exciting times

[@Slav4o911]

Can they, their current Gemini is trash.

[@airplanegobrr]

Jesus absolutely dominating openAI! Way to go Google! Hope these models are some day open source and we will be able to run them on our own hardware!

[@roxxxxxy]

damnnn, Google is coming for OpenAI

[@Guardian_s_]

Coming for Microsoft Not OpenAI

[@staticmind1872]

@@Guardian_s_ same thing

[@deniskhakimov]

The most precious thing is that Google is back in the fight! 🤗

[@BenKDesigns]

Hey, this is amazing! But, um...can you guys like...apply this kind of zeal to fixing your current assistant or something? I'm really getting tired of feeling like it's somehow gotten worse over the past few years. Like, this morning...I said "Hey google, I want to listen to 'I Am Hell, by Machinehead'. Instead, I don't even know what it started to play. I had to try FIVE different times in five different combinations of the artist and title before it just decided to work. Or, heck. I have a custom routine set up so that where I say "Page ". Who is this Simon person? Why do I give a crap? How hard is it to make the assistant smart enough to recognize that I have this custom routine and keywords in there, and figure out that I am NOT interested in pictures of this Simon person? So, yeah, if anybody at Google is listening...PLEASE. Make this technology the new assistant...NOW. And use this massive amount of context it can have to make it learn everything about me, the people I know, and the music I like to make even *slightly* more intelligent guesses at what I want to do. Because seriously, it's insane when you guys are investing this much time in a paid chatbot while the one you already have schlepped onto countless devices is barely capable of figuring out the song I want to listen to...

[@BenKDesigns]

And, an update to the above: Today, I opened my assistant on my phone, and clearly said "I want to watch Baby Shark on the Family Room TV". I saw the text, it heard me. What was the reply? "OK, playing your playlist 'Baby Driver' on the Family Room TV'. WHY? HOW? WHYYY?

[@laurensjvg]

OpenAI finally getting some real competition

[@piteshbhanushali1140]

Its fake...

[@smitpatwa3055]

Step1 Give it all the stock market data. Step 2 Ask it what stock to buy Step 3 ??? Step 4 profit

[@Slav4o911]

Buy Nvidia... that's what the bot said. 🤯

[@not_hehe__]

a million tokens is crazy, AI is getting better at an insane pace

[@edudocerrado8584]

Would be nice to hook this to a large codebase, I bet it would speed development a lot!

[@thogos3758]

when is this coming to the gemini website?

[@laurencevanhelsuwe3052]

This will give us a generation of "programmers" who have taken script kiddie "work" flows to the next level.

[@jaspercaelan4998]

I doubt there will be many software developers left in 5-10 years.

[@Tom_Neverwinter]

OK. Let's see it get some Github code requests completed. That's the ultimate benchmark.

[@majectic-berry]

I find it funny how software developers are the only ones who actually get EXCITED when an AI does their job better than them

[@TOI-700]

#amazingWorkGeminiTeam 😂😂😂

[@VaibhavShewale]

ooh damn, this can help me in learning new things

[@relegendize]

Testing their new project on a Mac of Apple, their biggest rival? That’s wild

[@0siiris]

for what i use AI for, context length is critical. hope to see open ai push the limits of context like this as well but for now gemini has won me over!

[@lala-r8u]

عالیست ❤❤❤❤❤❤❤❤❤❤❤❤❤❤❤❤❤❤❤خداداخاللاهلالهلاه

[@prakhars962]

Ok I tried Gemini 1.5 pro. it can't write a code to solve a euler bernoulli cantilever beam in python.

[@turolretar]

oh well

[@ViprazDesigns]

how long did it take you to get accepted into the waitlist? because there's a waitlist for Gemini 1.5 pro right now and you have to sign up

[@prakhars962]

@@ViprazDesigns 2-3 months

[@georgeodongo4734]

For the time being...give them one year only

[@MondayGone]

Great! I look forward to the release date.

[@fiffy6572]

the future looking amazing for learning

[@holthuizenoemoet591]

why would you need to, with these models ever increasing in capabilities, what's the point.

[@fiffy6572]

@@holthuizenoemoet591you know humans build those things right?

[@sneer0101]

​@@holthuizenoemoet591 You're clueless

[@sleepnaught]

0.01% of developers work on something like this. Vast majority won't be around much longer.

[@fiffy6572]

@@sleepnaught we don't see farmers using the plow by hand either, this is just the next step

[@Okamine]

Are they using macs? Not a chromebook or something?

[@xIronWarlordx]

Can you actually do anything on a chromebook other than browse the web with chrome?

[@Okamine]

@@xIronWarlordx probably, who knows 🤷‍♂️ Haven’t got the chance to test one yet.

[@atierintel]

Can we just admit it is already doing much more beautiful things as opposed to simply fixing our code? Such as driving individuals with principles of deep cognitive thought, critical deep discussions, high levels of intellectual stimulation, positive feedback loops, understandings of the broader world, psychology, music, art, war, politics, human nature, philosophy, research, ?

[@overpope3510]

Brother, don't get all psychotic. Ai is literally trained on the entire Internet. It's still just a search engine for latent space

[@ЛукаЋоровић]

Google be like: "Trust me bro!"

[@kaimueric9390]

The big question is, are all these claims actually true in real life (once the model is available), or it's yet another misleading (or should I say, fake) video, just like the one circulating before Gemini was launched?

[@Slav4o911]

Probably not true. In Google place if I wanted to impress people, I wouldn't tell anyone and just update the model and when people start to freak out how powerful is the model, then I would reveal the demo.... not the other way around. Remember what OpenAI did, they first put their ChatGPT, people started to freak out heavily, then OpenAI started to dumb down and censor their model (because it was just too good). Google does the opposite, they show us the uncensored model and then the release version is lobotomized and it's nothing like what they've shown. We already know these models, when uncensored are very powerful and when censored they become braindead. I mean when model is censored it's censored all around, it's like getting a genius and make a lobotomy to him. If people think some non existent "safety" is more important than AGI, we'll never have AGI. I mean somebody is still going to build AGI and take on everyone, but everything will be done in secret, which is much more dangerous... but people who don't understand the subject, have already made the decision.

[@MrHaloshot]

Will be the end of people in Tech ? What if i throw my entire code base and ask to run tests and solve all the current issues ? Or if i ask to build an entire codebase end to end ?

[@triq0]

the fact that it’s not a live demo leads me to believe that getting their model to perform like this took many attempts so they recorded only after they got it to work. would have been much more impressive if it had been a live demo edit: not that this isn’t cool af

[@lack_of_awareness]

this isn't showing much, how much of this data was already in the training set to begin with? how much of your question is it actually bothering to use the data given in the prompt rather than straight up memory? how about you put some hidden phrase in the context somewhere in the middle, and ask to "spot a hidden phrase in the given data". see if its actually attuning to the text, not just glancing at it

[@jcy089]

What’s the output token limit though? If it’s like GPT 4: 100K input and only 4000K output then it’s still going to be pretty limited. GPT 4 can ingest a whole novel but can’t generate you a full essay within the output token limit.

[@DigisignD]

But you can tell it to continue, right?

[@Neolisk]

GPT4 cannot understand or extract details from the video, only understand at high level.

[@purpleAiPEy]

good choice with threejs. the most obscure library.

[@themdr00]

Google is still behind

[@vectoralphaSec]

Lol this announcement AND OpenAI's new model SORA. This year 2024 is gonna be wild. Its still barely February!!

[@EXTERMINADORJAVIER]

What a coincidence that Google starts launching AI engines directly after OpenAI and now they want to catch the first place but you Google, are too late.

[@nikplaysgames4734]

I'm honestly quite conflicted on how to feel about AI. In one sense, the fact that we are coming up with these capabilities are insane, and I think the progression of technology is super cool. On the other hand, I can easily see this taking away jobs from web devs once this gets more advanced. Also, I think AI has made a super negative impact on education. Kids who can't write a competent sentence are now spouting out full well written 5 paragraph essays. (though my english teacher says it's stupidly easy to tell when a kid uses AI, as the writing style is super robotic. You can change this, but the people who are AI generating essays to turn in probably aren't adding the right parameters to the generation of the essay to make it sound more human).

[@r-8009]

"I can easily see this taking away jobs..." The technological trend in the long term is that labor-saving advancements actually create jobs on net, not lose them. Why? Because the new technology which displaces previous laborers is always more efficient, meaning that it achieves greater results at lower cost. This is a gain, no matter how you slice it, because it frees up resources that would otherwise be expended, and so those resources are now available for other uses, and so end up being applied to other ventures and projects, thereby expanding the sum total of enterprises on the whole, which, by extension, increases the general demand for labor in some form or other. So it's actually a fallacy to suppose that just because particular jobs are lost today, that people must be worse off in general. In truth, everyone is better off when more efficient technologies become widespread, even if that means that in the short term, someone's job gets lost. "I think AI has made a super negative impact on education." With all due respect, you're not talking about education in the meaningful sense, but schooling, and your concern isn't with the quality of the material learned, but with the possibility of cheating. If the possibility of cheating is all you are focused on, then yes, AI is a problem for education. But if you focus instead on the greater implications of this technology, then it will soon become clear that traditional education structures are going to have to be rethought completely, and it won't do to try to rigidly maintain them by unlovingly calling every creative workaround for stuffy, irrelevant assignments "cheating." Truthfully, students who demonstrate that they can solve problems efficiently are to be commended, not reviled. But because the schooling system is not designed to reward out-of-the-box thinking, they are unfortunately reviled.

[@Person-who-exists]

But did you fake it like the initial demo video?

[@Slav4o911]

It's real but this one in the demo is called Gemini ultra super duper... and not Gemini Pro... they just made a small mistake and showed us Gemini ultra super duper, instead of Pro....

[@andriisokyrko4803]

Lol, at the same time, Gemini Ultra 1.0 refuses to write meaningful shaders, can't make protobufs for the existing code(and copilot can) while the demo was super impressive. It just gives a lot of random information you you didn't ask for.

[@hanspeter24]

google using apple machine 😂🤷🏽‍♀️🙌

[@am01013]

Is it a real demo this time?

[@ivanignacio2353]

so that quantity of tokens used for analize a code that big, how much money are we talking about approximately?

[@Slav4o911]

Probably only for corporations, that's why I don't like these Google demos. If it's not going to be for everyone, don't show it. (I don't mean they should give it for free, I mean it should be with reasonable price) . Today their regular Gemini is a trash.

[@edenassos]

@@Slav4o911This is their KZbin channel, they can show what they want. Why are you gatekeeping when you’re broke?

[@ivanignacio2353]

yeah maybe it's cheaper to hire a developer lol @@Slav4o911

[@27sosite73]

do i understand this right openAi for chatGpt 4 price is $0.01 / 1K tokens here we are talking about request with 1kk tokens so price for each request (approx if we take $0.01 / 1K tokens) = 10$ per request

[@ts4gv]

If AI stops exactly where it is right now that'd be perfect but the problem is I don't see this stuff slowing down anytime soon so as a result I'm inclined to hate every single new development, no matter how cool

[@sanjoynathgeometrifyingtrigono]

How much do it cost in India?i need it

[@peaklander1]

Yeah, it's over guys. Pack it up.

[@JOHN.Z999]

Gemini ♊ is better now!!!! ❤

[@Guardian_s_]

ChatGPT 5 is coming now

[@abe6215]

If this is true, Open AI has some homework to do

[@yehaa00]

More like "ClosedAfAI"

[@abe6215]

@@yehaa00 😅

[@ycombinator765]

@@yehaa00 😂😂😂

[@GrindThisGame]

Microsoft AI.

[@babytv7136]

We want it open source

[@jimchen8759]

when i asked gemini for coding, it always showed the example code with outdated version. Even it could search everything on internet. That really confuse me 😢

[@egonvanpraet]

Huge if true!

[@Slav4o911]

It's not true... they also did similar "demo" before, then in reality it's not what they've showed in the demo.

[@ankitnmnaik229]

​@@Slav4o911 cause they Nerf it due to some stupid safety standards

[@pabtorre]

1 Mega token ? 1MT?

[@dirverslicense]

is it for real this time ?

[@xXMaDGaMeR]

how do we know that wasn’t part of the training data ?

[@Leto2ndAtreides]

Impressive!

[@xiaoai877]

All of sudden I thought Zuckerberg purchased Google

[@akf2000]

Please release Gemini in the UK

[@tuapuikia]

Singapore can use it now 😊😊😊

[@HiddenExp]

The thing is, can it solve "unwritten-before" problems?

[@archardor3392]

No.

[@ultimultig]

we losing our jobs with this one 🗣️🗣️🗣️🔥🔥🔥

[@RUMPshit]

Isn't this just using RAG?.... I feel like google is lying again

[@insightsAtDawn]

The Great Filter in all its glory

[@MartiQwx]

I like it, keep it up

[@paltaboo]

Would it be possible for Gemini to read code bases, like a python project and the modules in the projects directory in my drive? its currently only limited to reading documents or pdfs.

[@konstantink2396]

When?

[@user-hd5gz4de7y]

Fool me once, who will believe this is real after google faking their first AI video

[@aravjain]

GPT-5 will be much better, I don’t doubt it. Likely hundreds of trillions of parameters

[@staniekkkkkkkkkkkkkkkkkkkkkkkk]

How much energy does analysing such thing require?

[@GrindThisGame]

6 energon cubes.

[@brakweny]

What about Gemini Ultra?

[@KhialMustapha]

There models are definitely very strong, i am just imagining whats going to happen once these models are wired to us via neural interfaces!

[@holthuizenoemoet591]

Then they will just very subtly filter the sensory information that you receive and make you not perceive things that aren't aligned with googles business model :)

[@h20dancing18]

@@holthuizenoemoet591 the cheaper and faster solution is to make AR glasses like Apple vision pro that filter things visually. also wdym by google business model? and (for my own sanity) is this satire or not?

[@edenassos]

Would not change a thing if you are not intelligent enough to utilise that data.

[@turolretar]

they’ll probably use people to train their super AI

[@KhialMustapha]

​@@turolretar i mean models generally, not google's, remember also that your brain is still YOUR brain, so you will be able to filter data coming into it just like you filter data you read by your eyes or your ears