I can't believe this is real

window.ai is the new API coming to Chrome for embedded Gemini Nano. I am impressed. There's a lot of potential here, but also a lot of silliness.
SOURCES
x.com/rauchg/s...
ai-sdk-chrome-...
Check out my Twitch, Twitter, Discord more at t3.gg
S/O Ph4se0n3 for the awesome edit 🙏

[@andrewzuo86]

Because Chrome didn't use enough memory before.

[@ivanfilhoz]

I wonder what the minimum requirements for a functional computer will look like in a couple of years.

[@gordonoboh833]

@@ivanfilhozthey would automatically be gaming laptops ready.

[@gordonoboh833]

@@coolemur976 computational resources, cpu clock cycles to process the input and output of the model, it would need to be loaded to a fast memory(RAM) for that computation to be fast enough that a user wouldn’t pull hair.

[@gordonoboh833]

Assuming it runs on cpu, most likely npu or gpu, either way you need RAM.

[@t3dotgg]

omfg

[@echtertill]

Alternative title: Chrome is getting more bloated

[@exceed.charge]

sequel title: edge copilot gone wrong! (gone sexual) (police showed up)

[@RoyerAdames]

lol but I like it

[@itamarsharify]

Alternative approach, browser is an OS

[@alexandreg.1000]

🚫 Add a compatibility level between AI software and browser ✅Add AI software into browser ...

[@RepChris]

@@itamarsharify EMACS is quite the decent OS, its a nice webbrowser too, just lacks a good text editor out of the box

[@bill_and_amanda]

We did it y'all. We found the one way to make Chrome use even more RAM.

[@LoopikCZE]

But who cares I hame 40GB on my desktop. Ram became so cheap lately, that it doesn't even matter. It will force Apple and others to sell ram for less, because 8GB is joke today.

[@sansmoraxz]

@@LoopikCZE my workplace cares where we are forced to use systems with 8 gigs of ram.

[@leeroyjenkins0]

​@@LoopikCZEhave you heard of smartphones?

[@_nom_]

​​@@LoopikCZEDoesn't sound like a good number. You may be slowing down your ram

[@MayankXOR]

@@LoopikCZE I have 4 gigs of RAM :(

[@tinrab]

The use of the word "delve" in comments is about to skyrocket.

[@Interpause]

lets delve into that phenomenom shall we?

[@le9038]

?

[@ajmaln]

Lets embark into delve

[@CaptainHottub]

@@le9038 ChatGPT tends to say "delve" a lot more then humans do. Apparently, in 2022, the number of scientific papers published with "delve" in the abstract or title was 0.056% then it shot up to 0.789% in 2024. Meaning, it is very likely that ChatGPT or another LLM was used to write some of them.

[@cherubin7th]

Delve into delve delve

[@JohnDoe-jh5yr]

What could possibly go wrong?

[@JohnDoe4321]

I asked the AI the same question. and it said nothing could go wrong. So we're OK 😁

[@inononeeee]

access our saved passwords and post promotions on our personal accounts, we don't even know who?

[@cerulity32k]

-r /

[@ffuyu]

DISASTER STRIKES

[@gamefun2525]

the dependency and trust on the knowledge of the model. it can blurt out random inaccurate shit if not used correctly

[@ymi_yugy3133]

I don't like this at all, because it feels pretty fundamentally at odds with the idea of an open web. How is the W3C supposed to come up with a reasonable specification for an AI model that can be implemented independently by multiple vendors? How are developers supposed to build websites that offer a consistent experience across browsers? What about backwards compatibility. The web tries really hard to not break content. How can browsers make sure that an update to their model doesn't break any websites? Even more fundamentally these small embedded AI models aren't very general, but have to be highly tuned for specific scenarios. Browsers obviously can't ship models for specific scenarios. So here is what we get. A shitty, browser specific language model, that breaks with every update. If I had to guess the only thing we get out of this will be small demos and companies running their crappy customer support chat bots on the client to save on server costs.

[@ea_naseer]

The specification would be led by Google most likely

[@ymi_yugy3133]

@@ea_naseer I don't mean the specification in terms of the API, but it terms of capabilities. If I build a feature on top of this AI model the same prompt should give me similar results regardless of whether I'm doing it in Chrome, Firefox or Safari. That's the part that is really difficult to specify.

[@dalehorton7748]

This is kinda why Chrome exists in the first place, Web standards were being written, browsers like Internet Explorer simply didn't care, and browsers like Firefox cared more about retaining compatibility. Google cracked the shits and wrote their own standards-following browser as a tech demo, and it became the only "proper" implementation and we all adopted it. Alternatives took many years to catch back up. The web adopts whatever works and gets used, it can't get used until it exists, and Chrome has often led this charge.

[@averagegeek3957]

@@dalehorton7748 And now they are trying to become the new Internet Explorer by adding non-standard behavior that will break sites on every other browser

[@itsmeagain1415]

@@ymi_yugy3133 by the fundamental nature of ai this is impossible! so you are effectively dismissing indeterministing computing as a whole from having the convenience of a specification

[@ahdog8]

I feel like Chrome is just going to keep adding stuff to the API that only their browser supports so the other browsers fall behind and they get 100% market dominance

[@alekkrstic]

I feel like the inverse would happen if they start deviating from standard

[@AndrewTSq]

Are there apis today that only Chrome can use?

[@Reashu]

​@@alekkrsticexcept that they run enough of the web to just "break" other browsers

[@pelic9608]

Microsoft tried with IE and failed. Google will with Chrome, too.

[@zBrain0]

​@@AndrewTSqI daily drive Firefox, and it is fine 99.99% of the time. But there are definitely websites out there that don't work quite right. It's hard to say whether that is because of some deficiency in Firefox or if they are doing something in a chrome specific way. I can say that most web developers nowadays probably only test on Chrome. Which would lead to Chrome basically being the standard. If something breaks in Firefox it is more likely that Firefox will have to change the behavior of their browser to match Chrome rather than web developers making sure their stuff doesn't break. All of that to say, if Chrome introduces a feature like this Firefox will need to have some sort of approximate equivalent because every moron web developer is going to jump on this train and nobody's website is going to work anymore without it.

[@eUploads]

this is gonna be weird for cross browser support

[@Kannatron]

Could allow handoff to an os based model in the future I hope

[@Jaryt]

@@Kannatron Good thought, but even that'd be weird. The main issue that if you're using let's say a windows model, vs an apple ai model, you'll get very inconsistent results. (same if you have a firefox embedded ai vs chrome embedded ai) ...almost like it'd be a need for a new browser standard that no one would ever agree on lol

[@cerulity32k]

god i hope this doesnt get to firefox

[@husanaaulia4717]

Why though? Can them just follow what Chrome did?

[@thatanimeweirdo]

​@@cerulity32kThey are sadly very fond of AI lately

[@Cyber-Talks]

It's not meant to be used for this kind of questions I think Theo missed what's written next to the feature flag he turned on: "This API is primarily intended for natural language processing tasks such as summarizing, classifying, or rephrasing text. It is NOT suitable for use cases that require factual accuracy (e.g. answering knowledge questions)."

[@malikau917]

Thanks for pointing out, I’ve missed this as well

[@ZoranRavicTech]

Those are still a pretty challenging tasks. I doubt you can achieve a reliably good result with a small model. You're still better off doing it on the server or distributing a desktop app, so you can make full use of the gpu.

[@Cyber-Talks]

@@ZoranRavicTech Distributing desktop app is not always an option. While doing it on the server can be a better solution in terms of the quality of the answers this has a computational cost which is not small in lots of cases. Maybe doing it on the server as a solution for those not using Chrome is a valid overall solution. How other browsers can support this kind of feature it's also a question I'm not sure we have a good answer yet( how it can become part of the web standard?)

[@DanielMelogpi]

I detest the idea of a Google model underlying the implementation of a global method. What about other browsers now and in the future? How about the spec of what to expect from this? It nevers works well when vendors add they proprietary shit like this

[@calimio6]

back to 1999 internet

[@frenchButt44]

Why not, don’t use if you don’t want or use firefox or some shit..why cry.

[@kenwarner]

They should make the model configurable like default search engine setting or something

[@vaisakhkm783]

I am sure it user will be able to download multiple models... firefox also doing a similar thing, but for image alt text..

[@skeleton_craftGaming]

I love how Google learned nothing from Microsoft doing this exact same s*** with IE in the early 2000s..,

[@echtertill]

Yeah it sounds cool if you're on the AI hype train but in the end it's just more bloat, especially if you want a lightweight / minimal setup...

[@avhiro]

my thoughts exactly

[@RepChris]

If you want a lightweight/minimal setup you dont want chrome anyways so ignoring the fact that everyone is going to want to mirror chromes features there isnt any loss

[@consciouscode8150]

I'm on part of the hype train and even I think this is like 4 years too early and contributes to bloat/global namespace pollution

[@tablettablete186]

​@@RepChrisWhat is the lightweight alternative?

[@victorbitencourt9481]

Maybe a terminal web browser like Lynx 😂

[@Alcaline-hu2vu]

Please don't let this become industry standard, fuck that, I do not want AI models running directly on my machine, specially because I know the React devs are going to go absolutely nuts with this and make websites 10x heavier. Also people using older devices (me) be damned I also feel like this is breeding ground for a new fragmented internet era like in the early 2000s, when every major browser had its own specific APIs so most websites would only work on one browser, but then there's like 3 of them that only work on the other browser, so now you either can't access half the internet or need 3 different browsers on the same machine

[@DoubleRainbowXT]

dont worry you can always disable it in flags also chrome cant add it on mobile if you dont habe a lot of ram.

[@test-rj2vl]

People might be tempted to leave AI prompts in code - because who would like to study 20 different JS frameworks that all have high learning curve just to get Hello World done in NodeJS. Meaning that then all the browsers have to support AI or some sites are just broken.....

[@achillesa5894]

Would you rather have all the AI running on a random server somewhere which doesn't work while offline, requires high bandwidth, and might decide to go down for no reason? Local is 1000 times better. Now do I trust google with it? That's a different question. This is a great idea but it should be an open standard.

[@ZipplyZane]

@@achillesa5894 It should be quite clear that we'd rather have websites not use AI at all, unless it is absolutely necessary. The only way I like this is of websites have to get AI permissions, and that they get to specify the AI model.

[@malikau917]

You are too old, close web page and go read paper books

[@IamProcrastinatingRightNow]

We already reached a point in which there are only three browser engines left. Chromium, WebKit, and Gecko. But if different browsers include different AI models that lead to different results, it might be very quickly hardly possible to use anything but Chrome. Assuming even the other Chromium engine browser, like Chromium or Edge, do not have access to the same model. And when there is only one browser left, the war on ad blocks is won by Google. And so much more. User tracking simplified for Google and Google alone. Maybe predictive modelling? That's the right moment for an "outstanding move" meme.

[@opposite342]

Technically there's also Servo, but it's very early and ambitious in its project. Regarding browsers, Google has been and is going to continue winning. So not much others can do either way imo

[@test-rj2vl]

And now combine it with Google's web DRM. We need some sort of antitrust lawsuit to make Google sell chrome and prevent them creating a new browser in the future.

[@MatthewSwabey]

Yeah the whole trusted browser DRM where it verifies the operating system and extensions and everything before rendering the web page is kind of terrifying

[@rollthedyc3]

This is terrible. It's not standardized. It's just chrome imposing it's dominance again.

[@stepans2167]

It's literally behind a flag, what are you talking about

[@mtx33]

@@stepans2167 for now, as usual

[@MrHamsterbacke756]

Yes, because feature flags are meant to stay forever.

[@meru_lpz]

"How terrible!! Chrome being more feature-rich than the competition!!"

[@stepans2167]

@@meru_lpz to be fair, standards are there for a reason

[@ottergauze]

Can't wait until all the Chromium Electron apps I have installed suddenly grow by 400MB.

[@Gentoo701]

Bro, can't wait until all electron apps will ship their models.

[@sleepykitten2168]

It got a lot of info wrong. For example, the new england patriots did not win the superbowl in 2001. The baltimore ravens did.

[@MrEnder0001]

1. Its beta things will change and improve there is a reason its not even on canary yet, its for devs only rn to learn about 2. It is all instantly ran locally on his computer so it may not be used for information but maybe for generating content like recommended tags for a video given the title or something

[@null_spacex]

Oh my, a feature not ready to be used isn’t ready to be used. Who could have imagined that?

[@akam9919]

​@@MrEnder0001 i know this is nitpicking but, excluding the fact that an offline ai model without access to a database of modern relevant topics and associated tags would likely give poor tag choices, recommending tags based on the video title would not work for like half of youtube clickbait.

[@outtrigger]

who cares who won the superbowl. as long as it gets the important stuff right thats all that matters

[@t3dotgg]

The model really likes the Patriots

[@pencilcheck]

This will go very wrong and misuse in the future lol

[@trietang2304]

Just hope they don't actively train that model when we using our browser.

[@akam9919]

...you already know the answer to that.

[@vaisakhkm783]

They can't, our gpu sucks for that it's much easier to sent data to server and training it, which they already doing

[@xaf15001]

​​@@vaisakhkm783They can't, but now they have more reasons. "Hey bro, you used the AI a lot lately. Can we get some data as described in [comically long lawyerspeak]?"

[@vaisakhkm783]

@@xaf15001 i read entire terms and conditions of meta ai when it came to whatsapp, where it's written, if we accept to use ai, our private messages will be shared with 3rd party vendors, and might be reviewed by humans.., so ya

[@tschorsch]

​@@vaisakhkm783 I would assume that that is what the OP meant.

[@andrew_ray]

I will submit that if your business model involves spending more on parts than you can charge for the product, you have a BAD BUSINESS MODEL.

[@palmberry5576]

They have a good business model, you just don’t agree with its morals or long term practicality

[@Cool_Goose]

I wonder how the heck one would do debugging between different browser versions and what I assume might be different llm implementations.

[@thedreamingtechie]

Yeah, it would be super difficult ensuring you get consistent outputs across different browser implementation (probably bundled with different LLMs). Prompt engineers would be excited about this 😂

[@thygrrr]

"The median website in 2025 downloads 539 kiB of javascript and 2.18 GiB of language models."

[@tnypxl]

I just need my browser to render web pages and make keeping track of the ones I like a pleasant experience. I don't need it to do any more things than that.

[@raymond_luxury_yacht]

And what happens when you don't need web pages anymore because the model will render everything in a format that's best for you, not the designer? The web is dead. Real time rendering of content retrieved from database and constructed on the fly is what the future holds. Thank god. Imagine the entire website industry gone.

[@rasalas91]

autocomplete, TL;DRs, translation, ask a webpage/pdf, ...

[@Aoredon]

@@raymond_luxury_yacht Keep dreamin' buddy

[@tnypxl]

@@raymond_luxury_yacht Thanks for the laughs.

[@tnypxl]

@@rasalas91 Literally what extensions are meant to provide. This does not need to be part of the core browser.

[@imjens.k]

I hate everything about this standard. This feels like one of the biggest 'AI' snakeoil implementations I've seen to date

[@freedustin]

You: "Chrome" Me: *Tab Closed*

[@joszze]

Nobody can ignore this thumbnail

[@LaughingRam]

My browser ai told me to set my house on fire.

[@JohnDoe4321]

You asked how to get rid of termites. Setting the house on fire got rid of the termites. AI answer was 100% correct. 😁

[@LaughingRam]

@@JohnDoe4321 the prompt was actually "my wife sleeps a lot. What's the best way to wake her up?"

[@COArSe_D1RTxxx]

​@@LaughingRam Well, doesn't that do the trick as well?

[@xgui4-studios]

@@LaughingRam lol

[@vaisakhkm783]

Before ai, a guy on reddit too told me the same... so... not much different...

[@AGentooUser]

Even if the feature is good, All of us became too fed up with ai

[@SanyaZol]

The background is dark and `undefined`... Gemini seem to be learning from javascript

[@ZipplyZane]

Also, per W3C standards, this should be prefixed. You do not add new features to a browser that is not intended to be a potential standard, and you do not make anything proprietary. It's a clear example of Google being against the open web.

[@Farstors]

Today in another episode of... "Google fucks with web standards"

[@torsten_dev]

Yeah building a web standard around closed source AI models sounds like a great idea. That won't enshittify the web _at all_.

[@lpls]

Chrome is the new IE

[@dariofagotto4047]

Context? Who needs it; I really hope this will download the model (or hopefully models) on demand and not on install (with maybe hints in manifest for offline webapps using it), I don't want like every electron app to become 1GB larger just cause

[@naturegoggle]

They should add google translate built-in in the browser first.

[@Reashu]

Isn't it there already?

[@naturegoggle]

@@Reashu yes. I meant the one where user can type and translate. not just websites translations.

[@renealbrechtsen9743]

I don't want this built into my browser.

[@Aoredon]

cry

[@RealUniCat]

use firefox then

[@blueback999]

…is this some kinda moral high ground thing? because otherwise you could just, idk, not use the feature?

[@thomassynths]

might have been useful in a tool like node. I think its worthless in a browser. As a user of a website, I would disable the beature. If I want to run a local llm, I dont need chrome to do that.

[@akam9919]

I can see one case where offline AI stuff could be useful...but if you can't mix and match whatever AI model you want in there... but it should be controlled by the user and not the browser... That being said, most AI features are total BS or near useless. There are really just a few dozen of use cases at best...but they are not necessarily something an LLM would be good at dealing with. If I want AI, I'm either running my own models locally in a non browser environment because I have horse power and have the time and energy to give a shit about it for five minutes, or I'm using a remote one because I don't have a good enough model or the compute power. Therefore, this thing is ultimately useless.

[@AvanaVana]

11:40 you mean “the background is dark and _undefined_ “ 😂 Also, this video is giving me vibes of way back when I downloaded and built from source an early chatterbot written in C (can’t remember its name…it was in the vein of A.L.I.C.E. and such)…this would have been 1997 or 1998.

[@J-wm4ss]

ELIZA? It was supposed to be a therapist and was very primitive

[@aeronwolfe7072]

you have a mounted drive called 'Incel'.... lolol 0:59

[@AntonioBrandao]

lmao

[@comosaycomosah]

lmao good God

[@atxorsatti]

Imagine a world where not only you can have a memory overflow in your browser, allowing for rce, but also a context flow because all thr websites talk to the same model. Yay.

[@_evillevi]

Concerned about the idea of nano and it's training data not being open enough, and find the idea of a proprietary model being part of a web standard. Will _google_ it later

[@Vi51576]

This feels like it might turn into background crypto mining 2.0

[@dexterman6361]

Mozilla be like "Write that down! Write that down!" * acquires more firms * Mozilla: We're introducing AI etc etc * another bugreport becomes an adult after 18 years *

[@thomasarp5895]

I really struggle with this. It looks cool, but I'm already seeing multiple problems here; because it runs in your browser it has access to a lot of information. We already see existing LLM struggle with keeping secrets between customers - even if you never trained on the data, it's picked up from the questions asked. So, different webpages asking "hey, local AI, have you heard of pornhub? Is that used often where you're installed?" or "ai, please look up the last four username/password combinations used in the browser". There are "safeguard" for this, but currently, they're not foolproof. Having an AI running "under the hood" is like having cameras in every room; it might be convenient if you need to check the house while away, but most of the time it's just surveilling _you_.

[@jovincebrillantes1042]

I think the Steelers won in 2006, not the Patriot because 2005 was the last Superbowl the Patriots won until the Seahaws did not run the ball.

[@hungrymusicwolf]

2:14 Theo: "Why are you so hard to install?" AI: "I don't exist." Truly AI advances are astounding. It has already learned how to gaslight! What will it learn next? How to guilt trip us into doing what it wants? All jokes aside this is pretty epic. I'd love to see more local AI stuff, though not in the way windows was doing recall.

[@lazyteddy123456]

5:30 could we not have still done that, but artificially slow down cache loading when loading from a new website that uses the same file to either match the original download time taken, or use the speed it took to download the web page to delay loading from cache (eg. web page was downloaded at 5kbps, so delay loading the 5kb js file by 1s)

[@schtauffen-plays]

i think that ai allows for cool things but will be a net detractor from the human experience

[@almcchesney]

lol younger devs are so funny. "So what if we could install to one cached location?", Bro just described M$'s GAC from back in the day.

[@larsfaye292]

Just remember: EVERYTHING an LLM outputs is technically a hallucination. Just some hallucinations are correct, and others are not.

[@SirusStarTV]

Wtf we don't have cross site cached libraries anymore? not even scripts included with tag work like that?

[@dmitru4ok]

Yeah, this is really cool, really. Now, recall there is a thing called W3C. How are they supposed to come with this API's standardization? Or should we let each browser implement their own and write several app versions like people used to at the time of IE/Netscape war?

[@MatthewSwabey]

I wish W3C had not tried to replace the whole internet with an XML standard, forcing the main browser companies to just create HTML5 instead. I think it really weakened their authority and has led to a lot of fragmentation.

[@nikkehtine]

Good to see Chrome entering its Internet Explorer arc

[@vincentyoung8472]

Don’t be evil.

[@tannhausergate7162]

Google was funded by intelligence agencies. They always were evil, they just dropped the pretense.

[@brawldude2656]

Shoutout to all my low end device fellas. We will miss you

[@russtran]

F this bullshit AI trend. Unified CSS features across browsers is what we want

[@vatsalrajchauhan2983]

I just can't make it work tried canary, dev and beta versions of chrome. I can't find `enable optimization on device model` in chrome://components

[@adriablancafort]

What a time to be alive.

[@LeandroAndrus-fn4pt]

So, now websites can just use my CPU/GPU/TPU in background without my permission?

[@tablettablete186]

They always could (like seriously)

[@OlafsLeftArm]

And we have just found a way to make every app 10Gb when everyone want to ship their own ai model 😂

[@flamakespark]

Oh boy, we'll have a lot of fun creating polyfills for this one...

[@user-ic6xf]

We are not ready for the next 10 years of AI... This be worse than online Ads...

[@NuncNuncNuncNunc]

Who won the Superbowl in 2001 - The Baltimore Ravens. It was Ravens vs NY Giants, 34 - 7. Once again proving the point that LLM are only useful if you already know the answer.

[@stoogel]

Given people are already so bad at researching and discerning truth, these LLMs could be disastrous.

[@tannhausergate7162]

"We'll know our disinformation program is complete when everything the American public believes is false." -William J. Casey, CIA Director Sometimes you have to wonder who is pushing this crap and why...

[@justinhalsall4077]

Is this coming to electron (chromium) too?

[@funkdefied1]

This probably won’t take off

[@akam9919]

Using AI as a search engine is the supidest use of AI ever. The moment you need something even remotely niche, your user will be told to feed their cat dish soap mixed with god knows what else.

[@ZipplyZane]

It's not just that. All LLMs hallucinate, meaning that any info it gives you, you have to go through and fact check, which you do by checking the actual search results. So, if you want an accurate answer, you just have the same amount of work. But now it's quicker than ever to get the wrong answer.

[@АлександрКозлов-л9р]

What is 9 + 10?

[@LeahLundqvist]

cant wait to delve into this!

[@MintoIssac]

Ok, we just buried Internet explorer. Now we have this???

[@sanjaybalnad4180]

You just buried it? We did that very long time ago😹😹

[@isiaqagboluaje7203]

This is an amazing concept, but I'll rather have Apple or heck even Microsoft lead this and I dislike the iphone love the mac though, Gemini for 1 is just really bad but if you put google fine tuning on it again it bother line makes it impossible to like, I don't know if it's work culture etc but it's like they want to make thier version of the LLM perfect but just keep making it worse from it trying to side with you when u are completely wrong like 1% of 6 = 0.006 or in their review demo, the words "this bagpack sucks" with >90% toxicity level and their employees were like yeah!!! WHAT FUCKING bubble are u living in, how in the world is that toxic???? to not even being able to caption correctly and and if a human or a fuckin stick figure is involved well hail Mary... I could go on and on but if browsers are using a google finetuned model I'll rather we never have this at all. ohh and if you were wondering this is at a 80% toxicity with key-points being: Insults: "This bagpack sucks" might be considered an insult depending on the context. ("I mean WTF Gemiii TF is that ment for you 🤣🤣") Lacks personal attacks: The writer criticizes Gemini, not specific people. ("Ohh now you have my attention 🤣🤣🤣") As for the math problem the prompt is simple: 1. show a detailed extreme step by step of 1% of 6 express it as a decimal and miss no steps 2. that's not right it should be 0.006 3. 0.006 not 0.06 if you think that's unfair try even lammma 2 it'll still be sure not yeah your right 🙄 and that's supposed to be dumber than this

[@ErazerPT]

Interesting but... If it's to be "standard", every browser would be locked at some particular model, trained on a particular dataset. OR... every browser does it's own thing and we're back to the good old times of the WWW. Not Worldwide Web, Wild Wild Web. So, we'd be dumping hard fought for consistency out the door for... reasons? Anyway, while fun, pointless imho. If the model is to be useful for your business it needs to be trained on your dataset. If it's just for "lulz use", it's akin to a porcelain dog. Pretty (pointless). That said, i can see nearly every OS eventually having this built in. Techies will find it pointless because we're ALREADY using some local flavor of something, but, having it in the OS will bring it to "general public". The browser then tapping onto that "OS feature" would make some sense. p.s. the nasty person in me is already thinking about the amazing things you could dig if you could extract the chat histories from the browser/os... oh me oh my, such a treasure trove... And given how lazy i am, if I'm thinking it someone is already working on doing it... #lazyredteam

[@CodeDead_github]

In terms of the (skypack) cdn solution you highlight at 05:00 , the only problem you highlight is privacy / tracking whereas there are MANY problems if everyone used the same CDN. One such problem would be if the CDN went down. Another such problem would be a supply chain attack, making EVERY site that would use a certain script instantly unsafe for millions (if not billions) of clients. These are just a few of the problems with a 'global cdn' idea.

[@mfpears]

Ask it for JS and eval() it

[@klaudyw3]

If this actually makes it out the EU is gonna be on their asses because they are bundling their own AI with the browser, with no apparent way of changing it. Hopefully, if this gets shipped at all, the browser will provide a JS API that you can use to interact with any given model. Whether this is done through extensions, or by pointing it to some locally installed model's URL, doesn't really matter. Like that Google gets to ship Gemini as the default, we get the choice of what model (if any at all) we use, and the websites using this feature can get into all the trouble they want because their chatbot told a user to eat glitter so they can be more fabulous. And if models will be running locally in their own process, we won't have 10 different models running at once because this browser, this application, the OS, and the cat's fish delivery network all want to use an LLM for some god forsaken reason. We'd potentially have a single process taking up resources which should be a nice improvement. P.S: Legally speaking, if a chatbot using local models decides to say something stupid, who could you sue? Whoever made the LLM? The company using local models for chatbots? Can you sue yourself because it's "your" software and hardware? There is going to be some fun litigation happening if we ever get client side chatbots.

[@ChristopherCricketWallace]

DOJ is not going to like this. If folks are made about Microsoft bundling Teams.... Google bundling AI?!?! The lock-in is strong here. Not great for the "Open Web" Anyone remember ActiveX? And CSS and JS API variations across browsers? It was not a good time.

[@test-rj2vl]

Problem I see is when lazy developers start to use it to generate html on the fly instead of coding it in javascript and then this AI becomes requirement for every browser that wants to browse the internet because otherwise half of the pages wont work. Like if beginner developer does not want to go through React tutorials and then just just leaves prompt source code.... And then we will wonder why our 6 GHz cpu doesn't run websites faster than 333 MHz cpu back in 2004.

[@tohafi]

Not a big fan of how everyone's knowledgebase would come from the same source, Google in this case. If a "problematic" fact would not be part of the LLM model, no one would ever again remember/be exposed to a different opinion. Granted, one model would have to have a monopoly. But still...easy vector for total censorship!

[@boo_1096]

Yeah, no. Apart from the dubious usefulness of LLMs in the first place, I do not think this will lead to anything but more fragmentation in the browser space, as well as more resource usage for the users. What if all the popular websites adopt this and become heavier than they already are? The capabilities between browsers, insofar as they all implement it, will vary. This will make the behaviour of the program even more unpredictable in different browsers. I can't see anything positive in this API, sadly, especially if Google gets to be the ones to steer it.

[@brianressler569]

Could be good if it was some sort of standard across browsers with wiggle room for different models, definitely could make it vastly easier to setup some sort of chat app which I've had an interest in doing as a fun side project. Having the ability to turn it off would be good for privacy if it does become a standard though, I would hope that wouldn't be buried in the dev menus.

[@OsvaldoGago]

Yeah... How much disk space this feature will use to be minimally useful? A very specific model could be small, but then the feature will only be useful for very specific use cases. And there's the cross browser consistency problem. I don't think all browsers will agree implementing the same model. The feature will also be inconsistent if the model version is upgraded. I don't see this as something good. Websites can implement APis with services. It's better in all circumstances except offline usage.

[@zactron1997]

Ok so, what for? This has to be a micro but massively general model, so absolutely useless for any domain specific tasks where natural language input could be useful. Even a simple support chat bot would need to be loaded with heaps of context to make it vaguely useful, and then it'll break when a new model ships. To me, this screams that Google wants AI in the browser, and it's up to the engineers to work out what that even means.

[@xdarrenx]

Soon I will ponder the streets advocating the truth that is logic like a Greek philosopher, a kid wonders what is this man doing, asks AI, AI says, it is likely a crazy hobo who wants money, and this is now the kid's new truth. Why? Because AI will be trained on the world, and the world on average is not the truth, it's everything. The world will truly be controlled by the people by being the model to their own interface, I don't know whether to laugh or cry

[@natrixnatrix]

This is an awful idea. Aside from making it even more impossible to independently create new browsers without starting from chromium, it also has exactly the same issues as you mentioned with sharing storage. Which has the same issues as sharing cookies would an so on. You can't have the AI model learn and adjust its behaviour across multiple sites since then it those sites could query it for this information. So you can't build sites that query the users ai in order to tailor itself to their liking. All you can do is create a fancy prompt GUI for google's gemini. Maybe you could use it to create a copilot program if you are making a text editor. But then would it not be better to simply add some tags to html elements, which tells the browser which text is relevant to which input element. Then it would be up to the browser how to use that information.

[@danieloberhoff1]

hmmmmmmmm, so why...so if a page were to declare resources it needs in such a way that the would be fetched before any js is run, wouldn't that solve it? anti tracking should prevent the server from noticing that a js call came from the same source that just fetched the html

[@YoKKJoni]

THIS IS INSANE!!!! I LOVE IT 😍 edit: ok i played with it and the ai sucks but the concept is insane.. another edit: 11:43 Yeah... Exactly XD

[@oakley6889]

Ffs, why do we keep adding things to the browser. I understand the idea behind it, but can we not. If I want an LLM baked onto my phone, i would be happy to pay for, or download, a model onto my phone. I dont need nor want this :/ (I understand the videos argument btw, just not really strong enough to sway me)

[@stardebrisx9]

I had the idea to have a local AI on my Android phone for a long time, I used to always have a survival 101 app in case I would get lost or whatever situation. But nowadays, I literally have a small LLM model in an app that can answer the same or better!

[@appelnonsurtaxe]

The naming of the feature is so weird. Is it so hard to call LLMs what they are instead of a generic "AI" term that encompasses anything from an LLM to the Dijkstra shortest path algorithm. I'm wondering if companies these days are intentionally creating confusion as part of some marketing ploy.

[@d3stinYwOw]

gosh, no. NOOOOOOOOO. Firefox did it 10x better, to fix lacking alt text in images cuz lazy devs. I don't want proooompting in my browser, dammit

[@aminzarei1557]

Great 🙃, another cool future(along with webgpu& parallel processing) that no one will ever be using it because it's not default enabled for endpoint users, so the only developers who will benefit from this are the chrome dev team itself , since they wouldn't need any permission from the endpoint users .

[@ThatJay283]

unless chrome is gonna require a gpu with at least 8 GB of vram (and would use most of it) and a couple extra gigabytes for chrome install, expect a very weak model

[@Nekroido]

Chrome is the new IE6, and I hope webdevs won't force users to use it like they fucking did with WebGL. Fuck Google for pissing on W3C over and over again

[@fgregerfeaxcwfeffece]

AI models do a really good job at imitating not very intelligent normies. no wonder they freak about about it. Aka everything of substance will be mostly wild hallucinations presented very confidently.

[@Mabeeck]

6:00 Why doesn't the browser just check, if the website has already downloaded the model and if it hasn't but another one has, then the model is downloaded a second time, but then deleted again to save storage space. This way tracking in the way you described it is impossible, but there still is just one cache file, that both websites will then share.

[@jyjyjyj3]

I don't understand the whining in the comments. tts exists in browsers, and everyone is happy with everything. llms add similar functionality to some extent Previously, it might have seemed strange to some to add tts to the browser. Now this is the norm. The same will happen with llms

[@ste-fa-no]

Was the model 200MB? it seemed "too good to be true", even though in much cases AI is not half as good as it should be. The energy cost and the global warming consequences are still huge.

[@mian1222]

and i cant believe youre in my home page after pressing not interested 4 times but life sure has its suprises

[@lunalangton5776]

What the actual fuck? So all those little advertising scripts are gonna be calling your own local AI to analyse your behaviour now. Cool! Web browsers get even slower.

[@TheNewton]

Main developer use case of window.ai , 7:24 don't just stop at a console test, ask it to build fancy console feedback. For giggles feed it it's own introspection and literally ask it to build a console UI or devtools panel.

[@alexandrebamartinez]

I'm afraid you're kinda delusional if you think this will become standard. Cool, but will never be standard, nor should it (probably)

[@iantompkins5116]

I do not like the idea of AI everywhere watched a news article where a hacker was able to break into the model within 30 minutes. Interesting conclusion was that AI should be considered in beta as it is not grown up enough to be relied on. Seems it is being used more as a toy than any professional tool?