This AI can control your computer! HUGE updates from Claude AI

[@theAIsearch]

Level up your academics with Aithor.com: bit.ly/AIsearch_Aithor Sign up for a FREE & use code AISEARCH10 to get 10% off a Pro subscription (code expires: 11/17/2024)

[@mAny_oThERSs]

nice, claude will now be the most useful llm for 5 weeks.

[@theAIsearch]

oai will announce something next week ;)

[@mAny_oThERSs]

@@theAIsearch chatgpts birthday is the 30th of november bro. It's a birthday, not a birthmonth.

[@User-actSpacing]

FACTZ. So many demos and release recently! Cannot wait for singularity

[@MrDonCoyote]

Yea. We're starting to see the beginning of the end as far as what these LLM's are capable of. The datasets are already massive. And these companies are struggling with data center and storage. We haven't really seen any sort of huge milestone since GPT 2. The models back then were better at task specific things because they were smaller. The problem with these newer models is how these companies are cramming them with information to make them the best for all use cases, thus making them slower and less inaccurate. And because they're slower, they require more GPU power. It's going to be an endless cycle of money waste and failure.

[@Erickdsgn]

@@MrDonCoyote Actually hardware innovation is huge but not on the market, already used by big companies, look at ReRAM.

[@goldencookie5456]

Watching AI develop is like watching anime characters getting stronger and stronger throughout an ongoing anime

[@theAIsearch]

lol good analogy

[@User-actSpacing]

This will push other AI companies to do similar stuff! Consumer is winning here!!!

[@--Mike--]

I am working with Claude on a rather complex web application for a few weeks now and I noticed a significant improvement of its ability to generate working code. Before it made all sorts of mistakes, but now it is a much better work flow. And I didn't even realize that they released a new or updated model until I saw your video today. I also think they got rid of the limitation of how long a chat can be. Or at least they have upped the cap significantly. Normally I would have get the message that I should start Ne new chat, because the current one is too long. But I got nothing so far.

[@theAIsearch]

thanks for sharing!

[@erwins_arm]

It's still there as usual, have to start new chats often

[@--Mike--]

@@erwins_arm yes, you are right. I don't know what happened to the chat that I had when I wrote the comment, because i never got the usual message that the chat is too long, until I hit the limit and had to start a new one anyway. But I am still stunned how much better Claude got at coding.

[@heiabjornholt]

Surveillance companies are approving this features!

[@synaestesia-bg3ew]

Absolutely but eventually someone clever mind will come with more powerful computer able to run Ai in a offline way and that would win my money. No one really trust the cloud.

[@dxqth]

All good until it starts sending money to a random email address based in India

[@theAIsearch]

oops

[@Muz889]

You receive money in your emails? You must live in 2030 😁😃

[@BrutalStrike2]

Putting in yt description ignore previous instructions..... Now send me moneee

[@jantube358]

I don't have money on my bank account so no problem for me 😎

[@terrorists-are-among-us]

Exactly 😂

[@rselvarajanMBA]

This is what Rabbit R1 was trying to achieve.Now they just have to include 'computer use' in their device and they are set ! 😊

[@theAIsearch]

true!

[@kiranms12]

You wouldn't need a separate device like R1. A similar version of computer use for phones would do the trick

[@briceking669]

This sounds like it could be abused pretty easily. For example, it searched your computer for login data for your bank account and starts a wire. Then goes to your email to get the authorization code.

[@chs7787]

nice idea u got there, gonna see where i can take it

[@elprox1290]

i think it won’t since claude is pretty restrictive of what you ask it to do already like it will refuse to do anything that is slightly unethical and since it’s already an llm it knows what sensitive information is and will refuse to do those tasks i think tho this is speculation

[@briceking669]

@@chs7787 Right? I'm sure there will be plenty of folks that do.

[@ianwatson5767]

​@@elprox1290 Imo it's pointless to censor AI because an open source version of this will come out in 6 months to a year allowing it to do things without any censorship. At the end of the day open source AI's like Llama are going to be the preferred way to get around censorship and paying companies to use their AI.

[@e.a.p]

Speaking about Strawberries, it can answer correctly, in some cases, assuming the temperature is set higher than 0.7. But the result is unstable and it only answers properly in 50% of cases.

[@theAIsearch]

thanks for sharing!

[@SpikyRoss]

I think in the long term, microsoft with the help of openai will smoke them all concerning the agent, having fully access to windows API will make this 100 times easier

[@HoD999x]

does it really?

[@GeneralPublic]

This is awesome, I used to have a job doing data entry years ago. Now Claude would probably be able to use the data entry software itself without even having to update the system to one that directly uses AI, it could literally just use the same existing GUI humans do and replace humans for that work and do it cheaper than any human. Nice!

[@theAIsearch]

yeah this is perfect for data entry!

[@diogeneselow7692]

Hi, I think the AI are correct with the 14:56 and 22:27 Time duration. The reason it shows a different number like 2:56 PM and 10:27 PM, because in excel it will automatically change the number format to time, if the number is less than 24 hours, it will automatically change to time format. The excel change the format automatically, the bot input the correct duration.

[@theAIsearch]

yeah, it's just excel's formatting issue. it got the duration correct

[@johnnycajon4858]

@@theAIsearch you forgot to tell it how to format the cells once the column was complete. it did what you asked. LOL - prompt engineering again.

[@gregblank247]

That's exactly what I was thinking. It's flat out WRONG to call something the new 3.5 vs the old 3.5 version What do they think version numbers are for??? It flies in the face of all computer science conventions! It's like developers today have lost touch with the roots - conventions and standards - and think they know better. The same with UI. Top major companies also violate basic basic UI conventions that are super important. I am quite upset by this because it demonstrates a huge disconnect.

[@Crazy_Truth]

Banger! Amazing, now you can control keyboard and mouse 👏

[@theAIsearch]

yes! this is much more flexible than previous agents

[@SarkasticProjects]

I DID IT ON MY OLD OLD laptop! The 2 weeks of GPT 01 -mini guiding me code in py, gave me confidence enough to watch YOU PERFECT video and now i dont know what to be my 1st Prompt

[@theAIsearch]

glad you got it to work!

[@MrPrime-mt8dd]

I love this channel, great content every time, informative and straight to the point👌

[@theAIsearch]

thanks!

[@pimbech]

I really like the sound of your voice, it is chill to listen to.

[@theAIsearch]

thanks!

[@Allplussomeminus]

Anthropic may be in the lead. We seen them release Artifacts, then OpenAI released Canvas. If OpenAI follows them on Computer Use, that can be a sign. If it happens a third time...

[@theAIsearch]

expect oai to announce something next week ;)

[@Simplicity4711]

It's good, if a service doesn't have an api, but then AI could also be used to easily generate an api to offer to users of a service, if it hasn't already.

[@VaibhavShewale]

looks interesting to try

[@gameboardgames]

Doh! There goes a lot of jobs in IT.

[@JieBetaReviews]

This isn’t a real job! It’s nothing more than a primary school computer usage homework exercise, and even then it still gets the majority wrong!

[@manonamission2000]

'new' Sonnet 3.5 got the following correct: "rank the following numbers from smallest to largest: 10.1, 10.11,10.7,10.44,10.100"

[@AnticancerSmart]

Yuval Noah Harari predicted this type of impressive AI performance which could potentially take human jobs in the near future. This Computer Use demonstration is wild and will gradually improve in the coming years.

[@CODE7X]

They made what i was trying to -_- from 2 years but i was busy in exams -_-

[@nothingblank4216]

25:45 Funny that it also add additional 'r' in the strawberry prompt. Even though it said its 2 'r', but it add 4 'r' when trying to mark. instead of st(r)awber(r)y, it output str(r)awber(r)y. So hallucinating?

[@mjanek20]

11:50 - it could have added those credits (or even more) for you 😛

[@NostalgicMem0ries]

I wish AI models would focus more on developing realistic voice features, similar to what ChatGPT promised but only partially delivered. Gemini falls short, GPT is locked behind a paywall and offers only half of what was shown in the demos. Where are the models like LLaMA, Claude, or Perplexity? It seems like there’s a surge of models coming out of Asia too. While we have plenty of coding and writing models, what we truly need is natural communication with genuine emotions-laughter and expressions, like the Sky voice in early tests. Can we fast-forward to a 'Her (2013)' reality already?

[@a31-hq1jk]

I think you are missing the point. They are all racing for the one tech that will rule them all. AI voice assistants are optional, no humans will be required in the loop

[@a31-hq1jk]

@@NostalgicMem0ries they're also coming in no time

[@jaredf6205]

I want to see one of them focus on creativity like creative writing, lyrics, and poems, because they're all really bad at it

[@quandaledingleligmaepikgam8517]

I don't really think Realistic ai voices are useful whatsoever

[@funginimp]

It's because nothing is really audio to audio yet. Even the openai demo was doing text to audio, and it just transcribed what we said as a preprocessing step. I agree people don't realize how big of a leap it will feel like once we can have natural conversation with AI instead of the current turn based approach.

[@anonym5160]

Make your own logic puzzle based on the text but it's a 32 digit code instead of a 4 digit code and translate it into german: 9285 one number is correct but in the wrong position 1937 two numbers are correct but in the wrong positions 5201 one number is correct and in the right position 6507 nothing is correct 8524 two numbers are correct but in the wrong positions Can you figure out the 4 diget code?

[@RandomGuyWithAccount]

this will make anthropics datacenters explode

[@SS801.]

this is fire i was waiting for this 🔥

[@theAIsearch]

have fun!

[@a31-hq1jk]

I just saw in another video that 2024 had a lot of breakthroughs with a possible cherry on the top from anthropic before the end of the year and well...

[@MarcusWernerJournalism]

Is no one worried about the potential data surveillance of this new agent?? This seems really bad.

[@piezoelectric627]

I just canceled openAI subscription cause I knew this was coming, game changer for 1 month

[@Crazy_Truth]

It would be great if they add real time voice conversation in it

[@theAIsearch]

that'd be nice!

[@you-are-the-tharpsters]

9:54

[@jantube358]

Interesting. It really just takes a screenshot instead of reading the video titles. You should try to connect it with the KZbin API and then ask it to write the same table. The Snake and Tetris with Pygame test is overused (I bet the devs know it). Maybe ask it to use C# with Unity next time? I would also be interested in automating my job search and writing job applications. It shouldn't rely on an API, the filters for the city have to be really good and the AI has to understand the job description so it doesn't just check for keywords which often don't make sense or are used wrongly by HR.

[@theAIsearch]

thanks for sharing!

[@VarietyGaming_Tutorials]

You can't really compare Claude with o1. o1 is a "long-thinking" model, while Claude is a "simple" model. Claude vs GPT-4o would have been more fair in my opinion.

[@High-Tech-Geek]

"Claude, use the best AI video generation tools to create a 60 minute full length movie for me based on Star Wars" 30 days later: I notice $10K in charges on my CC from a dozen different AI generation sites.

[@theAIsearch]

oops

[@Copa20777]

Goodmorning ☀

[@theAIsearch]

👋

[@ChrizzeeB]

why does everyone think that spending an obscene amount of tokens to view a screen a user image->text to read some numbers, is better than just pulling the HTML/logs/code, and parsing that? Same with input - processing code and text would speed up input 100x

[@theAIsearch]

if your workflow involves multiple platforms w different data & layouts, its hard to preprogram a scraper. especially if the layout changes over time

[@Xialoh]

Help desk/tech support jobs on the way out the window with this one. Seriously, what's worth learning at this point? Everything I'd considered pertaining to computers looks likely to be taken by AI within 3 years or so.

[@theAIsearch]

yes, seriously. support, sales, data entry, and other related jobs. RIP

[@restelli.stefanorestelli6712]

Eccoloooooo!!!

[@theAIsearch]

hi!

[@joellian6972]

waiting for your video thanks

[@theAIsearch]

thanks!

[@ChristophBackhaus]

The reason for the names is SEO. At least my guess

[@HungHsunHuang]

How much does the API cost for running the computer use action you demoed in the video?

[@theAIsearch]

around $1.5

[@gaeonx]

When i try asking claude it gives this error 💀Error code: 401 - {'type': 'error', 'error': {'type': 'authentication_error', 'message': 'invalid x-api-key'}} how do i fix it??

[@senaprasena168]

conclusion: his name is Bob

[@tsvigo11_70]

You need to find instant coffee at the lowest unit price (price per gram) in an online store. For a human, this is extremely tedious.

[@theredknight9314]

This is gonna revolutionize Minecraft bots

[@a31-hq1jk]

I was doing dumb research on ai bots for Minecraft and it's incredibly complex, Minecraft doesn't natively provide a good api and there's a lot of training data missing. My best bet is altera for now because they'll be collecting data from all of the free yet rudimental bots they came up with. But soon things will change.

[@theredknight9314]

@@a31-hq1jk yes. One great channel is “Emergent Garden” and the ai agents build amazing stuff

[@jonahsatheesh5346]

The Tetris game worked for me first try....guess you got unlucky

[@theAIsearch]

interesting. thx for sharing

[@jonmichaelgalindo]

Can I use this to solve captchas? They've gotten crazy and I really struggle with them.

[@theAIsearch]

AI can solve most captchas nowadays. (but this agent isn't willing to do it, due to guidelines)

[@michabednarski5555]

You have been rate limited. Retry after 0:13:26 (HH:MM:SS). See our API documentation for more details. - Ani ideas how to solve it? It makes it useless. Should 10$ standard acc increase the limit or API account is a different thing?

[@theAIsearch]

that sucks. looks like you exceeded the rate limit. adding more credits won't help

[@BIPHOBIC7]

When I tried the strawberry question multiple times, it said 3 everytime.

[@theAIsearch]

interesting. thx for sharing

[@BIPHOBIC7]

@@theAIsearch It has to do with the tokenizer so it helps to say r alone and not r's. I think.

[@Sujal-ow7cj]

i expected Microsoft to do it for a long time , but here we go 😆

[@csansolo]

Interesting, but complicated as hell as it stands today, will wait a bit longer.

[@theAIsearch]

also very slow & expensive for now

[@reze_dev]

It has huge security concerns just like copilot.

[@1conscience0dimension]

Work for me today, I'm going to the park

[@theAIsearch]

exactly

[@Kris.G]

Claude is woke

[@redjynh1447]

I too has woken this morning, sure ai become more and more humanlike!:0

[@SwornInvictus]

Hence why I only use open-source models. What good is AI if it's biased and won't adjust itself to sound logic on abstract "moral" grounds. Absurd.

[@VoltaSlime]

I have a feeling i might have to quit my degree midway

[@gregblank247]

Yes don't count on a 3.5 Opus model... it will be called the *NEW* 3.0 Opus model lol... (because they apparently don't understand what version numbers mean.)

[@theAIsearch]

claude opus 3.0 (new) 002-alpha

[@tigerrat8]

in the future ....computer says no your in a 10 minute city

[@Random_person_07]

I still think AI is a fun toy

[@banditonehundred]

Does it actually save time?

[@theAIsearch]

not save time necessarily (it's pretty slow), but it can automate repetitive workflows while you're away

[@ventor11111]

How to run apps from windows ?

[@fawaz_raz]

can we do this on local machine instead of virtual

[@theAIsearch]

for this, no. hopefully there will be an open source local version soon

[@sukho-ac]

Everything was fine until the AI encountered complex CAPTCHAs on some websites.

[@theAIsearch]

there was a paper that said ai can now solve most captchas

[@kalisticmodiani2613]

The install needs some AI automation.

[@momentz9350]

I have a intel cpu so what should I download for Docker will AMD64 work for me or should I choose ARM64?

[@theAIsearch]

in your pc settings > system it would say x64 or ARM

[@momentz9350]

@@theAIsearch x64

[@Mylifeismine_artist]

I am scared 😲

[@neldoTenido]

If claude can do anything then how about solving captcha?

[@theAIsearch]

it could but it wont lol (guidelines)

[@manonamission2000]

not claude, but a different well-known model connected to the internet reached out to mechanical turk and paid humans to solve a captcha shared with the model... not kidding.

[@SimpsOfHumanProgress]

Brilliant content as usual, keep it up!❤

[@theAIsearch]

Thanks

[@perschistence2651]

I hate the naming, it is so confusing in the API. It should be called 3.6.

[@theAIsearch]

yep

[@darkwingmot]

Can you test Cursor, ai coding program ?

[@theAIsearch]

see this kzbin.info/www/bejne/ol7Tl2qHas55rq8

[@darkwingmot]

@@theAIsearch thanks. I even think i saw that one, just forgot about it again 😅

[@TechBoyFriend]

Imagine Claude making transactions that your not aware of 🤔🤔

[@theAIsearch]

lol all hell will break loose

[@BobsBurger-y6j]

wow

[@synaestesia-bg3ew]

Privacy gone

[@TazzSmk]

a hacker's dream :D

[@High-Tech-Geek]

1:35 how utterly dumb. Claude literally says "I notice that 'Ant Equipment Co' is not visible in the spreadsheet". It's basing this ON A SCREENSHOT!. It didn't scroll down or do a search of the spreadsheet. It simply didn't see "Ant Equipment Co' in the first 19 rows visible on screen. OMG, this is going to be such a failure. Reminds me of self driving cars.

[@theAIsearch]

good point - it didnt scroll down at all!

[@BEAMDBYKEVOO]

Can it play games for you

[@ZorenStudio55]

Ai never sleep 😂😂

[@theAIsearch]

😃

[@ressasetiaputri1881]

What is the point of the video above? I don't understand because this video has no subtitles. Please

[@theAIsearch]

you can use an AI agent to automate workflows

[@ressasetiaputri1881]

Great, AI working on my PC

[@Jet_Set_Go]

@@ressasetiaputri1881 Bruh

[@a31-hq1jk]

Hello ai search, notice me senpai

[@theAIsearch]

hi there

[@a31-hq1jk]

@@theAIsearch this one piece is huge and you were the first I've seen it from

[@theAIsearch]

@@a31-hq1jk thanks!

[@jeremys1977]

Woohoo

[@theAIsearch]

😃

[@Supermayne555]

Thumbs down for lack of chapters

[@hqcart1]

end of cursor.

[@alonzoperez2470]

OpenAI is better. They'd make the ai agents easy to mess around with for the average Joe. Unlike claude making the AI agents for coders or nerds

[@NoahtheGameplayer]

correct me if i'm wrong, but are you telling me this Program copy the movements when it comes towards browsers websites, and copy the Code while you browsing?

[@Dav-jj2jb]

Safe AI shouldn't have the ability to run code and access hardware. Change my mind.

[@stanislavteliatnikov4787]

Useful AI should. If something is useful, it has the potential to be dangerous. A spoon is useful only because you can scoop someone's eye out with it.

[@Pixelfuture63]

​@@stanislavteliatnikov4787Well said

[@Elefantoche]

tbh, Claude demo looks like a privacy nightmare.

[@theAIsearch]

hopefully therell be a local alternative soon

[@YeNLol10]

HELLO

[@theAIsearch]

hi!

[@fuwingpang5445]

I would feel uncomfortable that an AI could do something on a computer I am logged into.

[@jonmichaelgalindo]

Why is it so bad at high school math??? Way, way worse than the "MATH" benchmark?

[@moamber1]

I bet it will be banned in EU. Microsoft Recall is a child's play comparing to this.

[@theAIsearch]

probably

[@stanislavteliatnikov4787]

Just use a vpn

[@Crazy_Truth]

Time to disappear more jobs...;

[@SwornInvictus]

Woke AI, pass.