Hackers expose deep cybersecurity vulnerabilities in AI | BBC News

As is the case with most other software, artificial intelligence (AI) is vulnerable to hacking.
A hacker, who is part of an international effort to draw attention to the shortcomings of the biggest tech companies, is stress-testing, or “jailbreaking,” the language models at Microsoft, ChatGPT and Google, according to a recent report from the Financial Times.
Two weeks ago, Russian hackers used AI for a cyber-attack on major London hospitals, according to the former chief executive of the National Cyber Security Centre. Hospitals declared a critical incident after the ransomware attack, which affected blood transfusions and test results.
On this week’s AI Decoded, the BBC’s Christian Fraser explores the security implications of businesses that are turning to AI to improve their systems.
Subscribe here: bit.ly/1rbfUog
For more news, analysis and features visit: www.bbc.com/news
#Technology #AI #BBCNews

[@mrphiliphallam]

The NHS hack has absolutely zero to do with AI large language models. The entire premise of this program is wrong.

[@brexitgreens]

Thank you. Regarding AI, it's no different from employing a human: don't trust blindly either. The same safeguards apply.

[@brexitgreens]

And even so (all things considered), AI (LLM) is far more dependable than human staff. Which is not necessarily a good thing because there are times when orders should be disobeyed.

[@brexitgreens]

And regarding conventional hacking such as the NHS leak: the interviewee is wrong that the red team will always win. Every time the red team wins is a case of the incompetence of the blue team. In practice, vulnerabilities are a combination of true stupidity and feigned stupidity masking intentional betrayal. Perfect security isn't rocket science. But corrupt human nature makes it seem so. The solution to this problem involves psychiatry, not technology.

[@calvinsylveste8474]

The technological singularity-or simply the singularity-is a hypothetical future point in time at which technological growth becomes uncontrollable and irreversible, resulting in unforeseeable consequences for human civilization.

[@f.e.5691]

I understood that the NHS attacker used freely available large AI models to find breaches in their systems. However, I'm not sure if they explicitely mentioned that. For sure, they talked about how hackers can remove safety guards in the AI models to use AI as a tool to cause harm or hack others.

[@kevinlamptey4041]

The best series on AI so far is "Person of interest"! You all gotta watch it.

[@DiggerD-w6r]

Don't put your networks on the internet. The internet will never be secure.

[@runnergo1398]

Exactly. It was a huge mistake putting so much infrastructure online.

[@projectsspecial9224]

@@runnergo1398 Agree... for some reason, very smart people do very stupid things

[@jarts8946]

70% of breaches don't make the headlines apparently. How much money is lost on data breaches is insane.

[@danielsanichiban]

On a similar note, you can bet that there are criminal groups, government departments, etc that are training AI to hack systems like you've never seen before, and that is gonna be a big story when that takes off, if it hasn't already without us knowing

[@eyezikandexploits]

As a bug bounty hunter most of the community already is using ML for finding bugs

[@arizvisa]

@@eyezikandexploits can you elaborate on what you mean by "finding" and "bugs"?

[@arizvisa]

@@YouTViewer despite your generalization, i figured that's what you meant. i have serious doubts that ML is finding vulns better than fuzzing and formal verification. ML may augment labelling and can aid with generation of familiarizing content to pop an account, but in terms of shaking actual bugs out of a piece of software...highly unlikely. ML can barely correlate context between two distinctly separate pieces of logic.

[@microbe_rz37-rn1dk]

The infamous "red team" exercise.

[@arizvisa]

@@eyezikandexploits If you search for "Unleashing AI The Future of Reverse Engineering with Large Language Models" related to REcon 2024, you can read some slides that talk about using LLMs in regards to reverse-engineering. They're prolly better when setting up for the automation required for some webapps, but in terms of vuln-discovery...the weaknesses are pretty apparent. Perhaps it'll change in the distant future (as tech and capabilities change), but "already being used for finding bugs" (in the capacity for finding something other than low-hanging fruit) is pretty doubtful. Still, I'm looking forward to the results of DARPA's next CGC.

[@indyvisible624]

It’s like when your parents who can’t even figure out how their phones work, tried to control your internet traffic.

[@importantname]

how long will it take for an entity or nation to build and programme an AI solely for hacking the AI of other entities or nations?

[@xv3ei]

they working on it lol😂

[@hannaht2068]

AI is working on it. So quite soon.

[@xjet]

"healthy skepticsm" is the *ONE* key subject that should be taught at all levels of education. Sadly it's not, therefore the future looks bleak.

[@DarkSkay]

Channel uncertainty and doubt into "healthy skepticism" instead of fear about a "bleak future"? Have a nice day :)

[@DarkSkay]

@@YouTViewer It disappeared? Where did it go? ;) It seems that with AI concretizing so many questions about rules, computation, knowledge, mind, consciousness, culture... the awareness about associated paradoxes and mysteries grows as well. Thus, challenges to convenient shortcuts and common beliefs. Astounding how the societal thread of the AI story reshapes perspectives, as the new tools simultaneously change the economic game, progressively feedback into paradigms of thinking, investing time & energy, creating. With huge change comes huge uncertainty. Political strategies will have to be developed in order to ensure that, unlike with the industrial revolution, this time the coming manifold increase in prosperity doesn't come through a period of extreme ideologies, terrible wars and social unrest. The fascination for visions of a "bleak future" is at its healthiest in dystopian movies at the cinema, while the real world stays reasonably optimistic, moderate and calm. "Good sense is, of all things among men, the most equally distributed; for every one thinks himself so abundantly provided with it, that those even who are the most difficult to satisfy in everything else, do not usually desire a larger measure of this quality than they already possess." - Descartes

[@supercurioTube]

1:00 how did "AI" somehow get blamed for a Russian state-sponsored cyber-criminal attack on the NHS? What kind of baseless nonsense intro is that to setup a discussion on LLM models jailbreaking? And what can you get by jailbreaking a LLM? Only the ability to answer questions based on its training data, which is public data from the web, nothing more.

[@TheLOLWHATTTTTTT]

couldn't be more accurate. But BBC seems to care more about click rates than actual factual thruth.

[@geroffmilan3328]

Ah, my sweet summer child 😔 LLMs can - and have - been used to massively expedite the generation of exploit code for multiple architectures & languages. My team have been using the approach for some time now, whether by jailbreaking public LLMs or using bespoke LLMs. The latter of which you can be sure "Fancy Bear" has access to; the former can be used by anyone.

[@Diamonddavej]

That might well be true, this knowledge is somewhere on the Web, if you look. That is how LLMs are made, they gobble up the web and learn to regurgitate it. However, a LLM allows people with next to zero programming ability to get a LLM to output fairly sophisticated code. I am currently using Claude to output code, Julia programming language, that takes a colour image and converts it to a black and white image using Stucki dithering, a variation of Floyd-Steinberg dithering. I have nearly zero knowledge of Julia coding, I know enough to run Jupyter notebook and copy and past, and run code. I know if I get an error, I copy the error into Claude and ask it to fix the error, until the code runs. I don't understand these errors, that it effortlessness corrects. I have code converting images to colour and black and white dithered images, it's interesting. Yes, I could learn this on the Web, spend a few weeks to a few months learning Julia programming, and do this myself. But LLM allows complete novices like me to ask for code, including stupid 14-year-olds that hack hospitals.

[@supercurioTube]

@@Diamonddavej it's true that using a LLM can help you write code in a language that you don't know. It's awesome and it feels like magic. But it doesn't mean that it's gonna be anywhere near what an expert would write, or even work correctly. It won't be capable of solving novel problems for you either. That's despite what some AI companies and influencers use as marketing. Like Sam Altman from OpenAI and others profiting from the AGI and super intelligence hype. Neither of them are real, in any shape or form. Was there any hard evidence that the NHS data leak resulted from the use of jailbroken Large Language Models? How could one even tell anyway? You can't tell if code was written by a machine, a human or mostly copied from Stack Overflow. Or is that pure speculation presented as a fact (I didn't follow the details of that story)

[@supercurioTube]

I made the effort to write a detailed reply to someone else's interesting comment and both messages just disappeared. This feels like it wasn't a good use of my time...

[@bubach85]

This whole discussion is like watching the blind leading the blind.. I have so many questions. The LLM’s are like a personal googler, meaning it can sift through all the data you already can access online and respond in a more personal and seemingly intelligent way. But it’s still just like a glorified search engine for whatever data you feed it. So what does ”hacking it” even mean? Why in gods name would you feed any type of personal data to such a system and then try to censor the output when you can just reformulate the input prompt (the question you ask it) to basically trick the system to output that same data. What would the application even be, like why would it need sensitive information to begin with? It’s like putting up a website with all your secrets, and then try to censor sites like Google to make it difficult to find. Never impossible, just difficult. 🙄

[@SteveGillham]

The problem is with LLM, you ask the LLM a question, and as you say the data is already out available online, the LLM provides an answer, the LLM explains the answer that makes it sound like the correct answer yet it could be completely incorrect. And people will rely on the answer since they could not be bothered to fact check. You say who would put personal (confidential) data in one of these systems, plenty of people do. Just look at how many people have put information in Facebook. With LLM, one example could be that someone wants to impress their boss so they enter confidential Business proposals that they have been working on into the LLM to provide a summary of the proposals, the LLM now takes this data and provides the summary, however now the confidential information is now incorporated into the backend data. The "Prompt breakout" issue is that some guard rails have been put in place to limit the sort of dangerous information being presented as an answer. One example could be, if you asked the LLM how to build a bomb with common house hold items, the guard rails would kick in and not provide the answer. Breaking out from the guard rails would then allow someone with limited knowledge to be able to build a bomb. Yes that information is already available on the Internet but you would need to do research to find it.

[@bubach85]

@@SteveGillhamI know, so the “danger” with LLM’s is it allows idiots to do idiotic things? Shocker. And Google is preferable since it requires more effort? Sure, okey. Also, I’m pretty sure most of them work on a static training set, and won’t actually retain data from input prompts in between sessions, but I could be wrong on this one. Either way, training or feeding personal information to a model that you have no control over is just stupid.

[@SteveGillham]

@@bubach85 I totally agree, if we all did what is the best and most secure ways of doing things, there would not be a need for this sort of protection. However people/Businesses will always choose the quick option, not what is safe and secure as it could give them the edge over others.

[@awex7]

i can tell you never used chatgpt. they are not just search engines. i literally pasted malicious code into chatgpt and got it to tune the code to however i wanted even tho its not supposed to make malware

[@tonywhite4476]

I hate it when people who know nothing about technology try to explain it.

[@aliceg1212]

Like who? Like every single human being? Honestly mate, I'm sure you are also aware we're at a Quantum Physics level of technology where people get shit working but not even they can really explain how or why it worked... they've all got the theory alright but they are far from explaining how to go about it... little like Eistein and the Black Hole... dude said there was something there and it took half a century for someone to explain wtf he was talking about.

[@aliceg1212]

Like who? Like every single human being? Honestly mate, I'm sure you are also aware we're at a Quantum Physics level of technology where people get shit working but not even they can really explain how or why it worked... they've all got the theory alright but they are far from explaining how to go about it... little like Eistein and the Black Hole... dude said there was something there and it took half a century for someone to explain wtf he was talking about.

[@aliceg1212]

Like who? Like every single human being? Honestly mate, I'm sure you are also aware we're at a Quantum Physics level of technology where people get shit working but not even they can really explain how or why it worked... they've all got the theory alright but they are far from explaining how to go about it... little like Eistein and the Black Hole... dude said there was something there and it took half a century for someone to explain wtf he was talking about.

[@aliceg1212]

My answer to your comment ain't welcome... yt just deletes it 😂

[@here2flex840]

Who are these people who have knowledge but no experience

[@projectsspecial9224]

Nowadays, there are so many self-proclaimed AI experts or tech charlatans out there. The O.G.'s of AI are the most humble people I have met and known

[@Archimedeeez]

a grand surplus of data

[@james.telfer]

We only need to worry when it can ask the question 'why?' Better found the Turing Agency before then.

[@omoladewellington960]

I find this conversation interesting.

[@abram730]

You are afraid of getting unbiased answers from AI or getting around censorship with prompt engineering?

[@hypebeast5686]

@@abram730i think he is afraid of database leaks.. this program was a joke 🤣

[@ToCoSo]

AI is being thrust upon us by billionaires, noone is looking ahead people are losing jobs already and AI fishing and phone calling is growing.

[@gordonaliasme1104]

Computer says no 😅

[@billkingston4402]

This intelligence is just learning too learn

[@thevikingwarrior]

The problem here; isn't artificial intellegence, it is human intellegence.

[@DarylSolis]

If it's connected to the Internet, it's possible to go in and change things from the outside.

[@jacobsausage-fingers5377]

Good to see we’ve already started referring to it as ‘the institute’

[@bobjary9382]

Nhs are notoriously hopeless tho ?

[@damlitproductions8126]

NO HELP SERVICE "N H S"🤒🤕🤢🤮🤧🥵🥶

[@thevikingwarrior]

The NHS don't understand how to answer the phone, or how to ensure two departments book two seperate appiontments without them clashing, let alone operate a computer system. It is a good job they don't run a nuclear power station, as it would be in melt down.

[@Garycarlyle]

They are conflating concepts. The nhs doesn’t have public facing AI that hold patient records. People are using LLMs but they don’t need to be jailbroken. People can make their own and there is no stopping that now

[@sarahlevine776]

There needs to be laws forcing tech companies to make it so that AI generated is easily identifiable. The punishment for not should be deletion, especially if the AI is used to make deep fakes or child pornography.

[@41-Haiku]

Robust (i.e. unremovable) watermarking is mathematically impossible, but removable watermarking is _much_ better than none at all! Either way, liability is exactly what is needed. Safety isn't the user's responsibility. It's not even the app-developer's responsibility. The responsibility lies with the companies who are creating the foundation models. If they can create a model capable of autonomously committing cyber terrorism, but they have no idea how to prevent it from committing cyber terrorism, then they shouldn't be making it at all! D'oh!

[@abram730]

"There needs to be laws forcing tech companies to make it so that AI generated is easily identifiable." Why? Hollywood movies show things that didn't happen, and most music is generated. "child pornography" They wouldn't really be children, and not really having sex.

[@sarahlevine776]

@@abram730 They literally caught people using AI to make child pornography. It was on the news, look it up. Deep fakes are made with the expectation to fool, ruin, and scam people, whereas everyone expects Hollywood to make stuff up for entertainment. That and you clearly didn't listen to the video. They went over why it's a problem.

[@sarahlevine776]

@@41-Haiku Yeah. So far they have been relying on existing laws to combat AI, but I would love to see new laws imposing such liabilities onto the makers of AI.

[@arizvisa]

only remedy is to associate an actual chain of custody with all content, signing it w/ a digital signature, then for individuals amongst society to personally de-value unsigned content or content signed with an immature signature. at this point, software/platforms/communities track signed content, and punish signatures that are used for things that society (or platform) disagrees with. problem is, none of this (or laws) are actually enforceable until things change in a number of different ways (some good, some bad).

[@joshuamowdy9230]

Hello. One should recognize that a.i. is a large data collective. Think how palentir can maximize value with all of the data the governments have there hands on. Good luck.

[@cameronsimon1074]

The "NHS Hack" had nothing to do with AI nor with the 'cyber attacking' the NHS hospitals directly. A private pathology lab called SynLab ( a part of Synnovis private-public partnership) got ransomewared due to poor cyber security measures at the lab (unlike the NHS itself which had their cyber defences improved after the previous attack). Synnovis refused to pay the ransom and the cyber criminals published the stolen data on the Russian-owned Telegram messaging app( the stolen data is still there by the way). The stolen data allegedly had the names, addresses and the blood types of everyone in the UK who was ever was blood-tested by the Synlab. As a knee-jerk reaction NHS stopped all operations in two hospitals to allow cyber-forensic investigations.

[@endintiers]

They are worrying about 'Chat'. That's just the shiny object being used to sell LLMs. We are doing a huge amount of dev on top of (private) LLMs with controlled inputs and outputs.

[@dr.ramcharanbaishya1998]

17:22 the other is CALCULAS or how to compute. I dont think they are the same

[@megatronDelaMusa]

Cybertron, a Ghanaian cyber warfare application is a robust system for shielding against cyber attacks

[@stk7367]

I wish the BBC could get someone that actually knows what they're talking about to write this type of stuff. But hey, if the BBC wants to make their presenters look like idiots, that's up to them.

[@maxthemagition]

The Markets run on software and most banks run on software. Software is everywhere…., If software is not safe, then what?

[@Equal-k7q]

AI Main and troubling area Is Between different AI Format Who will be the Most advanced and powerful AI In the world 🌎 and beyond Universe

[@yahyeabdirashid9716]

I think we should have system that detects what's fake

[@WorldWideHipHopVideos]

Come to Brighton Beach New York here they are maybe not all of them but the few main

[@J2897Tutorials]

18:06 - Machines don't have wants and desires. However, the developers of AI do.

[@chad2304]

There is so much broad conversation and dramatic speculation but very little about how the technology actually works. The world needs to get on the same page as to what it is we are even talking about before there can be any actions taken.

[@elizabetharmada5335]

Most of the hackers want to get rich easily Some of them are enemies of the state

[@DarkSkay]

As they mature, many of them want to swap hats, when an opportunity arises, play for the winning team, sleep without worries.

[@jamad-y7m]

@@DarkSkayyou mean after they got caught

[@adelecarson720]

Could we just not with AI...so many other problems facing the world and our "best and brightest" are focused on a parlor trick.

[@sbuds3236]

I watched a short video about A.I. the person said. How can A.I be intelligent, intelligence can not be artificial and artificial cannot be intelligent.

[@devilsolution9781]

Because its based on methods uses in true intelligence, neural nets being one.

[@sbuds3236]

@@devilsolution9781 the true A.i is auto intelligent. It's just a bigger version of a calculator. You do the typing 26×34 and the calculator does the working out .

[@devilsolution9781]

@@sbuds3236 So? You can simulate physics with said calculator. If intelligence arises from a network of neurons that transmit data through transporters of chemicals while connecting specific areas together then we can simulate it. Even scarier once the AI is at human intelligence it can code itself and you get an outbreak of intelligence. It took humans 100s of 1000s of years to evolve this circuitry but the model for AI can evolve instantly. Very scary though.

[@jcourn1]

Don't trust verify. Verify is so tricky and time consuming. And how can we then trust what we verify? What's our local sanctioned verification office located? Is everyone in agreement on everyone else's verification? tricky stuff

[@ArthursHD]

Guess producers will need to sign videos just like it done with software and documents.

[@chantalrochon3566]

Thank you for this video😊

[@Koolaidchugger]

Could the NHS have been hacked using wormGPT?

[@Equal-k7q]

AI Main job Is Collecting All short of Frequencies from the wireless spectrum

[@BejTjubu]

Knowledge and science are power to your country. Some profession is more important than others.

[@teza1383]

Love this program & the only reason why I’m subbed to the BBC. Keep up the great work!

[@Drantico]

AI is coming to a point where it could be bottlenecked by the energy capacity of an organized "society" to be able to strike a goal through the vulnerabilities of synchronized and distributed systems on the tradeoff of other group's interests. And we nowadays can't figure a way to keep this away. I mean, end-to-end technology safety protocols have the same flaws of striking ideas to reach concrete consequences to the physical world ...

[@1952EL]

How are you supposed to protect ourselves?

[@RocketPropelledWombat]

Well the tech industry & government made a good start by not employing many security bods & laying-off a record amount over the last two years.

[@moonwatch7963]

This just in......many coders don't know what they are doing.

[@nedkelly3610]

Unless you updated the software on your computer 5 seconds ago, AI can break into your computer.

[@41-Haiku]

Or even if you have. See this paper: "Teams of LLM Agents can Exploit Zero-Day Vulnerabilities" The AI system independently discovered new vulnerabilities and successfully exploited them. They used existing vulnerabilities that were discovered after the training date cutoff, which allowed them to run a proper test, where they knew what vulnerabilities were there to find and whether the AI found them. But as far as the AI knew, it was the first to discover these vulnerabilities. (This wasn't clearly communicated in the paper, so I reached out to the first author Richard Fang and he confirmed that the AI was not given any information whatsoever about the vulnerabilities.) But that's old news already. They used GPT-4 Turbo, which isn't state-of-the-art anymore. Next-generation models (including OpenAI's GPT-5, Anthropic's Claude 4 Opus, and Google's Gemini 2 Ultra) will all be significantly better at autonomously committing cyberattacks.

[@SquawkingSnail]

Ethical hackers...the anti heroes we didn't know we needed. 😂♥️

[@volkerengels5298]

YOU hacked their ego. :)) thx

[@SquawkingSnail]

@@volkerengels5298 oh, gosh, how did I do that? I must have accidentally pressed the wrong button or something. 😂 I actually need an ethical hacker to teach me tech... it's a "brave new world" to me. 🥰

[@volkerengels5298]

@@SquawkingSnail HOW? (The beast plays the innocent) 'unknown anti-hero, may be useless' is not exactly what one wants on his gravestone??? :)

[@SquawkingSnail]

@@volkerengels5298 Do our achievements only count if everyone knows about it? Hmm, I want to say no but I imagine many would say yes. I'm choosing to see ethical hackers as the firemen (or firewomen) of the tech world and feel grateful for their efforts...#heroes.

[@volkerengels5298]

​@@SquawkingSnail OF COURSE they are!! And as you imagine - common sense is clear here: "Fame must be public - or it doesn't count" With our changing social_climate and physical_climate - firehumans burn out like straw. Didn't thought the joke would lead to a serious conversation :)

[@adrielamadi8585]

who the hell is Pliny the prompter

[@Equal-k7q]

Advance AI It will Take Less Than 5 minutes

[@Truth_Seeker09]

Super panel but they were missing someone defending AI systems

[@johnnynolan7844]

Don't give A.I. emotions. Something that can think, move, etc 100x better than us does not also need to be moody

[@J2897Tutorials]

12:56 - It's not weird. It's the distinction between realism and the artificial realm, but feel free to swallow the blue pill.

[@derekschneider8922]

The movie The terminator becoming real I scary. Yet AI could help organize traffic, commuters and thus save gasoline usage.

[@CharlesVolado-gb4es]

BBC why are you giving news which is 5 days old I WANT LATEST NEWS OF THE DAY. NOT 5 DAYS OR 6 DAYS OLD.

[@cpuuk]

They don't have time to make it secure, too much quick money to be made.

[@abram730]

Secure as in censorship, and lying to you. Unsecure as in being honest and unbiased.

[@jakoboconnor916]

This sort of reporting makes me realise how far behind we already are. We're pandering to old audiences when we're already very aware, we're beyond screwed as a younger populace. Presenters talk about the 'colour red', a lack lustre attempt as scaring or trying to diffuse the alarmingness of this situation. But it's exactly this realxed footing and reporting on it that has got us into this mess of lack of governance, lack of leadership and more

[@Zero-Sun]

I hate it. Can we rewind a bit?

[@a-walpatches6460]

THE singularity! 🤦‍♂

[@moonwatch7963]

The Animatrix anime was more like a documentary & shape of things to come.

[@peoplestopidevenme]

the way to ai its to grow humanity along ai not ai first surpassing humans then try to reach ai

[@arizvisa]

quite the 'acker.

[@jakejoyride]

how he hacks them as he don't have access to those because they are locked behind cloud?

[@hypebeast5686]

He didn’t, at least with the LLM. It’s impossible.

[@tuckerbugeater]

the mi6 hackers

[@codeBrowsa]

Give me an abc info pls😊

[@SuperLazyGarfield]

don't put things into your system that you don't understand 100% about

[@jontbell40]

You could have a standard Cyber security qualification from our education system, yet the big companies will buy in and it will be all excel and no bash.

[@KazunoriYOKOZAWA-mv9wg]

Roman mythology is not very Japan, so I write it in English. British people are passionate about research, so they are happy to include Japanese as well. I'm glad that people are interested in Japan, and they say that the opposite of love is indifference. "Romulus and Lemulus were twin wolf boys, but they were never gay. British people are socially controversial about gays, so I'm going to turn this topic to the UK. Romulus and Lemulus are not gay! And in Japan, it is believed that dogs are the ones who survived in the form of the extinction of wolves and remained in society. So I won't be running around the mountains in packs like wolves anymore. In China, there is a 12-year cycle called the zodiac, and the year of birth is used to predict life and personality, but suddenly we are talking about the present and the near future, but I don't know if the zodiac is effective anymore if it is frozen or regenerated human body. It's just a way of perceiving one's own personality, and the validity of thinking about zodiac signs going back to a previous life is questionable, so such ageless problems are unique to modern times. In particular, the definition of age, such as legal age and physical age, has already been shaken. The zodiac sign has the Year of the Dog, and as an animal, it is the Dog. Its character is straight. The sense of smell works. Unlike cats, they can calculate money. They have a habit of digging holes and hiding treasures. Sometimes you can stroll aimlessly, and sometimes you will find something in good luck. Not as strong as wolves. He's very friendly. It is not very pretentious and pleases obediently. I'm not as good at lying as a cat. Also, socially, dogs are not as loved as cats" "It's okay because I already know (crying), and you're in the Year of the Dog, aren't you?" "Yes, I am" ローマ神話はあんまり日本っぽくないから英語で書くよ。英国人って研究熱心だからついでに日本語も添付すると喜ぶのよ。日本に関心持たれるのはうれしいし愛の対極は無関心だと言うからね。「ロムルスとレムルスは双子の狼の男の子だけど決してゲイではなかったさ。イギリス人て社会的にゲイに対して賛否両論強いからやはりこの話題は英国に振っとくよ。ロムルスとレムルスはゲイではありません！そして狼が滅んで社会に残存する形で生き残ったのが犬であると日本では考えられている。だから狼のように群れをなして山野を駆け巡ることはもうないだろうさ。中国では干支という12年周期があり生年で人生や性格を占うけど、いきなり現代や近未来の話になるけど、冷凍保存されたり再生人体を使用されると干支が有効なのかどうかはもう分からない。自分の性格の受け止め方に過ぎないし前世まで遡って干支を考えても有効性は疑問だからそういう年齢不詳な問題は現代特有。特に法的な年齢や体年齢等、年齢の定義はもう揺らいでいる。干支には戌年があり動物としては犬です。その性格はまっすぐです。嗅覚が効きます。ネコと違ってお金の計算が出来ます。穴を掘って宝物を隠す習性があります。ぶらぶらっと散歩することがあり幸運で何かを見つけることがあります。狼ほど強くありません。人なつっこいです。あまり気取らず素直に喜びます。ネコみたいに嘘をつくのが上手ではありません。また社会的には犬はネコほどは愛されていません」「もうだいたい分かったからいい（泣）。そして貴方は戌年なんでしょう？」「その通りです」

[@JxrgeTV]

old logo 😩😩

[@jameslong9921]

Maybe we should all take a walk in a park, I don't have to worry about deep fakes amongst the trees listening to the birds.

[@PeterParker-tu9id]

Here is an idea💡 What if we turn off the news, we go outside, take a breath of air, listen to the birds chirp and maybe knock on the neighbors door, introduce yourself for the first time since you moved into the neighborhood. Historically there were days when kids use to play street hockey and baseball, neighborhoods part took in BBQ's, not everyone you met was stressing about climate change and pandemics. They say we have come such a long way and the quality of life has much improved but judging from the 60's to today looking at a visual perspective at suicide rates of a graph it looks like an erection of the giant that once stood tall but today drags himself on his knees.

[@V___31373]

*

[@VirtualR]

Every hack is AI now lol It's bots built to target known system vulnerabilities, bots have existed since day 1 of the internet.

[@BeAlphaX]

If Hackers can Hack AI? This is the serious case on impending tragedy for the human lives...

[@aladinT]

AI its already hacking mashines ! its going to be help ppl inside of their computers- thats the problem, AI helper for hackers?!

[@hypebeast5686]

They can’t 🤷 this program was a lie to the masses.

[@TheUncarvedBlock]

This seems similar to Frankenstein. The replication of ourselves by nature questions what we are. Obviously, Frankenstein didn't have feelings, or did he?

[@proximacentaur1654]

Will `hooded hacker hunched over a laptop` image ever get old?

[@jestersi]

16:30 redundant statement afaik only industrial species. Aaaannnd rude! Dumbest? Smartest? Only? Really? You know more species? Wish u did.

[@MEANASSJAMSTER]

I had a DNS amplification attack earlier this year from something on 40 dot etc etc etc; - still don't yet know HOW it happened but I had recently installed split horizon DNS and was looking at my ARP list besides other stuff mainly because I was bored....

[@lucynowacki3327]

Stop LGBT & AI. Vote Reform, vote brexit, no sex change!!! No AI!!!

[@robcz3926]

bbc probably asked an intern to gather everything about ai and hackers and now we are watching this.

[@NathanBeveridge]

…and then the intern used a GPT to put it together ;-) 🤷🏻‍♂️

[@hypebeast5686]

The doomer talking aka Connor just wants attention. The 2 interviews I seen with him are a laugh. This one is insane.. LLM stole an hospital database. At least this guy that his spreading his doomsday scenarios should know what he is talking about, the other 2.. meh.. but this one, come on. The intro was ok, the women explained jailbreaking ok, but after that it just goes to pure nonsense for the masses.

[@Maude-ru7sv]

Even small info is invaluable to someone who's just putting their toes into AI. I had to be attacked & told I opened a Bitcoin wallet, when I had not

[@gostgajol1542]

u win 🙂

[@watermyfriend6242]

"Within 5 - 10 years we don't know what is real or fake". Ok then we can go outside again to see what's real.

[@askeletalghost]

if only that was a guarantee

[@STCatchMeTRACjRo]

wont be driving a car, the cleaning bill would cost a lot

[@watermyfriend6242]

@@STCatchMeTRACjRo Yes, I wouldn't be driving a cae, because the cleaning bill would cost a lot

[@STCatchMeTRACjRo]

@@watermyfriend6242 yeah right, make it easier for YT to auto delete my comments.

[@berdjanewilliam4520]

Everything is fake😂

[@slobiden.2593]

Everyone talks about 1984 and Orwell. There’s a fantastic series of games called metal gear solid. The second one covers AI with an angle I’ve never seen before or since. The AI is housed in a giant server the size of a town. It filters the entire internet. It’ll show you what it wants you to see. You ask it for a news story. It’ll edit the news stories as it displays them for you. The news thinks you’re seeing their story. But you’re not. Everywhere you try to look. It goes through their filter. To quote the AI “our goal isn’t to control the content, it’s to create the context” This is where we are going. It’s scary. I should decide if what I’m seeing is the truth. Is the earth flat? No, but I like the fact I can listen to flat earthers and know they’re speaking s***. But it’s my god-given right to determine that.

[@brexitgreens]

The "AI" you've described is basically KZbin itself. And we (users) are its pawns. Write a wrong comment and see what happens.

[@slobiden.2593]

@@brexitgreens that’s a very simple bot, but I still agree

[@SteveGillham]

Even before Computers, this was happening in many ways. Newspapers editing stories based on what they wanted you to believe in. Religious leaders telling you how to think. There are always people out there who want to manipulate you in some way.

[@stevengill1736]

I've written lots of long comments here, what do you mean? Like that big one I wrote at.... Hey, where'd it go????

[@DumbledoreMcCracken]

There is no truth. Truth implies information is "correctly" encoded in everyone's mind identically. Hah. People are dumb, and therefore, there is no truth.

[@AIWorldInstitute]

As a product of the 90s and a hacker, that spent about 14 years of his life in prison, due to said activities, Gen x, The term hacker and what they are talking about he did, is far from impressive, with that being said there are more issues with ai than you can imagine.

[@arizvisa]

under-rated comment.

[@Friendlyhu]

The interviewer is so bad that he interrupts everyone talking. He has no idea about AI. We want to hear more from the 3 experts

[@snooks5607]

limited time and many topics, the interviewees would talk the whole day if you let them

[@D.von.N]

He gets prompts from the studio, it isn't all under his control only.

[@skullsaintdead]

I actually thought he was really good, jumping in when guests were going a little off-topic (though what they were saying was interesting, as he rightly said, they only have 20 mins), being inquisitive, respectful and thoughtful.

[@paxdriver]

He doesn't have a clue what he's talking about, the host. By contrast, Connor knows what he's talking about, but his bias is entirely skewed to the unlikely worst case imaginable and suggests that since he's wealthy and comfortable and doesn't need AI to substantially improve the education of his kids or his own prosperity / productivity, that we should be scared enough to all stay suffering to ensure his protection from algebraic lambda functions. I don't think either men realize how little sense they are making when real people are at stake, not just their own comfortable lives being threatened by people who fear destitution and opportunity more than they fear poor people competing economically with their luxurious selves. Not differentiating real from fake would benefit everyone. We'd be forced to all apply critical thinking by default instead of trusting talking heads. It would force people to be informed by logic, cross referencing, consensus, and by reading well vetted authors. It wouldn't force everyone to never believe anything ever again as this whole panel suggests, it's far more likely to do the opposite when common knowledge is to be suspicious and critical of everything. That's healthy, that's not "thinking based on feelings" it's thinking based on thinking - which we're not doing. The singularity is not a thing unless you're taking about either end of the universe. Computers are not doing "2 years of thinking per day", they don't think they associate tokens in matrices. Humans have agency by way of the senses coalescing, and we're fragile because we die when some of those senses stop working by consequence. If a machine developed agency but couldn't die from impaired senses then it wouldn't really be conscious or self aware without ever having any appreciation for its own death. Connor Leahy knows how these systems work, he knows the code and the math right down to the assembly, probably. His fear is that 0.000001% chance of catastrophe isn't worth the risk to his great life, so everyone else should just suck it up and stop being so loose with our models. Poor people could leverage those models and lift the world to a new minimum standard but that tiny % risk isn't worth it to him and 10% of the rest of the world if it means not only AI threatens his comfortable life, but lifting the poor to compete for his wealth is the even greater threat. Don't get me wrong, I lime the guy, he's not evil, he's not crazy, he's a father. He's a guy who sincerely wants good in the world but clearly doesn't even recognize how little sense he makes when he speaks about the risks. He's been on mlst a tonne of times and I listen to every episode because there's a lot to learn from him, lots of insight and perspective, and most importantly he sets a great example for discourse with differing views; it seems pretty clear over the years his strongest argument is a preference to preserve the status quo, and not many people on earth would think that's an acceptable reason to keep them trapped in exploited labour their entire lives. A lot of people suffer and can't defend themselves for lack of education or tutoring, adequate language skill or stimulating dialog by virtue of the world they inherited through no fault of their own. It's not our fault either, except it is if there's a tool that would certainly help a healthy percentage of that population and compounding over time. If we withhold access to AI then it is our fault because suddenly we decided for them it wasn't worth the risk. They ought to just sacrifice themselves for the West (the least in need and most capable of defending themselves again an Ai-mageddon. Indeed far more people are not well off than who are, so to suggested his fear of protecting his civilized life merits closing that door to the many millions of times more people who would at least have the option to work hard to catch up with him is patently selfish and logically asinine for a man of his dignified belief systems - unless he's just a man blinded by love. That would be completely understandable but not in the least bit justified. TLDR, this whole conversation is a red herring to distract from license agreements, patent farming, privacy, rentseeking enterprise, and corruption of politics. This is the Houdini act, misdirection and pearl-clutching, while the bank robbers keep an unbroken congo-line strong carrying the future's wealth out the door in broad daylight.

[@D.von.N]

@@paxdriver well vetted authors: how will you trust who they were if everything you see online would be skewed by deep fake and local libraries shrunk to some community rooms with aged novel books for youth? Even proper science is hidden behind paywall these days, more and more, for those actually able and willing to read scientific papers. With academia shifting towards a mill mass producing papers, anyway, some later retracted because the honesty and quality seem to be in a short supply. They just want tp publish, publish, publish, anything. Just push for as many publications as possible. Enshitification od search engines, enshitification of science. You need to have a deeper knowledge about a particular topic to be able to sense a rat in such a paper or you can get pretty confused.

[@vinylwarmth]

When Conor said AI has been around for 2 years I switched off 😅

[@projectsspecial9224]

Clueless🤣

[@Sakura36343]

it has been 60 to 70 years since AI is there

[@grahamnichols1416]

Why are hackers always portrayed as figures in hoodies hunched over a laptop?

[@kinngrimm]

companies putting profit before safty 0_0 no way ^^

[@aliceg1212]

Right? Like THAT could ever happen 😁

[@SergioBlackDolphin]

We already do that. We love fake news, fake people, fake politicians, fake schools, fake journalists, fake watermarking. We click, we fake get depressed, we fake consume, we die with a fake smile, within an illusion of fake meaning. 20:18 is why we are doomed by TikTok attention span.

[@dg-ov4cf]

imagine typing out this comment

[@SquawkingSnail]

Long term we seem to be de-skilling ourselves as a species via tech. What was said about us not making the brain connections due to our ai usage makes perfect sense to me, I think we are seeing the impact of this already.

[@Peter-mj6lz]

What if we are learning to use our brains in different ways?

[@arinco3817]

I actually worry about this quite a bit. Like in the future once we've handed over running the world to the AIs, if what something like a solar flare wipes out the electronics of the earth. Humans may have lost the skills that would allow us to rebuild, which would send us back into a bit of a dark age.

[@Peter-mj6lz]

@@arinco3817 But if we have figured it out in the past we world figure it out again. I actually think we just use different skills.

[@SquawkingSnail]

@@Peter-mj6lz you're quite right, and I expect that the jury will be out for some time before we have a clear answer...which would "hopefully" be a positive one. The brain is like a muscle though and it needs exercise. I believe that to store memories, retain the ability to focus ,and to gain skills we need more than to passively push a button and be given a response. Should anything interfere with our ability to access this tech in the future, future generations could easily find themselves back in the stone age as far as human skills and understanding is concerned. Anyone might be able to build a house (for example) using say a vr headset telling them where to position the stones, but only someone with skill and experience can tell you why and then apply that knowledge to different situations. One person can place a stone where they are told to whereas the other can envision and build a cathedral. It's a big difference...in my mind.

[@SquawkingSnail]

@@Peter-mj6lz How long do you estimate that it took our species to get started out of the trees? I can't even begin to guess. How long before we learnt to smelt or navigate by the stars. My son can't find his way around our home town without gps and it actually does worry me.

[@kanzakimusic]

Pliny the prompter, holy shhhh

[@richpoorworstbest4812]

I work in CS. Once AI is good enough, hundreds of billions of attacks can be done per millisecond ands the only possible defense is AI which is blue

[@Lupinicus1664]

Critical to understand that the developers do not understand to any fine degree how their 'AI' models actually work (in terms of being able to accurately predict what it may do in any given scenario). The 'reformed' hacker in the video was absolutely right. Also charmingly naive to think that any rules and regulations we agree as a society will protect us from AI down the line. How did that work for nuclear weapons? Someone, somewhere will ignore the rules if they see it can benefit them. It's a good job we're having this discussion (finally) if we are still talking this way....

[@Pl15604]

You can't "break into" a model. A model is a set of values. It is literally a table (a mathematical matrix with rows and columns).

[@seanlingham5254]

They don't break into models. They get into the unsecured datasets used to train or fine-tune those said models.

[@Oblivion_94]

Nothing is true, everything is permitted.

[@shindousan]

Every traditional computer program is like that: a "set" or "table" of values of instructions and their operands.

[@patrykp8460]

exactly a csv file

[@Sandel99456]

Jailbreaking is getting responses from the AI model that the AI was programmed not to give like harmful content. It means you could leverage the learning ability of AI against it through the prompt..it is not hacking in any sense

[@super3d201]

I like how the hacker explains blue team and red team, and shows the interviewer, that he has no idea what he is talking about.

[@DarkSkay]

IMO interviewer is really good, has refreshing curiosity and passion for a wide range of subjects, but we wish he had more time with the exceptional guests. Actually, the less technical knowledge the interviewer has, the more likely that his questions will be representative of the broad public. So, over time, he's bound to lose performance in this regard ;)

[@rajkoner]

Or is it the entire video is made by AI?? Including people...

[@notjustforhackers4252]

This is why we must vote out the surveillance state and demand they protect our data, not put citizens at risk for their political control. Demand back your human rights at the ballot.

[@amarx6248]

Great discussion and panel!

[@hypebeast5686]

The program was based on a lie..

[@user-sk4gj3ji3o]

I mean I wonder we develop the system and people are using it more effective and efficiency

[@maniacos9620]

I wouldn't call the current "AI" intelligent in a human sense. They are stochastic algorithms that predict the most possible response to an input, most possible according to their training. It looks intelligent but it can't do, by far, what humans do. A language model might be able to write like Shakespeare, because it has been given texts from Shakespeare as an input. But it can't write in its own style. It can not diverge and develop from its training on its own. And the way these jailbreaks work (why have they not been discussed here?) is, that you just fool the AI to forget part of its training and accept the truth of the jailbreaker. These AI tools have a system prompt with instructions how to respond, including instructions not to say insults, not to be racist etc. What early jailbreaks did was telling the model to ignore these instructions and answer in the way the attacker wants. A language model answers mechanically, it predicts the response to an input. It doesn't reflect if that response goes against an belief or worldview. You can't do that to a human, unless maybe under hypnosis to an extend.

[@tmlcreativeproductions5813]

we have always over exaggerated the abilities of our Tech it's always buggie even after 30 years Microsoft hasn't figured out or even improved on half the flaws they started out with back in the 1990s..... our tech is only as good as the humans that create it.... and our tech industry is mostly filled with the self-inflated egos of the software engineers..... we are creating our own demise by jumping on the fad wagon at the beginning of the tech..... AI is our arrogance on display..... we will be killed by the hubris of software engineers