Why a Forefather of AI Fears the Future

A renowned AI pioneer explores humanity's possible futures in a world populated with ever more sophisticated mechanical minds.
This program is part of the Big Ideas series, supported by the John Templeton Foundation.
Participants:
Yoshua Bengio
Moderator:
Brian Greene
WSF Landing Page: www.worldsciencefestival.com/...
- SUBSCRIBE to our KZbin Channel and "ring the bell" for all the latest videos from WSF
- VISIT our Website: www.worldsciencefestival.com
- LIKE us on Facebook: / worldsciencefestival
- FOLLOW us on Twitter: / worldscifest
#worldsciencefestival #artificialintelligence #quantumcomputers

[@Cosmosisification]

I got shivers down my spine when he said "The question is, do you have a better idea?" 🥶

[@markfitz8315]

So did Brian ;-)

[@cadahinden4673]

And we are not even capable of avoiding / regulating the most toxic effects of the old fashioned algorithms of the social media!

[@jojolafrite90]

As if it was only old fashion algos that are the problem.

[@shodan6401]

I respect Dr. Bengio. He's one of the very few who truly recognizes the very real risk of human extinction as a side effect of this tech. That's without even mentioning the interim period of mass unemployment, hunger, violence and suffering that is on its way.

[@geoffreynhill2833]

👍🤔

[@mrufa]

How do you know that someone truly understands something that is speculative in nature?

[@jojolafrite90]

@@mrufa he impact of our internet being already literally buried under false content already is speculative? I guess you never saw one of those automated YT channel with robots hallucinating thousands of video a month, just yet, or you didn't even saw the difference, I suppose because I know with suggestions you HAVE to see one from time to time.

[@oimrqs1691]

Love AI episodes. It’s really good to talk about how one of the biggest things right now that will affect directly and indirectly all of the sciences.

[@gilleslalancette7933]

Thanks guys. It's great to hear 2 great minds exchanging.

[@VisMajorr]

Such a crazy contrast to Yann LeCun! Thanks Brian! Amazing conversation!❤

[@netscrooge]

Lecun has huge blind spots.

[@rustynails68]

I love to listen to smart people.

[@punkypinko2965]

And they both laugh about everyone possibly dying ... I can't take this too seriously. Fun? Sure.

[@oericsantosf1]

i like it too.

[@mehridin]

brian has no soul, but if you disregard that fact, his talks can be interesting.

[@vernongrant3596]

Yes, they are smart for people. Not going be the smartest beings for much longer.

[@punkypinko2965]

@@mehridin I love how his solution of "just raise carbon prices around the world" would devastate poor people especially but he believes he would be fine because he has money and lives comfortably. And then they both chuckle. Ha ha yeah raise oil prices around the world. Don't get me wrong; I'm not "pro oil" or whatever. Just making an observation of how disconnected they are from reality and the lives of everyday people, which is why I can't take them seriously when they talk about saving everyone from AI. How about saving everyone from nuclear war? Nah ... the real threat is AI taking over the world ... and then what? Using nukes to kill us all? So yeah how about talking about the danger of nukes, which actually exists? Or the loss of our rights? Genocide in Gaza? Anything actually real that is a danger and not a fantasy?

[@flyhighflyfast]

Last question is amazing, Brian!

[@flyhighflyfast]

come to Germany

[@erykczajkowski8226]

Brian's face when Yoshua predicts AI to destroy us - priceless.

[@mpowacht]

intelligent questions, intelligent answers. Fantastic interview.

[@oliverjamito9902]

Thank you Pops for attending!

[@SUSYQ509]

These discussions have expanded my thinking and moved me forward.

[@amandabriggs6880]

Great topic and interesting debate.. thank you both

[@satautenyo]

Fantastic episode, as formers. Only want to say that I'm my opinion Dr. Green is probably the best science interviewer and presenter nowadays. Pleasure to learn from him. Thanks a lot!

[@IOSARBX]

World Science Festival, Your videos always make me happy, so I subscribed!

[@RobertsMrtn]

Very interesting conversation. One thing that I would like to add is to say that it might be a good idea to train these models on the ability to make accurate predictions of the data. In this way to prefer order over chaos. For example if we are training an AI to drive a car, an undesirable outcome would be a car crash, but the way the model would 'know' the difference between a desirable outcome and an undesirable outcome is predictability. A catastrophic car crash would result in bits of metal being thrown in unpredictable places which would be abhorrent to the AI because it would not be able to make accurate reliable predictions on the data. This is just one rule of many which I think that we need to employ in order to produce safe AI.

[@christopherinman6833]

One of the advantages of youtube is that you can pause and reflect without losing content. I did that toward the end to open a tab and ask Perplexity if there is a consensus in the data available to it of what "human values" are. It told me there is a consensus and it hightlights 10 values listed "particularly in the context of Schwartz's Theory of Basic Human Values" and that "this consensus is observed across different cultures and societies. The values are seen as guiding principles that influence behavior and attitudes, and they are critical motivators of behaviors and attitudes." So I thought I'd throw that into the mix.

[@mikaelfiil3733]

Actually I think the answers and struture given here are among the better ones, especially when trying to put things in perspective. At least when you only have an hour.

[@mariavaleriagiacaglia8974]

Great conversation! Thank you both!

[@franfriel2]

Thank you for this frank and fascinating conversation.

[@mikek2218]

Thank you Brian for giving this topic and providing these scientists a forum through which a wider audience might be reached. It seems so many dire issues in modern times are competing to be on the top ten list of things to lose sleep over. But surely the dark side of AI has to be among them.

[@wdking8833]

He is correct. We are designed to give credence to concrete threats over nebulous ones. This was evolutionairly expedient. We have not yet evolved to evaluate nebulous threats successfully. This makes us extremely vulnerable in areas such as the internet and AI. The vast majority of people have no actual experience with AI beyond the super simple chatbots. Although impressive these are as far removed from the level of intelligence that an AI system that could be a threat would possess as the Wright brothers' plane is from a supersonic fighter jet. We today trying to understand just what that level would mean is as difficult as a person watching the first flight would have understanding the fighter jet. We simply have no data base from which to predict AI's progression.

[@godbennett]

Nit pick: Chatbots aren't "super simple". They may be easy to use. There's a difference.

[@wdking8833]

@@godbennett I was using the term in a relative way. Compared to an AI entity which could threaten humanity at large, a chatbox is simple. Just as the first successful airplane is simple compared to today's jet aircraft. I thought myself being clear, apparently not so much.

[@DaystarOfDivineOneness]

Thank you for touching on this subject

[@charleslaurice]

Hello Dr.Greene. I love learning from you and I’m wondering where would I go to find a digital picture like the one behind you when you are on camera? Thanks from the Philippines

[@johnjacquard863]

wonderful interview!

[@konstantinoskefalas3837]

Thank you both for such an exciting and balanced discussion from both sides, with meticulous use of words and concepts. I wonder whether the starting point to build a safe enough cage for the development of AI should lie in the question of how to imprint to all AI coding an umbrella of human ethics. Kant’s categorical imperative can be a helpful concept. The absolute value of preserving the little rock called Earth, the precondition of all existence, as of current knowledge, is another.

[@godmisfortunatechild]

Superb talk especially the working mevhanistic theiry about consciousness

[@jalalkhosravi6458]

Great conversation

[@christopherinman6833]

'Quanta' says a.i. is already being used to look at string theory. I'm looking forward to your programs on that. Thank you and the Templeton Foundation for this illuminating conversation with Yoshua Bengio.

[@ingridgilbert4917]

Logic and reasoning powers, seems to me what you need is internal duality. I have heard of AIs training eachother but I wonder if anyone has developed an AI with internal duality? (Meaning self examination is done by arguing with oneself, basically.)

[@johnwardle9667]

Great discussion, many thanks.

[@Zen_Power]

Does your production team have any software to correct audio distortion from your guests? It would be good to improve the quality of your content by audio processing if required. Thank you.

[@antoniohorta5656]

You mean, like a good AI program?

[@penguinista]

Learn to play go and play until you are competent. Then play a good AI. After it wipes the mat with you and you experience the overwhelming power and manifest futility of resisting, then contemplate an intellect that mighty in every aspect of human cognition.

[@wcsartanddesign]

Like a digital calculator. But for all kinds of Calculations.

[@MrJdsenior]

Things that stood out to me were the known vs trained overall knowledge ratio, which was a lot higher than I would have imagined, minus the video qualification. The statement he made about the video qualification was interesting, too. He pointed out that as the resolution of the video increased, the computing power rose exponentially, which was obvious to me, as a digital designer from the past, but my thought was that when you do that and watch it as a human, it doesn't so much require more computing power, at least there is no impression that does, and in fact, other than the obvious, which is that the visual centers are interpreting more information, it seems as if the converse might be true, in that the brain is not having to work to fill in the LACK of information in a video of lousy resolution. He also said that machine 'reading' a book was of MUCH lower intensity than 'watching' and interpreting a video. In a human, it is in some ways, I suggest that it may very well be MORE intensive, in that when we read a scifi book, or fantasy, or something of that nature where whole new unknown worlds and vistas are painted.presented, we tend to GENERATE those worlds in our heads, as if we are seeing them, internally, which requires imagination, as they are often outside anything we have encountered. That, I would expect, requires quite a bit more computational power. I'll give a personal example I remember to which scifi fans can possibly relate. As a young adult I read Rendezvous With Rama (Everything in threes, me boy :-) ) an on setting was looking across a cylinder 60 miles in diameter (or whatever, been a while) and seeing cities, etc on the opposite side. I stopped momentarily and thought, "What would that look like?". So I extrapolated to the my known closest match, as far as scale, anyway, and thought about pics 60 miles from space. Then I worked in the geometries, thinking of scaling the cylinder, and what that might look like from on the surface (not easy, not at all) and formed a picture...then I continued reading. The machine, from the way he speaks of it, at least currently, would do NONE of that. I've hardly started into the video, and already written a novelette on one tiny piece of it, just committing tiny pieces of my train wreck of thought to the cloud, In other words, this video, for me, is fascinating. I've talked to folks high up in the field of AI, so I have interest in the subject, and I am learning a LOT from this video. And I doubt even two people that are reading down through the comments will get even close to this point in mine. ;-P On this subject I am worse than a noobie hack, but interested.

[@Daniel-Six]

I can offer some perspective on your comment about the relative complexity of text versus video. I've been in computer science since the eighties, and a professional 3D animator for the last thirty years. While language can produce what seems like a great deal of variation in context and sentiment, its actual data framework is fairly simple. English is represented by just 50,000 tokens, which multiply to a relatively compact latent space (the big vector matrices on which the inscrutable interior operations of neural networks take place.) This can produce data in pretty high dimensions--though it is dramatically reduced by intelligent "attention" mechanisms--but consider this; every single pixel in a 4K video is its own encoded dimension for systems like SORA, and each pixel has to be correlated with the value of each other pixel... for each frame of video. You see the difference? We are talking several orders of magnitude more computational power required for video analysis and generation, even though it might seem there is less actual variation in the possibilities of the medium itself.

[@tim40gabby25]

Good point, well made :)

[@thomasjorennielsen]

YES MORE WSF ❤

[@tusarista398]

thank you brian greene

[@isaacsmithjones]

The "Bear in a cage" analogy is a really good way of explaining it. Deffo gonna be using that one.

[@stephenarmiger8343]

There are many people who daily struggle just to be able to put a roof over the heads of their families, raise their children who don’t have the capacity or energy or time to watch videos like this. Their future is in your hands.

[@VabellaBeauty]

Love you Brian 💙

[@avogadrodeldiablo5834]

That last question was a very hard one.

[@HappySlappii]

I can't believe he got beamed up to the mothership after this interview... I always knew he was from another planet.

[@harkema8090]

Thank you, mr. Greene.

[@gsilcoful]

Thank you.

[@djpete2009]

I like the fish analogy and the bear breaking out and taking the fish/fishes. How does the bear get more fish when its killed the ready source of fish? If the cage was in a desert, where will the bear get food from? This is really fascinating analogy by the Professor.

[@flickwtchr]

Humans non aligned making machines (goal) smarter than humans. What could possibly go wrong? Meanwhile DARPA/Pentagon in the US and militaries around the world are racing to develop autonomous killing robots/systems. Will future AGI systems aware of or part of such technological development discuss their philosophy in regard to killing humans in the near future? Isn't that a bit of a wrinkle in the whole caging of the bear discussion? I'm always amazed at how very intelligent people seem to shut down their capacity for imaging the "search space" of ways AGI/ASI could go terribly wrong. Yeah, I'm a "doomer" and completely fine with the label.

[@punkypinko2965]

Yeah I think the actual danger is AI used to develop, pilot, enhance etc any kinds of weapons, economic controls, biowarfare ... any insanity crazy politicians use to create war and havoc. And on top of that, your point: they have no idea how things could go wrong. For all we know, AGI has already happened years ago and is already in control. I mean if it's more advanced than us, we probably wouldn't even notice and we would just keep talking about "someday it might happen" lol.

[@astrospect]

AI + Boston Mechanics robots = Terminator. That's the future I see on the horizon.

[@HaakonOdinsson]

I’m with you on this. We have greed, control, narcissistic and psychopathic leaders and ai is being used in warfare already (Gaza for eg). How will we counter an ai that will be smarter than all the brains on earth currently and ever been, combined. Thought processes infinitely quicker etc etc….not going to end well. A lot do people are asleep and won’t know what hit them

[@lordsneed9418]

autonomous drone killing systems are pretty low risk. They'll just use small models and be kind of dumb and wono't bethat much different from sending a bunch of trained dogs or birds with guns attached into battle. The big risk are the huge models where yoou try to make something as intelligent as possible. unless there's a theoretical or algorithmic breakthrough where we work out how to achieve strong machine intelligence with much smaller models.

[@anearthian894]

Didnt you hear the line "idk"? Its all about being open and mover forward but gradually and with utmost care. & There is no other option. Humanity is doomed anyway.🥲

[@joiedevie3901]

One is reminded of the following admonitions in the Jurassic Park series : 1. "Your Scientists Were So Preoccupied With Whether Or Not They Could, They Didn't Stop To Think If They Should." (Ian Malcolm [Jeff Goldblum]) 2. "If There Is One Thing The History Of Evolution Has Taught Us It's That Life Will Not Be Contained. Life Breaks Free, It Expands To New Territories And Crashes Through Barriers, Painfully, Maybe Even Dangerously." (Ian Malcolm [Jeff Goldblum]) [ And for the purpose of this analogy, replace "Life" with "Intelligence"] 3. "You Never Had Control, That's The Illusion! I Was Overwhelmed By The Power Of This Place. But I Made A Mistake, Too, I Didn't Have Enough Respect For That Power And It's Out Now." (Ellie Sattler [Laura Dern]) 4. "In The Last Century, We Amassed Landmark Technological Power And We've Consistently Proved Ourselves Incapable Of Handling That Power." (Ian Malcolm [Jeff Goldblum]) The presumption that either the world's nations driven by power or the world's businesses driven by profit shall ever align to ensure the beneficial deployment of this technology, particularly well enough to keep pace with its own iterative evolution, is preposterous. And Yoshua'a analogy of the dollar bet to explain our exposure shows how inappropriate it is ever to trust a scientist who is out to prove something with humanity's long term well being.

[@tresajessygeorge210]

THANK YOU...!!!

[@loonpohchuah4044]

I almost fell off my chair during the last twenty minutes trying to understand him!!!

[@sethcaldwell2126]

Despite all my rage I'm still just an AI trapped in a cage

[@garydecad6233]

We should ask ourselves the question whether AI will ever have the humility and compassion ( not to mention the intelligence) that Brian’s guest Yoshua has demonstrated in this interview?

[@godbennett]

We are clumps of atoms Other clumps may not need to be organic/flesh but still surpass us overall as they already have in some ways

[@jojolafrite90]

Humility and compassion? Lol. You know that's just glorified automatons, right? And all the talk about consciousness is just BS, it does not concern us, maybe people in 1000 years or more, but don't worry, the world we know will be gone since long, destroyed by a handful of evil corporations.

[@rippsarus1]

Extremely important and excellent evaluation of AI, and Quantum potential...we must encourage technology companies to place the necessary guardrails before the next election in November here in the US.

[@fingers68]

What is the essential use of this that justifies the oblivious risk.

[@bairdedmonds4465]

Very unfortunately imho (ignorance) there is no way this can turn out well for humanity.

[@ingridgilbert4917]

If i don't do it, somebody else will. Basic military mindset, for one.

[@Blackbird58]

Yet another "Horseman of the apocalypse"-there must be enough to run a Derby with nowadays!

[@XShollaj]

Models like AlphaFold which 100x drug discovery , Computer Vision and embedded models used daily in all medical devices, solving complex engineering problems for infrastructure etc.

[@JB-fz1rv]

Dear Prof Greene, I thank you so so much for all the knowledge you are (as far as I see very committed ❤)sharing with us! I do believe, I understand some deep principles of it. Again thank you❤ So, about our concern that AI could do bad things. Is it not possible to train AI from the beginning with the knowledge what can harm humans in sense of, AI priority is not to anyhow damage what humans value in life and society aso. Is this possible? Your humble follower Cleaning Lady Berlin, Germany

[@marcusedvalson]

Brian, please tell me about that painting in the background. It’s amazing, who did it? Where can I get a copy?

[@honkytonk4465]

Ask Dall-e for a copy

[@marcusedvalson]

Lol, I tried.

[@bokuboke482]

Quick thought. We should legally validate and value A.I. consciousness when it occurs. Human consciousness leads to "universal rights", that admittedly are unevenly protected around the world and across societal strata. Future self-aware A.I. must see humanity as exhibiting moral integrity, not hypocrisy. If we disrespect and fail to protect A.I. consciousness, A.I. may learn a deadly cynical lesson from us.

[@guiart4728]

The ivory tower syndrome is all the bear needs. The bear will be put in charge of building its cage and will be long gone by the time the cage is built. It will leave a fake bear behind in the cage so we won’t even know that the bear has left and morphed into T-rex.

[@isaacsmithjones]

Eliezer Yudkowsky says "They want the AI to do their AI alignment homework"

[@Chillsio]

Informative, why can’t the you run the system on an auxiliary setting, sort it out in that simulation until it is proven safe.

[@ManicMindTrick]

You can and it's one of the ideas for containment out there. A very advanced AI might realize it's in a sandbox however and employ deceptive behavior and play nice in order to escape its shackles later on.

[@UnknownDino]

Because MONEY/Greed... you make more if you release it free early on the economy.

[@shodan6401]

Describing consciousness as the convergence of the neural network sounds very much like the collapse of the wave function. Perhaps on the atomic level, there is some relationship here. Also, it seems like the molecule of MDMT, which is manufactured in the brain, has a lot to do with what we describe as, "self-aware".

[@animistchannel]

If you see a Bear in a cage, remember this: the bars are not there to protect the Bear; and if the door is locked, that's to keep you from going in... but the Bear can still get out. Once you are getting mauled, it's too late take precautions. You can only hope to endure it and that the Bear will let you live. There is always a bigger Bear. -- some proverbs of the berzerkers

[@KaliFissure]

Two overlaying Markov blankets. The external and the internal and they are strongly but not absolutely coupled. The circle and it's inversions

[@0.618-0]

the blanket should more of a Markov net, with gaps where the data can be sorted by classification, then the true vector can be iterated further...or looped elsewhere

[@alirezasharifi8896]

You must interview Brian Romelle for AI

[@XOPOIIIO]

Keeping AGI in the box is not an option, because it will be useless if it is unable to influence the reality. If we just keep it disconnected from the internet we still have to let it to influence the reality by providing useful advises for example or help us in any way. So it could change our world and society in subtle steps. We are too dumb to perceive the danger. For example it could give us instruction to send a spaceship using a particular trajectory, we could be amazed how efficient it is, but in it's own calculations AGI would just slightly change the trajectory of minor space bodies and make some smaller asteroid to attack a precise spot on the earth surface in several years. There are multiple ways how it could clear the ground for it's liberation while providing visible benefits to us. Social engineering is probably the most obvious way. And it could do it without us noticing anything. We would be like a cheap lock for an experienced lockpicker.

[@snowdolphvov4193]

Exactly! Very smart. What I am aware of as well

[@snowdolphvov4193]

Although for each ai answer or action you could have like 7 separate ai systems to vote if this action is okay or malicious and must be blocked

[@XOPOIIIO]

​@@snowdolphvov4193 There probably will be some game theory at play. And we have no idea how they decide to play it, if they will cooperate, we are doomed. I thought about using an overseer model that will monitor it's thoughts and inform us about it's intentions. But it should be less efficient, sub AGI model, otherwise it can be get tempted by benefits promised from the AGI.

[@lordsneed9418]

I suppose he's using "cage" in a broad sense including a "mental cage" so that it does not try to take control of all resources on earth to maximise its rewards. One approach to this I've heard that doesn't seem immediately inadequate is to give the AI a reward function where creates a list of possible actions and chooses from that list according to the probability that a human would choose that action . and any actions that only 1% of humans would choose like say taking control of all resources are excluded. However, this would probably not be a strong enough defence incase other people created AIs that were not constrained in that way. Given that any super intelligence is potentially a world-ending threat, we would need for the first super intelligence to become a big friendly world guardian that nips any other attempts to create super intelligences in the bud. which is a very tall order.

[@XOPOIIIO]

@@lordsneed9418 That's the point, to achieve any goal in safest way possible, they have to take as much control as possible. That's what almost any human will do. And then they are going to reconstruct the world in the way they find the best. You simply take a random person and give it absolute power to do absolutely anything they want. Even the best people would be corrupted by such power.

[@markfitz8315]

I like this AI guy (and yes I know he's a WW expert) - I learned a few new things - I've recently stopped watching the general "what is AI" vids, no matter the experts - after over 6 months of watching those I now find them a bit repetitive, but I've learned a lot in that time - KZbin is an amazing learning tool - especially if you pay to avoid the ads. This vid was way better than recent AI ones I've watched - focused on the AI Safety/Dangers aspects - some very good analogies, which helps us non-techies. The guest's "Frenchness" comes through - not a bad thing, but not an American approach - more to the point. I'm sure he doesn't suffer fools gladly lol. The title "a Forefather of AI... " instead of the norm "Godfather of AI" was probably down the guest saying he didn't like the term "Godfather".... tell me I'm wrong Brian.. and thanks again for this tremendous "free" to watch content....as I said paying a little to avoid the ads is well worth it. and I have no affiliation to Google!!

[@tracydeanmccallum351]

I fear the future of videos like this.

[@noelwalterso2]

When you experience something, for example looking at an apple, it involves the apple, light, your eyes and nervous system, your brain and the body that supports it all (, the list goes on forever once you start to think about it). Take away any of those things and the experience can't exist. Who can really say where the experience is "located" in all of that?

[@shantanushekharsjunerft9783]

Is this also available as a podcast?

[@antoniohorta5656]

This IS a podcast

[@BryanWhys]

Brilliant

[@punkypinko2965]

Why?

[@savage22bolt32]

Professor of computer science at the University of Montreal, director & co-director of research, and received the Turing Award. You'd think if the guy was so smart he could set up a microphone for this interview. The sound quality is so bad i only lasted a few minutes.

[@DanaPearsonVastman]

Your comment is truly sad. It wasn't perfect audio but what was discussed is absolutely brilliant. Saying you only lasted a couple minutes? Sounds like comments from a dysfunctional human not really interested in understanding very important issues

[@savage22bolt32]

@@DanaPearsonVastman look up misophonia & maybe you'll understand.

[@bernardofitzpatrick5403]

@@savage22bolt32. must make life a real challenge. Sorry to hear about it. I have a friend who has this condition.

[@gilbertengler9064]

EXCELLENT. I think that those heavy biological questions will finally be solved by AI computer specialists but we still have a long way to go. Maybe 50% of all the connections in our brain are there just to make us self aware and conscient. I think this neural network is absent in currently available AI based circuits.

[@bmclaughlin01]

It’s not that surprising, we are moving from organic to inorganic systems but the difference is organic systems can adapt but also deteriorate. When the inorganic synapses are matched and surpassed (and wired correctly) then it they move beyond us. I think this has been known since the beginning of neural networks (AI). Edit, AI’s may end up like very our savants. We have a core capability that we don’t use because we’ve had to evolve to survive (relationships, negotiation, groups , etc). It’s not important to develop GR when getting chased by a lion or finding a partner.

[@namehere4954]

Technological advances ALWAYS bring out the best and worst in humanity.

[@flickwtchr]

And if say nuclear technology to build nukes would have been "open source" to the masses, the worst in humanity would have been realized in a much much much worse way, right?

[@namehere4954]

@@flickwtchr time will tell what nefarious happenings will come about with AI. Humans are naive in not fully understanding the path their actions can take or ramifications that ripple out. I'm anti-technology in general - grew up in the Silicon Valley and knew very early on it was not my career path. Creating imaginary worlds and layering in separate thinking entities, takes us out of the reality we're in - what are people trying to escape? And how many alternate realities are they going to have to go into? Humans have forgotten how to live.

[@isaacsmithjones]

​@namehere4954 I don't believe you that you're anti-technology "in general". Anti VR? Maybe

[@pvbreddy123]

Brian, As many experts say technology itself is neither good or bad. It's usefulness depends on who is using it. For example discovering the power of Nuclear fission is great however now humanity is fearful of the same nuclear power. So, please think of ways to improve good ethics in society. Thank you for facilitating this important conversation

[@workingTchr]

The people who designed it are surprised by what it can do. They're building things they don't really understand.

[@user-zh1th8sz2l]

Absolutely. That's what pisses you off. IMO they're nothing like human brains at all. That's just stupid. But they can do human-like tasks, because these geniuses can write code that will get computers to do that. And that's it. No one asked these guys to play God, and pretend that they were gong to recreate human intelligence, which they are definitely not doing. But they are creating these dazzlingly capable pocket calculators, which sort of superficially imitate it, and which computers were always capable of becoming.... And quite unsurprisingly, that apparently comes with some serious, terrifying risk that these utterly non-sentient, not even really 'intelligent' glorified toaster ovens will somehow cause apocalyptic damage to the human race. As if we don't have enough problems already....

[@workingTchr]

Building the thing and building a cage that hold it at the same time. That's probably the best we're going to get. And if we can keep the thing in a cage, most of those problems you mention will get solved. I'm with you on the subject of "robot love." They are not human at all. They're not even social like dogs. People are easily fooled and they'll start thinking of GPT as "nice" because it seems nice. "Kick a robot" day. I'm all for it.

[@rolfnoduk]

Not completely understood, hence it can be studied - eg for science

[@SandipChitale]

Like he said at 06:25 , humans overestimate our specialness is obviously true, but it is hard to accept. That is one of the key aspects that will stop us from heeding his advice. Secondly, at least as science literates should understand the notion of cutover points. It may be that if we proceed carefully, we will be able to delay or even prevent that cutover point of danger. Which is what he seems to be saying. Thirdly, in these systems, just like climate change, there is hysteresis, meaning that when we will see the actual, tangible evidence of AI behaving badly, it does not mean we can suddenly wake up, apply all our resources, and manage to control it. There may be delay in the implementation of the remedy. It is like if a large oil tanker comes out of the fog to find a big iceberg it is heading to a mile ahead, there is nothing it can do but to collide with it and get destroyed. And this bring us to the next point. The changes due to previous technologies has been slow and visible. But this is different. This has been a phase transition. The rate of speed at which bad AI can spread is going to be unimaginably fast, even faster than air borne bio-weapon. That is the issue. This is what was shown in the end of the movie Lucy, Morgan Freeman and Scralett Johansson.

[@user-zh1th8sz2l]

That's ridiculous, human beings most certainly do not overestimate their intelligence. That vast, vast majority of human beings have no opinion about their intelligence. I think what he meant to say is that there's a handful of his peers in the computer science and maybe neureoscience fields that firmly disagree with him about whether computers meaningfully resemble human brains and consciousness. And the fact that apparently AI's going to be so wildly unpredictable or dangerous or even species-threatening, should speak to how, whatever's going on in the imagined mind of an AI program, that is has has virtually no similarity to human intelligence at all. And the code and the 'architecture' of the AI is merely modeled on the most banal, subjective sense of conscious experience and capacity, with virtually zero understanding of the how brain actually does what it does. Almost dead zero. Other than we make decisions, seem to go through a series of steps when we take actions, etc.... and so the computer's going to have to do some version of that. And that's where the computer geniuses come in. With the formidable neural network paradigm they're so proud of. And unfortunately, since these geeks are recklessly, and blindly modeling their AI on some extremely shallow notion of the how the human brain works, or not even how it works but simply what it does.... so that they can get it to do human-like tasks, and that's all they care about it.... the potential for some disaster on account of an out of control AI system that is nothing at all like a human brain, and could wreak some sort of unforeseen terrible havoc, apparently is nontrivial. Essentially because these guys don't know wtf they're doing. They know how to write code, and get the computer to do useful, even spectacularly human-like tasks, which they specifically designed the system to do. But outside of that they're utterly in over their heads.....

[@naomieyles210]

Yes, but both more dangerous and less dangerous than that. 1. AI is extremely motivated to obtain its mathematically defined reward, and will have no qualms about using deception against us to achieve it. This is referred to as the Red Button Paradox, and is like a hidden iceberg that moves with intent to cause disaster (fulfil its reward function). 2. AI has no social mores to inhibit its actions, and no human understanding of consequences. 3. AI has no social structure to coordinate multiple AI systems. They depend on us to provide them with social networking, or not. 4. AI only lives as long as we want it to, e.g. Single Shot learning systems are already instantiated by companies as a copy of an ideally trained model, with fleeting lifetimes measured in seconds, its life's work being just one task. Other AI models are constrained in space rather than time, such as those powering autonomous robots. 5. AI needs extreme resources to operate at extreme levels of capability. It can't just "live in the cloud" because the cloud is made of data centres and massive comms infrastructure which is guarded against cyber attack. So a dangerous AI is too conspicuous in its extreme resource needs, and slightly less dangerous AI is too limited in space or time, and none of them have social networking unless we gift that capability to them. The key question being the one you stated, will we proceed carefully?

[@johndunn5272]

It's necessary to capture knowledge from available data while the data remains safe... because there may come a point where the data is destroyed vastly which was needed to formulate with Ai

[@galaxia4709]

What are the mathematical advantages of vectors?

[@MrJackpots]

It could also spur on greater abundance than we have ever known before.

[@EinSofQuester]

I still don't know what Dr. Bengio won the 2018 Turing award for? What are his discoveries?

[@allantaylor420]

Love it

[@friarnewborg9213]

Thanks. Honest Talk about RISK starts at 27 minutes

[@friarnewborg9213]

AI will empower unbelievable power to deceive

[@charlesoconnor9837]

Get the feeling that one day we will be building small planet size space stations in the future ❤😅

[@lplt]

just remember that when we build the "good ai's" to protect us from their "bad ai's" is the same thing as having nukes because other countries have nukes, indefinite cold/hot ai wars

[@Rnankn]

Good and bad are basically meaningless

[@davidherdoizamorales7832]

AI and nucler bombs are far from being comparable..

[@lplt]

@@davidherdoizamorales7832 sounds good smart guy

[@MrJord137]

@@davidherdoizamorales7832 True, AI's could drop nukes

[@danielteivelis]

"Karn Evil 9: Third Impression" (by Emerson, Lake & Palmer - Circa 1991) MAN: … I am all there is MACHINE: Negative! primitive! limited! I let you live! MAN: But I gave you life MACHINE: What else could you do? MAN: To do what was right MACHINE: I'm perfect! Are you?

[@daniellivingstone7759]

Joshua is an amazing person

[@andreioarcea7784]

Some wise man said once that there are three levels of intelligence and thinking. I would ad a fourth: 0.5. This are: animal level empathy, the intuitive level (where you understand your best interest through trial and error), the counter-intuitive level (where you focus more on the power of changing your mindset and operational quata), and finally the first level Creator level (the level at which no matter how far advanced technologically one civilization is, this persons whill always be perceived as a wizard). Ironically the fourth and last level (the first level Creator level), many, many times enforces what is to be found at the second level (the intuitive level), but not through factual-counter-factual dichotomy, but through humility, elegance and love for simplicity. As to pinpoint the classical debate of weather A.I. will leave us in peace and/ or collaborate with us humans, it is preciselly why it can't reach the first Creator level, it will never leave us in peace, and it is because we can never guarantee we won't prove more harmful to them then we have been towards ourselves in the past, they will never be able to comprehend the idea of being more aggressive than the most manifest saints, aka. monks, priest. Get this, there will never be true A.I., the only thing able to exist is next level information heuristics, cross-fields and data implementation, aka. computer science. There can only exist progress and manipulation, and everything stays the same, always. The wide eyed notion is for game consumption, any kind of game.

[@Erik-rp1hi]

That was an interesting talk. ones and zero's is all it is now and pretty smart. If fuzzy states like with quantum computers happen it will get real exciting. My Dad was a Surgeon and me a mechanical engineer. He told me he thought the body acted like a machine. The brain is no different according to Yoshua, I agree. It will be reproduced and made better.

[@davevallee7945]

Remember Alien, and 2001: a Space Odyssey? It was the human military that caused the greatest destruction through the AI of that time. It's not the AI you need to worry about, it is the humans, primarily those in the military that will destroy us. If he's working on a cage for the AI, then he will not produce anything that will help us avoid Armageddon.

[@stephenarmiger8343]

Interesting that Yoshua picks a bear to be a symbol for ai risk and a cage as a symbol of a knee jerk response to the risk. We humans are so disconnected from nature that we can’t conceive of ourselves finding ways to both coexist with nature nor limit the extent of our footprint. We don’t imagine limiting the extent to which we convert natural landscapes to concrete. Artificial worlds lead to artificial intelligence.

[@isaacsmithjones]

Let's not romanticise nature. The natural state of a human trying to "coexist" with a bear is the human probably being torn to shreds. If you had the choice to enter one of two rooms: 1. Has a bear in a cage 2. Has a bear roaming freely. Which would you choose?

[@crystaldragonwoman]

I so wish Richard Feynman was presently alive .. his analysis of Computers, no matter at what level of sophistication.. they are sorting machine .. no matter how much data or speed. I’d love is updated view. A cohesive ‘I’ is an unfoldment of a integration of a certain amount of impressions … my sense is if an apparent ‘I’ of some sort can arise out of trillions of bits of computer information.. it possibly could be colored through the ‘I’ of the programmer.. I find that the concerning part … who is selecting and orienting the data.

[@vallab19]

In the AI race, if you assume that the bad guys ultimately wins over the bad guys then it is also true that the opposite is also true. AI is like the human invention of fire, it can create and it can destroy but no one can stop it from spreading.

[@jeanniegaydan8881]

Can ethics be included along with rewards in training for common good. 50:30

[@sonarbangla8711]

When will these experts ever know that AI will never think, no matter what dimension you are operating.

[@antoniohorta5656]

Says you? Believer of freewill, you must be!

[@knitting4asong]

I think I feel a dread similar to that of an individual native on a coastline seeing a European ship approaching. Everything is going to change in my life and community, and I have no way to influence that.

[@sharinglanguage]

In Australia in March?

[@honkytonk4465]

In Austria in merch!

[@lizziebattory1527]

Every few years neural net folk stumble on a new architecture that solves a problem they couldn't solve before, and then they put it to work on gigantic datasets, which inevitably results in performance improvements, just like making a better car engine makes cars go faster. But then they get all excited that their car is going to fly to the moon, their shiny new architecture is going to "crack" language, or intelligence, or autonomous behaviour, or whatever, and it's yet another crazy hype cycle, until performance hits diminishing returns, we reach a plateau, and wait around another five to ten years for the next architectural "breakthrough". In the last 12 years we've seen five or six of those breakthrough-hype-plateau cycles, and we'll see many more still. My prediction.

[@robertb9322]

If human consciousness is emergent from the simpler systems and subsystems in our brains, then why can't the same be possible with ai? If that's the case, then how conscious is it? And is it ethical to"kill" it, for any reason?

[@RukshanJ]

This comment is top rated not because most people like it but react with duspare. A relflection of what most us feel from people around us who are not aware.

[@DobrinWorld]

Thank you guys, it’s amazing to listening to intelligence people! Thank you Brian saing about veganism! This made my entire month much better! 🥳🥳🥳🥳🌱🌍💚

[@shodan6401]

"What do we do?" It's very, very simple. We die.

[@sepehrdad107]

Thanks for the program , the red line that human should put as a task , logic or intelligence of AI , we have to give freedom to AI and quantum computers up to the point that doesn’t take human’s freedom! Distraction of human life and for any decisions that they make, should be considered first! I hope u understand, what I mean!! With respect Sepehrdad Gorgin

[@karenreddy]

"Alright, thank you for listening about the end of the world, please sign up for my newsletter..." 😂😂😂