Yoshua Bengio - Why We Shouldn't Blast Off to AGI Just Yet (AGI Destinations Series, Episode 1)

This is an interview with Dr. Yoshua Bengio, Turing Award Winner and Scientific Director of the Montreal Institute for Learning Algorithms.
This is the first episode in a 5-part series about "AGI Destinations" - where we unpack the preferable and non-preferable futures humanity might strive towards in the years ahead.
Read more of Yoshua's work at: yoshuabengio.org/
This episode referred to the following other essays and resources:
-- The Intelligence Trajectory Political Matrix: danfaggella.com/itpm
-- The SDGs of Strong AGI: emerj.com/ai-power/sdgs-of-ai/
...
There three main questions we'll be covering on the Trajectory:
1. Who are the power players in AGI and what are their incentives?
2. What kind of posthuman future are we moving towards, or should we be moving towards?
3. What should we do about it?
If this sounds like it's up your alley, I'm glad to have you here.
Connect:
danfaggella.com/trajectory
danfaggella
linkedin.com/in/danfaggella
Newsletter:
bit.ly/TrajectoryTw

[@41-Haiku]

I love Yoshua's takes on this! We really need to slow down and be more careful. Any non-negligible risk in this planetary gamble is not acceptable. We need time to figure out how to ensure a good future and minimize those risks.

[@trajectoryai]

I think his take is indeed rational. Building an UNworthy successor (danfaggella.com/worthy) would not only be the end of man, but potentially of life itself.

[@AMG855]

Fantastic episode. Very aligned to Yoshua on this!

[@trajectoryai]

I feel the same. I was absolutely not expecting him to advocate for posthuman life of any kind, but his openness to "care" for both current and future forms of life was surprising for me.

[@TheManinBlack9054]

Great episode with great guest!

[@johannesandthestarworld9941]

Super interesting. Should have A LOT more exposure.. Thank you both!

[@danfaggella9452]

Thank you :D!

[@MichaelSimmons1981]

Great first episode!

[@danfaggella9452]

Michael, thank you! Happy to have you here

[@odiseezall]

Glad to be here from the start.

[@danfaggella9452]

I'm genuinely grateful to have you here. It's been a long time coming to be able to fully focus on the big-picture future, the long game of AI. I'm glad people are interested!

[@BrunoPadilhaBlog]

Interview starts at 4:06

[@Senecamarcus]

My friend, would you be kind enough to let the guest talk more than you. Ask a simple question and let them talk. Not only it makes you look extremely smart but it’s also polite to the guest who has taken time out to be on your show.

[@webizfabulous2535]

I am here from twitter. Thanks , keep on inviting more people doing philosophy in AI or people who are actual cognitive scientist.

[@trajectoryai]

I appreciate the compliment! That's the plan indeed.

[@yourbrain8700]

Let's solve aging, then we can take our time with safe ASI. To the degree ASI is needed to solve aging, even if there may be other consequences, I'd support it. Let's be immortal humans while slowly figuring out how to safely merge, consume the universe and maximize values we humans may not understand, though probably pursuing ultra high hedonic tone is a one piece.

[@trajectoryai]

I think that's a fair and reasonable ask. It certainly won't be everyone's opinion, many people will want potentia to expand as soon as possible danfaggella.com/potentia. But I suspect most people will share your sentiment.