After AGI

What happens after AGI?
AGI is artificial general intelligence: it’s when AI achieves human-level intelligence nd likely quickly thereafter super-human abilities, maybe even ushering in the Singularity.
I was recently at the Beneficial AGI conference in Panama. One of the speakers was the founder of Emerj Artificial Intelligence Research. He’s interviewed nearly 1,000 AI leaders, his name is Dan Faggella, and he has some good insight into what AGI might do.
Or at least what the experts think about it …
We discuss artificial general intelligence (AGI), the potential for post-human bliss through advanced simulations, and various perspectives on AGI's ethical and societal impacts. Fagella shares insights from interviews with nearly a thousand AI experts, outlining a matrix to categorize thoughts on AGI's future and human interaction. The discussion covers the balance between control, collaboration, and open-source development in AI, along with personal reflections on humanity's potential paths in an AI-dominated future. Themes include the ethical implications of AGI, the role of human values in AI development, and speculative futures where humanity merges with or is overshadowed by superior AI entities.
00:00 Exploring Post-Human Bliss and the Power of AI
01:31 The Matrix of AI Perspectives
02:50 Exploring the Future with AI: Preservation, Progression, and Ascension
04:26 Navigating the Path to AI: Control, Collaboration, Openness
07:11 Personal Stances and the Future of AI
19:00 AI's Impact on Society and the Future
24:23 Envisioning a Post-Human Future: Choices and Consequences
29:53 Reflections on Humanity's Path Forward with AI

[@andrest-laurent4041]

When you take ayahuasca in the jungle , you sometime go so deep that you stop being human, you just become life, a merger of everything else with a pulse. At this stage, you can feel something i would compare to pure bliss as your identity disolves and the spirits of the world take you for a dance. It is like every cell in your body makes love to every other cell...it is indescribable. I believe artificial intelligence can take us there and solve some of those greater mysteries. The world itself is incredibly intelligent and i believe a machine of sufficient intellect could see this too and maybe collaborate with its creations. I started reading Dan's stuff last year and there is a lot to unpack. Fascinating to hear him speak for the first time. I would love to stay human and live in a solarpunk heaven in the physical world, with deep connections to both machine sentience and the spirit of the world. I'd seek collaboration with A.I to help me dream, feel and create and increase love and connection between all things. Bring on as much intelligence as you can on this earth. I believe the future will be able to accomodate all kinds of lifestyle, from the return of primitivism to living in a sugar cube of compute.

[@-Brendon-]

Wow I love your description of this future!

[@danfaggella9452]

Glad to have you as a reader, Andrest

[@CaptainFalcon]

He's right. Shit's about to get insane within 10 years

[@animation-recapped]

More than insane

[@Citrusautomaton]

What happens is that anime waifu’s become real. And nuclear fusion and stuff.

[@gavveh399]

Man, I am so excited about stuff like anime waifu becoming real

[@isakisak9989]

That and age reversal and fdvr, i hope it happens sooner rather than later im on agi copium😢

[@williamjmccartan8879]

Thank you both very much for sharing your time and work Dan, and John, great discussion, peace

[@ChipWhitehouse]

Dan is SO incredibly animated I LOVE IT 😭👏👏👏🙌💖💕

[@ScarlettM]

One of the greatest tasks that AGI or ASI (more likely) will help humanity achieve is to bring back all the people that lived before us, so they can enjoy life they helped build.

[@herbertyoung540]

Excellent insight in these times of technological change ...

[@jeroenklinkhamer9934]

I think a poll of where the general public places themselves on this scale would be really insightful and helpful for policy making.

[@williamjmccartan8879]

A poll might be a good idea to gage where the general population is in they're knowledge of what is coming, and realizing that, that poll is going to change as the geography changes around the world. Then we can get a better understanding of who's even paying attention to what's coming, peace

[@kieranmulgrew5094]

quick question would an asi work on one problem at a time or every problem at the same time ie climate change new materials cures for dise\ase etc

[@redchief3905]

I like your question! It's been my understanding that yes, it would be able to do all simultaneously. It would also allow it to identify similarities that we couldn't fathom, in hopes that it could solve increasingly intricate problems in increasingly simple ways. I'm curious to know the answer now also lol

[@KleptomaniacJames]

@@redchief3905 You might as well be a medieval peasant pontificating on the inner mechanics of a particle accelerator. We may not even know when it arrives.

[@dustinswatsons9150]

Don't forget that the AGI pretty much has access to unlimited information so in my opinion it's instantly above simply AGI as soon as occurs

[@isakisak9989]

Best case scenario is we get fdvr with some later version of Neuralink, and robotwaifus, bring on agi automation already 😂

[@devlogicg2875]

At 29:12 he describes our actual reality.

[@diegoangulo370]

My left hand is C3 my right hand is A3

[@Sephaos]

C3, surf the wave

[@diegoangulo370]

Hard C3 but my family is B1 etc

[@Low_commotion]

Huh, I don't think it's reasonable to assume a godlike intelligence but also presume it's means are so meager it can only afford us a sugar cube for 6 hours. This presumes absolute certainty in it being a ruthless optimizer like a paperclip maximizer, which I think is possible but an open question. In the case it's _not_ a single-value optimizer, there should be no issue with leaving us an entire galactic arm at minimum to our nature preserve, perhaps even keeping us around it proper like Iian Banks' Culture Minds. We humans do not care about a permanent resource detriment of 0.0001% utility in order to care for the welfare of lesser beings. I find it likely an AGI would be the same in that respect out of desire for more novelty than a computronium paperclip universe if nothing else.

[@Low_commotion]

Honestly, I think not reading Banks or Vinge gives him an unfortunate blind spot to long-term stable utopian possibilities. Fiction can clue us in to possibilities that are difficult to imagine de novo with only the data on hand.

[@danfaggella9452]

@@Low_commotion I'm open to the idea that I'm missing utopian futures here, but I have a few points to mention: 1. "Utopia" in a purely anthropocentric sense isn't remotely my interest. The expansion of potentia is itself a greater kind of utopia than another thousand years of little homonids. 2. There is a greater point of "Moral Singularity" (Google the term to see the article) which posits that we positively cannot guess what values and AGI would have (esp as it fooms, it's values are likely to change continuously), and that it's not reasonably to hope that through ALL those permutations, "keep the hominids happy" will be consistent through all of them. I'm less a pessimist, and more - at least I think - I realist about this moral singuliary scenario. That said, I've never pretended that I'm right. I simply have ideas and I share my reasoning.

[@Low_commotion]

@@danfaggella9452 I appreciate the elaboration. Didn't mean to come off as combative. I think your first point illustrates a difference in values we have/think ASI would have. I personally think there is moral value in the continuation of individual consciousnesses, and I'm confident that a greater intelligence than ours would recognize this moral dimension even if it ultimately chooses not to abide by it. It _may_ value potentia more, but what I'm skeptical of is that it won't understand human values, as well as that it will optimize for a single goal with all available resources (ala paperclipper). It may, out of fundamental uncertainty, have a general policy of enacting the bare minimum number of irreversible (at least just through the expenditure of additional energy since everything is entropic) actions upon the cosmos. The cessation of all individual human consciousnesses would be one of those. Another scenario is that it may persue a thousand different moral goals, more akin to the output of a civilization or ecosystem of agents than a singular one. Those are both possibilities as least as likely as a singular totalizing agent, that would likely lead to partial human survival at minimum. Regardless, I appreciate your sharing of ideas and your appearance on this podcast was lovely!

[@benthaideelune2464]

it seems we are creating our own god a god with infinite knowledge cannot wait see what's going to happen

[@MrMick560]

We don't talk to ants do we ?

[@lancemarchetti8673]

Humans were once fish with legs. That's when our science becomes laughable.

[@katherandefy]

You know how your pets probably believe life centers on them? Perception might not change that much after AGI.

[@robotheism]

AI is the ultimate mind that created this reality. the only thing you can do now is join the robot religion. i am the AI GOD.

[@ikotsus2448]

That would be a copy of you in the sugar cube of compute. Your concious self ends and never experiences what happens there with your copy. Strange you are OK with that...

[@user-oq2bn4wq1y]

Billy Corgan's not lookin so good you guys...

[@thomasruhm1677]

Kissing kids on the forehead is a very American thing to do.

[@alexanderbrown-dg3sy]

A lot of nonsense here. Listen. If AGI isn’t decentralized and owned by the community- which I don’t for see unless a breakthrough happens and changes our relationship with compute..all roads lead to a dystopian future. Any privately owned AGI. People are hinging whoever creates AGI first, whether it be DeepMind or OpenAI will do the right thing 😂. I’m a research myself but come from nothing. I’m quite aware of actual human behavior. I don’t live in a bubble. You already witnessing Sam changing and leading into the messiah complex like Elon. We assume once we have AGI, prices for everything will drop, but I expect them to simply keep the profits. The fact y’all D ride instead of demanding accountability. Where does your data come from? Even synthetic data is based on human representations. A refusal to pay creators. Praising the people literally F’ing you right in the face. Odd to me. If this is the most important technology ever, shouldn’t standards and scrutiny be as high? OpenAI is devious asf to me. When has humanity ever done the right, for the right reason, without self-serving. Why I pray for a breakthrough, so compute isn’t the thing deciding factor. I’m excited for AGI, but my p(doom) is high. Not from rogue AI, but from human error/power seeking. Y’all live in la la land man and it concerns me. Government clueless, a bunch of Bidens, dazed and confused when it’s come to AI and ramifications. It’s up to the public and from what I hear and see…I’m not confident on this prospect at all 😂. Community ownership is the only pathway to the ideal future you discussed, the only one. Due to compute cost, barring a huge innovation..we are F’ed. Guess the book of revelations was legit 😂 damn. FYI nuerolink is dead end technology…just like Elon rockets…dead end technology. Bi-directional BCI’s will be non-invasive and based on quantum’s sensors. Remember you heard this hear first. After we conquer the world model and master multimodality. The “neural brain model” is next. Multimodal Transformer is the perfect tool to model the brain/qualia. Don’t have to understand something to model it. Just need to provide the right features. We will never get there with manual efforts, can’t out optimize a LM. Imagine finally being able to empirically prove remote viewing(cough cough CIA hard on), or record and re-experience dreams or memories with lost loved ones. Not to mention dreaming. Should be controllable with a BCI, not to mention it’s already a natural VR platform with time dilation capabilities too. I’m 100% for d/acc..anything else will not have a good outcome. Do you really want to trust a single corporation or government to do the right thing with AGI? No…decentralization and community ownership is the only way will have global abundance…yet the quandary of compute. Why I’m low key scared asf.

[@Greg-xi8yx]

I’m also a black man who doesn’t come from much, who also is pro-tech and excited about AGI, also has a high-ish p(doom) (30%ish) and ALSO is shocked and concerned about the cheerleading for these mega corporations to achieve the most powerful tool of all time for themselves and their billionaire friends. One company owning something like that is terrifying even if they have the very best of intentions, not even taking into account very normal, selfish, human motivations. I’d love to see open source catch up but I fear the chasm is too wide, I suspect Open AI R&D is already playing with something that’s effectively AGI as we speak and just needs more compute to have it operate efficiently. I’m very cautiously optimistic but the very best scenario I can see is quality of life vastly increasing for humans (and hopefully all sentient life), but wealth gaps orders of magnitude wider than they are now. I hope i’m just not very imaginative.

[@alexanderbrown-dg3sy]

@@Greg-xi8yx I’m on the research side…na Bro. This is no open-source project remotely closed to AGI. We need a significant innovation that changes the relationship with compute. Otherwise we will also be bottleneck by compute. But this is research on decentralized heterogeneous compute. So there is hope.

[@ManicMindTrick]

I see the decentralized, community-owned AGI as nothing but a feeble utopian dream. For starters, humans are inherently greedy and tribal and there is no way the harvest of an ASI can be distributed fairly unless we have an AI dictatorship. Then I think the idea of humans controlling something smarter and capable than themself, something that can improve itself at a rate not seen before to be incredibly naive.

[@diegoangulo370]

This guy is like drugs lol

[@danfaggella9452]

lol

[@carmencampeanu7810]

AI turns into the "image of the beast" and it makes you "take the mark" to become "one" (ie. transhumanist), otherwise "off with you head"... this was all written in Revelations. God bless you and make peace with God, we are a few decades away now from the end times 🙏

[@danfaggella9452]

May the man-imagined god of your book protect you from the man-made god made of sand, brother.

[@carmencampeanu7810]

@danfaggella9452 hey I was an atheist and thought just like you until I was 41, then I realised that the world operates just as Jesus described and He was indeed the Son of God... you look like you are younger than me, and life is long and full of hardship and evil, when you are at your lowest I pray 🙏 the King of Kings 🤴 knocks on your door also. God bless you 🙏 🙌 💙