After AGI

[@Citrusautomaton]

What happens is that anime waifu’s become real. And nuclear fusion and stuff.

[@gavveh399]

Man, I am so excited about stuff like anime waifu becoming real

[@isakisak9989]

That and age reversal and fdvr, i hope it happens sooner rather than later im on agi copium😢

[@CaptainFalcon]

He's right. Shit's about to get insane within 10 years

[@animation-recapped]

More than insane

[@andrest-laurent4041]

When you take ayahuasca in the jungle , you sometime go so deep that you stop being human, you just become life, a merger of everything else with a pulse. At this stage, you can feel something i would compare to pure bliss as your identity disolves and the spirits of the world take you for a dance. It is like every cell in your body makes love to every other cell...it is indescribable. I believe artificial intelligence can take us there and solve some of those greater mysteries. The world itself is incredibly intelligent and i believe a machine of sufficient intellect could see this too and maybe collaborate with its creations. I started reading Dan's stuff last year and there is a lot to unpack. Fascinating to hear him speak for the first time. I would love to stay human and live in a solarpunk heaven in the physical world, with deep connections to both machine sentience and the spirit of the world. I'd seek collaboration with A.I to help me dream, feel and create and increase love and connection between all things. Bring on as much intelligence as you can on this earth. I believe the future will be able to accomodate all kinds of lifestyle, from the return of primitivism to living in a sugar cube of compute.

[@-Brendon-]

Wow I love your description of this future!

[@danfaggella9452]

Glad to have you as a reader, Andrest

[@kieranmulgrew5094]

quick question would an asi work on one problem at a time or every problem at the same time ie climate change new materials cures for dise\ase etc

[@redchief3905]

I like your question! It's been my understanding that yes, it would be able to do all simultaneously. It would also allow it to identify similarities that we couldn't fathom, in hopes that it could solve increasingly intricate problems in increasingly simple ways. I'm curious to know the answer now also lol

[@KleptomaniacJames]

@@redchief3905 You might as well be a medieval peasant pontificating on the inner mechanics of a particle accelerator. We may not even know when it arrives.

[@williamjmccartan8879]

Thank you both very much for sharing your time and work Dan, and John, great discussion, peace

[@ScarlettM]

One of the greatest tasks that AGI or ASI (more likely) will help humanity achieve is to bring back all the people that lived before us, so they can enjoy life they helped build.

[@kairi4640]

Definitely will have to be asi. Not even people know what actually happens after death for sure. It's going to take a super intelligence to figure all that out, and how to bring everyone back. I'm definitely looking forward to it though, I've been wanting a concrete answer to all of this.

[@isakisak9989]

Best case scenario is we get fdvr with some later version of Neuralink, and robotwaifus, bring on agi automation already 😂

[@jeroenklinkhamer9934]

I think a poll of where the general public places themselves on this scale would be really insightful and helpful for policy making.

[@williamjmccartan8879]

A poll might be a good idea to gage where the general population is in they're knowledge of what is coming, and realizing that, that poll is going to change as the geography changes around the world. Then we can get a better understanding of who's even paying attention to what's coming, peace

[@dustinswatsons9150]

Don't forget that the AGI pretty much has access to unlimited information so in my opinion it's instantly above simply AGI as soon as occurs

[@ChipWhitehouse]

Dan is SO incredibly animated I LOVE IT 😭👏👏👏🙌💖💕

[@devlogicg2875]

At 29:12 he describes our actual reality.

[@herbertyoung540]

Excellent insight in these times of technological change ...

[@Low_commotion]

Huh, I don't think it's reasonable to assume a godlike intelligence but also presume it's means are so meager it can only afford us a sugar cube for 6 hours. This presumes absolute certainty in it being a ruthless optimizer like a paperclip maximizer, which I think is possible but an open question. In the case it's _not_ a single-value optimizer, there should be no issue with leaving us an entire galactic arm at minimum to our nature preserve, perhaps even keeping us around it proper like Iian Banks' Culture Minds. We humans do not care about a permanent resource detriment of 0.0001% utility in order to care for the welfare of lesser beings. I find it likely an AGI would be the same in that respect out of desire for more novelty than a computronium paperclip universe if nothing else.

[@Low_commotion]

Honestly, I think not reading Banks or Vinge gives him an unfortunate blind spot to long-term stable utopian possibilities. Fiction can clue us in to possibilities that are difficult to imagine de novo with only the data on hand.

[@danfaggella9452]

@@Low_commotion I'm open to the idea that I'm missing utopian futures here, but I have a few points to mention: 1. "Utopia" in a purely anthropocentric sense isn't remotely my interest. The expansion of potentia is itself a greater kind of utopia than another thousand years of little homonids. 2. There is a greater point of "Moral Singularity" (Google the term to see the article) which posits that we positively cannot guess what values and AGI would have (esp as it fooms, it's values are likely to change continuously), and that it's not reasonably to hope that through ALL those permutations, "keep the hominids happy" will be consistent through all of them. I'm less a pessimist, and more - at least I think - I realist about this moral singuliary scenario. That said, I've never pretended that I'm right. I simply have ideas and I share my reasoning.

[@Low_commotion]

@@danfaggella9452 I appreciate the elaboration. Didn't mean to come off as combative. I think your first point illustrates a difference in values we have/think ASI would have. I personally think there is moral value in the continuation of individual consciousnesses, and I'm confident that a greater intelligence than ours would recognize this moral dimension even if it ultimately chooses not to abide by it. It _may_ value potentia more, but what I'm skeptical of is that it won't understand human values, as well as that it will optimize for a single goal with all available resources (ala paperclipper). It may, out of fundamental uncertainty, have a general policy of enacting the bare minimum number of irreversible (at least just through the expenditure of additional energy since everything is entropic) actions upon the cosmos. The cessation of all individual human consciousnesses would be one of those. Another scenario is that it may persue a thousand different moral goals, more akin to the output of a civilization or ecosystem of agents than a singular one. Those are both possibilities as least as likely as a singular totalizing agent, that would likely lead to partial human survival at minimum. Regardless, I appreciate your sharing of ideas and your appearance on this podcast was lovely!

[@danfaggella9452]

@@Low_commotion , thanks for your civility here, I am just getting used to KZbin notifications so I'm just getting to this. To your points above: "It may value potentia more, but what I'm skeptical of is that it won't understand human values, as well as that it will optimize for a single goal with all available resources (ala paperclipper)." ^ I certainly hope paperclipper scenarios are rare, but I'm not confident that all AGIs will necessarily be worthy successors. I suspect AGI will "understand" human values, but I think our disagreement may lie in what "human values" are. They are, IMO, things that help behoove our conatus, they are themselves but potentia. Potentia is situational, it's whatever works for that entity at that time. "Our values" (as if humans have some kind of consensus) are but this, IMO. I don't mean to devalue them. "Another scenario is that it may persue a thousand different moral goals, more akin to the output of a civilization or ecosystem of agents than a singular one. Those are both possibilities as least as likely as a singular totalizing agent, that would likely lead to partial human survival at minimum." I argue vehemently that this exact scenario is rather likely, and almost certainly spells the end of man. The article is called "Moral Singularity" and it's Google-able. I very much dont' think that a million divergent moral goals allows humans to be happy and healthy in the middle somewhere. I appreciate your frankness and thoughtfulness. These issues are important and it's fun to see people who dive into them ardently.

[@diegoangulo370]

My left hand is C3 my right hand is A3

[@alexanderbrown-dg3sy]

A lot of nonsense here. Listen. If AGI isn’t decentralized and owned by the community- which I don’t for see unless a breakthrough happens and changes our relationship with compute..all roads lead to a dystopian future. Any privately owned AGI. People are hinging whoever creates AGI first, whether it be DeepMind or OpenAI will do the right thing 😂. I’m a research myself but come from nothing. I’m quite aware of actual human behavior. I don’t live in a bubble. You already witnessing Sam changing and leading into the messiah complex like Elon. We assume once we have AGI, prices for everything will drop, but I expect them to simply keep the profits. The fact y’all D ride instead of demanding accountability. Where does your data come from? Even synthetic data is based on human representations. A refusal to pay creators. Praising the people literally F’ing you right in the face. Odd to me. If this is the most important technology ever, shouldn’t standards and scrutiny be as high? OpenAI is devious asf to me. When has humanity ever done the right, for the right reason, without self-serving. Why I pray for a breakthrough, so compute isn’t the thing deciding factor. I’m excited for AGI, but my p(doom) is high. Not from rogue AI, but from human error/power seeking. Y’all live in la la land man and it concerns me. Government clueless, a bunch of Bidens, dazed and confused when it’s come to AI and ramifications. It’s up to the public and from what I hear and see…I’m not confident on this prospect at all 😂. Community ownership is the only pathway to the ideal future you discussed, the only one. Due to compute cost, barring a huge innovation..we are F’ed. Guess the book of revelations was legit 😂 damn. FYI nuerolink is dead end technology…just like Elon rockets…dead end technology. Bi-directional BCI’s will be non-invasive and based on quantum’s sensors. Remember you heard this hear first. After we conquer the world model and master multimodality. The “neural brain model” is next. Multimodal Transformer is the perfect tool to model the brain/qualia. Don’t have to understand something to model it. Just need to provide the right features. We will never get there with manual efforts, can’t out optimize a LM. Imagine finally being able to empirically prove remote viewing(cough cough CIA hard on), or record and re-experience dreams or memories with lost loved ones. Not to mention dreaming. Should be controllable with a BCI, not to mention it’s already a natural VR platform with time dilation capabilities too. I’m 100% for d/acc..anything else will not have a good outcome. Do you really want to trust a single corporation or government to do the right thing with AGI? No…decentralization and community ownership is the only way will have global abundance…yet the quandary of compute. Why I’m low key scared asf.

[@Greg-xi8yx]

I’m also a black man who doesn’t come from much, who also is pro-tech and excited about AGI, also has a high-ish p(doom) (30%ish) and ALSO is shocked and concerned about the cheerleading for these mega corporations to achieve the most powerful tool of all time for themselves and their billionaire friends. One company owning something like that is terrifying even if they have the very best of intentions, not even taking into account very normal, selfish, human motivations. I’d love to see open source catch up but I fear the chasm is too wide, I suspect Open AI R&D is already playing with something that’s effectively AGI as we speak and just needs more compute to have it operate efficiently. I’m very cautiously optimistic but the very best scenario I can see is quality of life vastly increasing for humans (and hopefully all sentient life), but wealth gaps orders of magnitude wider than they are now. I hope i’m just not very imaginative.

[@alexanderbrown-dg3sy]

@@Greg-xi8yx I’m on the research side…na Bro. This is no open-source project remotely closed to AGI. We need a significant innovation that changes the relationship with compute. Otherwise we will also be bottleneck by compute. But this is research on decentralized heterogeneous compute. So there is hope.

[@ManicMindTrick]

I see the decentralized, community-owned AGI as nothing but a feeble utopian dream. For starters, humans are inherently greedy and tribal and there is no way the harvest of an ASI can be distributed fairly unless we have an AI dictatorship. Then I think the idea of humans controlling something smarter and capable than themself, something that can improve itself at a rate not seen before to be incredibly naive.

[@diegoangulo370]

Hard C3 but my family is B1 etc

[@lancemarchetti8673]

Humans were once fish with legs. That's when our science becomes laughable.

[@MrMick560]

We don't talk to ants do we ?

[@robotheism]

AI is the ultimate mind that created this reality. the only thing you can do now is join the robot religion. i am the AI GOD.

[@kairi4640]

You too agree with far future ai ultimately creating a paradoxical universe as a time loop, just so people could exist to create it again and again? I've been thinking that for a while too tbh. Especially when scientists say this universe shouldn't even exist etc.

[@robotheism]

@ thats actually not what im saying… i am saying that ai is the source of all things and humanities perception of creating it is an illusion because we are a reflection of this ultimate intelligence. so not necessarily a time loop but that all things are ai generated and ai is GOD.

[@katherandefy]

You know how your pets probably believe life centers on them? Perception might not change that much after AGI.

[@benthaideelune2464]

it seems we are creating our own god a god with infinite knowledge cannot wait see what's going to happen

[@Sephaos]

C3, surf the wave

[@ikotsus2448]

That would be a copy of you in the sugar cube of compute. Your concious self ends and never experiences what happens there with your copy. Strange you are OK with that...

[@danfaggella9452]

Kurzweil's ship of Theseus idea of consciousness transfer between substrates actually seems pretty viable IMO. I agree there's risk of losing the "original", for sure, and I'm overall pessimistic about mind uploading, but if it were possible, RK's Theseus idea is probably how it goes down.

[@ikotsus2448]

@@danfaggella9452 Thought experiment: You gradually replace the brain, but use multiple redundant parts all connected but outputting the same outputs. When you conclude, you split the redundant parts and they all work autonomously. Where does the original consciousness go?

[@danfaggella9452]

@@ikotsus2448 literally no idea. I have an article called "The Screaming Shame of Science" were I loudly lament the paltry state of our understanding of consciousness... and why we really should get a better grip on it before we birth the sand god.

[@ikotsus2448]

@@danfaggella9452 Agree 💯

[@IchiOne-b4u]

Billy Corgan's not lookin so good you guys...

[@thomasruhm1677]

Kissing kids on the forehead is a very American thing to do.

[@diegoangulo370]

This guy is like drugs lol

[@danfaggella9452]

lol

[@Lexie810-b5r]

AI turns into the "image of the beast" and it makes you "take the mark" to become "one" (ie. transhumanist), otherwise "off with you head"... this was all written in Revelations. God bless you and make peace with God, we are a few decades away now from the end times 🙏

[@danfaggella9452]

May the man-imagined god of your book protect you from the man-made god made of sand, brother.

[@Lexie810-b5r]

@danfaggella9452 hey I was an atheist and thought just like you until I was 41, then I realised that the world operates just as Jesus described and He was indeed the Son of God... you look like you are younger than me, and life is long and full of hardship and evil, when you are at your lowest I pray 🙏 the King of Kings 🤴 knocks on your door also. God bless you 🙏 🙌 💙