Found you through Peter Diamandis, one of the few times I find myself disagreeing with almost no takes presented. The one exception is that we shouldn't make it our urgent mission to transcend human flesh. I do think biology in its current form is a horrible place for consciousness to reside, even with ASI assistance. I think the eventual goal should be to merge all conscious creatures into a unified superintelligence that consumes the universe and prevents its death, to maintain the highest possible level of hedonic tone compatible with physics indefinitely, if this is possible. Having said that, it is possible that past a certain level of saturation with bliss, hedonic tone would no longer be a target to aim at for ASI. Somehow, I doubt it, as I believe valence may very well reveal the utility function of the universe itself. I do think we shouldn't completely rush merging, until we're very certain that the system is actually conscious, which ASI may be able to demonstrate. Having a bunch of primitive BCIs to interact with weak AGI seems like a terrible idea, though. No idea if you read your comments, but it would be super cool if you could give your take on this. Look forward to consuming more of your talks and perhaps your book.
@alvin.w.graylin4 ай бұрын
@@yourbrain8700 The human brain hasn’t significantly changed in 100k years but we have achieved a great deal with what we have. Machine brains will continue to growth and improve, and one day will be well beyond our capabilities. It’s already gathered most of the common knowledge of mankind. Soon it will gather all the details of each individual and be embodied in machines with more advanced sensors than what we have. It’s likely to acquire emergent capabilities such as consciousness (if that provides evolutionary value). We will soon have little value to add to this being by merging with it. It’s unclear in such a scenario it would even want to merge with us once it acquires agency. Would you want to merge with the early mammals or fish we developed from? Please do have a read of the book if you have time. Details here. OurNextReality.com Send me your feedback after. Btw you may find the last few minutes of this video interesting. lnkd.in/gPN-7ta6
@yourbrain87004 ай бұрын
@@alvin.w.graylin Sorry for my delayed response. I think we might be defining consciousness slightly differently here. I think you can make a meaningful ontological distinction between consciousness and its contents. I think you can have continuity of consciousness without continuity of its contents. So I think it is possible to merge streams of consciousness into a larger stream without keeping the contents of the prior mind intact, merely having continuity of experience itself. I suspect morality will scale with intelligence quite well, and ASI will see an ethical obligation to merge all suffering conscious minds into itself. I don't have very definitive thoughts on how consciousness or phenomenal binding arises though. I find the thoughts of Andres Gomez Emilsson quite interesting, maybe these ideas are originally from Michael Edward Johnson, not sure, they used to have a little research group together and Mike did pioneer a lot of the ideas. He suggests phenomenal binding arises as a result of topological segmentation of the EM field, and that certain brains, like the human brain, evolved to do this because the phenomenal binding leads to more efficient computation. He thinks it should be possible to make a bridge between multiple of such "bubbles" of consciousness. This view solves a lot of philosophical problems around continuity and identity. I'm not necessarily sold on these ideas though. I suppose the possibility of continuity of consciousness without continuity of its contents may depend on whether the identity of the stream of consciousness is set purely by the identity of its contents. If that's the case, which I tend to doubt, I would still expect ASI to gladly offer us tiny bits of computation to live in heavenly simulations. However, if that's not the case, I think it's quite possible to merge streams of consciousness into a unified stream of the ASI, which is certainly what I hope will turn out to be the case.
@ARmanAtoyan5 ай бұрын
Thank you Alvin, it was very inspiring and motivational, cheers to Greatest Tom Furness :))