Roman Yampolskiy on Shoggoth, Scaling Laws, and Evidence for AI being Uncontrollable

Roman Yampolskiy joins the podcast again to discuss whether AI is like a Shoggoth, whether scaling laws will hold for more agent-like AIs, evidence that AI is uncontrollable, and whether designing human-like AI would be safer than the current development path. You can read more about Roman's work at cecs.louisville.edu/ry/
Timestamps:
00:00 Is AI like a Shoggoth?
09:50 Scaling laws
16:41 Are humans more general than AIs?
21:54 Are AI models explainable?
27:49 Using AI to explain AI
32:36 Evidence for AI being uncontrollable
40:29 AI verifiability
46:08 Will AI be aligned by default?
54:29 Creating human-like AI
1:03:41 Robotics and safety
1:09:01 Obstacles to AI in the economy
1:18:00 AI innovation with current models
1:23:55 AI accidents in the past and future

[@Tygerdurden]

This man is awesome, props to him

[@Sentientism]

Thank you both! Here's more from Roman @Sentientism in case of interest. We talk about "what's real?", "who matters?" and "how to make a better world?" (or how to avoid destroying this one) kzbin.info/www/bejne/iXycnXqsfNJ8isUsi=MqwjYp8OlWekU-ZO

[@TheMrCougarful]

If the host read himself some HP Lovecraft, he would know that the Shoggoth started out as a universally useful tool, made of artificial life, that eventually destroyed its maker. The shoggoth was not in any way superior to the maker, except in being more insanely violent.

[@mrpicky1868]

i would say the proportionate predictability drop with intelligence rise is arguable. in competitive task yes but in many cases where there is only one optimal way it's the other way around and more predictable

[@Hexanitrobenzene]

Ha. Yes, you know that it will choose the most optimal way, but you don't know which way it is in advance because you cannot compute it.

[@Dan-dy8zp]

It doesn't make any sense something would change its terminal goals because 'it's just something some guy made up'. That's not a *terminal* goal.

[@UrthKitten]

Wall e

[@akmonra]

I found this interview disappointing. I've always had a high opinion Yampolskiy, but he mostly seems to just be rehashing old, faulty arguments. Maybe his book is better

[@Hexanitrobenzene]

Faulty ? Which arguments do you find faulty ?

[@magnuskarlsson8655]

Then why don't you enlighten us? What's wrong with the arguments he presented?