Mystery of Entropy FINALLY Solved After 50 Years? (STEPHEN WOLFRAM)

  Рет қаралды 461,892

Machine Learning Street Talk

Machine Learning Street Talk

Күн бұрын

Please check out Numerai - our sponsor @
numer.ai/mlst
Patreon: / mlst
Discord: / discord
The Second Law: Resolving the Mystery of the Second Law of Thermodynamics
Buy Stephen's book here - tinyurl.com/2jj2t9wa
The Language Game: How Improvisation Created Language and Changed the World by Morten H. Christiansen and Nick Chater
Buy here: tinyurl.com/35bvs8be
Stephen Wolfram starts by discussing the second law of thermodynamics - the idea that entropy, or disorder, tends to increase over time. He talks about how this law seems intuitively true, but has been difficult to prove. Wolfram outlines his decades-long quest to fully understand the second law, including failed early attempts to simulate particles mixing as a 12-year-old. He explains how irreversibility arises from the computational irreducibility of underlying physical processes coupled with our limited ability as observers to do the computations needed to "decrypt" the microscopic details.
The conversation then shifts to discussing language and how concepts allow us to communicate shared ideas between minds positioned in different parts of "rule space." Wolfram talks about the successes and limitations of using large language models to generate Wolfram Language code from natural language prompts. He sees it as a useful tool for getting started programming, but one still needs human refinement.
The final part of the conversation focuses on AI safety and governance. Wolfram notes uncontrolled actuation is where things can go wrong with AI systems. He discusses whether AI agents could have intrinsic experiences and goals, how we might build trust networks between AIs, and that managing a system of many AIs may be easier than a single AI. Wolfram emphasizes the need for more philosophical depth in thinking about AI aims, and draws connections between potential solutions and his work on computational irreducibility and physics.
Show notes: docs.google.com/document/d/1h...
Pod version: podcasters.spotify.com/pod/sh...
/ stephen_wolfram
TOC:
00:00:00 - Introduction
00:02:34 - Second law book
00:14:01 - Reversibility / entropy / observers / equivalence
00:34:22 - Concepts/language in the ruliad
00:49:04 - Comparison to free energy principle
00:53:58 - ChatGPT / Wolfram / Language
01:00:17 - AI risk
Panel: Dr. Tim Scarfe @ecsquendor / Dr. Keith Duggar @DoctorDuggar

Пікірлер: 1 500
@quasarsupernova9643
@quasarsupernova9643 9 ай бұрын
I use Mathematica every waking hour of my life. I have been doing this for the last 30 years. Everything I have done in Physics is largely due to Mathematica. Hats off to Wolfram Inc.
@AndreasDelleske
@AndreasDelleske 9 ай бұрын
Allow me to say: Uh-oh :)
@Achrononmaster
@Achrononmaster 9 ай бұрын
Free the software my dudes. Donate to the free-libre software devs. Euthanize the rentiers. (Anything I can do with Mathekrapital I can do with Python + Nim).
@gemthomas
@gemthomas 9 ай бұрын
Give an example of how u use it please
@PetWanties
@PetWanties 9 ай бұрын
@@gemthomas calculating the time before he can go home from the job
@redflipper992
@redflipper992 9 ай бұрын
wow, what's it like being so profoundly limited?
@element4element4
@element4element4 8 ай бұрын
"The most recognisable and brilliant scientist alive today" What a crazy statement to start a podcast with. I really debate whether I can bother continuing if it starts in such a dumb way. I can imagine it will be full of mumbo jumbo that makes little sense with an audience that has zero background to evaluate or understand what he is saying, and takes everything as gold since they consider him the "most brilliant scientist alive". As a working theoretical physicists, I often end up frustrated after listening to stuff like that.
@ng8tvinfluence78
@ng8tvinfluence78 27 күн бұрын
Just because you’re a theoretical physicist doesn’t mean you’re not an arrogant asshole
@Bob-qq4is
@Bob-qq4is 25 күн бұрын
Most working physicists don’t like Wolfram since he is in their field and makes way more money and has more notoriety than they could ever dream of. Or maybe there’s other reasons but he seems not well liked by the community
@element4element4
@element4element4 24 күн бұрын
@@Bob-qq4is Do you have any background to evaluate whether anything Wolfram says makes any sense? Or just impressed by these podcasts?`` His whole fanbase are people that do not have any background to understand any of it. He spreads his ideas on podcasts where people can't tell whether it makes sense, instead of in peer-reviewed journals where it is evaluated by experts. Ever wondered why? Jealous because he makes more money? Jim Simons is one of the richest people in the world, he is probably worth 20 times Wolfram. If not more. Yet his work is highly respected in the math and physics community.
@element4element4
@element4element4 24 күн бұрын
Wolframs early work, before leaving academia, was pretty solid. His software, Mathematica, is really good. I use it every day. But his recent work is extremely disappointing. It's a massive combination of buzzwords, extreme claims and no genuine will to back up any of these claims. He has been invited to give seminars or even online discussed his ideas with scientists. Whenever anybody asks into any detail about one extreme claim, he reverts to making 5 other unrelated extreme claims about his "theory". This is not in any way serious science. If you are impressed by big words you don't understand on podcasts, and make up your opinion on the science community based on it, I have stuff to sell you man.
@nembobuldrini
@nembobuldrini 6 ай бұрын
Fantastic conversation. It amazes me how Stephen, while sometimes difficult to follow, from time to time he pops out with concepts and analogies simple enough to make sense of, and yet very powerful. Kudos to Tim & Keith for bringing this conversation!
@msinaanc
@msinaanc 7 ай бұрын
Wonderful content. I have listened Dr. Wolfram on a youtube video of MIT Physics LLM talks and I was shocked and aspired by his way of handling topics. Here is no different, brilliant questions, brilliant ideas not only technical but deeply philosophical ones. Thanks for bringing this to our scope.
@lupf5689
@lupf5689 9 ай бұрын
Nah, I don't get it. The more I listen to that guy, the more convinced I am, that this is a) a very bad case of confusing the map with the terrain / the model with reality b) taking an arbitrary model and trying to make everything fit at all cost c) leading no where at all d) me being much dumber than I thought or a mix of them.
@commentarytalk1446
@commentarytalk1446 9 ай бұрын
I'm mildly amazed intelligent people think big talking heads on a screen is better for communication of an idea than visual aids and even dynamic visual aids that could be programmed................ I just see big talking heads on a screen and too much verbiage (verbal + garbage).
@paulklee5790
@paulklee5790 9 ай бұрын
@@commentarytalk1446I’m sorry you find it too hard, that’s quite understandable, the sandpit is over there in the corner, do enjoy yourself…
@commentarytalk1446
@commentarytalk1446 9 ай бұрын
@@paulklee5790 First of all "You're not sorry" so as such you're a liar. Secondly, you don't seem very adept at reading comprehension and would score zero if you read again. Thirdly you're a time-wasting troll using a mild form of insult to sound superior/humorous because of a sense of over-defensiveness. Try to take a good look in the mirror if you even human.
@amiran5273
@amiran5273 9 ай бұрын
The part where he compares "internal experience" of a laptop with a human experience is just one example that shows how shallow and one dimensional some of his takes are. I agree about him having just a single model (computation) and trying to force everything to fit it. For some problems it's great, for others - hopeless.
@Sirbikingviking
@Sirbikingviking 9 ай бұрын
Holy cow what an amazing conversation. I feel privileged to be in the modern world and have access to this kind of brain bending, brain expanding stuff!
@goldwhitedragon
@goldwhitedragon 8 ай бұрын
Listen to Nature and really expand it.
@512Squared
@512Squared 8 ай бұрын
​@@goldwhitedragonnot a very bright comment. As if Nature has a monopoly on what's real when all that listening or observing nature is going to do is raised a lot of abstract questions that require abstract tools to make any progress with. It's not like you look and immediately it's all visible. You have to penetrate it with a penetrating and contemplative mind. Also, a small mention on 'false causation', one of the biggest fallacies that emerged from 'listening to nature'and which took thousands of years to untangle ourselves from.
@goldwhitedragon
@goldwhitedragon 8 ай бұрын
@@512Squared That's right. A contemplative and SINCERE mind, not one that says "not very bright."
@512Squared
@512Squared 8 ай бұрын
@@goldwhitedragon deconstruct your own original reply and you will clearly see why it was not very bright while claiming to be bright. You took my reply that was calling that out and did more or less the same moral superiority bs. It's the insensitivity that is hardest to see. And yes, it has to be called out clearly, otherwise wolves are mistaken for sheep. And you projecting that back to me because I called you out on it? I say it again, not very bright. Funny, it was just one word 'really', but it revealed so much about how you look down on certain kinds of knowledge and inquiry, construct hierarchies that don't really exist, so yes, not very bright. But hey, you can step into clarity any time you want. Don't make it about me. If you to be want be enlightened, then drop the silly superiority and appreciate and celebrate knowledge and insight wherever it is found. Otherwise, grow a thicker skin to criticism rather than trying to make it about someone else. I doubt very much you'll take this in good faith, but good luck.
@512Squared
@512Squared 8 ай бұрын
@@goldwhitedragon I mean seriously, a SINCERE mind would not make the original comment you made.
@bioxbiox
@bioxbiox 7 ай бұрын
Amazing conversation. Highest level content, presented in very understandable way without going too low. An intellectual pleasure for sure.
@Tekay37
@Tekay37 9 ай бұрын
If anyone ever creates a caricature of Dr. Wolfram it would be Dr. Wolfram on a Podcast being asked a single question and then just not stopping answering the question for and the multiple side effects of the question for a couple of days and the host struggling to slip another question in to at least guide the conversation into a certain direction. He's talking about fascinating stuff, though! I loved it.
@ticthak
@ticthak 8 ай бұрын
@@epajarjestys9981 Parsing problem, much?
@alabamacajun7791
@alabamacajun7791 8 ай бұрын
Interesting observation. When your brain is that vast and you don't share at scale* you end up with cortex entropy. The mind is at it's best when you are teaching others. It become natural wanting to just tell all. Grand unification. *At scale meaning wanting to be able to expand though at extreme rates. Out mouths and the listeners ears are too slow.
@Tekay37
@Tekay37 8 ай бұрын
@@alabamacajun7791 ob the other hand: if can't understand something briefly, you haven't um bereits it thoroughly.
@goldwhitedragon
@goldwhitedragon 8 ай бұрын
Try Chris Langan, America's smartest man and his CTMU. On Kurt jamungals show.
@katherandefy
@katherandefy 8 ай бұрын
I understood it. I would love to learn more about how philosophically we could match the pace of the techical side. I do think he has cracked the entropy befuddlement.
@mootytootyfrooty
@mootytootyfrooty 9 ай бұрын
The best thing in this interview is the pure joy in all your faces
@nomenec
@nomenec 9 ай бұрын
It is truly a privilege having access to such luminaries! But of course, I enjoy these kinds of conversations wherever and whenever they happen ;-)
@mootytootyfrooty
@mootytootyfrooty 9 ай бұрын
just a humble path integral in a big big ruliad 😁@@nomenec
@Dessoxyn
@Dessoxyn 9 ай бұрын
That is why I watch Wolfram on video--his genuine enthusiasm and joy is something that can't be copied or faked
@mootytootyfrooty
@mootytootyfrooty 9 ай бұрын
@@Dessoxyn he does seem a little behind the times on this entropy topic, diffusion models for example basically entirely hinge on least action principles which is tied at the hip with model entropy and bayesian inference etc. Seems like its been a crystal clear concept for computing since the 80s at least, ignoring wizards like Shannon way earlier who gave us the whole field of DSP.
@mootytootyfrooty
@mootytootyfrooty 9 ай бұрын
@@AndreAnyone It's more likely that evolution and cognition exist because of it. It's like THE rabbit hole of physics and biology haha.
@benbennit
@benbennit 7 ай бұрын
Yes yes yes. This is hitting all the right approach points... after years of reading physics and working with reinforced machine leaning, these ideas get to the heart of the universe and how we experience it. I will definately be getting Stevens book.
@uguptuzirby8451
@uguptuzirby8451 8 ай бұрын
Mind-blowing conversation, enjoyed it a lot, thanks!
@goksanisil9107
@goksanisil9107 8 ай бұрын
His bridge between temperature level of language models and thermodynamics state changes at the beginning, is a great demonstration of the level of thinking he does
@inthefade
@inthefade 7 ай бұрын
I think applying the idea of phase transitions like this to other things is a great idea.
@makeitreality457
@makeitreality457 8 ай бұрын
Inspiring interview. It stimulates thoughts about how, as a writing tool, AI-assisted search can be good for looking up who in history had similar ideas. That way we can sort of cite ideas we had that mayb were not entirely original or perhaps needed more credibility. We may be standing on the shoulders of giants. But it doesn't do much good when we don't know who they are.
@hooked4215
@hooked4215 7 ай бұрын
What "doesn't do much good" is when we don't understand what they say.
@TheSensualSerpien
@TheSensualSerpien 8 ай бұрын
I can safely say that no one else can blow my mind like Wolfram does.
@NiallsSongs
@NiallsSongs 7 ай бұрын
Very beautiful concepts and models presented here. Thank you for the inspiration.
@HeronMarkBlade
@HeronMarkBlade 9 ай бұрын
fantastic material as ever, thanks!
@MachineLearningStreetTalk
@MachineLearningStreetTalk 9 ай бұрын
Top Quotes from Stephen Wolfram: "I think I now really understand [the second law of thermodynamics]. I began to understand it back in the 1980s." "The interplay between the underlying computational process...and our limited computational abilities kind of at the top." "Computational irreducibility means you're just stuck going through every step in the computation." "Science isn't going to be able to give you all the answers." "Language is our encapsulation of things we care about versus things we don't." "The workflow that I see really emerging is...I have a concept in my mind, and I want to get my computer to do it." "Most of [the computational universe], we humans don't yet care about." "If we leave AIs to their own devices, they're just gonna go out and explore other parts of the Ruliad." "When you talk about goals...I can have an external theory of what their goals are, and so can I for your average AI." "Right now, we're not having AIs connected to us...we are progressively connecting [them] to more and more actuation systems in the world, and we should care about that." "I'm in a sense more concerned about the lack of depth of understanding on the philosophical side than on the technical side." "It's inevitable that it's kind of like there's this thermodynamics of AIs." "Is it easier to manage a billion AIs than it is to manage one AI? I think the answer may be yes." "When you talk to people who were there when it started...they're always like, well, I think it's right, but we're not quite sure."
@svetimfm
@svetimfm 9 ай бұрын
Paraphrasing: “Thousands of years of philosophy and, in the end, we have to write code”
@DavenH
@DavenH 9 ай бұрын
@@RickDelmonico holy crap, that is what I call committing to a joke!
@RickDelmonico
@RickDelmonico 9 ай бұрын
@@DavenH how old are you, like 12?
@RickDelmonico
@RickDelmonico 9 ай бұрын
The first thing Steven did was commit to particles. It can be shown, however, that all the particle-like phenomena can be explained by using properties of the wave functions/state vectors alone. Thus there is no evidence for particles. Wave-particle duality arises because the wave functions alone have both wave-like and particle-like properties. Feynman's path integrals are not infinite, they're fractal.
@szymonbaranowski8184
@szymonbaranowski8184 9 ай бұрын
hahaha 😂😂😂
@swozzares
@swozzares 9 ай бұрын
You gotta wonder if knowing too much leads you off into crazy land.
@georgesos
@georgesos 9 ай бұрын
It does. I have this video to prove it.
@xevios.9336
@xevios.9336 8 ай бұрын
Wait I need to see this video loool
@gupwalla961
@gupwalla961 3 ай бұрын
There is only an infinitesimal separating the rational, irrational, and transcendental.
@roddneyfett444
@roddneyfett444 7 ай бұрын
Incredible discussion about communication from different locations and how knowledge of events can be different for each observer. Reminds me of how polarized light is changed as it passes through a filter. Two people can see an event differently, but when they attempt to communicate what they saw, they end up communicating the event as the same. Their communication is transformed to align with the location it presently resides.
@alonamaloh
@alonamaloh 8 ай бұрын
I met Stephen Wolfram once and I can't stand the high opinion of himself he has. The last thing this man needs is to be introduced as "perhaps the most recognizable and brilliant scientist alive today".
@ticthak
@ticthak 8 ай бұрын
Like too many exceptionally brilliant people, he's got an exceptionally inflated false ego. But at least he offers something for real substantive thought and discussion. Anyone else who HASN'T done VERY IMPORTANT fundamental theoretical work, probably doesn't have anythging original or substantial to offer on the topic, yet likely has an unmeritedly inflated false ego...
@chyldstudios
@chyldstudios 9 ай бұрын
Wonderful interview with Stephan Wolfram. Interesting to hear him discuss the interplay between the second law of thermodynamics, i.e., entropy and how that relates to challenges in really understand how LLMs work.
@timjohnson3913
@timjohnson3913 9 ай бұрын
We had quite different takeaways from this video. He claims to have had some epiphany about how 2nd law really works (an understanding that has evaded him for last 50 years until very recently). But imo he didn’t give us any of that explanation. He just derailed off into different random stories. If you got some understanding on how he interprets the 2nd Law from this, please share.
@carlosgaspar8447
@carlosgaspar8447 9 ай бұрын
@@timjohnson3913 sabine h. covered her view on the topic a few weeks ago. the gist of it being that any initial state, no matter unlikely it is (all molecules in one half of the box) is just one of many, many, possible states and no less likely than any other. i tend to agree with her take on the subject.
@adminnvbs9166
@adminnvbs9166 8 ай бұрын
@@timjohnson3913 What I understood is that Wolfram explains that the reason we perceive that entropy must always increase (that time’s arrow moves forward) is because our reality interpreter (our brain) processes information packets at speeds in the millisecond range whereas the processes that are actually taking place occur at speeds in the nanosecond range. He implies that this conclusion is a natural outflow of the analysis of how ideas are packaged and transmitted from one space/(reality interpreter) to another.
@timjohnson3913
@timjohnson3913 8 ай бұрын
@@adminnvbs9166 and that makes any sense to you? Sure you gave a “what” explanation but I don’t see any connection to heat dissipating or broken eggs not coming together nor do I see any “why” that makes what you said a good explanation
@ilikenicethings
@ilikenicethings 8 ай бұрын
@@timjohnson3913​​⁠​​⁠it has to do with “coarse graining” of the many possible configurations of micro-states. The coarse graining corresponds to the observable macro-states. The observable directionality of evolving macro-states is due to there being many more configurations of micro-states corresponding to later observable macro-states. For example, there’s more ways that the molecules of an egg can be observed to be scrambled than there are unscrambled. Roughly speaking…
@gavinlangley8411
@gavinlangley8411 9 ай бұрын
When I hear Stephen I feel the concepts are re-statements of existing theories using his own language rather than being truly original. Stephen seems to be making parallels and restating concepts in his model. It's like a second order process description with a it's own naming convention. It's either brilliant or trivial and my limited mind can't quite grasp which.
@commentarytalk1446
@commentarytalk1446 9 ай бұрын
I read one of his papers on the subject instead of listening to this talk as there's countless interesting diagams illustrating his investigations and I think it's a promising direction and tool-set to use. I would say the title is bogus (the author of the video confirms this in the comments sections elsewhere as it's a hook for yt sensationalism for views). However from the paper the most interest connection made was the concept of the complexity/entropy of a system and it's size AND how the observer is able to conceptualize it... ie limitations apply at both ends. I think that's illustrated well in the diagrams, its almost intuitively simply so probaby relatively robust and a nice addition or extension to former ideas about entropy - at least within my own very weak understanding of the subject! So yes it's not a solution as the title suggests but I think the tools of investigation expand understanding of 2nd Law of Thermodynamics in a very practical application. As I pointed out before: Visuals aids are worth a lot more than talking heads to transmit ideas! The video's title is poor and the content visually is inadequate.
@simesaid
@simesaid 9 ай бұрын
​​@@adamluhring2482 yes, I really quite like Stephen, and think that his intuition regarding the importance of understanding ourselves as specifically evolved creatures who observe the world in a very specific way, is a crucially important one. That said, though, I have to sadly agree with your synopsis of his work - despite the steady stream of talk about having finally discovered (solved, reconciled, understood, explained etc) some area or another of metaphysical inquiry... well, there's a _very_ steady stream of talk. I'm just not sure that there's much physical exercise going on to support all that hot air.
@stegemme
@stegemme 9 ай бұрын
if you want original try David Deutsch
@sonarbangla8711
@sonarbangla8711 9 ай бұрын
Wolfram once wanted his theory to be peer revied. I remember the review board gently called on him to find a better proof of his theories. Even in this video the only qualification is half a million reviews, but he didn't show any satisfaction.
@numbersix8919
@numbersix8919 8 ай бұрын
I think you've done it, actually. His unique take take on things might be an explanation. Or it might be a re-framing. In what sense is it useful? Does it improve our observations? Our understanding? Our predictions? Our control of natural phenomena? The Positivists hoped that, beginning with mathematics, and progressing to physics, and by way of physics to chemistry, from chemistry to biology, from biology to psychology, from psychology to the social sciences, and then on to the arts, a logical language could eventually unite all of human experience and knowledge into a consistent system to understand, predict, and control everything. Sound crazy? Anyway, that was destroyed by Kurt Gödel in the 1930s. Wolfram has a clear hypothesis: reality is fundamentally a binary computation. This is why he's on the sidelines of science. The correspondence between physics and mathematics is well known but not understood at all. Every scientist knows it's a mystery. There are many divergent opinions about it. They divide along the lines of whether mathematics is real or not. The promise of at once solving this deep mystery, and revealing the unifying principles of physical reality in the process, is the source of Wolfram's sensational appeal. Stephen Wolfram is an experimental mathematician, an honorable profession. It's a type of inventor. Buckminster Fuller was one such. He also did good work. He also was a character. He also had fanatical followers.
@markm1514
@markm1514 7 ай бұрын
Legendary interview.
@Livinghighandwise
@Livinghighandwise 8 ай бұрын
Great discussion!
@gcewing
@gcewing 8 ай бұрын
On the idea of computational irreducibility becoming obvious, this is probably a thing that's happened since we got computers. We've had practical experience of trying to write programs to do non-trivial things, and that's given us a feel for what kinds of things can be computed quickly and what can't.
@KravMagoo
@KravMagoo 8 ай бұрын
I'm not sure that all that he's "discovering" is "specifically accurate" as much as it is "conditionally accurate". Suppose you had a barrel of the infinite. The way another intelligent species "begins to make sense" of what's in the barrel could conceivably result in a completely different ruliad than the one that he is "discovering" based on our current humanized conditions that represent our attempt to make sense of the same barrel of the infinite. In other words, not only is observer bias a possibility, but our inevitably "locked-in" anthropicly-limited perspective may produce a different set of explanatory rules. If we had a chance to compare our ruliad with another ruliad produced by another "alien" perspective, they would probably be different in some respects. The question is, would they have the same bones, or would they be fundamentally different? Seems like an important question, but it may be a bit too "stringy" to matter...meaning too "stringy" to be testable. Still, I wonder if perception affects a ruliad--specifically, the description of a ruliad? SW has already talked about how humans are invariably "locked in" to having a limited perceptional capacity, and we have to (whether we recognize it or not) limit our "intake of data" to what seems to "matter" to us. As has been stated before, no "model" of reality ever is reality...the amount of information is exceedingly infinite, and we can only ever focus on an excruciatingly small subset of that data. Anyway, interesting stuff.
@fenzelian
@fenzelian 8 ай бұрын
The implications of computational irreducibility are not obvious to most people even now. Even people who think they understand it frequently slip into reductionism. A good example of this is pro-life people who insist that life begins at conception and that a fetus is not different from a baby - that you skip immediately from not-person to person, and pointing to a reductive element, like a heartbeat, as evidence of a sort of instantaneous mapping of reality. This view is not consistent at all with the reality Wolfram is describing or with the concept of computational irreducibility especially as it is so common in biological systems - that organisms have to pass through time in order to become what they become and that this process can’t be skipped over.
@dieSpinnt
@dieSpinnt 7 ай бұрын
Gödel walks in: "Hold my beer ..." also Gödel: "My friend, can I have some of that stuff you smoked, @gcewing?"
@whimpypatrol5503
@whimpypatrol5503 7 ай бұрын
​@@fenzelianEntropy is much more concrete in the case of genetics than heat. Think of the landscape model that virus physicist Peter Schuster describes in explaining the natural algorithm that allowed proteins to evolve into the efficient optimal folding machines that they are. A similar landscape model can be used to describe the universe of all possible gene configurations and organize them by the genetic differences (as distances) between them. For organisms to evolve, their gene structures must migrate across generations through this landscape. The law of entropy applies to this landscape because less gene arrangements produce successful complex life forms than produce successful simple life forms. And, likewise, gene arrangements that produce successful simple life forms are outnumbered by those that produce unsuccessful life. We know this based on entropy. Within this landscape may be more than 10⁶⁰⁰ possible arrangements. However many, it is a very large number so big that not even a smidgen of them could have occurred across 4 billion years even if every organism that ever existed in that time frame was genetically unique. Yet, in defiance of the static entropy characteristics of the genetics landscape mapping all life, gene configurations managed to randomly migrate to ones that produce ever increasingly complex life forms. All I can say is bull dung; it didn’t happen. Do the math. A natural selection genetic algorithm is not sufficient enough to solve such complex problems approximately optimizing dozens and dozens of interrelated phenotype systems in single organisms. Bull dung. No algorithm could solve such a search problem.
@hackingthehumantimemachine9360
@hackingthehumantimemachine9360 8 ай бұрын
Stephen this is a very insight producing presentation on Entropy and how it is affected by the limits of the resolution of our perceptions and measurements. Thanks for making such a great contribution to our understanding of this subject.
@SeanDriver
@SeanDriver 8 ай бұрын
great conversation ❤
@ezraorlofsky7809
@ezraorlofsky7809 8 ай бұрын
Every now and again youtube suggests a video that im actually interested in. This is one of them
@raminsafizadeh
@raminsafizadeh 9 ай бұрын
Fantastic interview! A follow up one, very soon, as in a few days, would be a great idea! Probably, the most qualified person to hear on the so called dangers of LLMs.
@edmundkudzayi7571
@edmundkudzayi7571 7 ай бұрын
"please be as technical as possible, we want all the details" boffin: "I really don't think you quite want that but I will go a certain distance" ha ha ha
@glenliesegang233
@glenliesegang233 8 ай бұрын
Embedded in what language is are common concepts also embodied as word-groupings with connections. A.I. is picking up mathematical patterns which, by virtue of linkage, comes close to modeling the deeper aspects below language, the hidden stuff which are assumptions we /brains need to comprehend and communicate.
@anthonylawrence5842
@anthonylawrence5842 8 ай бұрын
And Michael Levins bioelectricity, morphogenic fields and intelligent agents. There seems to be fundamental structural forms driven by electrical forces within the cellular structure which signal through ion channels and gap junctions which detemines the physiological blueprint of an entitity, beyond the function of the genes.
@paveltolmachev1898
@paveltolmachev1898 7 ай бұрын
I don't understand how the mystery of Entropy is FINALLY solved. This video doesn't contain a single well explained idea, rather just "all-connected-to-all-how-fascinating" type of thing
@schmetterling4477
@schmetterling4477 7 ай бұрын
You are correct. They were just bullshitting you. ;-)
@AICoffeeBreak
@AICoffeeBreak 9 ай бұрын
Wow, can't wait to listen to this. I'll urgently watch today after I finish some work. Stephen Wolfram is always fascinating to listen to, even though I always feel I don't understand everything he says.
@AICoffeeBreak
@AICoffeeBreak 9 ай бұрын
Just watched and absolutely loved it!
@AICoffeeBreak
@AICoffeeBreak 9 ай бұрын
I'm not quite sure if Mr. Wolfram got into the details of the book he wanted to go into. It seems a bit like that strand of conversation got diverted. I should read the book. 📖
@Dessoxyn
@Dessoxyn 9 ай бұрын
"I always feel I don't understand everything he says" Embrace that feeling, it will lead to you learning things you otherwise wouldn't or inspire you to figure out what you don't understand.
@adnanmahmutovic
@adnanmahmutovic 9 ай бұрын
Just amazing. Every second of it. What a mind.
@tb1197
@tb1197 8 ай бұрын
As a retired professor, I admired Stephen Wolfram, Donald Knuth, Stephen Timoshenko, etc... all these people are pioneers in their fields who operated at a higher level.
@optimusoptimum4436
@optimusoptimum4436 9 ай бұрын
Hi and Thank you for this engaging interview with Dr. Wolfram on the fascinating subject of entropy. I appreciate the depth of the conversation and the insights shared. However, I'd like to suggest one thing for future content: Title Alignment: While the title is certainly eye-catching, it might be seen as an overstatement. Dr. Wolfram's insights are valuable, but the term "solved" may not fully represent the complexity of the subject. Perhaps a more nuanced title could better reflect the content.A more accurate title might be something like "New Insights into the Mystery of Entropy: A Conversation with Stephen Wolfram." Thnx.
@wolphramjonny7751
@wolphramjonny7751 8 ай бұрын
@@adamluhring2482 I guess you took the shut up and calculate directive too seriously. Most theoretical physicists do believe the evolution is unitary, even if it is still unclear how the observer enters into the picture. Basically, information is conserved, that is why black holes look so evil.
@FallenStarFeatures
@FallenStarFeatures 9 ай бұрын
TJ;DW: Clickbait title combined with a strained effort to make the 2nd Law of Thermodynamics somehow relevant to trendy AI buzzwords.
@Goblin.Slayer
@Goblin.Slayer 6 ай бұрын
indeed
@FallenStarFeatures
@FallenStarFeatures 6 ай бұрын
It's actually even worse. It's not just a clickbait bull session, this entire discussion of thermodynamic "irreversibility" is confabulated nonsense. To physicists, it is NOT "an enduring mystery" that subatomic physical laws are reversible, while "the behavior we observe in the universe is manifestly irreversible". All it takes to understand, for example, the behavior of a container of gas molecules is to ignore Wolram's mystifying word salad conflating entropy with encryption, and focus on the nuts and bolts. Entropy is simply a measure of random disorder. There is nothing "irreversible" about the initial configuration of gas molecules in the box, and there is nothing that prevents them from returning to that initial state at any point in the future. The reason the gas molecules' movements APPEAR to be irreversible is because of combinatorial explosion: There are so incalculably many potential arrangements of the gas molecules in the box that it is extraordinarily UNLIKELY you will ever see them assume the same configuration twice (or any other specific configuration for that matter). That is the so-called "mystery of entropy", and it was well understand far earlier than 50 years ago.
@tappetmanifolds7024
@tappetmanifolds7024 7 ай бұрын
Fantastic explanation. An amazing achievement which is rarely mentioned is Cedric Villani's 'Proof of non-linear Landau damping and convergence to equilibrium for the Boltzmann equation'. Does the time-independent Schrodinger make any dostinction between past, present and future? Is the Poincare recurrence theorem and Boltzmann H - theorem a form of time reversibility?
@JohnVandivier
@JohnVandivier 8 ай бұрын
"In the end you've got to write code" spoke to my heart
@TheOneMaddin
@TheOneMaddin 9 ай бұрын
I would like to see how his model of a "changing hypergraph" deals with the fact that there is not a distinguished time direction in Minkowski space.
@photorealm
@photorealm 9 ай бұрын
What a great conversation to be a fly on the wall in.
@claudiusraphael9423
@claudiusraphael9423 7 ай бұрын
Surprised to have found a likeminded thinker. Thanks for sharing!
@user-kc1vg3nt2o
@user-kc1vg3nt2o 5 ай бұрын
Wow Wow! It was truly a treat to hear him talk about ideas that he is thinking about right now. It is like an artist describing each brush stroke, as he paints. I did not realize how much he is working on AI and the extent to which his language is playing a role in the development of Chat gpt. I think his new ideas about computational physics will move physics and engineering forward in leaps and bounds. I think his kind of thinking will be the key to modernizing how we live.
@BrianMosleyUK
@BrianMosleyUK 9 ай бұрын
Easily the most fascinating guest you've ever had. I could listen to this man all day. 🙏❤️
@TheNameOfJesus
@TheNameOfJesus 8 ай бұрын
I want to agree, but I had to stop after the first 10-12 minutes after hearing not a single new idea.
@robocop30301
@robocop30301 9 ай бұрын
What agreat conversation. Would love to hear both of the other conversations mentioned in this interview (Bach and Friston). You guys are doing great stuff. Many thanks 🙏🙏
@Christontoast
@Christontoast 9 ай бұрын
Yes to Joscha Bach. Such amazing minds we are privileged to experience! Thank you!
@space-time-somdeep
@space-time-somdeep 8 ай бұрын
So beautiful lecture
@imstevemcqueen
@imstevemcqueen 8 ай бұрын
Excellent content
@srh80
@srh80 9 ай бұрын
I think its a strech say this is a conversation about science. At best its about philosophy of science. He is definitely a very smart and successful person. His theories are too hand wavey for a physicist. For e.g. his claim about space composed of atoms and our aggregate observation manifests as Continuum. A claim without a formal theory does not forward scientific progress. For e.g. I think a legit proposed theory like, loop quantum gravity suggested spacetime as discrete. But its predictions does not match observations. About rulial space, lets assume 10**600 is true. What then? Its as pointless as many worlds theory, something that can never be proven and doesnt make any observable predictions.
@nanow1990
@nanow1990 9 ай бұрын
We will never be able to predict the universe hence the Uncertainty Principle. We are the part of the Entropy, Universe itself. We can always measure simulation that we are running but simulation can't predict itself with deterministic certainty. Standard model cels are bashing their heads trying to fine tune the particles yet they didn't really provide any useful conclusions which could be used today.
@AZTECMAN
@AZTECMAN 9 ай бұрын
In terms of introducing Wolfram to Friston, I'd be curious to see Michael Levin as a 3rd party discussing some of these topics.
@EricDMMiller
@EricDMMiller 9 ай бұрын
I emailed Levin yesterday to suggest that he speak with Wolfram.
@ptrckqnln
@ptrckqnln 8 ай бұрын
I wonder if Friston and Levin would be able to get a word in!
@EricDMMiller
@EricDMMiller 8 ай бұрын
It's funny how his reply in the video was basically to say "I find it's not worth talking to other people anymore." Lol
@brandonheaton6197
@brandonheaton6197 9 ай бұрын
Minite 18 is the best explanation of computational irreducibility i've ever heard
@klomo13
@klomo13 7 ай бұрын
thank you dr. stephen wolfram, you are one of the greatest minds of our time, a true inspiration. I love Wolfram Alpha, it was extremely usefull during my studies.
@lenyabloko
@lenyabloko 9 ай бұрын
"I have a suspicion that there is a way out of this mess" is all he could say.
@skulptor
@skulptor 3 ай бұрын
Next book.
@rezibtutsanai
@rezibtutsanai 9 ай бұрын
"In the end, you have to write code" this is a great notion. I came to this conclusion many years ago and Mr. Wolfram's work has only come to vindicate many notions I have come across in my search for meaning.
@zpango2000
@zpango2000 8 ай бұрын
⁰⁰0⁰0⁰⁰⁰⁰00⁰00⁰⁰000000⁰⁰⁰⁰00⁰⁰⁰00⁰⁰0⁰⁰⁰0⁰⁰⁰⁰⁰⁰0⁰⁰😊
@goldwhitedragon
@goldwhitedragon 8 ай бұрын
CTMU answers all questions. All.
@whatzause
@whatzause 3 ай бұрын
We are bounded in whatever ways you claim, but we also bounded by the limits of our language to explain, describe, and even discuss the matters you are addressing. With those limitations (constraints of discussion) you do a remarkable job with those difficulties against you.
@mfpears
@mfpears 9 ай бұрын
25:00 "Abstract" is the word 36:00 An abstraction 36:30 A neuron
@briandecker8403
@briandecker8403 9 ай бұрын
Keep in mind that Wolfram is on the record as being against peer review, operates entirely outside of the standard physics paradigm, and is basically considered a fraud by people like Sean Carroll, Katie Mack, and Daniel Harlow. The most common complaint is that he consistently argues from positions of pre-arranged supposition -i.e. I put a rabbit in a hat then state "If we suppose that a rabbit is coming out of this hat, and look - here is a rabbit!" then go on and on about how remarkable that is; well that's not remarkable - it's a trick. I might believe to my core that I am expressing a novel concept, but my belief that it is novel does not actually make it novel.
@EudaderurScheiss
@EudaderurScheiss 9 ай бұрын
you have to consider him a technical philosoph. the view he holds about what the universe is and how it behaves, can be embeded into a computers way of processing. and there is truth to this viewpoint. he may be right about it. the mathematical concepts we have, describe certain observations of the universes nature that match our formulas, but only do so in slices. its like looking through a box of scales or building scales to describe what we see. wolfram tries to role up everything from behind. by having a computational definition of the universe. which you can not really prove as long as you do not find it. there may be some time when AI with lots of computational resources, can process all the possible scales, but for now its philosopy. its also funny that computer guys just want to automate everything. you cant peer review this, because there is nothing there to review. its a computers job to review this. but yeah the critic of him holding a nothing burger thats not proveable is also valid.
@briandecker8403
@briandecker8403 9 ай бұрын
@@EudaderurScheiss thank you for a well reasoned and thought provoking response. I agree - it is better to consider Wolfram as a philosopher of technology (I would place Searle in the same box) - and his ideas ARE interesting. I think my primary point of disagreement is when Wolfram describes a gas molecule "calculating" its next position or a magnet "computing" it's polarity - as these are words which indicate an active process by an inert object. This is similar to the AI discussion where people assert "understanding", "knowing", or "sentience" - loaded words for sure. Saying a night light "knows it's dark" and therefore is AI is as misleading as claiming a gas molecule "calculates" its next position.
@ArtOfTheProblem
@ArtOfTheProblem 9 ай бұрын
i was tripped up there to, but then what part of a comptuer is "calculating", is it the electrons or 'a system of electrons'?@@briandecker8403
@EudaderurScheiss
@EudaderurScheiss 9 ай бұрын
@@briandecker8403 thats why its philosophy, he describes those things out of a computational lense, inside of his theory. it resonates very well with a lot of programmer types, since we are used to think like that. for us this is just logical, we can imaging those things easily since we think like that all day. its not the molecule "calculating" its the universe itself calculating - the computer. it sits on top in his theory. even though i never understand whats the order of calculation (he had something written about it, but not sure, maybe he changed that part, didnt fully watch the video). its always philosophy if you need new words to describe abstract concepts. it could be true. but because of the complexity of the universe, finding new essential laws of physic is getting harder and harder. so i guess the computational/simulation approach will become a standard in physics in the future
@imacds
@imacds 9 ай бұрын
He essentially said that his theory is a Theory of Everything, which is a red flag.
@MrBabadude
@MrBabadude 9 ай бұрын
Every time I listen to Stephen Wolfram I get excited. I get so many ideas I want to explore. Not just his ideas but he causes me to think more deeply about the things I’m working on. Wow great interview.
@vallab19
@vallab19 9 ай бұрын
Sounds fascinating.
@user-sc1bh5jb9o
@user-sc1bh5jb9o 9 ай бұрын
this conversation is following second law of thermodynamics (entropy) is increasing with time, more terms coming up, adding more to complexity (this feels like creating more parking places for our understanding)
@cdenn016
@cdenn016 9 ай бұрын
Eh...It sounds to me like he took the second law and all it's subtleties (nevermind QM, nevermind chaos, nevermind probability) and transcribed it into a different language without resolving those subtleties. One big thing, I think, is we HAVE to reconcile the kantian nature of our observations (or the observer problem in QM) and whether space-time are primal or not. What can he predict here? Otherwise it seems like "what's the point?🤷" I'll have to read the book. But I do love the whole idea of all this complexity stuff 😍
@PavelSTL
@PavelSTL 8 ай бұрын
Can't wait for the Observer theory from Wolfram. One thing I wished you asked him about it is: How are you going to deal with the classic problem of self reference - the limits and structural bounds your theory will impose on our minds are themselves the result of these limits. You have to be outside of these limits yourself to know those limits are there.
@horasefu1438
@horasefu1438 8 ай бұрын
there is no plausible solution for this problem, it's a philosophical problem from the domain of epistemology and there is no way of neither resolving it nor going around it. any theory can hence only hope and strive in compensating for it, incorporating this as a fact and simply moving on.
@PavelSTL
@PavelSTL 8 ай бұрын
@@horasefu1438 Moving on exactly where though? Deriving a superluminal travel or finding out what's at the center of the black hole? I think this is still being stuck in the same old Platonic cave, it's just today we frame it in terms of bits and computation, and superpositions because we now have QM. Whatever the label for the problem or its source, it's still a problem that needs to be addressed. If not, it's either Pragmatism, in which case, it's Wittgenstein's “Whereof one cannot speak, thereof one must be silent.” or admittance that it's a cool story, perhaps a good plot for the next incarnation of the Matrix trilogy.
@alextrebek5237
@alextrebek5237 3 ай бұрын
@35:00 this is what Dr Hofstadter posited in "Analogy as the Fuel and Fire of Thinking." Assume language enforces a degree of regularity and conformity to qualia
@AnJo888
@AnJo888 8 ай бұрын
What a trip... In a good way. The more I hear about new Physics' ideas the more all that 'The Secret'/'Create your own Universe' lore makes sense.
@cryoshakespeare4465
@cryoshakespeare4465 9 ай бұрын
Awesome interview! It's funny how he talks about ostracising the AI at the end as an alternative means of punishment, reminds me of how banishment was a historical penalty for people of significant means, and in some ways it's considered worse than death - you don't get to become a martyr or a victim, you just become irrelevant. Also lets you hold being accepted back into the fold as a carrot.
@musbiq
@musbiq 8 ай бұрын
That's a great point to keep in mind.
@henrik3141
@henrik3141 8 ай бұрын
Are there real scientists who take all his stuff actually seriously?
@franzfrikadelli6074
@franzfrikadelli6074 2 ай бұрын
no
@patrickavis5475
@patrickavis5475 8 ай бұрын
As always, a very interesting conversation, but how do you test any of it?
@markopetrovic7376
@markopetrovic7376 8 ай бұрын
This conversation starting point problem - refers to one formulation of LEonard Susskind formulations regarding entropy, that observed randomnes is described as a thermal equilibrium as a result of many tiny fractalised components which are too hard (useless) to account for. And next question derived from it ---> what if we can account them precisely and somehow practically apply that hidden part of information in real science. That`s how i percieve this extraordinary topic.
@javadhashtroudian5740
@javadhashtroudian5740 9 ай бұрын
Thank you for another great episode.... I remember the first computer I programmed 1974. I worked for the vendor (NCR) and I felt so lucky that I had 8k of core on my computer whereas our customers hadc4k. The good all days.... thank you for reminding us older folk how lucky we are today.
@-_a-a_-
@-_a-a_- 9 ай бұрын
Lucky? Technology is destroying society and people's lives!
@yamishogun6501
@yamishogun6501 8 ай бұрын
We are all very lucky until the nukes start flying...
@zando5108
@zando5108 9 ай бұрын
AI will be crucial in helping us understand the universe. A different perspective, a different kind of intelligence will prove key. My pet theory is that Many impasses in different fields have their limitations rooted in the inherent thinking processes, language, logic of biological humans.
@josgraha
@josgraha 7 ай бұрын
Wow, the statement from Dr. Wolfram that all of his thoughts and writing on such are designed to be overlaid upon a computational model. That kinda changes everything I have heard or thought about Dr. Wolfram's writings because for me personally I might have written something off as "oh well this is kind of like X" but does X also work as a computational model? That's so cool! No wonder he loves cellular automata and of course all of the legendary software contributions over his career, we can start to grasp the convergence. Thank you so much for the interview!
@doodle6004
@doodle6004 8 ай бұрын
Stephen, (extension of prior comment): How do we know whether the most important information is in the vast, eternal bit; vs. the tiniest, most discriminating bit? You mentioned that as we populate more and more of rulial space we cease to exist. I very much agree. As a species of observers, over our evolution, are we reaching ever more discriminating levels of perception? Increasing neural efficiency, or organization - order?
@CalinColdea
@CalinColdea 3 ай бұрын
Although understood pretty much nothing, still listened to it, being 1000'sX better than any music. Mr. Wolfram is an absolute gem of our times.
@robertjustice8361
@robertjustice8361 3 ай бұрын
kzbin.info/www/bejne/Y6i9ZGhvqNV8jLs
@XOPOIIIO
@XOPOIIIO 9 ай бұрын
AGI doesn't need survival instinct, survival can be instrumental to any goal.
@Cabildabear
@Cabildabear 8 ай бұрын
Shit that's a profound insight, where we usually assume the survival instinct would take precedence over all, yet we have the concepts of self-sacrifice, heroism, or suicide that disregard that apparent sense of self preservation
@XOPOIIIO
@XOPOIIIO 8 ай бұрын
@@Cabildabear Self-sacrifice developed in humans because of it's tribal history, it's still evolutionary in nature, not on personal, but on tribal level.
@6ixpool520
@6ixpool520 2 ай бұрын
@@XOPOIIIO Its a beneficial trait to do the best thing for the continued propagation of your genes. If that means sacrificing yourself in a way that benefits your progeny, then it makes sense fro ma selfish gene perspective.
@peterkamau2014
@peterkamau2014 2 ай бұрын
what the hell are you trying say?
@XOPOIIIO
@XOPOIIIO 2 ай бұрын
@@6ixpool520 Exactly
@Pseudify
@Pseudify 9 ай бұрын
I came to hear Stephan but subbed because of Tim and Keith. Class acts!
@megamillionfreak
@megamillionfreak 8 ай бұрын
That’s a revolutionary way to pronounce transition. 👌🏻 He’s an absolute treasure.
@AlainPaulikevitch
@AlainPaulikevitch 2 ай бұрын
Please someone kindly point to the minute in this video where something new about entropy is actually said. While the man talking seems remarkable and very interesting to listen to I failed to identify how rambling about AI had anything to do with proving the second law of thermodynamics.
@Eric-zo8wo
@Eric-zo8wo 7 ай бұрын
0:56: 🔬 Dr. Stephen Wolfram's insatiable hunger for knowledge and research on ancient manuscripts and early scientists' conception of the universe. 16:50: 💡 The second law of thermodynamics is an interplay between the computational process and our ability to observe things. 34:28: 🧠 Minds in rural space can communicate through concepts, which act as packaged particles of information. 51:09: 🧠 The speaker finds it interesting that theoretical debates often need to be translated into code to be understood and grounded. 1:08:09: 🤔 The speaker discusses the future of AI and the challenges of AI governance. Recap by Tammy AI
@WarrenLacefield
@WarrenLacefield 9 ай бұрын
This is so cool. LLM predict/select the next word. The talk, e.g., about Tesla world-models for cars, is that the observers are the cameras with high resolution dynamic inputs, being retained in memory for perhaps 10 seconds of 60 frames per second. The highway "world model" is trained (like the LLM) to predict all the bits in the next frame, up to maybe even the next full second of frames. So the model predicts a future. It can also predict 100 other possible futures (quickly), select the "best/most likely/desired/or goal-oriented" future, and send appropriate commands to the auto control system to realize that future. Meanwhile, it can also prepare appropriate (re)actions in the event that any of the other possible predicted futures actually occurs .. in the very next dynamic "frame" or ground truth it receives from the vision system. If you think about it, this is what a driver does constantly, watching the cars, guessing what they might do next, deciding on what he or she is doing next; doing that, while worrying about the other drivers; and so forth on and on. To the extent that works in silicon, IMO, that really is totally amazing!
@richardseymour6091
@richardseymour6091 9 ай бұрын
Hilarious to hear him talk about 'If I made up a word and no one used it' and proceed to use the term rule-i-ad as if it were something. :)
@ticthak
@ticthak 8 ай бұрын
It's a perfectly reasonable term. I've used it shortly after I heard it defined the first time, and I KNOW thousands of other people use it in the same conceptual sense, assuming "concept" and "sense" aren't qualia.
@NicholasNewlin
@NicholasNewlin 7 ай бұрын
There is so much bullshit here. And it is profoundly disappointing that so many people have watched this interview and made glowing, even worshipful comments about Wolfram after watching it. I'd really like to know two things: 1. Did Wolfram pay the two smiling sycophants who made this video with him? 2. Has Wolfram paid anyone to make flattering comments about the video? Here's the truth: Stephen Wolfram was a boy genius. He's gone on to make a lot of money. Good for him. But in his physics project he has published a book and given interviews that amounted to stealing the ideas of other physicists and mathematicians, pawning them off as his own discoveries - and framing those ideas as if no one had discovered them before - and offered nothing that is actually new and fruitful. I read his book. It's basically the same thing Benoit Mandelbrot wrote fifty years ago re-packaged into "computational irrudicibility". Go download Wolfram's physics book. It's a huge collection of fractal images. IIRC, in all those pages, there isn't a single citation to another physicist's work, experiment, observation or theory.
@Anders01
@Anders01 9 ай бұрын
Exciting to hear what Stephen Wolfram has discovered. I believe he is at least on the track that entropy is like encrypted information rather than actual randomness, that it looks random because of the difficulty of measuring all the details, if that's still his view.
@Sulayman.786
@Sulayman.786 9 ай бұрын
So disorder is encrypted order? Next time someone tells me that I'm out of order, I will just reply 'No, in fact I'm in order, just that I utilize privacy technologies'.
@ArchonExMachina
@ArchonExMachina 9 ай бұрын
That's how randomness, noise, mysteries and magic appear to us. Anything of which we have insufficient information to form an illusion of having a grasp of.
@Achrononmaster
@Achrononmaster 9 ай бұрын
Randomness is relative. If you know all the bits in a string it's not random to you. You just can't usefully compress it to communicate beyond the Shannon bounds. That's also the essence of the 2nd LoT. To usefully communicate a high entropy state of stuff in a box (up to anti-de Sitter space) you have to grossly over-simplify --- meaning you've chunked a lot and used macro variables, not micro, and many micro can realize the same macro. It has nothing to do with computers and hypergraphs _per se._ It is computational by default, by definition, since it's just mathematical description. That doesn't mean anything profound. How else are you going to describe physics? With poetry? (Been done.) The math always works if you get the inputs right. To me, fwiw, Wolfram comes across as a child nerd with bald hair. Higher IQ than me, have to say (though that's no guarantor of having useful insights). Not a grifter, but someone who is too easily surprised by trivialities. I'm not a hater though. I like Stephen's enthusiasm. I wish he'd help "solve world poverty" though, which is not operationally a terribly hard thing, it is mighty politically hard. He needs to learn basic MMT , which he will not get chatting with the likes of NNT, instead see smithwillsuffice.github.io/ohanga-pai/questions/1_basic_ohangapai/ for some MMT basics. ("Solving poverty" --- i.e., solving the hard problem of instigating the political will to eliminate poverty via fair distribution of necessary output --- is a surer path to a Nobel Peace Prize than any hypergraph theorising is to a Physics Nobel or Math Abel. Justsyain. If that sort of prize is what tickles your ego.)
@PetWanties
@PetWanties 9 ай бұрын
compressed might be better term than encrypted
@MichelleHell
@MichelleHell 9 ай бұрын
Disorder and randomness are two terrible ways of understanding entropy. It boggles my mind anyone can think of science with this understanding of entropy. Entropy explains how one must expend energy to harness energy, thus eliminating the possibilities of perpetual motion. Wolfram starts to get into the Carnot cycle, talking about irreversible processes. If your take away from entropy is, "the world is devolving into chaos and randomness", you've entirely lost the plot. The harnessing of energy is always escaping our grasp, and the more we harness the quicker we speed up this process. Think of harnessing all the energy released by fossil fuels. You have to collect the molecules and the heat from the atmosphere, and compact it back to the oil or gasoline. If we burned oil as energy to perform this process, we'd be contributing to the problem we're solving. How much oil has to be burned to reverse the burning process? You're better off cutting the losses and developing forms of energy generation that don't heat the atmosphere.
@donmc1950
@donmc1950 8 ай бұрын
An interesting perspective on entropy based on the limits observability of computation. It will be interesting to see how useful this perspective is in future. I have always been fascinated by the operation of the negative feedback amplifier whereby the amplifier output is differentially added to the input to create a stable system. Perhaps all nature works this way ?
@memegazer
@memegazer 8 ай бұрын
Well for my take there is a dimension left out, time. Imo "past" is discrete relative to frame of refences but converted to spatial dimensions. But this is just a conveince for making sense of the arrow of time.
@russell62790
@russell62790 8 ай бұрын
​@@memegazeroh please, stop making sense. It's boring.
@arinco3817
@arinco3817 9 ай бұрын
Absolutely awesome! The final comment about managing a billion ais might be more simple than 1 echoes what George Hotz was saying
@muhokutan4772
@muhokutan4772 9 ай бұрын
Always a pleasure to listen to Steven!
@valterszakrevskis
@valterszakrevskis 9 ай бұрын
A nice conversation. I find it necessary to also mention the mathematical universe hypothesis, as it is extremely similar to the Ruliad idea. Perhaps one theory emphasizes computation while the other focuses on mathematical structure, with time being a factor in one and not the other.
@valterszakrevskis
@valterszakrevskis 9 ай бұрын
Although time can be a factor in math structures too, so it's more of a different approach to the same thing maybe,
@NightmareCourtPictures
@NightmareCourtPictures 9 ай бұрын
The two ideas are indeed similiar, but the mathematical universe, is a subset of the computational universe proposed by Wolfram...as the Ruliad contains all possible logical systems, including mathematics. He has sections of his studies on meta-mathematics that you should look into that goes into the underlying ideas. "How Universal is the Concept of Numbers" is a good lecture to watch from him, i think you'll be surprised.
@valterszakrevskis
@valterszakrevskis 9 ай бұрын
@NightmareCourtPictures 1st statement) Isn't it the exact opposite? I think Ruliad is a questionable and incomplete application of MUH. It is important to understand what math is. Beyond numbers and shapes, math studies abstract structures and their relations. There is no universally agreed-upon definition of mathematics, but it includes logic and many related areas. Math is turning complete (pretty sure, the internet seems to agree). 2nd statement). I took a look at the lecture, and he mentions some interesting ideas, but I don't see how it changes any of my points. I'm sure he is a smart guy. The main problem with all mathematical universe hypotheses (MUH) and "related ideas" is that they are unverifiable as far as I see. I'm glad Wolfram is trying to develop these ideas further, to perhaps arrive at something practical. That would be great. I see his ruliad as MUH with some more assumptions (making it a subset of MUH). The concept of computational irreducibility is interesting, but I think it's likely wrong. It's a message of its own, though I'm happy to share (and complete the thoughts for myself). The reasoning might take quite a few words to explain, but is clear and I think it comes down to definitions and beyond those the implications. Further, his reasoning appears handwavy and as far as I understand and I think no rigorous math exists to prove his claims.
@valterszakrevskis
@valterszakrevskis 9 ай бұрын
I may have mixed in some of my thoughts with those of the mathematical universe hypothesis, or maybe not. Either way, the above reasoning stands.
@NightmareCourtPictures
@NightmareCourtPictures 9 ай бұрын
​@@valterszakrevskis To your first statement : the mathematical universe, implies that the universe is made out of numbers...mainly to explain why universe gives us fine-tuned constants, and using this premise as a way to excuse the fine-tuning problem without invoking something like god. The computational universe is similar except it is fundamentally computational...not defined out of numbers, and that lecture (how universal is the concept of numbers) is an important lecture in explaining this and why the Ruliad concept is not mathematical universe theory but *way more* than that. To your second statement and third statement: Computational Irreducibility is an observed phenomenon of Computational Systems. He wrote a book called "A New Kind of Science" which you should watch the series he made on it (it's 14 parts 2 hours each sorry...but its a great watch) In that book he goes into pain-staking detail of the computational experiments he did. If you study any kind of computability, this book is like a right in one's face "Proof by Exhaustion" way of showing that these things are real and not hand waved. It's ironically hard to actually prove that any of it is wrong...because those experiments clearly show that it is just true...self-evident as he would say. Studying the stuff for 2.5 years now and applying the work he laid out in applications for my own purposes...I would say with great confidence this is true, and it'll only be a matter of time before people start catching on. Cheers,
@mansamusa559
@mansamusa559 8 ай бұрын
totally interesting, understood like 70%.. But Prof Wolfram needs to give these guys more respect, they give me super smart vibes even in front of the Prof!
@justgivemethetruth
@justgivemethetruth 8 ай бұрын
Have had trouble getting into Wolfram's lectures before, but this is very packed with accessible concepts to think about. Wonderful.
@adammichael9759
@adammichael9759 8 ай бұрын
Its been a few weeks since i enjoyed something so much. The depression and being 36 with two chronically ill parents As well as having a relationship with my wife for 22 years. Its good now but it was abusive until we both got therapy. Its all been hitting me at once. This is taking my mind off alll of that . Now that's priceless. New subscriber and i love Wolfram.
@carolspencer6915
@carolspencer6915 8 ай бұрын
Good afternoon to you three. 😀 Wonderous shared discussion. Fascinating indeed Stephen, only know a wee bit of your work so far. Has enabled my brain to upgrade alot of inner software and a sense of better understanding and might add direction. Truly Grateful. 💜
@martinmartin8940
@martinmartin8940 2 ай бұрын
I love hearing Stephen Wolfram talk, even in the moments when gets a little incoherent :D Also, as a linguist, I can appreciate the way you phrased your bit about the language game; you seem to have a good grasp on the matter
@ChuckNorris-lf6vo
@ChuckNorris-lf6vo 8 ай бұрын
Good job.
@74Gee
@74Gee 9 ай бұрын
Fascinating conversation, I was particularly interested in the AI risk chapter, specifically the actuation concept. There used to be about 25 million "classical" programmers, now, pretty much anyone with the internet can program, to some degree using AI. Classical programmers learn ethics and responsibility alongside their skills development, but the newer AI assisted programmers have little to none of these accountable traits. Stephen Wolfram correctly identified the scope of actuation, and how that could represent a significant challenge but then the conversation moved on to an AI developing internal agentiveness. But what about the AI assisted programmers using AI to develop systems capable of producing unstoppable systems? - either by accident, or deliberately. An AI doesn't need to develop its own agentiveness to be agentive. Agentiveness can be synthesized with automation code provided by naive, or disenfranchised, AI programmers. I've come up with examples of potentially uncontrollable AI automations that could wreak significant damage to society and none of them require anything more than consumer hardware, open source models and basic automations. If AI can help us do the right thing, it can certainly help us do the wrong thing and AGI is not a prerequisite for either.
@ticthak
@ticthak 8 ай бұрын
The incidence of human malfeasance is statistically certain, therefore the incidence of human-prompted AI malfeasance is statistically certain. And, unfortunately, just becasue ethics and moral standards are (or at least were) part of programming study, they've obviouskly not made much of a difference over the past 70-80 years in terms of the proliferation of fundamentally immoral ventures such as health insurance, most of the MIC, energy companies, or the rest of the commons that's been subsumed by private enterprise. Your point is spot on, I just don't think the oncoming negative consequences of actuaction are fundamentally different, they'll just be much worse than we've already got. Maybe that offers potential for positive solutions, if we work hard enough for it.
@orbatos
@orbatos 8 ай бұрын
Making useful programs needs guidance. Generative systems do not have agency, only statistical reproduction. This means the average Internet user attempting to make something new with machine learning will not be able to utilize it in a very productive manner. Likewise an experienced programmer can make good use of such tools. The primary goal in development of this tooling is primarily about lowering pay for skilled labor and secondarily about being able to pass legal responsibility for decision making to a mechanical process. Both of these things are not good.
@74Gee
@74Gee 8 ай бұрын
@@orbatos I agree with your points on programming, I didn't mean to suggest that everyone can program effectively however the trajectory of the trends are fairly clear, we are lowering the bar for both skill and accountability into a broader set of users. Similarly automation can mitigate incompetence and failure rates (code, compile, test, repeat - until success). These are trajectories that I believe will lead to the development of significantly powerful tool that could be almost impossible to mitigate. If only one of these tools is developed we could have a major problem. Meta is rumored to be releasing Llama 3 as an open source model to compete directly with GPT4 and I postulate this, with the safely rails inevitably removed will be sufficient to advance these trajectories well into the danger zone - on consumer hardware too. The consumer hardware part is important as it removes a barrier for malware producing systems to replicate exponentially. I also agree that lowering the pay for skilled labor (pushing skills out of the market when we need them most), and especially the automation of decision making are not at all good. To me it seems like a lot of trajectories are heading in the opposite direction from where they need to be going and corporate goals and ego are at the wheel.
@ob7022
@ob7022 9 ай бұрын
Just wondering whether Stephen is inspired by the philosophy of Giles Deleuze? A lot of the concepts he puts forward (e.g. the ruliad) sound similar to Deleuze’s rhizomes and plane of immanence
@DelandaBaudLacanian
@DelandaBaudLacanian 9 ай бұрын
I just asked Google bard this question, it could be hallucinating though 🤷: "The ruliad is a set of all possible computations, while a rhizome is a network of interconnected nodes. Both the ruliad and the rhizome are non-hierarchical and non-linear, meaning that they do not have a central organizing principle. They are also both constantly evolving and changing, as new nodes are added and old nodes are removed. However: there are also some key differences between the ruliad, rhizomes, and the plane of immanence. The ruliad is a more mathematical concept, while rhizomes and the plane of immanence are more philosophical concepts. The ruliad is also more focused on the future, while rhizomes and the plane of immanence are more focused on the present."
@georgesos
@georgesos 9 ай бұрын
Delusional you said?...😂
@Walczyk
@Walczyk 3 ай бұрын
a new kind of science, i find him to be fascinating
@justdoityourself7134
@justdoityourself7134 9 ай бұрын
52:00 "And then you have to write code..." nailed it. As a programmer, I wish everyone understood how grounding and orienting to practical reality this statement is.
@jondor654
@jondor654 9 ай бұрын
We must mind the gap in dimensionality between a simulation and the real thing
@ticthak
@ticthak 8 ай бұрын
@@jondor654 That applies especially to qualia.
@BuFu1O1
@BuFu1O1 9 ай бұрын
Some observer isn't born/created without some kind of it having some sort of risk assessment mechanism. I was playing with programming some particles, by reading the book The Nature of Code, and you quickly get to the part of particles avoiding other particles. If you want some agent to behave as some kind of entity, add some risk perceiving mechanism.
@teenspirit1
@teenspirit1 8 ай бұрын
I loved mathematica's website. I browsed its wiki whenever I was curious about a concept back in the early 2000s. The wealth of interlinked knowledge was huge. Mathematica was pretty good as well. But that was it. A wiki and a software. Then there was the web counterpart of the software back in the early 2010s. But then I started seeing wolfram in the media. He kept talking about how he was part of great discoveries. Whenever there is some discovery, there he is, as if he is taking credit for it. Is it me or is stephen wolfram just being delusional?
@Us3rn4m3N0tF0und
@Us3rn4m3N0tF0und 8 ай бұрын
It is not you.
@mithrandirthegrey7644
@mithrandirthegrey7644 8 ай бұрын
Same. I remember trying to come up with equations to make it draw things that I wanted. It was very basic all those years ago.
@av-gb5cp
@av-gb5cp 8 ай бұрын
I don't think so. He happens to have the recognition to be able to talk about those sort of things, and his writings have put him in the spotlight. But just because he's the only one you hear talking about those things, does it mean aren't any others?
@sergiosfcb5208
@sergiosfcb5208 7 ай бұрын
Yes
@rogercole
@rogercole 9 ай бұрын
Yes! Being together Wolfram and Friston. Maybe add Chris Fields and/or Michael Levin. This could supercharge Wolfram’s development of observer theory.
@MachineLearningStreetTalk
@MachineLearningStreetTalk 9 ай бұрын
Wolfram and Friston is on
@frankdaze2353
@frankdaze2353 9 ай бұрын
Good stuff
The Mystery of Spinors
1:09:42
Richard Behiel
Рет қаралды 627 М.
Monster dropped gummy bear 👻🤣 #shorts
00:45
Yoeslan
Рет қаралды 12 МЛН
How Feynman did quantum mechanics (and you should too)
26:29
Physics with Elliot
Рет қаралды 414 М.
The Most Misunderstood Concept in Physics
27:15
Veritasium
Рет қаралды 13 МЛН
This is why Deep Learning is really weird.
2:06:38
Machine Learning Street Talk
Рет қаралды 311 М.
Should we abandon the multiverse theory? | Sabine Hossenfelder, Roger Penrose, Michio Kaku
53:43
The Institute of Art and Ideas
Рет қаралды 1,4 МЛН
Why a Forefather of AI Fears the Future
1:10:41
World Science Festival
Рет қаралды 91 М.
Coding the Cosmos: Does Reality Emerge From Simple Computations?
2:32:55
World Science Festival
Рет қаралды 593 М.
The secrets of Einstein's unknown equation - with Sean Carroll
53:59
The Royal Institution
Рет қаралды 661 М.
Introducing GPT-4o
26:13
OpenAI
Рет қаралды 2,9 МЛН
🤯Самая КРУТАЯ Функция #shorts
0:58
YOLODROID
Рет қаралды 3,4 МЛН
САМЫЙ дешевый ПК с OZON на RTX 4070
16:16
Мой Компьютер
Рет қаралды 114 М.
Airpods’un Gizli Özelliği mi var?
0:14
Safak Novruz
Рет қаралды 3 МЛН
Best Gun Stock for VR gaming. #vr #vrgaming  #glistco
0:15
Glistco
Рет қаралды 1,7 МЛН