What is ergodicity? - Alex Adamou

[@BlueSoulTiger]

Big up-vote for clarity of exposition: such an underrated property, yet so obviously helpful. It actually takes a lot of work to achieve this, so chapeau to you Alex.

[@alexadamou7039]

Many thanks!

[@1ron1van]

Loved the video - if only KZbin were to fill my feed with this kind of material ...

[@Tronized]

Absolutely excellent! Such clarity brought to an overcomplicated topic. Can't wait for more videos.

[@science_engineering]

Brilliant! Finally a REAL mathematician explained this ambiguous and difficult feature in the way as it's supposed to be explained..) p.s.: pitch and calmness during this talk are also brilliant..)

[@Hubieee]

Once I have understood something I try to explain it as clear as possible, not only to check my own understanding but also because I have run into so many papers and books where things were "explained" in a way that it raised more questions than it gave answers... Thanks for this video. Appreciated.

[@MrDhrubamukherjee]

This is a fantastic video. Looking forward to other videos...

[@siddharthsawant3155]

This extraordinarily fascinating. Please keep educating us. This is so exciting!!

[@borjaurrea7960]

Amazing content, so straightforward to follow this complicated topic. Many thanks

[@ramazankizilyildirim3476]

This could be the clearest introduction of the topic. Thanks

[@Fogad237]

This is simply great. That"s how teaching sould be. Thank you!

[@LightHolmes]

This cleared up so many concepts and was extremely informative. Thank you!

[@evillarroya]

Amazing explanation and great sound quality. Many thanks.

[@danielayoutube6122]

Hands down the best video of 2022 so far! It is so well explained!!

[@taojesusvelozvazquez6677]

I really need a good Spanish translation of this content, hopefully a hero will emerge who creates it for this channel

[@muizabdul29]

Underrated content. Beautiful.

[@stevebrown2557]

That was an excellent lesson. Thank you!

[@alexadamou7039]

Thank you, too!

[@value8035]

Cool. This is precise and clear. Thank you!

[@sajarnitsa]

It is a very enlightening video!

[@alexadamou7039]

Thank you! I'm glad you found it useful.

[@jonmoore8995]

This is amazing. I understood this, and appreciate such clear explanation.

[@sharanbalasubramanian8172]

Amazing video. He had me captivated till the end.

[@stooforthecat]

Great video. I’m very interested in the applications of these theories to insurance problems. Looking forward to seeing more of them.

[@alexadamou7039]

We have a paper on that and I am sure we will do a video about it. For some reason I can't post the link here but you can search for "insurance makes wealth grow faster".

[@stooforthecat]

@@alexadamou7039 thanks Alex. Will search for that. A lot actuarial modelling for insurance is predicated on utility theory and assuming that the data is i.i.d. A lot of these assumptions fall over in reality. I’m looking forward to learning more about ergodocity and how it might impact typical models used in the same. Cheers.

[@pinakibhattacharyya7853]

@@stooforthecat Some exponentially decaying autocorrelation function is a better alternative I suppose or some correlations with power-law memory kernel..Do we see generalized functions like Mittag-Leffler, Fox - H or M - Wright functions in insurance mathematics or some sort of reduced-form intensity based models of hazard rates, point process modelling framework .

[@zaranikdel]

@alexdamou7039 Thank you, very clear explanation. About the example at time 12:25, it is obvious it's not ergodic because the transformation is not measure preserving. In other words, in each iteration you are changing the probabilities of red and green balls. The first condition for a transformation to be ergodic is to be measure-preserving.

[@HidekazuOki]

Brilliant and easy-to-understand explanation! Thanks for sharing such an excellent video!

[@berkeunal5773]

7:50 it is good to mention von Neumann as well for his mean ergodic theorem

[@ibraheemmoosa]

How is this connected to Markov chain? Specifically to MCMC algorithms?

[@Interviewologist]

really great explanation and unexpectedly informative

[@mktsp2]

Meilleur video Sur tout l’internet! BRAVO mon vieux!!!!

[@PedroRibeiro-zs5go]

Thanks, this was an EXCELLENT video!

[@jonatanrisberg5531]

Subscribed! Thank you for a great intuition boost on the topic.

[@asdf8asdf8asdf8asdf]

As somebody who learns by example, you could do literally almost the same video over two or three times with different real world examples to help the concept sink in.... These ideas are so ridiculously rich that I found myself getting distracted at every moment with all the different possibilities -- Is statistical mechanics really properly laid out? What types of systems violate underlying ergodicity assumptions and have to be handled with different mathematics? What does this do in quality analysis of frequentist probability studies, if we evaluate if the cross-sectional sample is it truly the same as the longitudinal average (space and time average is) it's very rich!! hope to see many more of these videos!.

[@tutoro5567]

would be great to explain what each example means, with all the variables and connenction to the picture

[@balintccc12]

extremely helpful video, thank you!

[@juliocorrearios9103]

This video is great! How often are you going to be releasing new materials, guys? Looking forward to seeing the next ones!

[@alexadamou7039]

We've only just started and this is all quite experimental, so I can't give you a precise answer. However, I would guess 1-2 videos a month of this length covering key themes in EE, and maybe some shorter ones on single results.

[@EconomicsDesign]

@@alexadamou7039 This is wonderful. Already looking forward to your next videos! Thanks for making the video.

[@pinakibhattacharyya7853]

@@alexadamou7039 Please discuss Johnson-Nyquist theorem, fluctuation-disspation relations, Chapman-Kolmogorov type Markov integrals...their generalizations, Master equations, Fokker-Planck equations and their fractional realizations while we have the pleasure to drink in all the spoon fed knowledge in flashy-bangy and whizzy platforms

[@petelok9969]

Clear as a bell. Thank you 😊 🙏

[@geor664]

This is superb. You could say it's an above average explanation (pardon the pun).

[@arj123sub]

Very interesting video. Tx for posting

[@JK12345-z]

Amazing！Thanks for sharing your knowledge!

[@pinakibhattacharyya7853]

Any kind of ageing effects feature in the theory of ergodicity economics?

[@alexadamou7039]

Yes. For general wealth dynamics, we can have a situation where some terms dominate at short times and other terms dominate at long times. In effect, the character of the dynamics change over time, which can cause some observables of the model to exhibit ageing. I can't go into detail in a KZbin comment but we will discuss this in our textbook, which should be released later this year. Please keep an eye on ergodicityeconomics.com/lecture-notes/.

[@miguelmendes8102]

Sorry to bother. The example on the green and red balls why is it true that the space average equals 1/2? thanks for your time!

[@alexadamou7039]

The ball fraction converges to a uniform random variable from 0 to 1 (see e.g. sci-hub.se/10.2307/30211982) which has expectation value 1/2. More simply, we can appeal to symmetry: the ball fraction starts at 1/2 and every trajectory has an equally likely trajectory which is its reflection in the line x=1/2. Therefore, the ensemble average must be 1/2.

[@Hank-ry9bz]

11:30 counterexamples in ergodicity

[@timcieplowski2523]

Shouldn't the "Random multiplicative growth" graph (14:20) have at least one of the time-averages be higher than the ensemble-average?

[@alexadamou7039]

You need an exponentially growing number of trajectories to see one of the atypically large ones that lift the ensemble average.

[@timcieplowski2523]

@@alexadamou7039 I don't understand how, after round 600 for example, all of the trajectories can be negative while the ensemble is positive. If it is the case that what you are showing is just a sample of trajectories which make up the ensemble, my point is that it would be more clear for the viewer if at least one is above the ensemble. It could also be that I am still misunderstanding.

[@alexadamou7039]

@@timcieplowski2523 I don't think you are misunderstanding. As I say in the video, the ensemble average is in the limit of infinitely many trajectories. After long enough time, a typical *finite* sample of trajectories, such as the sample shown, will all lie below the ensemble average. To see one atypically lucky trajectory near the ensemble average by the end of the simulation, I would need to have used an exponentially large sample. The message I'm trying to convey is that the ensemble average is not at all reflective of typical long-time behaviour in this model.

[@timcieplowski2523]

@@alexadamou7039 I see. I was getting hung-up thinking that the ensemble slope should be an average of the sample trajectories seen. Thanks for taking the time to reply!

[@kalamaroni]

@@alexadamou7039 I was confused by the same point. Your explanation here makes the example much clearer - I might suggest pinning it to the top of the comments section if possible.

[@hcubill]

What an awesome video very well explained!

[@ABHISHEKGUPTA-bl1pb]

Only one word for the explanation: Wowww.. Great

[@HristosPerhanidis]

14:18 If read line is an aggregate of all other lines, how does it goes up while each path is decaying? Can somebody explain? It seems like overall wealth is decreasing, even in comparison with previous steps

[@skinny32]

Not all the system trajectories are shown > a very small number accelerate to extremely high values while most others gradually approach zero. As a result the arithmetic mean increases but is no representative of performance of most systems.

[@mohamedmouh3949]

so clear thank you so much 🤩🤩🤩

[@alvinjamur1]

absolutely fantastic!!

[@anastasiyalykholat5470]

Nice explanation, who's the author of the paiting in the back?

[@karatsurba4791]

Nice. So, say a system is ergodic, what does that actually tell us about the "problem/research Q" that can used in a useful way ?

[@simonburgess2453]

Great explanation

[@Speak4Yourself2]

Thanks a lot!

[@creepyghoul2163]

Great video

[@mltamarlin]

Thank you very much! Isn't ergodicity usually defined in terms of visiting all of the space, and then equality of space and time averages is derived from that? Where the main difference would just be whether the space can be divided into areas with orbits that stay within them?

[@alexadamou7039]

Yes, sometimes ergodicity defined as you describe. The basic definition I give in section 1 of the talk would be called "mean ergodicity" in some communities. It is the definition we use most often in the EE research programme, because it is simple and adequate for our applications. However, I do discuss exploration of state space - which is the picture commonly used in dynamical systems theory - in the section 2 of the talk, starting at 6:15.

[@pinakibhattacharyya7853]

As per my understanding the concept of "ergodicity" is a statistical mechanical concept where you create replicas of the same system and take an ensemble average and argue that it should be equal to a time average or a trajectory level average (which is what we observe experimentally)...but that there are caveats! Since you can basically equate the response of a system to external perurbations in that framework of trajectory-based averages...then the question of stable averages creeps in which boils down to a convergence of probability measures! The interesting thing then becomes looking for alternatives to the basic a prior notions of ergocity and delve into the realm where non-ergodic behavior is the most observed phenomena. then as somebody from EE background commented what the understand about the problem with regards to some sort of linear-response embedded in theorems like Wiener-Khintchine which relates the Fourier Transform of the power spectral density with the auto-correlation function of the inherent randomness or noise in noisy circuits! There exists generalizations at present which go beyond this linear-response and ergodic Wiener-Khintchine regime and talks about nonergodic behavior or ageing!

[@pinakibhattacharyya7853]

Ergodic control of diffusions is a pretty related and well-researched topic!

[@jaeimp]

Great presentation! Thank you! What is the connection between your 'equation of life' and a Markov chain?

[@Jootawallah]

Excellent video, especially the section on Examples. I have a question about the example of multiplicative growth. I don't understand how all the trajectories can be decreasing but the ensemble average is increasing. What do you mean by an ensemble average here? Is it not just the average over all ensembles at a single time step? Also, does non-ergodicity fundamentally mean that there is a dependence on the initial value, or more largely, on the path?

[@elvispiss]

It is because the exponentially decaying trajectories will never go below 0 - just between 0 and 1. So even if you have a very small amount of trajectories growing exponentially, they will dominate the ensemble average, which is just 1/N * sum{x_i}. I was thinking it would have been easier to see if he included 1 trajectory that grows only exponentially in the figure

[@Jootawallah]

@@elvispiss Ah, if the decreasing trajectories are bounded between 0 and 1, then it makes sense for the average to explode because of an exceptionally high value.

[@--------------------------..]

as I understand it, it's the diffence between arithmetic mean (ensemble average) of 1.05 and geometric mean of sqrt(1.5*0.6)~0.9487. with each repeated play of this game wagering all your wealth, the expeted return moves from the arithmetic mean to the lower geometric mean. In the end, it has a negative expected return as losing 40% half the time would require you to win 66.67% (instead of 50%) half the time to make up for it.

[@seanskinner1672]

Terrific!

[@vaibhavbhasin3861]

Really beautiful explanation. I would love to explore the code of this, is there a course that would help me with simulations ?

[@dziugaschvoinikov4440]

That last question at the end really perplexed me. Could someone provide with an answer? I can’t decipher which one is ensemble average and which one is time average…

[@varbenovk]

Incredibly clear and well-illustrated! Well done! One small remark only: it is a bit distracting you are not looking at the camera. I realize this is easier said than done, as you have a script, but still :) Thanks for sharing!

[@PafLeRenard]

Great !! Thank you !

[@nadyanabahi8259]

best 3 am find ‼️‼️

[@bohdanschatschneider9962]

Perhaps a silly question, but it's not clear to me as to what things can be defined as ergodic. It's stated repeatedly in the lecture that "processes" can be defined as ergodic or not (e.g., pick/adding green and red balls, measuring the position of gas particles in an ensemble/system, flipping of a coin, etc..). But it is never stated if the system used in observing the process is ergodic or not. Can a system be defined as ergodic or not based on the variable/state dependent process that is being observed? Furthermore, can a given system/ensemble be ergodic upon observing one process, but not in observing another?

[@eugeniomazzetti6341]

When are we gettin more videos?:)

[@alexadamou7039]

Two of my colleagues are filming as we speak!

[@eugeniomazzetti6341]

@@alexadamou7039 Thanks:)

[@skalderman]

So if I understand it right, suppose you have elections between 2 candidates win possibility of one candidate is say %55 and gets the % 55 of all votes it is a special case of ergodic process?

[@docoftheworld]

sorry for the dumb question: why in the last example the probability of half it goes above 50% (so 1.5) but down 40% (0.6) and not 50% as well (0.5).

[@mattgunter9674]

Processes that create "structure" or "have memory" are the non-Ergodic ones, correct? While, trajectories that have no structure-creating (or structure-destroying) dynamic tend to be Ergodic. I think An Important Point is that the iNon-Ergodic Processes must be both "Probability-Aware" and "Structure-Aware" in order to avoid an "Error Catastrophe". The mean-reversion example could be considered "structure-aware" once it is past the early phase of large movements. What type of process is probability-aware during this phase? (besides humans?)

[@alexadamou7039]

You might be able to connect ergodicity and non-ergodicity to ideas about structure and memory, depending on how you define those things mathematically. I give some examples of path-dependence in the final section of the talk. However, my main aim here is to stress that ergodicity is actually a very simple concept: are time and ensemble average equal?

[@mattgunter9674]

@@alexadamou7039 This was the best explanation I have ever seen. so, Thank you! It appears that any sensitivity to initial conditions is a sure sign of a non-ergodic process, and also unaccounted for by the naive ergodic assumptions. Perhaps in a future video you can show a counter-example! thx!

[@RafaBld1996]

Fractional brownian motion with hurst exponent 0

[@giorgiotorrieri1893]

Great video. One consideration: The model at minute 13.15 should be A LOT more famous than it is. Call this "an economy". It is primed for growth (a good decision will make you earn more than a bad decision will cost you) and indeed it does grow exponentially But it's all driven by a minority of "repeatedly lucky" that bring the average up while the typical curve goes exponentially to zero!!!!!! Because even in this growth bias everyone's one bad decision away from having nothing. Now, if one adds an if statement to the model, where any curve below 1 would automatically get added a +1 Nearly all curves would grow exponentially Moral of the story....

[@ufukyarsan2149]

just vov great explanation

[@ramit7]

It was brilliant thanks a ton!

[@Vancouverite39]

Thanks very much, I am starting to learn about this important area. May I ask in the final example, what would then be an optimal decision-making strategy when faced with a situation such as in the final example, given that individual repeated trials result in a strong tendency for fortunes to decline over time, despite the ensemble average being positive (profitable)? Are there situations which actually behave as in the final example, but may falsely appear to be ergodic?

[@skalderman]

Ensemble avg caters to the market setter dealing with multiple traders while different trajectories represent buy-sell series of individual traders. I am not sure about what the optimal strategy might be

[@yongmrchen]

For as far as what I understand, it’s like you’re doomed for better or worse on an individual basis, and you’re trapped in the initial condition, i.e., your first move, and as time goes on, it reinforces. I don’t think there is an optimal decision strategy for individuals unless you have an infinite time horizon which allows you to “see” the whole trajectory.

[@BlueSoulTiger]

Another up-vote for the high information quality of the comments. After only 40 of them, I have had all my questions answered. Thank you all

[@roberttommola6541]

You are doing god's work sir.

[@II_superluminal_II]

HOLY SHIT I HAVE NEVER BEEN CONFUSED IN MY LIFE and I can follow Policy Improvement Theorem, I enjoyed the video though. Going to keep at it until I get it

[@danawen555]

讲的很好～非常感谢！

[@irelandrone]

I think it should be the same system but with different trials? Not the different systems?

[@KarinaMitropoulou]

Quiz answer: a, right?

[@alexadamou7039]

There's no right answer. At a deep level, it is a question about our uncertainty. If we know what aspects of an individual mean that a treatment will or will not work, then we can identify which people will and will not benefit. This will look like the second scenario. But when we don't know those things, it will look like the first scenario. Agree?

[@prestonsumner7969]

@@alexadamou7039 Agree... I think. At the level of the immune system it would seem that an individual's dose necessary to prevent the disease would vary over time based on others factors of the immune system's current functioning. On that basis it would seem that over a long enough time span the immune system would find itself unable to produce enough antibodies making it 70% effective in 100% of indviduals.

[@prestonsumner7969]

@@alexadamou7039 I need to also add that this video and the related material from Ole Peters on ergodicity has really opened my eyes to some malpractice in finance and economics. Thank you.

[@prestonsumner7969]

After further thought the best answer (but least likely to be correct) is neither, rather it means that it is 83.7% effective for 83.7% of the people 😉.

[@alexadamou7039]

@@prestonsumner7969 The geometric mean is an important quantity in ergodicity economics!

[@GraemeCox]

I just read your insurance paper and it made a lot of sense but I can’t help wonder that Monte Carlo simulations can ‘prove’ a lot of these concepts that mathematicians struggle to explain with symbolic maths. You showed this in the example at the end of this video. Now we have computers that can do Monte Carlo sims easily and quickly should we move on from symbolic maths to explain/prove/experiment these concepts?

[@alexadamou7039]

I agree that simulation is easy and powerful with modern computers. It's an essential tool, but it's not the whole toolbox. Intuition and analysis are also important.

[@CaptchaSamurai]

Very clear and concise! Thank you ε>. From my pov, the presentation would be clearer if examples would be #2, not #3.

[@DamaKubu]

Jesus christ I love you guys.

[@quantized101]

That's why theoretical physics, like statistical thermodynamics, is considered high science. As they think about these deep concepts much before other subjects catch up on them.

[@gal766]

Last example makes no sense. The ensemble average of infinitely many trajectories is 1*1.5*0.6=0.9!!! a negative trend not a positive one!

[@alvarocarrillo3905]

cómo me gustaría saber más inglés 😟

[@GermanCoder42]

Bro i can't, go to dentist.