Markov Chains Clearly Explained! Part - 1

Let's understand Markov chains and its properties with an easy example. I've also discussed the equilibrium state in great detail.
#markovchain #datascience #statistics
For more videos please subscribe -
bit.ly/normalizedNERD
Markov Chain series -
• Markov Chains Clearly ...
Facebook -
/ nerdywits
Instagram -
/ normalizednerd
Twitter -
/ normalized_nerd

[@NormalizedNerd]

Since many of you are asking about the calculation of left eigenvector (π)...Here are the equations: from πA = π 0.2x + 0.3y + 0.5z = x 0.6x=y 0.2x+0.7y+0.5z=z from π[1]+π[2]+π[3] = 1 x+y+z=1

[@arianakenzie4235]

Dude you should collaborate with @ahmadbazzi

[@putraduha3176]

Thanks man, online school isn't really being nice to my brain

[@dhruvsingla2212]

Hey, can you also tell how to code moving from one state to another based on probability? Like you did a random probability walk, how did the code decide which state to go to using probability.

[@NormalizedNerd]

@@dhruvsingla2212 I think you are looking for this video: kzbin.info/www/bejne/fWipeoRvm72fbLc

[@dhruvsingla2212]

@@NormalizedNerd Great, thanks 👍

[@nshiba]

This is sooo easy to understand. I took atleast a month to learn this about 25 yrs back for my masters thesis work when I first learnt this subject. Now, I thought of revisiting this topic for my daughter's higher secondary project. 25 years have really brought a topic from masters to secondary school level and months of learning to a few minutes of a well prepared video. Thanks to your channel, KZbin, Internet and technology in general. 🙏

[@NormalizedNerd]

Thanks a lot for sharing your experience. It really feels nice to read such comments. I'm glad have to have a platform like this.

[@Fresh_Career_Compass]

Which institute is teaching this in secondary level.plz provide syllabus link .i am redesigning a syllbus

[@Nuur_Rajput]

​@@Fresh_Career_Compass yea. I'm curious too

[@_rd_kocaman]

where the heck does this studied in high school?

[@nshiba]

Sorry I missed all your comments. Markov Chains is one of the IA (Internal Assessment) topics to choose from for the HL (Higher level ?) Mathematics for IB (International Baccalaureate Diploma) programme ( which is higher secondary school level - Year 11 and Year 12) in Singapore. You can Google to find the details with the above information.

[@DawgFL]

Thanks dude. It takes a whole nother level of intelligence to be able to break down a concept like this so anyone can understand it. I'm learning markov chains in class right now and when the professor teaches it it literally looks like an alien language to me, i almost broke down because i might fail the class. but im going to watch all ur videos and itll help me a lot.

[@NormalizedNerd]

Thanks a lot mate!

[@joemaxwell8361]

Got way more excited than I should have when I thought "hmm, that kinda looks like the eigen vectors..." AND THEN IT WAS.

[@NormalizedNerd]

Haha...

[@dnbhattacharya343]

Holy crap we are nerdy.

[@counter-thought2226]

This is a lifesaver. I started a stochastics class last week with an almost nonexistent background in probability. I was completely troubled at first but after watching this video and reading through some course material, I can actually understand the exercises. Thank you.

[@angrybruce8262]

Mate, that is a good explanation! The only problem is that now I AM HUNGRY:)

[@NormalizedNerd]

Haha XD

[@69erthx1138]

After burgers, Will took Skulyer for pizza, then give her a night cap with his hot dog.

[@2highbruh]

@@69erthx1138 oh, okay, good for him

[@themathskompanyap4730]

Subscribe for more such Markov chain concepts friends. kzbin.info/www/bejne/mJyWfp13eJ6Eqbs

[@muhammadihsan6645]

Woowww , human being human

[@ishankaul9065]

Great explanation! A full series on the different types of Markov chains with explanations like this would be awesome.

[@NormalizedNerd]

I'll try to work on this

[@themathskompanyap4730]

Subscribe for more such Markov chain concepts friends. kzbin.info/www/bejne/mJyWfp13eJ6Eqbs

[@karlrombauts4909]

This is such a fantastic video. It makes all the concepts very easy to understand without skipping important technical details. Thank you for making such a great resource!

[@willbutplural]

Wow great explanation that includes terminology, stationary states, and connections between adjacency matrices, directed graphs, and markov chains 👍 A+ thank you!

[@gameboardgames]

This video was really well constructed and interesting, in equal measure to being informative! Thank you Mr Nerd!

[@michaella5110]

you have no clue how much you helped a bunch of online MS Analytics students. Thank you so much!

[@NormalizedNerd]

I'm so happy to hear this!!

[@aromalas5713]

Omg man this is such a great explanation. Loved the presentation, the animation and everything about it. Keep going!

[@dieserhugo2960]

Jeez, if my professor had introduced Markov chains like this instead of spending multiple lectures talking about Google's page-rank system without any goal in mind, I would've saved myself a lot of confusion. Thank you!

[@karannchew2534]

Note for my future revision. Markov Chain models a system that changes its status. One important rule: the next status of the system only depends on its current status. Status = serve pizza, serve burger or serve hotdog = x, y, z = Connected, Disconnected, Terminated, Active Markov chain can be drawn as a state diagram. Or written as a transition matrix. State diagram represents all possible status and associated probabilities. Transition matrix = represent the state diagram = probability from one state to another = A At equilibrium, the probabilities of the next status doesn't change any more. The probability of state at equilibrium = Stationary Distribution. Let's call such equilibrium probability π. Aπ = π π = Eigenvector of the matrix = Probabilities of each status the system could be in, assuming equilibrium stage. Using two equations: A) Aπ = π B) sum of probability is 1, we can work out the value of π, i.e. the equilibrium probability Alternatively, run a simulation. A: Do all Markov Chain have a equilibrium state? Q: Don't know... Need to study more to find out... Q: Can I use Subscriber Status to as the hidden state? A: Yes. But if the status is known, then it's better to use it as the Observation states. Q: Can I "model" next status to be only depending on the current status? But then the next status actually also depend on the previous status, this seems contradictory. A: Yes, I can. At per state level, the next status only depends on the current status. But the at the system level and at equilibrium, it "depends" on both the current and the previous state, because the current states had been "affected" by the previous states.

[@Ceratops17]

hii, maybe if you still need the answer. You can prove that an ergodic Markov chain, so a chain where all states communicate with each other and it’s aperiodic (gcd is 1) always has an equilibrium state.

[@chaityashah4221]

dont know if you revised it , but i surely did a revision

[@bubblewrap55]

Good explanation, they never covered why am I calculating eigen values in high school, loved how that path and random walk converged in the end.

[@NormalizedNerd]

Thanks!! Yeah...they teach stuffs without their applications :(

[@abc4924]

You guys calculate eigenvalues at High school? Great!

[@manishmayank4199]

@@abc4924 my reaction was same...I studied eigenvalues in my 2nd semester of college

[@IshanBanerjee]

I was trying to understand Evolution algebras and for that I needed idea of Markov chains. Beautifully explained. Thank you so much.

[@akhilgoenka6817]

Found this awesome channel today. Fantastic visuals & crystal clear explanation. Subscribed!

[@theelysium1597]

This is a great video! I am currently having Linear Algebra II and Probability (2 separat courses) and this video perfectly connected them :) thank you!

[@NormalizedNerd]

Glad to hear that :D

[@rommix0]

This is so cool. I'm getting into machine learning, and videos like these are extremely help. I've only really come across HMM for its historic use in Speech Recognition.

[@opencode69]

While i was trying to understand this i avoided complex terms the best i can but with this video i have no need to try avoiding it because of the thorough explanation typing this 2 years later the "whats up people of the future" really got me

[@rebeccacarroll8385]

This is the best video ever. Seriously, I was ripping my hair about these concepts and this bridges each point beautifully.

[@traderrider09]

That was one of the smoothest explanations i ever came across !

[@umarkhan-hu7yt]

You make it clear and more intuitive. Thanks

[@johnperkins6550]

I am just starting to learn this. The best explanation of all the videos I have seen.. Very understandable. And there is the application to Python and Data Science as BONUS! I am subscribed and I want to see all of the videos now!!!

[@jiangxu3895]

Dude, this is the first time I get the idea of Markov chain. Thanks a lot!!!

[@lowerbound4803]

Very well-explained, appreciate your effort. Thank you for making this.

[@pemessh]

You sir, just earned a subscriber. These kinds of quality videos and great explanation is what we love. Thank you. Best wishes from Nepal.

[@NormalizedNerd]

Thanks and welcome to normalized nerd :)

[@themathskompanyap4730]

Subscribe for more such Markov chain concepts friends. kzbin.info/www/bejne/mJyWfp13eJ6Eqbs

[@chloewei768]

Awesome explanation!! It is so beginner friendly and I love it!! Thank you! and look forward to seeing more content from you!!

[@NormalizedNerd]

Definitely...More videos are coming!

[@wakabaka777]

Wonderful explanation! I love this visualization

[@anubhavyadav4279]

You made it look so simple! Amazing man!

[@dr-x-robotnik]

This tutorial helped me with my NLP project on part-of-speech-tagging. Thank you very much!

[@NormalizedNerd]

Glad it helped!

[@XiaohanGao]

Informative and super clear!!! Thx!

[@mariusbaur6765]

thanks a lot! incredible how you can explain a difficult topic in such an easy way!

[@mamotivated]

Great content, thanks for sharing. Your education is helping lots of people. Keep going.

[@how_about_naw]

Dude, you need to add a thanks button and let us buy you a coffee.

[@manim4434]

Thank you so much, I really needed it and your video and great explanation and method helped so much.

[@bhushanakerkar6441]

excellent explanation. Just too good to be true. You have made an esoteric subject so simple

[@MrRaja]

Thanks for the explanation. It's starting to make sense. Little by little.

[@franciss.fernandez7581]

This was an amazing video. You're an outstanding instructor!

[@NormalizedNerd]

Wow, thank you!

[@JackMenendez]

Wow, thank you. Why was this so hard for me back in the day? Great job.

[@ralphvonchunjo]

Thanks from the future! Great explanation, outstanding instructor!

[@3munchenman]

You explained it to me like I am 5 years old. And that is what I needed. Thank you!

[@emrullahcelik7704]

Very concise explanation. Thank you.

[@casestudy3167]

very well explained. thank you for making this video

[@aftabasir7933]

Well made and well visualized. Good job.

[@KN-ls9rq]

woah, that was an awesome video man! I think i'll be watching your videos just for fun too! keep doing what you do 👍

[@yashshah4182]

What a great introduction to Markov Chains! Thank you, it was really helpful

[@taquakhairysaeed1771]

wow this is the best technical video i have ever seen!! Well done!

[@JeffLuntGames]

Cool video - watching the whole series now.

[@nicholasadegbe4629]

I covered just 2 minutes of this and I'm so excited!!!

[@NormalizedNerd]

:D

[@AnupKumar-nz2qq]

It's a very nice video to understand the Markov chain model in a simplified way. Please make more such videos on the Markov model and stochastic process.

[@piotrgorczyca5548]

5:24 I feel you bro, recording entire audio and then finding out about the mistake just at the editing ... I did the same, just cut words from other parts of the recording and put them to create a sentence... Thanks for the video btw, very nice.

[@NormalizedNerd]

Exactly bro :/

[@rg31222]

So true...so much time and effort goes into creating any content especially audio and video...great video and great channel.

[@georgeiskander2458]

Really awesome. I never understood this topic as easily as you did.................. Thanks

[@aydnaydin9109]

perfect explanation.. everybody can understand. this video may be the easiest explanation for this topic. THANK YOU !!!

[@jeevanmarg]

Excellent demonstration. Really helpful. Thank you.

[@NormalizedNerd]

Thanks!

[@rishikambhampati2862]

Hello, Thanks for the wonderful explanation. I have a naive question though, how did we arrive at the adjacency matrix and directed graph with probabilities in the first place? Is it from observations or domain knowledge(in this case, will restaurant give us the probabilities)?

[@naageshk1256]

Great explanation . Thank you so much ..

[@Life_42]

Thank you greatly! You're a great educator!

[@pratikshakharat8644]

Yes yes we want more with such interesting examples

[@traj250]

Awesome video. Undergad student that really appreciates this simplification

[@lucasqwert1]

Thank you only one thing I didn't get after πA = π and sum of probability is 1, how do we calculate the stationary state as π =[25/71 15/ 71 31/71 ] ?

[@marclennardcolina6033]

Great Explanation. Learned a lot from these! I would also like to ask for permission to cite your examples in a report I'm about to make in my masters class.

[@NormalizedNerd]

Yes, absolutely. Best of luck for your report :D

[@joaopinto415]

You saved my life! Thank you very much!

[@Reigatsu]

Great video! As a physics graduate, it’s honestly surprising how often eigenvalues and eigenvector keep showing up in what I do!

[@n-panda921]

ya! and you can really think this in terms of quantum mechanics too, I like all these connections

[@ihateyourusernames]

Awesome video. Great presentation, clear explanation, and plenty of areas to grow from here. Thanks very much. Sub'd and looking forward to more content!

[@panpeter7879]

Have to say this is a very very helpful video for understanding MCMC 🎉🎉🎉

[@capszabidin9219]

Perfect explanation, thanks!

[@zinniye]

This helped me so much! Thank you!

[@NormalizedNerd]

Glad to hear that!

[@estelitaribeiro4196]

Perfect explanation!! Thanks!!

[@eventhisidistaken]

Thank you, this was very helpful. If you decide to expand on the video, the one thing that was not immediately clear to me, was *why* pi represents the stationary state probabilities. I had to write out the probability equations for that to become clear.

[@NormalizedNerd]

Thanks for this feedback :D

[@RamakrishnanRukmini]

That is the value reached by the system finally. No more variation. End state values. Hence stationary state.

[@sinaghafouri2612]

Awesome video. Thanks!

[@yxu2973]

wonderful, amazing video !

[@saadali4797]

a great video to understand the topic easily

[@qqyerik38]

Impressive video! Helped me a lot!!

[@kmunson007]

Fantastic video. Very easy decision to subscribe!

[@Dubai_life_]

Thank you very much. More videos please.

[@sumers9396]

perfectly explained, thank you!!

[@abdelkaderbenzirar5795]

Thank you so much for this great work👏🤝

[@happyduck70]

3:35 I wish my days were like this, such beautiful music while walking and eating unhealthy food

[@huitv1]

Very clear explanation, well done! ty

[@NormalizedNerd]

Glad you enjoyed it!

[@chriswil8252]

Helpful. Honestly it’s too helpful.

[@chuanyu8813]

Amazing, I like those beautiful pictures of food to explain Markov Chain!

[@lucasaimaretto3725]

Very clear explanation! thank you!

[@NormalizedNerd]

Thanks dude!

[@chaimaaelkasbaji]

Great Explanation.

[@praneetkumarpatra2661]

my mind is blown!!! evry new thing that was covered in my course in the last 1 month just got used here!!!

[@NormalizedNerd]

Haha...don't you like when that happens 😍

[@GhosT-sd6ji]

Lovely explanation and very clear in a simple way, would love to see more of these!

[@NormalizedNerd]

More to come!

[@Eyenn_n]

Great to see you, prison mike! :D

[@GhosT-sd6ji]

@@Eyenn_n Haha, a pleasure!

[@dhanushp1680]

scranton branch is on fire

[@volckerrules942]

Great video! Thanks!

[@user-fw2kc6iv1f]

good bro,you make me understand Markov model

[@ciberman]

"Please pause the video if you need a moment to convince yourself" What kind of 3blue1brown is that?!

[@techie1143]

Very good explanation with clarity. It will be greatly appreciated if you could include the script of these videos.

[@AaronCarlsson]

Great explanation, please make more videos that go into greater depth.

[@aipaperreader]

Life saver video 👍 prerequisite to understand markov regime switching model in econometrics

[@palamalama]

Really good video! Thanks for the explanation

[@oliverrainer5771]

Great work!

[@jackfitzgerald6604]

Superb video! Thank you :)

[@shilpask9601]

great way to explaining sir tq so much...!!

[@vatsaldabhi1145]

Superb Explanation. Learned a lot from these!

[@NormalizedNerd]

Glad it helped!

[@kiranmaikiranmai8972]

Very Helpful , Please make more videos

[@vishaljain4915]

Very clear explanation!

[@vinx3078]

I'm here from ddlc and I could not understand a thing until I saw this video. Dude is the most helpful guy on this site

[@NormalizedNerd]

So nice to hear that!