Markov Chains Clearly Explained! Part - 1

Let's understand Markov chains and its properties with an easy example. I've also discussed the equilibrium state in great detail.
#markovchain #datascience #statistics
For more videos please subscribe -
bit.ly/normaliz...
Markov Chain series -
• Markov Chains Clearly ...
Facebook -
/ nerdywits
Instagram -
/ normalizednerd
Twitter -
/ normalized_nerd

[@NormalizedNerd]

Since many of you are asking about the calculation of left eigenvector (π)...Here are the equations: from πA = π 0.2x + 0.3y + 0.5z = x 0.6x=y 0.2x+0.7y+0.5z=z from π[1]+π[2]+π[3] = 1 x+y+z=1

[@arianakenzie4235]

Dude you should collaborate with @ahmadbazzi

[@putraduha3176]

Thanks man, online school isn't really being nice to my brain

[@dhruvsingla2212]

Hey, can you also tell how to code moving from one state to another based on probability? Like you did a random probability walk, how did the code decide which state to go to using probability.

[@NormalizedNerd]

@@dhruvsingla2212 I think you are looking for this video: kzbin.info/www/bejne/fWipeoRvm72fbLc

[@dhruvsingla2212]

@@NormalizedNerd Great, thanks 👍

[@nshiba]

This is sooo easy to understand. I took atleast a month to learn this about 25 yrs back for my masters thesis work when I first learnt this subject. Now, I thought of revisiting this topic for my daughter's higher secondary project. 25 years have really brought a topic from masters to secondary school level and months of learning to a few minutes of a well prepared video. Thanks to your channel, KZbin, Internet and technology in general. 🙏

[@NormalizedNerd]

Thanks a lot for sharing your experience. It really feels nice to read such comments. I'm glad have to have a platform like this.

[@NSFWrated]

Which institute is teaching this in secondary level.plz provide syllabus link .i am redesigning a syllbus

[@Nuur_Rajput]

​@@NSFWrated yea. I'm curious too

[@_rd_kocaman]

where the heck does this studied in high school?

[@nshiba]

Sorry I missed all your comments. Markov Chains is one of the IA (Internal Assessment) topics to choose from for the HL (Higher level ?) Mathematics for IB (International Baccalaureate Diploma) programme ( which is higher secondary school level - Year 11 and Year 12) in Singapore. You can Google to find the details with the above information.

[@counter-thought2226]

This is a lifesaver. I started a stochastics class last week with an almost nonexistent background in probability. I was completely troubled at first but after watching this video and reading through some course material, I can actually understand the exercises. Thank you.

[@michaella5110]

you have no clue how much you helped a bunch of online MS Analytics students. Thank you so much!

[@NormalizedNerd]

I'm so happy to hear this!!

[@DawgFL]

Thanks dude. It takes a whole nother level of intelligence to be able to break down a concept like this so anyone can understand it. I'm learning markov chains in class right now and when the professor teaches it it literally looks like an alien language to me, i almost broke down because i might fail the class. but im going to watch all ur videos and itll help me a lot.

[@NormalizedNerd]

Thanks a lot mate!

[@ImJoegath]

Got way more excited than I should have when I thought "hmm, that kinda looks like the eigen vectors..." AND THEN IT WAS.

[@NormalizedNerd]

Haha...

[@dnbhattacharya343]

Holy crap we are nerdy.

[@fpartidafpartida]

@@dnbhattacharya343I came here to try to understand Markov chains, after a mathematician Dr. casually mentioned them during an AI talk. I completely get the concept now, but I could not actually perform any of the equations. Does that still count as being nerdy for me? 🧐

[@angrybruce8262]

Mate, that is a good explanation! The only problem is that now I AM HUNGRY:)

[@NormalizedNerd]

Haha XD

[@69erthx1138]

After burgers, Will took Skulyer for pizza, then give her a night cap with his hot dog.

[@2highbruh]

@@69erthx1138 oh, okay, good for him

[@themathskompanyap4730]

Subscribe for more such Markov chain concepts friends. kzbin.info/www/bejne/mJyWfp13eJ6Eqbs

[@muhammadihsan6645]

Woowww , human being human

[@ishankaul9065]

Great explanation! A full series on the different types of Markov chains with explanations like this would be awesome.

[@NormalizedNerd]

I'll try to work on this

[@themathskompanyap4730]

Subscribe for more such Markov chain concepts friends. kzbin.info/www/bejne/mJyWfp13eJ6Eqbs

[@bubblewrap55]

Good explanation, they never covered why am I calculating eigen values in high school, loved how that path and random walk converged in the end.

[@NormalizedNerd]

Thanks!! Yeah...they teach stuffs without their applications :(

[@abc4924]

You guys calculate eigenvalues at High school? Great!

[@manishmayank4199]

@@abc4924 my reaction was same...I studied eigenvalues in my 2nd semester of college

[@LucasSteinberger-g9d]

This video is literally perfect as an instructional. It has a limited scope, and everything it shows feels obvious and related to what was just shown previously. Thanks for the good work!

[@pemessh]

You sir, just earned a subscriber. These kinds of quality videos and great explanation is what we love. Thank you. Best wishes from Nepal.

[@NormalizedNerd]

Thanks and welcome to normalized nerd :)

[@themathskompanyap4730]

Subscribe for more such Markov chain concepts friends. kzbin.info/www/bejne/mJyWfp13eJ6Eqbs

[@karannchew2534]

Note for my future revision. Markov Chain models a system that changes its status. One important rule: the next status of the system only depends on its current status. Status = serve pizza, serve burger or serve hotdog = x, y, z = Connected, Disconnected, Terminated, Active Markov chain can be drawn as a state diagram. Or written as a transition matrix. State diagram represents all possible status and associated probabilities. Transition matrix = represent the state diagram = probability from one state to another = A At equilibrium, the probabilities of the next status doesn't change any more. The probability of state at equilibrium = Stationary Distribution. Let's call such equilibrium probability π. Aπ = π π = Eigenvector of the matrix = Probabilities of each status the system could be in, assuming equilibrium stage. Using two equations: A) Aπ = π B) sum of probability is 1, we can work out the value of π, i.e. the equilibrium probability Alternatively, run a simulation. A: Do all Markov Chain have a equilibrium state? Q: Don't know... Need to study more to find out... Q: Can I use Subscriber Status to as the hidden state? A: Yes. But if the status is known, then it's better to use it as the Observation states. Q: Can I "model" next status to be only depending on the current status? But then the next status actually also depend on the previous status, this seems contradictory. A: Yes, I can. At per state level, the next status only depends on the current status. But the at the system level and at equilibrium, it "depends" on both the current and the previous state, because the current states had been "affected" by the previous states.

[@Ceratops17]

hii, maybe if you still need the answer. You can prove that an ergodic Markov chain, so a chain where all states communicate with each other and it’s aperiodic (gcd is 1) always has an equilibrium state.

[@chaityashah4221]

dont know if you revised it , but i surely did a revision

[@blackbocks]

"Using two equations: A) Aπ = π B) sum of probability is 1" Do you mean πA since we can't do Aπ?

[@Octane09]

That was one of the smoothest explanations i ever came across !

[@opencode69]

While i was trying to understand this i avoided complex terms the best i can but with this video i have no need to try avoiding it because of the thorough explanation typing this 2 years later the "whats up people of the future" really got me

[@rebeccacarroll8385]

This is the best video ever. Seriously, I was ripping my hair about these concepts and this bridges each point beautifully.

[@wakabaka777]

Wonderful explanation! I love this visualization

[@piotrgorczyca5548]

5:24 I feel you bro, recording entire audio and then finding out about the mistake just at the editing ... I did the same, just cut words from other parts of the recording and put them to create a sentence... Thanks for the video btw, very nice.

[@NormalizedNerd]

Exactly bro :/

[@rg31222]

So true...so much time and effort goes into creating any content especially audio and video...great video and great channel.

[@georgewhichello4708]

@@NormalizedNerd 8:13 you say 46% instead of 43% also

[@karlrombauts4909]

This is such a fantastic video. It makes all the concepts very easy to understand without skipping important technical details. Thank you for making such a great resource!

[@how_about_naw]

Dude, you need to add a thanks button and let us buy you a coffee.

[@willbutplural]

Wow great explanation that includes terminology, stationary states, and connections between adjacency matrices, directed graphs, and markov chains 👍 A+ thank you!

[@jiangxu3895]

Dude, this is the first time I get the idea of Markov chain. Thanks a lot!!!

[@RichardVaught]

This was a good explanation, with one exception. There is a REASON that pi can used, and why pi is used. I know that most mathematicians take the connection between frequency and pi for granted, but a lot of folks really don't have an intuition regarding that.

[@IshanBanerjee]

I was trying to understand Evolution algebras and for that I needed idea of Markov chains. Beautifully explained. Thank you so much.

[@lyzhenyang2982]

This is so clear I love you for the rest of my life. I swear half of my tuition fees should go to you and 3b1b.

[@Julian-tf8nj]

the pronunciation of "pizza" that sounds like the town of "Pisa" cracks me up (I'm an Italian speaker)... but the explanations are superbly clear and helpful, thanks! 😁

[@theelysium1597]

This is a great video! I am currently having Linear Algebra II and Probability (2 separat courses) and this video perfectly connected them :) thank you!

[@NormalizedNerd]

Glad to hear that :D

[@XiaohanGao]

Informative and super clear!!! Thx!

[@3munchenman]

You explained it to me like I am 5 years old. And that is what I needed. Thank you!

[@shrur3527]

Tq so much🙏🙏❤️❤️

[@annabaannaba6994]

Very vice tutorial and Excellent video

[@aromalas5713]

Omg man this is such a great explanation. Loved the presentation, the animation and everything about it. Keep going!

[@Reigatsu]

Great video! As a physics graduate, it’s honestly surprising how often eigenvalues and eigenvector keep showing up in what I do!

[@n-panda921]

ya! and you can really think this in terms of quantum mechanics too, I like all these connections

[@praneetkumarpatra2661]

my mind is blown!!! evry new thing that was covered in my course in the last 1 month just got used here!!!

[@NormalizedNerd]

Haha...don't you like when that happens 😍

[@gameboardgames]

This video was really well constructed and interesting, in equal measure to being informative! Thank you Mr Nerd!

[@ciberman]

"Please pause the video if you need a moment to convince yourself" What kind of 3blue1brown is that?!

[@giovanniberardi4134]

You're an excellent teacher👍

[@Kosake82]

@7:45 "Please pause the video if you need a moment to convince yourself." That gave me a good laugh for some reason.😄

[@georgeiskander2458]

Really awesome. I never understood this topic as easily as you did.................. Thanks

[@akhilgoenka6817]

Found this awesome channel today. Fantastic visuals & crystal clear explanation. Subscribed!

[@vinx3078]

I'm here from ddlc and I could not understand a thing until I saw this video. Dude is the most helpful guy on this site

[@NormalizedNerd]

So nice to hear that!

[@dr-x-robotnik]

This tutorial helped me with my NLP project on part-of-speech-tagging. Thank you very much!

[@NormalizedNerd]

Glad it helped!

[@Elara_momentum]

Thanks!

[@muhammadwaseem_]

Fell in love with your channel and content quality....

[@NormalizedNerd]

Thank you for your kind words :D

[@johnperkins6550]

I am just starting to learn this. The best explanation of all the videos I have seen.. Very understandable. And there is the application to Python and Data Science as BONUS! I am subscribed and I want to see all of the videos now!!!

[@taquakhairysaeed1771]

wow this is the best technical video i have ever seen!! Well done!

[@happyduck70]

3:35 I wish my days were like this, such beautiful music while walking and eating unhealthy food

[@aydnaydin9109]

perfect explanation.. everybody can understand. this video may be the easiest explanation for this topic. THANK YOU !!!

[@ratchanonsupakit4375]

Too good! Got baited from the food snapshot, but the content inside is superb.

[@NormalizedNerd]

Haha…Thanks mate!

[@umarkhan-hu7yt]

You make it clear and more intuitive. Thanks

[@pujasangwan8008]

Fantastic explanations with the help of daily life examples.thank you a lot

[@bhushanakerkar6441]

excellent explanation. Just too good to be true. You have made an esoteric subject so simple

[@avasaralavivekaditya1981]

At 2:43 , how did we get 0.7

[@argish]

dude when that voice over said "a directed graph" I legit thought some alien invaded my room 💀

[@JackMenendez]

Wow, thank you. Why was this so hard for me back in the day? Great job.

[@AnupKumar-nz2qq]

It's a very nice video to understand the Markov chain model in a simplified way. Please make more such videos on the Markov model and stochastic process.

[@Elias-hk9sc]

Wonderful Video. It was perfect to get a simple overview on markov chains.

[@marclennardcolina6033]

Great Explanation. Learned a lot from these! I would also like to ask for permission to cite your examples in a report I'm about to make in my masters class.

[@NormalizedNerd]

Yes, absolutely. Best of luck for your report :D

[@pratikshakharat8644]

Yes yes we want more with such interesting examples

[@casestudy3167]

very well explained. thank you for making this video

[@yashshah4182]

What a great introduction to Markov Chains! Thank you, it was really helpful

[@ralphvonchunjo]

Thanks from the future! Great explanation, outstanding instructor!

[@chriswil8252]

Helpful. Honestly it’s too helpful.

[@MrRaja]

Thanks for the explanation. It's starting to make sense. Little by little.

[@muhtasirimran]

1:05 I would like to think it reverse as we are people from future. If I know what they are serving tomorrow, I can predict what they are serving today

[@Life_42]

Thank you greatly! You're a great educator!

[@panpeter7879]

Have to say this is a very very helpful video for understanding MCMC 🎉🎉🎉

[@vishaljain4915]

Very clear explanation!

[@ashfvt7712]

You are making me hungry😂. This was a great video. The presentation was very neat.

[@aftabasir7933]

Well made and well visualized. Good job.

[@JeffLuntGames]

Cool video - watching the whole series now.

[@manim4434]

Thank you so much, I really needed it and your video and great explanation and method helped so much.

[@capsizabidin31]

Perfect explanation, thanks!

[@mamotivated]

Great content, thanks for sharing. Your education is helping lots of people. Keep going.

[@naimahersy3966]

After watching this video. Nerd has been normalized. Amazing 😊

[@NormalizedNerd]

he he

[@KN-ls9rq]

woah, that was an awesome video man! I think i'll be watching your videos just for fun too! keep doing what you do 👍

[@dieserhugo2960]

Jeez, if my professor had introduced Markov chains like this instead of spending multiple lectures talking about Google's page-rank system without any goal in mind, I would've saved myself a lot of confusion. Thank you!

[@estelitaribeiro4196]

Perfect explanation!! Thanks!!

[@joaopinto415]

You saved my life! Thank you very much!

[@huitv1]

Very clear explanation, well done! ty

[@NormalizedNerd]

Glad you enjoyed it!

[@franciss.fernandez7581]

This was an amazing video. You're an outstanding instructor!

[@NormalizedNerd]

Wow, thank you!

[@emrullahcelik7704]

Very concise explanation. Thank you.

[@chloewei768]

Awesome explanation!! It is so beginner friendly and I love it!! Thank you! and look forward to seeing more content from you!!

[@NormalizedNerd]

Definitely...More videos are coming!

[@aliman5827]

Oh God this was the series I actually needed! tnx bro!!!

[@NormalizedNerd]

Thanks mate!

[@floriantschelisnig2332]

Thanks, after watching this video my university skript makes now much more sense.

[@NormalizedNerd]

Very happy to hear that!

[@theodoresweger4948]

I watched the movie "Beautiful Mind'" and the random walk comes to mind, I found this quite interesting along with the Ignamac macine the Germans used and how it was the code was finally broken, and the consequences of giving away the code was broken and how that would effect WWII.

[@saadali4797]

a great video to understand the topic easily

[@sharadchandakacherla8268]

this video made me subscribe to the channel. simplicity always wins

[@cathlinbarki224]

it amazes me still that how youtube can teaches me more than my own college teacher :))

[@xaviermagnus8310]

KZbin is bigger and has smarter people in the end.

[@naageshk1256]

Great explanation . Thank you so much ..

[@clashwithdheeraj1599]

just like a wow explanation

[@jeevanmarg]

Excellent demonstration. Really helpful. Thank you.

[@NormalizedNerd]

Thanks!

[@kmunson007]

Fantastic video. Very easy decision to subscribe!

[@traj250]

Awesome video. Undergad student that really appreciates this simplification

[@anubhavyadav4279]

You made it look so simple! Amazing man!

[@zinniye]

This helped me so much! Thank you!

[@NormalizedNerd]

Glad to hear that!

[@zoltanmisley666]

"Please pause for a second to convince yourself" dude... that's just straight up savage

[@HankusMaximus]

You have a gift for teaching

[@NormalizedNerd]

Thank you mate :)

[@nicholasadegbe4629]

I covered just 2 minutes of this and I'm so excited!!!

[@NormalizedNerd]

:D

[@udayagnihotri2702]

Great explanation

[@chaimaaelkasbaji]

Great Explanation.