Markov Decision Processes Three - Georgia Tech - Machine Learning

[@demidevil666]

This discussion helped me tremendously while writing my Bachelor's thesis. I love the fact that I'm listening to a vivid conversation and not a dry lecture.

[@hassanfarooq7379]

Its best way to learn when there is a funny student there like Michael. Great work!!!

[@Emperorerror]

Could not disagree more with the others here. Having the student helps a lot

[@misterproject8]

Agreed!

[@muhammadrehan4752]

Its a fun way learning. Thumbs up guys. Love from Pakistan :)

[@misterproject8]

In a sense, we do actually just use the present to make decisions. We don't know for certain what happened in the past, we only trust that our memories and records are good enough to represent them.

[@huesOfEverything]

And they had to pass it to me one generation at a TIME because you know - Markov Property :D This guy is just hilarious

[@maba-n3j]

Hi, I am from Russia and I really appreciate how you mentioned Russia! It was really funny))) Thank you for the video!

[@imalive404]

@1:52 the professor tells that the obvious problem with that is if you have to remember everything from beginning of time you are only going to see every state once. Could you please explain it ?? :)

[@_SimpleSam]

+imalive The suggestion is that you remember past states by including them in the current state. Meaning, you would have a super long 'id', a lot of data, to define the current state. The problem with that is the 'state' gets big very quickly, and more importantly, each new state is necessarily unique and 'new' given that the history is infinite and the state definition growing. If that makes any sense :P

[@imalive404]

SimpleSam Thanks man :)

[@_SimpleSam]

imalive Figured you moved on, but I saw it and figured I'd try to help the next digital wanderer :)

[@stanley_george]

If some day I end being a lecturer of comp Sci.. I would definitely use these funny lines about Russians and historians

[@DBBBB]

Am I the only one who found those jokes incredibly funny?

[@hassanfarooq7379]

haha, this is the funniest yet best way to learn.

[@stefantincescu7169]

You waste a lot of time talking to that guy.

[@civilowl965]

Great content but could you get rid of the other guy. He's really annoying and unfunny and unnecessary. Thanks.