Markov Decision Processes for Planning under Uncertainty (Cyrill Stachniss)

[@abhinavgupta9990]

Absolutely marvellous introduction, Professor. Thank you so much for these insightful lectures.

[@TheProblembaer2]

Thank you!

[@michaellosh1851]

Great introduction!

[@vvyogi]

23:27 Very helpful explanation. 1 Question : Will discounting affect the behavior that we observe here? Will the agent prefer a faster, although riskier, route?

[@CyrillStachniss]

It will affect the behavior. The agent will prefer policies that lead to rewards being obtained earlier in time (they can be but are not necessarily more risky).

[@oldcowbb]

does mdp work for continuous states and continuous action? like work on R^2 plane instead of a finite grid

[@dushkoklincharov9099]

Why not just move the charging station to the upper left corner :D Great lecture btw

[@oldcowbb]

your boss is gonna give you really big negative reward for changing the infrastructure