Discrete Stochastic Dynamic Programming This textbook by Martin L. Puterman offers an integrated and up-to-date approach to Markov decision processes within discrete time. It focuses on infinite-horizon models and also covers finite horizons and continuous-time models with discrete states. Contents Markov decision processes and discrete stoc