You are here

Markov Decision Processes with Their Applications

Qiying Hu and Wuyi Yue
Publisher: 
Springer
Publication Date: 
2008
Number of Pages: 
297
Format: 
Hardcover
Series: 
Advances in Mechanics and Mathematics 14
Price: 
89.95
ISBN: 
978-0-387-36950-1
Category: 
Monograph
We do not plan to review this book.

List of Figures.- List of Tables.- Preface.- Acknowledgments.- 1. Introduction.- 2. Discrete-Time Markov Decision Processes: Total Reward.- 3. Discrete-Time Markov Decision Processes: Average Criterion.- 4. Continuous-Time Markov Decision Processes.- 5. Semi-Markov Decision Processes.- 6. Markov Decision Processes in Semi-Markov Environments.- 7. Optimal Control of Discrete Event Systems: I. 8. Optimal Control of Discrete Event Systems: II.- 9. Optimal Replacement Under Stochastic Environments.- 10. Optimal Allocation in Sequential Online Auctions.- Index.