You are here

Continuous-Time Markov Chains and Applications: A Two-Time-Scale Approach

Edition: 
2
Publisher: 
Springer
Number of Pages: 
427
Price: 
129.00
ISBN: 
9781461443452
Date Received: 
Friday, November 30, 2012
Reviewable: 
No
Include In BLL Rating: 
No
G. George Yin and Qing Zhang
Series: 
Stochastic Modelling and Applied Probability 37
Publication Date: 
2013
Format: 
Hardcover
Category: 
Monograph

Prologue and Preliminaries: Introduction and overview- Mathematical preliminaries.- Markovian models.- Two-Time-Scale Markov Chains: Asymptotic Expansions of Solutions for Forward Equations.- Occupation Measures: Asymptotic Properties and Ramification.- Asymptotic Expansions of Solutions for Backward Equations.- Applications:MDPs, Near-optimal Controls, Numerical Methods, and LQG with Switching: Markov Decision Problems.- Stochastic Control of Dynamical Systems.- Numerical Methods for Control and Optimization.- Hybrid LQG Problems.- References.- Index.

Publish Book: 
Modify Date: 
Friday, November 30, 2012

Dummy View - NOT TO BE DELETED