Oregon

Markov Decision Processes: Discrete Stochastic Dynamic Programming (Wiley

Description: The past decade has seen considerable theoretical and applied research on Markov decision processes, as well as the growing use of these models in ecology, economics, communications engineering, and other fields where outcomes are uncertain and sequential decision-making processes are needed. A timely response to this increased activity, Martin L. Puterman's new work provides a uniquely up-to-date, unified, and rigorous treatment of the theoretical, computational, and applied research on Markov decision process models. It discusses all major research directions in the field, highlights many significant applications of Markov decision processes models, and explores numerous important topics that have previously been neglected or given cursory coverage in the literature. Markov Decision Processes focuses primarily on infinite horizon discrete time models and models with discrete time spaces while also examining models with arbitrary state spaces, finite horizon models, and continuous-time discrete state models. The book is organized around optimality criteria, using a common framework centered on the optimality (Bellman) equation for presenting results. The results are presented in a "theorem-proof" format and elaborated on through both discussion and examples, including results that are not available in any other book. A two-state Markov decision process model, presented in Chapter 3, is analyzed repeatedly throughout the book and demonstrates many results and algorithms. Markov Decision Processes covers recent research advances in such areas as countable state space models with average reward criterion, constrained models, and models with risk sensitive optimality criteria. It alsoexplores several topics that have received little or no attention in other books, including modified policy iteration, multichain models with average reward criterion, and sensitive optimality. In addition, a Bibliographic Remarks section in each chapter comments on relevant historical references in the book's extensive, up-to-date bibliography...numerous figures illustrate examples, algorithms, results, and computations...a biographical sketch highlights the life and work of A. A. Markov...an afterword discusses partially observed models and other key topics...and appendices examine Markov chains, normed linear spaces, semi-continuous functions, and linear programming. Markov Decision Processes will prove to be invaluable to researchers in operations research, management science, and control theory. Its applied emphasis will serve the needs of researchers in communications and control engineering, economics, statistics, mathematics, computer science, and mathematical ecology. Moreover, its conceptual development from simple to complex models, numerous applications in text and problems, and background coverage of relevant mathematics will make it a highly useful textbook in courses on dynamic programming and stochastic control.

Price: 203 AUD

Location: Hillsdale, NSW

End Time: 2025-02-10T03:13:02.000Z

Shipping Cost: 24.61 AUD

Product Images

Markov Decision Processes: Discrete Stochastic Dynamic Programming (WileyMarkov Decision Processes: Discrete Stochastic Dynamic Programming (Wiley

Item Specifics

Return shipping will be paid by: Buyer

Returns Accepted: Returns Accepted

Item must be returned within: 30 Days

Return policy details:

EAN: 9780471727828

UPC: 9780471727828

ISBN: 9780471727828

MPN: N/A

Book Title: Markov Decision Processes: Discrete Stochastic Dyn

Item Length: 23.4 cm

Number of Pages: 684 Pages

Publication Name: Markov Decision Processes: Discrete Stochastic Dynamic Programming

Language: English

Publisher: John Wiley & Sons Inc

Item Height: 234 mm

Subject: Mathematics

Publication Year: 2005

Type: Textbook

Item Weight: 994 g

Author: Martin L. Puterman

Item Width: 156 mm

Format: Paperback

Recommended

CONTINUOUS-TIME MARKOV DECISION PROCESSES: THEORY AND By Xianping Guo & Onesimo
CONTINUOUS-TIME MARKOV DECISION PROCESSES: THEORY AND By Xianping Guo & Onesimo

$104.95

View Details
Markov Decision Processes and the Belief-Desire-Intention Model: Bridging the Ga
Markov Decision Processes and the Belief-Desire-Intention Model: Bridging the Ga

$74.82

View Details
Markov Decision Processes with Their Applications by Qiying Hu (English) Paperba
Markov Decision Processes with Their Applications by Qiying Hu (English) Paperba

$147.74

View Details
Markov Decision Processes and the Belief-Desire-Intention Model - 9781461414711
Markov Decision Processes and the Belief-Desire-Intention Model - 9781461414711

$44.50

View Details
Markov Chains and Decision Processes for Engineers and Managers, Paperback by...
Markov Chains and Decision Processes for Engineers and Managers, Paperback by...

$98.87

View Details
Markov Decision Processes: Discrete Stochastic Dynamic Programming by Puterman
Markov Decision Processes: Discrete Stochastic Dynamic Programming by Puterman

$261.57

View Details
Piunovskiy - Continuous-Time Markov Decision Processes   Borel Space  - T9000z
Piunovskiy - Continuous-Time Markov Decision Processes Borel Space - T9000z

$223.22

View Details
Continuous-Time Markov Decision Processes - 9783642025464
Continuous-Time Markov Decision Processes - 9783642025464

$98.97

View Details
Vikram Krishnamu Partially Observed Markov Decision Proce (Hardback) (UK IMPORT)
Vikram Krishnamu Partially Observed Markov Decision Proce (Hardback) (UK IMPORT)

$152.57

View Details
The Trust-Based Interactive Partially Observable Markov Decision Process
The Trust-Based Interactive Partially Observable Markov Decision Process

$64.64

View Details