Continuous-time Markov decision processes : theory and applications

書誌事項

Continuous-time Markov decision processes : theory and applications

Xianping Guo, Onésimo Hernández-Lerma

(Stochastic modelling and applied probability, 62)

Springer Verlag, 2009

大学図書館所蔵 件 / 27

この図書・雑誌をさがす

注記

Bibliography: p. 221-227

Includes index

内容説明・目次

内容説明

Continuous-time Markov decision processes (MDPs), also known as controlled Markov chains, are used for modeling decision-making problems that arise in operations research (for instance, inventory, manufacturing, and queueing systems), computer science, communications engineering, control of populations (such as fisheries and epidemics), and management science, among many other fields. This volume provides a unified, systematic, self-contained presentation of recent developments on the theory and applications of continuous-time MDPs. The MDPs in this volume include most of the cases that arise in applications, because they allow unbounded transition and reward/cost rates. Much of the material appears for the first time in book form.

目次

and Summary.- Continuous-Time Markov Decision Processes.- Average Optimality for Finite Models.- Discount Optimality for Nonnegative Costs.- Average Optimality for Nonnegative Costs.- Discount Optimality for Unbounded Rewards.- Average Optimality for Unbounded Rewards.- Average Optimality for Pathwise Rewards.- Advanced Optimality Criteria.- Variance Minimization.- Constrained Optimality for Discount Criteria.- Constrained Optimality for Average Criteria.

「Nielsen BookData」 より

関連文献: 1件中  1-1を表示

詳細情報

ページトップへ