Topics in the constructive theory of countable Markov chains
著者
書誌事項
Topics in the constructive theory of countable Markov chains
Cambridge University Press, 2008
- : pbk
大学図書館所蔵 件 / 全4件
-
該当する所蔵館はありません
- すべての絞り込み条件を解除する
注記
this digitally printed version(with corrections)2008 -- T.p.verso
Originally published: 1995
Includes bibliographical references and index
内容説明・目次
内容説明
Markov chains are an important idea, related to random walks, which crops up widely in applied stochastic analysis. They are used, for example, in performance modelling and evaluation of computer networks, queuing networks, and telecommunication systems. The main point of the present book is to provide methods, based on the construction of Lyapunov functions, of determining when a Markov chain is ergodic, null recurrent, or transient. These methods can also be extended to the study of questions of stability. Of particular concern are reflected random walks and reflected Brownian motion. The authors provide not only a self-contained introduction to the theory but also details of how the required Lyapunov functions are constructed in various situations.
目次
- Introduction and history
- 1. Preliminaries
- 2. General criteria
- 3. Explicit construction of Lyapunov functions
- 4. Ideology of induced chains
- 5. Random walks in two dimensional complexes
- 6. Stability
- 7. Exponential convergence and analyticity for ergodic Markov chains
- Bibliography.
「Nielsen BookData」 より