Markov chains and stochastic stability

Bibliographic Information

Markov chains and stochastic stability

S.P. Meyn and R.L. Tweedie

(Communications and control engineering)

Springer, 1996, c1993

  • : Berlin
  • : New York

Related Bibliography 1 items

Search this Book/Journal
Note

Includes bibliographical references (p. [528]-541) and indexes

"3rd printing 1996"--T.p. verso

Description and Table of Contents

Description

The area of Markov chain theory and application has matured over the past 20 years. This publication deals with the action of Markov chains on general state spaces. It discusses the theories and the use to be gained, concentrating on the areas of engineering, operations research and control theory. Throughout, the theme of stochastic stability and the search for practical methods of verifying such stability, provide a new and powerful technique which not only affects applications, but also the development of the theory itself. The impact of the theory on specific models is discussed in detail.

Table of Contents

Contents: Communication and Regeneration: Heuristics.- Markov Models.- Transition Probabilities.- Irreducibility.- Pseudo-atoms.- Topology and Continuity.- Nonlinear State Space Model.- Stability Structures: Transience and Recurrence.- Harris and Topological Recurrence.- The Existence of +.- Drift and Regularity.- Invariance and Tightness. Convergence: Ergodicity.- f-Ergodicity and f-Regularity.- Geometric Ergodicity.- V-Uniform Ergodicity.- Sample Paths and Limit Theorems.- Positivity.- Generalised Classification Criteria. Appendices: Mud Maps.- Testing for Stability.- Glossary of Model Assumptions.- Mathematical Background.

by "Nielsen BookData"

Related Books: 1-1 of 1
Details
  • NCID
    BA40379273
  • ISBN
    • 3540198326
    • 0387198326
  • Country Code
    uk
  • Title Language Code
    eng
  • Text Language Code
    eng
  • Place of Publication
    London ; Tokyo
  • Pages/Volumes
    xvi, 550 p.
  • Size
    24 cm
  • Classification
  • Parent Bibliography ID
Page Top