RESEARCH ARTICLE

Limiting process of absorbing Markov chains

  • Jinwen CHEN
Expand
  • Department of Mathematical Sciences, Tsinghua University, Beijing 100084, China

Received date: 01 Apr 2014

Accepted date: 22 May 2014

Published date: 20 Aug 2014

Copyright

2014 Higher Education Press and Springer-Verlag Berlin Heidelberg

Abstract

We outline an approach to investigate the limiting law of an absorbing Markov chain conditional on having not been absorbed for long time. The main idea is to employ Donsker-Varadhan’s entropy functional which is typically used as the large deviation rate function for Markov processes. This approach provides an interpretation for a certain quasi-ergodicity

Cite this article

Jinwen CHEN . Limiting process of absorbing Markov chains[J]. Frontiers of Mathematics in China, 2014 , 9(4) : 753 -759 . DOI: 10.1007/s11464-014-0400-8

1
Anderson W J. Continuous-Time Markov Chains. An Applications-Oriented Approach. Berlin: Springer-Verlag, 1991

DOI

2
Bolthausen E, Schmock U. On the maximum entropy principle for uniformly ergodic Markov chains. Stochastic Process Appl, 1989, 33(1): 1-27

DOI

3
Chen J W, Deng X X. Large deviations and related problems for absorbing Markov chains. Stochastic Process Appl, 2013, 123: 2398-2418

DOI

4
Donsker M D, Varadhan S R S. Asymptotic evaluation of certain Markov process expectations for large time. (I). Comm Pure Appl Math, 1975, 28: 1-47

DOI

5
Donsker M D, Varadhan S R S. Asymptotic evaluation of certain Markov process expectations for large time. (II). Comm Pure Appl Math, 1975, 28: 279-301

DOI

6
Donsker M D, Varadhan S R S. Asymptotic evaluation of certain Markov process expectations for large time. (III). Comm Pure Appl Math, 1976, 29: 389-461

DOI

7
Donsker M D, Varadhan S R S. Asymptotic evaluation of certain Markov process expectations for large time. (IV). Comm Pure Appl Math, 1983, 36: 183-212

DOI

8
Flaspohler D C. Quasi-stationary distributions for absorbing continuous-time denumerable Markov chains. Ann Inst Statist Math, 1973, 26: 351-356

DOI

9
Kingman J F C. The exponential decay of Markov transition probabilities. Proc Lond Math Soc (3), 1963, XIII: 337-358

Outlines

/