IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v72y2000i2p208-229.html
   My bibliography  Save this article

Singularly Perturbed Markov Chains: Convergence and Aggregation

Author

Listed:
  • Yin, G.
  • Zhang, Q.
  • Badowski, G.

Abstract

Asymptotic properties of singularly perturbed Markov chains having measurable and/or continuous generators are developed in this work. The Markov chain under consideration has a finite-state space and is allowed to be nonstationary. Its generator consists of a rapidly varying part and a slowly changing part. The primary concerns are on the properties of the probability vectors and an aggregated process that depend on the characteristics of the fast varying part of the generators. The fast changing part of the generators can either consist of l recurrent classes, or include also transient states in addition to the recurrent classes. The case of inclusion of transient states is examined in detail. Convergence of the probability vectors under the weak topology of L2 is obtained first. Then under slightly stronger conditions, it is shown that the convergence also takes place pointwise. Moreover, convergence under the norm topology of L2 is derived. Furthermore, a process with aggregated states is obtained which converges to a Markov chain in distribution.

Suggested Citation

  • Yin, G. & Zhang, Q. & Badowski, G., 2000. "Singularly Perturbed Markov Chains: Convergence and Aggregation," Journal of Multivariate Analysis, Elsevier, vol. 72(2), pages 208-229, February.
  • Handle: RePEc:eee:jmvana:v:72:y:2000:i:2:p:208-229
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047-259X(99)91855-9
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Hwang, Chii-Ruey & Sheu, Shuenn-Jyi, 1998. "On the Geometrical Convergence of Gibbs Sampler inRd," Journal of Multivariate Analysis, Elsevier, vol. 66(1), pages 22-37, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.

      More about this item

      Keywords

      singularly perturbed Markov chain; weak topology; pointwise convergence; convergence in L2; aggregation; weak convergence;
      All these keywords.

      JEL classification:

      • L2 - Industrial Organization - - Firm Objectives, Organization, and Behavior

      Statistics

      Access and download statistics

      Corrections

      All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:72:y:2000:i:2:p:208-229. See general information about how to correct material in RePEc.

      If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

      If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

      If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

      For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

      Please note that corrections may take a couple of weeks to filter through the various RePEc services.

      IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.