IDEAS home Printed from https://ideas.repec.org/p/msh/ebswps/2004-10.html
   My bibliography  Save this paper

Estimating Components in Finite Mixtures and Hidden Markov Models

Author

Listed:
  • D.S. Poskitt
  • Jing Zhang

Abstract

When the unobservable Markov chain in a hidden Markov model is stationary the marginal distribution of the observations is a finite mixture with the number of terms equal to the number of the states of the Markov chain. This suggests estimating the number of states of the unobservable Markov chain by determining the number of mixture components in the marginal distribution. We therefore present new methods for estimating the number of states in a hidden Markov model, and coincidentally the unknown number of components in a finite mixture, based on penalized quasi-likelihood and generalized quasi-likelihood ratio methods constructed from the marginal distribution. The procedures advocated are simple to calculate and results obtained in empirical applications indicate that they are as effective as current available methods based on the full likelihood. We show that, under fairly general regularity conditions, the methods proposed will generate strongly consistent estimates of the unknown number of states or components.

Suggested Citation

  • D.S. Poskitt & Jing Zhang, 2004. "Estimating Components in Finite Mixtures and Hidden Markov Models," Monash Econometrics and Business Statistics Working Papers 10/04, Monash University, Department of Econometrics and Business Statistics.
  • Handle: RePEc:msh:ebswps:2004-10
    as

    Download full text from publisher

    File URL: http://www.buseco.monash.edu.au/ebs/pubs/wpapers/2004/wp10-04.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Hansen, Bruce E, 1996. "Erratum: The Likelihood Ratio Test under Nonstandard Conditions: Testing the Markov Switching Model of GNP," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 11(2), pages 195-198, March-Apr.
    2. Davidson, James, 1994. "Stochastic Limit Theory: An Introduction for Econometricians," OUP Catalogue, Oxford University Press, number 9780198774037, Decembrie.
    3. Jing Zhang & Robert A. Stine, 2001. "Autocovariance Structure of Markov Regime Switching Models and Model Selection," Journal of Time Series Analysis, Wiley Blackwell, vol. 22(1), pages 107-124, January.
    4. Sylvia. Richardson & Peter J. Green, 1997. "On Bayesian Analysis of Mixtures with an Unknown Number of Components (with discussion)," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 59(4), pages 731-792.
    5. Hamilton, James D, 1989. "A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle," Econometrica, Econometric Society, vol. 57(2), pages 357-384, March.
    6. Hamilton, James D., 1996. "Specification testing in Markov-switching time-series models," Journal of Econometrics, Elsevier, vol. 70(1), pages 127-157, January.
    7. Hansen, Bruce E, 1996. "Erratum: The Likelihood Ratio Test under Nonstandard Conditions: Testing the Markov Switching Model of GNP," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 11(2), pages 195-198, March-Apr.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Md Atikur Rahman Khan & D.S. Poskitt, 2010. "Description Length Based Signal Detection in singular Spectrum Analysis," Monash Econometrics and Business Statistics Working Papers 13/10, Monash University, Department of Econometrics and Business Statistics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nan Li & Simon S. Kwok, 2021. "Jointly determining the state dimension and lag order for Markov‐switching vector autoregressive models," Journal of Time Series Analysis, Wiley Blackwell, vol. 42(4), pages 471-491, July.
    2. Sen, Rituparna & Hsieh, Fushing, 2009. "A note on testing regime switching assumption based on recurrence times," Statistics & Probability Letters, Elsevier, vol. 79(24), pages 2443-2450, December.
    3. Charles, Amélie & Darné, Olivier & Diebolt, Claude & Ferrara, Laurent, 2015. "A new monthly chronology of the US industrial cycles in the prewar economy," Journal of Financial Stability, Elsevier, vol. 17(C), pages 3-9.
    4. Sean D. Campbell, 2002. "Specification Testing and Semiparametric Estimation of Regime Switching Models: An Examination of the US Short Term Interest Rate," Working Papers 2002-26, Brown University, Department of Economics.
    5. Maddalena Cavicchioli, 2015. "Likelihood Ratio Test and Information Criteria for Markov Switching Var Models: An Application to the Italian Macroeconomy," Italian Economic Journal: A Continuation of Rivista Italiana degli Economisti and Giornale degli Economisti, Springer;Società Italiana degli Economisti (Italian Economic Association), vol. 1(3), pages 315-332, November.
    6. Beine, Michel, 2003. "Volatility expectations and asymmetric effects of direct interventions in the FX market," Journal of the Japanese and International Economies, Elsevier, vol. 17(1), pages 55-80, March.
    7. Billio, Monica & Getmansky, Mila & Pelizzon, Loriana, 2012. "Dynamic risk exposures in hedge funds," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3517-3532.
    8. Ferrara, Laurent, 2003. "A three-regime real-time indicator for the US economy," Economics Letters, Elsevier, vol. 81(3), pages 373-378, December.
    9. Pierre-Yves Hénin & Pape N. Diaye, 2001. "L'effet des politiques budgétaires sur l'activité : une fonction des conditions conjoncturelles et du régime budgétaire ?," Economie & Prévision, La Documentation Française, vol. 147(1), pages 73-88.
    10. ZHENG, Tingguo & WANG, Xia & GUO, Huiming, 2012. "Estimating forward-looking rules for China's Monetary Policy: A regime-switching perspective," China Economic Review, Elsevier, vol. 23(1), pages 47-59.
    11. Kasahara, Hiroyuki & Shimotsu, Katsumi, 2019. "Asymptotic properties of the maximum likelihood estimator in regime switching econometric models," Journal of Econometrics, Elsevier, vol. 208(2), pages 442-467.
    12. Edwards, Sebastian & Susmel, Raul, 2001. "Volatility dependence and contagion in emerging equity markets," Journal of Development Economics, Elsevier, vol. 66(2), pages 505-532, December.
    13. Vadim Marmer, 2008. "Testing the null hypothesis of no regime switching with an application to GDP growth rates," Empirical Economics, Springer, vol. 35(1), pages 101-122, August.
    14. Huntley Schaller & Simon Van Norden, 1997. "Regime switching in stock market returns," Applied Financial Economics, Taylor & Francis Journals, vol. 7(2), pages 177-191.
    15. Nicolas Rautureau, 2004. "Modèles à changement de régime et test de la théorie des anticipations rationnelles de la structure par terme des taux dintérêt en France," Économie et Prévision, Programme National Persée, vol. 163(2), pages 117-129.
    16. Igor Alexandre Clemente de Morais & Marcelo Savino Portugal, 2003. "Business Cycle in the Industrial Production of Brazilian States," Anais do XXXI Encontro Nacional de Economia [Proceedings of the 31st Brazilian Economics Meeting] e75, ANPEC - Associação Nacional dos Centros de Pós-Graduação em Economia [Brazilian Association of Graduate Programs in Economics].
    17. Sebastian Edwards, 2000. "Interest Rates, Contagion and Capital Controls," NBER Working Papers 7801, National Bureau of Economic Research, Inc.
    18. Massimo Guidolin, 2011. "Markov Switching Models in Empirical Finance," Advances in Econometrics, in: Missing Data Methods: Time-Series Methods and Applications, pages 1-86, Emerald Group Publishing Limited.
    19. Mr. Abdul d Abiad, 2003. "Early Warning Systems: A Survey and a Regime-Switching Approach," IMF Working Papers 2003/032, International Monetary Fund.
    20. LeBaron, Blake, 2003. "Non-Linear Time Series Models in Empirical Finance,: Philip Hans Franses and Dick van Dijk, Cambridge University Press, Cambridge, 2000, 296 pp., Paperback, ISBN 0-521-77965-0, $33, [UK pound]22.95, [," International Journal of Forecasting, Elsevier, vol. 19(4), pages 751-752.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:msh:ebswps:2004-10. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Professor Xibin Zhang (email available below). General contact details of provider: https://edirc.repec.org/data/dxmonau.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.