IDEAS home Printed from https://ideas.repec.org/p/hka/wpaper/2021-023.html
   My bibliography  Save this paper

Identification and Estimation of Non-stationary Hidden Markov Models

Author

Listed:
  • Martin Garcia-Vazquez

    (University of Minnesota)

Abstract

This paper provides a novel constructive identification proof for non-stationary Hidden Markov models. The identification result establishes that only two periods of time are required if one wants to identify transition probabilities between those two periods. This is achieved by using three conditionally independent noisy measures of the hidden state. The paper also provides a novel estimator for nonstationary hidden Markov models based on the identification proof. Montecarlo experiments show that this estimator is faster to compute than maximum likelihood, and almost as precise for large enough samples. Moreover, I show how my identification proof and my estimator can be used in two different relevant applications: Identification and estimation of Conditional Choice Probabilities, initial conditions and laws of motion in dynamic discrete choice models when there is an unobservable state; and identification and estimation of the production function of cognitive skills in a child development context when skills and investment are unobserved.

Suggested Citation

  • Martin Garcia-Vazquez, 2021. "Identification and Estimation of Non-stationary Hidden Markov Models," Working Papers 2021-023, Human Capital and Economic Opportunity Working Group.
  • Handle: RePEc:hka:wpaper:2021-023
    Note: M
    as

    Download full text from publisher

    File URL: http://humcap.uchicago.edu/RePEc/hka/wpaper/Garcia-Vazquez_2021_identification-estimation-non-stationary-HMM.pdf
    File Function: First version, May 25, 2021
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Amengual, D.; Bueren, J.; Crego, J.A.;, 2017. "Endogenous Health Groups and Heterogeneous Dynamics of the Elderly," Health, Econometrics and Data Group (HEDG) Working Papers 17/18, HEDG, c/o Department of Economics, University of York.
    2. Victor Aguirregabiria & Pedro Mira, 2002. "Swapping the Nested Fixed Point Algorithm: A Class of Estimators for Discrete Markov Decision Models," Econometrica, Econometric Society, vol. 70(4), pages 1519-1543, July.
    3. V. Joseph Hotz & Robert A. Miller, 1993. "Conditional Choice Probabilities and the Estimation of Dynamic Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 60(3), pages 497-529.
    4. repec:hal:spmain:info:hdl:2441/4m4fqk908d9obqasu0uhft7t94 is not listed on IDEAS
    5. Shuaizhang Feng & Yingyao Hu, 2013. "Misclassification Errors and the Underestimation of the US Unemployment Rate," American Economic Review, American Economic Association, vol. 103(2), pages 1054-1070, April.
    6. Flavio Cunha & James J. Heckman & Susanne M. Schennach, 2010. "Estimating the Technology of Cognitive and Noncognitive Skill Formation," Econometrica, Econometric Society, vol. 78(3), pages 883-931, May.
    7. Bonhomme, Stéphane & Jochmans, Koen & Robin, Jean-Marc, 2017. "Nonparametric estimation of non-exchangeable latent-variable models," Journal of Econometrics, Elsevier, vol. 201(2), pages 237-248.
    8. Ang, Andrew & Bekaert, Geert, 2002. "Regime Switches in Interest Rates," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 163-182, April.
    9. Robert E. Hall & Marianna Kudlyak, 2019. "Job-Finding and Job-Losing: A Comprehensive Model of Heterogeneous Individual Labor-Market Dynamics," NBER Working Papers 25625, National Bureau of Economic Research, Inc.
    10. Mehmet Soytas & Limor Golan & George-Levi Gayle, 2014. "What Accounts for the Racial Gap in Time Allocation and Intergenerational Transmission of Human Capital?," 2014 Meeting Papers 83, Society for Economic Dynamics.
    11. Joseph Kruskal, 1976. "More factors than subjects, tests and treatments: An indeterminacy theorem for canonical decomposition and individual differences scaling," Psychometrika, Springer;The Psychometric Society, vol. 41(3), pages 281-293, September.
    12. Mr. Ippei Shibata, 2019. "Labor Market Dynamics: A Hidden Markov Approach," IMF Working Papers 2019/282, International Monetary Fund.
    13. repec:hal:spmain:info:hdl:2441/lpag9391598uoauqu4u9opq76 is not listed on IDEAS
    14. Jeffrey M Wooldridge, 2010. "Econometric Analysis of Cross Section and Panel Data," MIT Press Books, The MIT Press, edition 2, volume 1, number 0262232588, December.
    15. Kory Kroft & Fabian Lange & Matthew J. Notowidigdo, 2013. "Duration Dependence and Labor Market Conditions: Evidence from a Field Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(3), pages 1123-1167.
    16. Hu, Yingyao & Shum, Matthew, 2012. "Nonparametric identification of dynamic models with unobserved state variables," Journal of Econometrics, Elsevier, vol. 171(1), pages 32-44.
    17. Robert Shimer, 2005. "The Cyclical Behavior of Equilibrium Unemployment and Vacancies," American Economic Review, American Economic Association, vol. 95(1), pages 25-49, March.
    18. Peter Arcidiacono & Robert A. Miller, 2011. "Conditional Choice Probability Estimation of Dynamic Discrete Choice Models With Unobserved Heterogeneity," Econometrica, Econometric Society, vol. 79(6), pages 1823-1867, November.
    19. repec:hal:spmain:info:hdl:2441/etefo8s8r89oamhnhiclqr530 is not listed on IDEAS
    20. Francesco Agostinelli & Matthew Wiswall, 2016. "Identification of Dynamic Latent Factor Models: The Implications of Re-Normalization in a Model of Child Development," NBER Working Papers 22441, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hu Yingyao & Shum Matthew & Tan Wei & Xiao Ruli, 2017. "A Simple Estimator for Dynamic Models with Serially Correlated Unobservables," Journal of Econometric Methods, De Gruyter, vol. 6(1), pages 1-16, January.
    2. Sebastian Galiani & Juan Pantano, 2021. "Structural Models: Inception and Frontier," NBER Working Papers 28698, National Bureau of Economic Research, Inc.
    3. Hanming Fang & Yang Wang, 2015. "Estimating Dynamic Discrete Choice Models With Hyperbolic Discounting, With An Application To Mammography Decisions," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 56(2), pages 565-596, May.
    4. Cheng Chou & Geert Ridder & Ruoyao Shi, 2024. "Identification and Estimation of Nonstationary Dynamic Binary Choice Models," Working Papers 202402, University of California at Riverside, Department of Economics.
    5. Khai Xiang Chiong & Alfred Galichon & Matt Shum, 2016. "Duality in dynamic discrete‐choice models," Quantitative Economics, Econometric Society, vol. 7(1), pages 83-115, March.
    6. Sasaki, Yuya & Takahashi, Yuya & Xin, Yi & Hu, Yingyao, 2023. "Dynamic discrete choice models with incomplete data: Sharp identification," Journal of Econometrics, Elsevier, vol. 236(1).
    7. Myrto Kalouptsidi & Paul T. Scott & Eduardo Souza-Rodrigues, 2018. "Linear IV Regression Estimators for Structural Dynamic Discrete Choice Models," NBER Working Papers 25134, National Bureau of Economic Research, Inc.
    8. Hu, Yingyao, 2017. "The econometrics of unobservables: Applications of measurement error models in empirical industrial organization and labor economics," Journal of Econometrics, Elsevier, vol. 200(2), pages 154-168.
    9. Kalouptsidi, Myrto & Scott, Paul T. & Souza-Rodrigues, Eduardo, 2021. "Linear IV regression estimators for structural dynamic discrete choice models," Journal of Econometrics, Elsevier, vol. 222(1), pages 778-804.
    10. Taisuke Otsu & Martin Pesendorfer, 2021. "Equilibrium multiplicity in dynamic games: testing and estimation," STICERD - Econometrics Paper Series 618, Suntory and Toyota International Centres for Economics and Related Disciplines, LSE.
    11. Hu, Yingyao & Shum, Matthew, 2012. "Nonparametric identification of dynamic models with unobserved state variables," Journal of Econometrics, Elsevier, vol. 171(1), pages 32-44.
    12. Bruneel-Zupanc, Christophe Alain, 2021. "Discrete-Continuous Dynamic Choice Models: Identification and Conditional Choice Probability Estimation," TSE Working Papers 21-1185, Toulouse School of Economics (TSE).
    13. An, Yonghong & Hu, Yingyao & Xiao, Ruli, 2021. "Dynamic decisions under subjective expectations: A structural analysis," Journal of Econometrics, Elsevier, vol. 222(1), pages 645-675.
    14. A. Norets & X. Tang, 2014. "Semiparametric Inference in Dynamic Binary Choice Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 81(3), pages 1229-1262.
    15. Limor Golan & Carl Sanders & Jonathan James, 2019. "What Explains the Racial Gaps in Task Assignment and Pay Over the Life-Cycle?," 2019 Meeting Papers 320, Society for Economic Dynamics.
    16. Kalouptsidi, Myrto & Scott, Paul T. & Souza-Rodrigues, Eduardo, 2018. "Linear IV Regression Estimators for Structural Dynamic Discrete Choice Models," CEPR Discussion Papers 13240, C.E.P.R. Discussion Papers.
    17. Yingyao Hu, 2015. "Microeconomic models with latent variables: applications of measurement error models in empirical industrial organization and labor economics," CeMMAP working papers CWP03/15, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    18. Taisuke Otsu & Martin Pesendorfer, 2023. "Equilibrium multiplicity in dynamic games: Testing and estimation," The Econometrics Journal, Royal Economic Society, vol. 26(1), pages 26-42.
    19. repec:hal:spmain:info:hdl:2441/7svo6civd6959qvmn4965cth1d is not listed on IDEAS
    20. Hong, Han & Li, Weiming & Wang, Boyu, 2015. "Estimation of dynamic discrete models from time aggregated data," Journal of Econometrics, Elsevier, vol. 188(2), pages 435-446.
    21. Steven T Berry & Giovanni Compiani, 2023. "An Instrumental Variable Approach to Dynamic Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 90(4), pages 1724-1758.

    More about this item

    Keywords

    identification; Child Development; cognitive skills; investment in children;
    All these keywords.

    JEL classification:

    • C10 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - General
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hka:wpaper:2021-023. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Jennifer Pachon (email available below). General contact details of provider: https://edirc.repec.org/data/mfichus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.