IDEAS home Printed from https://ideas.repec.org/a/bla/scjsta/v41y2014i4p970-987.html
   My bibliography  Save this article

Parameter Estimation for Hidden Markov Models with Intractable Likelihoods

Author

Listed:
  • Thomas A. Dean
  • Sumeetpal S. Singh
  • Ajay Jasra
  • Gareth W. Peters

Abstract

type="main" xml:id="sjos12077-abs-0001"> Approximate Bayesian computation (ABC) is a popular technique for analysing data for complex models where the likelihood function is intractable. It involves using simulation from the model to approximate the likelihood, with this approximate likelihood then being used to construct an approximate posterior. In this paper, we consider methods that estimate the parameters by maximizing the approximate likelihood used in ABC. We give a theoretical analysis of the asymptotic properties of the resulting estimator. In particular, we derive results analogous to those of consistency and asymptotic normality for standard maximum likelihood estimation. We also discuss how sequential Monte Carlo methods provide a natural method for implementing our likelihood-based ABC procedures.

Suggested Citation

  • Thomas A. Dean & Sumeetpal S. Singh & Ajay Jasra & Gareth W. Peters, 2014. "Parameter Estimation for Hidden Markov Models with Intractable Likelihoods," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 41(4), pages 970-987, December.
    • Handle: RePEc:bla:scjsta:v:41:y:2014:i:4:p:970-987
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1111/sjos.12077
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Sangjoon Kim & Neil Shephard & Siddhartha Chib, 1998. "Stochastic Volatility: Likelihood Inference and Comparison with ARCH Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(3), pages 361-393.
    2. Peters, Gareth W. & Wüthrich, Mario V. & Shevchenko, Pavel V., 2010. "Chain ladder method: Bayesian bootstrap versus classical bootstrap," Insurance: Mathematics and Economics, Elsevier, vol. 47(1), pages 36-51, August.
    3. McKinley Trevelyan & Cook Alex R & Deardon Robert, 2009. "Inference in Epidemic Models without Likelihoods," The International Journal of Biostatistics, De Gruyter, vol. 5(1), pages 1-40, July.
    4. Gareth W. Peters & Mario V. Wuthrich & Pavel V. Shevchenko, 2010. "Chain ladder method: Bayesian bootstrap versus classical bootstrap," Papers 1004.2548, arXiv.org.
    5. Knut Heggland & Arnoldo Frigessi, 2004. "Estimating functions in indirect inference," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 66(2), pages 447-462, May.
    6. Paul Fearnhead & Dennis Prangle, 2012. "Constructing summary statistics for approximate Bayesian computation: semi-automatic approximate Bayesian computation," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 74(3), pages 419-474, June.
    7. repec:dau:papers:123456789/5724 is not listed on IDEAS
    8. Blum, Michael G. B., 2010. "Approximate Bayesian Computation: A Nonparametric Perspective," Journal of the American Statistical Association, American Statistical Association, vol. 105(491), pages 1178-1187.
    9. White, Halbert, 1982. "Maximum Likelihood Estimation of Misspecified Models," Econometrica, Econometric Society, vol. 50(1), pages 1-25, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Creel, Michael & Kristensen, Dennis, 2015. "ABC of SV: Limited information likelihood inference in stochastic volatility jump-diffusion models," Journal of Empirical Finance, Elsevier, vol. 31(C), pages 85-108.
    2. Chaya Weerasinghe & Ruben Loaiza-Maya & Gael M. Martin & David T. Frazier, 2023. "ABC-based Forecasting in State Space Models," Monash Econometrics and Business Statistics Working Papers 12/23, Monash University, Department of Econometrics and Business Statistics.
    3. Johan Dahlin & Fredrik Lindsten & Thomas B. Schon, 2015. "Quasi-Newton particle Metropolis-Hastings," Papers 1502.03656, arXiv.org, revised Sep 2015.
    4. David T. Frazier & Ruben Loaiza-Maya & Gael M. Martin, 2021. "Variational Bayes in State Space Models: Inferential and Predictive Accuracy," Papers 2106.12262, arXiv.org, revised Feb 2022.
    5. Johan Dahlin & Mattias Villani & Thomas B. Schon, 2015. "Bayesian optimisation for fast approximate inference in state-space models with intractable likelihoods," Papers 1506.06975, arXiv.org, revised Jun 2017.
    6. Gael M. Martin & Brendan P.M. McCabe & David T. Frazier & Worapree Maneesoonthorn & Christian P. Robert, 2016. "Auxiliary Likelihood-Based Approximate Bayesian Computation in State Space Models," Monash Econometrics and Business Statistics Working Papers 09/16, Monash University, Department of Econometrics and Business Statistics.
    7. Gael M. Martin & David T. Frazier & Christian P. Robert, 2020. "Computing Bayes: Bayesian Computation from 1763 to the 21st Century," Monash Econometrics and Business Statistics Working Papers 14/20, Monash University, Department of Econometrics and Business Statistics.
    8. Gael M. Martin & David T. Frazier & Christian P. Robert, 2021. "Approximating Bayes in the 21st Century," Monash Econometrics and Business Statistics Working Papers 24/21, Monash University, Department of Econometrics and Business Statistics.
    9. Adam Persin & Ajay Jasr, 2016. "Twisting the Alive Particle Filter," Methodology and Computing in Applied Probability, Springer, vol. 18(2), pages 335-358, June.
    10. Gael M. Martin & David T. Frazier & Christian P. Robert, 2022. "Computing Bayes: From Then `Til Now," Monash Econometrics and Business Statistics Working Papers 14/22, Monash University, Department of Econometrics and Business Statistics.
    11. Gael M. Martin & Brendan P.M. McCabe & Worapree Maneesoonthorn & Christian P. Robert, 2014. "Approximate Bayesian Computation in State Space Models," Monash Econometrics and Business Statistics Working Papers 20/14, Monash University, Department of Econometrics and Business Statistics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ajay Jasra, 2015. "Approximate Bayesian Computation for a Class of Time Series Models," International Statistical Review, International Statistical Institute, vol. 83(3), pages 405-435, December.
    2. Pierre-Olivier Goffard & Patrick Laub, 2021. "Approximate Bayesian Computations to fit and compare insurance loss models," Working Papers hal-02891046, HAL.
    3. D.T. Frazier & G.M. Martin & C.P. Robert & J. Rousseau, 2016. "Asymptotic Properties of Approximate Bayesian Computation," Monash Econometrics and Business Statistics Working Papers 18/16, Monash University, Department of Econometrics and Business Statistics.
    4. Bertl Johanna & Ewing Gregory & Kosiol Carolin & Futschik Andreas, 2017. "Approximate maximum likelihood estimation for population genetic inference," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 16(5-6), pages 387-405, December.
    5. Man Chung Fung & Gareth W. Peters & Pavel V. Shevchenko, 2016. "A unified approach to mortality modelling using state-space framework: characterisation, identification, estimation and forecasting," Papers 1605.09484, arXiv.org.
    6. Pierre-Olivier Goffard & Patrick Laub, 2021. "Approximate Bayesian Computations to fit and compare insurance loss models," Post-Print hal-02891046, HAL.
    7. Gael M. Martin & Brendan P.M. McCabe & David T. Frazier & Worapree Maneesoonthorn & Christian P. Robert, 2016. "Auxiliary Likelihood-Based Approximate Bayesian Computation in State Space Models," Monash Econometrics and Business Statistics Working Papers 09/16, Monash University, Department of Econometrics and Business Statistics.
    8. Goffard, Pierre-Olivier & Laub, Patrick J., 2021. "Approximate Bayesian Computations to fit and compare insurance loss models," Insurance: Mathematics and Economics, Elsevier, vol. 100(C), pages 350-371.
    9. David T. Frazier & Gael M. Martin & Christian P. Robert, 2015. "On Consistency of Approximate Bayesian Computation," Monash Econometrics and Business Statistics Working Papers 19/15, Monash University, Department of Econometrics and Business Statistics.
    10. Lombardi, Marco J. & Calzolari, Giorgio, 2009. "Indirect estimation of [alpha]-stable stochastic volatility models," Computational Statistics & Data Analysis, Elsevier, vol. 53(6), pages 2298-2308, April.
    11. Xing Ju Lee & Christopher C. Drovandi & Anthony N. Pettitt, 2015. "Model choice problems using approximate Bayesian computation with applications to pathogen transmission data sets," Biometrics, The International Biometric Society, vol. 71(1), pages 198-207, March.
    12. McKinley, Trevelyan J. & Ross, Joshua V. & Deardon, Rob & Cook, Alex R., 2014. "Simulation-based Bayesian inference for epidemic models," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 434-447.
    13. Malik, Ali Khalil, 2005. "European exchange rate volatility dynamics: an empirical investigation," Journal of Empirical Finance, Elsevier, vol. 12(1), pages 187-215, January.
    14. Gael M. Martin & David T. Frazier & Christian P. Robert, 2020. "Computing Bayes: Bayesian Computation from 1763 to the 21st Century," Monash Econometrics and Business Statistics Working Papers 14/20, Monash University, Department of Econometrics and Business Statistics.
    15. Christian Bontemps & Nour Meddahi, 2012. "Testing distributional assumptions: A GMM aproach," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(6), pages 978-1012, September.
    16. Anthony Ebert & Ritabrata Dutta & Kerrie Mengersen & Antonietta Mira & Fabrizio Ruggeri & Paul Wu, 2021. "Likelihood‐free parameter estimation for dynamic queueing networks: Case study of passenger flow in an international airport terminal," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 70(3), pages 770-792, June.
    17. Calvet, Laurent-Emmanuel & Czellar , Veronika, 2011. "state-observation sampling and the econometrics of learning models," HEC Research Papers Series 947, HEC Paris.
    18. Xiaolin Luo & Pavel V. Shevchenko, 2012. "Bayesian Model Choice of Grouped t-Copula," Methodology and Computing in Applied Probability, Springer, vol. 14(4), pages 1097-1119, December.
    19. Stefano Cabras & María Castellanos & Erlis Ruli, 2014. "A Quasi likelihood approximation of posterior distributions for likelihood-intractable complex models," METRON, Springer;Sapienza Università di Roma, vol. 72(2), pages 153-167, August.
    20. Sungbae An & Frank Schorfheide, 2007. "Bayesian Analysis of DSGE Models," Econometric Reviews, Taylor & Francis Journals, vol. 26(2-4), pages 113-172.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:scjsta:v:41:y:2014:i:4:p:970-987. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0303-6898 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.