IDEAS home Printed from https://ideas.repec.org/a/bla/scjsta/v41y2014i4p970-987.html
   My bibliography  Save this article

Parameter Estimation for Hidden Markov Models with Intractable Likelihoods

Author

Listed:
  • Thomas A. Dean
  • Sumeetpal S. Singh
  • Ajay Jasra
  • Gareth W. Peters

Abstract

type="main" xml:id="sjos12077-abs-0001"> Approximate Bayesian computation (ABC) is a popular technique for analysing data for complex models where the likelihood function is intractable. It involves using simulation from the model to approximate the likelihood, with this approximate likelihood then being used to construct an approximate posterior. In this paper, we consider methods that estimate the parameters by maximizing the approximate likelihood used in ABC. We give a theoretical analysis of the asymptotic properties of the resulting estimator. In particular, we derive results analogous to those of consistency and asymptotic normality for standard maximum likelihood estimation. We also discuss how sequential Monte Carlo methods provide a natural method for implementing our likelihood-based ABC procedures.

Suggested Citation

  • Thomas A. Dean & Sumeetpal S. Singh & Ajay Jasra & Gareth W. Peters, 2014. "Parameter Estimation for Hidden Markov Models with Intractable Likelihoods," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 41(4), pages 970-987, December.
    • Handle: RePEc:bla:scjsta:v:41:y:2014:i:4:p:970-987
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1111/sjos.12077
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Sangjoon Kim & Neil Shephard & Siddhartha Chib, 1998. "Stochastic Volatility: Likelihood Inference and Comparison with ARCH Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(3), pages 361-393.
    2. Peters, Gareth W. & Wüthrich, Mario V. & Shevchenko, Pavel V., 2010. "Chain ladder method: Bayesian bootstrap versus classical bootstrap," Insurance: Mathematics and Economics, Elsevier, vol. 47(1), pages 36-51, August.
    3. McKinley Trevelyan & Cook Alex R & Deardon Robert, 2009. "Inference in Epidemic Models without Likelihoods," The International Journal of Biostatistics, De Gruyter, vol. 5(1), pages 1-40, July.
    4. Gareth W. Peters & Mario V. Wuthrich & Pavel V. Shevchenko, 2010. "Chain ladder method: Bayesian bootstrap versus classical bootstrap," Papers 1004.2548, arXiv.org.
    5. White, Halbert, 1983. "Corrigendum [Maximum Likelihood Estimation of Misspecified Models]," Econometrica, Econometric Society, vol. 51(2), pages 513-513, March.
    6. Knut Heggland & Arnoldo Frigessi, 2004. "Estimating functions in indirect inference," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 66(2), pages 447-462, May.
    7. Paul Fearnhead & Dennis Prangle, 2012. "Constructing summary statistics for approximate Bayesian computation: semi-automatic approximate Bayesian computation," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 74(3), pages 419-474, June.
    8. repec:dau:papers:123456789/5724 is not listed on IDEAS
    9. Blum, Michael G. B., 2010. "Approximate Bayesian Computation: A Nonparametric Perspective," Journal of the American Statistical Association, American Statistical Association, vol. 105(491), pages 1178-1187.
    10. White, Halbert, 1982. "Maximum Likelihood Estimation of Misspecified Models," Econometrica, Econometric Society, vol. 50(1), pages 1-25, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Creel, Michael & Kristensen, Dennis, 2015. "ABC of SV: Limited information likelihood inference in stochastic volatility jump-diffusion models," Journal of Empirical Finance, Elsevier, vol. 31(C), pages 85-108.
    2. Adam Persin & Ajay Jasr, 2016. "Twisting the Alive Particle Filter," Methodology and Computing in Applied Probability, Springer, vol. 18(2), pages 335-358, June.
    3. Chaya Weerasinghe & Ruben Loaiza-Maya & Gael M. Martin & David T. Frazier, 2023. "ABC-based Forecasting in State Space Models," Monash Econometrics and Business Statistics Working Papers 12/23, Monash University, Department of Econometrics and Business Statistics.
    4. Johan Dahlin & Fredrik Lindsten & Thomas B. Schon, 2015. "Quasi-Newton particle Metropolis-Hastings," Papers 1502.03656, arXiv.org, revised Sep 2015.
    5. David T. Frazier & Ruben Loaiza-Maya & Gael M. Martin, 2021. "Variational Bayes in State Space Models: Inferential and Predictive Accuracy," Papers 2106.12262, arXiv.org, revised Feb 2022.
    6. Johan Dahlin & Mattias Villani & Thomas B. Schon, 2015. "Bayesian optimisation for fast approximate inference in state-space models with intractable likelihoods," Papers 1506.06975, arXiv.org, revised Jun 2017.
    7. Gael M. Martin & Brendan P.M. McCabe & David T. Frazier & Worapree Maneesoonthorn & Christian P. Robert, 2016. "Auxiliary Likelihood-Based Approximate Bayesian Computation in State Space Models," Monash Econometrics and Business Statistics Working Papers 09/16, Monash University, Department of Econometrics and Business Statistics.
    8. Gael M. Martin & David T. Frazier & Christian P. Robert, 2022. "Computing Bayes: From Then `Til Now," Monash Econometrics and Business Statistics Working Papers 14/22, Monash University, Department of Econometrics and Business Statistics.
    9. Weerasinghe, Chaya & Loaiza-Maya, Rubén & Martin, Gael M. & Frazier, David T., 2025. "ABC-based forecasting in misspecified state space models," International Journal of Forecasting, Elsevier, vol. 41(1), pages 270-289.
    10. Gael M. Martin & Brendan P.M. McCabe & Worapree Maneesoonthorn & Christian P. Robert, 2014. "Approximate Bayesian Computation in State Space Models," Monash Econometrics and Business Statistics Working Papers 20/14, Monash University, Department of Econometrics and Business Statistics.
    11. Gael M. Martin & David T. Frazier & Christian P. Robert, 2020. "Computing Bayes: Bayesian Computation from 1763 to the 21st Century," Monash Econometrics and Business Statistics Working Papers 14/20, Monash University, Department of Econometrics and Business Statistics.
    12. Gael M. Martin & David T. Frazier & Christian P. Robert, 2021. "Approximating Bayes in the 21st Century," Monash Econometrics and Business Statistics Working Papers 24/21, Monash University, Department of Econometrics and Business Statistics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. repec:bla:istatr:v:83:y:2015:i:3:p:405-435 is not listed on IDEAS
    2. Pierre-Olivier Goffard & Patrick Laub, 2021. "Approximate Bayesian Computations to fit and compare insurance loss models," Working Papers hal-02891046, HAL.
    3. D.T. Frazier & G.M. Martin & C.P. Robert & J. Rousseau, 2016. "Asymptotic Properties of Approximate Bayesian Computation," Monash Econometrics and Business Statistics Working Papers 18/16, Monash University, Department of Econometrics and Business Statistics.
    4. Theodore Panagiotidis & Georgios Papapanagiotou, 2024. "A note on the determinants of NFTs returns," Working Paper series 24-07, Rimini Centre for Economic Analysis.
    5. Malik, Ali Khalil, 2005. "European exchange rate volatility dynamics: an empirical investigation," Journal of Empirical Finance, Elsevier, vol. 12(1), pages 187-215, January.
    6. Bertl Johanna & Ewing Gregory & Kosiol Carolin & Futschik Andreas, 2017. "Approximate maximum likelihood estimation for population genetic inference," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 16(5-6), pages 291-312, December.
    7. Christian Bontemps & Nour Meddahi, 2012. "Testing distributional assumptions: A GMM aproach," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(6), pages 978-1012, September.
    8. Sungbae An & Frank Schorfheide, 2007. "Bayesian Analysis of DSGE Models," Econometric Reviews, Taylor & Francis Journals, vol. 26(2-4), pages 113-172.
    9. Bontemps, Christian & Meddahi, Nour, 2005. "Testing normality: a GMM approach," Journal of Econometrics, Elsevier, vol. 124(1), pages 149-186, January.
    10. Man Chung Fung & Gareth W. Peters & Pavel V. Shevchenko, 2016. "A unified approach to mortality modelling using state-space framework: characterisation, identification, estimation and forecasting," Papers 1605.09484, arXiv.org.
    11. Pierre-Olivier Goffard & Patrick Laub, 2021. "Approximate Bayesian Computations to fit and compare insurance loss models," Post-Print hal-02891046, HAL.
    12. Gael M. Martin & Brendan P.M. McCabe & David T. Frazier & Worapree Maneesoonthorn & Christian P. Robert, 2016. "Auxiliary Likelihood-Based Approximate Bayesian Computation in State Space Models," Monash Econometrics and Business Statistics Working Papers 09/16, Monash University, Department of Econometrics and Business Statistics.
    13. Goffard, Pierre-Olivier & Laub, Patrick J., 2021. "Approximate Bayesian Computations to fit and compare insurance loss models," Insurance: Mathematics and Economics, Elsevier, vol. 100(C), pages 350-371.
    14. Petrova, Katerina, 2022. "Asymptotically valid Bayesian inference in the presence of distributional misspecification in VAR models," Journal of Econometrics, Elsevier, vol. 230(1), pages 154-182.
    15. Czudaj, Robert L., 2019. "Dynamics between trading volume, volatility and open interest in agricultural futures markets: A Bayesian time-varying coefficient approach," Econometrics and Statistics, Elsevier, vol. 12(C), pages 78-145.
    16. Chaya Weerasinghe & Ruben Loaiza-Maya & Gael M. Martin & David T. Frazier, 2023. "ABC-based Forecasting in State Space Models," Monash Econometrics and Business Statistics Working Papers 12/23, Monash University, Department of Econometrics and Business Statistics.
    17. David T. Frazier & Gael M. Martin & Christian P. Robert, 2015. "On Consistency of Approximate Bayesian Computation," Monash Econometrics and Business Statistics Working Papers 19/15, Monash University, Department of Econometrics and Business Statistics.
    18. Chen, Yi-Ting, 2012. "A simple approach to standardized-residuals-based higher-moment tests," Journal of Empirical Finance, Elsevier, vol. 19(4), pages 427-453.
    19. Sanha Noh, 2020. "Posterior Inference on Parameters in a Nonlinear DSGE Model via Gaussian-Based Filters," Computational Economics, Springer;Society for Computational Economics, vol. 56(4), pages 795-841, December.
    20. Das, Debojyoti & Bhatia, Vaneet & Kumar, Surya Bhushan & Basu, Sankarshan, 2022. "Do precious metals hedge crude oil volatility jumps?," International Review of Financial Analysis, Elsevier, vol. 83(C).
    21. P.A.V.B. Swamy & I-Lok Chang & Jatinder S. Mehta & William H. Greene & Stephen G. Hall & George S. Tavlas, 2016. "Removing Specification Errors from the Usual Formulation of Binary Choice Models," Econometrics, MDPI, vol. 4(2), pages 1-21, June.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:scjsta:v:41:y:2014:i:4:p:970-987. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0303-6898 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.