IDEAS home Printed from https://ideas.repec.org/a/spr/compst/v38y2023i2d10.1007_s00180-022-01226-3.html
   My bibliography  Save this article

Approximate Bayesian computation using asymptotically normal point estimates

Author

Listed:
  • George Karabatsos

    (Departments of Educational Psychology, and Mathematics, Statistics, and Computer Sciences)

Abstract

Approximate Bayesian computation (ABC) provides inference of the posterior distribution, even for models with intractable likelihoods, by replacing the exact (intractable) model likelihood by a tractable approximate likelihood. Meanwhile, historically, the development of point-estimation methods usually precedes the development of posterior estimation methods. We propose and study new ABC methods based on asymptotically normal and consistent point-estimators of the model parameters. Specifically, for the classical ABC method, we propose and study two alternative bootstrap methods for estimating the tolerance tuning parameter, based on resampling from the asymptotic normal distribution of the given point-estimator. This tolerance estimator can be quickly computed even for any model for which it is computationally costly to sample directly from its exact likelihood, provided that its summary statistic is specified as consistent point-estimator of the model parameters with estimated asymptotic normal distribution that can typically be easily sampled from. Furthermore, this paper introduces and studies a new ABC method based on approximating the exact intractable likelihood by the asymptotic normal density of the point-estimator, motivated by the Bernstein-Von Mises theorem. Unlike the classical ABC method, this new approach does not require tuning parameters, aside from the summary statistic (the parameter point estimate). Each of the new ABC methods is illustrated and compared through a simulation study of tractable models and intractable likelihood models, and through the Bayesian intractable likelihood analysis of a real 23,000-node network dataset involving stochastic search model selection.

Suggested Citation

  • George Karabatsos, 2023. "Approximate Bayesian computation using asymptotically normal point estimates," Computational Statistics, Springer, vol. 38(2), pages 531-568, June.
  • Handle: RePEc:spr:compst:v:38:y:2023:i:2:d:10.1007_s00180-022-01226-3
    DOI: 10.1007/s00180-022-01226-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00180-022-01226-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s00180-022-01226-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Mikael Sunnåker & Alberto Giovanni Busetto & Elina Numminen & Jukka Corander & Matthieu Foll & Christophe Dessimoz, 2013. "Approximate Bayesian Computation," PLOS Computational Biology, Public Library of Science, vol. 9(1), pages 1-10, January.
    2. Richard Royall & Tsung‐Shan Tsou, 2003. "Interpreting statistical evidence by using imperfect models: robust adjusted likelihood functions," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 65(2), pages 391-404, May.
    3. Brouste, Alexandre & Fukasawa, Masaaki & Hino, Hideitsu & Iacus, Stefano & Kamatani, Kengo & Koike, Yuta & Masuda, Hiroki & Nomura, Ryosuke & Ogihara, Teppei & Shimuzu, Yasutaka & Uchida, Masayuki & Y, 2014. "The YUIMA Project: A Computational Framework for Simulation and Inference of Stochastic Differential Equations," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 57(i04).
    4. Wentao Li & Paul Fearnhead, 2018. "On the asymptotic efficiency of approximate Bayesian computation estimators," Biometrika, Biometrika Trust, vol. 105(2), pages 285-299.
    5. Drovandi, Christopher C. & Pettitt, Anthony N., 2011. "Likelihood-free Bayesian estimation of multivariate quantile distributions," Computational Statistics & Data Analysis, Elsevier, vol. 55(9), pages 2541-2556, September.
    6. D T Frazier & G M Martin & C P Robert & J Rousseau, 2018. "Asymptotic properties of approximate Bayesian computation," Biometrika, Biometrika Trust, vol. 105(3), pages 593-607.
    7. repec:dau:papers:123456789/5724 is not listed on IDEAS
    8. Rodrigues, G.S. & Prangle, D. & Sisson, S.A., 2018. "Recalibration: A post-processing method for approximate Bayesian computation," Computational Statistics & Data Analysis, Elsevier, vol. 126(C), pages 53-66.
    9. Lee, Lung-Fei, 1993. "Asymptotic Distribution of the Maximum Likelihood Estimator for a Stochastic Frontier Function Model with a Singular Information Matrix," Econometric Theory, Cambridge University Press, vol. 9(3), pages 413-430, June.
    10. van der Vaart, Elske & Beaumont, Mark A. & Johnston, Alice S.A. & Sibly, Richard M., 2015. "Calibration and evaluation of individual-based models using Approximate Bayesian Computation," Ecological Modelling, Elsevier, vol. 312(C), pages 182-190.
    11. Christopher C. Drovandi & Anthony N. Pettitt & Malcolm J. Faddy, 2011. "Approximate Bayesian computation using indirect inference," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 60(3), pages 317-337, May.
    12. Matti Vihola & Jordan Franks, 2020. "On the use of approximate Bayesian computation Markov chain Monte Carlo with inflated tolerance and post-correction," Biometrika, Biometrika Trust, vol. 107(2), pages 381-395.
    13. Krivitsky, Pavel N., 2017. "Using contrastive divergence to seed Monte Carlo MLE for exponential-family random graph models," Computational Statistics & Data Analysis, Elsevier, vol. 107(C), pages 149-161.
    14. Fei Jin & Lung-fei Lee, 2018. "Lasso Maximum Likelihood Estimation of Parametric Models with Singular Information Matrices," Econometrics, MDPI, vol. 6(1), pages 1-24, February.
    15. Hyungtae Hwang & Beongsoo So & Yongdai Kim, 2005. "On limiting posterior distributions," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 14(2), pages 567-580, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Henri Pesonen & Umberto Simola & Alvaro Köhn‐Luque & Henri Vuollekoski & Xiaoran Lai & Arnoldo Frigessi & Samuel Kaski & David T. Frazier & Worapree Maneesoonthorn & Gael M. Martin & Jukka Corander, 2023. "ABC of the future," International Statistical Review, International Statistical Institute, vol. 91(2), pages 243-268, August.
    2. Gael M. Martin & David T. Frazier & Christian P. Robert, 2020. "Computing Bayes: Bayesian Computation from 1763 to the 21st Century," Monash Econometrics and Business Statistics Working Papers 14/20, Monash University, Department of Econometrics and Business Statistics.
    3. Espen Bernton & Pierre E. Jacob & Mathieu Gerber & Christian P. Robert, 2019. "Approximate Bayesian computation with the Wasserstein distance," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 81(2), pages 235-269, April.
    4. Gael M. Martin & David T. Frazier & Christian P. Robert, 2021. "Approximating Bayes in the 21st Century," Monash Econometrics and Business Statistics Working Papers 24/21, Monash University, Department of Econometrics and Business Statistics.
    5. Luis Alvarez & Cristine Pinto & Vladimir Ponczek, 2022. "Homophily in preferences or meetings? Identifying and estimating an iterative network formation model," Papers 2201.06694, arXiv.org, revised Mar 2024.
    6. Aushev, Alexander & Pesonen, Henri & Heinonen, Markus & Corander, Jukka & Kaski, Samuel, 2022. "Likelihood-free inference with deep Gaussian processes," Computational Statistics & Data Analysis, Elsevier, vol. 174(C).
    7. Frazier, David T. & Maneesoonthorn, Worapree & Martin, Gael M. & McCabe, Brendan P.M., 2019. "Approximate Bayesian forecasting," International Journal of Forecasting, Elsevier, vol. 35(2), pages 521-539.
    8. Chapron, Guillaume & Wikenros, Camilla & Liberg, Olof & Wabakken, Petter & Flagstad, Øystein & Milleret, Cyril & Månsson, Johan & Svensson, Linn & Zimmermann, Barbara & Åkesson, Mikael & Sand, Håkan, 2016. "Estimating wolf (Canis lupus) population size from number of packs and an individual based model," Ecological Modelling, Elsevier, vol. 339(C), pages 33-44.
    9. Wilkinson Richard David, 2013. "Approximate Bayesian computation (ABC) gives exact results under the assumption of model error," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 12(2), pages 129-141, May.
    10. Lee, Xing Ju & Hainy, Markus & McKeone, James P. & Drovandi, Christopher C. & Pettitt, Anthony N., 2018. "ABC model selection for spatial extremes models applied to South Australian maximum temperature data," Computational Statistics & Data Analysis, Elsevier, vol. 128(C), pages 128-144.
    11. Yi Liu & Veronika Ročková & Yuexi Wang, 2021. "Variable selection with ABC Bayesian forests," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 83(3), pages 453-481, July.
    12. Chaya Weerasinghe & Ruben Loaiza-Maya & Gael M. Martin & David T. Frazier, 2023. "ABC-based Forecasting in State Space Models," Monash Econometrics and Business Statistics Working Papers 12/23, Monash University, Department of Econometrics and Business Statistics.
    13. Long, Hongwei & Ma, Chunhua & Shimizu, Yasutaka, 2017. "Least squares estimators for stochastic differential equations driven by small Lévy noises," Stochastic Processes and their Applications, Elsevier, vol. 127(5), pages 1475-1495.
    14. Hemant Kulkarni & Jayabrata Biswas & Kiranmoy Das, 2019. "A joint quantile regression model for multiple longitudinal outcomes," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 103(4), pages 453-473, December.
    15. D.T. Frazier & G.M. Martin & C.P. Robert & J. Rousseau, 2016. "Asymptotic Properties of Approximate Bayesian Computation," Monash Econometrics and Business Statistics Working Papers 18/16, Monash University, Department of Econometrics and Business Statistics.
    16. Iacus, Stefano M. & Mercuri, Lorenzo & Rroji, Edit, 2017. "COGARCH(p, q): Simulation and Inference with the yuima Package," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 80(i04).
    17. Smith, Simon C. & Timmermann, Allan & Zhu, Yinchu, 2019. "Variable selection in panel models with breaks," Journal of Econometrics, Elsevier, vol. 212(1), pages 323-344.
    18. Li, J. & Nott, D.J. & Fan, Y. & Sisson, S.A., 2017. "Extending approximate Bayesian computation methods to high dimensions via a Gaussian copula model," Computational Statistics & Data Analysis, Elsevier, vol. 106(C), pages 77-89.
    19. Zhiwei Zhang, 2010. "Profile Likelihood and Incomplete Data," International Statistical Review, International Statistical Institute, vol. 78(1), pages 102-116, April.
    20. Forneron, Jean-Jacques & Ng, Serena, 2018. "The ABC of simulation estimation with auxiliary statistics," Journal of Econometrics, Elsevier, vol. 205(1), pages 112-139.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:compst:v:38:y:2023:i:2:d:10.1007_s00180-022-01226-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.