IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0285836.html
   My bibliography  Save this article

Informative and adaptive distances and summary statistics in sequential approximate Bayesian computation

Author

Listed:
  • Yannik Schälte
  • Jan Hasenauer

Abstract

Calibrating model parameters on heterogeneous data can be challenging and inefficient. This holds especially for likelihood-free methods such as approximate Bayesian computation (ABC), which rely on the comparison of relevant features in simulated and observed data and are popular for otherwise intractable problems. To address this problem, methods have been developed to scale-normalize data, and to derive informative low-dimensional summary statistics using inverse regression models of parameters on data. However, while approaches only correcting for scale can be inefficient on partly uninformative data, the use of summary statistics can lead to information loss and relies on the accuracy of employed methods. In this work, we first show that the combination of adaptive scale normalization with regression-based summary statistics is advantageous on heterogeneous parameter scales. Second, we present an approach employing regression models not to transform data, but to inform sensitivity weights quantifying data informativeness. Third, we discuss problems for regression models under non-identifiability, and present a solution using target augmentation. We demonstrate improved accuracy and efficiency of the presented approach on various problems, in particular robustness and wide applicability of the sensitivity weights. Our findings demonstrate the potential of the adaptive approach. The developed algorithms have been made available in the open-source Python toolbox pyABC.

Suggested Citation

  • Yannik Schälte & Jan Hasenauer, 2023. "Informative and adaptive distances and summary statistics in sequential approximate Bayesian computation," PLOS ONE, Public Library of Science, vol. 18(5), pages 1-21, May.
  • Handle: RePEc:plo:pone00:0285836
    DOI: 10.1371/journal.pone.0285836
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0285836
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0285836&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0285836?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Pierre Del Moral & Arnaud Doucet & Ajay Jasra, 2006. "Sequential Monte Carlo samplers," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(3), pages 411-436, June.
    2. Paul Fearnhead & Dennis Prangle, 2012. "Constructing summary statistics for approximate Bayesian computation: semi-automatic approximate Bayesian computation," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 74(3), pages 419-474, June.
    3. Wentao Li & Paul Fearnhead, 2018. "On the asymptotic efficiency of approximate Bayesian computation estimators," Biometrika, Biometrika Trust, vol. 105(2), pages 285-299.
    4. David T. Frazier & Christian P. Robert & Judith Rousseau, 2020. "Model misspecification in approximate Bayesian computation: consequences and diagnostics," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 82(2), pages 421-444, April.
    5. Nunes Matthew A & Balding David J, 2010. "On Optimal Selection of Summary Statistics for Approximate Bayesian Computation," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 9(1), pages 1-16, September.
    6. D T Frazier & G M Martin & C P Robert & J Rousseau, 2018. "Asymptotic properties of approximate Bayesian computation," Biometrika, Biometrika Trust, vol. 105(3), pages 593-607.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gael M. Martin & David T. Frazier & Christian P. Robert, 2020. "Computing Bayes: Bayesian Computation from 1763 to the 21st Century," Monash Econometrics and Business Statistics Working Papers 14/20, Monash University, Department of Econometrics and Business Statistics.
    2. Gael M. Martin & David T. Frazier & Christian P. Robert, 2021. "Approximating Bayes in the 21st Century," Monash Econometrics and Business Statistics Working Papers 24/21, Monash University, Department of Econometrics and Business Statistics.
    3. Henri Pesonen & Umberto Simola & Alvaro Köhn‐Luque & Henri Vuollekoski & Xiaoran Lai & Arnoldo Frigessi & Samuel Kaski & David T. Frazier & Worapree Maneesoonthorn & Gael M. Martin & Jukka Corander, 2023. "ABC of the future," International Statistical Review, International Statistical Institute, vol. 91(2), pages 243-268, August.
    4. Espen Bernton & Pierre E. Jacob & Mathieu Gerber & Christian P. Robert, 2019. "Approximate Bayesian computation with the Wasserstein distance," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 81(2), pages 235-269, April.
    5. Weerasinghe, Chaya & Loaiza-Maya, Rubén & Martin, Gael M. & Frazier, David T., 2025. "ABC-based forecasting in misspecified state space models," International Journal of Forecasting, Elsevier, vol. 41(1), pages 270-289.
    6. Frazier, David T. & Maneesoonthorn, Worapree & Martin, Gael M. & McCabe, Brendan P.M., 2019. "Approximate Bayesian forecasting," International Journal of Forecasting, Elsevier, vol. 35(2), pages 521-539.
    7. Lee, Xing Ju & Hainy, Markus & McKeone, James P. & Drovandi, Christopher C. & Pettitt, Anthony N., 2018. "ABC model selection for spatial extremes models applied to South Australian maximum temperature data," Computational Statistics & Data Analysis, Elsevier, vol. 128(C), pages 128-144.
    8. Chaya Weerasinghe & Ruben Loaiza-Maya & Gael M. Martin & David T. Frazier, 2023. "ABC-based Forecasting in State Space Models," Monash Econometrics and Business Statistics Working Papers 12/23, Monash University, Department of Econometrics and Business Statistics.
    9. Luis Alvarez & Cristine Pinto & Vladimir Ponczek, 2022. "Homophily in preferences or meetings? Identifying and estimating an iterative network formation model," Papers 2201.06694, arXiv.org, revised Mar 2025.
    10. Li, J. & Nott, D.J. & Fan, Y. & Sisson, S.A., 2017. "Extending approximate Bayesian computation methods to high dimensions via a Gaussian copula model," Computational Statistics & Data Analysis, Elsevier, vol. 106(C), pages 77-89.
    11. George Karabatsos, 2023. "Approximate Bayesian computation using asymptotically normal point estimates," Computational Statistics, Springer, vol. 38(2), pages 531-568, June.
    12. Florian Maire & Nial Friel & Pierre ALQUIER, 2017. "Informed Sub-Sampling MCMC: Approximate Bayesian Inference for Large Datasets," Working Papers 2017-40, Center for Research in Economics and Statistics.
    13. D T Frazier & G M Martin & C P Robert & J Rousseau, 2018. "Asymptotic properties of approximate Bayesian computation," Biometrika, Biometrika Trust, vol. 105(3), pages 593-607.
    14. Christopher C. Drovandi & Anthony N. Pettitt, 2013. "Bayesian Experimental Design for Models with Intractable Likelihoods," Biometrics, The International Biometric Society, vol. 69(4), pages 937-948, December.
    15. Baey, Charlotte & Smith, Henrik G. & Rundlöf, Maj & Olsson, Ola & Clough, Yann & Sahlin, Ullrika, 2023. "Calibration of a bumble bee foraging model using Approximate Bayesian Computation," Ecological Modelling, Elsevier, vol. 477(C).
    16. Jonathan U Harrison & Ruth E Baker, 2020. "An automatic adaptive method to combine summary statistics in approximate Bayesian computation," PLOS ONE, Public Library of Science, vol. 15(8), pages 1-21, August.
    17. Prangle Dennis & Fearnhead Paul & Cox Murray P. & Biggs Patrick J. & French Nigel P., 2014. "Semi-automatic selection of summary statistics for ABC model choice," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 13(1), pages 67-82, February.
    18. Christian P. Robert, 2013. "Bayesian Computational Tools," Working Papers 2013-45, Center for Research in Economics and Statistics.
    19. Buzbas, Erkan O. & Rosenberg, Noah A., 2015. "AABC: Approximate approximate Bayesian computation for inference in population-genetic models," Theoretical Population Biology, Elsevier, vol. 99(C), pages 31-42.
    20. Gareth W. Peters & Efstathios Panayi & Francois Septier, 2015. "SMC-ABC methods for the estimation of stochastic simulation models of the limit order book," Papers 1504.05806, arXiv.org.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0285836. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.