IDEAS home Printed from https://ideas.repec.org/p/msh/ebswps/2015-19.html
   My bibliography  Save this paper

On Consistency of Approximate Bayesian Computation

Author

Listed:
  • David T. Frazier
  • Gael M. Martin
  • Christian P. Robert

Abstract

Approximate Bayesian computation (ABC) methods have become increasingly prevalent of late, facilitating as they do the analysis of intractable, or challenging, statistical problems. With the initial focus being primarily on the practical import of ABC, exploration of its formal statistical properties has begun to attract more attention. The aim of this paper is to establish general conditions under which ABC methods are Bayesian consistent, in the sense of producing draws that yield a degenerate posterior distribution at the true parameter (vector) asymptotically (in the sample size). We derive conditions under which arbitrary summary statistics yield consistent inference in the Bayesian sense, with these conditions linked to identiÖcation of the true parameters. Using simple illustrative examples that have featured in the literature, we demonstrate that identiÖcation, and hence consistency, is unlikely to be achieved in many cases, and propose a simple diagnostic procedure that can indicate the presence of this problem. We also formally explore the link between consistency and the use of auxiliary models within ABC, and illustrate the subsequent results in the Lotka-Volterra predator-prey model.

Suggested Citation

  • David T. Frazier & Gael M. Martin & Christian P. Robert, 2015. "On Consistency of Approximate Bayesian Computation," Monash Econometrics and Business Statistics Working Papers 19/15, Monash University, Department of Econometrics and Business Statistics.
  • Handle: RePEc:msh:ebswps:2015-19
    as

    Download full text from publisher

    File URL: https://www.monash.edu/__data/assets/pdf_file/0011/925877/wp19-15.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Duffie, Darrell & Singleton, Kenneth J, 1993. "Simulated Moments Estimation of Markov Models of Asset Prices," Econometrica, Econometric Society, vol. 61(4), pages 929-952, July.
    2. repec:dau:papers:123456789/7848 is not listed on IDEAS
    3. Creel, Michael & Kristensen, Dennis, 2015. "ABC of SV: Limited information likelihood inference in stochastic volatility jump-diffusion models," Journal of Empirical Finance, Elsevier, vol. 31(C), pages 85-108.
    4. McFadden, Daniel, 1989. "A Method of Simulated Moments for Estimation of Discrete Response Models without Numerical Integration," Econometrica, Econometric Society, vol. 57(5), pages 995-1026, September.
    5. Pakes, Ariel & Pollard, David, 1989. "Simulation and the Asymptotics of Optimization Estimators," Econometrica, Econometric Society, vol. 57(5), pages 1027-1057, September.
    6. Paul Fearnhead & Dennis Prangle, 2012. "Constructing summary statistics for approximate Bayesian computation: semi-automatic approximate Bayesian computation," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 74(3), pages 419-474, June.
    7. Christopher C. Drovandi & Anthony N. Pettitt & Malcolm J. Faddy, 2011. "Approximate Bayesian computation using indirect inference," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 60(3), pages 317-337, May.
    8. Jean-Michel Marin & Natesh S. Pillai & Christian P. Robert & Judith Rousseau, 2014. "Relevant statistics for Bayesian model choice," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 76(5), pages 833-859, November.
    9. Gourieroux, C & Monfort, A & Renault, E, 1993. "Indirect Inference," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 8(S), pages 85-118, Suppl. De.
    10. Knut Heggland & Arnoldo Frigessi, 2004. "Estimating functions in indirect inference," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 66(2), pages 447-462, May.
    11. Blum, Michael G. B., 2010. "Approximate Bayesian Computation: A Nonparametric Perspective," Journal of the American Statistical Association, American Statistical Association, vol. 105(491), pages 1178-1187.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. D.T. Frazier & G.M. Martin & C.P. Robert & J. Rousseau, 2016. "Asymptotic Properties of Approximate Bayesian Computation," Monash Econometrics and Business Statistics Working Papers 18/16, Monash University, Department of Econometrics and Business Statistics.
    2. Calvet, Laurent E. & Czellar, Veronika, 2015. "Through the looking glass: Indirect inference via simple equilibria," Journal of Econometrics, Elsevier, vol. 185(2), pages 343-358.
    3. Frazier, David T. & Oka, Tatsushi & Zhu, Dan, 2019. "Indirect inference with a non-smooth criterion function," Journal of Econometrics, Elsevier, vol. 212(2), pages 623-645.
    4. Gael M. Martin & Brendan P.M. McCabe & David T. Frazier & Worapree Maneesoonthorn & Christian P. Robert, 2016. "Auxiliary Likelihood-Based Approximate Bayesian Computation in State Space Models," Monash Econometrics and Business Statistics Working Papers 09/16, Monash University, Department of Econometrics and Business Statistics.
    5. Efstathios Panayi & Gareth Peters, 2015. "Stochastic simulation framework for the Limit Order Book using liquidity motivated agents," Papers 1501.02447, arXiv.org, revised Jan 2015.
    6. Ghysels, E. & Harvey, A. & Renault, E., 1995. "Stochastic Volatility," Papers 95.400, Toulouse - GREMAQ.
    7. Forneron, Jean-Jacques & Ng, Serena, 2018. "The ABC of simulation estimation with auxiliary statistics," Journal of Econometrics, Elsevier, vol. 205(1), pages 112-139.
    8. Niyousha Hosseinichimeh & Hazhir Rahmandad & Mohammad S. Jalali & Andrea K. Wittenborn, 2016. "Estimating the parameters of system dynamics models using indirect inference," System Dynamics Review, System Dynamics Society, vol. 32(2), pages 154-178, April.
    9. Liesenfeld, Roman & Breitung, Jörg, 1998. "Simulation based methods of moments in empirical finance," Tübinger Diskussionsbeiträge 136, University of Tübingen, School of Business and Economics.
    10. Ghysels, Eric & Guay, Alain, 2004. "Testing For Structural Change In The Presence Of Auxiliary Models," Econometric Theory, Cambridge University Press, vol. 20(6), pages 1168-1202, December.
    11. Ramdan Dridi & Eric Renault, 2000. "Semi-Parametric Indirect Inference," STICERD - Econometrics Paper Series 392, Suntory and Toyota International Centres for Economics and Related Disciplines, LSE.
    12. Di Iorio, Francesca & Calzolari, Giorgio, 2006. "Discontinuities in indirect estimation: An application to EAR models," Computational Statistics & Data Analysis, Elsevier, vol. 50(8), pages 2124-2136, April.
    13. Santos, Manuel S., 2004. "Simulation-based estimation of dynamic models with continuous equilibrium solutions," Journal of Mathematical Economics, Elsevier, vol. 40(3-4), pages 465-491, June.
    14. Ramdan Dridi, 2000. "Simulated Asymptotic Least Squares Theory," STICERD - Econometrics Paper Series 396, Suntory and Toyota International Centres for Economics and Related Disciplines, LSE.
    15. Frazier, David T. & Maneesoonthorn, Worapree & Martin, Gael M. & McCabe, Brendan P.M., 2019. "Approximate Bayesian forecasting," International Journal of Forecasting, Elsevier, vol. 35(2), pages 521-539.
    16. Gael M. Martin & Brendan P.M. McCabe & Worapree Maneesoonthorn & Christian P. Robert, 2014. "Approximate Bayesian Computation in State Space Models," Monash Econometrics and Business Statistics Working Papers 20/14, Monash University, Department of Econometrics and Business Statistics.
    17. Tauchen, George E., 1995. "New Minimum Chi-Square Methods in Empirical Finance," Working Papers 95-42, Duke University, Department of Economics.
    18. Creel, Michael, 2017. "Neural nets for indirect inference," Econometrics and Statistics, Elsevier, vol. 2(C), pages 36-49.
    19. Santos, Manuel S., 2003. "Simulation-based estimation of dynamic models with continuous equilibrium solutions," UC3M Working papers. Economics we034716, Universidad Carlos III de Madrid. Departamento de Economía.
    20. Creel, Michael & Kristensen, Dennis, 2016. "On selection of statistics for approximate Bayesian computing (or the method of simulated moments)," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 99-114.

    More about this item

    Keywords

    Bayesian consistency; likelihood-free methods; conditioning; auxiliary modelbased ABC; ordinary differential equations; Lotka-Volterra model.;
    All these keywords.

    JEL classification:

    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
    • C18 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Methodolical Issues: General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:msh:ebswps:2015-19. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Professor Xibin Zhang (email available below). General contact details of provider: https://edirc.repec.org/data/dxmonau.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.