IDEAS home Printed from https://ideas.repec.org/p/aub/autbar/950.15.html
   My bibliography  Save this paper

On Selection of Statistics for Approximate Bayesian Computing or the Method of Simulated Moments

Author

Listed:
  • Michael Creel
  • Dennis Kristensen

Abstract

This paper presents a cross validation method for selection of statistics for Approximate Bayesian Computing, and for related estimation methods such as the Method of Simulated Moments. The method uses simulated annealing to minimize the cross validation criterion over a combinatorial search space that may contain many, many elements. An example, for which optimal statistics are known from theory, shows that the method is able to select optimal statistics out of a large set of candidate statistics.

Suggested Citation

  • Michael Creel & Dennis Kristensen, 2015. "On Selection of Statistics for Approximate Bayesian Computing or the Method of Simulated Moments," UFAE and IAE Working Papers 950.15, Unitat de Fonaments de l'Anàlisi Econòmica (UAB) and Institut d'Anàlisi Econòmica (CSIC), revised 27 Feb 2015.
    • Handle: RePEc:aub:autbar:950.15
    as

    Download full text from publisher

    File URL: http://pareto.uab.es/wp/2015/95015.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. C. C. Drovandi & A. N. Pettitt, 2011. "Estimation of Parameters for Macroparasite Population Evolution Using Approximate Bayesian Computation," Biometrics, The International Biometric Society, vol. 67(1), pages 225-233, March.
    2. Hall, Alastair R. & Inoue, Atsushi & Nason, James M. & Rossi, Barbara, 2012. "Information criteria for impulse response function matching estimation of DSGE models," Journal of Econometrics, Elsevier, vol. 170(2), pages 499-518.
    3. Gourieroux, C & Monfort, A & Renault, E, 1993. "Indirect Inference," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 8(S), pages 85-118, Suppl. De.
    4. Hansen, Lars Peter, 1982. "Large Sample Properties of Generalized Method of Moments Estimators," Econometrica, Econometric Society, vol. 50(4), pages 1029-1054, July.
    5. Smith, A A, Jr, 1993. "Estimating Nonlinear Time-Series Models Using Simulated Vector Autoregressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 8(S), pages 63-84, Suppl. De.
    6. Paul Fearnhead & Dennis Prangle, 2012. "Constructing summary statistics for approximate Bayesian computation: semi-automatic approximate Bayesian computation," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 74(3), pages 419-474, June.
    7. Peter Hall & Jeff Racine & Qi Li, 2004. "Cross-Validation and the Estimation of Conditional Probability Densities," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 1015-1026, December.
    8. Michael Creel & Dennis Kristensen, "undated". "Indirect Likelihood Inference," Working Papers 558, Barcelona School of Economics.
    9. repec:dau:papers:123456789/5724 is not listed on IDEAS
    10. Goffe, William L. & Ferrier, Gary D. & Rogers, John, 1994. "Global optimization of statistical functions with simulated annealing," Journal of Econometrics, Elsevier, vol. 60(1-2), pages 65-99.
    11. Stock, James H & Wright, Jonathan H & Yogo, Motohiro, 2002. "A Survey of Weak Instruments and Weak Identification in Generalized Method of Moments," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(4), pages 518-529, October.
    12. Andrews, Donald W. K. & Lu, Biao, 2001. "Consistent model and moment selection procedures for GMM estimation with application to dynamic panel data models," Journal of Econometrics, Elsevier, vol. 101(1), pages 123-164, March.
    13. Torben G. Andersen & Tim Bollerslev & Francis X. Diebold, 2007. "Roughing It Up: Including Jump Components in the Measurement, Modeling, and Forecasting of Return Volatility," The Review of Economics and Statistics, MIT Press, vol. 89(4), pages 701-720, November.
    14. Gallant, A. Ronald & Tauchen, George, 1996. "Which Moments to Match?," Econometric Theory, Cambridge University Press, vol. 12(4), pages 657-681, October.
    15. Creel, Michael & Kristensen, Dennis, 2015. "ABC of SV: Limited information likelihood inference in stochastic volatility jump-diffusion models," Journal of Empirical Finance, Elsevier, vol. 31(C), pages 85-108.
    16. Xu Cheng & Zhipeng Liao, 2012. "Select the Valid and Relevant Moments: A One-Step Procedure for GMM with Many Moments," PIER Working Paper Archive 12-045, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    17. McFadden, Daniel, 1989. "A Method of Simulated Moments for Estimation of Discrete Response Models without Numerical Integration," Econometrica, Econometric Society, vol. 57(5), pages 995-1026, September.
    18. Michael P. Murray, 2006. "Avoiding Invalid Instruments and Coping with Weak Instruments," Journal of Economic Perspectives, American Economic Association, vol. 20(4), pages 111-132, Fall.
    19. Wu, Lihua & Wang, Yuyun, 1998. "An Introduction to Simulated Annealing Algorithms for the Computation of Economic Equilibrium," Computational Economics, Springer;Society for Computational Economics, vol. 12(2), pages 151-169, October.
    20. Chernozhukov, Victor & Hong, Han, 2003. "An MCMC approach to classical estimation," Journal of Econometrics, Elsevier, vol. 115(2), pages 293-346, August.
    21. Nunes Matthew A & Balding David J, 2010. "On Optimal Selection of Summary Statistics for Approximate Bayesian Computation," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 9(1), pages 1-16, September.
    22. Tauchen, George, 1986. "Statistical Properties of Generalized Method-of-Moments Estimators of Structural Parameters Obtained from Financial Market Data: Reply," Journal of Business & Economic Statistics, American Statistical Association, vol. 4(4), pages 423-425, October.
    23. Joyce Paul & Marjoram Paul, 2008. "Approximately Sufficient Statistics and Bayesian Computation," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 7(1), pages 1-18, August.
    24. Michael Creel & Dennis Kristensen, 2013. "Indirect Likelihood Inference (revised)," UFAE and IAE Working Papers 931.13, Unitat de Fonaments de l'Anàlisi Econòmica (UAB) and Institut d'Anàlisi Econòmica (CSIC).
    25. Tauchen, George, 1986. "Statistical Properties of Generalized Method-of-Moments Estimators of Structural Parameters Obtained from Financial Market Data," Journal of Business & Economic Statistics, American Statistical Association, vol. 4(4), pages 397-416, October.
    26. Mark A. Beaumont & Jean-Marie Cornuet & Jean-Michel Marin & Christian P. Robert, 2009. "Adaptive approximate Bayesian computation," Biometrika, Biometrika Trust, vol. 96(4), pages 983-990.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Creel, Michael, 2017. "Neural nets for indirect inference," Econometrics and Statistics, Elsevier, vol. 2(C), pages 36-49.
    2. Valerio Scalone, 2018. "Estimating Non-Linear DSGEs with the Approximate Bayesian Computation: an application to the Zero Lower Bound," Working papers 688, Banque de France.
    3. Michael Creel, 2016. "Neural Nets for Indirect Inference," UFAE and IAE Working Papers 960.16, Unitat de Fonaments de l'Anàlisi Econòmica (UAB) and Institut d'Anàlisi Econòmica (CSIC), revised 18 Jul 2016.
    4. Boucher, Vincent, 2020. "Equilibrium homophily in networks," European Economic Review, Elsevier, vol. 123(C).
    5. Vincent Boucher, 2017. "The Estimation of Network Formation Games with Positive Spillovers," Cahiers de recherche 1710, Centre de recherche sur les risques, les enjeux économiques, et les politiques publiques.
    6. Michael Creel & Jiti Gao & Han Hong & Dennis Kristensen, 2016. "Bayesian Indirect Inference and the ABC of GMM," Monash Econometrics and Business Statistics Working Papers 1/16, Monash University, Department of Econometrics and Business Statistics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Michael Creel, 2021. "Inference Using Simulated Neural Moments," Econometrics, MDPI, vol. 9(4), pages 1-15, September.
    2. Forneron, Jean-Jacques & Ng, Serena, 2018. "The ABC of simulation estimation with auxiliary statistics," Journal of Econometrics, Elsevier, vol. 205(1), pages 112-139.
    3. Mardi Dungey & Vitali Alexeev & Jing Tian & Alastair R. Hall, 2015. "Econometricians Have Their Moments: GMM at 32," The Economic Record, The Economic Society of Australia, vol. 91, pages 1-24, June.
    4. Alastair R. Hall, 2015. "Econometricians Have Their Moments: GMM at 32," The Economic Record, The Economic Society of Australia, vol. 91(S1), pages 1-24, June.
    5. Prosper Donovon & Alastair R. Hall, 2015. "GMM and Indirect Inference: An appraisal of their connections and new results on their properties under second order identification," Economics Discussion Paper Series 1505, Economics, The University of Manchester.
    6. Michael Creel & Dennis Kristensen, 2013. "Indirect Likelihood Inference (revised)," UFAE and IAE Working Papers 931.13, Unitat de Fonaments de l'Anàlisi Econòmica (UAB) and Institut d'Anàlisi Econòmica (CSIC).
    7. Creel, Michael, 2017. "Neural nets for indirect inference," Econometrics and Statistics, Elsevier, vol. 2(C), pages 36-49.
    8. Creel, Michael & Kristensen, Dennis, 2015. "ABC of SV: Limited information likelihood inference in stochastic volatility jump-diffusion models," Journal of Empirical Finance, Elsevier, vol. 31(C), pages 85-108.
    9. Kristensen, Dennis & Shin, Yongseok, 2012. "Estimation of dynamic models with nonparametric simulated maximum likelihood," Journal of Econometrics, Elsevier, vol. 167(1), pages 76-94.
    10. Gael M. Martin & David T. Frazier & Christian P. Robert, 2020. "Computing Bayes: Bayesian Computation from 1763 to the 21st Century," Monash Econometrics and Business Statistics Working Papers 14/20, Monash University, Department of Econometrics and Business Statistics.
    11. Michael Creel & Dennis Kristensen, "undated". "Indirect Likelihood Inference," Working Papers 558, Barcelona School of Economics.
    12. Michael Creel, 2016. "Neural Nets for Indirect Inference," UFAE and IAE Working Papers 960.16, Unitat de Fonaments de l'Anàlisi Econòmica (UAB) and Institut d'Anàlisi Econòmica (CSIC), revised 18 Jul 2016.
    13. Ruge-Murcia, Francisco J., 2007. "Methods to estimate dynamic stochastic general equilibrium models," Journal of Economic Dynamics and Control, Elsevier, vol. 31(8), pages 2599-2636, August.
    14. Ramdan Dridi & Eric Renault, 2000. "Semi-Parametric Indirect Inference," STICERD - Econometrics Paper Series 392, Suntory and Toyota International Centres for Economics and Related Disciplines, LSE.
    15. Ramdan Dridi, 2000. "Simulated Asymptotic Least Squares Theory," STICERD - Econometrics Paper Series 396, Suntory and Toyota International Centres for Economics and Related Disciplines, LSE.
    16. Frazier, David T. & Maneesoonthorn, Worapree & Martin, Gael M. & McCabe, Brendan P.M., 2019. "Approximate Bayesian forecasting," International Journal of Forecasting, Elsevier, vol. 35(2), pages 521-539.
    17. Jesús Fernández-Villaverde & Juan F. Rubio-Ramírez, 2007. "Estimating Macroeconomic Models: A Likelihood Approach," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 74(4), pages 1059-1087.
    18. Heinz König & Michael Lechner, 1994. "Some Recent Developments in Microeconometrics - A Survey," Swiss Journal of Economics and Statistics (SJES), Swiss Society of Economics and Statistics (SSES), vol. 130(III), pages 299-331, September.
    19. Tauchen, George E., 1995. "New Minimum Chi-Square Methods in Empirical Finance," Working Papers 95-42, Duke University, Department of Economics.
    20. Matteo Barigozzi & Roxana Halbleib & David Veredas, 2012. "Which model to match?," Working Papers 1229, Banco de España.

    More about this item

    Keywords

    Approximate Bayesian Computation; likelihood-free methods; selection of statistics; method of simulated moments;
    All these keywords.

    JEL classification:

    • E24 - Macroeconomics and Monetary Economics - - Consumption, Saving, Production, Employment, and Investment - - - Employment; Unemployment; Wages; Intergenerational Income Distribution; Aggregate Human Capital; Aggregate Labor Productivity
    • O41 - Economic Development, Innovation, Technological Change, and Growth - - Economic Growth and Aggregate Productivity - - - One, Two, and Multisector Growth Models

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:aub:autbar:950.15. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Xavier Vila (email available below). General contact details of provider: https://edirc.repec.org/data/ufuabes.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.