IDEAS home Printed from https://ideas.repec.org/p/bge/wpaper/942.html
   My bibliography  Save this paper

Neural Nets for Indirect Inference

Author

Listed:
  • Michael Creel

Abstract

For simulable models, neural networks are used to approximate the limited information posterior mean, which conditions on a vector of statistics, rather than on the full sample. Because the model is simulable, training and testing samples may be generated with sizes large enough to train well a net that is large enough, in terms of number of hidden layers and neurons, to learn the limited information posterior mean with good accuracy. Targeting the limited information posterior mean using neural nets is simpler, faster, and more successful than is targeting the full information posterior mean, which conditions on the observed sample. The output of the trained net can be used directly as an estimator of the model’s parameters, or as an input to subsequent classical or Bayesian indirect inference estimation. Examples of indirect inference based on the out- put of the net include a small dynamic stochastic general equilibrium model, estimated using both classical indirect inference methods and approximate Bayesian computing (ABC) methods, and a continuous time jump-diffusion model for stock index returns, estimated using ABC.

Suggested Citation

  • Michael Creel, 2016. "Neural Nets for Indirect Inference," Working Papers 942, Barcelona School of Economics.
  • Handle: RePEc:bge:wpaper:942
    as

    Download full text from publisher

    File URL: https://www.barcelonagse.eu/sites/default/files/working_paper_pdfs/942.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Gourieroux, C & Monfort, A & Renault, E, 1993. "Indirect Inference," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 8(S), pages 85-118, Suppl. De.
    2. Michael Creel & Dennis Kristensen, "undated". "Indirect Likelihood Inference," Working Papers 558, Barcelona School of Economics.
    3. Creel, Michael & Kristensen, Dennis, 2015. "ABC of SV: Limited information likelihood inference in stochastic volatility jump-diffusion models," Journal of Empirical Finance, Elsevier, vol. 31(C), pages 85-108.
    4. McFadden, Daniel, 1989. "A Method of Simulated Moments for Estimation of Discrete Response Models without Numerical Integration," Econometrica, Econometric Society, vol. 57(5), pages 995-1026, September.
    5. Chernozhukov, Victor & Hong, Han, 2003. "An MCMC approach to classical estimation," Journal of Econometrics, Elsevier, vol. 115(2), pages 293-346, August.
    6. Gallant, A. Ronald & Tauchen, George, 1996. "Which Moments to Match?," Econometric Theory, Cambridge University Press, vol. 12(4), pages 657-681, October.
    7. Grazzini, Jakob & Richiardi, Matteo, 2015. "Estimation of ergodic agent-based models by simulated minimum distance," Journal of Economic Dynamics and Control, Elsevier, vol. 51(C), pages 148-165.
    8. Peter Winker & Dietmar Maringer, 2009. "The convergence of estimators based on heuristics: theory and application to a GARCH model," Computational Statistics, Springer, vol. 24(3), pages 533-550, August.
    9. Pakes, Ariel & Pollard, David, 1989. "Simulation and the Asymptotics of Optimization Estimators," Econometrica, Econometric Society, vol. 57(5), pages 1027-1057, September.
    10. Donald, Stephen G. & Imbens, Guido W. & Newey, Whitney K., 2009. "Choosing instrumental variables in conditional moment restriction models," Journal of Econometrics, Elsevier, vol. 152(1), pages 28-36, September.
    11. Hal R. Varian, 2014. "Big Data: New Tricks for Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 28(2), pages 3-28, Spring.
    12. Creel, Michael & Kristensen, Dennis, 2016. "On selection of statistics for approximate Bayesian computing (or the method of simulated moments)," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 99-114.
    13. Carrasco, Marine & Chernov, Mikhail & Florens, Jean-Pierre & Ghysels, Eric, 2007. "Efficient estimation of general dynamic models with a continuum of moment conditions," Journal of Econometrics, Elsevier, vol. 140(2), pages 529-573, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Michael Creel, 2021. "Inference Using Simulated Neural Moments," Econometrics, MDPI, vol. 9(4), pages 1-15, September.
    2. Thomas R. Cook & Aaron Smalter Hall, 2017. "Macroeconomic Indicator Forecasting with Deep Neural Networks," Research Working Paper RWP 17-11, Federal Reserve Bank of Kansas City.
    3. Ernesto Carrella, 2021. "No Free Lunch when Estimating Simulation Parameters," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 24(2), pages 1-7.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Michael Creel, 2016. "Neural Nets for Indirect Inference," UFAE and IAE Working Papers 960.16, Unitat de Fonaments de l'Anàlisi Econòmica (UAB) and Institut d'Anàlisi Econòmica (CSIC), revised 18 Jul 2016.
    2. Creel, Michael & Kristensen, Dennis, 2016. "On selection of statistics for approximate Bayesian computing (or the method of simulated moments)," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 99-114.
    3. Kristensen, Dennis & Shin, Yongseok, 2012. "Estimation of dynamic models with nonparametric simulated maximum likelihood," Journal of Econometrics, Elsevier, vol. 167(1), pages 76-94.
    4. Forneron, Jean-Jacques & Ng, Serena, 2018. "The ABC of simulation estimation with auxiliary statistics," Journal of Econometrics, Elsevier, vol. 205(1), pages 112-139.
    5. Mardi Dungey & Vitali Alexeev & Jing Tian & Alastair R. Hall, 2015. "Econometricians Have Their Moments: GMM at 32," The Economic Record, The Economic Society of Australia, vol. 91, pages 1-24, June.
    6. Alastair R. Hall, 2015. "Econometricians Have Their Moments: GMM at 32," The Economic Record, The Economic Society of Australia, vol. 91(S1), pages 1-24, June.
    7. Michael Creel, 2021. "Inference Using Simulated Neural Moments," Econometrics, MDPI, vol. 9(4), pages 1-15, September.
    8. Calvet, Laurent E. & Czellar, Veronika, 2015. "Through the looking glass: Indirect inference via simple equilibria," Journal of Econometrics, Elsevier, vol. 185(2), pages 343-358.
    9. Ghysels, Eric & Guay, Alain, 2004. "Testing For Structural Change In The Presence Of Auxiliary Models," Econometric Theory, Cambridge University Press, vol. 20(6), pages 1168-1202, December.
    10. Bruins, Marianne & Duffy, James A. & Keane, Michael P. & Smith, Anthony A., 2018. "Generalized indirect inference for discrete choice models," Journal of Econometrics, Elsevier, vol. 205(1), pages 177-203.
    11. Jean-Jacques Forneron, 2019. "A Sieve-SMM Estimator for Dynamic Models," Papers 1902.01456, arXiv.org, revised Jan 2023.
    12. Frazier, David T. & Oka, Tatsushi & Zhu, Dan, 2019. "Indirect inference with a non-smooth criterion function," Journal of Econometrics, Elsevier, vol. 212(2), pages 623-645.
    13. Jonathan Chassot & Michael Creel, 2023. "Constructing Efficient Simulated Moments Using Temporal Convolutional Networks," Working Papers 1412, Barcelona School of Economics.
    14. Jean-Jacques Forneron, 2019. "A Scrambled Method of Moments," Papers 1911.09128, arXiv.org.
    15. Michael Creel & Dennis Kristensen, 2013. "Indirect Likelihood Inference (revised)," UFAE and IAE Working Papers 931.13, Unitat de Fonaments de l'Anàlisi Econòmica (UAB) and Institut d'Anàlisi Econòmica (CSIC).
    16. David T. Frazier & Ruben Loaiza-Maya & Gael M. Martin, 2021. "Variational Bayes in State Space Models: Inferential and Predictive Accuracy," Papers 2106.12262, arXiv.org, revised Feb 2022.
    17. Otero, Karina V., 2016. "Intensity of default in sovereign bonds: Estimation of an unobservable process," MPRA Paper 86782, University Library of Munich, Germany.
    18. Ramdan Dridi & Eric Renault, 2000. "Semi-Parametric Indirect Inference," STICERD - Econometrics Paper Series 392, Suntory and Toyota International Centres for Economics and Related Disciplines, LSE.
    19. Di Iorio, Francesca & Calzolari, Giorgio, 2006. "Discontinuities in indirect estimation: An application to EAR models," Computational Statistics & Data Analysis, Elsevier, vol. 50(8), pages 2124-2136, April.
    20. Vincent Boucher, 2017. "The Estimation of Network Formation Games with Positive Spillovers," Cahiers de recherche 1710, Centre de recherche sur les risques, les enjeux économiques, et les politiques publiques.

    More about this item

    Keywords

    neural networks; indirect inference; approximate Bayesian computing; machine learning; DSGE; jump-diffusion;
    All these keywords.

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C45 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Neural Networks and Related Topics
    • C58 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Financial Econometrics

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bge:wpaper:942. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Bruno Guallar (email available below). General contact details of provider: https://edirc.repec.org/data/bargses.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.