IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2203.06537.html
   My bibliography  Save this paper

Fast Simulation-Based Bayesian Estimation of Heterogeneous and Representative Agent Models using Normalizing Flow Neural Networks

Author

Listed:
  • Cameron Fen

Abstract

This paper proposes a simulation-based deep learning Bayesian procedure for the estimation of macroeconomic models. This approach is able to derive posteriors even when the likelihood function is not tractable. Because the likelihood is not needed for Bayesian estimation, filtering is also not needed. This allows Bayesian estimation of HANK models with upwards of 800 latent states as well as estimation of representative agent models that are solved with methods that don't yield a likelihood--for example, projection and value function iteration approaches. I demonstrate the validity of the approach by estimating a 10 parameter HANK model solved via the Reiter method that generates 812 covariates per time step, where 810 are latent variables, showing this can handle a large latent space without model reduction. I also estimate the algorithm with an 11-parameter model solved via value function iteration, which cannot be estimated with Metropolis-Hastings or even conventional maximum likelihood estimators. In addition, I show the posteriors estimated on Smets-Wouters 2007 are higher quality and faster using simulation-based inference compared to Metropolis-Hastings. This approach helps address the computational expense of Metropolis-Hastings and allows solution methods which don't yield a tractable likelihood to be estimated.

Suggested Citation

  • Cameron Fen, 2022. "Fast Simulation-Based Bayesian Estimation of Heterogeneous and Representative Agent Models using Normalizing Flow Neural Networks," Papers 2203.06537, arXiv.org.
  • Handle: RePEc:arx:papers:2203.06537
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2203.06537
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Christopher L. House & John V. Leahy, 2004. "An sS Model with Adverse Selection," Journal of Political Economy, University of Chicago Press, vol. 112(3), pages 581-614, June.
    2. Caballero, Ricardo J. & Engel, Eduardo M.R.A., 2007. "Price stickiness in Ss models: New interpretations of old results," Journal of Monetary Economics, Elsevier, vol. 54(Supplemen), pages 100-121, September.
    3. Smith, A A, Jr, 1993. "Estimating Nonlinear Time-Series Models Using Simulated Vector Autoregressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 8(S), pages 63-84, Suppl. De.
    4. SeHyoun Ahn & Greg Kaplan & Benjamin Moll & Thomas Winberry & Christian Wolf, 2018. "When Inequality Matters for Macro and Macro Matters for Inequality," NBER Macroeconomics Annual, University of Chicago Press, vol. 32(1), pages 1-75.
    5. Kristensen, Dennis & Shin, Yongseok, 2012. "Estimation of dynamic models with nonparametric simulated maximum likelihood," Journal of Econometrics, Elsevier, vol. 167(1), pages 76-94.
    6. Duffie, Darrell & Singleton, Kenneth J, 1993. "Simulated Moments Estimation of Markov Models of Asset Prices," Econometrica, Econometric Society, vol. 61(4), pages 929-952, July.
    7. Frank Smets & Rafael Wouters, 2007. "Shocks and Frictions in US Business Cycles: A Bayesian DSGE Approach," American Economic Review, American Economic Association, vol. 97(3), pages 586-606, June.
    8. Cecilia R. Caglio & R. Matthew Darst & Ṣebnem Kalemli-Özcan, 2021. "Collateral Heterogeneity and Monetary Policy Transmission: Evidence from Loans to SMEs and Large Firms," NBER Working Papers 28685, National Bureau of Economic Research, Inc.
    9. Christopher A. Hennessy & Toni M. Whited, 2007. "How Costly Is External Financing? Evidence from a Structural Estimation," Journal of Finance, American Finance Association, vol. 62(4), pages 1705-1745, August.
    10. Adrien Auclert & Bence Bardóczy & Matthew Rognlie & Ludwig Straub, 2021. "Using the Sequence‐Space Jacobian to Solve and Estimate Heterogeneous‐Agent Models," Econometrica, Econometric Society, vol. 89(5), pages 2375-2408, September.
    11. McFadden, Daniel, 1989. "A Method of Simulated Moments for Estimation of Discrete Response Models without Numerical Integration," Econometrica, Econometric Society, vol. 57(5), pages 995-1026, September.
    12. Keane, Michael P & Wolpin, Kenneth I, 1994. "The Solution and Estimation of Discrete Choice Dynamic Programming Models by Simulation and Interpolation: Monte Carlo Evidence," The Review of Economics and Statistics, MIT Press, vol. 76(4), pages 648-672, November.
    13. Peter Haan & Arne Uhlendorff, 2006. "Estimation of multinomial logit models with unobserved heterogeneity using maximum simulated likelihood," Stata Journal, StataCorp LP, vol. 6(2), pages 229-245, June.
    14. Gallant, A. Ronald & Tauchen, George, 1996. "Which Moments to Match?," Econometric Theory, Cambridge University Press, vol. 12(4), pages 657-681, October.
    15. Wenbin Chen & Shi-Zhuan Han & Jie Li & Tianhang Zhou, 2021. "The SOE Channel of Monetary Policy Transmission: Evidence from China's Economic Stimulus Package," Asian Economic Papers, MIT Press, vol. 20(3), pages 73-93, Fall.
    16. Stephen J. Terry, 2017. "Alternative Methods for Solving Heterogeneous Firm Models," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 49(6), pages 1081-1111, September.
    17. repec:zbw:bofitp:2021_015 is not listed on IDEAS
    18. Robert J. DiNapoli & Enrico R. Crema & Carl P. Lipo & Timothy M. Rieth & Terry L. Hunt, 2021. "Approximate Bayesian Computation of radiocarbon and paleoenvironmental record shows population resilience on Rapa Nui (Easter Island)," Nature Communications, Nature, vol. 12(1), pages 1-10, December.
    19. Thomas Winberry, 2018. "A method for solving and estimating heterogeneous agent macro models," Quantitative Economics, Econometric Society, vol. 9(3), pages 1123-1151, November.
    20. Flury, Thomas & Shephard, Neil, 2011. "Bayesian Inference Based Only On Simulated Likelihood: Particle Filter Analysis Of Dynamic Economic Models," Econometric Theory, Cambridge University Press, vol. 27(5), pages 933-956, October.
    21. Carrasco, Marine & Chernov, Mikhail & Florens, Jean-Pierre & Ghysels, Eric, 2007. "Efficient estimation of general dynamic models with a continuum of moment conditions," Journal of Econometrics, Elsevier, vol. 140(2), pages 529-573, October.
    22. Taylor, Lucian A., 2013. "CEO wage dynamics: Estimates from a learning model," Journal of Financial Economics, Elsevier, vol. 108(1), pages 79-98.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ramis Khabibullin & Sergei Seleznev, 2022. "Fast Estimation of Bayesian State Space Models Using Amortized Simulation-Based Inference," Bank of Russia Working Paper Series wps104, Bank of Russia.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jean-Jacques Forneron, 2019. "A Sieve-SMM Estimator for Dynamic Models," Papers 1902.01456, arXiv.org, revised Jan 2023.
    2. Michael Creel & Dennis Kristensen, 2013. "Indirect Likelihood Inference (revised)," UFAE and IAE Working Papers 931.13, Unitat de Fonaments de l'Anàlisi Econòmica (UAB) and Institut d'Anàlisi Econòmica (CSIC).
    3. Calvet, Laurent E. & Czellar, Veronika, 2015. "Through the looking glass: Indirect inference via simple equilibria," Journal of Econometrics, Elsevier, vol. 185(2), pages 343-358.
    4. Guay, François & Schwenkler, Gustavo, 2021. "Efficient estimation and filtering for multivariate jump–diffusions," Journal of Econometrics, Elsevier, vol. 223(1), pages 251-275.
    5. Michael Creel & Dennis Kristensen, "undated". "Indirect Likelihood Inference," Working Papers 558, Barcelona School of Economics.
    6. Mardi Dungey & Vitali Alexeev & Jing Tian & Alastair R. Hall, 2015. "Econometricians Have Their Moments: GMM at 32," The Economic Record, The Economic Society of Australia, vol. 91, pages 1-24, June.
    7. Alastair R. Hall, 2015. "Econometricians Have Their Moments: GMM at 32," The Economic Record, The Economic Society of Australia, vol. 91(S1), pages 1-24, June.
    8. Kristensen, Dennis & Shin, Yongseok, 2012. "Estimation of dynamic models with nonparametric simulated maximum likelihood," Journal of Econometrics, Elsevier, vol. 167(1), pages 76-94.
    9. Forneron, Jean-Jacques & Ng, Serena, 2018. "The ABC of simulation estimation with auxiliary statistics," Journal of Econometrics, Elsevier, vol. 205(1), pages 112-139.
    10. Gael M. Martin & David T. Frazier & Ruben Loaiza-Maya & Florian Huber & Gary Koop & John Maheu & Didier Nibbering & Anastasios Panagiotelis, 2023. "Bayesian Forecasting in the 21st Century: A Modern Review," Monash Econometrics and Business Statistics Working Papers 1/23, Monash University, Department of Econometrics and Business Statistics.
    11. Bruins, Marianne & Duffy, James A. & Keane, Michael P. & Smith, Anthony A., 2018. "Generalized indirect inference for discrete choice models," Journal of Econometrics, Elsevier, vol. 205(1), pages 177-203.
    12. Papp, Tamás K. & Reiter, Michael, 2020. "Estimating linearized heterogeneous agent models using panel data," Journal of Economic Dynamics and Control, Elsevier, vol. 115(C).
    13. Corradi, Valentina & Swanson, Norman R., 2011. "Predictive density construction and accuracy testing with multiple possibly misspecified diffusion models," Journal of Econometrics, Elsevier, vol. 161(2), pages 304-324, April.
    14. Frazier, David T. & Oka, Tatsushi & Zhu, Dan, 2019. "Indirect inference with a non-smooth criterion function," Journal of Econometrics, Elsevier, vol. 212(2), pages 623-645.
    15. Zhongjun Qu & Fan Zhuo, 2021. "Likelihood Ratio-Based Tests for Markov Regime Switching," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 88(2), pages 937-968.
    16. Martin Browning & Mette Ejrnæs & Javier Alvarez, 2010. "Modelling Income Processes with Lots of Heterogeneity," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 77(4), pages 1353-1381.
    17. Ramdan Dridi & Eric Renault, 2000. "Semi-Parametric Indirect Inference," STICERD - Econometrics Paper Series 392, Suntory and Toyota International Centres for Economics and Related Disciplines, LSE.
    18. Santos, Manuel S., 2004. "Simulation-based estimation of dynamic models with continuous equilibrium solutions," Journal of Mathematical Economics, Elsevier, vol. 40(3-4), pages 465-491, June.
    19. Ramdan Dridi, 2000. "Simulated Asymptotic Least Squares Theory," STICERD - Econometrics Paper Series 396, Suntory and Toyota International Centres for Economics and Related Disciplines, LSE.
    20. Kristensen, Dennis & Salanié, Bernard, 2017. "Higher-order properties of approximate estimators," Journal of Econometrics, Elsevier, vol. 198(2), pages 189-208.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2203.06537. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.