IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2210.07154.html
   My bibliography  Save this paper

Fast Estimation of Bayesian State Space Models Using Amortized Simulation-Based Inference

Author

Listed:
  • Ramis Khabibullin
  • Sergei Seleznev

Abstract

This paper presents a fast algorithm for estimating hidden states of Bayesian state space models. The algorithm is a variation of amortized simulation-based inference algorithms, where a large number of artificial datasets are generated at the first stage, and then a flexible model is trained to predict the variables of interest. In contrast to those proposed earlier, the procedure described in this paper makes it possible to train estimators for hidden states by concentrating only on certain characteristics of the marginal posterior distributions and introducing inductive bias. Illustrations using the examples of the stochastic volatility model, nonlinear dynamic stochastic general equilibrium model, and seasonal adjustment procedure with breaks in seasonality show that the algorithm has sufficient accuracy for practical use. Moreover, after pretraining, which takes several hours, finding the posterior distribution for any dataset takes from hundredths to tenths of a second.

Suggested Citation

  • Ramis Khabibullin & Sergei Seleznev, 2022. "Fast Estimation of Bayesian State Space Models Using Amortized Simulation-Based Inference," Papers 2210.07154, arXiv.org.
  • Handle: RePEc:arx:papers:2210.07154
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2210.07154
    File Function: Latest version
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Pierre Del Moral & Arnaud Doucet & Ajay Jasra, 2006. "Sequential Monte Carlo samplers," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(3), pages 411-436, June.
    2. David M. Blei & Alp Kucukelbir & Jon D. McAuliffe, 2017. "Variational Inference: A Review for Statisticians," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(518), pages 859-877, April.
    3. Ron Gallant & Raffaella Giacomini & Giuseppe Ragusa, 2013. "Generalized method of moments with latent variables," CeMMAP working papers 50/13, Institute for Fiscal Studies.
    4. Sangjoon Kim & Neil Shephard & Siddhartha Chib, 1998. "Stochastic Volatility: Likelihood Inference and Comparison with ARCH Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(3), pages 361-393.
    5. Gary Koop & Dimitris Korobilis, 2012. "Forecasting Inflation Using Dynamic Model Averaging," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 53(3), pages 867-886, August.
    6. Tetsuya Kaji & Elena Manresa & Guillaume Pouliot, 2020. "An adversarial approach to structural estimation," CeMMAP working papers CWP39/20, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    7. Fernández-Villaverde, J. & Rubio-Ramírez, J.F. & Schorfheide, F., 2016. "Solution and Estimation Methods for DSGE Models," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 527-724, Elsevier.
    8. Duffie, Darrell & Singleton, Kenneth J, 1993. "Simulated Moments Estimation of Markov Models of Asset Prices," Econometrica, Econometric Society, vol. 61(4), pages 929-952, July.
    9. Diebold, Francis X. & Schorfheide, Frank & Shin, Minchul, 2017. "Real-time forecast evaluation of DSGE models with stochastic volatility," Journal of Econometrics, Elsevier, vol. 201(2), pages 322-332.
    10. Athanasios Orphanides & Simon van Norden, 2002. "The Unreliability of Output-Gap Estimates in Real Time," The Review of Economics and Statistics, MIT Press, vol. 84(4), pages 569-583, November.
    11. Alejandro Justiniano & Giorgio E. Primiceri, 2008. "The Time-Varying Volatility of Macroeconomic Fluctuations," American Economic Review, American Economic Association, vol. 98(3), pages 604-641, June.
    12. Simon N. Wood, 2010. "Statistical inference for noisy nonlinear ecological dynamic systems," Nature, Nature, vol. 466(7310), pages 1102-1104, August.
    13. Gunawan, David & Kohn, Robert & Nott, David, 2021. "Variational Bayes approximation of factor stochastic volatility models," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1355-1375.
    14. Frank Schorfheide & Dongho Song, 2020. "Real-Time Forecasting with a (Standard) Mixed-Frequency VAR During a Pandemic," Working Papers 20-26, Federal Reserve Bank of Philadelphia.
    15. Frank Schorfheide & Dongho Song, 2015. "Real-Time Forecasting With a Mixed-Frequency VAR," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(3), pages 366-380, July.
    16. McFadden, Daniel, 1989. "A Method of Simulated Moments for Estimation of Discrete Response Models without Numerical Integration," Econometrica, Econometric Society, vol. 57(5), pages 995-1026, September.
    17. Hodrick, Robert J & Prescott, Edward C, 1997. "Postwar U.S. Business Cycles: An Empirical Investigation," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 29(1), pages 1-16, February.
    18. Gallant, A. Ronald & Tauchen, George, 1996. "Which Moments to Match?," Econometric Theory, Cambridge University Press, vol. 12(4), pages 657-681, October.
    19. Gallant, A. Ronald & McCulloch, Robert E., 2009. "On the Determination of General Scientific Models With Application to Asset Pricing," Journal of the American Statistical Association, American Statistical Association, vol. 104(485), pages 117-131.
    20. Tetsuya Kaji & Elena Manresa & Guillaume Pouliot, 2020. "An Adversarial Approach to Structural Estimation," Working Papers 2020-144, Becker Friedman Institute for Research In Economics.
    21. Carrasco, Marine & Florens, Jean-Pierre, 2002. "Simulation-Based Method of Moments and Efficiency," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(4), pages 482-492, October.
    22. Giorgio E. Primiceri, 2005. "Time Varying Structural Vector Autoregressions and Monetary Policy," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(3), pages 821-852.
    23. Christophe Andrieu & Arnaud Doucet & Roman Holenstein, 2010. "Particle Markov chain Monte Carlo methods," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(3), pages 269-342, June.
    24. repec:dau:papers:123456789/7305 is not listed on IDEAS
    25. Carl E. Walsh, 2010. "Monetary Theory and Policy, Third Edition," MIT Press Books, The MIT Press, edition 3, volume 1, number 0262013770, December.
    26. Cameron Fen, 2022. "Fast Simulation-Based Bayesian Estimation of Heterogeneous and Representative Agent Models using Normalizing Flow Neural Networks," Papers 2203.06537, arXiv.org.
    27. Lux, Thomas, 2018. "Estimation of agent-based models using sequential Monte Carlo methods," Journal of Economic Dynamics and Control, Elsevier, vol. 91(C), pages 391-408.
    28. Blanchard, Olivier Jean & Kahn, Charles M, 1980. "The Solution of Linear Difference Models under Rational Expectations," Econometrica, Econometric Society, vol. 48(5), pages 1305-1311, July.
    29. Anderson, Gary & Moore, George, 1985. "A linear algebraic procedure for solving linear perfect foresight models," Economics Letters, Elsevier, vol. 17(3), pages 247-252.
    30. Thomas Laubach & John C. Williams, 2003. "Measuring the Natural Rate of Interest," The Review of Economics and Statistics, MIT Press, vol. 85(4), pages 1063-1070, November.
    31. Delli Gatti, Domenico & Grazzini, Jakob, 2020. "Rising to the challenge: Bayesian estimation and forecasting techniques for macroeconomic Agent Based Models," Journal of Economic Behavior & Organization, Elsevier, vol. 178(C), pages 875-902.
    32. Stock, James H. & Watson, Mark, 2011. "Dynamic Factor Models," Scholarly Articles 28469541, Harvard University Department of Economics.
    33. Sims, Christopher A, 2002. "Solving Linear Rational Expectations Models," Computational Economics, Springer;Society for Computational Economics, vol. 20(1-2), pages 1-20, October.
    34. Hamilton, James D, 1989. "A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle," Econometrica, Econometric Society, vol. 57(2), pages 357-384, March.
    35. N. Chopin & P. E. Jacob & O. Papaspiliopoulos, 2013. "SMC-super-2: an efficient algorithm for sequential analysis of state space models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 75(3), pages 397-426, June.
    36. Frank Smets & Raf Wouters, 2003. "An Estimated Dynamic Stochastic General Equilibrium Model of the Euro Area," Journal of the European Economic Association, MIT Press, vol. 1(5), pages 1123-1175, September.
    37. Carriero, Andrea & Clark, Todd E. & Marcellino, Massimiliano, 2019. "Large Bayesian vector autoregressions with stochastic volatility and non-conjugate priors," Journal of Econometrics, Elsevier, vol. 212(1), pages 137-154.
    38. J. Durbin, 2002. "A simple and efficient simulation smoother for state space time series analysis," Biometrika, Biometrika Trust, vol. 89(3), pages 603-616, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Denis Koshelev & Alexey Ponomarenko & Sergei Seleznev, 2023. "Amortized neural networks for agent-based model forecasting," Papers 2308.05753, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gael M. Martin & David T. Frazier & Ruben Loaiza-Maya & Florian Huber & Gary Koop & John Maheu & Didier Nibbering & Anastasios Panagiotelis, 2023. "Bayesian Forecasting in the 21st Century: A Modern Review," Monash Econometrics and Business Statistics Working Papers 1/23, Monash University, Department of Econometrics and Business Statistics.
    2. Gael M. Martin & David T. Frazier & Worapree Maneesoonthorn & Ruben Loaiza-Maya & Florian Huber & Gary Koop & John Maheu & Didier Nibbering & Anastasios Panagiotelis, 2022. "Bayesian Forecasting in Economics and Finance: A Modern Review," Papers 2212.03471, arXiv.org, revised Jul 2023.
    3. Fernández-Villaverde, J. & Rubio-Ramírez, J.F. & Schorfheide, F., 2016. "Solution and Estimation Methods for DSGE Models," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 527-724, Elsevier.
    4. Aruoba, S. Borağan & Bocola, Luigi & Schorfheide, Frank, 2017. "Assessing DSGE model nonlinearities," Journal of Economic Dynamics and Control, Elsevier, vol. 83(C), pages 34-54.
    5. Zila, Eric & Kukacka, Jiri, 2023. "Moment set selection for the SMM using simple machine learning," Journal of Economic Behavior & Organization, Elsevier, vol. 212(C), pages 366-391.
    6. Özer Karagedikli & Troy Matheson & Christie Smith & Shaun P. Vahey, 2010. "RBCs AND DSGEs: THE COMPUTATIONAL APPROACH TO BUSINESS CYCLE THEORY AND EVIDENCE," Journal of Economic Surveys, Wiley Blackwell, vol. 24(1), pages 113-136, February.
    7. Sergey Ivashchenko & Semih Emre Cekin & Rangan Gupta & Chien-Chiang Lee, 2022. "Real-Time Forecast of DSGE Models with Time-Varying Volatility in GARCH Form," Working Papers 202204, University of Pretoria, Department of Economics.
    8. Andras Fulop & Jeremy Heng & Junye Li, 2022. "Efficient Likelihood-based Estimation via Annealing for Dynamic Structural Macrofinance Models," Papers 2201.01094, arXiv.org.
    9. Mertens, Elmar, 2023. "Precision-based sampling for state space models that have no measurement error," Journal of Economic Dynamics and Control, Elsevier, vol. 154(C).
    10. Jesús Fernández-Villaverde & Juan F. Rubio-Ramírez, 2007. "Estimating Macroeconomic Models: A Likelihood Approach," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 74(4), pages 1059-1087.
    11. YANO Koiti, 2010. "Time-varying Analysis of Dynamic Stochastic General Equilibrium Models Based on Sequential Monte Carlo Methods," ESRI Discussion paper series 231, Economic and Social Research Institute (ESRI).
    12. Joshua C.C. Chan & Rodney W. Strachan, 2023. "Bayesian State Space Models In Macroeconometrics," Journal of Economic Surveys, Wiley Blackwell, vol. 37(1), pages 58-75, February.
    13. Magnus Reif, 2020. "Macroeconomics, Nonlinearities, and the Business Cycle," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 87.
    14. Vasco Cúrdia & Marco Del Negro & Daniel L. Greenwald, 2014. "Rare Shocks, Great Recessions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(7), pages 1031-1052, November.
    15. Siddhartha Chib & Minchul Shin & Fei Tan, 2023. "DSGE-SVt: An Econometric Toolkit for High-Dimensional DSGE Models with SV and t Errors," Computational Economics, Springer;Society for Computational Economics, vol. 61(1), pages 69-111, January.
    16. Hirokuni Iiboshi & Mototsugu Shintani & Kozo Ueda, 2022. "Estimating a Nonlinear New Keynesian Model with the Zero Lower Bound for Japan," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 54(6), pages 1637-1671, September.
    17. Paccagnini, Alessia, 2017. "Dealing with Misspecification in DSGE Models: A Survey," MPRA Paper 82914, University Library of Munich, Germany.
    18. Andrea Carriero & Todd E. Clark & Massimiliano Marcellino & Elmar Mertens, 2021. "Addressing COVID-19 Outliers in BVARs with Stochastic Volatility," Working Papers 21-02R, Federal Reserve Bank of Cleveland, revised 09 Aug 2021.
    19. Francesco Bianchi & Cosmin L. Ilut & Martin Schneider, 2018. "Uncertainty Shocks, Asset Supply and Pricing over the Business Cycle," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 85(2), pages 810-854.
    20. Karamé, Frédéric & Patureau, Lise & Sopraseuth, Thepthida, 2008. "Limited participation and exchange rate dynamics: Does theory meet the data?," Journal of Economic Dynamics and Control, Elsevier, vol. 32(4), pages 1041-1087, April.

    More about this item

    JEL classification:

    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C45 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Neural Networks and Related Topics

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2210.07154. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.