IDEAS home Printed from https://ideas.repec.org/p/rim/rimwps/19-17.html
   My bibliography  Save this paper

High-dimensional macroeconomic forecasting using message passing algorithms

Author

Listed:
  • Dimitris Korobilis

    (Adam Smith Business School, University of Glasgow, UK; Rimini Centre for Economic Analysis)

Abstract

This paper proposes two distinct contributions to econometric analysis of large information sets and structural instabilities. First, it treats a regression model with time-varying coefficients, stochastic volatility and exogenous predictors, as an equivalent high-dimensional static regression problem with thousands of covariates. Inference in this specification proceeds using Bayesian hierarchical priors that shrink the high-dimensional vector of coefficients either towards zero or time-invariance. Second, it introduces the frameworks of factor graphs and message passing as a means of designing efficient Bayesian estimation algorithms. In particular, a Generalized Approximate Message Passing (GAMP) algorithm is derived that has low algorithmic complexity and is trivially parallelizable. The result is a comprehensive methodology that can be used to estimate time-varying parameter regressions with arbitrarily large number of exogenous predictors. In a forecasting exercise for U.S. price inflation this methodology is shown to work very well.

Suggested Citation

  • Dimitris Korobilis, 2019. "High-dimensional macroeconomic forecasting using message passing algorithms," Working Paper series 19-17, Rimini Centre for Economic Analysis.
  • Handle: RePEc:rim:rimwps:19-17
    as

    Download full text from publisher

    File URL: http://rcea.org/RePEc/pdf/wp19-17.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Korobilis, Dimitris, 2013. "Hierarchical shrinkage priors for dynamic regressions with many predictors," International Journal of Forecasting, Elsevier, vol. 29(1), pages 43-59.
    2. Blix, Mårten, 1999. "Forecasting Swedish Inflation With a Markov Switching VAR," Working Paper Series 76, Sveriges Riksbank (Central Bank of Sweden).
    3. Frühwirth-Schnatter, Sylvia & Wagner, Helga, 2010. "Stochastic model specification search for Gaussian and partial non-Gaussian state space models," Journal of Econometrics, Elsevier, vol. 154(1), pages 85-100, January.
    4. Stock, James H. & Watson, Mark W., 1999. "Forecasting inflation," Journal of Monetary Economics, Elsevier, vol. 44(2), pages 293-335, October.
    5. Luc Bauwens & Gary Koop & Dimitris Korobilis & Jeroen V.K. Rombouts, 2015. "The Contribution of Structural Break Models to Forecasting Macroeconomic Series," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(4), pages 596-620, June.
    6. Giordani, Paolo & Kohn, Robert, 2008. "Efficient Bayesian Inference for Multiple Change-Point and Mixture Innovation Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 26, pages 66-77, January.
    7. Koop, Gary & Korobilis, Dimitris, 2010. "Bayesian Multivariate Time Series Methods for Empirical Macroeconomics," Foundations and Trends(R) in Econometrics, now publishers, vol. 3(4), pages 267-358, July.
    8. Jan J. J. Groen & Richard Paap & Francesco Ravazzolo, 2013. "Real-Time Inflation Forecasting in a Changing World," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 31(1), pages 29-44, January.
    9. Joshua C.C. Chan & Gary Koop & Roberto Leon-Gonzalez & Rodney W. Strachan, 2012. "Time Varying Dimension Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(3), pages 358-367, January.
    10. Miguel A.G. Belmonte & Gary Koop & Dimitris Korobilis, 2014. "Hierarchical Shrinkage in Time‐Varying Parameter Models," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 33(1), pages 80-94, January.
    11. Luc Bauwens & Gary Koop & Dimitris Korobilis & Jeroen V.K. Rombouts, 2015. "The Contribution of Structural Break Models to Forecasting Macroeconomic Series," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(4), pages 596-620, June.
    12. Jouchi Nakajima & Mike West, 2013. "Bayesian Analysis of Latent Threshold Dynamic Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 31(2), pages 151-164, April.
    13. Davide Pettenuzzo & Allan Timmermann, 2017. "Forecasting Macroeconomic Variables Under Model Instability," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 35(2), pages 183-201, April.
    14. James H. Stock & Mark W. Watson, 2007. "Erratum to "Why Has U.S. Inflation Become Harder to Forecast?"," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(7), pages 1849-1849, October.
    15. Pooyan Amir-Ahmadi & Christian Matthes & Mu-Chun Wang, 2020. "Choosing Prior Hyperparameters: With Applications to Time-Varying Parameter Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 38(1), pages 124-136, January.
    16. Kalli, Maria & Griffin, Jim E., 2014. "Time-varying sparsity in dynamic regression models," Journal of Econometrics, Elsevier, vol. 178(2), pages 779-793.
    17. James H. Stock & Mark W. Watson, 2007. "Why Has U.S. Inflation Become Harder to Forecast?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(s1), pages 3-33, February.
    18. Edward P. Herbst & Frank Schorfheide, 2016. "Bayesian Estimation of DSGE Models," Economics Books, Princeton University Press, edition 1, number 10612.
    19. Cooley, Thomas F & Prescott, Edward C, 1976. "Estimation in the Presence of Stochastic Parameter Variation," Econometrica, Econometric Society, vol. 44(1), pages 167-184, January.
    20. M. P. Wand, 2017. "Fast Approximate Inference for Arbitrarily Large Semiparametric Regression Models via Message Passing," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(517), pages 137-168, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Cepni, Oguzhan & Clements, Michael P., 2024. "How local is the local inflation factor? Evidence from emerging European countries," International Journal of Forecasting, Elsevier, vol. 40(1), pages 160-183.
    2. Niko Hauzenberger & Florian Huber & Gary Koop & James Mitchell, 2023. "Bayesian Modeling of Time-Varying Parameters Using Regression Trees," Working Papers 23-05, Federal Reserve Bank of Cleveland.
    3. Boriss Siliverstovs & Daniel S. Wochner, 2021. "State‐dependent evaluation of predictive ability," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(3), pages 547-574, April.
    4. Gary Koop & Dimitris Korobilis, 2023. "Bayesian Dynamic Variable Selection In High Dimensions," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 64(3), pages 1047-1074, August.
    5. Florian Huber & Gary Koop & Michael Pfarrhofer, 2020. "Bayesian Inference in High-Dimensional Time-varying Parameter Models using Integrated Rotated Gaussian Approximations," Papers 2002.10274, arXiv.org.
    6. Barbara Rossi, 2019. "Forecasting in the Presence of Instabilities: How Do We Know Whether Models Predict Well and How to Improve Them," Working Papers 1162, Barcelona School of Economics.
    7. Korobilis, Dimitris & Pettenuzzo, Davide, 2020. "Machine Learning Econometrics: Bayesian algorithms and methods," MPRA Paper 100165, University Library of Munich, Germany.
    8. G. Cubadda & S. Grassi & B. Guardabascio, 2022. "The Time-Varying Multivariate Autoregressive Index Model," Papers 2201.07069, arXiv.org.
    9. Boriss Siliverstovs & Daniel Wochner, 2019. "Recessions as Breadwinner for Forecasters State-Dependent Evaluation of Predictive Ability: Evidence from Big Macroeconomic US Data," KOF Working papers 19-463, KOF Swiss Economic Institute, ETH Zurich.
    10. Dimitris Korobilis & Kenichi Shimizu, 2022. "Bayesian Approaches to Shrinkage and Sparse Estimation," Foundations and Trends(R) in Econometrics, now publishers, vol. 11(4), pages 230-354, June.
    11. Arefiev, Nikolay & Khabibullin, Ramis, 2018. "Bayesian identification of structural vector autoregression models," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 49, pages 115-142.
    12. Oguzhan Cepni & Rangan Gupta & Yigit Onay, 2022. "The role of investor sentiment in forecasting housing returns in China: A machine learning approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(8), pages 1725-1740, December.
    13. Niko Hauzenberger, 2020. "Flexible Mixture Priors for Large Time-varying Parameter Models," Papers 2006.10088, arXiv.org, revised Nov 2020.
    14. Niko Hauzenberger & Florian Huber & Gary Koop & James Mitchell, 2020. "Bayesian Modelling of TVP-VARs Using Regression Trees," Working Papers 2308, University of Strathclyde Business School, Department of Economics, revised Aug 2023.
    15. George Kapetanios & Fotis Papailias, 2018. "Big Data & Macroeconomic Nowcasting: Methodological Review," Economic Statistics Centre of Excellence (ESCoE) Discussion Papers ESCoE DP-2018-12, Economic Statistics Centre of Excellence (ESCoE).
    16. Dimitris Korobilis, 2018. "Machine Learning Macroeconometrics: A Primer," Working Paper series 18-30, Rimini Centre for Economic Analysis.
    17. Niko Hauzenberger & Florian Huber & Gary Koop, "undated". "Dynamic Shrinkage Priors for Large Time-varying Parameter Regressions using Scalable Markov Chain Monte Carlo Methods," Working Papers 2305, University of Strathclyde Business School, Department of Economics.
    18. Hauzenberger, Niko & Huber, Florian & Klieber, Karin, 2023. "Real-time inflation forecasting using non-linear dimension reduction techniques," International Journal of Forecasting, Elsevier, vol. 39(2), pages 901-921.
    19. Manfred M. Fischer & Niko Hauzenberger & Florian Huber & Michael Pfarrhofer, 2021. "General Bayesian time-varying parameter VARs for predicting government bond yields," Papers 2102.13393, arXiv.org.
    20. Hauzenberger, Niko, 2021. "Flexible Mixture Priors for Large Time-varying Parameter Models," Econometrics and Statistics, Elsevier, vol. 20(C), pages 87-108.
    21. Fischer, Manfred M. & Hauzenberger, Niko & Huber, Florian & Pfarrhofer, Michael, 2022. "General Bayesian time-varying parameter VARs for modeling government bond yields," Working Papers in Regional Science 2021/01, WU Vienna University of Economics and Business.
    22. Daniel Wochner, 2020. "Dynamic Factor Trees and Forests – A Theory-led Machine Learning Framework for Non-Linear and State-Dependent Short-Term U.S. GDP Growth Predictions," KOF Working papers 20-472, KOF Swiss Economic Institute, ETH Zurich.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Korobilis, Dimitris & Koop, Gary, 2018. "Variational Bayes inference in high-dimensional time-varying parameter models," Essex Finance Centre Working Papers 22665, University of Essex, Essex Business School.
    2. Gary Koop & Dimitris Korobilis, 2023. "Bayesian Dynamic Variable Selection In High Dimensions," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 64(3), pages 1047-1074, August.
    3. Hauzenberger, Niko, 2021. "Flexible Mixture Priors for Large Time-varying Parameter Models," Econometrics and Statistics, Elsevier, vol. 20(C), pages 87-108.
    4. Niko Hauzenberger, 2020. "Flexible Mixture Priors for Large Time-varying Parameter Models," Papers 2006.10088, arXiv.org, revised Nov 2020.
    5. Nima Nonejad, 2021. "An Overview Of Dynamic Model Averaging Techniques In Time‐Series Econometrics," Journal of Economic Surveys, Wiley Blackwell, vol. 35(2), pages 566-614, April.
    6. Korobilis, Dimitris, 2019. "High-dimensional macroeconomic forecasting using message passing algorithms," MPRA Paper 96079, University Library of Munich, Germany.
    7. Joshua C. C. Chan, 2018. "Specification tests for time-varying parameter models with stochastic volatility," Econometric Reviews, Taylor & Francis Journals, vol. 37(8), pages 807-823, September.
    8. Jan Prüser, 2021. "Forecasting US inflation using Markov dimension switching," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(3), pages 481-499, April.
    9. Dufays, Arnaud & Rombouts, Jeroen V.K., 2020. "Relevant parameter changes in structural break models," Journal of Econometrics, Elsevier, vol. 217(1), pages 46-78.
    10. Dimitris Korobilis, 2018. "Machine Learning Macroeconometrics: A Primer," Working Paper series 18-30, Rimini Centre for Economic Analysis.
    11. Joshua C.C. Chan & Rodney W. Strachan, 2023. "Bayesian State Space Models In Macroeconometrics," Journal of Economic Surveys, Wiley Blackwell, vol. 37(1), pages 58-75, February.
    12. Koop, Gary & Korobilis, Dimitris, 2011. "UK macroeconomic forecasting with many predictors: Which models forecast best and when do they do so?," Economic Modelling, Elsevier, vol. 28(5), pages 2307-2318, September.
    13. Dimitris Korobilis, 2013. "Var Forecasting Using Bayesian Variable Selection," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(2), pages 204-230, March.
    14. Florian Huber & Michael Pfarrhofer & Philipp Piribauer, 2020. "A multi‐country dynamic factor model with stochastic volatility for euro area business cycle analysis," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(6), pages 911-926, September.
    15. Felix Abramovich & Vadim Grinshtein, 2013. "Estimation of a sparse group of sparse vectors," Biometrika, Biometrika Trust, vol. 100(2), pages 355-370.
    16. Florian Huber & Gary Koop & Michael Pfarrhofer, 2020. "Bayesian Inference in High-Dimensional Time-varying Parameter Models using Integrated Rotated Gaussian Approximations," Papers 2002.10274, arXiv.org.
    17. Lasha Kavtaradze & Manouchehr Mokhtari, 2018. "Factor Models And Time†Varying Parameter Framework For Forecasting Exchange Rates And Inflation: A Survey," Journal of Economic Surveys, Wiley Blackwell, vol. 32(2), pages 302-334, April.
    18. Szafranek, Karol, 2019. "Bagged neural networks for forecasting Polish (low) inflation," International Journal of Forecasting, Elsevier, vol. 35(3), pages 1042-1059.
    19. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    20. Eric Eisenstat & Joshua C. C. Chan & Rodney W. Strachan, 2016. "Stochastic Model Specification Search for Time-Varying Parameter VARs," Econometric Reviews, Taylor & Francis Journals, vol. 35(8-10), pages 1638-1665, December.

    More about this item

    Keywords

    high-dimensional inference; factor graph; belief propagation; Bayesian shrinkage; time-varying parameter model;
    All these keywords.

    JEL classification:

    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C55 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Large Data Sets: Modeling and Analysis
    • C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:rim:rimwps:19-17. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Marco Savioli (email available below). General contact details of provider: https://edirc.repec.org/data/rcfeait.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.