IDEAS home Printed from https://ideas.repec.org/p/gla/glaewp/2020_11.html

Bayesian dynamic variable selection in high dimensions

Author

Listed:
  • Gary Koop
  • Dimitris Korobilis

Abstract

This paper proposes a variational Bayes algorithm for computationally efficient posterior and predictive inference in time-varying parameter (TVP) models. Within this context we specify a new dynamic variable/model selection strategy for TVP dynamic regression models in the presence of a large number of predictors. This strategy allows for assessing in individual time periods which predictors are relevant (or not) for forecasting the dependent variable. The new algorithm is evaluated numerically using synthetic data and its computational advantages are established. Using macroeconomic data for the US we find that regression models that combine time-varying parameters with the information in many predictors have the potential to improve forecasts of price inflation over a number of alternative forecasting models.

Suggested Citation

  • Gary Koop & Dimitris Korobilis, 2020. "Bayesian dynamic variable selection in high dimensions," Working Papers 2020_11, Business School - Economics, University of Glasgow.
    • Handle: RePEc:gla:glaewp:2020_11
    as

    Download full text from publisher

    File URL: https://www.gla.ac.uk/media/Media_722386_smxx.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. David M. Blei & Alp Kucukelbir & Jon D. McAuliffe, 2017. "Variational Inference: A Review for Statisticians," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(518), pages 859-877, April.
    2. Bitto, Angela & Frühwirth-Schnatter, Sylvia, 2019. "Achieving shrinkage in a time-varying parameter model framework," Journal of Econometrics, Elsevier, vol. 210(1), pages 75-97.
    3. Laurent Callot & Johannes Tang Kristensen, 2014. "Vector Autoregressions with parsimoniously Time Varying Parameters and an Application to Monetary Policy," Tinbergen Institute Discussion Papers 14-145/III, Tinbergen Institute, revised 09 Apr 2015.
    4. Daniel R. Kowal & David S. Matteson & David Ruppert, 2019. "Dynamic shrinkage processes," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 81(4), pages 781-804, September.
    5. Yixin Wang & David M. Blei, 2019. "Frequentist Consistency of Variational Bayes," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(527), pages 1147-1161, July.
    6. Michael W. McCracken & Serena Ng, 2021. "FRED-QD: A Quarterly Database for Macroeconomic Research," Review, Federal Reserve Bank of St. Louis, vol. 103(1), pages 1-44, January.
    7. Luc Bauwens & Gary Koop & Dimitris Korobilis & Jeroen V.K. Rombouts, 2015. "The Contribution of Structural Break Models to Forecasting Macroeconomic Series," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(4), pages 596-620, June.
    8. Gary Koop & Simon M. Potter, 2007. "Estimation and Forecasting in Models with Multiple Breaks," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 74(3), pages 763-789.
    9. Dangl, Thomas & Halling, Michael, 2012. "Predictive regressions with time-varying coefficients," Journal of Financial Economics, Elsevier, vol. 106(1), pages 157-181.
    10. Jouchi Nakajima & Mike West, 2013. "Bayesian Analysis of Latent Threshold Dynamic Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 31(2), pages 151-164, April.
    11. James H. Stock & Mark W. Watson, 2007. "Why Has U.S. Inflation Become Harder to Forecast?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(s1), pages 3-33, February.
    12. Pooyan Amir-Ahmadi & Christian Matthes & Mu-Chun Wang, 2020. "Choosing Prior Hyperparameters: With Applications to Time-Varying Parameter Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 38(1), pages 124-136, January.
    13. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    14. Giordani, Paolo & Kohn, Robert, 2008. "Efficient Bayesian Inference for Multiple Change-Point and Mixture Innovation Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 26, pages 66-77, January.
    15. James H. Stock & Mark W. Watson, 2007. "Erratum to “Why Has U.S. Inflation Become Harder to Forecast?”," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(7), pages 1849-1849, October.
    16. Joshua C.C. Chan & Gary Koop & Roberto Leon-Gonzalez & Rodney W. Strachan, 2012. "Time Varying Dimension Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(3), pages 358-367, January.
    17. Kalli, Maria & Griffin, Jim E., 2014. "Time-varying sparsity in dynamic regression models," Journal of Econometrics, Elsevier, vol. 178(2), pages 779-793.
    18. Leland E. Farmer & Lawrence Schmidt & Allan Timmermann, 2023. "Pockets of Predictability," Journal of Finance, American Finance Association, vol. 78(3), pages 1279-1341, June.
    19. Domenico Giannone & Michele Lenza & Giorgio E. Primiceri, 2021. "Economic Predictions With Big Data: The Illusion of Sparsity," Econometrica, Econometric Society, vol. 89(5), pages 2409-2437, September.
    20. repec:rim:rimwps:19-17 is not listed on IDEAS
    21. Miguel A.G. Belmonte & Gary Koop & Dimitris Korobilis, 2014. "Hierarchical Shrinkage in Time‐Varying Parameter Models," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 33(1), pages 80-94, January.
    22. Dimitris Korobilis, 2021. "High-Dimensional Macroeconomic Forecasting Using Message Passing Algorithms," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(2), pages 493-504, March.
    23. Joseph P. Byrne & Dimitris Korobilis & Pinho J. Ribeiro, 2018. "On The Sources Of Uncertainty In Exchange Rate Predictability," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 59(1), pages 329-357, February.
    24. J. B. Taylor & Harald Uhlig (ed.), 2016. "Handbook of Macroeconomics," Handbook of Macroeconomics, Elsevier, edition 1, volume 2, number 2.
    25. Granger Clive W.J., 2008. "Non-Linear Models: Where Do We Go Next - Time Varying Parameter Models?," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 12(3), pages 1-11, September.
    26. Yousuf, Kashif & Ng, Serena, 2021. "Boosting high dimensional predictive regressions with time varying parameters," Journal of Econometrics, Elsevier, vol. 224(1), pages 60-87.
    27. Kyle Jurado & Sydney C. Ludvigson & Serena Ng, 2015. "Measuring Uncertainty," American Economic Review, American Economic Association, vol. 105(3), pages 1177-1216, March.
    28. David T. Frazier & Ruben Loaiza-Maya & Gael M. Martin, 2021. "Variational Bayes in State Space Models: Inferential and Predictive Accuracy," Papers 2106.12262, arXiv.org, revised Feb 2022.
    29. De Mol, Christine & Giannone, Domenico & Reichlin, Lucrezia, 2008. "Forecasting using a large number of predictors: Is Bayesian shrinkage a valid alternative to principal components?," Journal of Econometrics, Elsevier, vol. 146(2), pages 318-328, October.
    30. Todd E. Clark & Francesco Ravazzolo, 2015. "Macroeconomic Forecasting Performance under Alternative Specifications of Time‐Varying Volatility," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(4), pages 551-575, June.
    31. Dimitris Korobilis & Kenichi Shimizu, 2022. "Bayesian Approaches to Shrinkage and Sparse Estimation," Foundations and Trends(R) in Econometrics, now publishers, vol. 11(4), pages 230-354, June.
    32. Cooley, Thomas F & Prescott, Edward C, 1976. "Estimation in the Presence of Stochastic Parameter Variation," Econometrica, Econometric Society, vol. 44(1), pages 167-184, January.
    33. Korobilis, Dimitris, 2019. "High-dimensional macroeconomic forecasting using message passing algorithms," MPRA Paper 96079, University Library of Munich, Germany.
    34. Ormerod, J. T. & Wand, M. P., 2010. "Explaining Variational Approximations," The American Statistician, American Statistical Association, vol. 64(2), pages 140-153.
    35. Gary Koop & Dimitris Korobilis, 2012. "Forecasting Inflation Using Dynamic Model Averaging," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 53(3), pages 867-886, August.
    36. Hui Zou & Trevor Hastie, 2005. "Addendum: Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(5), pages 768-768, November.
    37. G. Elliott & C. Granger & A. Timmermann (ed.), 2013. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 2, number 2.
    38. Shively, Thomas S. & Kohn, Robert, 1997. "A Bayesian approach to model selection in stochastic coefficient regression models and structural time series models," Journal of Econometrics, Elsevier, vol. 76(1-2), pages 39-52.
    39. Stock, J.H. & Watson, M.W., 2016. "Dynamic Factor Models, Factor-Augmented Vector Autoregressions, and Structural Vector Autoregressions in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 415-525, Elsevier.
    40. Hui Zou & Trevor Hastie, 2005. "Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(2), pages 301-320, April.
    41. Timothy Cogley & Thomas J. Sargent, 2005. "Drift and Volatilities: Monetary Policies and Outcomes in the Post WWII U.S," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 8(2), pages 262-302, April.
    42. Davide Pettenuzzo & Allan Timmermann, 2017. "Forecasting Macroeconomic Variables Under Model Instability," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 35(2), pages 183-201, April.
    43. James H. Stock & Mark W. Watson, 2007. "Why Has U.S. Inflation Become Harder to Forecast?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(s1), pages 3-33, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Cepni, Oguzhan & Clements, Michael P., 2024. "How local is the local inflation factor? Evidence from emerging European countries," International Journal of Forecasting, Elsevier, vol. 40(1), pages 160-183.
    2. Zhentong Lu & Kenichi Shimizu, 2025. "Estimating Discrete Choice Demand Models with Sparse Market-Product Shocks," Staff Working Papers 25-10, Bank of Canada.
    3. David T. Frazier & Ruben Loaiza-Maya & Gael M. Martin, 2021. "Variational Bayes in State Space Models: Inferential and Predictive Accuracy," Papers 2106.12262, arXiv.org, revised Feb 2022.
    4. Luo, Jiawen & Cepni, Oguzhan & Demirer, Riza & Gupta, Rangan, 2025. "Forecasting multivariate volatilities with exogenous predictors: An application to industry diversification strategies," Journal of Empirical Finance, Elsevier, vol. 81(C).
    5. Afees A. Salisu & Rangan Gupta & Ahamuefula E. Ogbonna, 2021. "Point and density forecasting of macroeconomic and financial uncertainties of the USA," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(4), pages 700-707, July.
    6. Mauro Bernardi & Daniele Bianchi & Nicolas Bianco, 2022. "Smoothing volatility targeting," Papers 2212.07288, arXiv.org.
    7. Niko Hauzenberger, 2020. "Flexible Mixture Priors for Large Time-varying Parameter Models," Papers 2006.10088, arXiv.org, revised Nov 2020.
    8. Athanasios Triantafyllou & Nikolaos Vlastakis & Neil Kellard, 2025. "Forecasting Oil Price Volatility: Does Oil Price Uncertainty Matter?," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 45(7), pages 817-830, July.
    9. Jiawen Luo & Tony Klein & Thomas Walther & Qiang Ji, 2024. "Forecasting realized volatility of crude oil futures prices based on machine learning," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 43(5), pages 1422-1446, August.
    10. Salisu, Afees A. & Tchankam, Jean Paul, 2022. "US Stock return predictability with high dimensional models," Finance Research Letters, Elsevier, vol. 45(C).
    11. Jan Prüser & Florian Huber, 2024. "Nonlinearities in macroeconomic tail risk through the lens of big data quantile regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 39(2), pages 269-291, March.
    12. Chen, Sihan & Ming, Lei & Yang, Haoxi & Yang, Shenggang, 2025. "Iterated Dynamic Model Averaging and application to inflation forecasting," International Review of Financial Analysis, Elsevier, vol. 102(C).
    13. Yousuf, Kashif & Ng, Serena, 2021. "Boosting high dimensional predictive regressions with time varying parameters," Journal of Econometrics, Elsevier, vol. 224(1), pages 60-87.
    14. Hauzenberger, Niko, 2021. "Flexible Mixture Priors for Large Time-varying Parameter Models," Econometrics and Statistics, Elsevier, vol. 20(C), pages 87-108.
    15. Haowen Bao & Yongmiao Hong & Yuying Sun & Shouyang Wang, 2024. "Sparse Interval-valued Time Series Modeling with Machine Learning," Papers 2411.09452, arXiv.org.
    16. Dimitris Korobilis & Kenichi Shimizu, 2022. "Bayesian Approaches to Shrinkage and Sparse Estimation," Foundations and Trends(R) in Econometrics, now publishers, vol. 11(4), pages 230-354, June.
    17. Afees A. Salisu & Rangan Gupta & Ahamuefula E. Ogbonna, 2020. "Point and Density Forecasting of Macroeconomic and Financial Uncertainties of the United States," Working Papers 202058, University of Pretoria, Department of Economics.
    18. Weerasinghe, Chaya & Loaiza-Maya, Rubén & Martin, Gael M. & Frazier, David T., 2025. "ABC-based forecasting in misspecified state space models," International Journal of Forecasting, Elsevier, vol. 41(1), pages 270-289.
    19. Zhao, Jing, 2023. "Time-varying impact of geopolitical risk on natural resources prices: Evidence from the hybrid TVP-VAR model with large system," Resources Policy, Elsevier, vol. 82(C).
    20. Martin, Gael M. & Frazier, David T. & Maneesoonthorn, Worapree & Loaiza-Maya, Rubén & Huber, Florian & Koop, Gary & Maheu, John & Nibbering, Didier & Panagiotelis, Anastasios, 2024. "Bayesian forecasting in economics and finance: A modern review," International Journal of Forecasting, Elsevier, vol. 40(2), pages 811-839.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hauzenberger, Niko, 2021. "Flexible Mixture Priors for Large Time-varying Parameter Models," Econometrics and Statistics, Elsevier, vol. 20(C), pages 87-108.
    2. Niko Hauzenberger, 2020. "Flexible Mixture Priors for Large Time-varying Parameter Models," Papers 2006.10088, arXiv.org, revised Nov 2020.
    3. repec:rim:rimwps:18-31 is not listed on IDEAS
    4. Dimitris Korobilis & Kenichi Shimizu, 2022. "Bayesian Approaches to Shrinkage and Sparse Estimation," Foundations and Trends(R) in Econometrics, now publishers, vol. 11(4), pages 230-354, June.
    5. Florian Huber & Gary Koop & Michael Pfarrhofer, 2020. "Bayesian Inference in High-Dimensional Time-varying Parameter Models using Integrated Rotated Gaussian Approximations," Papers 2002.10274, arXiv.org.
    6. Dimitris Korobilis, 2021. "High-Dimensional Macroeconomic Forecasting Using Message Passing Algorithms," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(2), pages 493-504, March.
    7. Joshua C.C. Chan & Rodney W. Strachan, 2023. "Bayesian State Space Models In Macroeconometrics," Journal of Economic Surveys, Wiley Blackwell, vol. 37(1), pages 58-75, February.
    8. Barbara Rossi, 2021. "Forecasting in the Presence of Instabilities: How We Know Whether Models Predict Well and How to Improve Them," Journal of Economic Literature, American Economic Association, vol. 59(4), pages 1135-1190, December.
    9. Hauzenberger, Niko & Huber, Florian & Klieber, Karin, 2023. "Real-time inflation forecasting using non-linear dimension reduction techniques," International Journal of Forecasting, Elsevier, vol. 39(2), pages 901-921.
    10. Joshua C. C. Chan, 2018. "Specification tests for time-varying parameter models with stochastic volatility," Econometric Reviews, Taylor & Francis Journals, vol. 37(8), pages 807-823, September.
    11. Dufays, Arnaud & Rombouts, Jeroen V.K., 2020. "Relevant parameter changes in structural break models," Journal of Econometrics, Elsevier, vol. 217(1), pages 46-78.
    12. Nima Nonejad, 2021. "An Overview Of Dynamic Model Averaging Techniques In Time‐Series Econometrics," Journal of Economic Surveys, Wiley Blackwell, vol. 35(2), pages 566-614, April.
    13. repec:rim:rimwps:18-30 is not listed on IDEAS
    14. Chen, Qitong & Hong, Yongmiao & Li, Haiqi, 2024. "Time-varying forecast combination for factor-augmented regressions with smooth structural changes," Journal of Econometrics, Elsevier, vol. 240(1).
    15. Magnus Reif, 2020. "Macroeconomics, Nonlinearities, and the Business Cycle," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 87.
    16. Joscha Beckmann & Rainer Schüssler, 2014. "Forecasting Exchange Rates under Model and Parameter Uncertainty," CQE Working Papers 3214, Center for Quantitative Economics (CQE), University of Muenster.
    17. Felix Abramovich & Vadim Grinshtein, 2013. "Estimation of a sparse group of sparse vectors," Biometrika, Biometrika Trust, vol. 100(2), pages 355-370.
    18. Arnaud Dufays & Zhuo Li & Jeroen V.K. Rombouts & Yong Song, 2021. "Sparse change‐point VAR models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(6), pages 703-727, September.
    19. Martin, Gael M. & Frazier, David T. & Maneesoonthorn, Worapree & Loaiza-Maya, Rubén & Huber, Florian & Koop, Gary & Maheu, John & Nibbering, Didier & Panagiotelis, Anastasios, 2024. "Bayesian forecasting in economics and finance: A modern review," International Journal of Forecasting, Elsevier, vol. 40(2), pages 811-839.
    20. Cepni, Oguzhan & Clements, Michael P., 2024. "How local is the local inflation factor? Evidence from emerging European countries," International Journal of Forecasting, Elsevier, vol. 40(1), pages 160-183.
    21. Beckmann, Joscha & Schüssler, Rainer, 2016. "Forecasting exchange rates under parameter and model uncertainty," Journal of International Money and Finance, Elsevier, vol. 60(C), pages 267-288.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    JEL classification:

    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gla:glaewp:2020_11. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Business School Research Team (email available below). General contact details of provider: https://edirc.repec.org/data/dpglauk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.