IDEAS home Printed from https://ideas.repec.org/p/boe/boeewp/1025.html
   My bibliography  Save this paper

Flexible Bayesian MIDAS: time‑variation, group‑shrinkage and sparsity

Author

Listed:
  • Kohns, David

    (Aalto University)

  • Potjagailo, Galina

    (Bank of England)

Abstract

We propose a mixed‑frequency regression prediction approach that models a time‑varying trend, stochastic volatility and fat tails in the variable of interest. The coefficients of high‑frequency indicators are regularised via a shrinkage prior that accounts for the grouping structure and within‑group correlation among lags. A new sparsification algorithm on the posterior motivated by Bayesian decision theory derives inclusion probabilities over lag groups, thus making the results easy to communicate without imposing sparsity a priori. An empirical application on nowcasting UK GDP growth suggests that group‑shrinkage in combination with the time‑varying components substantially increases nowcasting performance by reading signals from an economically meaningful subset of indicators, whereas the time‑varying components help by allowing the model to switch between indicators. Over the data release cycle, signals initially stem from survey data and then shift towards few ‘hard’ real activity indicators. During the Covid pandemic, the model performs relatively well since it shifts towards indicators for the service and housing sectors that capture the disruptions from economic lockdowns.

Suggested Citation

  • Kohns, David & Potjagailo, Galina, 2023. "Flexible Bayesian MIDAS: time‑variation, group‑shrinkage and sparsity," Bank of England working papers 1025, Bank of England.
  • Handle: RePEc:boe:boeewp:1025
    as

    Download full text from publisher

    File URL: https://www.bankofengland.co.uk/-/media/boe/files/working-paper/2023/flexible-bayesian-midas-time-variation-group-shrinkage-and-sparsity.pdf
    File Function: Full text
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Elena Angelini & Gonzalo Camba‐Mendez & Domenico Giannone & Lucrezia Reichlin & Gerhard Rünstler, 2011. "Short‐term forecasts of euro area GDP growth," Econometrics Journal, Royal Economic Society, vol. 14(1), pages 25-44, February.
    2. Diebold, Francis X & Gunther, Todd A & Tay, Anthony S, 1998. "Evaluating Density Forecasts with Applications to Financial Risk Management," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 863-883, November.
    3. Ferrara, Laurent & Mogliani, Matteo & Sahuc, Jean-Guillaume, 2022. "High-frequency monitoring of growth at risk," International Journal of Forecasting, Elsevier, vol. 38(2), pages 582-595.
    4. Jacquier, Eric & Polson, Nicholas G. & Rossi, P.E.Peter E., 2004. "Bayesian analysis of stochastic volatility models with fat-tails and correlated errors," Journal of Econometrics, Elsevier, vol. 122(1), pages 185-212, September.
    5. Juan Antolin-Diaz & Thomas Drechsel & Ivan Petrella, 2017. "Tracking the Slowdown in Long-Run GDP Growth," The Review of Economics and Statistics, MIT Press, vol. 99(2), pages 343-356, May.
    6. Zou, Hui, 2006. "The Adaptive Lasso and Its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1418-1429, December.
    7. Domenico Giannone & Michele Lenza & Giorgio E. Primiceri, 2021. "Economic Predictions With Big Data: The Illusion of Sparsity," Econometrica, Econometric Society, vol. 89(5), pages 2409-2437, September.
    8. Mogliani, Matteo & Simoni, Anna, 2021. "Bayesian MIDAS penalized regressions: Estimation, selection, and prediction," Journal of Econometrics, Elsevier, vol. 222(1), pages 833-860.
    9. Serena Ng, 2021. "Modeling Macroeconomic Variations after Covid-19," NBER Working Papers 29060, National Bureau of Economic Research, Inc.
    10. Antik Chakraborty & Anirban Bhattacharya & Bani K Mallick, 2020. "Bayesian sparse multiple regression for simultaneous rank reduction and variable selection," Biometrika, Biometrika Trust, vol. 107(1), pages 205-221.
    11. Chang-Jin Kim & Charles R. Nelson, 1999. "Has The U.S. Economy Become More Stable? A Bayesian Approach Based On A Markov-Switching Model Of The Business Cycle," The Review of Economics and Statistics, MIT Press, vol. 81(4), pages 608-616, November.
    12. Sangjoon Kim & Neil Shephard & Siddhartha Chib, 1998. "Stochastic Volatility: Likelihood Inference and Comparison with ARCH Models," Review of Economic Studies, Oxford University Press, vol. 65(3), pages 361-393.
    13. Gabriel Perez-Quiros & Margaret M. McConnell, 2000. "Output Fluctuations in the United States: What Has Changed since the Early 1980's?," American Economic Review, American Economic Association, vol. 90(5), pages 1464-1476, December.
    14. Carriero, Andrea & Galvão, Ana Beatriz & Kapetanios, George, 2019. "A comprehensive evaluation of macroeconomic forecasting methods," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1226-1239.
    15. Claudia Foroni & Massimiliano Marcellino & Christian Schumacher, 2015. "Unrestricted mixed data sampling (MIDAS): MIDAS regressions with unrestricted lag polynomials," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 178(1), pages 57-82, January.
    16. Andreou, Elena & Ghysels, Eric & Kourtellos, Andros, 2010. "Regression models with mixed sampling frequencies," Journal of Econometrics, Elsevier, vol. 158(2), pages 246-261, October.
    17. Pierre Guérin & Massimiliano Marcellino, 2013. "Markov-Switching MIDAS Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 31(1), pages 45-56, January.
    18. Huber, Florian & Koop, Gary & Onorante, Luca & Pfarrhofer, Michael & Schreiner, Josef, 2023. "Nowcasting in a pandemic using non-parametric mixed frequency VARs," Journal of Econometrics, Elsevier, vol. 232(1), pages 52-69.
    19. James H. Stock & Mark W. Watson, 2007. "Why Has U.S. Inflation Become Harder to Forecast?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(s1), pages 3-33, February.
    20. Andrii Babii & Eric Ghysels & Jonas Striaukas, 2022. "Machine Learning Time Series Regressions With an Application to Nowcasting," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(3), pages 1094-1106, June.
    21. Antonello D'Agostino & Luca Gambetti & Domenico Giannone, 2013. "Macroeconomic forecasting and structural change," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(1), pages 82-101, January.
    22. Berger, Tino & Everaert, Gerdie & Vierke, Hauke, 2016. "Testing for time variation in an unobserved components model for the U.S. economy," Journal of Economic Dynamics and Control, Elsevier, vol. 69(C), pages 179-208.
    23. Domenico Giannone & Michele Lenza & Giorgio E. Primiceri, 2019. "Priors for the Long Run," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(526), pages 565-580, April.
    24. Nicolas Woloszko, 2020. "Tracking activity in real time with Google Trends," OECD Economics Department Working Papers 1634, OECD Publishing.
    25. Marta Bańbura & Michele Modugno, 2014. "Maximum Likelihood Estimation Of Factor Models On Datasets With Arbitrary Pattern Of Missing Data," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(1), pages 133-160, January.
    26. Christiane Baumeister & Danilo Leiva-León & Eric R. Sims, 2021. "Tracking Weekly State-Level Economic Conditions," NBER Working Papers 29003, National Bureau of Economic Research, Inc.
    27. Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2015. "Realtime nowcasting with a Bayesian mixed frequency model with stochastic volatility," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 178(4), pages 837-862, October.
    28. Petrella, Ivan & Antolin-Diaz, Juan & Drechsel, Thomas, 2021. "Advances in Nowcasting Economic Activity: Secular Trends, Large Shocks and New Data," CEPR Discussion Papers 15926, C.E.P.R. Discussion Papers.
    29. J. E. Griffin & P. J. Brown, 2012. "Structuring shrinkage: some correlated priors for regression," Biometrika, Biometrika Trust, vol. 99(2), pages 481-487.
    30. Carlos M. Carvalho & Nicholas G. Polson & James G. Scott, 2010. "The horseshoe estimator for sparse signals," Biometrika, Biometrika Trust, vol. 97(2), pages 465-480.
    31. Chiu, Ching-Wai (Jeremy) & Mumtaz, Haroon & Pintér, Gábor, 2017. "Forecasting with VAR models: Fat tails and stochastic volatility," International Journal of Forecasting, Elsevier, vol. 33(4), pages 1124-1143.
    32. Michele Lenza & Giorgio E. Primiceri, 2022. "How to estimate a vector autoregression after March 2020," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(4), pages 688-699, June.
    33. Anesti, Nikoleta & Hayes, Simon & Moreira, Andre & Tasker, James, 2017. "Peering into the present: the Bank’s approach to GDP nowcasting," Bank of England Quarterly Bulletin, Bank of England, vol. 57(2), pages 122-133.
    34. Todd E. Clark, 2011. "Real-Time Density Forecasts From Bayesian Vector Autoregressions With Stochastic Volatility," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(3), pages 327-341, July.
    35. Florian Huber & Gary Koop & Luca Onorante, 2021. "Inducing Sparsity and Shrinkage in Time-Varying Parameter Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(3), pages 669-683, July.
    36. James H. Stock & Mark W. Watson, 2016. "Core Inflation and Trend Inflation," The Review of Economics and Statistics, MIT Press, vol. 98(4), pages 770-784, October.
    37. Chan, Joshua C.C. & Grant, Angelia L., 2016. "Modeling energy price dynamics: GARCH versus stochastic volatility," Energy Economics, Elsevier, vol. 54(C), pages 182-189.
    38. Cogley, Timothy & Morozov, Sergei & Sargent, Thomas J., 2005. "Bayesian fan charts for U.K. inflation: Forecasting and sources of uncertainty in an evolving monetary system," Journal of Economic Dynamics and Control, Elsevier, vol. 29(11), pages 1893-1925, November.
    39. McCausland, William J. & Miller, Shirley & Pelletier, Denis, 2011. "Simulation smoothing for state-space models: A computational efficiency analysis," Computational Statistics & Data Analysis, Elsevier, vol. 55(1), pages 199-212, January.
    40. Niko Hauzenberger & Florian Huber & Luca Onorante, 2021. "Combining shrinkage and sparsity in conjugate vector autoregressive models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 36(3), pages 304-327, April.
    41. David Kohns & Arnab Bhattacharjee, 2020. "Nowcasting Growth using Google Trends Data: A Bayesian Structural Time Series Model," Papers 2011.00938, arXiv.org, revised May 2022.
    42. Nikoleta Anesti & Ana Beatriz Galvao & Silvia Miranda-Agrippino, 2018. "Uncertain Kingdom: Nowcasting GDP and its Revisions," Discussion Papers 1824, Centre for Macroeconomics (CFM).
    43. Michele Lenza & Giorgio E. Primiceri, 2020. "How to Estimate a VAR after March 2020," NBER Working Papers 27771, National Bureau of Economic Research, Inc.
    44. Wang, Hansheng & Leng, Chenlei, 2008. "A note on adaptive group lasso," Computational Statistics & Data Analysis, Elsevier, vol. 52(12), pages 5277-5286, August.
    45. Frühwirth-Schnatter, Sylvia & Wagner, Helga, 2010. "Stochastic model specification search for Gaussian and partial non-Gaussian state space models," Journal of Econometrics, Elsevier, vol. 154(1), pages 85-100, January.
    46. Eric Ghysels & Pedro Santa-Clara & Rossen Valkanov, 2004. "The MIDAS Touch: Mixed Data Sampling Regression Models," CIRANO Working Papers 2004s-20, CIRANO.
    47. George Kapetanios & Fotis Papailias, 2022. "Real Time Indicators During the COVID-19 Pandemic Individual Predictors & Selection," Economic Statistics Centre of Excellence (ESCoE) Technical Reports ESCOE-TR-15, Economic Statistics Centre of Excellence (ESCoE).
    48. Mark W. Watson & James H. Stock, 2004. "Combination forecasts of output growth in a seven-country data set," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 405-430.
    49. Joshua C. C. Chan, 2017. "The Stochastic Volatility in Mean Model With Time-Varying Parameters: An Application to Inflation Modeling," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 35(1), pages 17-28, January.
    50. Friedman, Jerome H. & Hastie, Trevor & Tibshirani, Rob, 2010. "Regularization Paths for Generalized Linear Models via Coordinate Descent," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 33(i01).
    51. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
    52. P. Richard Hahn & Carlos M. Carvalho, 2015. "Decoupling Shrinkage and Selection in Bayesian Linear Models: A Posterior Summary Perspective," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(509), pages 435-448, March.
    53. Foroni, Claudia & Marcellino, Massimiliano, 2014. "A comparison of mixed frequency approaches for nowcasting Euro area macroeconomic aggregates," International Journal of Forecasting, Elsevier, vol. 30(3), pages 554-568.
    54. Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2016. "Large Vector Autoregressions with Stochastic Volatility and Flexible Priors," Working Papers (Old Series) 1617, Federal Reserve Bank of Cleveland.
    55. Jennie Bai & Eric Ghysels & Jonathan H. Wright, 2013. "State Space Models and MIDAS Regressions," Econometric Reviews, Taylor & Francis Journals, vol. 32(7), pages 779-813, October.
    56. James H. Stock & Mark W. Watson, 2007. "Why Has U.S. Inflation Become Harder to Forecast?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(s1), pages 3-33, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. David Kohns & Arnab Bhattacharjee, 2020. "Nowcasting Growth using Google Trends Data: A Bayesian Structural Time Series Model," Papers 2011.00938, arXiv.org, revised May 2022.
    2. Kohns, David & Bhattacharjee, Arnab, 2023. "Nowcasting growth using Google Trends data: A Bayesian Structural Time Series model," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1384-1412.
    3. Gael M. Martin & David T. Frazier & Ruben Loaiza-Maya & Florian Huber & Gary Koop & John Maheu & Didier Nibbering & Anastasios Panagiotelis, 2023. "Bayesian Forecasting in the 21st Century: A Modern Review," Monash Econometrics and Business Statistics Working Papers 1/23, Monash University, Department of Econometrics and Business Statistics.
    4. Gael M. Martin & David T. Frazier & Worapree Maneesoonthorn & Ruben Loaiza-Maya & Florian Huber & Gary Koop & John Maheu & Didier Nibbering & Anastasios Panagiotelis, 2022. "Bayesian Forecasting in Economics and Finance: A Modern Review," Papers 2212.03471, arXiv.org, revised Jul 2023.
    5. Magnus Reif, 2020. "Macroeconomics, Nonlinearities, and the Business Cycle," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 87.
    6. Markus Heinrich & Magnus Reif, 2018. "Forecasting using mixed-frequency VARs with time-varying parameters," ifo Working Paper Series 273, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
    7. Andrea Carriero & Todd E. Clark & Massimiliano Marcellino & Elmar Mertens, 2021. "Addressing COVID-19 Outliers in BVARs with Stochastic Volatility," Working Papers 21-02R, Federal Reserve Bank of Cleveland, revised 09 Aug 2021.
    8. Todd E. Clark & Michael W. McCracken & Elmar Mertens, 2020. "Modeling Time-Varying Uncertainty of Multiple-Horizon Forecast Errors," The Review of Economics and Statistics, MIT Press, vol. 102(1), pages 17-33, March.
    9. Hauzenberger, Niko & Huber, Florian & Klieber, Karin, 2023. "Real-time inflation forecasting using non-linear dimension reduction techniques," International Journal of Forecasting, Elsevier, vol. 39(2), pages 901-921.
    10. Joshua C.C. Chan & Rodney W. Strachan, 2023. "Bayesian State Space Models In Macroeconometrics," Journal of Economic Surveys, Wiley Blackwell, vol. 37(1), pages 58-75, February.
    11. Mogliani, Matteo & Simoni, Anna, 2021. "Bayesian MIDAS penalized regressions: Estimation, selection, and prediction," Journal of Econometrics, Elsevier, vol. 222(1), pages 833-860.
    12. David Kohns & Tibor Szendrei, 2021. "Decoupling Shrinkage and Selection for the Bayesian Quantile Regression," Papers 2107.08498, arXiv.org.
    13. Pfarrhofer, Michael, 2022. "Modeling tail risks of inflation using unobserved component quantile regressions," Journal of Economic Dynamics and Control, Elsevier, vol. 143(C).
    14. Knut Are Aastveit & Francesco Ravazzolo & Herman K. van Dijk, 2018. "Combined Density Nowcasting in an Uncertain Economic Environment," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 36(1), pages 131-145, January.
    15. Richard Schnorrenberger & Aishameriane Schmidt & Guilherme Valle Moura, 2024. "Harnessing Machine Learning for Real-Time Inflation Nowcasting," Working Papers 806, DNB.
    16. Hauzenberger, Niko, 2021. "Flexible Mixture Priors for Large Time-varying Parameter Models," Econometrics and Statistics, Elsevier, vol. 20(C), pages 87-108.
    17. Barbara Rossi, 2019. "Forecasting in the presence of instabilities: How do we know whether models predict well and how to improve them," Economics Working Papers 1711, Department of Economics and Business, Universitat Pompeu Fabra, revised Jul 2021.
    18. Niko Hauzenberger & Michael Pfarrhofer & Luca Rossini, 2020. "Sparse time-varying parameter VECMs with an application to modeling electricity prices," Papers 2011.04577, arXiv.org, revised Apr 2023.
    19. Tamás Kiss & Stepan Mazur & Hoang Nguyen & Pär Österholm, 2023. "Modeling the relation between the US real economy and the corporate bond‐yield spread in Bayesian VARs with non‐Gaussian innovations," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(2), pages 347-368, March.
    20. Hartwig, Benny, 2022. "Bayesian VARs and prior calibration in times of COVID-19," Discussion Papers 52/2022, Deutsche Bundesbank.

    More about this item

    Keywords

    Bayesian MIDAS regressions; forecasting; time‑variation and fat tails; grouped horseshoe prior; decision analysis;
    All these keywords.

    JEL classification:

    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C44 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Operations Research; Statistical Decision Theory
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:boe:boeewp:1025. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Digital Media Team (email available below). General contact details of provider: https://edirc.repec.org/data/boegvuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.