IDEAS home Printed from https://ideas.repec.org/a/ibn/ijspjl/v14y2025i3p1.html

Bayesian Shrinkage in High-Dimensional VAR Models: A Comparative Study

Author

Listed:
  • Harrison Katz
  • Robert E. Weiss

Abstract

High-dimensional vector autoregressive (VAR) models offer a versatile framework for multivariate time series analysis, yet face critical challenges from over-parameterization and uncertain lag order. In this paper, we systematically compare three Bayesian shrinkage priors (horseshoe, lasso, and normal) and two frequentist regularization approaches (ridge and nonparametric shrinkage) under three carefully crafted simulation scenarios. These scenarios encompass (i) overfitting in a low-dimensional setting, (ii) sparse high-dimensional processes, and (iii) a combined scenario where both large dimension and overfitting complicate inference. We evaluate each method in quality of parameter estimation (root mean squared error, coverage, and interval length) and out-of-sample forecasting (one-step-ahead forecast RMSE). Our findings show that local-global Bayesian methods, particularly the horseshoe, dominate in maintaining accurate coverage and minimizing parameter error, even when the model is heavily over-parameterized. Frequentist ridge often yields competitive point forecasts but underestimates uncertainty, leading to sub-nominal coverage. A real-data application using macroeconomic variables from Canada illustrates how these methods perform in practice, reinforcing the advantages of local-global priors in stabilizing inference when dimension or lag order is inflated.

Suggested Citation

  • Harrison Katz & Robert E. Weiss, 2025. "Bayesian Shrinkage in High-Dimensional VAR Models: A Comparative Study," International Journal of Statistics and Probability, Canadian Center of Science and Education, vol. 14(3), pages 1-1, October.
  • Handle: RePEc:ibn:ijspjl:v:14:y:2025:i:3:p:1
    as

    Download full text from publisher

    File URL: https://ccsenet.org/journal/index.php/ijsp/article/download/0/0/52129/56759
    Download Restriction: no

    File URL: https://ccsenet.org/journal/index.php/ijsp/article/view/0/52129
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Javier Sánchez García & Salvador Cruz Rambaud, 2022. "Machine Learning Regularization Methods in High-Dimensional Monetary and Financial VARs," Mathematics, MDPI, vol. 10(6), pages 1-15, March.
    2. Nicholson, William B. & Matteson, David S. & Bien, Jacob, 2017. "VARX-L: Structured regularization for large vector autoregressions with exogenous variables," International Journal of Forecasting, Elsevier, vol. 33(3), pages 627-651.
    3. Sims, Christopher A, 1980. "Macroeconomics and Reality," Econometrica, Econometric Society, vol. 48(1), pages 1-48, January.
    4. Matteo Barigozzi & Haeran Cho & Dom Owens, 2024. "FNETS: Factor-Adjusted Network Estimation and Forecasting for High-Dimensional Time Series," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 42(3), pages 890-902, July.
    5. Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-162, April.
    6. Hui Zou & Trevor Hastie, 2005. "Addendum: Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(5), pages 768-768, November.
    7. S. Yaser Samadi & Wiranthe B. Herath, 2023. "Reduced-rank Envelope Vector Autoregressive Models," Papers 2309.12902, arXiv.org.
    8. Valentina Aprigliano, 2020. "A large Bayesian VAR with a block‐specific shrinkage: A forecasting application for Italian industrial production," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(8), pages 1291-1304, December.
    9. Hui Zou & Trevor Hastie, 2005. "Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(2), pages 301-320, April.
    10. Prüser, Jan & Blagov, Boris, 2022. "Improving inference and forecasting in VAR models using cross-sectional information," Ruhr Economic Papers 960, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yoshiki Nakajima & Naoya Sueishi, 2022. "Forecasting the Japanese macroeconomy using high-dimensional data," The Japanese Economic Review, Springer, vol. 73(2), pages 299-324, April.
    2. Gefang, Deborah, 2014. "Bayesian doubly adaptive elastic-net Lasso for VAR shrinkage," International Journal of Forecasting, Elsevier, vol. 30(1), pages 1-11.
    3. Hauzenberger, Niko & Huber, Florian & Klieber, Karin & Marcellino, Massimiliano, 2025. "Bayesian neural networks for macroeconomic analysis," Journal of Econometrics, Elsevier, vol. 249(PC).
    4. Kim, Hyun Hak & Swanson, Norman R., 2018. "Mining big data using parsimonious factor, machine learning, variable selection and shrinkage methods," International Journal of Forecasting, Elsevier, vol. 34(2), pages 339-354.
    5. Joseph, Andreas & Potjagailo, Galina & Chakraborty, Chiranjit & Kapetanios, George, 2024. "Forecasting UK inflation bottom up," International Journal of Forecasting, Elsevier, vol. 40(4), pages 1521-1538.
    6. Thomas Despois & Catherine Doz, 2023. "Identifying and interpreting the factors in factor models via sparsity: Different approaches," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(4), pages 533-555, June.
    7. Dai, Zhifeng & Tang, Rui & Zhang, Xinhua, 2023. "Multilayer network analysis for measuring the inter-connectedness between the oil market and G20 stock markets," Energy Economics, Elsevier, vol. 120(C).
    8. Samuel N. Cohen & Giulia Mantoan & Lars Nesheim & 'Aureo de Paula & Arthur Turrell & Lingyi Yang, 2023. "Nowcasting using regression on signatures," Papers 2305.10256, arXiv.org, revised Dec 2025.
    9. Matteo Barigozzi & Marc Hallin, 2017. "A network analysis of the volatility of high dimensional financial series," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 66(3), pages 581-605, April.
    10. Bullock, Shaina S. & Bullock, David W. & Wilson, William W., 2023. "Short-Term Factors Influencing Corn Export Basis Values in the Pre- and Post-COVID Periods: A Comparison of Econometric and Machine Learning Approaches," 2023 Conference, April 24-25, 2023, St. Louis, Missouri 379019, NCR-134/ NCCC-134 Applied Commodity Price Analysis, Forecasting, and Market Risk Management.
    11. Eickmeier, Sandra & Ng, Tim, 2011. "Forecasting national activity using lots of international predictors: An application to New Zealand," International Journal of Forecasting, Elsevier, vol. 27(2), pages 496-511, April.
    12. Clément Cariou & Amélie Charles & Olivier Darné, 2024. "Are national or regional surveys useful for nowcasting regional jobseekers? The case of the French region of Pays‐de‐la‐Loire," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 43(6), pages 2341-2357, September.
    13. Kascha, Christian & Trenkler, Carsten, 2015. "Forecasting VARs, model selection, and shrinkage," Working Papers 15-07, University of Mannheim, Department of Economics.
    14. Hongwei Zhang & Qiang He & Ben Jacobsen & Fuwei Jiang, 2020. "Forecasting stock returns with model uncertainty and parameter instability," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(5), pages 629-644, August.
    15. Olivier Darne & Amelie Charles, 2020. "Nowcasting GDP growth using data reduction methods: Evidence for the French economy," Economics Bulletin, AccessEcon, vol. 40(3), pages 2431-2439.
    16. Ching Hsu & Tina Yu & Shu-Heng Chen, 2021. "Narrative economics using textual analysis of newspaper data: new insights into the U.S. Silver Purchase Act and Chinese price level in 1928–1936," Journal of Computational Social Science, Springer, vol. 4(2), pages 761-785, November.
    17. Schumacher, Christian, 2010. "Factor forecasting using international targeted predictors: The case of German GDP," Economics Letters, Elsevier, vol. 107(2), pages 95-98, May.
    18. Cheng, Mingmian & Swanson, Norman R. & Yang, Xiye, 2021. "Forecasting volatility using double shrinkage methods," Journal of Empirical Finance, Elsevier, vol. 62(C), pages 46-61.
    19. Hasnain Iftikhar & Faridoon Khan & Paulo Canas Rodrigues & Abdulmajeed Atiah Alharbi & Jeza Allohibi, 2025. "Forecasting of Inflation Based on Univariate and Multivariate Time Series Models: An Empirical Application," Mathematics, MDPI, vol. 13(7), pages 1-18, March.
    20. Bo Yu & Dayong Zhang & Qiang Ji, 2025. "Forecasting portfolio variance: a new decomposition approach," Annals of Operations Research, Springer, vol. 348(1), pages 543-578, May.

    More about this item

    JEL classification:

    • R00 - Urban, Rural, Regional, Real Estate, and Transportation Economics - - General - - - General
    • Z0 - Other Special Topics - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ibn:ijspjl:v:14:y:2025:i:3:p:1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Canadian Center of Science and Education (email available below). General contact details of provider: https://edirc.repec.org/data/cepflch.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.