IDEAS home Printed from https://ideas.repec.org/a/ibn/ijspjl/v14y2025i3p1.html

Bayesian Shrinkage in High-Dimensional VAR Models: A Comparative Study

Author

Listed:
  • Harrison Katz
  • Robert E. Weiss

Abstract

High-dimensional vector autoregressive (VAR) models offer a versatile framework for multivariate time series analysis, yet face critical challenges from over-parameterization and uncertain lag order. In this paper, we systematically compare three Bayesian shrinkage priors (horseshoe, lasso, and normal) and two frequentist regularization approaches (ridge and nonparametric shrinkage) under three carefully crafted simulation scenarios. These scenarios encompass (i) overfitting in a low-dimensional setting, (ii) sparse high-dimensional processes, and (iii) a combined scenario where both large dimension and overfitting complicate inference. We evaluate each method in quality of parameter estimation (root mean squared error, coverage, and interval length) and out-of-sample forecasting (one-step-ahead forecast RMSE). Our findings show that local-global Bayesian methods, particularly the horseshoe, dominate in maintaining accurate coverage and minimizing parameter error, even when the model is heavily over-parameterized. Frequentist ridge often yields competitive point forecasts but underestimates uncertainty, leading to sub-nominal coverage. A real-data application using macroeconomic variables from Canada illustrates how these methods perform in practice, reinforcing the advantages of local-global priors in stabilizing inference when dimension or lag order is inflated.

Suggested Citation

  • Harrison Katz & Robert E. Weiss, 2025. "Bayesian Shrinkage in High-Dimensional VAR Models: A Comparative Study," International Journal of Statistics and Probability, Canadian Center of Science and Education, vol. 14(3), pages 1-1, October.
  • Handle: RePEc:ibn:ijspjl:v:14:y:2025:i:3:p:1
    as

    Download full text from publisher

    File URL: https://ccsenet.org/journal/index.php/ijsp/article/download/0/0/52129/56759
    Download Restriction: no

    File URL: https://ccsenet.org/journal/index.php/ijsp/article/view/0/52129
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Javier Sánchez García & Salvador Cruz Rambaud, 2022. "Machine Learning Regularization Methods in High-Dimensional Monetary and Financial VARs," Mathematics, MDPI, vol. 10(6), pages 1-15, March.
    2. Matteo Barigozzi & Haeran Cho & Dom Owens, 2024. "FNETS: Factor-Adjusted Network Estimation and Forecasting for High-Dimensional Time Series," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 42(3), pages 890-902, July.
    3. Nicholson, William B. & Matteson, David S. & Bien, Jacob, 2017. "VARX-L: Structured regularization for large vector autoregressions with exogenous variables," International Journal of Forecasting, Elsevier, vol. 33(3), pages 627-651.
    4. Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-162, April.
    5. Sims, Christopher A, 1980. "Macroeconomics and Reality," Econometrica, Econometric Society, vol. 48(1), pages 1-48, January.
    6. Hui Zou & Trevor Hastie, 2005. "Addendum: Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(5), pages 768-768, November.
    7. S. Yaser Samadi & Wiranthe B. Herath, 2023. "Reduced-rank Envelope Vector Autoregressive Models," Papers 2309.12902, arXiv.org.
    8. Valentina Aprigliano, 2020. "A large Bayesian VAR with a block‐specific shrinkage: A forecasting application for Italian industrial production," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(8), pages 1291-1304, December.
    9. Hui Zou & Trevor Hastie, 2005. "Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(2), pages 301-320, April.
    10. Prüser, Jan & Blagov, Boris, 2022. "Improving inference and forecasting in VAR models using cross-sectional information," Ruhr Economic Papers 960, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yoshiki Nakajima & Naoya Sueishi, 2022. "Forecasting the Japanese macroeconomy using high-dimensional data," The Japanese Economic Review, Springer, vol. 73(2), pages 299-324, April.
    2. Gefang, Deborah, 2014. "Bayesian doubly adaptive elastic-net Lasso for VAR shrinkage," International Journal of Forecasting, Elsevier, vol. 30(1), pages 1-11.
    3. Hauzenberger, Niko & Huber, Florian & Klieber, Karin & Marcellino, Massimiliano, 2025. "Bayesian neural networks for macroeconomic analysis," Journal of Econometrics, Elsevier, vol. 249(PC).
    4. Kim, Hyun Hak & Swanson, Norman R., 2018. "Mining big data using parsimonious factor, machine learning, variable selection and shrinkage methods," International Journal of Forecasting, Elsevier, vol. 34(2), pages 339-354.
    5. Joseph, Andreas & Potjagailo, Galina & Chakraborty, Chiranjit & Kapetanios, George, 2024. "Forecasting UK inflation bottom up," International Journal of Forecasting, Elsevier, vol. 40(4), pages 1521-1538.
    6. Thomas Despois & Catherine Doz, 2023. "Identifying and interpreting the factors in factor models via sparsity: Different approaches," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(4), pages 533-555, June.
    7. Dai, Zhifeng & Tang, Rui & Zhang, Xinhua, 2023. "Multilayer network analysis for measuring the inter-connectedness between the oil market and G20 stock markets," Energy Economics, Elsevier, vol. 120(C).
    8. Olivier Darne & Amelie Charles, 2020. "Nowcasting GDP growth using data reduction methods: Evidence for the French economy," Economics Bulletin, AccessEcon, vol. 40(3), pages 2431-2439.
    9. Samuel N. Cohen & Giulia Mantoan & Lars Nesheim & 'Aureo de Paula & Arthur Turrell & Lingyi Yang, 2023. "Nowcasting using regression on signatures," Papers 2305.10256, arXiv.org, revised Dec 2025.
    10. Kim, Hyun Hak & Swanson, Norman R., 2014. "Forecasting financial and macroeconomic variables using data reduction methods: New empirical evidence," Journal of Econometrics, Elsevier, vol. 178(P2), pages 352-367.
    11. Matteo Barigozzi & Marc Hallin, 2017. "A network analysis of the volatility of high dimensional financial series," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 66(3), pages 581-605, April.
    12. Nicholson, William B. & Matteson, David S. & Bien, Jacob, 2017. "VARX-L: Structured regularization for large vector autoregressions with exogenous variables," International Journal of Forecasting, Elsevier, vol. 33(3), pages 627-651.
    13. Gabauer, David & Gupta, Rangan & Marfatia, Hardik A. & Miller, Stephen M., 2024. "Estimating U.S. housing price network connectedness: Evidence from dynamic Elastic Net, Lasso, and ridge vector autoregressive models," International Review of Economics & Finance, Elsevier, vol. 89(PB), pages 349-362.
    14. Maung, Kenwin & Swanson, Norman R., 2025. "A survey of models and methods used for forecasting when investing in financial markets," International Journal of Forecasting, Elsevier, vol. 41(4), pages 1355-1382.
    15. Wang, Zhenzhong & Zhu, Zhengyuan & Yu, Cindy, 2025. "Variable Selection in Macroeconomic Forecasting with Many Predictors," Econometrics and Statistics, Elsevier, vol. 36(C), pages 19-36.
    16. Plakandaras, Vasilios & Gupta, Rangan & Gogas, Periklis & Papadimitriou, Theophilos, 2015. "Forecasting the U.S. real house price index," Economic Modelling, Elsevier, vol. 45(C), pages 259-267.
    17. Bantis, Evripidis & Clements, Michael P. & Urquhart, Andrew, 2023. "Forecasting GDP growth rates in the United States and Brazil using Google Trends," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1909-1924.
    18. Bullock, Shaina S. & Bullock, David W. & Wilson, William W., 2023. "Short-Term Factors Influencing Corn Export Basis Values in the Pre- and Post-COVID Periods: A Comparison of Econometric and Machine Learning Approaches," 2023 Conference, April 24-25, 2023, St. Louis, Missouri 379019, NCR-134/ NCCC-134 Applied Commodity Price Analysis, Forecasting, and Market Risk Management.
    19. Billio, Monica & Casarin, Roberto & Rossini, Luca, 2019. "Bayesian nonparametric sparse VAR models," Journal of Econometrics, Elsevier, vol. 212(1), pages 97-115.
    20. Eickmeier, Sandra & Ng, Tim, 2011. "Forecasting national activity using lots of international predictors: An application to New Zealand," International Journal of Forecasting, Elsevier, vol. 27(2), pages 496-511, April.

    More about this item

    JEL classification:

    • R00 - Urban, Rural, Regional, Real Estate, and Transportation Economics - - General - - - General
    • Z0 - Other Special Topics - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ibn:ijspjl:v:14:y:2025:i:3:p:1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Canadian Center of Science and Education (email available below). General contact details of provider: https://edirc.repec.org/data/cepflch.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.