IDEAS home Printed from https://ideas.repec.org/a/ibn/ijspjl/v14y2025i3p1.html
   My bibliography  Save this article

Bayesian Shrinkage in High-Dimensional VAR Models: A Comparative Study

Author

Listed:
  • Harrison Katz
  • Robert E. Weiss

Abstract

High-dimensional vector autoregressive (VAR) models offer a versatile framework for multivariate time series analysis, yet face critical challenges from over-parameterization and uncertain lag order. In this paper, we systematically compare three Bayesian shrinkage priors (horseshoe, lasso, and normal) and two frequentist regularization approaches (ridge and nonparametric shrinkage) under three carefully crafted simulation scenarios. These scenarios encompass (i) overfitting in a low-dimensional setting, (ii) sparse high-dimensional processes, and (iii) a combined scenario where both large dimension and overfitting complicate inference. We evaluate each method in quality of parameter estimation (root mean squared error, coverage, and interval length) and out-of-sample forecasting (one-step-ahead forecast RMSE). Our findings show that local-global Bayesian methods, particularly the horseshoe, dominate in maintaining accurate coverage and minimizing parameter error, even when the model is heavily over-parameterized. Frequentist ridge often yields competitive point forecasts but underestimates uncertainty, leading to sub-nominal coverage. A real-data application using macroeconomic variables from Canada illustrates how these methods perform in practice, reinforcing the advantages of local-global priors in stabilizing inference when dimension or lag order is inflated.

Suggested Citation

  • Harrison Katz & Robert E. Weiss, 2025. "Bayesian Shrinkage in High-Dimensional VAR Models: A Comparative Study," International Journal of Statistics and Probability, Canadian Center of Science and Education, vol. 14(3), pages 1-1, October.
  • Handle: RePEc:ibn:ijspjl:v:14:y:2025:i:3:p:1
    as

    Download full text from publisher

    File URL: https://ccsenet.org/journal/index.php/ijsp/article/download/0/0/52129/56759
    Download Restriction: no

    File URL: https://ccsenet.org/journal/index.php/ijsp/article/view/0/52129
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Javier Sánchez García & Salvador Cruz Rambaud, 2022. "Machine Learning Regularization Methods in High-Dimensional Monetary and Financial VARs," Mathematics, MDPI, vol. 10(6), pages 1-15, March.
    2. Nicholson, William B. & Matteson, David S. & Bien, Jacob, 2017. "VARX-L: Structured regularization for large vector autoregressions with exogenous variables," International Journal of Forecasting, Elsevier, vol. 33(3), pages 627-651.
    3. Sims, Christopher A, 1980. "Macroeconomics and Reality," Econometrica, Econometric Society, vol. 48(1), pages 1-48, January.
    4. Matteo Barigozzi & Haeran Cho & Dom Owens, 2024. "FNETS: Factor-Adjusted Network Estimation and Forecasting for High-Dimensional Time Series," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 42(3), pages 890-902, July.
    5. Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-162, April.
    6. Hui Zou & Trevor Hastie, 2005. "Addendum: Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(5), pages 768-768, November.
    7. S. Yaser Samadi & Wiranthe B. Herath, 2023. "Reduced-rank Envelope Vector Autoregressive Models," Papers 2309.12902, arXiv.org.
    8. Valentina Aprigliano, 2020. "A large Bayesian VAR with a block‐specific shrinkage: A forecasting application for Italian industrial production," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(8), pages 1291-1304, December.
    9. Hui Zou & Trevor Hastie, 2005. "Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(2), pages 301-320, April.
    10. Prüser, Jan & Blagov, Boris, 2022. "Improving inference and forecasting in VAR models using cross-sectional information," Ruhr Economic Papers 960, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yoshiki Nakajima & Naoya Sueishi, 2022. "Forecasting the Japanese macroeconomy using high-dimensional data," The Japanese Economic Review, Springer, vol. 73(2), pages 299-324, April.
    2. Gefang, Deborah, 2014. "Bayesian doubly adaptive elastic-net Lasso for VAR shrinkage," International Journal of Forecasting, Elsevier, vol. 30(1), pages 1-11.
    3. Hauzenberger, Niko & Huber, Florian & Klieber, Karin & Marcellino, Massimiliano, 2025. "Bayesian neural networks for macroeconomic analysis," Journal of Econometrics, Elsevier, vol. 249(PC).
    4. Kim, Hyun Hak & Swanson, Norman R., 2018. "Mining big data using parsimonious factor, machine learning, variable selection and shrinkage methods," International Journal of Forecasting, Elsevier, vol. 34(2), pages 339-354.
    5. Joseph, Andreas & Potjagailo, Galina & Chakraborty, Chiranjit & Kapetanios, George, 2024. "Forecasting UK inflation bottom up," International Journal of Forecasting, Elsevier, vol. 40(4), pages 1521-1538.
    6. Thomas Despois & Catherine Doz, 2023. "Identifying and interpreting the factors in factor models via sparsity: Different approaches," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(4), pages 533-555, June.
    7. Caroline Jardet & Baptiste Meunier, 2022. "Nowcasting world GDP growth with high‐frequency data," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(6), pages 1181-1200, September.
    8. Dai, Zhifeng & Tang, Rui & Zhang, Xinhua, 2023. "Multilayer network analysis for measuring the inter-connectedness between the oil market and G20 stock markets," Energy Economics, Elsevier, vol. 120(C).
    9. Olivier Darne & Amelie Charles, 2020. "Nowcasting GDP growth using data reduction methods: Evidence for the French economy," Economics Bulletin, AccessEcon, vol. 40(3), pages 2431-2439.
    10. Korobilis, Dimitris, 2013. "Hierarchical shrinkage priors for dynamic regressions with many predictors," International Journal of Forecasting, Elsevier, vol. 29(1), pages 43-59.
    11. Samuel N. Cohen & Silvia Lui & Will Malpass & Giulia Mantoan & Lars Nesheim & 'Aureo de Paula & Andrew Reeves & Craig Scott & Emma Small & Lingyi Yang, 2023. "Nowcasting with signature methods," Papers 2305.10256, arXiv.org.
    12. Billio, Monica & Casarin, Roberto & Rossini, Luca, 2019. "Bayesian nonparametric sparse VAR models," Journal of Econometrics, Elsevier, vol. 212(1), pages 97-115.
    13. Kim, Hyun Hak & Swanson, Norman R., 2014. "Forecasting financial and macroeconomic variables using data reduction methods: New empirical evidence," Journal of Econometrics, Elsevier, vol. 178(P2), pages 352-367.
    14. Matteo Barigozzi & Marc Hallin, 2017. "A network analysis of the volatility of high dimensional financial series," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 66(3), pages 581-605, April.
    15. Nicholson, William B. & Matteson, David S. & Bien, Jacob, 2017. "VARX-L: Structured regularization for large vector autoregressions with exogenous variables," International Journal of Forecasting, Elsevier, vol. 33(3), pages 627-651.
    16. Gabauer, David & Gupta, Rangan & Marfatia, Hardik A. & Miller, Stephen M., 2024. "Estimating U.S. housing price network connectedness: Evidence from dynamic Elastic Net, Lasso, and ridge vector autoregressive models," International Review of Economics & Finance, Elsevier, vol. 89(PB), pages 349-362.
    17. Plakandaras, Vasilios & Gupta, Rangan & Gogas, Periklis & Papadimitriou, Theophilos, 2015. "Forecasting the U.S. real house price index," Economic Modelling, Elsevier, vol. 45(C), pages 259-267.
    18. Bantis, Evripidis & Clements, Michael P. & Urquhart, Andrew, 2023. "Forecasting GDP growth rates in the United States and Brazil using Google Trends," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1909-1924.
    19. Eickmeier, Sandra & Ng, Tim, 2011. "Forecasting national activity using lots of international predictors: An application to New Zealand," International Journal of Forecasting, Elsevier, vol. 27(2), pages 496-511, April.
    20. Clément Cariou & Amélie Charles & Olivier Darné, 2024. "Are national or regional surveys useful for nowcasting regional jobseekers? The case of the French region of Pays‐de‐la‐Loire," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 43(6), pages 2341-2357, September.

    More about this item

    JEL classification:

    • R00 - Urban, Rural, Regional, Real Estate, and Transportation Economics - - General - - - General
    • Z0 - Other Special Topics - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ibn:ijspjl:v:14:y:2025:i:3:p:1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Canadian Center of Science and Education (email available below). General contact details of provider: https://edirc.repec.org/data/cepflch.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.