IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2202.03110.html
   My bibliography  Save this paper

Predicting Default Probabilities for Stress Tests: A Comparison of Models

Author

Listed:
  • Martin Guth

Abstract

Since the Great Financial Crisis (GFC), the use of stress tests as a tool for assessing the resilience of financial institutions to adverse financial and economic developments has increased significantly. One key part in such exercises is the translation of macroeconomic variables into default probabilities for credit risk by using macrofinancial linkage models. A key requirement for such models is that they should be able to properly detect signals from a wide array of macroeconomic variables in combination with a mostly short data sample. The aim of this paper is to compare a great number of different regression models to find the best performing credit risk model. We set up an estimation framework that allows us to systematically estimate and evaluate a large set of models within the same environment. Our results indicate that there are indeed better performing models than the current state-of-the-art model. Moreover, our comparison sheds light on other potential credit risk models, specifically highlighting the advantages of machine learning models and forecast combinations.

Suggested Citation

  • Martin Guth, 2022. "Predicting Default Probabilities for Stress Tests: A Comparison of Models," Papers 2202.03110, arXiv.org.
  • Handle: RePEc:arx:papers:2202.03110
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2202.03110
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Huber, Florian & Koop, Gary & Onorante, Luca & Pfarrhofer, Michael & Schreiner, Josef, 2023. "Nowcasting in a pandemic using non-parametric mixed frequency VARs," Journal of Econometrics, Elsevier, vol. 232(1), pages 52-69.
    2. Castro, Vítor, 2013. "Macroeconomic determinants of the credit risk in the banking system: The case of the GIPSI," Economic Modelling, Elsevier, vol. 31(C), pages 672-683.
    3. Carlos M. Carvalho & Nicholas G. Polson & James G. Scott, 2010. "The horseshoe estimator for sparse signals," Biometrika, Biometrika Trust, vol. 97(2), pages 465-480.
    4. Peter Grundke & Kamil Pliszka & Michael Tuchscherer, 2020. "Model and estimation risk in credit risk stress tests," Review of Quantitative Finance and Accounting, Springer, vol. 55(1), pages 163-199, July.
    5. Bostjan Aver, 2008. "An Empirical Analysis of Credit Risk Factors of the Slovenian Banking System," Managing Global Transitions, University of Primorska, Faculty of Management Koper, vol. 6(3), pages 317-334.
    6. Hsiao, Cheng & Wan, Shui Ki, 2014. "Is there an optimal forecast combination?," Journal of Econometrics, Elsevier, vol. 178(P2), pages 294-309.
    7. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    8. Anirban Bhattacharya & Debdeep Pati & Natesh S. Pillai & David B. Dunson, 2015. "Dirichlet--Laplace Priors for Optimal Shrinkage," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(512), pages 1479-1490, December.
    9. Castrén, Olli & Dées, Stéphane & Zaher, Fadi, 2010. "Stress-testing euro area corporate default probabilities using a global macroeconomic model," Journal of Financial Stability, Elsevier, vol. 6(2), pages 64-78, June.
    10. Hansen, Bruce E. & Racine, Jeffrey S., 2012. "Jackknife model averaging," Journal of Econometrics, Elsevier, vol. 167(1), pages 38-46.
    11. Marco Gross & Javier Población, 2019. "Implications of Model Uncertainty for Bank Stress Testing," Journal of Financial Services Research, Springer;Western Finance Association, vol. 55(1), pages 31-58, February.
    12. Elliott, Graham & Rothenberg, Thomas J & Stock, James H, 1996. "Efficient Tests for an Autoregressive Unit Root," Econometrica, Econometric Society, vol. 64(4), pages 813-836, July.
    13. Hyndman, Rob J. & Koehler, Anne B., 2006. "Another look at measures of forecast accuracy," International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
    14. Ivan Alves, 2005. "Sectoral fragility: factors and dynamics," BIS Papers chapters, in: Bank for International Settlements (ed.), Investigating the relationship between the financial and real economy, volume 22, pages 450-80, Bank for International Settlements.
    15. Fan J. & Li R., 2001. "Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1348-1360, December.
    16. Bruce E. Hansen, 2007. "Least Squares Model Averaging," Econometrica, Econometric Society, vol. 75(4), pages 1175-1189, July.
    17. Marcello Bofondi & Tiziano Ropele, 2011. "Macroeconomic determinants of bad loans: evidence from Italian banks," Questioni di Economia e Finanza (Occasional Papers) 89, Bank of Italy, Economic Research and International Relations Area.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mark F. J. Steel, 2020. "Model Averaging and Its Use in Economics," Journal of Economic Literature, American Economic Association, vol. 58(3), pages 644-719, September.
    2. Wen-Hsien Liu & Shu-Shih Weng, 2018. "On predicting the semiconductor industry cycle: a Bayesian model averaging approach," Empirical Economics, Springer, vol. 54(2), pages 673-703, March.
    3. Niko Hauzenberger & Florian Huber & Karin Klieber & Massimiliano Marcellino, 2022. "Bayesian Neural Networks for Macroeconomic Analysis," Papers 2211.04752, arXiv.org, revised Apr 2024.
    4. Todd E. Clark & Florian Huber & Gary Koop & Massimiliano Marcellino & Michael Pfarrhofer, 2023. "Tail Forecasting With Multivariate Bayesian Additive Regression Trees," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 64(3), pages 979-1022, August.
    5. Chan, Joshua C.C., 2021. "Minnesota-type adaptive hierarchical priors for large Bayesian VARs," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1212-1226.
    6. Adusei Jumah & Robert M. Kunst, 2016. "Optimizing time-series forecasts for inflation and interest rates using simulation and model averaging," Applied Economics, Taylor & Francis Journals, vol. 48(45), pages 4366-4378, September.
    7. Anastasios Petropoulos & Vasilis Siakoulis & Dionysios Mylonas & Aristotelis Klamargias, 2018. "A combined statistical framework for forecasting default rates of Greek Financial Institutions' credit portfolios," Working Papers 243, Bank of Greece.
    8. Iulia Andreea Bucur & Simona Elena Dragomirescu, 2014. "The Influence Of Macroeconomic Conditions On Credit Risk: Case Of Romanian Banking System," Studies and Scientific Researches. Economics Edition, "Vasile Alecsandri" University of Bacau, Faculty of Economic Sciences, issue 19.
    9. Xing, Li-Min & Zhang, Yue-Jun, 2022. "Forecasting crude oil prices with shrinkage methods: Can nonconvex penalty and Huber loss help?," Energy Economics, Elsevier, vol. 110(C).
    10. Exterkate, Peter & Groenen, Patrick J.F. & Heij, Christiaan & van Dijk, Dick, 2016. "Nonlinear forecasting with many predictors using kernel ridge regression," International Journal of Forecasting, Elsevier, vol. 32(3), pages 736-753.
    11. Rongjie Jiang & Liming Wang & Yang Bai, 2021. "Optimal model averaging estimator for semi-functional partially linear models," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 84(2), pages 167-194, February.
    12. Haowen Bao & Zongwu Cai & Yuying Sun & Shouyang Wang, 2023. "Penalized Model Averaging for High Dimensional Quantile Regressions," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 202302, University of Kansas, Department of Economics, revised Jan 2023.
    13. Xueying Tang & Xiaofan Xu & Malay Ghosh & Prasenjit Ghosh, 2018. "Bayesian Variable Selection and Estimation Based on Global-Local Shrinkage Priors," Sankhya A: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 80(2), pages 215-246, August.
    14. Thilo Reinschlussel & Martin C. Arnold, 2024. "Information-Enriched Selection of Stationary and Non-Stationary Autoregressions using the Adaptive Lasso," Papers 2402.16580, arXiv.org.
    15. Tae‐Hwy Lee & Shahnaz Parsaeian & Aman Ullah, 2022. "Forecasting Under Structural Breaks Using Improved Weighted Estimation," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 84(6), pages 1485-1501, December.
    16. Shi, Guiling & Lim, Chae Young & Maiti, Tapabrata, 2019. "Model selection using mass-nonlocal prior," Statistics & Probability Letters, Elsevier, vol. 147(C), pages 36-44.
    17. Posch, Konstantin & Arbeiter, Maximilian & Pilz, Juergen, 2020. "A novel Bayesian approach for variable selection in linear regression models," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    18. Jia Chen & Degui Li & Oliver Linton & Zudi Lu, 2015. "Semiparametric model averaging of ultra-high dimensional time series," CeMMAP working papers CWP62/15, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    19. Fang, Fang & Yu, Zhou, 2020. "Model averaging assisted sufficient dimension reduction," Computational Statistics & Data Analysis, Elsevier, vol. 152(C).
    20. Tu, Yundong & Yi, Yanping, 2017. "Forecasting cointegrated nonstationary time series with time-varying variance," Journal of Econometrics, Elsevier, vol. 196(1), pages 83-98.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2202.03110. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.