IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2202.03110.html
   My bibliography  Save this paper

Predicting Default Probabilities for Stress Tests: A Comparison of Models

Author

Listed:
  • Martin Guth

Abstract

Since the Great Financial Crisis (GFC), the use of stress tests as a tool for assessing the resilience of financial institutions to adverse financial and economic developments has increased significantly. One key part in such exercises is the translation of macroeconomic variables into default probabilities for credit risk by using macrofinancial linkage models. A key requirement for such models is that they should be able to properly detect signals from a wide array of macroeconomic variables in combination with a mostly short data sample. The aim of this paper is to compare a great number of different regression models to find the best performing credit risk model. We set up an estimation framework that allows us to systematically estimate and evaluate a large set of models within the same environment. Our results indicate that there are indeed better performing models than the current state-of-the-art model. Moreover, our comparison sheds light on other potential credit risk models, specifically highlighting the advantages of machine learning models and forecast combinations.

Suggested Citation

  • Martin Guth, 2022. "Predicting Default Probabilities for Stress Tests: A Comparison of Models," Papers 2202.03110, arXiv.org.
  • Handle: RePEc:arx:papers:2202.03110
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2202.03110
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Huber, Florian & Koop, Gary & Onorante, Luca & Pfarrhofer, Michael & Schreiner, Josef, 2023. "Nowcasting in a pandemic using non-parametric mixed frequency VARs," Journal of Econometrics, Elsevier, vol. 232(1), pages 52-69.
    2. Castro, Vítor, 2013. "Macroeconomic determinants of the credit risk in the banking system: The case of the GIPSI," Economic Modelling, Elsevier, vol. 31(C), pages 672-683.
    3. Carlos M. Carvalho & Nicholas G. Polson & James G. Scott, 2010. "The horseshoe estimator for sparse signals," Biometrika, Biometrika Trust, vol. 97(2), pages 465-480.
    4. Peter Grundke & Kamil Pliszka & Michael Tuchscherer, 2020. "Model and estimation risk in credit risk stress tests," Review of Quantitative Finance and Accounting, Springer, vol. 55(1), pages 163-199, July.
    5. Bostjan Aver, 2008. "An Empirical Analysis of Credit Risk Factors of the Slovenian Banking System," Managing Global Transitions, University of Primorska, Faculty of Management Koper, vol. 6(3), pages 317-334.
    6. Hsiao, Cheng & Wan, Shui Ki, 2014. "Is there an optimal forecast combination?," Journal of Econometrics, Elsevier, vol. 178(P2), pages 294-309.
    7. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    8. Anirban Bhattacharya & Debdeep Pati & Natesh S. Pillai & David B. Dunson, 2015. "Dirichlet--Laplace Priors for Optimal Shrinkage," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(512), pages 1479-1490, December.
    9. Castrén, Olli & Dées, Stéphane & Zaher, Fadi, 2010. "Stress-testing euro area corporate default probabilities using a global macroeconomic model," Journal of Financial Stability, Elsevier, vol. 6(2), pages 64-78, June.
    10. Hansen, Bruce E. & Racine, Jeffrey S., 2012. "Jackknife model averaging," Journal of Econometrics, Elsevier, vol. 167(1), pages 38-46.
    11. Marco Gross & Javier Población, 2019. "Implications of Model Uncertainty for Bank Stress Testing," Journal of Financial Services Research, Springer;Western Finance Association, vol. 55(1), pages 31-58, February.
    12. Elliott, Graham & Rothenberg, Thomas J & Stock, James H, 1996. "Efficient Tests for an Autoregressive Unit Root," Econometrica, Econometric Society, vol. 64(4), pages 813-836, July.
    13. Hyndman, Rob J. & Koehler, Anne B., 2006. "Another look at measures of forecast accuracy," International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
    14. Ivan Alves, 2005. "Sectoral fragility: factors and dynamics," BIS Papers chapters, in: Bank for International Settlements (ed.), Investigating the relationship between the financial and real economy, volume 22, pages 450-80, Bank for International Settlements.
    15. Fan J. & Li R., 2001. "Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1348-1360, December.
    16. Bruce E. Hansen, 2007. "Least Squares Model Averaging," Econometrica, Econometric Society, vol. 75(4), pages 1175-1189, July.
    17. Marcello Bofondi & Tiziano Ropele, 2011. "Macroeconomic determinants of bad loans: evidence from Italian banks," Questioni di Economia e Finanza (Occasional Papers) 89, Bank of Italy, Economic Research and International Relations Area.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mark F. J. Steel, 2020. "Model Averaging and Its Use in Economics," Journal of Economic Literature, American Economic Association, vol. 58(3), pages 644-719, September.
    2. Wen-Hsien Liu & Shu-Shih Weng, 2018. "On predicting the semiconductor industry cycle: a Bayesian model averaging approach," Empirical Economics, Springer, vol. 54(2), pages 673-703, March.
    3. Niko Hauzenberger & Florian Huber & Karin Klieber & Massimiliano Marcellino, 2022. "Bayesian Neural Networks for Macroeconomic Analysis," Papers 2211.04752, arXiv.org, revised Apr 2024.
    4. Exterkate, Peter & Groenen, Patrick J.F. & Heij, Christiaan & van Dijk, Dick, 2016. "Nonlinear forecasting with many predictors using kernel ridge regression," International Journal of Forecasting, Elsevier, vol. 32(3), pages 736-753.
    5. Qingfeng Liu & Qingsong Yao & Guoqing Zhao, 2020. "Model averaging estimation for conditional volatility models with an application to stock market volatility forecast," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(5), pages 841-863, August.
    6. Ren, Yu & Liang, Xuanxuan & Wang, Qin, 2021. "Short-term exchange rate forecasting: A panel combination approach," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 73(C).
    7. Todd E. Clark & Florian Huber & Gary Koop & Massimiliano Marcellino & Michael Pfarrhofer, 2023. "Tail Forecasting With Multivariate Bayesian Additive Regression Trees," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 64(3), pages 979-1022, August.
    8. Chan, Joshua C.C., 2021. "Minnesota-type adaptive hierarchical priors for large Bayesian VARs," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1212-1226.
    9. Adusei Jumah & Robert M. Kunst, 2016. "Optimizing time-series forecasts for inflation and interest rates using simulation and model averaging," Applied Economics, Taylor & Francis Journals, vol. 48(45), pages 4366-4378, September.
    10. Anastasios Petropoulos & Vasilis Siakoulis & Dionysios Mylonas & Aristotelis Klamargias, 2018. "A combined statistical framework for forecasting default rates of Greek Financial Institutions' credit portfolios," Working Papers 243, Bank of Greece.
    11. Qifan Song & Guang Cheng, 2020. "Bayesian Fusion Estimation via t Shrinkage," Sankhya A: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 82(2), pages 353-385, August.
    12. Yan, Xiaodong & Wang, Hongni & Wang, Wei & Xie, Jinhan & Ren, Yanyan & Wang, Xinjun, 2021. "Optimal model averaging forecasting in high-dimensional survival analysis," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1147-1155.
    13. Jan Prüser & Florian Huber, 2024. "Nonlinearities in macroeconomic tail risk through the lens of big data quantile regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 39(2), pages 269-291, March.
    14. Yuying Sun & Shaoxin Hong & Zongwu Cai, 2023. "Optimal Local Model Averaging for Divergent-Dimensional Functional-Coefficient Regressions," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 202309, University of Kansas, Department of Economics, revised Sep 2023.
    15. Banerjee, Sayantan, 2022. "Horseshoe shrinkage methods for Bayesian fusion estimation," Computational Statistics & Data Analysis, Elsevier, vol. 174(C).
    16. Iulia Andreea Bucur & Simona Elena Dragomirescu, 2014. "The Influence Of Macroeconomic Conditions On Credit Risk: Case Of Romanian Banking System," Studies and Scientific Researches. Economics Edition, "Vasile Alecsandri" University of Bacau, Faculty of Economic Sciences, issue 19.
    17. Gao, Yan & Zhang, Xinyu & Wang, Shouyang & Zou, Guohua, 2016. "Model averaging based on leave-subject-out cross-validation," Journal of Econometrics, Elsevier, vol. 192(1), pages 139-151.
    18. Jingwen Tu & Hu Yang & Chaohui Guo & Jing Lv, 2021. "Model averaging marginal regression for high dimensional conditional quantile prediction," Statistical Papers, Springer, vol. 62(6), pages 2661-2689, December.
    19. Mohitosh Kejriwal & Xuewen Yu, 2019. "Generalized Forecasr Averaging in Autoregressions with a Near Unit Root," Purdue University Economics Working Papers 1318, Purdue University, Department of Economics.
    20. Xing, Li-Min & Zhang, Yue-Jun, 2022. "Forecasting crude oil prices with shrinkage methods: Can nonconvex penalty and Huber loss help?," Energy Economics, Elsevier, vol. 110(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2202.03110. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.