IDEAS home Printed from https://ideas.repec.org/a/eee/jbfina/v134y2022ics0378426621002855.html

Opening the black box – Quantile neural networks for loss given default prediction

Author

Listed:
  • Kellner, Ralf
  • Nagl, Maximilian
  • Rösch, Daniel

Abstract

We extend the linear quantile regression with a neural network structure to enable more flexibility in every quantile of the bank loan loss given default distribution. This allows us to model interactions and non-linear impacts of any kind without the need of specifying the exact form beforehand. The precision of the quantile forecasts increases up to 30% compared to the benchmark, especially for higher quantiles which are most important in credit risk. By using a novel feature importance measure, we calculate the strength, direction, interactions and other non-linear impacts for every conditional quantile and every variable. This enables us to explain why our extension exhibits superior performance over the benchmark. Moreover, we find that the macroeconomy is up to two times more important in USA than in Europe and has large joint impacts in both regions. The macroeconomy is most important in the US, whereas in Europe collateralization is essential.

Suggested Citation

  • Kellner, Ralf & Nagl, Maximilian & Rösch, Daniel, 2022. "Opening the black box – Quantile neural networks for loss given default prediction," Journal of Banking & Finance, Elsevier, vol. 134(C).
  • Handle: RePEc:eee:jbfina:v:134:y:2022:i:c:s0378426621002855
    DOI: 10.1016/j.jbankfin.2021.106334
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0378426621002855
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jbankfin.2021.106334?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Khieu, Hinh D. & Mullineaux, Donald J. & Yi, Ha-Chin, 2012. "The determinants of bank loan recovery rates," Journal of Banking & Finance, Elsevier, vol. 36(4), pages 923-933.
    2. Gambetti, Paolo & Gauthier, Geneviève & Vrins, Frédéric, 2019. "Recovery rates: Uncertainty certainly matters," Journal of Banking & Finance, Elsevier, vol. 106(C), pages 371-383.
    3. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    4. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," Review of Finance, European Finance Association, vol. 33(5), pages 2223-2273.
    5. Mai, Feng & Tian, Shaonan & Lee, Chihoon & Ma, Ling, 2019. "Deep learning models for bankruptcy prediction using textual disclosures," European Journal of Operational Research, Elsevier, vol. 274(2), pages 743-758.
    6. Bellotti, Anthony & Brigo, Damiano & Gambetti, Paolo & Vrins, Frédéric, 2021. "Forecasting recovery rates on non-performing loans with machine learning," International Journal of Forecasting, Elsevier, vol. 37(1), pages 428-444.
    7. Luo, Jian & Yan, Xin & Tian, Ye, 2020. "Unsupervised quadratic surface support vector machine with application to credit risk assessment," European Journal of Operational Research, Elsevier, vol. 280(3), pages 1008-1017.
    8. Calabrese, Raffaella, 2014. "Downturn Loss Given Default: Mixture distribution estimation," European Journal of Operational Research, Elsevier, vol. 237(1), pages 271-277.
    9. Li, Qi & Racine, Jeffrey S, 2008. "Nonparametric Estimation of Conditional CDF and Quantile Functions With Mixed Categorical and Continuous Data," Journal of Business & Economic Statistics, American Statistical Association, vol. 26, pages 423-434.
    10. Sopitpongstorn, Nithi & Silvapulle, Param & Gao, Jiti & Fenech, Jean-Pierre, 2021. "Local logit regression for loan recovery rate," Journal of Banking & Finance, Elsevier, vol. 126(C).
    11. Tadao Hoshino, 2014. "Quantile regression estimation of partially linear additive models," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 26(3), pages 509-536, September.
    12. repec:spo:wpmain:info:hdl:2441/5rkqqmvrn4tl22s9mc4b6ga2g is not listed on IDEAS
    13. Nazemi, Abdolreza & Heidenreich, Konstantin & Fabozzi, Frank J., 2018. "Improving corporate bond recovery rate prediction using multi-factor support vector regressions," European Journal of Operational Research, Elsevier, vol. 271(2), pages 664-675.
    14. Daniel W. Apley & Jingyu Zhu, 2020. "Visualizing the effects of predictor variables in black box supervised learning models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 82(4), pages 1059-1086, September.
    15. A Matuszyk & C Mues & L C Thomas, 2010. "Modelling LGD for unsecured personal loans: decision tree approach," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 61(3), pages 393-398, March.
    16. Betz, Jennifer & Krüger, Steffen & Kellner, Ralf & Rösch, Daniel, 2020. "Macroeconomic effects and frailties in the resolution of non-performing loans," Journal of Banking & Finance, Elsevier, vol. 112(C).
    17. Salvatore D. Tomarchio & Antonio Punzo, 2019. "Modelling the loss given default distribution via a family of zero‐and‐one inflated mixture models," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 182(4), pages 1247-1266, October.
    18. Qi, Min & Zhao, Xinlei, 2011. "Comparison of modeling methods for Loss Given Default," Journal of Banking & Finance, Elsevier, vol. 35(11), pages 2842-2855, November.
    19. Paolo Gambetti & Francesco Roccazzella & Frédéric Vrins, 2022. "Meta-Learning Approaches for Recovery Rate Prediction," Risks, MDPI, vol. 10(6), pages 1-29, June.
    20. Nazemi, Abdolreza & Fabozzi, Frank J., 2018. "Macroeconomic variable selection for creditor recovery rates," Journal of Banking & Finance, Elsevier, vol. 89(C), pages 14-25.
    21. Egon A. Kalotay & Edward I. Altman, 2017. "Intertemporal Forecasts of Defaulted Bond Recoveries and Portfolio Losses," Review of Finance, European Finance Association, vol. 21(1), pages 433-463.
    22. Horowitz, Joel L. & Lee, Sokbae, 2005. "Nonparametric Estimation of an Additive Quantile Regression Model," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 1238-1249, December.
    23. Victor Chernozhukov & Iv·n Fern·ndez-Val & Alfred Galichon, 2010. "Quantile and Probability Curves Without Crossing," Econometrica, Econometric Society, vol. 78(3), pages 1093-1125, May.
    24. Bastos, João A., 2010. "Forecasting bank loans loss-given-default," Journal of Banking & Finance, Elsevier, vol. 34(10), pages 2510-2517, October.
    25. Qi, Min & Yang, Xiaolong, 2009. "Loss given default of high loan-to-value residential mortgages," Journal of Banking & Finance, Elsevier, vol. 33(5), pages 788-799, May.
    26. Doshi, Hitesh & Elkamhi, Redouane & Ornthanalai, Chayawat, 2018. "The Term Structure of Expected Recovery Rates," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 53(6), pages 2619-2661, December.
    27. Grunert, Jens & Weber, Martin, 2009. "Recovery rates of commercial lending: Empirical evidence for German companies," Journal of Banking & Finance, Elsevier, vol. 33(3), pages 505-513, March.
    28. Altman, Edward I. & Kalotay, Egon A., 2014. "Ultimate recovery mixtures," Journal of Banking & Finance, Elsevier, vol. 40(C), pages 116-129.
    29. Koenker,Roger, 2005. "Quantile Regression," Cambridge Books, Cambridge University Press, number 9780521845731, August.
    30. Qi Li & Juan Lin & Jeffrey S. Racine, 2013. "Optimal Bandwidth Selection for Nonparametric Conditional Distribution and Quantile Functions," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 31(1), pages 57-65, January.
    31. Sigrist, Fabio & Hirnschall, Christoph, 2019. "Grabit: Gradient tree-boosted Tobit models for default prediction," Journal of Banking & Finance, Elsevier, vol. 102(C), pages 177-192.
    32. Yao, Xiao & Crook, Jonathan & Andreeva, Galina, 2017. "Enhancing two-stage modelling methodology for loss given default with support vector machines," European Journal of Operational Research, Elsevier, vol. 263(2), pages 679-689.
    33. Loterman, Gert & Brown, Iain & Martens, David & Mues, Christophe & Baesens, Bart, 2012. "Benchmarking regression algorithms for loss given default modeling," International Journal of Forecasting, Elsevier, vol. 28(1), pages 161-170.
    34. Maha Bakoben & Tony Bellotti & Niall Adams, 2020. "Identification of credit risk based on cluster analysis of account behaviours," Journal of the Operational Research Society, Taylor & Francis Journals, vol. 71(5), pages 775-783, May.
    35. Nazemi, Abdolreza & Fatemi Pour, Farnoosh & Heidenreich, Konstantin & Fabozzi, Frank J., 2017. "Fuzzy decision fusion approach for loss-given-default modeling," European Journal of Operational Research, Elsevier, vol. 262(2), pages 780-791.
    36. Kaposty, Florian & Kriebel, Johannes & Löderbusch, Matthias, 2020. "Predicting loss given default in leasing: A closer look at models and variable selection," International Journal of Forecasting, Elsevier, vol. 36(2), pages 248-266.
    37. Betz, Jennifer & Kellner, Ralf & Rösch, Daniel, 2018. "Systematic Effects among Loss Given Defaults and their Implications on Downturn Estimation," European Journal of Operational Research, Elsevier, vol. 271(3), pages 1113-1144.
    38. Mindy Leow & Christophe Mues & Lyn Thomas, 2014. "The economy and loss given default: evidence from two UK retail lending data sets," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 65(3), pages 363-375, March.
    39. Dumitrescu, Elena & Hué, Sullivan & Hurlin, Christophe & Tokpavi, Sessi, 2022. "Machine learning for credit scoring: Improving logistic regression with non-linear decision-tree effects," European Journal of Operational Research, Elsevier, vol. 297(3), pages 1178-1192.
    40. Wu, Qi & Yan, Xing, 2019. "Capturing deep tail risk via sequential learning of quantile dynamics," Journal of Economic Dynamics and Control, Elsevier, vol. 109(C).
    41. Yashkir, Olga & Yashkir, Yuriy, 2013. "Loss Given Default Modelling: Comparative Analysis," MPRA Paper 46147, University Library of Munich, Germany.
    42. Hwang, Ruey-Ching & Chu, Chih-Kang & Yu, Kaizhi, 2020. "Predicting LGD distributions with mixed continuous and discrete ordinal outcomes," International Journal of Forecasting, Elsevier, vol. 36(3), pages 1003-1022.
    43. Ruey-Ching Hwang & Chih-Kang Chu, 2018. "A logistic regression point of view toward loss given default distribution estimation," Quantitative Finance, Taylor & Francis Journals, vol. 18(3), pages 419-435, March.
    44. Hartmann-Wendels, Thomas & Miller, Patrick & Töws, Eugen, 2014. "Loss given default for leasing: Parametric and nonparametric estimations," Journal of Banking & Finance, Elsevier, vol. 40(C), pages 364-375.
    45. Petropoulos, Anastasios & Siakoulis, Vasilis & Stavroulakis, Evangelos & Vlachogiannakis, Nikolaos E., 2020. "Predicting bank insolvencies using machine learning techniques," International Journal of Forecasting, Elsevier, vol. 36(3), pages 1092-1113.
    46. Ellen Tobback & David Martens & Tony Van Gestel & Bart Baesens, 2014. "Forecasting Loss Given Default models: impact of account characteristics and the macroeconomic state," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 65(3), pages 376-392, March.
    47. Bellotti, Tony & Crook, Jonathan, 2012. "Loss given default models incorporating macroeconomic variables for credit cards," International Journal of Forecasting, Elsevier, vol. 28(1), pages 171-182.
    48. repec:spo:wpecon:info:hdl:2441/5rkqqmvrn4tl22s9mc4b6ga2g is not listed on IDEAS
    49. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2223-2273.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Cheng, Hui & Jiang, Cuiqing & Wang, Zhao & Ni, Xiaoya, 2025. "Multi-view locally weighted regression for loss given default forecasting," International Journal of Forecasting, Elsevier, vol. 41(1), pages 290-306.
    2. Theo Berger, 2025. "On the information content of explainable artificial intelligence for quantitative approaches in finance," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 47(1), pages 177-203, March.
    3. Hoang Hiep Nguyen & Jean-Laurent Viviani & Sami Ben Jabeur, 2023. "Bankruptcy prediction using machine learning and Shapley additive explanations," Post-Print hal-04223161, HAL.
    4. Fissler, Tobias & Merz, Michael & Wüthrich, Mario V., 2023. "Deep quantile and deep composite triplet regression," Insurance: Mathematics and Economics, Elsevier, vol. 109(C), pages 94-112.
    5. Matthias Nagl & Maximilian Nagl & Daniel Rösch, 2025. "Non-linearity and the distribution of market-based loss rates," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 47(3), pages 933-967, September.
    6. Davood Pirayesh Neghab & Mucahit Cevik & M. I. M. Wahab & Ayse Basar, 2025. "Explaining Exchange Rate Forecasts with Macroeconomic Fundamentals Using Interpretive Machine Learning," Computational Economics, Springer;Society for Computational Economics, vol. 65(4), pages 1857-1899, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jennifer Betz & Ralf Kellner & Daniel Rösch, 2021. "Time matters: How default resolution times impact final loss rates," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 70(3), pages 619-644, June.
    2. Marc Gürtler & Marvin Zöllner, 2023. "Heterogeneities among credit risk parameter distributions: the modality defines the best estimation method," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 45(1), pages 251-287, March.
    3. Nazemi, Abdolreza & Rezazadeh, Hani & Fabozzi, Frank J. & Höchstötter, Markus, 2022. "Deep learning for modeling the collection rate for third-party buyers," International Journal of Forecasting, Elsevier, vol. 38(1), pages 240-252.
    4. Li, Aimin & Li, Zhiyong & Bellotti, Anthony, 2023. "Predicting loss given default of unsecured consumer loans with time-varying survival scores," Pacific-Basin Finance Journal, Elsevier, vol. 78(C).
    5. Matthias Nagl & Maximilian Nagl & Daniel Rösch, 2025. "Non-linearity and the distribution of market-based loss rates," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 47(3), pages 933-967, September.
    6. Nazemi, Abdolreza & Baumann, Friedrich & Fabozzi, Frank J., 2022. "Intertemporal defaulted bond recoveries prediction via machine learning," European Journal of Operational Research, Elsevier, vol. 297(3), pages 1162-1177.
    7. Hurlin, Christophe & Leymarie, Jérémy & Patin, Antoine, 2018. "Loss functions for Loss Given Default model comparison," European Journal of Operational Research, Elsevier, vol. 268(1), pages 348-360.
    8. Distaso, Walter & Roccazzella, Francesco & Vrins, Frédéric, 2025. "Business cycle and realized losses in the consumer credit industry," European Journal of Operational Research, Elsevier, vol. 323(3), pages 1024-1039.
    9. Betz, Jennifer & Kellner, Ralf & Rösch, Daniel, 2018. "Systematic Effects among Loss Given Defaults and their Implications on Downturn Estimation," European Journal of Operational Research, Elsevier, vol. 271(3), pages 1113-1144.
    10. Nazemi, Abdolreza & Fabozzi, Frank J., 2024. "Interpretable machine learning for creditor recovery rates," Journal of Banking & Finance, Elsevier, vol. 164(C).
    11. Cheng, Hui & Jiang, Cuiqing & Wang, Zhao & Ni, Xiaoya, 2025. "Multi-view locally weighted regression for loss given default forecasting," International Journal of Forecasting, Elsevier, vol. 41(1), pages 290-306.
    12. Kaposty, Florian & Kriebel, Johannes & Löderbusch, Matthias, 2020. "Predicting loss given default in leasing: A closer look at models and variable selection," International Journal of Forecasting, Elsevier, vol. 36(2), pages 248-266.
    13. Salvatore D. Tomarchio & Antonio Punzo, 2019. "Modelling the loss given default distribution via a family of zero‐and‐one inflated mixture models," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 182(4), pages 1247-1266, October.
    14. Sopitpongstorn, Nithi & Silvapulle, Param & Gao, Jiti & Fenech, Jean-Pierre, 2021. "Local logit regression for loan recovery rate," Journal of Banking & Finance, Elsevier, vol. 126(C).
    15. Xia, Yufei & Zhao, Junhao & He, Lingyun & Li, Yinguo & Yang, Xiaoli, 2021. "Forecasting loss given default for peer-to-peer loans via heterogeneous stacking ensemble approach," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1590-1613.
    16. Starosta, Wojciech, 2021. "Loss given default decomposition using mixture distributions of in-default events," European Journal of Operational Research, Elsevier, vol. 292(3), pages 1187-1199.
    17. Barbagli, Matteo & François, Pascal & Gauthier, Geneviève & Vrins, Frédéric, 2025. "The role of CDS spreads in explaining bond recovery rates," Journal of Banking & Finance, Elsevier, vol. 174(C).
    18. Ruey-Ching Hwang & Chih-Kang Chu & Kaizhi Yu, 2021. "Predicting the Loss Given Default Distribution with the Zero-Inflated Censored Beta-Mixture Regression that Allows Probability Masses and Bimodality," Journal of Financial Services Research, Springer;Western Finance Association, vol. 59(3), pages 143-172, June.
    19. Carleo, Alessandra & Rocci, Roberto, 2024. "Functional clustering of NPLs recovery curves," Socio-Economic Planning Sciences, Elsevier, vol. 95(C).
    20. Hwang, Ruey-Ching & Chu, Chih-Kang & Yu, Kaizhi, 2020. "Predicting LGD distributions with mixed continuous and discrete ordinal outcomes," International Journal of Forecasting, Elsevier, vol. 36(3), pages 1003-1022.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • G21 - Financial Economics - - Financial Institutions and Services - - - Banks; Other Depository Institutions; Micro Finance Institutions; Mortgages
    • G33 - Financial Economics - - Corporate Finance and Governance - - - Bankruptcy; Liquidation

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jbfina:v:134:y:2022:i:c:s0378426621002855. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jbf .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.