IDEAS home Printed from https://ideas.repec.org/p/zbw/bubdps/042022.html
   My bibliography  Save this paper

Calibration alternatives to logistic regression and their potential for transferring the dispersion of discriminatory power into uncertainties of probabilities of default

Author

Listed:
  • Wosnitza, Jan Henrik

Abstract

The transformation of credit scores into probabilities of default plays an important role in credit risk estimation. The linear logistic regression has developed into a standard calibration approach in the banking sector. With the advent of machine learning techniques in the discriminatory phase of credit risk models, however, the standard calibration approach is currently under scrutiny again. In particular, the assumptions behind the linear logistic regression provide critics with a target. Previous literature has converted the calibration problem into a regression task without any loss of generality. In this paper, we draw on recent academic results in order to suggest two new one-parametric families of differentiable functions as candidates for this regression. The derivation of these two families of differentiable functions is based on the maximum entropy principle and, thus, they rely on a minimum number of assumptions. We compare the performance of four calibration approaches on a real-world data set and find that one of the new one-parametric families outperforms the linear logistic regression. Furthermore, we develop an approach in order to quantify the part of the general estimation error of probabilities of default that stems from the statistical dispersion of the discriminatory power.

Suggested Citation

  • Wosnitza, Jan Henrik, 2022. "Calibration alternatives to logistic regression and their potential for transferring the dispersion of discriminatory power into uncertainties of probabilities of default," Discussion Papers 04/2022, Deutsche Bundesbank.
  • Handle: RePEc:zbw:bubdps:042022
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/251197/1/1794356207.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Moro Russ A. & Härdle Wolfgang K. & Schäfer Dorothea, 2017. "Company rating with support vector machines," Statistics & Risk Modeling, De Gruyter, vol. 34(1-2), pages 55-67, June.
    2. Artem Bequé & Kristof Coussement & Ross Gayler & Stefan Lessmann, 2017. "Approaches for credit scorecard calibration: An empirical analysis," Post-Print hal-01745262, HAL.
    3. Dirk Tasche, 2009. "Estimating discriminatory power and PD curves when the number of defaults is small," Papers 0905.3928, arXiv.org, revised Mar 2010.
    4. Agarwal, Vineet & Taffler, Richard, 2008. "Comparing the performance of market-based and accounting-based bankruptcy prediction models," Journal of Banking & Finance, Elsevier, vol. 32(8), pages 1541-1551, August.
    5. Majid Bazarbash, 2019. "FinTech in Financial Inclusion: Machine Learning Applications in Assessing Credit Risk," IMF Working Papers 2019/109, International Monetary Fund.
    6. Segoviano, Miguel A., 2006. "Consistent information multivariate density optimizing methodology," LSE Research Online Documents on Economics 24511, London School of Economics and Political Science, LSE Library.
    7. Pedro G. Fonseca & Hugo D. Lopes, 2017. "Calibration of Machine Learning Classifiers for Probability of Default Modelling," Papers 1710.08901, arXiv.org.
    8. Petropoulos, Anastasios & Siakoulis, Vasilis & Stavroulakis, Evangelos & Vlachogiannakis, Nikolaos E., 2020. "Predicting bank insolvencies using machine learning techniques," International Journal of Forecasting, Elsevier, vol. 36(3), pages 1092-1113.
    9. Khandani, Amir E. & Kim, Adlar J. & Lo, Andrew W., 2010. "Consumer credit-risk models via machine-learning algorithms," Journal of Banking & Finance, Elsevier, vol. 34(11), pages 2767-2787, November.
    10. Butaru, Florentin & Chen, Qingqing & Clark, Brian & Das, Sanmay & Lo, Andrew W. & Siddique, Akhtar, 2016. "Risk and risk management in the credit card industry," Journal of Banking & Finance, Elsevier, vol. 72(C), pages 218-239.
    11. Andrés Alonso & José Manuel Carbó, 2020. "Machine learning in credit risk: measuring the dilemma between prediction and supervisory cost," Working Papers 2032, Banco de España.
    12. Aussenegg, Wolfgang & Resch, Florian & Winkler, Gerhard, 2011. "Pitfalls and remedies in testing the calibration quality of rating systems," Journal of Banking & Finance, Elsevier, vol. 35(3), pages 698-708, March.
    13. Youyi Fong & Ying Huang, 2019. "Modified Wilcoxon–Mann–Whitney Test and Power Against Strong Null," The American Statistician, Taylor & Francis Journals, vol. 73(1), pages 43-49, January.
    14. Jochen Lawrenz, 2008. "Assessing the Estimation Uncertainty of Default Probabilities," Credit and Capital Markets, Credit and Capital Markets, vol. 41(2), pages 217-238.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andrés Alonso & José Manuel Carbó, 2021. "Understanding the performance of machine learning models to predict credit default: a novel approach for supervisory evaluation," Working Papers 2105, Banco de España.
    2. Anastasios Petropoulos & Vasilis Siakoulis & Evaggelos Stavroulakis & Aristotelis Klamargias, 2019. "A robust machine learning approach for credit risk analysis of large loan level datasets using deep learning and extreme gradient boosting," IFC Bulletins chapters, in: Bank for International Settlements (ed.), Are post-crisis statistical initiatives completed?, volume 49, Bank for International Settlements.
    3. Anastasios Petropoulos & Vasilis Siakoulis & Evaggelos Stavroulakis & Aristotelis Klamargias, 2019. "A robust machine learning approach for credit risk analysis of large loan-level datasets using deep learning and extreme gradient boosting," IFC Bulletins chapters, in: Bank for International Settlements (ed.), The use of big data analytics and artificial intelligence in central banking, volume 50, Bank for International Settlements.
    4. Ting Sun & Miklos A. Vasarhelyi, 2018. "Predicting credit card delinquencies: An application of deep neural networks," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 25(4), pages 174-189, October.
    5. Huang, Yiping & Li, Zhenhua & Qiu, Han & Tao, Sun & Wang, Xue & Zhang, Longmei, 2023. "BigTech credit risk assessment for SMEs," China Economic Review, Elsevier, vol. 81(C).
    6. Irving Fisher Committee, 2019. "The use of big data analytics and artificial intelligence in central banking," IFC Bulletins, Bank for International Settlements, number 50, July.
    7. Andrés Alonso Robisco & José Manuel Carbó Martínez, 2022. "Measuring the model risk-adjusted performance of machine learning algorithms in credit default prediction," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 8(1), pages 1-35, December.
    8. Dimitrios Bisias & Mark Flood & Andrew W. Lo & Stavros Valavanis, 2012. "A Survey of Systemic Risk Analytics," Annual Review of Financial Economics, Annual Reviews, vol. 4(1), pages 255-296, October.
    9. Pan, Shuiyang & Long, Suwan(Cheng) & Wang, Yiming & Xie, Ying, 2023. "Nonlinear asset pricing in Chinese stock market: A deep learning approach," International Review of Financial Analysis, Elsevier, vol. 87(C).
    10. García-Céspedes, Rubén & Moreno, Manuel, 2022. "The generalized Vasicek credit risk model: A Machine Learning approach," Finance Research Letters, Elsevier, vol. 47(PA).
    11. Chen, Dangxing & Ye, Jiahui & Ye, Weicheng, 2023. "Interpretable selective learning in credit risk," Research in International Business and Finance, Elsevier, vol. 65(C).
    12. Carl Remlinger & Bri`ere Marie & Alasseur Cl'emence & Joseph Mikael, 2021. "Expert Aggregation for Financial Forecasting," Papers 2111.15365, arXiv.org, revised Jul 2023.
    13. Nicola Branzoli & Ilaria Supino, 2020. "FinTech credit: a critical review of empirical research," Questioni di Economia e Finanza (Occasional Papers) 549, Bank of Italy, Economic Research and International Relations Area.
    14. Citterio, Alberto & King, Timothy, 2023. "The role of Environmental, Social, and Governance (ESG) in predicting bank financial distress," Finance Research Letters, Elsevier, vol. 51(C).
    15. Chen, Shunqin & Guo, Zhengfeng & Zhao, Xinlei, 2021. "Predicting mortgage early delinquency with machine learning methods," European Journal of Operational Research, Elsevier, vol. 290(1), pages 358-372.
    16. Doumpos, Michalis & Zopounidis, Constantin & Gounopoulos, Dimitrios & Platanakis, Emmanouil & Zhang, Wenke, 2023. "Operational research and artificial intelligence methods in banking," European Journal of Operational Research, Elsevier, vol. 306(1), pages 1-16.
    17. Peter Martey Addo & Dominique Guegan & Bertrand Hassani, 2018. "Credit Risk Analysis Using Machine and Deep Learning Models," Risks, MDPI, vol. 6(2), pages 1-20, April.
    18. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2223-2273.
    19. Nakagawa, Kei & Sakemoto, Ryuta, 2022. "Cryptocurrency network factors and gold," Finance Research Letters, Elsevier, vol. 46(PB).
    20. Haskamp, Ulrich, 2017. "Improving the forecasts of European regional banks' profitability with machine learning algorithms," Ruhr Economic Papers 705, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.

    More about this item

    Keywords

    Calibration; credit score; cumulative accuracy profile; logistic regression; margin of conservatism; probability of default;
    All these keywords.

    JEL classification:

    • G17 - Financial Economics - - General Financial Markets - - - Financial Forecasting and Simulation
    • G21 - Financial Economics - - Financial Institutions and Services - - - Banks; Other Depository Institutions; Micro Finance Institutions; Mortgages
    • G33 - Financial Economics - - Corporate Finance and Governance - - - Bankruptcy; Liquidation

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:bubdps:042022. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/dbbgvde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.