IDEAS home Printed from
   My bibliography  Save this article

Validation of Corporate Probability of Default Models Considering Alternative Use Cases


  • Michael Jacobs

    (Wholesale 1st Line Model Development Validation Services, PNC Financial Services Group—Balance Sheet Analytics & Modeling/Model Development, 340 Madison Avenue, New York, NY 10022, USA)


In this study, we consider the construction of through-the-cycle (“TTC”) PD models designed for credit underwriting uses and point-in-time (“PIT”) PD models suitable for early warning uses, considering which validation elements should be emphasized in each case. We build PD models using a long history of large corporate firms sourced from Moody’s, with a large number of financial, equity market and macroeconomic variables as candidate explanatory variables. We construct a Merton model-style distance-to-default (“DTD”) measure and build hybrid structural reduced-form models to compare with the financial ratio and macroeconomic variable-only models. In the hybrid models, the financial and macroeconomic explanatory variables still enter significantly and improve the predictive accuracy of the TTC models, which generally lag behind the PIT models in that performance measure. We conclude that care must be taken to judiciously choose the manner in which we validate TTC vs. PIT models, as criteria may be rather different and be apart from standards such as discriminatory power. This study contributes to the literature by providing expert guidance to credit risk modeling, model validation and supervisory practitioners in controlling the model risk associated with such modeling efforts.

Suggested Citation

  • Michael Jacobs, 2021. "Validation of Corporate Probability of Default Models Considering Alternative Use Cases," IJFS, MDPI, vol. 9(4), pages 1-22, November.
  • Handle: RePEc:gam:jijfss:v:9:y:2021:i:4:p:63-:d:687129

    Download full text from publisher

    File URL:
    Download Restriction: no

    File URL:
    Download Restriction: no

    References listed on IDEAS

    1. Cesaroni, Tatiana, 2015. "Procyclicality of credit rating systems: How to manage it," Journal of Economics and Business, Elsevier, vol. 82(C), pages 62-83.
    2. Yixiao Jiang, 2021. "Semiparametric Estimation of a Corporate Bond Rating Model," Econometrics, MDPI, vol. 9(2), pages 1-20, May.
    3. Khandani, Amir E. & Kim, Adlar J. & Lo, Andrew W., 2010. "Consumer credit-risk models via machine-learning algorithms," Journal of Banking & Finance, Elsevier, vol. 34(11), pages 2767-2787, November.
    4. Amato, Jeffery D. & Furfine, Craig H., 2004. "Are credit ratings procyclical?," Journal of Banking & Finance, Elsevier, vol. 28(11), pages 2641-2677, November.
    5. Merton, Robert C, 1974. "On the Pricing of Corporate Debt: The Risk Structure of Interest Rates," Journal of Finance, American Finance Association, vol. 29(2), pages 449-470, May.
    6. Mr. John Kiff & Michael Kisser & Miss Liliana B Schumacher, 2013. "Rating Through-the-Cycle: What does the Concept Imply for Rating Stability and Accuracy?," IMF Working Papers 2013/064, International Monetary Fund.
    7. Small, Kenneth A & Hsiao, Cheng, 1985. "Multinomial Logit Specification Tests," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 26(3), pages 619-627, October.
    8. Fry, Tim R. L. & Harris, Mark N., 1996. "A Monte Carlo study of tests for the independence of irrelevant alternatives property," Transportation Research Part B: Methodological, Elsevier, vol. 30(1), pages 19-30, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Erik Stam & Roy Thurik & Peter van der Zwan, 2010. "Entrepreneurial exit in real and imagined markets," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 19(4), pages 1109-1139, August.
    2. Trueck, Stefan & Rachev, Svetlozar T., 2008. "Rating Based Modeling of Credit Risk," Elsevier Monographs, Elsevier, edition 1, number 9780123736833.
    3. Roy Cerqueti & Francesca Pampurini & Annagiulia Pezzola & Anna Grazia Quaranta, 2022. "Dangerous liasons and hot customers for banks," Review of Quantitative Finance and Accounting, Springer, vol. 59(1), pages 65-89, July.
    4. Kim, Jong-Min & Kim, Dong H. & Jung, Hojin, 2021. "Applications of machine learning for corporate bond yield spread forecasting," The North American Journal of Economics and Finance, Elsevier, vol. 58(C).
    5. Broto, Carmen & Molina, Luis, 2016. "Sovereign ratings and their asymmetric response to fundamentals," Journal of Economic Behavior & Organization, Elsevier, vol. 130(C), pages 206-224.
    6. Vijverberg, Wim P., 2011. "Testing for IIA with the Hausman-McFadden Test," IZA Discussion Papers 5826, Institute of Labor Economics (IZA).
    7. Gerald J. Lobo & Luc Paugam & Hervé Stolowy & Pierre Astolfi, 2017. "The Effect of Business and Financial Market Cycles on Credit Ratings: Evidence from the Last Two Decades," Abacus, Accounting Foundation, University of Sydney, vol. 53(1), pages 59-93, March.
    8. Curry, Timothy J. & Fissel, Gary S. & Hanweck, Gerald A., 2008. "Is there cyclical bias in bank holding company risk ratings?," Journal of Banking & Finance, Elsevier, vol. 32(7), pages 1297-1309, July.
    9. Ellis, Scott & Sharma, Satish & Brzeszczyński, Janusz, 2022. "Systemic risk measures and regulatory challenges," Journal of Financial Stability, Elsevier, vol. 61(C).
    10. Fok, D. & Paap, R., 2019. "New Misspecification Tests for Multinomial Logit Models," Econometric Institute Research Papers EI2019-24, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    11. Bannier, Christina E. & Bofinger, Yannik & Rock, Björn, 2019. "Doing safe by doing good: ESG investing and corporate social responsibility in the U.S. and Europe," CFS Working Paper Series 621, Center for Financial Studies (CFS).
    12. Mokhtarian, Patricia L. & Bagley, Michael N., 2000. "Modeling employees' perceptions and proportional preferences of work locations: the regular workplace and telecommuting alternatives," Transportation Research Part A: Policy and Practice, Elsevier, vol. 34(4), pages 223-242, May.
    13. Serafeim Tsoukas & Marina-Eliza Spaliara, 2014. "Market Implied Ratings and Financing Constraints: Evidence from US Firms," Journal of Business Finance & Accounting, Wiley Blackwell, vol. 41(1-2), pages 242-269, January.
    14. Claudio Borio, 2011. "Rediscovering the Macroeconomic Roots of Financial Stability Policy: Journey, Challenges, and a Way Forward," Annual Review of Financial Economics, Annual Reviews, vol. 3(1), pages 87-117, December.
    15. Curtis, John & McCoy, Daire & Aravena, Claudia, 2018. "Heating system upgrades: The role of knowledge, socio-demographics, building attributes and energy infrastructure," Energy Policy, Elsevier, vol. 120(C), pages 183-196.
    16. Matthias Bodenstedt & Daniel R�sch & Harald Scheule, 2013. "The path to impairment: do credit-rating agencies anticipate default events of structured finance transactions?," The European Journal of Finance, Taylor & Francis Journals, vol. 19(9), pages 841-860, October.
    17. Tim R. L. Fry & Mark N. Harris, 1998. "Testing for Independence of Irrelevant Alternatives," Sociological Methods & Research, , vol. 26(3), pages 401-423, February.
    18. Ahmed, Shamima & Alshater, Muneer M. & Ammari, Anis El & Hammami, Helmi, 2022. "Artificial intelligence and machine learning in finance: A bibliometric review," Research in International Business and Finance, Elsevier, vol. 61(C).
    19. Azad, A.S.M. Sohel & Chazi, Abdelaziz & Cooper, Peter & Ahsan, Amirul, 2018. "What determines the Japanese corporate credit spread? A new evidence," Research in International Business and Finance, Elsevier, vol. 45(C), pages 349-356.
    20. Zhou Lu & Zhuyao Zhuo, 2021. "Modelling of Chinese corporate bond default – A machine learning approach," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 61(5), pages 6147-6191, December.


    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jijfss:v:9:y:2021:i:4:p:63-:d:687129. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.