IDEAS home Printed from https://ideas.repec.org/a/gam/jijfss/v9y2021i4p63-d687129.html
   My bibliography  Save this article

Validation of Corporate Probability of Default Models Considering Alternative Use Cases

Author

Listed:
  • Michael Jacobs

    (Wholesale 1st Line Model Development Validation Services, PNC Financial Services Group—Balance Sheet Analytics & Modeling/Model Development, 340 Madison Avenue, New York, NY 10022, USA)

Abstract

In this study, we consider the construction of through-the-cycle (“TTC”) PD models designed for credit underwriting uses and point-in-time (“PIT”) PD models suitable for early warning uses, considering which validation elements should be emphasized in each case. We build PD models using a long history of large corporate firms sourced from Moody’s, with a large number of financial, equity market and macroeconomic variables as candidate explanatory variables. We construct a Merton model-style distance-to-default (“DTD”) measure and build hybrid structural reduced-form models to compare with the financial ratio and macroeconomic variable-only models. In the hybrid models, the financial and macroeconomic explanatory variables still enter significantly and improve the predictive accuracy of the TTC models, which generally lag behind the PIT models in that performance measure. We conclude that care must be taken to judiciously choose the manner in which we validate TTC vs. PIT models, as criteria may be rather different and be apart from standards such as discriminatory power. This study contributes to the literature by providing expert guidance to credit risk modeling, model validation and supervisory practitioners in controlling the model risk associated with such modeling efforts.

Suggested Citation

  • Michael Jacobs, 2021. "Validation of Corporate Probability of Default Models Considering Alternative Use Cases," IJFS, MDPI, vol. 9(4), pages 1-22, November.
  • Handle: RePEc:gam:jijfss:v:9:y:2021:i:4:p:63-:d:687129
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7072/9/4/63/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7072/9/4/63/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Cesaroni, Tatiana, 2015. "Procyclicality of credit rating systems: How to manage it," Journal of Economics and Business, Elsevier, vol. 82(C), pages 62-83.
    2. Yixiao Jiang, 2021. "Semiparametric Estimation of a Corporate Bond Rating Model," Econometrics, MDPI, vol. 9(2), pages 1-20, May.
    3. Khandani, Amir E. & Kim, Adlar J. & Lo, Andrew W., 2010. "Consumer credit-risk models via machine-learning algorithms," Journal of Banking & Finance, Elsevier, vol. 34(11), pages 2767-2787, November.
    4. Amato, Jeffery D. & Furfine, Craig H., 2004. "Are credit ratings procyclical?," Journal of Banking & Finance, Elsevier, vol. 28(11), pages 2641-2677, November.
    5. Merton, Robert C, 1974. "On the Pricing of Corporate Debt: The Risk Structure of Interest Rates," Journal of Finance, American Finance Association, vol. 29(2), pages 449-470, May.
    6. Mr. John Kiff & Michael Kisser & Miss Liliana B Schumacher, 2013. "Rating Through-the-Cycle: What does the Concept Imply for Rating Stability and Accuracy?," IMF Working Papers 2013/064, International Monetary Fund.
    7. Small, Kenneth A & Hsiao, Cheng, 1985. "Multinomial Logit Specification Tests," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 26(3), pages 619-627, October.
    8. Fry, Tim R. L. & Harris, Mark N., 1996. "A Monte Carlo study of tests for the independence of irrelevant alternatives property," Transportation Research Part B: Methodological, Elsevier, vol. 30(1), pages 19-30, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Erik Stam & Roy Thurik & Peter van der Zwan, 2010. "Entrepreneurial exit in real and imagined markets," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 19(4), pages 1109-1139, August.
    2. Roy Cerqueti & Francesca Pampurini & Annagiulia Pezzola & Anna Grazia Quaranta, 2022. "Dangerous liasons and hot customers for banks," Review of Quantitative Finance and Accounting, Springer, vol. 59(1), pages 65-89, July.
    3. Broto, Carmen & Molina, Luis, 2016. "Sovereign ratings and their asymmetric response to fundamentals," Journal of Economic Behavior & Organization, Elsevier, vol. 130(C), pages 206-224.
    4. Ellis, Scott & Sharma, Satish & Brzeszczyński, Janusz, 2022. "Systemic risk measures and regulatory challenges," Journal of Financial Stability, Elsevier, vol. 61(C).
    5. Fok, D. & Paap, R., 2019. "New Misspecification Tests for Multinomial Logit Models," Econometric Institute Research Papers EI2019-24, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    6. Bannier, Christina E. & Bofinger, Yannik & Rock, Björn, 2019. "Doing safe by doing good: ESG investing and corporate social responsibility in the U.S. and Europe," CFS Working Paper Series 621, Center for Financial Studies (CFS).
    7. Claudio Borio, 2011. "Rediscovering the Macroeconomic Roots of Financial Stability Policy: Journey, Challenges, and a Way Forward," Annual Review of Financial Economics, Annual Reviews, vol. 3(1), pages 87-117, December.
    8. Matthias Bodenstedt & Daniel R�sch & Harald Scheule, 2013. "The path to impairment: do credit-rating agencies anticipate default events of structured finance transactions?," The European Journal of Finance, Taylor & Francis Journals, vol. 19(9), pages 841-860, October.
    9. Azad, A.S.M. Sohel & Chazi, Abdelaziz & Cooper, Peter & Ahsan, Amirul, 2018. "What determines the Japanese corporate credit spread? A new evidence," Research in International Business and Finance, Elsevier, vol. 45(C), pages 349-356.
    10. Zhou Lu & Zhuyao Zhuo, 2021. "Modelling of Chinese corporate bond default – A machine learning approach," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 61(5), pages 6147-6191, December.
    11. Brian BARNARD, 2017. "Rating Migration and Bond Valuation: Decomposing Rating Migration Matrices from Market Data via Default Probability Term Structures," Expert Journal of Finance, Sprint Investify, vol. 5(1), pages 49-72.
    12. M. Hashem Pesaran & Til Schuermann & Bjorn-Jakob Treutler, 2007. "Global Business Cycles and Credit Risk," NBER Chapters, in: The Risks of Financial Institutions, pages 419-469, National Bureau of Economic Research, Inc.
    13. Simon Cheng & J. Scott Long, 2007. "Testing for IIA in the Multinomial Logit Model," Sociological Methods & Research, , vol. 35(4), pages 583-600, May.
    14. Brian BARNARD, 2017. "Rating Migration and Bond Valuation: Decomposing Rating Migration Matrices from Market Data via Default Probability Term Structures," Expert Journal of Finance, Sprint Investify, vol. 5, pages 49-72.
    15. Pertaia, Giorgi & Prokhorov, Artem & Uryasev, Stan, 2022. "A new approach to credit ratings," Journal of Banking & Finance, Elsevier, vol. 140(C).
    16. Gann, Philipp, 2009. "Liquidität, Risikoeinstellung des Kapitalmarktes und Konjunkturerwartung als Preisdeterminanten von Collateralized Debt Obligations (CDOs) - Eine simulationsgestützte Analyse," Discussion Papers in Business Administration 10582, University of Munich, Munich School of Management.
    17. Mokhtarian, Patricia L. & Bagley, Michael N., 2000. "Modeling employees' perceptions and proportional preferences of work locations: the regular workplace and telecommuting alternatives," Transportation Research Part A: Policy and Practice, Elsevier, vol. 34(4), pages 223-242, May.
    18. Yukiko Konno & Yuki Itoh, 2016. "An alternative to the standardized approach for assessing credit risk under the Basel Accords," Cogent Economics & Finance, Taylor & Francis Journals, vol. 4(1), pages 1220119-122, December.
    19. Arjun Seshadri & Johan Ugander, 2020. "Fundamental Limits of Testing the Independence of Irrelevant Alternatives in Discrete Choice," Papers 2001.07042, arXiv.org.
    20. Avouyi-Dovi, S. & Bardos, M. & Jardet, C. & Kendaoui, L. & Moquet , J., 2009. "Macro stress testing with a macroeconomic credit risk model: Application to the French manufacturing sector," Working papers 238, Banque de France.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jijfss:v:9:y:2021:i:4:p:63-:d:687129. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.