IDEAS home Printed from https://ideas.repec.org/p/pra/mprapa/30148.html
   My bibliography  Save this paper

The predictive accuracy of credit ratings: Measurement and statistical inference

Author

Listed:
  • Orth, Walter

Abstract

Credit ratings are ordinal predictions for the default risk of an obligor. To evaluate the accuracy of such predictions commonly used measures are the Accuracy Ratio or, equivalently, the Area under the ROC curve. The disadvantage of these measures is that they treat default as a binary variable thereby neglecting the timing of the default events and also not using the full information from censored observations. We present an alternative measure that is related to the Accuracy Ratio but does not suffer from these drawbacks. As a second contribution, we study statistical inference for the Accuracy Ratio and the proposed measure in the case of multiple cohorts of obligors with overlapping lifetimes. We derive methods that use more sample information and lead to more powerful tests than alternatives that filter just the independent part of the dataset. All procedures are illustrated in the empirical section using a dataset of S\&P Long Term Credit Ratings.

Suggested Citation

  • Orth, Walter, 2010. "The predictive accuracy of credit ratings: Measurement and statistical inference," MPRA Paper 30148, University Library of Munich, Germany, revised 16 Feb 2011.
    • Handle: RePEc:pra:mprapa:30148
    as

    Download full text from publisher

    File URL: https://mpra.ub.uni-muenchen.de/30148/1/MPRA_paper_30148.pdf
    File Function: original version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Walter Krämer & André Güttler, 2008. "On comparing the accuracy of default predictions in the rating industry," Empirical Economics, Springer, vol. 34(2), pages 343-356, March.
    2. Andre Güttler & Peter Raupach, 2010. "The Impact of Downward Rating Momentum," Journal of Financial Services Research, Springer;Western Finance Association, vol. 37(1), pages 1-23, February.
    3. C. A. Field & A. H. Welsh, 2007. "Bootstrapping clustered data," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(3), pages 369-390, June.
    4. Roger Newson, 2006. "Confidence intervals for rank statistics: Somers' D and extensions," Stata Journal, StataCorp LP, vol. 6(3), pages 309-334, September.
    5. Lando, David & Skodeberg, Torben M., 2002. "Analyzing rating transitions and rating drift with continuous observations," Journal of Banking & Finance, Elsevier, vol. 26(2-3), pages 423-444, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Orth, Walter, 2012. "The predictive accuracy of credit ratings: Measurement and statistical inference," International Journal of Forecasting, Elsevier, vol. 28(1), pages 288-296.
    2. Duffie, Darrell & Saita, Leandro & Wang, Ke, 2007. "Multi-period corporate default prediction with stochastic covariates," Journal of Financial Economics, Elsevier, vol. 83(3), pages 635-665, March.
    3. Andre Güttler & Peter Raupach, 2010. "The Impact of Downward Rating Momentum," Journal of Financial Services Research, Springer;Western Finance Association, vol. 37(1), pages 1-23, February.
    4. Dimitris Gavalas & Theodore Syriopoulos, 2014. "Bank Credit Risk Management and Rating Migration Analysis on the Business Cycle," IJFS, MDPI, vol. 2(1), pages 1-22, March.
    5. Alexander B. Matthies, 2013. "Empirical Research on Corporate Credit-Ratings: A Literature Review," SFB 649 Discussion Papers SFB649DP2013-003, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
    6. Kurt Hornik & Rainer Jankowitsch & Manuel Lingo & Stefan Pichler & Gerhard Winkler, 2010. "Determinants of heterogeneity in European credit ratings," Financial Markets and Portfolio Management, Springer;Swiss Society for Financial Market Research, vol. 24(3), pages 271-287, September.
    7. Pesaran, M. Hashem & Schuermann, Til & Treutler, Bjorn-Jakob & Weiner, Scott M., 2006. "Macroeconomic Dynamics and Credit Risk: A Global Perspective," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 38(5), pages 1211-1261, August.
    8. Wen Shi & Xi Chen & Jennifer Shang, 2019. "An Efficient Morris Method-Based Framework for Simulation Factor Screening," INFORMS Journal on Computing, INFORMS, vol. 31(4), pages 745-770, October.
    9. David Roodman & James G. MacKinnon & Morten Ørregaard Nielsen & Matthew D. Webb, 2019. "Fast and wild: Bootstrap inference in Stata using boottest," Stata Journal, StataCorp LP, vol. 19(1), pages 4-60, March.
    10. Correa, Arnildo & Marins, Jaqueline & Neves, Myrian & da Silva, Antonio Carlos, 2014. "Credit Default and Business Cycles: An Empirical Investigation of Brazilian Retail Loans," Revista Brasileira de Economia - RBE, EPGE Brazilian School of Economics and Finance - FGV EPGE (Brazil), vol. 68(3), September.
    11. Pesaran M.H. & Schuermann T. & Weiner S.M., 2004. "Modeling Regional Interdependencies Using a Global Error-Correcting Macroeconometric Model," Journal of Business & Economic Statistics, American Statistical Association, vol. 22, pages 129-162, April.
    12. Georges Dionne & Geneviève Gauthier & Khemais Hammami & Mathieu Maurice & Jean‐Guy Simonato, 2010. "Default Risk in Corporate Yield Spreads," Financial Management, Financial Management Association International, vol. 39(2), pages 707-731, June.
    13. Valerio Vacca, 2011. "An unexpected crisis? Looking at pricing effectiveness of different banks," Temi di discussione (Economic working papers) 814, Bank of Italy, Economic Research and International Relations Area.
    14. Kiefer, Nicholas M. & Larson, C. Erik, 2007. "A simulation estimator for testing the time homogeneity of credit rating transitions," Journal of Empirical Finance, Elsevier, vol. 14(5), pages 818-835, December.
    15. Coisnon, Thomas & Rousselière, Damien & Rousselière, Samira, 2018. "Information on biodiversity and environmental behaviors: a European study of individual and institutional drivers to adopt sustainable gardening practices," Working Papers 272611, Institut National de la recherche Agronomique (INRA), Departement Sciences Sociales, Agriculture et Alimentation, Espace et Environnement (SAE2).
    16. Jones, Stewart & Johnstone, David & Wilson, Roy, 2015. "An empirical evaluation of the performance of binary classifiers in the prediction of credit ratings changes," Journal of Banking & Finance, Elsevier, vol. 56(C), pages 72-85.
    17. Wozabal, David & Hochreiter, Ronald, 2012. "A coupled Markov chain approach to credit risk modeling," Journal of Economic Dynamics and Control, Elsevier, vol. 36(3), pages 403-415.
    18. François Coppens & Fernando Gonzáles & Gerhard Winkler, 2007. "The performance of credit rating systems in the assessment of collateral used in Eurosystem monetary policy operations," Working Paper Research 118, National Bank of Belgium.
    19. Robin Van Oirbeek & Emmanuel Lesaffre, 2018. "An Investigation of the Discriminatory Ability of the Clustering Effect of the Frailty Survival Model," Biostatistics and Biometrics Open Access Journal, Juniper Publishers Inc., vol. 6(3), pages 87-98, April.
    20. Johannes Hörner & Nicolas S Lambert, 2021. "Motivational Ratings [Toward the Next Generation of Recommender Systems: A Survey of the State-of-the-Art and Possible Extensions]," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 88(4), pages 1892-1935.

    More about this item

    Keywords

    Ratings; predictive accuracy; Accuracy Ratio; Harrell's C; overlapping lifetimes;
    All these keywords.

    JEL classification:

    • C41 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Duration Analysis; Optimal Timing Strategies
    • G32 - Financial Economics - - Corporate Finance and Governance - - - Financing Policy; Financial Risk and Risk Management; Capital and Ownership Structure; Value of Firms; Goodwill
    • G24 - Financial Economics - - Financial Institutions and Services - - - Investment Banking; Venture Capital; Brokerage

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:30148. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joachim Winter (email available below). General contact details of provider: https://edirc.repec.org/data/vfmunde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.