The predictive accuracy of credit ratings: Measurement and statistical inference
AbstractCredit ratings are ordinal predictions for the default risk of an obligor. To evaluate the accuracy of such predictions commonly used measures are the Accuracy Ratio or, equivalently, the Area under the ROC curve. The disadvantage of these measures is that they treat default as a binary variable thereby neglecting the timing of the default events and also not using the full information from censored observations. We present an alternative measure that is related to the Accuracy Ratio but does not suffer from these drawbacks. As a second contribution, we study statistical inference for the Accuracy Ratio and the proposed measure in the case of multiple cohorts of obligors with overlapping lifetimes. We derive methods that use more sample information and lead to more powerful tests than alternatives that filter just the independent part of the dataset. All procedures are illustrated in the empirical section using a dataset of S\&P Long Term Credit Ratings.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by University Library of Munich, Germany in its series MPRA Paper with number 30148.
Date of creation: 22 Mar 2010
Date of revision: 16 Feb 2011
Ratings; predictive accuracy; Accuracy Ratio; Harrell's C; overlapping lifetimes;
Find related papers by JEL classification:
- C41 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Duration Analysis; Optimal Timing Strategies
- G32 - Financial Economics - - Corporate Finance and Governance - - - Financing Policy; Financial Risk and Risk Management; Capital and Ownership Structure; Value of Firms; Goodwill
- G24 - Financial Economics - - Financial Institutions and Services - - - Investment Banking; Venture Capital; Brokerage
This paper has been announced in the following NEP Reports:
- NEP-ALL-2011-04-23 (All new papers)
- NEP-BAN-2011-04-23 (Banking)
- NEP-ECM-2011-04-23 (Econometrics)
- NEP-RMG-2011-04-23 (Risk Management)
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Prof. Dr. Walter Krämer & Andre Güttler, .
"On comparing the accuracy of default predictions in the rating industry,"
2, Business and Social Statistics Department, Technische Universität Dortmund, revised Oct 2006.
- Walter Krämer & André Güttler, 2008. "On comparing the accuracy of default predictions in the rating industry," Empirical Economics, Springer, vol. 34(2), pages 343-356, March.
- André Güttler & Walter Kraemer, 2008. "On Comparing the Accuracy of Default Predictions in the Rating Industry," CESifo Working Paper Series 2202, CESifo Group Munich.
- Andre Güttler & Peter Raupach, 2010. "The Impact of Downward Rating Momentum," Journal of Financial Services Research, Springer, vol. 37(1), pages 1-23, February.
- Roger Newson, 2006. "Confidence intervals for rank statistics: Somers' D and extensions," Stata Journal, StataCorp LP, vol. 6(3), pages 309-334, September.
- Lando, David & Skodeberg, Torben M., 2002. "Analyzing rating transitions and rating drift with continuous observations," Journal of Banking & Finance, Elsevier, vol. 26(2-3), pages 423-444, March.
- C. A. Field & A. H. Welsh, 2007. "Bootstrapping clustered data," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(3), pages 369-390.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Ekkehart Schlicht).
If references are entirely missing, you can add them using this form.