An empirical evaluation of the performance of binary classifiers in the prediction of credit ratings changes
In this study, we examine the predictive performance of a wide class of binary classifiers using a large sample of international credit ratings changes from the period 1983–2013. Using a number of financial, market, corporate governance, macro-economic and other indicators as explanatory variables, we compare classifiers ranging from conventional techniques (such as logit/probit and LDA) to fully nonlinear classifiers, including neural networks, support vector machines and more recent statistical learning techniques such as generalised boosting, AdaBoost and random forests. We find that the newer classifiers significantly outperform all other classifiers on both the cross sectional and longitudinal test samples; and prove remarkably robust to different data structures and assumptions. Simple linear classifiers such as logit/probit and LDA are found nonetheless to predict quite accurately on the test samples, in some cases performing comparably well to more flexible model structures. We conclude that simpler classifiers can be viable alternatives to more sophisticated approaches, particularly if interpretability is an important objective of the modelling exercise. We also suggest effective ways to enhance the predictive performance of many of the binary classifiers examined in this study.
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Marshall E. Blume & Felix Lim & A. Craig MacKinlay, "undated". "The Declining Credit Quality of US Corporate Debt: Myth or Reality?," Rodney L. White Center for Financial Research Working Papers 3-98, Wharton School Rodney L. White Center for Financial Research.
- Hand, John R M & Holthausen, Robert W & Leftwich, Richard W, 1992. " The Effect of Bond Rating Agency Announcements on Bond and Stock Prices," Journal of Finance, American Finance Association, vol. 47(2), pages 733-752, June.
- Koopman, Siem Jan & Kräussl, Roman & Lucas, André & Monteiro, André B., 2009.
"Credit cycles and macro fundamentals,"
Journal of Empirical Finance,
Elsevier, vol. 16(1), pages 42-54, January.
- Siem Jan Koopman & Roman Kraeussl & Andre Lucas & Andre Monteiro, 2006. "Credit Cycles and Macro Fundamentals," Tinbergen Institute Discussion Papers 06-023/2, Tinbergen Institute.
- Koopman, Siem Jan & Kräussl, Roman & Lucas, André, 2006. "Credit cycles and macro fundamentals," CFS Working Paper Series 2006/33, Center for Financial Studies (CFS).
- Zhang, Guoqiang & Y. Hu, Michael & Eddy Patuwo, B. & C. Indro, Daniel, 1999. "Artificial neural networks in bankruptcy prediction: General framework and cross-validation analysis," European Journal of Operational Research, Elsevier, vol. 116(1), pages 16-32, July.
- Nickell, Pamela & Perraudin, William & Varotto, Simone, 2000. "Stability of rating transitions," Journal of Banking & Finance, Elsevier, vol. 24(1-2), pages 203-227, January.
- Pamela Nickell & William Perraudin & Simone Varotto, 2001. "Stability of ratings transitions," Bank of England working papers 133, Bank of England.
- repec:hrv:faseco:30728046 is not listed on IDEAS
- Jones,Stewart & Hensher,David A. (ed.), 2008. "Advances in Credit Risk Modelling and Corporate Bankruptcy Prediction," Cambridge Books, Cambridge University Press, number 9780521689540, October.
- Ilia D. Dichev, 2001. "The Long-Run Stock Returns Following Bond Ratings Changes," Journal of Finance, American Finance Association, vol. 56(1), pages 173-203, 02.
- Altman, Edward I. & Marco, Giancarlo & Varetto, Franco, 1994. "Corporate distress diagnosis: Comparisons using linear discriminant analysis and neural networks (the Italian experience)," Journal of Banking & Finance, Elsevier, vol. 18(3), pages 505-529, May.
- Amato, Jeffery D. & Furfine, Craig H., 2004. "Are credit ratings procyclical?," Journal of Banking & Finance, Elsevier, vol. 28(11), pages 2641-2677, November.
- Shleifer, Andrei & Vishny, Robert W, 1997. " A Survey of Corporate Governance," Journal of Finance, American Finance Association, vol. 52(2), pages 737-783, June.
- Andrei Shleifer & Robert W. Vishny, 1995. "A Survey of Corporate Governance," Harvard Institute of Economic Research Working Papers 1741, Harvard - Institute of Economic Research.
- Andrei Shleifer & Robert W. Vishny, 1996. "A Survey of Corporate Governance," NBER Working Papers 5554, National Bureau of Economic Research, Inc.
- repec:bla:joares:v:22:y:1984:i::p:59-82 is not listed on IDEAS
- Ashbaugh-Skaife, Hollis & Collins, Daniel W. & LaFond, Ryan, 2006. "The effects of corporate governance on firms' credit ratings," Journal of Accounting and Economics, Elsevier, vol. 42(1-2), pages 203-243, October.
- Bangia, Anil & Diebold, Francis X. & Kronimus, Andre & Schagen, Christian & Schuermann, Til, 2002. "Ratings migration and the business cycle, with application to credit portfolio stress testing," Journal of Banking & Finance, Elsevier, vol. 26(2-3), pages 445-474, March.
- Anil Bangia & Francis X. Diebold & Til Schuermann, 2000. "Ratings Migration and the Business Cycle, With Application to Credit Portfolio Stress Testing," Center for Financial Institutions Working Papers 00-26, Wharton School Center for Financial Institutions, University of Pennsylvania.
- Marshall E. Blume & Felix Lim & A. Craig MacKinlay, "undated". "The Declining Credit Quality of US Corporate Debt: Myth or Reality?," Rodney L. White Center for Financial Research Working Papers 03-98, Wharton School Rodney L. White Center for Financial Research.
- Joy, O. Maurice & Tollefson, John O., 1975. "On the Financial Applications of Discriminant Analysis," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 10(05), pages 723-739, December.
- Alex Frino & Stewart Jones & Jin Boon Wong, 2007. "Market behaviour around bankruptcy announcements: evidence from the Australian Stock Exchange," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 47(4), pages 713-730.
- David A. Hensher & Stewart Jones & William H. Greene, 2007. "An Error Component Logit Analysis of Corporate Bankruptcy and Insolvency Risk in Australia," The Economic Record, The Economic Society of Australia, vol. 83(260), pages 86-103, 03.
- Altman, Edward I. & Rijken, Herbert A., 2004. "How rating agencies achieve rating stability," Journal of Banking & Finance, Elsevier, vol. 28(11), pages 2679-2714, November.
- Kar Yan Tam & Melody Y. Kiang, 1992. "Managerial Applications of Neural Networks: The Case of Bank Failure Predictions," Management Science, INFORMS, vol. 38(7), pages 926-947, July.
- Figlewski, Stephen & Frydman, Halina & Liang, Weijian, 2012. "Modeling the effect of macroeconomic factors on corporate default and credit rating transitions," International Review of Economics & Finance, Elsevier, vol. 21(1), pages 87-105.
- Altman, Edward I. & Haldeman, Robert G. & Narayanan, P., 1977. "ZETATM analysis A new model to identify bankruptcy risk of corporations," Journal of Banking & Finance, Elsevier, vol. 1(1), pages 29-54, June.
- Shumway, Tyler, 2001. "Forecasting Bankruptcy More Accurately: A Simple Hazard Model," The Journal of Business, University of Chicago Press, vol. 74(1), pages 101-124, January.
- Koopman, Siem Jan & Lucas, André & Schwaab, Bernd, 2011. "Modeling frailty-correlated defaults using many macroeconomic covariates," Journal of Econometrics, Elsevier, vol. 162(2), pages 312-325, June.
- Jones,Stewart & Hensher,David A. (ed.), 2008. "Advances in Credit Risk Modelling and Corporate Bankruptcy Prediction," Cambridge Books, Cambridge University Press, number 9780521869287, October.
- Lando, David & Skodeberg, Torben M., 2002. "Analyzing rating transitions and rating drift with continuous observations," Journal of Banking & Finance, Elsevier, vol. 26(2-3), pages 423-444, March.
- Christensen, Jens H.E. & Hansen, Ernst & Lando, David, 2004. "Confidence sets for continuous-time rating transition probabilities," Journal of Banking & Finance, Elsevier, vol. 28(11), pages 2575-2602, November. Full references (including those not matched with items on IDEAS)
When requesting a correction, please mention this item's handle: RePEc:eee:jbfina:v:56:y:2015:i:c:p:72-85. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Dana Niculescu)
If references are entirely missing, you can add them using this form.