IDEAS home Printed from https://ideas.repec.org/p/nbb/reswpp/200712-18.html
   My bibliography  Save this paper

Failure prediction models : performance, disagreements, and internal rating systems

Author

Listed:
  • Janet Mitchell

    () (National Bank of Belgium, Financial Stability Department
    CEPR)

  • Patrick Van Roy

    () (National Bank of Belgium, Financial Stability Department
    Université Libre de Bruxelles)

Abstract

We address a number of comparative issues relating to the performance of failure prediction models for small, private firms. We use two models provided by vendors, a model developed by the National Bank of Belgium, and the Altman Z-score model to investigate model power, the extent of disagreement between models in the ranking of firms, and the design of internal rating systems. We also examine the potential gains from combining the output of multiple models. We find that the power of all four models in predicting bankruptcies is very good at the one-year horizon, even though not all of the models were developed using bankruptcy data and the models use different statistical methodologies. Disagreements in firm rankings are nevertheless significant across models, and model choice will have an impact on loan pricing and origination decisions. We find that it is possible to realize important gains from combining models with similar power. In addition, we show that it can also be beneficial to combine a weaker model with a stronger one if disagreements across models with respect to failing firms are high enough. Finally, the number of classes in an internal rating system appears to be more important than the distribution of borrowers across classes

Suggested Citation

  • Janet Mitchell & Patrick Van Roy, 2007. "Failure prediction models : performance, disagreements, and internal rating systems," Working Paper Research 123, National Bank of Belgium.
  • Handle: RePEc:nbb:reswpp:200712-18
    as

    Download full text from publisher

    File URL: https://www.nbb.be/doc/oc/repec/reswpp/wp123en.pdf
    Download Restriction: no

    References listed on IDEAS

    as
    1. Stephen Satchel & Wei Xia, 2006. "Analytic Models of the ROC Curve: Applications to Credit Rating Model Validation," Research Paper Series 181, Quantitative Finance Research Centre, University of Technology, Sydney.
    2. S. Balcaen & H. Ooghe, 2004. "35 years of studies on business failure: an overview of the classical statistical methodologiesand their related problems," Working Papers of Faculty of Economics and Business Administration, Ghent University, Belgium 04/248, Ghent University, Faculty of Economics and Business Administration.
    3. Hanson, Samuel & Schuermann, Til, 2006. "Confidence intervals for probabilities of default," Journal of Banking & Finance, Elsevier, vol. 30(8), pages 2281-2301, August.
    4. Jankowitsch, Rainer & Pichler, Stefan & Schwaiger, Walter S.A., 2007. "Modelling the economic value of credit rating systems," Journal of Banking & Finance, Elsevier, vol. 31(1), pages 181-198, January.
    5. Stein, Roger M., 2005. "The relationship between default prediction and lending profits: Integrating ROC analysis and loan pricing," Journal of Banking & Finance, Elsevier, vol. 29(5), pages 1213-1236, May.
    6. Blochlinger, Andreas & Leippold, Markus, 2006. "Economic benefit of powerful credit scoring," Journal of Banking & Finance, Elsevier, vol. 30(3), pages 851-873, March.
    7. Ooghe, H. & Spaenjers, C. & Pieter vandermoere, 2005. "Business failure prediction: simple-intuitive models versus statistical models," Vlerick Leuven Gent Management School Working Paper Series 2005-22, Vlerick Leuven Gent Management School.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hainz, Christa, 2008. "Bank Competition - When is it Good?," Discussion Paper Series of SFB/TR 15 Governance and the Efficiency of Economic Systems 244, Free University of Berlin, Humboldt University of Berlin, University of Bonn, University of Mannheim, University of Munich.

    More about this item

    Keywords

    Basel II; failure prediction; internal ratings; model power; rating systems; ROC analysis.;

    JEL classification:

    • D40 - Microeconomics - - Market Structure, Pricing, and Design - - - General
    • G21 - Financial Economics - - Financial Institutions and Services - - - Banks; Other Depository Institutions; Micro Finance Institutions; Mortgages
    • G24 - Financial Economics - - Financial Institutions and Services - - - Investment Banking; Venture Capital; Brokerage
    • G28 - Financial Economics - - Financial Institutions and Services - - - Government Policy and Regulation
    • G33 - Financial Economics - - Corporate Finance and Governance - - - Bankruptcy; Liquidation

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbb:reswpp:200712-18. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (). General contact details of provider: http://edirc.repec.org/data/bnbgvbe.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.