IDEAS home Printed from https://ideas.repec.org/a/eee/finana/v47y2016icp70-85.html
   My bibliography  Save this article

Validation of default probability models: A stress testing approach

Author

Listed:
  • Tsukahara, Fábio Yasuhiro
  • Kimura, Herbert
  • Sobreiro, Vinicius Amorim
  • Zambrano, Juan Carlos Arismendi

Abstract

This study aims to evaluate the techniques used for the validation of default probability (DP) models. By generating simulated stress data, we build ideal conditions to assess the adequacy of the metrics in different stress scenarios. In addition, we empirically analyze the evaluation metrics using the information on 30,686 delisted US public companies as a proxy of default. Using simulated data, we find that entropy based metrics such as measure M are more sensitive to changes in the characteristics of distributions of credit scores. The empirical sub-samples stress test data show that AUROC is the metric most sensitive to changes in market conditions, being followed by measure M. Our results can help risk managers to make rapid decisions regarding the validation of risk models in different scenarios.

Suggested Citation

  • Tsukahara, Fábio Yasuhiro & Kimura, Herbert & Sobreiro, Vinicius Amorim & Zambrano, Juan Carlos Arismendi, 2016. "Validation of default probability models: A stress testing approach," International Review of Financial Analysis, Elsevier, vol. 47(C), pages 70-85.
    • Handle: RePEc:eee:finana:v:47:y:2016:i:c:p:70-85
    DOI: 10.1016/j.irfa.2016.06.007
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1057521916301028
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.irfa.2016.06.007?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Hakenes, Hendrik & Schnabel, Isabel, 2011. "Bank size and risk-taking under Basel II," Journal of Banking & Finance, Elsevier, vol. 35(6), pages 1436-1449, June.
    2. Verbraken, Thomas & Bravo, Cristián & Weber, Richard & Baesens, Bart, 2014. "Development and application of consumer credit scoring models using profit-based classification measures," European Journal of Operational Research, Elsevier, vol. 238(2), pages 505-513.
    3. Jobst, Norbert J. & Zenios, Stavros A., 2005. "On the simulation of portfolios of interest rate and credit risk sensitive securities," European Journal of Operational Research, Elsevier, vol. 161(2), pages 298-324, March.
    4. Steenackers, A. & Goovaerts, M. J., 1989. "A credit scoring model for personal loans," Insurance: Mathematics and Economics, Elsevier, vol. 8(1), pages 31-34, March.
    5. Carol Alexander & Stamatis Leontsinis, 2011. "Model Risk in Variance Swap Rates," ICMA Centre Discussion Papers in Finance icma-dp2011-10, Henley Business School, University of Reading.
    6. B Baesens & T Van Gestel & S Viaene & M Stepanova & J Suykens & J Vanthienen, 2003. "Benchmarking state-of-the-art classification algorithms for credit scoring," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 54(6), pages 627-635, June.
    7. Colletaz, Gilbert & Hurlin, Christophe & Pérignon, Christophe, 2013. "The Risk Map: A new tool for validating risk models," Journal of Banking & Finance, Elsevier, vol. 37(10), pages 3843-3854.
    8. Eliazar, Iddo I. & Sokolov, Igor M., 2010. "Measuring statistical heterogeneity: The Pietra index," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 389(1), pages 117-125.
    9. Boucher, Christophe M. & Daníelsson, Jón & Kouontchou, Patrick S. & Maillet, Bertrand B., 2014. "Risk models-at-risk," Journal of Banking & Finance, Elsevier, vol. 44(C), pages 72-92.
    10. Edward I. Altman, 1968. "Financial Ratios, Discriminant Analysis And The Prediction Of Corporate Bankruptcy," Journal of Finance, American Finance Association, vol. 23(4), pages 589-609, September.
    11. Merton, Robert C, 1974. "On the Pricing of Corporate Debt: The Risk Structure of Interest Rates," Journal of Finance, American Finance Association, vol. 29(2), pages 449-470, May.
    12. Hagedoorn, John, 1996. "Innovation and Entrepreneurship: Schumpeter Revisited," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 5(3), pages 883-896.
    13. Marshall, Andrew & Tang, Leilei & Milne, Alistair, 2010. "Variable reduction, sample selection bias and bank retail credit scoring," Journal of Empirical Finance, Elsevier, vol. 17(3), pages 501-512, June.
    14. Alexander, Carol & Sheedy, Elizabeth, 2008. "Developing a stress testing framework based on market risk models," Journal of Banking & Finance, Elsevier, vol. 32(10), pages 2220-2236, October.
    15. Edward I. Altman, 1968. "The Prediction Of Corporate Bankruptcy: A Discriminant Analysis," Journal of Finance, American Finance Association, vol. 23(1), pages 193-194, March.
    16. Christoph Zott, 2003. "Dynamic capabilities and the emergence of intraindustry differential firm performance: insights from a simulation study," Strategic Management Journal, Wiley Blackwell, vol. 24(2), pages 97-125, February.
    17. Medema, Lydian & Koning, Ruud H. & Lensink, Robert, 2009. "A practical approach to validating a PD model," Journal of Banking & Finance, Elsevier, vol. 33(4), pages 701-708, April.
    18. Kiefer, Nicholas M., 2009. "Default estimation for low-default portfolios," Journal of Empirical Finance, Elsevier, vol. 16(1), pages 164-173, January.
    19. Agarwal, Vineet & Taffler, Richard, 2008. "Comparing the performance of market-based and accounting-based bankruptcy prediction models," Journal of Banking & Finance, Elsevier, vol. 32(8), pages 1541-1551, August.
    20. Kerkhof, Jeroen & Melenberg, Bertrand, 2004. "Backtesting for risk-based regulatory capital," Journal of Banking & Finance, Elsevier, vol. 28(8), pages 1845-1865, August.
    21. Lopez, Jose A. & Saidenberg, Marc R., 2000. "Evaluating credit risk models," Journal of Banking & Finance, Elsevier, vol. 24(1-2), pages 151-165, January.
    22. Shumway, Tyler, 2001. "Forecasting Bankruptcy More Accurately: A Simple Hazard Model," The Journal of Business, University of Chicago Press, vol. 74(1), pages 101-124, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Wang, Zheqi & Crook, Jonathan & Andreeva, Galina, 2020. "Reducing estimation risk using a Bayesian posterior distribution approach: Application to stress testing mortgage loan default," European Journal of Operational Research, Elsevier, vol. 287(2), pages 725-738.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pesaran, M. Hashem & Schuermann, Til & Treutler, Bjorn-Jakob & Weiner, Scott M., 2006. "Macroeconomic Dynamics and Credit Risk: A Global Perspective," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 38(5), pages 1211-1261, August.
    2. Huang, Hsing-Hua & Lee, Han-Hsing, 2013. "Product market competition and credit risk," Journal of Banking & Finance, Elsevier, vol. 37(2), pages 324-340.
    3. Charitou, Andreas & Dionysiou, Dionysia & Lambertides, Neophytos & Trigeorgis, Lenos, 2013. "Alternative bankruptcy prediction models using option-pricing theory," Journal of Banking & Finance, Elsevier, vol. 37(7), pages 2329-2341.
    4. Duc Hong Vo & Binh Ninh Vo Pham & Chi Minh Ho & Michael McAleer, 2019. "Corporate Financial Distress of Industry Level Listings in Vietnam," JRFM, MDPI, vol. 12(4), pages 1-17, September.
    5. Evangelos C. Charalambakis, 2015. "On the Prediction of Corporate Financial Distress in the Light of the Financial Crisis: Empirical Evidence from Greek Listed Firms," International Journal of the Economics of Business, Taylor & Francis Journals, vol. 22(3), pages 407-428, November.
    6. John Nkwoma Inekwe, 2016. "Financial Distress, Employees’ Welfare and Entrepreneurship Among SMEs," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 129(3), pages 1135-1153, December.
    7. Inekwe, John Nkwoma & Jin, Yi & Valenzuela, Ma. Rebecca, 2018. "The effects of financial distress: Evidence from US GDP growth," Economic Modelling, Elsevier, vol. 72(C), pages 8-21.
    8. Boubaker, Sabri & Cellier, Alexis & Manita, Riadh & Saeed, Asif, 2020. "Does corporate social responsibility reduce financial distress risk?," Economic Modelling, Elsevier, vol. 91(C), pages 835-851.
    9. Evangelos C. Charalambakis & Ian Garrett, 2016. "On the prediction of financial distress in developed and emerging markets: Does the choice of accounting and market information matter? A comparison of UK and Indian Firms," Review of Quantitative Finance and Accounting, Springer, vol. 47(1), pages 1-28, July.
    10. Bauer, Julian & Agarwal, Vineet, 2014. "Are hazard models superior to traditional bankruptcy prediction approaches? A comprehensive test," Journal of Banking & Finance, Elsevier, vol. 40(C), pages 432-442.
    11. Krüger, Steffen & Oehme, Toni & Rösch, Daniel & Scheule, Harald, 2018. "A copula sample selection model for predicting multi-year LGDs and Lifetime Expected Losses," Journal of Empirical Finance, Elsevier, vol. 47(C), pages 246-262.
    12. Surbhi Bhatia & Manish K. Singh, 2022. "Fifty years since Altman (1968): Performance of financial distress prediction models," Working Papers 12, xKDR.
    13. Chen, Jie & Hill, Paula, 2013. "The impact of diverse measures of default risk on UK stock returns," Journal of Banking & Finance, Elsevier, vol. 37(12), pages 5118-5131.
    14. Şaban Çelik, 2013. "Micro Credit Risk Metrics: A Comprehensive Review," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 20(4), pages 233-272, October.
    15. B Korcan Ak & Patricia M Dechow & Yuan Sun & Annika Yu Wang, 2013. "The use of financial ratio models to help investors predict and interpret significant corporate events," Australian Journal of Management, Australian School of Business, vol. 38(3), pages 553-598, December.
    16. Manish K. Singh & Marta Gómez-Puig & Simón Sosvilla-Rivero, 2014. "Forward looking banking stress in EMU countries," Working Papers 14-10, Asociación Española de Economía y Finanzas Internacionales.
    17. Hernandez Tinoco, Mario & Wilson, Nick, 2013. "Financial distress and bankruptcy prediction among listed companies using accounting, market and macroeconomic variables," International Review of Financial Analysis, Elsevier, vol. 30(C), pages 394-419.
    18. Elena Ivona DUMITRESCU & Sullivan HUE & Christophe HURLIN & Sessi TOKPAVI, 2020. "Machine Learning or Econometrics for Credit Scoring: Let’s Get the Best of Both Worlds," LEO Working Papers / DR LEO 2839, Orleans Economics Laboratory / Laboratoire d'Economie d'Orleans (LEO), University of Orleans.
    19. Yukiko Konno & Yuki Itoh, 2016. "An alternative to the standardized approach for assessing credit risk under the Basel Accords," Cogent Economics & Finance, Taylor & Francis Journals, vol. 4(1), pages 1220119-122, December.
    20. Serrano-Cinca, Carlos & Gutiérrez-Nieto, Begoña & Bernate-Valbuena, Martha, 2019. "The use of accounting anomalies indicators to predict business failure," European Management Journal, Elsevier, vol. 37(3), pages 353-375.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:finana:v:47:y:2016:i:c:p:70-85. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/620166 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.