IDEAS home Printed from https://ideas.repec.org/a/spr/reaccs/v26y2021i2d10.1007_s11142-020-09575-4.html
   My bibliography  Save this article

Measuring credit risk using qualitative disclosure

Author

Listed:
  • John Donovan

    (University of Notre Dame)

  • Jared Jennings

    (Washington University in St. Louis)

  • Kevin Koharki

    (Purdue University)

  • Joshua Lee

    (Brigham Young University)

Abstract

We use machine learning methods to create a comprehensive measure of credit risk based on qualitative information disclosed in conference calls and in management’s discussion and analysis section of the 10-K. In out-of-sample tests, we find that our measure improves the ability to predict credit events (bankruptcies, interest spreads, and credit rating downgrades), relative to credit risk measures developed by prior research (e.g., z-score). We also find our measure based on conference calls explains within-firm variation in future credit events; however, we find little evidence that the measures of credit risk developed by prior research explain within-firm variation in credit risk. Our measure has utility for both academics and practitioners, as the majority of firms do not have readily available measures of credit risk, such as actively-traded CDS or credit ratings. Our study also adds to the growing body of research using machine-learning methods to gather information from conference calls and MD&A to explain key outcomes.

Suggested Citation

  • John Donovan & Jared Jennings & Kevin Koharki & Joshua Lee, 2021. "Measuring credit risk using qualitative disclosure," Review of Accounting Studies, Springer, vol. 26(2), pages 815-863, June.
  • Handle: RePEc:spr:reaccs:v:26:y:2021:i:2:d:10.1007_s11142-020-09575-4
    DOI: 10.1007/s11142-020-09575-4
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11142-020-09575-4
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11142-020-09575-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Frankel, Richard & Jennings, Jared & Lee, Joshua, 2016. "Using unstructured and qualitative disclosures to explain accruals," Journal of Accounting and Economics, Elsevier, vol. 62(2), pages 209-227.
    2. Paul C. Tetlock & Maytal Saar‐Tsechansky & Sofus Macskassy, 2008. "More Than Words: Quantifying Language to Measure Firms' Fundamentals," Journal of Finance, American Finance Association, vol. 63(3), pages 1437-1467, June.
    3. Dan S. Dhaliwal & Inder K. Khurana & Raynolde Pereira, 2011. "Firm Disclosure Policy and the Choice Between Private and Public Debt," Contemporary Accounting Research, John Wiley & Sons, vol. 28(1), pages 293-330, March.
    4. Bonsall, Samuel B. & Leone, Andrew J. & Miller, Brian P. & Rennekamp, Kristina, 2017. "A plain English measure of financial reporting readability," Journal of Accounting and Economics, Elsevier, vol. 63(2), pages 329-357.
    5. Stephan Hollander & Maarten Pronk & Erik Roelofsen, 2010. "Does Silence Speak? An Empirical Analysis of Disclosure Choices During Conference Calls," Journal of Accounting Research, Wiley Blackwell, vol. 48(3), pages 531-563, June.
    6. Theodore E. Christensen & Hang Pei & Spencer R. Pierce & Liang Tan, 2019. "Non-GAAP reporting following debt covenant violations," Review of Accounting Studies, Springer, vol. 24(2), pages 629-664, June.
    7. Shuping Chen & Bin Miao & Terry Shevlin, 2015. "A New Measure of Disclosure Quality: The Level of Disaggregation of Accounting Data in Annual Reports," Journal of Accounting Research, Wiley Blackwell, vol. 53(5), pages 1017-1054, December.
    8. Aysun Alp, 2013. "Structural Shifts in Credit Rating Standards," Journal of Finance, American Finance Association, vol. 68(6), pages 2435-2470, December.
    9. William J. Mayew, 2008. "Evidence of Management Discrimination Among Analysts during Earnings Conference Calls," Journal of Accounting Research, Wiley Blackwell, vol. 46(3), pages 627-659, June.
    10. Merton, Robert C, 1974. "On the Pricing of Corporate Debt: The Risk Structure of Interest Rates," Journal of Finance, American Finance Association, vol. 29(2), pages 449-470, May.
    11. Benjamin Yibin Zhang & Hao Zhou & Haibin Zhu, 2009. "Explaining Credit Default Swap Spreads with the Equity Volatility and Jump Risks of Individual Firms," Review of Financial Studies, Society for Financial Studies, vol. 22(12), pages 5099-5131, December.
    12. Tim Loughran & Bill Mcdonald, 2014. "Measuring Readability in Financial Disclosures," Journal of Finance, American Finance Association, vol. 69(4), pages 1643-1671, August.
    13. Martin, Xiumin & Roychowdhury, Sugata, 2015. "Do financial market developments influence accounting practices? Credit default swaps and borrowers׳ reporting conservatism," Journal of Accounting and Economics, Elsevier, vol. 59(1), pages 80-104.
    14. Ham, Charles & Koharki, Kevin, 2016. "The association between corporate general counsel and firm credit risk," Journal of Accounting and Economics, Elsevier, vol. 61(2), pages 274-293.
    15. Norden, Lars & Weber, Martin, 2004. "Informational efficiency of credit default swap and stock markets: The impact of credit rating announcements," Journal of Banking & Finance, Elsevier, vol. 28(11), pages 2813-2843, November.
    16. Black, Fischer & Scholes, Myron S, 1973. "The Pricing of Options and Corporate Liabilities," Journal of Political Economy, University of Chicago Press, vol. 81(3), pages 637-654, May-June.
    17. Hull, John & Predescu, Mirela & White, Alan, 2004. "The relationship between credit default swap spreads, bond yields, and credit rating announcements," Journal of Banking & Finance, Elsevier, vol. 28(11), pages 2789-2811, November.
    18. Vashishtha, Rahul, 2014. "The role of bank monitoring in borrowers׳ discretionary disclosure: Evidence from covenant violations," Journal of Accounting and Economics, Elsevier, vol. 57(2), pages 176-195.
    19. Campbell, Dennis & Loumioti, Maria & Wittenberg-Moerman, Regina, 2019. "Making sense of soft information: interpretation bias and loan quality," Journal of Accounting and Economics, Elsevier, vol. 68(2).
    20. Beaver, William H. & Shakespeare, Catherine & Soliman, Mark T., 2006. "Differential properties in the ratings of certified versus non-certified bond-rating agencies," Journal of Accounting and Economics, Elsevier, vol. 42(3), pages 303-334, December.
    21. Roberto Blanco & Simon Brennan & Ian W. Marsh, 2005. "An Empirical Analysis of the Dynamic Relation between Investment‐Grade Bonds and Credit Default Swaps," Journal of Finance, American Finance Association, vol. 60(5), pages 2255-2281, October.
    22. Edward I. Altman, 1968. "Financial Ratios, Discriminant Analysis And The Prediction Of Corporate Bankruptcy," Journal of Finance, American Finance Association, vol. 23(4), pages 589-609, September.
    23. Jae B. Kim & Pervin Shroff & Dushyantkumar Vyas & Regina Wittenberg‐Moerman, 2018. "Credit Default Swaps and Managers’ Voluntary Disclosure," Journal of Accounting Research, Wiley Blackwell, vol. 56(3), pages 953-988, June.
    24. Dyer, Travis & Lang, Mark & Stice-Lawrence, Lorien, 2017. "The evolution of 10-K textual disclosure: Evidence from Latent Dirichlet Allocation," Journal of Accounting and Economics, Elsevier, vol. 64(2), pages 221-245.
    25. Beatty, Anne & Weber, Joseph & Yu, Jeff Jiewei, 2008. "Conservatism and Debt," Journal of Accounting and Economics, Elsevier, vol. 45(2-3), pages 154-174, August.
    26. William Greene, 2004. "The behaviour of the maximum likelihood estimator of limited dependent variable models in the presence of fixed effects," Econometrics Journal, Royal Economic Society, vol. 7(1), pages 98-119, June.
    27. Das, Sanjiv & Kalimipalli, Madhu & Nayak, Subhankar, 2014. "Did CDS trading improve the market for corporate bonds?," Journal of Financial Economics, Elsevier, vol. 111(2), pages 495-525.
    28. Angela K. Davis & Jeremy M. Piger & Lisa M. Sedor, 2012. "Beyond the Numbers: Measuring the Information Content of Earnings Press Release Language," Contemporary Accounting Research, John Wiley & Sons, vol. 29(3), pages 845-868, September.
    29. Edward I. Altman, 1968. "The Prediction Of Corporate Bankruptcy: A Discriminant Analysis," Journal of Finance, American Finance Association, vol. 23(1), pages 193-194, March.
    30. Ohlson, Ja, 1980. "Financial Ratios And The Probabilistic Prediction Of Bankruptcy," Journal of Accounting Research, Wiley Blackwell, vol. 18(1), pages 109-131.
    31. Mark Cecchini & Haldun Aytug & Gary J. Koehler & Praveen Pathak, 2010. "Detecting Management Fraud in Public Companies," Management Science, INFORMS, vol. 56(7), pages 1146-1160, July.
    32. Tim Loughran & Bill Mcdonald, 2011. "When Is a Liability Not a Liability? Textual Analysis, Dictionaries, and 10‐Ks," Journal of Finance, American Finance Association, vol. 66(1), pages 35-65, February.
    33. Li, Feng, 2008. "Annual report readability, current earnings, and earnings persistence," Journal of Accounting and Economics, Elsevier, vol. 45(2-3), pages 221-247, August.
    34. Price, S. McKay & Doran, James S. & Peterson, David R. & Bliss, Barbara A., 2012. "Earnings conference calls and stock returns: The incremental informativeness of textual tone," Journal of Banking & Finance, Elsevier, vol. 36(4), pages 992-1011.
    35. Feng Li, 2010. "The Information Content of Forward‐Looking Statements in Corporate Filings—A Naïve Bayesian Machine Learning Approach," Journal of Accounting Research, Wiley Blackwell, vol. 48(5), pages 1049-1102, December.
    36. Manela, Asaf & Moreira, Alan, 2017. "News implied volatility and disaster concerns," Journal of Financial Economics, Elsevier, vol. 123(1), pages 137-162.
    37. Ramin P. Baghai & Henri Servaes & Ane Tamayo, 2014. "Have Rating Agencies Become More Conservative? Implications for Capital Structure and Debt Pricing," Journal of Finance, American Finance Association, vol. 69(5), pages 1961-2005, October.
    38. Yang Bao & Anindya Datta, 2014. "Simultaneously Discovering and Quantifying Risk Types from Textual Risk Disclosures," Management Science, INFORMS, vol. 60(6), pages 1371-1391, June.
    39. Allen H. Huang & Reuven Lehavy & Amy Y. Zang & Rong Zheng, 2018. "Analyst Information Discovery and Interpretation Roles: A Topic Modeling Approach," Management Science, INFORMS, vol. 64(6), pages 2833-2855, June.
    40. Bozanic, Zahn & Roulstone, Darren T. & Van Buskirk, Andrew, 2018. "Management earnings forecasts and other forward-looking statements," Journal of Accounting and Economics, Elsevier, vol. 65(1), pages 1-20.
    41. Sumit Agarwal, 2010. "Distance and Private Information in Lending," Review of Financial Studies, Society for Financial Studies, vol. 23(7), pages 2757-2788, July.
    42. Zhang, Jieying, 2008. "The contracting benefits of accounting conservatism to lenders and borrowers," Journal of Accounting and Economics, Elsevier, vol. 45(1), pages 27-54, March.
    43. Sudheer Chava & Michael R. Roberts, 2008. "How Does Financing Impact Investment? The Role of Debt Covenants," Journal of Finance, American Finance Association, vol. 63(5), pages 2085-2121, October.
    44. Samuel B. Bonsall & Kevin Koharki & Luke Watson, 2017. "Deciphering Tax Avoidance: Evidence from Credit Rating Disagreements," Contemporary Accounting Research, John Wiley & Sons, vol. 34(2), pages 818-848, June.
    45. Donald P. Morgan, 2002. "Rating Banks: Risk and Uncertainty in an Opaque Industry," American Economic Review, American Economic Association, vol. 92(4), pages 874-888, September.
    46. José María Liberti & Mitchell A Petersen, 2019. "Information: Hard and Soft," The Review of Corporate Finance Studies, Society for Financial Studies, vol. 8(1), pages 1-41.
    47. Kim, Irene & Skinner, Douglas J., 2012. "Measuring securities litigation risk," Journal of Accounting and Economics, Elsevier, vol. 53(1), pages 290-310.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhao, Qi & Xu, Weijun & Ji, Yucheng, 2023. "Predicting financial distress of Chinese listed companies using machine learning: To what extent does textual disclosure matter?," International Review of Financial Analysis, Elsevier, vol. 89(C).
    2. Yu Zhao & Huaming Du & Qing Li & Fuzhen Zhuang & Ji Liu & Gang Kou, 2022. "A Comprehensive Survey on Enterprise Financial Risk Analysis from Big Data Perspective," Papers 2211.14997, arXiv.org, revised May 2023.
    3. Li, Ken, 2022. "Textual fundamentals in earnings press releases," Advances in accounting, Elsevier, vol. 57(C).
    4. Zhang, Tianjiao & Zhu, Weidong & Wu, Yong & Wu, Zihao & Zhang, Chao & Hu, Xue, 2023. "An explainable financial risk early warning model based on the DS-XGBoost model," Finance Research Letters, Elsevier, vol. 56(C).
    5. Richard Frankel & Jared Jennings & Joshua Lee, 2022. "Disclosure Sentiment: Machine Learning vs. Dictionary Methods," Management Science, INFORMS, vol. 68(7), pages 5514-5532, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Richard Frankel & Jared Jennings & Joshua Lee, 2022. "Disclosure Sentiment: Machine Learning vs. Dictionary Methods," Management Science, INFORMS, vol. 68(7), pages 5514-5532, July.
    2. Acheampong, Albert & Elshandidy, Tamer, 2021. "Does soft information determine credit risk? Text-based evidence from European banks," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 75(C).
    3. Blankespoor, Elizabeth & deHaan, Ed & Marinovic, Iván, 2020. "Disclosure processing costs, investors’ information choice, and equity market outcomes: A review," Journal of Accounting and Economics, Elsevier, vol. 70(2).
    4. Augustin, Patrick & Subrahmanyam, Marti G. & Tang, Dragon Yongjun & Wang, Sarah Qian, 2014. "Credit Default Swaps: A Survey," Foundations and Trends(R) in Finance, now publishers, vol. 9(1-2), pages 1-196, December.
    5. Liebmann, Michael & Orlov, Alexei G. & Neumann, Dirk, 2016. "The tone of financial news and the perceptions of stock and CDS traders," International Review of Financial Analysis, Elsevier, vol. 46(C), pages 159-175.
    6. Sanjiv Das & Xin Huang & Soji Adeshina & Patrick Yang & Leonardo Bachega, 2023. "Credit Risk Modeling with Graph Machine Learning," INFORMS Joural on Data Science, INFORMS, vol. 2(2), pages 197-217, October.
    7. Kumar, Rahul & Deb, Soumya Guha & Mukherjee, Shubhadeep, 2020. "Do words reveal the latent truth? Identifying communication patterns of corporate losers," Journal of Behavioral and Experimental Finance, Elsevier, vol. 26(C).
    8. D. G. DeBoskey & Yan Luo & Linying Zhou, 2019. "CEO power, board oversight, and earnings announcement tone," Review of Quantitative Finance and Accounting, Springer, vol. 52(2), pages 657-680, February.
    9. Ingrid E. Fisher & Margaret R. Garnsey & Mark E. Hughes, 2016. "Natural Language Processing in Accounting, Auditing and Finance: A Synthesis of the Literature with a Roadmap for Future Research," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 23(3), pages 157-214, July.
    10. Allee, Kristian D. & Do, Chuong & Sterin, Mikhail, 2021. "Product market competition, disclosure framing, and casting in earnings conference calls," Journal of Accounting and Economics, Elsevier, vol. 72(1).
    11. Frankel, Richard & Jennings, Jared & Lee, Joshua, 2016. "Using unstructured and qualitative disclosures to explain accruals," Journal of Accounting and Economics, Elsevier, vol. 62(2), pages 209-227.
    12. Stephen Zamore & Kwame Ohene Djan & Ilan Alon & Bersant Hobdari, 2018. "Credit Risk Research: Review and Agenda," Emerging Markets Finance and Trade, Taylor & Francis Journals, vol. 54(4), pages 811-835, March.
    13. Peng Liang & Nan Hu & Ling Liu & Ting Zhang, 2023. "Managerial tone and investors' hedging activities: Evidence from credit default swaps," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 63(4), pages 3971-3998, December.
    14. Chen, Qi & Vashishtha, Rahul, 2017. "The effects of bank mergers on corporate information disclosure," Journal of Accounting and Economics, Elsevier, vol. 64(1), pages 56-77.
    15. James P. Ryans, 2021. "Textual classification of SEC comment letters," Review of Accounting Studies, Springer, vol. 26(1), pages 37-80, March.
    16. Chengru Hu & Wei Jiang, 2019. "Managerial risk incentives and accounting conservatism," Review of Quantitative Finance and Accounting, Springer, vol. 52(3), pages 781-813, April.
    17. Huijue Kelly Duan & Hanxin Hu & Yangin (Ben) Yoon & Miklos Vasarhelyi, 2022. "Increasing the utility of performance audit reports: Using textual analytics tools to improve government reporting," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 29(4), pages 201-218, October.
    18. Antonio Trujillo-Ponce & Reyes Samaniego-Medina & Clara Cardone-Riportella, 2014. "Examining what best explains corporate credit risk: accounting-based versus market-based models," Journal of Business Economics and Management, Taylor & Francis Journals, vol. 15(2), pages 253-276, April.
    19. Kerstin Lopatta & Mario Albert Gloger & Reemda Jaeschke, 2017. "Can Language Predict Bankruptcy? The Explanatory Power of Tone in 10‐K Filings," Accounting Perspectives, John Wiley & Sons, vol. 16(4), pages 315-343, December.
    20. Rennekamp, Kristina M. & Sethuraman, Mani & Steenhoven, Blake A., 2022. "Engagement in earnings conference calls," Journal of Accounting and Economics, Elsevier, vol. 74(1).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:reaccs:v:26:y:2021:i:2:d:10.1007_s11142-020-09575-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.