IDEAS home Printed from https://ideas.repec.org/a/pal/ijodag/v19y2022i1d10.1057_s41310-021-00129-x.html
   My bibliography  Save this article

Using machine learning methods to predict financial performance: Does disclosure tone matter?

Author

Listed:
  • Gehan A. Mousa

    (University of Bahrain)

  • Elsayed A. H. Elamir

    (University of Bahrain)

  • Khaled Hussainey

    (University of Portsmouth)

Abstract

We use three supervised machine learning methods, namely linear discriminant analysis, quadratic discriminant analysis, and random forest, to predict corporate financial performance. We use a sample of 63 listed banks from eight emerging markets, covering 10 years from 2008 to 2017, using earning per share as a measure of performance. We use the design science research (DSR) framework to examine whether the textual contents of annual reports in previous years contain value-relevant information to predict future performance; thus, these contents can improve the accuracy and quality of predictive models. We combine two groups of variables in the proposed models. The first group is the sentiment analysis of disclosure tone in annual report narratives using the Loughran and McDonald dictionary (J Finance 66:35–65, 2011), while the second group is the quantitative properties of banks which consist of five variables, namely size, financial leverage, age, market-to-book ratio, and risk. Our analysis suggests that the random forest method provides the best predictive model. We also provide evidence on the accuracy and performance of predictive models that can be increased by incorporating disclosure tone variables as non-financial variables with financial variables. Interestingly, we find that the uncertainty variable is the most important disclosure tone variable. Finally, we find that size is the most important variable related to banks’ quantitative characteristics. Our study suggests that the analysis of tone through corporate narrative disclosures can be used as a complementary or diagnostic approach rather than an alternative in making decisions by different stakeholders such as analysts, investors, and auditors.

Suggested Citation

  • Gehan A. Mousa & Elsayed A. H. Elamir & Khaled Hussainey, 2022. "Using machine learning methods to predict financial performance: Does disclosure tone matter?," International Journal of Disclosure and Governance, Palgrave Macmillan, vol. 19(1), pages 93-112, March.
  • Handle: RePEc:pal:ijodag:v:19:y:2022:i:1:d:10.1057_s41310-021-00129-x
    DOI: 10.1057/s41310-021-00129-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1057/s41310-021-00129-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1057/s41310-021-00129-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kursa, Miron B. & Rudnicki, Witold R., 2010. "Feature Selection with the Boruta Package," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 36(i11).
    2. Elshandidy, Tamer & Shrives, Philip J., 2016. "Environmental Incentives for and Usefulness of Textual Risk Reporting: Evidence from Germany," The International Journal of Accounting, Elsevier, vol. 51(4), pages 464-486.
    3. Rüdiger Hahn & Regina Lülfs, 2014. "Legitimizing Negative Aspects in GRI-Oriented Sustainability Reporting: A Qualitative Analysis of Corporate Disclosure Strategies," Journal of Business Ethics, Springer, vol. 123(3), pages 401-420, September.
    4. Lukason, Oliver & Laitinen, Erkki K., 2019. "Firm failure processes and components of failure risk: An analysis of European bankrupt firms," Journal of Business Research, Elsevier, vol. 98(C), pages 380-390.
    5. Arslan-Ayaydin, Özgür & Boudt, Kris & Thewissen, James, 2016. "Managers set the tone: Equity incentives and the tone of earnings press releases," Journal of Banking & Finance, Elsevier, vol. 72(S), pages 132-147.
    6. Thomas Keusch & Laury H.H. Bollen & Harold F.D. Hassink, 2012. "Self-serving Bias in Annual Report Narratives: An Empirical Analysis of the Impact of Economic Crises," European Accounting Review, Taylor & Francis Journals, vol. 21(3), pages 623-648, November.
    7. Thomas Schleicher & Martin Walker, 2010. "Bias in the tone of forward‐looking narratives," Accounting and Business Research, Taylor & Francis Journals, vol. 40(4), pages 371-390.
    8. Jensen, Michael C. & Meckling, William H., 1976. "Theory of the firm: Managerial behavior, agency costs and ownership structure," Journal of Financial Economics, Elsevier, vol. 3(4), pages 305-360, October.
    9. Kuhn, Max, 2008. "Building Predictive Models in R Using the caret Package," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 28(i05).
    10. Kearney, Colm & Liu, Sha, 2014. "Textual sentiment in finance: A survey of methods and models," International Review of Financial Analysis, Elsevier, vol. 33(C), pages 171-185.
    11. Lisa Maria Falschlunger & Christoph Eisl & Heimo Losbichler & Andreas Michael Greil, 2015. "Impression management in annual reports of the largest European companies," Journal of Applied Accounting Research, Emerald Group Publishing Limited, vol. 16(3), pages 383-399, November.
    12. Balcaen, Sofie & Ooghe, Hubert, 2006. "35 years of studies on business failure: an overview of the classic statistical methodologies and their related problems," The British Accounting Review, Elsevier, vol. 38(1), pages 63-93.
    13. Diego García, 2013. "Sentiment during Recessions," Journal of Finance, American Finance Association, vol. 68(3), pages 1267-1300, June.
    14. Doris M. Merkl-Davies & Niamh M. Brennan, 2011. "A conceptual framework of impression management: new insights from psychology, sociology and critical perspectives," Accounting and Business Research, Taylor & Francis Journals, vol. 41(5), pages 415-437, December.
    15. Li, Feng, 2008. "Annual report readability, current earnings, and earnings persistence," Journal of Accounting and Economics, Elsevier, vol. 45(2-3), pages 221-247, August.
    16. Liu, Baixiao & McConnell, John J., 2013. "The role of the media in corporate governance: Do the media influence managers' capital allocation decisions?," Journal of Financial Economics, Elsevier, vol. 110(1), pages 1-17.
    17. Doris M. Merkl-Davies & Niamh Brennan, 2007. "Discretionary disclosure strategies in corporate narratives : incremental information or impression management?," Open Access publications 10197/2907, Research Repository, University College Dublin.
    18. Angela K. Davis & Jeremy M. Piger & Lisa M. Sedor, 2006. "Beyond the numbers: an analysis of optimistic and pessimistic language in earnings press releases," Working Papers 2006-005, Federal Reserve Bank of St. Louis.
    19. Yaw-Shun Yu & Ambrosio Barros & Chih-Hung Tsai & Kuo-Hsiung Liao, 2014. "A Comparison of Ratios and Data Envelopment Analysis: Efficiency Assessment of Taiwan Public Listed Companies," International Journal of Academic Research in Accounting, Finance and Management Sciences, Human Resource Management Academic Research Society, International Journal of Academic Research in Accounting, Finance and Management Sciences, vol. 4(1), pages 212-219, January.
    20. Vivien A. Beattie & Michael J. Jones, 2000. "Changing Graph Use in Corporate Annual Reports: A Time†Series Analysis," Contemporary Accounting Research, John Wiley & Sons, vol. 17(2), pages 213-226, June.
    21. Doaa Aly & Sherif El-Halaby & Khaled Hussainey, 2018. "Tone disclosure and financial performance: evidence from Egypt," Accounting Research Journal, Emerald Group Publishing Limited, vol. 31(1), pages 63-74, May.
    22. Ole-Kristian Hope & Danqi Hu & Hai Lu, 2016. "The benefits of specific risk-factor disclosures," Review of Accounting Studies, Springer, vol. 21(4), pages 1005-1045, December.
    23. Baginski, Stephen P. & Demers, Elizabeth & Kausar, Asad & Yu, Yingri Julia, 2018. "Linguistic tone and the small trader," Accounting, Organizations and Society, Elsevier, vol. 68, pages 21-37.
    24. Mirko S. Heinle & Kevin C. Smith, 2017. "A theory of risk disclosure," Review of Accounting Studies, Springer, vol. 22(4), pages 1459-1491, December.
    25. Xin Ying Qiu & Padmini Srinivasan & Yong Hu, 2014. "Supervised learning models to predict firm performance with annual reports: An empirical study," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 65(2), pages 400-413, February.
    26. Lev, B, 1989. "On The Usefulness Of Earnings And Earnings Research - Lessons And Directions From 2 Decades Of Empirical-Research," Journal of Accounting Research, Wiley Blackwell, vol. 27, pages 153-192.
    27. Mark Clatworthy & Michael Jones, 2003. "Financial reporting of good news and bad news: evidence from accounting narratives," Accounting and Business Research, Taylor & Francis Journals, vol. 33(3), pages 171-185.
    28. Tim Loughran & Bill Mcdonald, 2011. "When Is a Liability Not a Liability? Textual Analysis, Dictionaries, and 10‐Ks," Journal of Finance, American Finance Association, vol. 66(1), pages 35-65, February.
    29. Angela K. Davis & Isho Tama†Sweet, 2012. "Managers’ Use of Language Across Alternative Disclosure Outlets: Earnings Press Releases versus MD&A," Contemporary Accounting Research, John Wiley & Sons, vol. 29(3), pages 804-837, September.
    30. Feng Li, 2010. "The Information Content of Forward‐Looking Statements in Corporate Filings—A Naïve Bayesian Machine Learning Approach," Journal of Accounting Research, Wiley Blackwell, vol. 48(5), pages 1049-1102, December.
    31. Mark A. Clatworthy & Michael John Jones, 2006. "Differential patterns of textual characteristics and company performance in the chairman's statement," Accounting, Auditing & Accountability Journal, Emerald Group Publishing, vol. 19(4), pages 493-511, July.
    32. Emrah Onder & A. Taylan Altintas, 2017. "Financial Performance Evaluation of Turkish Construction Companies in Istanbul Stock Exchange (BIST)," International Journal of Academic Research in Accounting, Finance and Management Sciences, Human Resource Management Academic Research Society, International Journal of Academic Research in Accounting, Finance and Management Sciences, vol. 7(3), pages 108-113, July.
    33. Balakrishnan, Ramji & Qiu, Xin Ying & Srinivasan, Padmini, 2010. "On the predictive ability of narrative disclosures in annual reports," European Journal of Operational Research, Elsevier, vol. 202(3), pages 789-801, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mushtaq, Rizwan & Gull, Ammar Ali & Shahab, Yasir & Derouiche, Imen, 2022. "Do financial performance indicators predict 10-K text sentiments? An application of artificial intelligence," Research in International Business and Finance, Elsevier, vol. 61(C).
    2. Mehmet Kayakus & Burçin Tutcu & Mustafa Terzioglu & Hasan Talaş & Güler Ferhan Ünal Uyar, 2023. "ROA and ROE Forecasting in Iron and Steel Industry Using Machine Learning Techniques for Sustainable Profitability," Sustainability, MDPI, vol. 15(9), pages 1-14, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ingrid E. Fisher & Margaret R. Garnsey & Mark E. Hughes, 2016. "Natural Language Processing in Accounting, Auditing and Finance: A Synthesis of the Literature with a Roadmap for Future Research," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 23(3), pages 157-214, July.
    2. Bassyouny, Hesham & Abdelfattah, Tarek & Tao, Lei, 2022. "Narrative disclosure tone: A review and areas for future research," Journal of International Accounting, Auditing and Taxation, Elsevier, vol. 49(C).
    3. Yan Luo & Linying Zhou, 2020. "Textual tone in corporate financial disclosures: a survey of the literature," International Journal of Disclosure and Governance, Palgrave Macmillan, vol. 17(2), pages 101-110, September.
    4. Ali Ataullah & Andrew Vivian & Bin Xu, 2018. "Optimistic Disclosure Tone and Conservative Debt Policy," Abacus, Accounting Foundation, University of Sydney, vol. 54(4), pages 445-484, December.
    5. Beattie, Vivien, 2014. "Accounting narratives and the narrative turn in accounting research: Issues, theory, methodology, methods and a research framework," The British Accounting Review, Elsevier, vol. 46(2), pages 111-134.
    6. Berkin, Anil & Aerts, Walter & Van Caneghem, Tom, 2023. "Feasibility analysis of machine learning for performance-related attributional statements," International Journal of Accounting Information Systems, Elsevier, vol. 48(C).
    7. Imen Derouiche & Riadh Manita & Anke Muessig, 2021. "Risk disclosure and firm operational efficiency," Annals of Operations Research, Springer, vol. 297(1), pages 115-145, February.
    8. Gilberto Marquez-Illescas & Allan A. Zebedee & Linying Zhou, 2019. "Hear Me Write: Does CEO Narcissism Affect Disclosure?," Journal of Business Ethics, Springer, vol. 159(2), pages 401-417, October.
    9. Liu, Pu & Nguyen, Hazel T., 2020. "CEO characteristics and tone at the top inconsistency," Journal of Economics and Business, Elsevier, vol. 108(C).
    10. Saverio Bozzolan & Giovanna Michelon & Marco Mattei & Andrea Giornetti, 2019. "Signing the letter to shareholders: Does the Signatory?s role relate to impression management?," FINANCIAL REPORTING, FrancoAngeli Editore, vol. 2019(1), pages 37-82.
    11. Tim Loughran & Bill Mcdonald, 2016. "Textual Analysis in Accounting and Finance: A Survey," Journal of Accounting Research, Wiley Blackwell, vol. 54(4), pages 1187-1230, September.
    12. Eachempati, Prajwal & Srivastava, Praveen Ranjan & Kumar, Ajay & Tan, Kim Hua & Gupta, Shivam, 2021. "Validating the impact of accounting disclosures on stock market: A deep neural network approach," Technological Forecasting and Social Change, Elsevier, vol. 170(C).
    13. Yekini, Liafisu Sina & Wisniewski, Tomasz Piotr & Millo, Yuval, 2016. "Market reaction to the positiveness of annual report narratives," The British Accounting Review, Elsevier, vol. 48(4), pages 415-430.
    14. Mather, Paul & Ranasinghe, Dinithi & Unda, Luisa A., 2021. "Are gender diverse boards more cautious? The impact of board gender diversity on sentiment in earnings press releases," Journal of Contemporary Accounting and Economics, Elsevier, vol. 17(3).
    15. Bassyouny, Hesham & Abdelfattah, Tarek & Tao, Lei, 2020. "Beyond narrative disclosure tone: The upper echelons theory perspective," International Review of Financial Analysis, Elsevier, vol. 70(C).
    16. Qian Wang & Duowen Wu & Lina Yan, 2021. "Effect of positive tone in MD&A disclosure on capital structure adjustment speed: evidence from China," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 61(4), pages 5809-5845, December.
    17. Kim, Jongkyum & Lim, Jee-Hae & Yoon, Kyunghee, 2022. "How do the content, format, and tone of Twitter-based corporate disclosure vary depending on earnings performance?," International Journal of Accounting Information Systems, Elsevier, vol. 47(C).
    18. Muhammad Farhan Malik & Yuan George Shan & Jamie Yixing Tong, 2022. "Do auditors price litigious tone?," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 62(S1), pages 1715-1760, April.
    19. Özgür Arslan‐Ayaydin & James Thewissen & Wouter Torsin, 2021. "Disclosure tone management and labor unions," Journal of Business Finance & Accounting, Wiley Blackwell, vol. 48(1-2), pages 102-147, January.
    20. D. G. DeBoskey & Yan Luo & Linying Zhou, 2019. "CEO power, board oversight, and earnings announcement tone," Review of Quantitative Finance and Accounting, Springer, vol. 52(2), pages 657-680, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pal:ijodag:v:19:y:2022:i:1:d:10.1057_s41310-021-00129-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.palgrave.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.