IDEAS home Printed from https://ideas.repec.org/a/eee/finana/v101y2025ics1057521925001140.html
   My bibliography  Save this article

Evaluating the impact of report readability on ESG scores: A generative AI approach

Author

Listed:
  • Shimamura, Takuya
  • Tanaka, Yoshitaka
  • Managi, Shunsuke

Abstract

This study explores the relationship between the readability of sustainability reports and ESG scores for U.S. companies using GPT-4, a generative AI tool. The findings reveal a positive correlation between context-dependent readability scores and the average of multiple ESG scores, whereas their standard deviations exhibit a negative correlation. Conversely, existing text-dependent readability scores reflecting word features show no correlation with ESG scores. Moreover, we observe a correlation between readability and ESG scores among companies with lower social visibility, where transparent disclosure is essential for accurate ESG evaluation. These results point to the usefulness of context-dependent readability in ESG evaluations. In particular, it suggests that the stability of ESG evaluations is related to the high level of readability that takes context into account.

Suggested Citation

  • Shimamura, Takuya & Tanaka, Yoshitaka & Managi, Shunsuke, 2025. "Evaluating the impact of report readability on ESG scores: A generative AI approach," International Review of Financial Analysis, Elsevier, vol. 101(C).
    • Handle: RePEc:eee:finana:v:101:y:2025:i:c:s1057521925001140
    DOI: 10.1016/j.irfa.2025.104027
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1057521925001140
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.irfa.2025.104027?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lo, Kin & Ramos, Felipe & Rogo, Rafael, 2017. "Earnings management and annual report readability," Journal of Accounting and Economics, Elsevier, vol. 63(1), pages 1-25.
    2. Bonsall, Samuel B. & Leone, Andrew J. & Miller, Brian P. & Rennekamp, Kristina, 2017. "A plain English measure of financial reporting readability," Journal of Accounting and Economics, Elsevier, vol. 63(2), pages 329-357.
    3. Tim Loughran & Bill Mcdonald, 2014. "Measuring Readability in Financial Disclosures," Journal of Finance, American Finance Association, vol. 69(4), pages 1643-1671, August.
    4. Dyer, Travis & Lang, Mark & Stice-Lawrence, Lorien, 2017. "The evolution of 10-K textual disclosure: Evidence from Latent Dirichlet Allocation," Journal of Accounting and Economics, Elsevier, vol. 64(2), pages 221-245.
    5. Brian J. Bushee & Ian D. Gow & Daniel J. Taylor, 2018. "Linguistic Complexity in Firm Disclosures: Obfuscation or Information?," Journal of Accounting Research, Wiley Blackwell, vol. 56(1), pages 85-121, March.
    6. Li, Feng, 2008. "Annual report readability, current earnings, and earnings persistence," Journal of Accounting and Economics, Elsevier, vol. 45(2-3), pages 221-247, August.
    7. Volkan Muslu & Sunay Mutlu & Suresh Radhakrishnan & Albert Tsang, 2019. "Corporate Social Responsibility Report Narratives and Analyst Forecast Accuracy," Journal of Business Ethics, Springer, vol. 154(4), pages 1119-1142, February.
    8. George Serafeim & Aaron Yoon, 2023. "Stock price reactions to ESG news: the role of ESG ratings and disagreement," Review of Accounting Studies, Springer, vol. 28(3), pages 1500-1530, September.
    9. Lebelle, Martin & Lajili Jarjir, Souad & Sassi, Syrine, 2022. "The effect of issuance documentation disclosure and readability on liquidity: Evidence from green bonds," Global Finance Journal, Elsevier, vol. 51(C).
    10. Kim, Yongtae & Li, Haidan & Li, Siqi, 2014. "Corporate social responsibility and stock price crash risk," Journal of Banking & Finance, Elsevier, vol. 43(C), pages 1-13.
    11. Kristian D. Allee & Matthew D. Deangelis, 2015. "The Structure of Voluntary Disclosure Narratives: Evidence from Tone Dispersion," Journal of Accounting Research, Wiley Blackwell, vol. 53(2), pages 241-274, May.
    12. Lori Holder-Webb & Jeffrey Cohen & Leda Nath & David Wood, 2009. "The Supply of Corporate Social Responsibility Disclosures Among U.S. Firms," Journal of Business Ethics, Springer, vol. 84(4), pages 497-527, February.
    13. Zhihong Wang & Tien‐Shih Hsieh & Joseph Sarkis, 2018. "CSR Performance and the Readability of CSR Reports: Too Good to be True?," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 25(1), pages 66-79, January.
    14. Kira R. Fabrizio & Eun-Hee Kim, 2019. "Reluctant Disclosure and Transparency: Evidence from Environmental Disclosures," Organization Science, INFORMS, vol. 30(6), pages 1207-1231, November.
    15. Florian Berg & Julian F Kölbel & Roberto Rigobon, 2022. "Aggregate Confusion: The Divergence of ESG Ratings [Corporate social responsibility and firm risk: theory and empirical evidence]," Review of Finance, European Finance Association, vol. 26(6), pages 1315-1344.
    16. Hu, Xinwen & Hua, Renhai & Liu, Qingfu & Wang, Chuanjie, 2023. "The green fog: Environmental rating disagreement and corporate greenwashing," Pacific-Basin Finance Journal, Elsevier, vol. 78(C).
    17. Samuel B. Bonsall & Brian P. Miller, 2017. "The impact of narrative disclosure readability on bond ratings and the cost of debt," Review of Accounting Studies, Springer, vol. 22(2), pages 608-643, June.
    18. Manish Jha & Jialin Qian & Michael Weber & Baozhong Yang, 2024. "ChatGPT and Corporate Policies," Papers 2409.17933, arXiv.org, revised Feb 2025.
    19. Soliman, Marwa & Ben-Amar, Walid, 2022. "Corporate social responsibility orientation and textual features of financial disclosures," International Review of Financial Analysis, Elsevier, vol. 84(C).
    20. James Heckman, 2013. "Sample selection bias as a specification error," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 31(3), pages 129-137.
    21. Michael D. Kimbrough & Xu (Frank) Wang & Sijing Wei & Jiarui (Iris) Zhang, 2024. "Does Voluntary ESG Reporting Resolve Disagreement among ESG Rating Agencies?," European Accounting Review, Taylor & Francis Journals, vol. 33(1), pages 15-47, January.
    22. Nazari, Jamal A. & Hrazdil, Karel & Mahmoudian, Fereshteh, 2017. "Assessing social and environmental performance through narrative complexity in CSR reports," Journal of Contemporary Accounting and Economics, Elsevier, vol. 13(2), pages 166-178.
    23. Li, Chengcheng & Wang, Xiaoqiong, 2022. "Local peer effects of corporate social responsibility," Journal of Corporate Finance, Elsevier, vol. 73(C).
    24. Ariela Caglio & Gaia Melloni & Paolo Perego, 2020. "Informational Content and Assurance of Textual Disclosures: Evidence on Integrated Reporting," European Accounting Review, Taylor & Francis Journals, vol. 29(1), pages 55-83, January.
    25. Davidson, Robert & Dey, Aiyesha & Smith, Abbie, 2015. "Executives' “off-the-job” behavior, corporate culture, and financial reporting risk," Journal of Financial Economics, Elsevier, vol. 117(1), pages 5-28.
    26. Shuili Du & Kun Yu, 2021. "Do Corporate Social Responsibility Reports Convey Value Relevant Information? Evidence from Report Readability and Tone," Journal of Business Ethics, Springer, vol. 172(2), pages 253-274, August.
    27. Souad Lajili Jarjir & Martin Lebelle & Syrine Sassi, 2022. "The effect of issuance documentation disclosure and readability on liquidity: Evidence from green bonds," Post-Print hal-03428710, HAL.
    28. Humphery-Jenner, Mark & Liu, Yun & Nanda, Vikram & Silveri, Sabatino & Sun, Minxing, 2024. "Of fogs and bogs: Does litigation risk make financial reports less readable?," Journal of Banking & Finance, Elsevier, vol. 163(C).
    29. Hoberg, Gerard & Lewis, Craig, 2017. "Do fraudulent firms produce abnormal disclosure?," Journal of Corporate Finance, Elsevier, vol. 43(C), pages 58-85.
    30. Justin Hung Nguyen, 2021. "Tax Avoidance and Financial Statement Readability," European Accounting Review, Taylor & Francis Journals, vol. 30(5), pages 1043-1066, October.
    31. Paul C. Godfrey & Craig B. Merrill & Jared M. Hansen, 2009. "The relationship between corporate social responsibility and shareholder value: an empirical test of the risk management hypothesis," Strategic Management Journal, Wiley Blackwell, vol. 30(4), pages 425-445, April.
    32. Aaron K. Chatterji & Rodolphe Durand & David I. Levine & Samuel Touboul, 2016. "Do ratings of firms converge? Implications for managers, investors and strategy researchers," Strategic Management Journal, Wiley Blackwell, vol. 37(8), pages 1597-1614, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Soliman, Marwa & Ben-Amar, Walid, 2022. "Corporate social responsibility orientation and textual features of financial disclosures," International Review of Financial Analysis, Elsevier, vol. 84(C).
    2. Shuolei Xu & Fangjun Wang & Charles P. Cullinan & Nanyan Dong, 2022. "Corporate Tax Avoidance and Corporate Social Responsibility Disclosure Readability: Evidence from China," Australian Accounting Review, CPA Australia, vol. 32(2), pages 267-289, June.
    3. Peng Hu & Xuming Li & Nian Li & Yiying Wang & Derek D. Wang, 2024. "Peeking into Corporate Greenwashing through the Readability of ESG Disclosures," Sustainability, MDPI, vol. 16(6), pages 1-23, March.
    4. Akhilesh Bajaj & Lori N. K. Leonard & Li Sun & Zhenze Xing, 2023. "Corporate social responsibility and annual report reading difficulty," Review of Quantitative Finance and Accounting, Springer, vol. 60(4), pages 1393-1428, May.
    5. Shuili Du & Kun Yu, 2021. "Do Corporate Social Responsibility Reports Convey Value Relevant Information? Evidence from Report Readability and Tone," Journal of Business Ethics, Springer, vol. 172(2), pages 253-274, August.
    6. Kuo Zhou & Xianghui Jin & Xinru Li & Yunqing Tao, 2024. "Enhancing sustainable development through effective disclosure: Corporate environmental performance and readability," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 31(1), pages 274-291, January.
    7. Senave, Elseline & Jans, Mieke J. & Srivastava, Rajendra P., 2023. "The application of text mining in accounting," International Journal of Accounting Information Systems, Elsevier, vol. 50(C).
    8. Rjiba, Hatem & Saadi, Samir & Boubaker, Sabri & Ding, Xiaoya (Sara), 2021. "Annual report readability and the cost of equity capital," Journal of Corporate Finance, Elsevier, vol. 67(C).
    9. Blankespoor, Elizabeth & deHaan, Ed & Marinovic, Iván, 2020. "Disclosure processing costs, investors’ information choice, and equity market outcomes: A review," Journal of Accounting and Economics, Elsevier, vol. 70(2).
    10. Jia, Jing & Li, Zhongtian, 2022. "Risk management committees and readability of risk management disclosure," Journal of Contemporary Accounting and Economics, Elsevier, vol. 18(3).
    11. Jannik Gerwanski & Othar Kordsachia & Patrick Velte, 2019. "Determinants of materiality disclosure quality in integrated reporting: Empirical evidence from an international setting," Business Strategy and the Environment, Wiley Blackwell, vol. 28(5), pages 750-770, July.
    12. Richard Frankel & Jared Jennings & Joshua Lee, 2022. "Disclosure Sentiment: Machine Learning vs. Dictionary Methods," Management Science, INFORMS, vol. 68(7), pages 5514-5532, July.
    13. Jie Huang & Derek D. Wang & Yiying Wang, 2024. "Textual Attributes of Corporate Sustainability Reports and ESG Ratings," Sustainability, MDPI, vol. 16(21), pages 1-20, October.
    14. Kalelkar, Rachana & Xu, Hongkang & Nguyen, Duong & Chen, Zheng, 2024. "Generalist CEOs and the readability of the 10-K report," Advances in accounting, Elsevier, vol. 65(C).
    15. Peter M. Clarkson & Jordan Ponn & Gordon D. Richardson & Frank Rudzicz & Albert Tsang & Jingjing Wang, 2020. "A Textual Analysis of US Corporate Social Responsibility Reports," Abacus, Accounting Foundation, University of Sydney, vol. 56(1), pages 3-34, March.
    16. Sun, Li & Johnson, Grace & Bradley, Wray, 2022. "CEO power and annual report reading difficulty," Journal of Contemporary Accounting and Economics, Elsevier, vol. 18(2).
    17. Aktas, Nihat & de Bodt, Eric & Dogan, Can Deniz, 2025. "Do investor reactions to merger announcements shape the writing of SEC filings?," The British Accounting Review, Elsevier, vol. 57(3).
    18. Jian Zhou & Xiaodong Lei & Jianglong Yu, 2024. "ESG rating divergence and corporate green innovation," Business Strategy and the Environment, Wiley Blackwell, vol. 33(4), pages 2911-2930, May.
    19. Muhammad Nadeem, 2022. "Board Gender Diversity and Managerial Obfuscation: Evidence from the Readability of Narrative Disclosure in 10-K Reports," Journal of Business Ethics, Springer, vol. 179(1), pages 153-177, August.
    20. Oradi, Javad & Hesarzadeh, Reza & E-Vahdati, Sahar & Nadeem, Muhammad, 2024. "CEO succession origin and annual reports readability," The British Accounting Review, Elsevier, vol. 56(6).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:finana:v:101:y:2025:i:c:s1057521925001140. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/620166 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.