IDEAS home Printed from https://ideas.repec.org/a/fan/macoma/vhtml10.3280-maco2023-002-s1008.html
   My bibliography  Save this article

Can we trust ESG Ratings? Some insights based on a bibliometric analysis of ESG data quality and rating reliability

Author

Listed:
  • Paola Demartini
  • Claudia Pagliei

Abstract

The aim of this research is to investigate the quality and reliability of ESG data provided by companies, as well as the accuracy and objectivity of ESG ratings produced by sustainability rating agencies (SRAs). Since SRAs use companies? non-financial information as input data when formulating their ESG ratings, these two topics appear to be strictly interconnected. Drawing on the Shanon and Weaver (1949) model of communication, we have addressed these issues by means of a systematic literature review combined with a bibliometric analysis. In our investigation we run: i) the co-citation analysis to de-tect the seminal papers; ii) a keyword co-occurrence analysis to explore how the main features of the academic debate have unfolded in the last five years; iii) a keyword co-occurrence analysis to obtain a network visualisation map to explore how the research broad scope was articulated in different clusters (i.e., themes of research). Among the clusters that emerged from the mapping, we have decided to delve into the streams of research we consider most relevant and deal with: the re-lationships between ESG and Artificial Intelligence (AI). Namely, we deem that AI may allow us to process massive amounts of data that contain crucial information for ESG investing. However, even if computer algorithms are able to analyse all information available efficiently, and in a timely manner, managers and investors should be aware of their opportunities and criticisms, while scholars should list propositions for advancing the research on these topics.

Suggested Citation

  • Paola Demartini & Claudia Pagliei, 2023. "Can we trust ESG Ratings? Some insights based on a bibliometric analysis of ESG data quality and rating reliability," MANAGEMENT CONTROL, FrancoAngeli Editore, vol. 2023(2 Suppl.), pages 161-187.
    • Handle: RePEc:fan:macoma:v:html10.3280/maco2023-002-s1008
    as

    Download full text from publisher

    File URL: http://www.francoangeli.it/riviste/Scheda_Rivista.aspx?IDArticolo=74060&Tipo=ArticoloPDF
    Download Restriction: Single articles can be downloaded buying download credits, for info: https://www.francoangeli.it/DownloadCredit
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Donthu, Naveen & Kumar, Satish & Mukherjee, Debmalya & Pandey, Nitesh & Lim, Weng Marc, 2021. "How to conduct a bibliometric analysis: An overview and guidelines," Journal of Business Research, Elsevier, vol. 133(C), pages 285-296.
    2. Gunnar Friede, 2019. "Why don't we see more action? A metasynthesis of the investor impediments to integrate environmental, social, and governance factors," Business Strategy and the Environment, Wiley Blackwell, vol. 28(6), pages 1260-1282, September.
    3. Quick, Reiner & Inwinkl, P., 2020. "Assurance on CSR Reports: Impact on the Credibility Perceptions of Non-Financial Information by Bank Directors," Publications of Darmstadt Technical University, Institute for Business Studies (BWL) 124765, Darmstadt Technical University, Department of Business Administration, Economics and Law, Institute for Business Studies (BWL).
    4. She, Chaoyuan & Michelon, Giovanna, 2019. "Managing stakeholder perceptions: Organized hypocrisy in CSR disclosures on Facebook," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 61(C), pages 54-76.
    5. Zabihollah Rezaee & Ling Tuo, 2019. "Are the Quantity and Quality of Sustainability Disclosures Associated with the Innate and Discretionary Earnings Quality?," Journal of Business Ethics, Springer, vol. 155(3), pages 763-786, March.
    6. Rodolphe Durand & Luc Paugam & Hervé Stolowy, 2019. "Do investors actually value sustainability indices? Replication, development, and new evidence on CSR visibility," Strategic Management Journal, Wiley Blackwell, vol. 40(9), pages 1471-1490, September.
    7. Greg Bala & Hendrik Bartel & James P. Hawley & Yung-Jae Lee, 2015. "Tracking “Real-time” Corporate Sustainability Signals Using Cognitive Computing," Journal of Applied Corporate Finance, Morgan Stanley, vol. 27(2), pages 95-102, June.
    8. Sebastian Utz, 2019. "Corporate scandals and the reliability of ESG assessments: evidence from an international sample," Review of Managerial Science, Springer, vol. 13(2), pages 483-511, April.
    9. Olga Hawn & Aaron K. Chatterji & Will Mitchell, 2018. "Do investors actually value sustainability? New evidence from investor reactions to the Dow Jones Sustainability Index (DJSI)," Strategic Management Journal, Wiley Blackwell, vol. 39(4), pages 949-976, April.
    10. Michael Robinson & Anne Kleffner & Stephanie Bertels, 2011. "Signaling Sustainability Leadership: Empirical Evidence of the Value of DJSI Membership," Journal of Business Ethics, Springer, vol. 101(3), pages 493-505, July.
    11. Carolina Almeida Cruz & Florinda Matos, 2023. "ESG Maturity: A Software Framework for the Challenges of ESG Data in Investment," Sustainability, MDPI, vol. 15(3), pages 1-18, February.
    12. John Dumay & Cristiana Bernardi & James Guthrie & Paola Demartini, 2016. "Integrated reporting: A structured literature review," Accounting Forum, Taylor & Francis Journals, vol. 40(3), pages 166-185, September.
    13. M. López & Arminda Garcia & Lazaro Rodriguez, 2007. "Sustainable Development and Corporate Performance: A Study Based on the Dow Jones Sustainability Index," Journal of Business Ethics, Springer, vol. 75(3), pages 285-300, October.
    14. Gregor Dorfleitner & Sebastian Utz & Maximilian Wimmer, 2018. "Patience pays off – corporate social responsibility and long-term stock returns," Journal of Sustainable Finance & Investment, Taylor & Francis Journals, vol. 8(2), pages 132-157, April.
    15. El Ghoul, Sadok & Guedhami, Omrane & Kwok, Chuck C.Y. & Mishra, Dev R., 2011. "Does corporate social responsibility affect the cost of capital?," Journal of Banking & Finance, Elsevier, vol. 35(9), pages 2388-2406, September.
    16. Charles H. Cho & Kathrin Bohr & Tony Jaehyun Choi & Katharine Partridge & Jhankrut Mukesh Shah & Ada Swierszcz, 2020. "Advancing Sustainability Reporting in Canada: 2019 Report on Progress," Accounting Perspectives, John Wiley & Sons, vol. 19(3), pages 181-204, September.
    17. Tsang, Albert & Frost, Tracie & Cao, Huijuan, 2023. "Environmental, Social, and Governance (ESG) disclosure: A literature review," The British Accounting Review, Elsevier, vol. 55(1).
    18. Axel Haller & Chris J. van Staden & Cristina Landis, 2018. "Value Added as part of Sustainability Reporting: Reporting on Distributional Fairness or Obfuscation?," Journal of Business Ethics, Springer, vol. 152(3), pages 763-781, October.
    19. Nees Jan Eck & Ludo Waltman, 2010. "Software survey: VOSviewer, a computer program for bibliometric mapping," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(2), pages 523-538, August.
    20. Wendy Stubbs & Paul Rogers, 2013. "Lifting the veil on environment-social-governance rating methods," Social Responsibility Journal, Emerald Group Publishing Limited, vol. 9(4), pages 622-640, September.
    21. Nicola Cucari & Salvatore Esposito De Falco & Beatrice Orlando, 2018. "Diversity of Board of Directors and Environmental Social Governance: Evidence from Italian Listed Companies," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 25(3), pages 250-266, May.
    22. Reiner Quick & Petra Inwinkl, 2020. "Assurance on CSR reports: impact on the credibility perceptions of non-financial information by bank directors," Meditari Accountancy Research, Emerald Group Publishing Limited, vol. 28(5), pages 833-862, June.
    23. Michele Galeotti & Rosa Lombardi & Paola Paoloni & Fabiana Roberto, 2022. "Big data and sustainability reports: The current approach to non-accounting data management," MANAGEMENT CONTROL, FrancoAngeli Editore, vol. 2022(2 Suppl.), pages 95-116.
    24. Sylvie Berthelot & Michel Coulmont & Vanessa Serret, 2012. "Do Investors Value Sustainability Reports? A Canadian Study," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 19(6), pages 355-363, November.
    25. Gunnar Friede & Timo Busch & Alexander Bassen, 2015. "ESG and financial performance: aggregated evidence from more than 2000 empirical studies," Journal of Sustainable Finance & Investment, Taylor & Francis Journals, vol. 5(4), pages 210-233, October.
    26. Sakis Kotsantonis & Chris Pinney & George Serafeim, 2016. "ESG Integration in Investment Management: Myths and Realities," Journal of Applied Corporate Finance, Morgan Stanley, vol. 28(2), pages 10-16, June.
    27. Amal Aouadi & Sylvain Marsat, 2018. "Do ESG Controversies Matter for Firm Value? Evidence from International Data," Journal of Business Ethics, Springer, vol. 151(4), pages 1027-1047, September.
    28. Giovanna Centorrino & Valeria Naciti & Daniela Rupo, 2022. "From double-entry bookkeeping and ledger to blockchain technology: New frontiers for accounting information systems," MANAGEMENT CONTROL, FrancoAngeli Editore, vol. 2022(2 Suppl.), pages 15-41.
    29. Avramov, Doron & Cheng, Si & Lioui, Abraham & Tarelli, Andrea, 2022. "Sustainable investing with ESG rating uncertainty," Journal of Financial Economics, Elsevier, vol. 145(2), pages 642-664.
    30. Gregor Dorfleitner & Christian Kreuzer & Christian Sparrer, 2020. "ESG controversies and controversial ESG: about silent saints and small sinners," Journal of Asset Management, Palgrave Macmillan, vol. 21(5), pages 393-412, September.
    31. Arthur Hughes & Michael A. Urban & Dariusz Wójcik, 2021. "Alternative ESG Ratings: How Technological Innovation Is Reshaping Sustainable Investment," Sustainability, MDPI, vol. 13(6), pages 1-23, March.
    32. Isabel‐María García‐Sánchez & Nazim Hussain & Sana‐Akbar Khan & Jennifer Martínez‐Ferrero, 2022. "Assurance of corporate social responsibility reports: Examining the role of internal and external corporate governance mechanisms," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 29(1), pages 89-106, January.
    33. Soh Young In & Dane Rook & Ashby Monk, 2019. "Integrating Alternative Data (Also Known as ESG Data) in Investment Decision Making," Global Economic Review, Taylor & Francis Journals, vol. 48(3), pages 237-260, July.
    34. Elena Escrig-Olmedo & María Ángeles Fernández-Izquierdo & Idoya Ferrero-Ferrero & Juana María Rivera-Lirio & María Jesús Muñoz-Torres, 2019. "Rating the Raters: Evaluating how ESG Rating Agencies Integrate Sustainability Principles," Sustainability, MDPI, vol. 11(3), pages 1-16, February.
    35. Maurizio Massaro & John Dumay & James Guthrie, 2016. "On the shoulders of giants: undertaking a structured literature review in accounting," Accounting, Auditing & Accountability Journal, Emerald Group Publishing Limited, vol. 29(5), pages 767-801, June.
    36. Philipp Krueger & Zacharias Sautner & Dragon Yongjun Tang & Rui Zhong, 2021. "The Effects of Mandatory ESG Disclosure Around the World," Swiss Finance Institute Research Paper Series 21-44, Swiss Finance Institute.
    37. Habiba Al‐Shaer & Mahbub Zaman, 2018. "Credibility of sustainability reports: The contribution of audit committees," Business Strategy and the Environment, Wiley Blackwell, vol. 27(7), pages 973-986, November.
    38. Susanne Arvidsson & John Dumay, 2022. "Corporate ESG reporting quantity, quality and performance: Where to now for environmental policy and practice?," Business Strategy and the Environment, Wiley Blackwell, vol. 31(3), pages 1091-1110, March.
    39. Ioannis Ioannou & George Serafeim, 2015. "The impact of corporate social responsibility on investment recommendations: Analysts' perceptions and shifting institutional logics," Strategic Management Journal, Wiley Blackwell, vol. 36(7), pages 1053-1081, July.
    40. Sahin, Özge & Bax, Karoline & Paterlini, Sandra & Czado, Claudia, 2023. "The pitfalls of (non-definitive) Environmental, Social, and Governance scoring methodology," Global Finance Journal, Elsevier, vol. 56(C).
    41. Olivier Boiral & David Talbot & Marie-Christine Brotherton & Iñaki Heras-Saizarbitoria, 2021. "Sustainability rating and moral fictionalism: opening the black box of nonfinancial agencies," Accounting, Auditing & Accountability Journal, Emerald Group Publishing Limited, vol. 34(8), pages 1740-1768, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dorfleitner, Gregor & Kreuzer, Christian & Sparrer, Christian, 2022. "To sin in secret is no sin at all: On the linkage of policy, society, culture, and firm characteristics with corporate scandals," Journal of Economic Behavior & Organization, Elsevier, vol. 202(C), pages 762-784.
    2. Selena Aureli & Sabrina Gigli & Renato Medei & Enrico Supino, 2020. "The value relevance of environmental, social, and governance disclosure: Evidence from Dow Jones Sustainability World Index listed companies," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 27(1), pages 43-52, January.
    3. Felipe Arias Fogliano de Souza Cunha & Erick Meira de Oliveira & Renato J. Orsato & Marcelo Cabus Klotzle & Fernando Luiz Cyrino Oliveira & Rodrigo Goyannes Gusmão Caiado, 2020. "Can sustainable investments outperform traditional benchmarks? Evidence from global stock markets," Business Strategy and the Environment, Wiley Blackwell, vol. 29(2), pages 682-697, February.
    4. Bryan Schmutz & Minoo Tehrani & Lawrence Fulton & Andreas W. Rathgeber, 2020. "Dow Jones Sustainability Indices, Do They Make a Difference? The U.S. and the European Union Companies," Sustainability, MDPI, vol. 12(17), pages 1-15, August.
    5. Chen, Zhongfei & Xie, Guanxia, 2022. "ESG disclosure and financial performance: Moderating role of ESG investors," International Review of Financial Analysis, Elsevier, vol. 83(C).
    6. N. Denuwara & A. Kim & V. Atree & P. Newenhisen & C. Gibson & D. Schork & M. Hakovirta, 2022. "Corporate economic performance and sustainability indices: a study based on the Dow Jones Sustainability Index," SN Business & Economics, Springer, vol. 2(7), pages 1-22, July.
    7. Yu, Haixu & Liang, Chuanyu & Liu, Zhaohua & Wang, He, 2023. "News-based ESG sentiment and stock price crash risk," International Review of Financial Analysis, Elsevier, vol. 88(C).
    8. Jannik Gerwanski, 2020. "Does it pay off? Integrated reporting and cost of debt: European evidence," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 27(5), pages 2299-2319, September.
    9. Billio, Monica & Costola, Michele & Hristova, Iva & Latino, Carmelo & Pelizzon, Loriana, 2022. "Sustainable finance: A journey toward ESG and climate risk," SAFE Working Paper Series 349, Leibniz Institute for Financial Research SAFE.
    10. Yusuf Babatunde Adeneye & Setareh Fasihi & Ines Kammoun & Khaldoon Albitar, 2024. "Does earnings management constrain ESG performance? The role of corporate governance," International Journal of Disclosure and Governance, Palgrave Macmillan, vol. 21(1), pages 69-92, March.
    11. Alan Kai Ming Au & Yi-Fan Yang & Huan Wang & Rui-Hong Chen & Leven J. Zheng, 2023. "Mapping the Landscape of ESG Strategies: A Bibliometric Review and Recommendations for Future Research," Sustainability, MDPI, vol. 15(24), pages 1-26, December.
    12. Karime Chahuán-Jiménez, 2020. "Correlation between the DJSI Chile and the Financial Indices of Chilean Companies," IJFS, MDPI, vol. 8(4), pages 1-14, November.
    13. Chen, Lifeng & Khurram, Muhammad Usman & Gao, Yuying & Abedin, Mohammad Zoynul & Lucey, Brian, 2023. "ESG disclosure and technological innovation capabilities of the Chinese listed companies," Research in International Business and Finance, Elsevier, vol. 65(C).
    14. Rudkin, Wanling & Cai, Charlie X., 2023. "Information content of sustainability index recomposition: A synthetic portfolio approach," International Review of Financial Analysis, Elsevier, vol. 88(C).
    15. Olivier Boiral & David Talbot & Marie‐Christine Brotherton, 2020. "Measuring sustainability risks: A rational myth?," Business Strategy and the Environment, Wiley Blackwell, vol. 29(6), pages 2557-2571, September.
    16. Małgorzata Janicka & Artur Sajnóg, 2022. "The ESG Reporting of EU Public Companies—Does the Company’s Capitalisation Matter?," Sustainability, MDPI, vol. 14(7), pages 1-17, April.
    17. Arjun Mitra & Corinne Post & Steve Sauerwald, 2021. "Evaluating Board Candidates: A Threat-Contingency Model of Shareholder Dissent Against Female Director Candidates," Organization Science, INFORMS, vol. 32(1), pages 86-110, January.
    18. Irina-Eugenia Iamandi & Laura-Gabriela Constantin & Sebastian Madalin Munteanu & Bogdan Cernat-Gruici, 2019. "Mapping the ESG Behavior of European Companies. A Holistic Kohonen Approach," Sustainability, MDPI, vol. 11(12), pages 1-41, June.
    19. Zhang, Dongyang, 2023. "Does green finance really inhibit extreme hypocritical ESG risk? A greenwashing perspective exploration," Energy Economics, Elsevier, vol. 121(C).
    20. Wong, Jin Boon & Zhang, Qin, 2022. "Stock market reactions to adverse ESG disclosure via media channels," The British Accounting Review, Elsevier, vol. 54(1).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fan:macoma:v:html10.3280/maco2023-002-s1008. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Stefania Rosato (email available below). General contact details of provider: http://www.francoangeli.it/riviste/sommario.aspx?IDRivista=166 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.