IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v17y2025i6p2460-d1609933.html
   My bibliography  Save this article

Developing a Novel Audit Risk Metric Through Sentiment Analysis

Author

Listed:
  • Xiao Wang

    (Enterprise Compliance Research Center, Binzhou Polytechnic, No. 919 Yellow River Twelve Road, Bincheng District, Binzhou 256619, China
    These authors contributed equally to this work.)

  • Feng Sun

    (School of Business Administration, Binzhou Polytechnic, Binzhou 256619, China
    These authors contributed equally to this work.)

  • Min Gyeong Kim

    (S.K.K. Business School, Sungkyunkwan University, Seoul 03063, Republic of Korea)

  • Hyung Jong Na

    (Department of Accounting and Taxation, Semyung University, 65, Semyeong-ro, Jecheon-si 27136, Republic of Korea
    These authors contributed equally to this work.)

Abstract

This study introduces the Audit Risk Sentiment Value (ARSV), a novel audit risk proxy that leverages sentiment analysis to address limitations in traditional audit risk measures such as audit fees (LNFEE), audit hours (LNHOUR), and discretionary accruals (|MJDA|). Traditional proxies primarily capture quantitative dimensions, overlooking qualitative insights embedded in audit report narratives. By systematically analyzing sentiment and tone, ARSV captures nuanced audit risk dimensions that reflect the auditor’s risk perception. The study validates ARSV using a dataset of South Korean firms listed on the KOSPI from 2018 to 2023. The results demonstrate the ARSV’s superior explanatory power, as confirmed through the Vuong test, showing consistent performance across binary and continuous measures of explanatory language. ARSV bridges the gap between qualitative and quantitative audit risk assessments, offering significant benefits to auditors, regulators, and investors. Its ability to enhance the interpretability of audit reports improves transparency and trust in financial reporting, addressing stakeholder demands for actionable, forward-looking information. Furthermore, ARSV aligns with global trends emphasizing sustainability and accountability by integrating qualitative insights into audit practices. While this study provides robust evidence supporting ARSV effectiveness, its focus on South Korean firms may limit its generalizability. Future research should explore ARSV application in diverse regulatory and cultural contexts and refine the sentiment analysis tools using advanced machine learning techniques. Expanding ARSV to include other unstructured data, such as management commentary, could further enhance its applicability. This study marks a significant step toward modernizing audit methodologies, aligning them with evolving demands for comprehensive and transparent financial reporting. The empirical analysis reveals that ARSV outperforms traditional audit risk proxies with significantly higher explanatory power. Specifically, ARSV achieved a pseudo R 2 of 0.786, compared to 0.608 for LNFEE, 0.604 for LNHOUR, and 0.578 for |MJDA|. The Vuong test results further validate ARSV superiority, with Z-statistics of −12.168, −12.492, and −9.775 when compared against LNFEE, LNHOUR, and |MJDA|, respectively. The model incorporating ARSV demonstrated a 62.454 F-value and an Adjusted R 2 of 0.599, highlighting its robustness and reliability in audit risk assessment. These quantitative metrics underscore ARSV’s effectiveness in capturing qualitative audit risk dimensions, offering a more precise and informative measure for stakeholders.

Suggested Citation

  • Xiao Wang & Feng Sun & Min Gyeong Kim & Hyung Jong Na, 2025. "Developing a Novel Audit Risk Metric Through Sentiment Analysis," Sustainability, MDPI, vol. 17(6), pages 1-24, March.
  • Handle: RePEc:gam:jsusta:v:17:y:2025:i:6:p:2460-:d:1609933
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/17/6/2460/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2071-1050/17/6/2460/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Geraldine Broye & Laurent Weill, 2008. "Does leverage influence auditor choice? A cross-country analysis," Applied Financial Economics, Taylor & Francis Journals, vol. 18(9), pages 715-731.
    2. Ran An & Wentao Li & Di Wang & Yanyan Wang & Lisheng Yu, 2023. "Do Key Audit Matters Affect Operating Activities? Evidence from Inventory Management," Abacus, Accounting Foundation, University of Sydney, vol. 59(1), pages 300-339, March.
    3. Linsley, Philip M. & Shrives, Philip J., 2006. "Risk reporting: A study of risk disclosures in the annual reports of UK companies," The British Accounting Review, Elsevier, vol. 38(4), pages 387-404.
    4. Chiara Demartini & Sara Trucco, 2016. "Does Intellectual Capital Disclosure Matter for Audit Risk? Evidence from the UK and Italy," Sustainability, MDPI, vol. 8(9), pages 1-19, August.
    5. Ronald A. Davidson & Dean Neu, 1993. "A Note on the Association between Audit Firm Size and Audit Quality," Contemporary Accounting Research, John Wiley & Sons, vol. 9(2), pages 479-488, March.
    6. Tim Loughran & Bill Mcdonald, 2011. "When Is a Liability Not a Liability? Textual Analysis, Dictionaries, and 10‐Ks," Journal of Finance, American Finance Association, vol. 66(1), pages 35-65, February.
    7. Shauhrat S. Chopra & Sachini Supunsala Senadheera & Pavani Dulanja Dissanayake & Piumi Amasha Withana & Rajeev Chib & Jay Hyuk Rhee & Yong Sik Ok, 2024. "Navigating the Challenges of Environmental, Social, and Governance (ESG) Reporting: The Path to Broader Sustainable Development," Sustainability, MDPI, vol. 16(2), pages 1-14, January.
    8. Seung Uk Choi & Hyung Jong Na & Kun Chang Lee, 2023. "Does explanatory language convey the auditor’s perceived audit risk? A study using a novel big data analysis metric," Managerial Auditing Journal, Emerald Group Publishing Limited, vol. 38(6), pages 783-812, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Giuseppe Iuliano & Gaetano Matonti, 2015. "Do big 4 audit companies detect earnings management and report it in the audit opinion? Empirical evidence from italian non-listed firms," ESPERIENZE D'IMPRESA, FrancoAngeli Editore, vol. 2015(2), pages 5-43.
    2. Ingrid E. Fisher & Margaret R. Garnsey & Mark E. Hughes, 2016. "Natural Language Processing in Accounting, Auditing and Finance: A Synthesis of the Literature with a Roadmap for Future Research," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 23(3), pages 157-214, July.
    3. Elshandidy, Tamer & Ahmed, Yousry, 2023. "Stock price informativeness of risk disclosure: Does time orientation matter?," The Quarterly Review of Economics and Finance, Elsevier, vol. 89(C), pages 149-162.
    4. Nadine Gatzert & Dinah Heidinger, 2020. "An Empirical Analysis of Market Reactions to the First Solvency and Financial Condition Reports in the European Insurance Industry," Journal of Risk & Insurance, The American Risk and Insurance Association, vol. 87(2), pages 407-436, June.
    5. KIM, Hyonok & YASUDA, Yukihiro & 安田, 行宏, 2016. "A new approach to identify the economic effects of disclosure: Information content of business risk disclosures in Japanese firms," Working Paper Series G-1-13, Hitotsubashi University Center for Financial Research.
    6. Imen Derouiche & Riadh Manita & Anke Muessig, 2021. "Risk disclosure and firm operational efficiency," Annals of Operations Research, Springer, vol. 297(1), pages 115-145, February.
    7. Kim, Hyonok & Yasuda, Yukihiro, 2018. "Business risk disclosure and firm risk: Evidence from Japan," Research in International Business and Finance, Elsevier, vol. 45(C), pages 413-426.
    8. Bassyouny, Hesham & Abdelfattah, Tarek & Tao, Lei, 2020. "Beyond narrative disclosure tone: The upper echelons theory perspective," International Review of Financial Analysis, Elsevier, vol. 70(C).
    9. Sang Cheol Lee & Mooweon Rhee & Jongchul Yoon, 2018. "Foreign Monitoring and Audit Quality: Evidence from Korea," Sustainability, MDPI, vol. 10(9), pages 1-22, September.
    10. Gu, Chen & Kurov, Alexander & Wolfe, Marketa Halova, 2018. "Relief Rallies after FOMC Announcements as a Resolution of Uncertainty," Journal of Empirical Finance, Elsevier, vol. 49(C), pages 1-18.
    11. Müller, Karsten, 2020. "German forecasters' narratives: How informative are German business cycle forecast reports?," Working Papers 23, German Research Foundation's Priority Programme 1859 "Experience and Expectation. Historical Foundations of Economic Behaviour", Humboldt University Berlin.
    12. Aaryan Gupta & Vinya Dengre & Hamza Abubakar Kheruwala & Manan Shah, 2020. "Comprehensive review of text-mining applications in finance," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 6(1), pages 1-25, December.
    13. Yan Luo & Linying Zhou, 2020. "Textual tone in corporate financial disclosures: a survey of the literature," International Journal of Disclosure and Governance, Palgrave Macmillan, vol. 17(2), pages 101-110, September.
    14. Bruce J. Mcconomy, 1998. "Bias and Accuracy of Management Earnings Forecasts: An Evaluation of the Impact of Auditing," Contemporary Accounting Research, John Wiley & Sons, vol. 15(2), pages 167-195, June.
    15. Jiao Ji & Oleksandr Talavera & Shuxing Yin, 2018. "The Hidden Information Content: Evidence from the Tone of Independent Director Reports," Working Papers 2018-28, Swansea University, School of Management.
    16. Bennani, Hamza & Romelli, Davide, 2024. "Exploring the informativeness and drivers of tone during committee meetings: The case of the Federal Reserve," Journal of International Money and Finance, Elsevier, vol. 148(C).
    17. Qian Wang & Duowen Wu & Lina Yan, 2021. "Effect of positive tone in MD&A disclosure on capital structure adjustment speed: evidence from China," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 61(4), pages 5809-5845, December.
    18. Bennani, Hamza, 2018. "Media coverage and ECB policy-making: Evidence from an augmented Taylor rule," Journal of Macroeconomics, Elsevier, vol. 57(C), pages 26-38.
    19. Umar, Tarik, 2022. "Complexity aversion when SeekingAlpha," Journal of Accounting and Economics, Elsevier, vol. 73(2).
    20. Jascha-Alexander Koch & Michael Siering, 2019. "The recipe of successful crowdfunding campaigns," Electronic Markets, Springer;IIM University of St. Gallen, vol. 29(4), pages 661-679, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:17:y:2025:i:6:p:2460-:d:1609933. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.