IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2305.17457.html
   My bibliography  Save this paper

Financial misstatement detection: a realistic evaluation

Author

Listed:
  • Elias Zavitsanos
  • Dimitris Mavroeidis
  • Konstantinos Bougiatiotis
  • Eirini Spyropoulou
  • Lefteris Loukas
  • Georgios Paliouras

Abstract

In this work, we examine the evaluation process for the task of detecting financial reports with a high risk of containing a misstatement. This task is often referred to, in the literature, as ``misstatement detection in financial reports''. We provide an extensive review of the related literature. We propose a new, realistic evaluation framework for the task which, unlike a large part of the previous work: (a) focuses on the misstatement class and its rarity, (b) considers the dimension of time when splitting data into training and test and (c) considers the fact that misstatements can take a long time to detect. Most importantly, we show that the evaluation process significantly affects system performance, and we analyze the performance of different models and feature types in the new realistic framework.

Suggested Citation

  • Elias Zavitsanos & Dimitris Mavroeidis & Konstantinos Bougiatiotis & Eirini Spyropoulou & Lefteris Loukas & Georgios Paliouras, 2023. "Financial misstatement detection: a realistic evaluation," Papers 2305.17457, arXiv.org.
    • Handle: RePEc:arx:papers:2305.17457
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2305.17457
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Sunita Goel & Jagdish Gangolly, 2012. "Beyond The Numbers: Mining The Annual Reports For Hidden Cues Indicative Of Financial Statement Fraud," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 19(2), pages 75-89, April.
    2. Lynnette Purda & David Skillicorn, 2015. "Accounting Variables, Deception, and a Bag of Words: Assessing the Tools of Fraud Detection," Contemporary Accounting Research, John Wiley & Sons, vol. 32(3), pages 1193-1223, September.
    3. Alexander Dyck & Adair Morse & Luigi Zingales, 2010. "Who Blows the Whistle on Corporate Fraud?," Journal of Finance, American Finance Association, vol. 65(6), pages 2213-2253, December.
    4. Bethany Hoogs & Thomas Kiehl & Christina Lacomb & Deniz Senturk, 2007. "A genetic algorithm approach to detecting temporal patterns indicative of financial statement fraud," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 15(1‐2), pages 41-56, January.
    5. repec:eme:maj000:02686900810890625 is not listed on IDEAS
    6. Patricia M. Dechow & Weili Ge & Chad R. Larson & Richard G. Sloan, 2011. "Predicting Material Accounting Misstatements," Contemporary Accounting Research, John Wiley & Sons, vol. 28(1), pages 17-82, March.
    7. Mark Cecchini & Haldun Aytug & Gary J. Koehler & Praveen Pathak, 2010. "Detecting Management Fraud in Public Companies," Management Science, INFORMS, vol. 56(7), pages 1146-1160, July.
    8. Belinna Bai & Jerome Yen & Xiaoguang Yang, 2008. "False Financial Statements: Characteristics Of China'S Listed Companies And Cart Detecting Approach," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 7(02), pages 339-359.
    9. Yang Bao & Bin Ke & Bin Li & Y. Julia Yu & Jie Zhang, 2020. "Detecting Accounting Fraud in Publicly Traded U.S. Firms Using a Machine Learning Approach," Journal of Accounting Research, Wiley Blackwell, vol. 58(1), pages 199-235, March.
    10. Ch. Spathis & M. Doumpos & C. Zopounidis, 2002. "Detecting falsified financial statements: a comparative study using multicriteria analysis and multivariate statistical techniques," European Accounting Review, Taylor & Francis Journals, vol. 11(3), pages 509-535.
    11. repec:eme:maj000:02686900410509802 is not listed on IDEAS
    12. Fen-May Liou, 2008. "Fraudulent financial reporting detection and business failure prediction models: a comparison," Managerial Auditing Journal, Emerald Group Publishing, vol. 23(7), pages 650-662, July.
    13. Kathleen A. Kaminski & T. Sterling Wetzel & Liming Guan, 2004. "Can financial ratios detect fraudulent financial reporting?," Managerial Auditing Journal, Emerald Group Publishing Limited, vol. 19(1), pages 15-28, January.
    14. Fen‐May Liou, 2008. "Fraudulent financial reporting detection and business failure prediction models: a comparison," Managerial Auditing Journal, Emerald Group Publishing Limited, vol. 23(7), pages 650-662, July.
    15. Tim Loughran & Bill Mcdonald, 2011. "When Is a Liability Not a Liability? Textual Analysis, Dictionaries, and 10‐Ks," Journal of Finance, American Finance Association, vol. 66(1), pages 35-65, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xin Xu & Feng Xiong & Zhe An, 2023. "Using Machine Learning to Predict Corporate Fraud: Evidence Based on the GONE Framework," Journal of Business Ethics, Springer, vol. 186(1), pages 137-158, August.
    2. Dennis W. Campbell & Ruidi Shang, 2022. "Tone at the Bottom: Measuring Corporate Misconduct Risk from the Text of Employee Reviews," Management Science, INFORMS, vol. 68(9), pages 7034-7053, September.
    3. Joanna Wyrobek & Lukasz Poplawski & Marcin Surowka, 2020. "Identification of a Fraudulent Organizational Culture in Enterprises Listed in Warsaw Stock Exchange," European Research Studies Journal, European Research Studies Journal, vol. 0(Special 2), pages 622-637.
    4. Lukui Huang & Alan Abrahams & Peter Ractham, 2022. "Enhanced financial fraud detection using cost‐sensitive cascade forest with missing value imputation," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 29(3), pages 133-155, July.
    5. Dan Amiram & Zahn Bozanic & James D. Cox & Quentin Dupont & Jonathan M. Karpoff & Richard Sloan, 2018. "Financial reporting fraud and other forms of misconduct: a multidisciplinary review of the literature," Review of Accounting Studies, Springer, vol. 23(2), pages 732-783, June.
    6. Abdullah Albizri & Deniz Appelbaum & Nicholas Rizzotto, 2019. "Evaluation of financial statements fraud detection research: a multi-disciplinary analysis," International Journal of Disclosure and Governance, Palgrave Macmillan, vol. 16(4), pages 206-241, December.
    7. Achakzai, Muhammad Atif Khan & Peng, Juan, 2023. "Detecting financial statement fraud using dynamic ensemble machine learning," International Review of Financial Analysis, Elsevier, vol. 89(C).
    8. Yang Bao & Bin Ke & Bin Li & Y. Julia Yu & Jie Zhang, 2021. "A Response to "Critique of an Article on Machine Learning in the Detection of Accounting Fraud"," Econ Journal Watch, Econ Journal Watch, vol. 18(1), pages 1-71–78, March.
    9. Shi Qiu & Yuansheng Luo & Hongwei Guo, 2021. "Multisource evidence theory‐based fraud risk assessment of China's listed companies," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(8), pages 1524-1539, December.
    10. Li, Jing & Li, Nan & Xia, Tongshui & Guo, Jinjin, 2023. "Textual analysis and detection of financial fraud: Evidence from Chinese manufacturing firms," Economic Modelling, Elsevier, vol. 126(C).
    11. Sunita Goel & Ozlem Uzuner, 2016. "Do Sentiments Matter in Fraud Detection? Estimating Semantic Orientation of Annual Reports," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 23(3), pages 215-239, July.
    12. Rong Liu & Jujun Huang & Zhongju Zhang, 2023. "Tracking disclosure change trajectories for financial fraud detection," Production and Operations Management, Production and Operations Management Society, vol. 32(2), pages 584-602, February.
    13. Craja, Patricia & Kim, Alisa & Lessmann, Stefan, 2020. "Deep Learning application for fraud detection in financial statements," IRTG 1792 Discussion Papers 2020-007, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    14. Adrian Gepp & Kuldeep Kumar & Sukanto Bhattacharya, 2021. "Lifting the numbers game: identifying key input variables and a best‐performing model to detect financial statement fraud," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 61(3), pages 4601-4638, September.
    15. Xiaowei Chen & Cong Zhai, 2023. "Bagging or boosting? Empirical evidence from financial statement fraud detection," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 63(5), pages 5093-5142, December.
    16. Zhang, Chanyuan (Abigail) & Cho, Soohyun & Vasarhelyi, Miklos, 2022. "Explainable Artificial Intelligence (XAI) in auditing," International Journal of Accounting Information Systems, Elsevier, vol. 46(C).
    17. James P. Ryans, 2021. "Textual classification of SEC comment letters," Review of Accounting Studies, Springer, vol. 26(1), pages 37-80, March.
    18. Nerissa C. Brown & Richard M. Crowley & W. Brooke Elliott, 2020. "What Are You Saying? Using topic to Detect Financial Misreporting," Journal of Accounting Research, Wiley Blackwell, vol. 58(1), pages 237-291, March.
    19. Achakzai, Muhammad Atif Khan & Juan, Peng, 2022. "Using machine learning Meta-Classifiers to detect financial frauds," Finance Research Letters, Elsevier, vol. 48(C).
    20. Yasheng Chen & Zhuojun Wu, 2022. "Financial Fraud Detection of Listed Companies in China: A Machine Learning Approach," Sustainability, MDPI, vol. 15(1), pages 1-15, December.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2305.17457. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.