IDEAS home Printed from https://ideas.repec.org/a/bla/joares/v58y2020i1p237-291.html
   My bibliography  Save this article

What Are You Saying? Using topic to Detect Financial Misreporting

Author

Listed:
  • NERISSA C. BROWN
  • RICHARD M. CROWLEY
  • W. BROOKE ELLIOTT

Abstract

We use a machine learning technique to assess whether the thematic content of financial statement disclosures (labeled topic) is incrementally informative in predicting intentional misreporting. Using a Bayesian topic modeling algorithm, we determine and empirically quantify the topic content of a large collection of 10‐K narratives spanning 1994 to 2012. We find that the algorithm produces a valid set of semantically meaningful topics that predict financial misreporting, based on samples of Securities and Exchange Commission (SEC) enforcement actions (Accounting and Auditing Enforcement Releases [AAERs]) and irregularities identified from financial restatements and 10‐K filing amendments. Our out‐of‐sample tests indicate that topic significantly improves the detection of financial misreporting by as much as 59% when added to models based on commonly used financial and textual style variables. Furthermore, models that incorporate topic significantly outperform traditional models when detecting serious revenue recognition and core expense errors. Taken together, our results suggest that the topics discussed in annual report filings and the attention devoted to each topic are useful signals in detecting financial misreporting.

Suggested Citation

  • Nerissa C. Brown & Richard M. Crowley & W. Brooke Elliott, 2020. "What Are You Saying? Using topic to Detect Financial Misreporting," Journal of Accounting Research, Wiley Blackwell, vol. 58(1), pages 237-291, March.
    • Handle: RePEc:bla:joares:v:58:y:2020:i:1:p:237-291
    DOI: 10.1111/1475-679X.12294
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/1475-679X.12294
    Download Restriction: no
    File URL: https://libkey.io/10.1111/1475-679X.12294?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. David F. Larcker & Anastasia A. Zakolyukina, 2012. "Detecting Deceptive Discussions in Conference Calls," Journal of Accounting Research, Wiley Blackwell, vol. 50(2), pages 495-540, May.
    2. Yang Bao & Bin Ke & Bin Li & Y. Julia Yu & Jie Zhang, 2020. "Detecting Accounting Fraud in Publicly Traded U.S. Firms Using a Machine Learning Approach," Journal of Accounting Research, Wiley Blackwell, vol. 58(1), pages 199-235, March.
    3. Tim Loughran & Bill Mcdonald, 2016. "Textual Analysis in Accounting and Finance: A Survey," Journal of Accounting Research, Wiley Blackwell, vol. 54(4), pages 1187-1230, September.
    4. Palmrose, Zoe-Vonna & Richardson, Vernon J. & Scholz, Susan, 2004. "Determinants of market reactions to restatement announcements," Journal of Accounting and Economics, Elsevier, vol. 37(1), pages 59-89, February.
    5. Joseph F. Brazel & Keith L. Jones & Mark F. Zimbelman, 2009. "Using Nonfinancial Measures to Assess Fraud Risk," Journal of Accounting Research, Wiley Blackwell, vol. 47(5), pages 1135-1166, December.
    6. Lynnette Purda & David Skillicorn, 2015. "Accounting Variables, Deception, and a Bag of Words: Assessing the Tools of Fraud Detection," Contemporary Accounting Research, John Wiley & Sons, vol. 32(3), pages 1193-1223, September.
    7. Files, Rebecca, 2012. "SEC enforcement: Does forthright disclosure and cooperation really matter?," Journal of Accounting and Economics, Elsevier, vol. 53(1), pages 353-374.
    8. Jessen L. Hobson & William J. Mayew & Mohan Venkatachalam, 2012. "Analyzing Speech to Detect Financial Misreporting," Journal of Accounting Research, Wiley Blackwell, vol. 50(2), pages 349-392, May.
    9. Hoberg, Gerard & Lewis, Craig, 2017. "Do fraudulent firms produce abnormal disclosure?," Journal of Corporate Finance, Elsevier, vol. 43(C), pages 58-85.
    10. Bloomfield, Robert, 2008. "Discussion of "Annual report readability, current earnings, and earnings persistence"," Journal of Accounting and Economics, Elsevier, vol. 45(2-3), pages 248-252, August.
    11. Beneish, Messod D., 1997. "Detecting GAAP violation: implications for assessing earnings management among firms with extreme financial performance," Journal of Accounting and Public Policy, Elsevier, vol. 16(3), pages 271-309.
    12. Kristina Rennekamp, 2012. "Processing Fluency and Investors’ Reactions to Disclosure Readability," Journal of Accounting Research, Wiley Blackwell, vol. 50(5), pages 1319-1354, December.
    13. Dyer, Travis & Lang, Mark & Stice-Lawrence, Lorien, 2017. "The evolution of 10-K textual disclosure: Evidence from Latent Dirichlet Allocation," Journal of Accounting and Economics, Elsevier, vol. 64(2), pages 221-245.
    14. Patricia M. Dechow & Richard G. Sloan & Amy P. Sweeney, 1996. "Causes and Consequences of Earnings Manipulation: An Analysis of Firms Subject to Enforcement Actions by the SEC," Contemporary Accounting Research, John Wiley & Sons, vol. 13(1), pages 1-36, March.
    15. Brian J. Bushee & Ian D. Gow & Daniel J. Taylor, 2018. "Linguistic Complexity in Firm Disclosures: Obfuscation or Information?," Journal of Accounting Research, Wiley Blackwell, vol. 56(1), pages 85-121, March.
    16. Feroz, Eh & Park, K & Pastena, Vs, 1991. "The Financial And Market Effects Of The Secs Accounting And Auditing Enforcement Releases," Journal of Accounting Research, Wiley Blackwell, vol. 29, pages 107-142.
    17. Tim Loughran & Bill Mcdonald, 2011. "When Is a Liability Not a Liability? Textual Analysis, Dictionaries, and 10‐Ks," Journal of Finance, American Finance Association, vol. 66(1), pages 35-65, February.
    18. Li, Feng, 2008. "Annual report readability, current earnings, and earnings persistence," Journal of Accounting and Economics, Elsevier, vol. 45(2-3), pages 221-247, August.
    19. Guay, Wayne & Samuels, Delphine & Taylor, Daniel, 2016. "Guiding through the Fog: Financial statement complexity and voluntary disclosure," Journal of Accounting and Economics, Elsevier, vol. 62(2), pages 234-269.
    20. Doyle, Jeffrey & Ge, Weili & McVay, Sarah, 2007. "Determinants of weaknesses in internal control over financial reporting," Journal of Accounting and Economics, Elsevier, vol. 44(1-2), pages 193-223, September.
    21. Yang Bao & Anindya Datta, 2014. "Simultaneously Discovering and Quantifying Risk Types from Textual Risk Disclosures," Management Science, INFORMS, vol. 60(6), pages 1371-1391, June.
    22. Allen H. Huang & Reuven Lehavy & Amy Y. Zang & Rong Zheng, 2018. "Analyst Information Discovery and Interpretation Roles: A Topic Modeling Approach," Management Science, INFORMS, vol. 64(6), pages 2833-2855, June.
    23. Bozanic, Zahn & Roulstone, Darren T. & Van Buskirk, Andrew, 2018. "Management earnings forecasts and other forward-looking statements," Journal of Accounting and Economics, Elsevier, vol. 65(1), pages 1-20.
    24. Andrew C. Call & Gerald S. Martin & Nathan Y. Sharp & Jaron H. Wilde, 2018. "Whistleblowers and Outcomes of Financial Misrepresentation Enforcement Actions," Journal of Accounting Research, Wiley Blackwell, vol. 56(1), pages 123-171, March.
    25. Kevin M. Quinn & Burt L. Monroe & Michael Colaresi & Michael H. Crespin & Dragomir R. Radev, 2010. "How to Analyze Political Attention with Minimal Assumptions and Costs," American Journal of Political Science, John Wiley & Sons, vol. 54(1), pages 209-228, January.
    26. Anastasia A. Zakolyukina, 2018. "How Common Are Intentional GAAP Violations? Estimates from a Dynamic Model," Journal of Accounting Research, Wiley Blackwell, vol. 56(1), pages 5-44, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Anastassia Fedyk & James Hodson & Natalya Khimich & Tatiana Fedyk, 2022. "Is artificial intelligence improving the audit process?," Review of Accounting Studies, Springer, vol. 27(3), pages 938-985, September.
    2. Ge Zhang & Yuxiang Gao & Gaoyong Li, 2023. "Research on Digital Transformation and Green Technology Innovation—Evidence from China’s Listed Manufacturing Enterprises," Sustainability, MDPI, vol. 15(8), pages 1-23, April.
    3. Achakzai, Muhammad Atif Khan & Peng, Juan, 2023. "Detecting financial statement fraud using dynamic ensemble machine learning," International Review of Financial Analysis, Elsevier, vol. 89(C).
    4. Charles P. Cullinan & Richard Holowczak & David Louton & Hakan Saraoglu, 2023. "Costs associated with exit or disposal activities: A topic modeling investigation of disclosure and market reaction," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 30(4), pages 173-191, October.
    5. Shuili Du & Assaad El Akremi & Ming Jia, 2023. "Quantitative Research on Corporate Social Responsibility: A Quest for Relevance and Rigor in a Quickly Evolving, Turbulent World," Journal of Business Ethics, Springer, vol. 187(1), pages 1-15, September.
    6. Zhao, Shuping & Xu, Kai & Wang, Zhao & Liang, Changyong & Lu, Wenxing & Chen, Bo, 2022. "Financial distress prediction by combining sentiment tone features," Economic Modelling, Elsevier, vol. 106(C).
    7. Chen, Cathy Yi-Hsuan & Fengler, Matthias R. & Härdle, Wolfgang Karl & Liu, Yanchu, 2022. "Media-expressed tone, option characteristics, and stock return predictability," Journal of Economic Dynamics and Control, Elsevier, vol. 134(C).
    8. Fengler, Matthias & Phan, Minh Tri, 2023. "A Topic Model for 10-K Management Disclosures," Economics Working Paper Series 2307, University of St. Gallen, School of Economics and Political Science.
    9. Zhao, Qi & Xu, Weijun & Ji, Yucheng, 2023. "Predicting financial distress of Chinese listed companies using machine learning: To what extent does textual disclosure matter?," International Review of Financial Analysis, Elsevier, vol. 89(C).
    10. So-Jin Yu & Jin-Sung Rha, 2021. "Research Trends in Accounting Fraud Using Network Analysis," Sustainability, MDPI, vol. 13(10), pages 1-26, May.
    11. Xin Xu & Feng Xiong & Zhe An, 2023. "Using Machine Learning to Predict Corporate Fraud: Evidence Based on the GONE Framework," Journal of Business Ethics, Springer, vol. 186(1), pages 137-158, August.
    12. Hoang, Daniel & Wiegratz, Kevin, 2022. "Machine learning methods in finance: Recent applications and prospects," Working Paper Series in Economics 158, Karlsruhe Institute of Technology (KIT), Department of Economics and Management.
    13. Rong Liu & Jujun Huang & Zhongju Zhang, 2023. "Tracking disclosure change trajectories for financial fraud detection," Production and Operations Management, Production and Operations Management Society, vol. 32(2), pages 584-602, February.
    14. Düsterhöft, Maximilian & Schiemann, Frank & Walther, Thomas, 2023. "Let’s talk about risk! Stock market effects of risk disclosure for European energy utilities," Energy Economics, Elsevier, vol. 125(C).
    15. Lukui Huang & Alan Abrahams & Peter Ractham, 2022. "Enhanced financial fraud detection using cost‐sensitive cascade forest with missing value imputation," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 29(3), pages 133-155, July.
    16. Richard Frankel & Jared Jennings & Joshua Lee, 2022. "Disclosure Sentiment: Machine Learning vs. Dictionary Methods," Management Science, INFORMS, vol. 68(7), pages 5514-5532, July.
    17. Hadro Dominika & Patora-Wysocka Zofia & Fijałkowska Justyna & Mróz-Gorgoń Barbara, 2023. "Sustainability and Fast Fashion from the Executive Perspective – the Case of LPP S.A," Journal of Intercultural Management, Sciendo, vol. 15(3), pages 148-178, September.
    18. Senave, Elseline & Jans, Mieke J. & Srivastava, Rajendra P., 2023. "The application of text mining in accounting," International Journal of Accounting Information Systems, Elsevier, vol. 50(C).
    19. Yasheng Chen & Xian Huang & Zhuojun Wu, 2023. "From natural language to accounting entries using a natural language processing method," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 63(4), pages 3781-3795, December.
    20. Gopal V. Krishnan & Emma‐Riikka Myllymäki & Neerav Nagar, 2021. "Does financial reporting quality vary across firm life cycle?," Journal of Business Finance & Accounting, Wiley Blackwell, vol. 48(5-6), pages 954-987, May.
    21. Zhang, Chanyuan (Abigail) & Cho, Soohyun & Vasarhelyi, Miklos, 2022. "Explainable Artificial Intelligence (XAI) in auditing," International Journal of Accounting Information Systems, Elsevier, vol. 46(C).
    22. von Zedlitz, Gerrit, 2023. "Mind the gap?! The current state of biodiversity reporting," SAFE White Paper Series 95, Leibniz Institute for Financial Research SAFE.
    23. Miao Liu, 2022. "Assessing Human Information Processing in Lending Decisions: A Machine Learning Approach," Journal of Accounting Research, Wiley Blackwell, vol. 60(2), pages 607-651, May.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. James P. Ryans, 2021. "Textual classification of SEC comment letters," Review of Accounting Studies, Springer, vol. 26(1), pages 37-80, March.
    2. Blankespoor, Elizabeth & deHaan, Ed & Marinovic, Iván, 2020. "Disclosure processing costs, investors’ information choice, and equity market outcomes: A review," Journal of Accounting and Economics, Elsevier, vol. 70(2).
    3. Senave, Elseline & Jans, Mieke J. & Srivastava, Rajendra P., 2023. "The application of text mining in accounting," International Journal of Accounting Information Systems, Elsevier, vol. 50(C).
    4. Berkin, Anil & Aerts, Walter & Van Caneghem, Tom, 2023. "Feasibility analysis of machine learning for performance-related attributional statements," International Journal of Accounting Information Systems, Elsevier, vol. 48(C).
    5. Dan Amiram & Zahn Bozanic & James D. Cox & Quentin Dupont & Jonathan M. Karpoff & Richard Sloan, 2018. "Financial reporting fraud and other forms of misconduct: a multidisciplinary review of the literature," Review of Accounting Studies, Springer, vol. 23(2), pages 732-783, June.
    6. Laure Batz, 2023. "Financial market enforcement in France," European Journal of Law and Economics, Springer, vol. 55(3), pages 409-468, June.
    7. Richard Frankel & Jared Jennings & Joshua Lee, 2022. "Disclosure Sentiment: Machine Learning vs. Dictionary Methods," Management Science, INFORMS, vol. 68(7), pages 5514-5532, July.
    8. Peter M. Clarkson & Jordan Ponn & Gordon D. Richardson & Frank Rudzicz & Albert Tsang & Jingjing Wang, 2020. "A Textual Analysis of US Corporate Social Responsibility Reports," Abacus, Accounting Foundation, University of Sydney, vol. 56(1), pages 3-34, March.
    9. Umar, Tarik, 2022. "Complexity aversion when SeekingAlpha," Journal of Accounting and Economics, Elsevier, vol. 73(2).
    10. Zvi Singer & Jing Zhang, 2022. "Do companies try to conceal financial misstatements through auditor shopping?," Journal of Business Finance & Accounting, Wiley Blackwell, vol. 49(1-2), pages 140-180, January.
    11. Chychyla, Roman & Leone, Andrew J. & Minutti-Meza, Miguel, 2019. "Complexity of financial reporting standards and accounting expertise," Journal of Accounting and Economics, Elsevier, vol. 67(1), pages 226-253.
    12. Gao, Lei & Calderon, Thomas G. & Tang, Fengchun, 2020. "Public companies' cybersecurity risk disclosures," International Journal of Accounting Information Systems, Elsevier, vol. 38(C).
    13. Pastwa, Anna M. & Shrestha, Prabal & Thewissen, James & Torsin, Wouter, 2021. "Unpacking the black box of ICO white papers: a topic modeling approach," LIDAM Discussion Papers LFIN 2021018, Université catholique de Louvain, Louvain Finance (LFIN).
    14. Tim Loughran & Bill Mcdonald, 2016. "Textual Analysis in Accounting and Finance: A Survey," Journal of Accounting Research, Wiley Blackwell, vol. 54(4), pages 1187-1230, September.
    15. Hills, Robert & Kubic, Matthew & Mayew, William J., 2021. "State sponsors of terrorism disclosure and SEC financial reporting oversight," Journal of Accounting and Economics, Elsevier, vol. 72(1).
    16. Thewissen, James & Shrestha, Prabal & Torsin, Wouter & Pastwa, Anna M., 2022. "Unpacking the black box of ICO white papers: A topic modeling approach," Journal of Corporate Finance, Elsevier, vol. 75(C).
    17. Chantziaras, Antonios & Koulikidou, Kleopatra & Leventis, Stergios, 2021. "The power of words in capital markets: SEC comment letters on foreign issuers and the impact of home country enforcement," Journal of International Accounting, Auditing and Taxation, Elsevier, vol. 42(C).
    18. Abdullah Albizri & Deniz Appelbaum & Nicholas Rizzotto, 2019. "Evaluation of financial statements fraud detection research: a multi-disciplinary analysis," International Journal of Disclosure and Governance, Palgrave Macmillan, vol. 16(4), pages 206-241, December.
    19. Kristian D. Allee & Matthew D. Deangelis & James R. Moon, 2018. "Disclosure “Scriptability”," Journal of Accounting Research, Wiley Blackwell, vol. 56(2), pages 363-430, May.
    20. Fengler, Matthias & Phan, Minh Tri, 2023. "A Topic Model for 10-K Management Disclosures," Economics Working Paper Series 2307, University of St. Gallen, School of Economics and Political Science.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:joares:v:58:y:2020:i:1:p:237-291. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0021-8456 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.