IDEAS home Printed from https://ideas.repec.org/a/spr/reaccs/v26y2021i1d10.1007_s11142-020-09565-6.html
   My bibliography  Save this article

Textual classification of SEC comment letters

Author

Listed:
  • James P. Ryans

    (London Business School)

Abstract

This study examines the impact of SEC comment letters on future financial reporting outcomes and earnings credibility. Naïve Bayesian classification identifies comment letters associated with future restatements and write-downs. An investor attention-based quantitative measure of importance, using EDGAR downloads, also predicts these outcomes. Disclosure-event abnormal returns, revenue recognition comments, and the number of letters in a conversation appear to be useful quantitative metrics for classifying importance in certain settings. This study also documents trends in comment letter topics over time and identifies topics associated with the textual and quantitative classifications of importance, providing insights into the factors that draw investor attention and that relate to future restatements and write-downs. Innocuous comment letters are associated with improvements in earnings credibility following comment letter reviews.

Suggested Citation

  • James P. Ryans, 2021. "Textual classification of SEC comment letters," Review of Accounting Studies, Springer, vol. 26(1), pages 37-80, March.
    • Handle: RePEc:spr:reaccs:v:26:y:2021:i:1:d:10.1007_s11142-020-09565-6
    DOI: 10.1007/s11142-020-09565-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11142-020-09565-6
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11142-020-09565-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. David F. Larcker & Anastasia A. Zakolyukina, 2012. "Detecting Deceptive Discussions in Conference Calls," Journal of Accounting Research, Wiley Blackwell, vol. 50(2), pages 495-540, May.
    2. Francis, Jennifer & LaFond, Ryan & Olsson, Per & Schipper, Katherine, 2005. "The market pricing of accruals quality," Journal of Accounting and Economics, Elsevier, vol. 39(2), pages 295-327, June.
    3. Kormendi, Roger & Lipe, Robert, 1987. "Earnings Innovations, Earnings Persistence, and Stock Returns," The Journal of Business, University of Chicago Press, vol. 60(3), pages 323-345, July.
    4. Miguel Duro & Jonas Heese & Gaizka Ormazabal, 2019. "The effect of enforcement transparency: Evidence from SEC comment-letter reviews," Review of Accounting Studies, Springer, vol. 24(3), pages 780-823, September.
    5. Rafael La Porta & Florencio Lopez‐De‐Silanes & Andrei Shleifer, 2006. "What Works in Securities Laws?," Journal of Finance, American Finance Association, vol. 61(1), pages 1-32, February.
    6. Michael S. Drake & Darren T. Roulstone & Jacob R. Thornock, 2015. "The Determinants and Consequences of Information Acquisition via EDGAR," Contemporary Accounting Research, John Wiley & Sons, vol. 32(3), pages 1128-1161, September.
    7. Dye, Ra, 1985. "Disclosure Of Nonproprietary Information," Journal of Accounting Research, Wiley Blackwell, vol. 23(1), pages 123-145.
    8. Tim Loughran & Bill Mcdonald, 2016. "Textual Analysis in Accounting and Finance: A Survey," Journal of Accounting Research, Wiley Blackwell, vol. 54(4), pages 1187-1230, September.
    9. Alexander Ljungqvist & Wenlan Qian, 2016. "How Constraining Are Limits to Arbitrage?," Review of Financial Studies, Society for Financial Studies, vol. 29(8), pages 1975-2028.
    10. Palmrose, Zoe-Vonna & Richardson, Vernon J. & Scholz, Susan, 2004. "Determinants of market reactions to restatement announcements," Journal of Accounting and Economics, Elsevier, vol. 37(1), pages 59-89, February.
    11. Beaver, Wh, 1968. "Information Content Of Annual Earnings Announcements," Journal of Accounting Research, Wiley Blackwell, vol. 6, pages 67-92.
    12. Bartov, Eli & Givoly, Dan & Hayn, Carla, 2002. "The rewards to meeting or beating earnings expectations," Journal of Accounting and Economics, Elsevier, vol. 33(2), pages 173-204, June.
    13. Jennifer Francis & Dhananjay Nanda & Per Olsson, 2008. "Voluntary Disclosure, Earnings Quality, and Cost of Capital," Journal of Accounting Research, Wiley Blackwell, vol. 46(1), pages 53-99, March.
    14. Jung, Wo & Kwon, Yk, 1988. "Disclosure When The Market Is Unsure Of Information Endowment Of Managers," Journal of Accounting Research, Wiley Blackwell, vol. 26(1), pages 146-153.
    15. Hoberg, Gerard & Lewis, Craig, 2017. "Do fraudulent firms produce abnormal disclosure?," Journal of Corporate Finance, Elsevier, vol. 43(C), pages 58-85.
    16. Tim Loughran & Bill McDonald, 2017. "The Use of EDGAR Filings by Investors," Journal of Behavioral Finance, Taylor & Francis Journals, vol. 18(2), pages 231-248, April.
    17. Ball, R & Brown, P, 1968. "Empirical Evaluation Of Accounting Income Numbers," Journal of Accounting Research, Wiley Blackwell, vol. 6(2), pages 159-178.
    18. Lawrence, Alastair & Sloan, Richard & Sun, Yuan, 2013. "Non-discretionary conservatism: Evidence and implications," Journal of Accounting and Economics, Elsevier, vol. 56(2), pages 112-133.
    19. Paul C. Tetlock, 2007. "Giving Content to Investor Sentiment: The Role of Media in the Stock Market," Journal of Finance, American Finance Association, vol. 62(3), pages 1139-1168, June.
    20. Werner Antweiler & Murray Z. Frank, 2004. "Is All That Talk Just Noise? The Information Content of Internet Stock Message Boards," Journal of Finance, American Finance Association, vol. 59(3), pages 1259-1294, June.
    21. Christensen, Hans B. & Hail, Luzi & Leuz, Christian, 2013. "Mandatory IFRS reporting and changes in enforcement," Journal of Accounting and Economics, Elsevier, vol. 56(2), pages 147-177.
    22. Patricia M. Dechow & Weili Ge & Chad R. Larson & Richard G. Sloan, 2011. "Predicting Material Accounting Misstatements," Contemporary Accounting Research, John Wiley & Sons, vol. 28(1), pages 17-82, March.
    23. Alexander Dyck & Adair Morse & Luigi Zingales, 2010. "Who Blows the Whistle on Corporate Fraud?," Journal of Finance, American Finance Association, vol. 65(6), pages 2213-2253, December.
    24. Heese, Jonas & Khan, Mozaffar & Ramanna, Karthik, 2017. "Is the SEC captured? Evidence from comment-letter reviews," Journal of Accounting and Economics, Elsevier, vol. 64(1), pages 98-122.
    25. Kinney, William Jr. & McDaniel, Linda S., 1989. "Characteristics of firms correcting previously reported quarterly earnings," Journal of Accounting and Economics, Elsevier, vol. 11(1), pages 71-93, February.
    26. Carhart, Mark M, 1997. "On Persistence in Mutual Fund Performance," Journal of Finance, American Finance Association, vol. 52(1), pages 57-82, March.
    27. Lang, M & Lundholm, R, 1993. "Cross-Sectional Determinants Of Analyst Ratings Of Corporate Disclosures," Journal of Accounting Research, Wiley Blackwell, vol. 31(2), pages 246-271.
    28. Collins, Daniel W. & Kothari, S. P., 1989. "An analysis of intertemporal and cross-sectional determinants of earnings response coefficients," Journal of Accounting and Economics, Elsevier, vol. 11(2-3), pages 143-181, July.
    29. Kelvin K. F. Law & Lillian F. Mills, 2015. "Taxes and Financial Constraints: Evidence from Linguistic Cues," Journal of Accounting Research, Wiley Blackwell, vol. 53(4), pages 777-819, September.
    30. Stephen V. Brown & Xiaoli (Shaolee) Tian & Jennifer Wu Tucker, 2018. "The Spillover Effect of SEC Comment Letters on Qualitative Corporate Disclosure: Evidence from the Risk Factor Disclosure," Contemporary Accounting Research, John Wiley & Sons, vol. 35(2), pages 622-656, June.
    31. Dyer, Travis & Lang, Mark & Stice-Lawrence, Lorien, 2017. "The evolution of 10-K textual disclosure: Evidence from Latent Dirichlet Allocation," Journal of Accounting and Economics, Elsevier, vol. 64(2), pages 221-245.
    32. S. P. Kothari & Susan Shu & Peter D. Wysocki, 2009. "Do Managers Withhold Bad News?," Journal of Accounting Research, Wiley Blackwell, vol. 47(1), pages 241-276, March.
    33. Jones Heese & Mozaffar Khan & Karthik Ramanna, 2017. "Is the SEC Captured? Evidence from Comment-Letter Reviews," Harvard Business School Working Papers 17-087, Harvard Business School.
    34. Angela K. Davis & Jeremy M. Piger & Lisa M. Sedor, 2012. "Beyond the Numbers: Measuring the Information Content of Earnings Press Release Language," Contemporary Accounting Research, John Wiley & Sons, vol. 29(3), pages 845-868, September.
    35. Hirshleifer, David & Teoh, Siew Hong, 2003. "Limited attention, information disclosure, and financial reporting," Journal of Accounting and Economics, Elsevier, vol. 36(1-3), pages 337-386, December.
    36. Christian Leuz & Peter D. Wysocki, 2016. "The Economics of Disclosure and Financial Reporting Regulation: Evidence and Suggestions for Future Research," Journal of Accounting Research, Wiley Blackwell, vol. 54(2), pages 525-622, May.
    37. Feroz, Eh & Park, K & Pastena, Vs, 1991. "The Financial And Market Effects Of The Secs Accounting And Auditing Enforcement Releases," Journal of Accounting Research, Wiley Blackwell, vol. 29, pages 107-142.
    38. Joshua Livnat & Richard R. Mendenhall, 2006. "Comparing the Post–Earnings Announcement Drift for Surprises Calculated from Analyst and Time Series Forecasts," Journal of Accounting Research, Wiley Blackwell, vol. 44(1), pages 177-205, March.
    39. Tim Loughran & Bill Mcdonald, 2011. "When Is a Liability Not a Liability? Textual Analysis, Dictionaries, and 10‐Ks," Journal of Finance, American Finance Association, vol. 66(1), pages 35-65, February.
    40. Li, Feng, 2008. "Annual report readability, current earnings, and earnings persistence," Journal of Accounting and Economics, Elsevier, vol. 45(2-3), pages 221-247, August.
    41. Feng Li, 2010. "The Information Content of Forward‐Looking Statements in Corporate Filings—A Naïve Bayesian Machine Learning Approach," Journal of Accounting Research, Wiley Blackwell, vol. 48(5), pages 1049-1102, December.
    42. Yang Bao & Anindya Datta, 2014. "Simultaneously Discovering and Quantifying Risk Types from Textual Risk Disclosures," Management Science, INFORMS, vol. 60(6), pages 1371-1391, June.
    43. Rick Johnston & Reining Petacchi, 2017. "Regulatory Oversight of Financial Reporting: Securities and Exchange Commission Comment Letters," Contemporary Accounting Research, John Wiley & Sons, vol. 34(2), pages 1128-1155, June.
    44. Allen H. Huang & Reuven Lehavy & Amy Y. Zang & Rong Zheng, 2018. "Analyst Information Discovery and Interpretation Roles: A Topic Modeling Approach," Management Science, INFORMS, vol. 64(6), pages 2833-2855, June.
    45. Joseph E. Engelberg & Christopher A. Parsons, 2011. "The Causal Impact of Media in Financial Markets," Journal of Finance, American Finance Association, vol. 66(1), pages 67-97, February.
    46. Eric Talley & Drew O'Kane, 2012. "The Measure of a MAC: A Machine-Learning Protocol for Analyzing Force Majeure Clauses in M&A Agreements," Journal of Institutional and Theoretical Economics (JITE), Mohr Siebeck, Tübingen, vol. 168(1), pages 181-201, March.
    47. Holthausen, Rw & Verrecchia, Re, 1988. "The Effect Of Sequential Information Releases On The Variance Of Price Changes In An Intertemporal Multi-Asset Market," Journal of Accounting Research, Wiley Blackwell, vol. 26(1), pages 82-106.
    48. William R. Kinney & Zoe‐Vonna Palmrose & Susan Scholz, 2004. "Auditor Independence, Non‐Audit Services, and Restatements: Was the U.S. Government Right?," Journal of Accounting Research, Wiley Blackwell, vol. 42(3), pages 561-588, June.
    49. Kevin M. Quinn & Burt L. Monroe & Michael Colaresi & Michael H. Crespin & Dragomir R. Radev, 2010. "How to Analyze Political Attention with Minimal Assumptions and Costs," American Journal of Political Science, John Wiley & Sons, vol. 54(1), pages 209-228, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Koulikidou, Kleopatra & Chantziaras, Antonios & Dedoulis, Emmanouil & Leventis, Stergios, 2023. "Regulatory enforcement, foreignness, and language negativity: Evidence from SEC comment letters," Journal of International Accounting, Auditing and Taxation, Elsevier, vol. 51(C).
    2. Hou, Chenxue & Wang, Qijian, 2023. "CSRC oral communication and corporate disclosure," Journal of Corporate Finance, Elsevier, vol. 79(C).
    3. Li, Ken, 2022. "Textual fundamentals in earnings press releases," Advances in accounting, Elsevier, vol. 57(C).
    4. Lu, Jing & Qiu, Yuhang, 2023. "Does non-punitive regulation diminish stock price crash risk?," Journal of Banking & Finance, Elsevier, vol. 148(C).
    5. Marshall A. Geiger & Bret Johnson & Keith L. Jones & Abdullah Kumas, 2022. "Information Leakage Around SEC Comment Letters," Management Science, INFORMS, vol. 68(11), pages 8449-8463, November.
    6. Bret A. Johnson & Ling Lei Lisic & Joon Seok Moon & Mengmeng Wang, 2023. "SEC comment letters on form S-4 and M&A accounting quality," Review of Accounting Studies, Springer, vol. 28(2), pages 862-909, June.
    7. Han, Mengrui & Ying, Qianwei & Huang, Li, 2023. "Firms’ delayed replies and investor confidence: Evidence from M&A comment letters in China," Finance Research Letters, Elsevier, vol. 56(C).
    8. Yewei Wu & Bofu Zhang, 2023. "Inquiry Letters and Tax Aggressiveness," China & World Economy, Institute of World Economics and Politics, Chinese Academy of Social Sciences, vol. 31(4), pages 37-65, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Blankespoor, Elizabeth & deHaan, Ed & Marinovic, Iván, 2020. "Disclosure processing costs, investors’ information choice, and equity market outcomes: A review," Journal of Accounting and Economics, Elsevier, vol. 70(2).
    2. Dechow, Patricia & Ge, Weili & Schrand, Catherine, 2010. "Understanding earnings quality: A review of the proxies, their determinants and their consequences," Journal of Accounting and Economics, Elsevier, vol. 50(2-3), pages 344-401, December.
    3. Chantziaras, Antonios & Koulikidou, Kleopatra & Leventis, Stergios, 2021. "The power of words in capital markets: SEC comment letters on foreign issuers and the impact of home country enforcement," Journal of International Accounting, Auditing and Taxation, Elsevier, vol. 42(C).
    4. Nerissa C. Brown & Richard M. Crowley & W. Brooke Elliott, 2020. "What Are You Saying? Using topic to Detect Financial Misreporting," Journal of Accounting Research, Wiley Blackwell, vol. 58(1), pages 237-291, March.
    5. Judson Caskey & Kanyuan Huang & Daniel Saavedra, 2023. "Noncompliance with SEC regulations: evidence from timely loan disclosures," Review of Accounting Studies, Springer, vol. 28(1), pages 126-163, March.
    6. Richard Frankel & Jared Jennings & Joshua Lee, 2022. "Disclosure Sentiment: Machine Learning vs. Dictionary Methods," Management Science, INFORMS, vol. 68(7), pages 5514-5532, July.
    7. Koulikidou, Kleopatra & Chantziaras, Antonios & Dedoulis, Emmanouil & Leventis, Stergios, 2023. "Regulatory enforcement, foreignness, and language negativity: Evidence from SEC comment letters," Journal of International Accounting, Auditing and Taxation, Elsevier, vol. 51(C).
    8. Li, Ken, 2022. "Textual fundamentals in earnings press releases," Advances in accounting, Elsevier, vol. 57(C).
    9. Nicholas M. Guest, 2021. "The Information Role of the Media in Earnings News," Journal of Accounting Research, Wiley Blackwell, vol. 59(3), pages 1021-1076, June.
    10. Hills, Robert & Kubic, Matthew & Mayew, William J., 2021. "State sponsors of terrorism disclosure and SEC financial reporting oversight," Journal of Accounting and Economics, Elsevier, vol. 72(1).
    11. Ingrid E. Fisher & Margaret R. Garnsey & Mark E. Hughes, 2016. "Natural Language Processing in Accounting, Auditing and Finance: A Synthesis of the Literature with a Roadmap for Future Research," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 23(3), pages 157-214, July.
    12. Fargher, Neil & Wee, Marvin, 2019. "The impact of Ball and Brown (1968) on generations of research," Pacific-Basin Finance Journal, Elsevier, vol. 54(C), pages 55-72.
    13. Miguel Duro & Jonas Heese & Gaizka Ormazabal, 2019. "The effect of enforcement transparency: Evidence from SEC comment-letter reviews," Review of Accounting Studies, Springer, vol. 24(3), pages 780-823, September.
    14. Ormazabal, Gaizka & Duro, Miguel & Heese, Jonas, 2017. "Does the Public Disclosure of the SEC’s Oversight Actions Matter?," CEPR Discussion Papers 12145, C.E.P.R. Discussion Papers.
    15. Berkin, Anil & Aerts, Walter & Van Caneghem, Tom, 2023. "Feasibility analysis of machine learning for performance-related attributional statements," International Journal of Accounting Information Systems, Elsevier, vol. 48(C).
    16. David F. Larcker & Anastasia A. Zakolyukina, 2012. "Detecting Deceptive Discussions in Conference Calls," Journal of Accounting Research, Wiley Blackwell, vol. 50(2), pages 495-540, May.
    17. Christina Bannier & Thomas Pauls & Andreas Walter, 2019. "Content analysis of business communication: introducing a German dictionary," Journal of Business Economics, Springer, vol. 89(1), pages 79-123, February.
    18. Simon Fritzsch & Philipp Scharner & Gregor Weiß, 2021. "Estimating the relation between digitalization and the market value of insurers," Journal of Risk & Insurance, The American Risk and Insurance Association, vol. 88(3), pages 529-567, September.
    19. Matthew Ege & Jennifer L. Glenn & John R. Robinson, 2020. "Unexpected SEC Resource Constraints and Comment Letter Quality†," Contemporary Accounting Research, John Wiley & Sons, vol. 37(1), pages 33-67, March.
    20. Crawley, Michael & Wahlen, James, 2014. "Analytics in empirical/archival financial accounting research," Business Horizons, Elsevier, vol. 57(5), pages 583-593.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:reaccs:v:26:y:2021:i:1:d:10.1007_s11142-020-09565-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.