IDEAS home Printed from https://ideas.repec.org/p/ecl/stabus/2060.html
   My bibliography  Save this paper

Detecting Deceptive Discussions in Conference Calls

Author

Listed:
  • Larcker, David F.

    (Stanford University)

  • Zakolyukina, Anastasia A.

    (Stanford University)

Abstract

We estimate classification models of deceptive discussions during quarterly earnings conference calls. Using data on subsequent financial restatements (and a set of criteria to identify especially serious accounting problems), we label the Question and Answer section of each call as \truthful" or \deceptive". Our models are developed with the word categories that have been shown by previous psychological and linguistic research to be related to deception. Using conservative statistical tests, we find that the out- of-sample performance of the models that are based on CEO or CFO narratives is significantly better than random by 4%- 6% (with 50% - 65% accuracy) and provides a significant improvement to a model based on discretionary accruals and traditional controls. We find that answers of deceptive executives have more references to general knowledge, fewer non-extreme positive emotions, and fewer references to shareholders value and value creation. In addition, deceptive CEOs use significantly fewer self- references, more third person plural and impersonal pronouns, more extreme positive emotions, fewer extreme negative emotions, and fewer certainty and hesitation words.

Suggested Citation

  • Larcker, David F. & Zakolyukina, Anastasia A., 2010. "Detecting Deceptive Discussions in Conference Calls," Research Papers 2060, Stanford University, Graduate School of Business.
  • Handle: RePEc:ecl:stabus:2060
    as

    Download full text from publisher

    File URL: http://gsbapps.stanford.edu/researchpapers/library/RP2060%20&%2083.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Tim Loughran & Bill McDonald & Hayong Yun, 2009. "A Wolf in Sheep’s Clothing: The Use of Ethics-Related Terms in 10-K Reports," Journal of Business Ethics, Springer, vol. 89(1), pages 39-49, May.
    2. Sanjiv R. Das & Mike Y. Chen, 2007. "Yahoo! for Amazon: Sentiment Extraction from Small Talk on the Web," Management Science, INFORMS, vol. 53(9), pages 1375-1388, September.
    3. Keith L. Jones & Gopal V. Krishnan & Kevin D. Melendrez, 2008. "Do Models of Discretionary Accruals Detect Actual Cases of Fraudulent and Restated Earnings? An Empirical Analysis," Contemporary Accounting Research, John Wiley & Sons, vol. 25(2), pages 499-531, June.
    4. Thompson, Samuel B., 2011. "Simple formulas for standard errors that cluster by both firm and time," Journal of Financial Economics, Elsevier, vol. 99(1), pages 1-10, January.
    5. Richardson, Scott A. & Sloan, Richard G. & Soliman, Mark T. & Tuna, Irem, 2005. "Accrual reliability, earnings persistence and stock prices," Journal of Accounting and Economics, Elsevier, vol. 39(3), pages 437-485, September.
    6. Mitchell A. Petersen, 2009. "Estimating Standard Errors in Finance Panel Data Sets: Comparing Approaches," Review of Financial Studies, Society for Financial Studies, vol. 22(1), pages 435-480, January.
    7. Carhart, Mark M, 1997. "On Persistence in Mutual Fund Performance," Journal of Finance, American Finance Association, vol. 52(1), pages 57-82, March.
    8. Elizabeth Demers & Clara Vega, 2008. "Soft information in earnings announcements: news or noise?," International Finance Discussion Papers 951, Board of Governors of the Federal Reserve System (U.S.).
    9. Jones, Jj, 1991. "Earnings Management During Import Relief Investigations," Journal of Accounting Research, Wiley Blackwell, vol. 29(2), pages 193-228.
    10. Li, Feng, 2008. "Annual report readability, current earnings, and earnings persistence," Journal of Accounting and Economics, Elsevier, vol. 45(2-3), pages 221-247, August.
    11. Kothari, S.P. & Leone, Andrew J. & Wasley, Charles E., 2005. "Performance matched discretionary accrual measures," Journal of Accounting and Economics, Elsevier, vol. 39(1), pages 163-197, February.
    12. Paul C. Tetlock & Maytal Saar‐Tsechansky & Sofus Macskassy, 2008. "More Than Words: Quantifying Language to Measure Firms' Fundamentals," Journal of Finance, American Finance Association, vol. 63(3), pages 1437-1467, June.
    13. Feinerer, Ingo & Hornik, Kurt & Meyer, David, 2008. "Text Mining Infrastructure in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 25(i05).
    14. Core, John E. & Guay, Wayne & Larcker, David F., 2008. "The power of the pen and executive compensation," Journal of Financial Economics, Elsevier, vol. 88(1), pages 1-25, April.
    15. Palmrose, Zoe-Vonna & Richardson, Vernon J. & Scholz, Susan, 2004. "Determinants of market reactions to restatement announcements," Journal of Accounting and Economics, Elsevier, vol. 37(1), pages 59-89, February.
    16. Paul Hribar & Daniel W. Collins, 2002. "Errors in Estimating Accruals: Implications for Empirical Research," Journal of Accounting Research, Wiley Blackwell, vol. 40(1), pages 105-134, March.
    17. Jessen L. Hobson & William J. Mayew & Mohan Venkatachalam, 2012. "Analyzing Speech to Detect Financial Misreporting," Journal of Accounting Research, Wiley Blackwell, vol. 50(2), pages 349-392, May.
    18. Fama, Eugene F. & French, Kenneth R., 1993. "Common risk factors in the returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 33(1), pages 3-56, February.
    19. Paul C. Tetlock, 2007. "Giving Content to Investor Sentiment: The Role of Media in the Stock Market," Journal of Finance, American Finance Association, vol. 62(3), pages 1139-1168, June.
    20. Werner Antweiler & Murray Z. Frank, 2004. "Is All That Talk Just Noise? The Information Content of Internet Stock Message Boards," Journal of Finance, American Finance Association, vol. 59(3), pages 1259-1294, June.
    21. Patricia M. Dechow & Weili Ge & Chad R. Larson & Richard G. Sloan, 2011. "Predicting Material Accounting Misstatements," Contemporary Accounting Research, John Wiley & Sons, vol. 28(1), pages 17-82, March.
    22. Christopher S. Armstrong & Alan D. Jagolinzer & David F. Larcker, 2010. "Chief Executive Officer Equity Incentives and Accounting Irregularities," Journal of Accounting Research, Wiley Blackwell, vol. 48(2), pages 225-271, May.
    23. McNichols, Maureen F., 2000. "Research design issues in earnings management studies," Journal of Accounting and Public Policy, Elsevier, vol. 19(4-5), pages 313-345.
    24. Daines, Robert M. & Gow, Ian D. & Larcker, David F., 2010. "Rating the ratings: How good are commercial governance ratings?," Journal of Financial Economics, Elsevier, vol. 98(3), pages 439-461, December.
    25. Tim Loughran & Bill Mcdonald, 2011. "When Is a Liability Not a Liability? Textual Analysis, Dictionaries, and 10‐Ks," Journal of Finance, American Finance Association, vol. 66(1), pages 35-65, February.
    26. Feng Li, 2010. "The Information Content of Forward‐Looking Statements in Corporate Filings—A Naïve Bayesian Machine Learning Approach," Journal of Accounting Research, Wiley Blackwell, vol. 48(5), pages 1049-1102, December.
    27. Balakrishnan, Ramji & Qiu, Xin Ying & Srinivasan, Padmini, 2010. "On the predictive ability of narrative disclosures in annual reports," European Journal of Operational Research, Elsevier, vol. 202(3), pages 789-801, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ingrid E. Fisher & Margaret R. Garnsey & Mark E. Hughes, 2016. "Natural Language Processing in Accounting, Auditing and Finance: A Synthesis of the Literature with a Roadmap for Future Research," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 23(3), pages 157-214, July.
    2. Dechow, Patricia & Ge, Weili & Schrand, Catherine, 2010. "Understanding earnings quality: A review of the proxies, their determinants and their consequences," Journal of Accounting and Economics, Elsevier, vol. 50(2-3), pages 344-401, December.
    3. James P. Ryans, 2021. "Textual classification of SEC comment letters," Review of Accounting Studies, Springer, vol. 26(1), pages 37-80, March.
    4. Ahmad, Khurshid & Han, JingGuang & Hutson, Elaine & Kearney, Colm & Liu, Sha, 2016. "Media-expressed negative tone and firm-level stock returns," Journal of Corporate Finance, Elsevier, vol. 37(C), pages 152-172.
    5. Vegard Høghaug Larsen & Leif Anders Thorsrud, 2022. "Asset returns, news topics, and media effects," Scandinavian Journal of Economics, Wiley Blackwell, vol. 124(3), pages 838-868, July.
    6. Jacob Boudoukh & Ronen Feldman & Shimon Kogan & Matthew Richardson, 2013. "Which News Moves Stock Prices? A Textual Analysis," NBER Working Papers 18725, National Bureau of Economic Research, Inc.
    7. Kearney, Colm & Liu, Sha, 2014. "Textual sentiment in finance: A survey of methods and models," International Review of Financial Analysis, Elsevier, vol. 33(C), pages 171-185.
    8. Wanli Li & Tiantian Yan & Yue Li & Ziqiao Yan, 2023. "Earnings management and CSR report tone: Evidence from China," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 30(4), pages 1883-1902, July.
    9. Frankel, Richard & Jennings, Jared & Lee, Joshua, 2016. "Using unstructured and qualitative disclosures to explain accruals," Journal of Accounting and Economics, Elsevier, vol. 62(2), pages 209-227.
    10. Karapandza, Rasa, 2016. "Stock returns and future tense language in 10-K reports," Journal of Banking & Finance, Elsevier, vol. 71(C), pages 50-61.
    11. Buehlmaier, Matthias M. M. & Zechner, Josef, 2016. "Financial media, price discovery, and merger arbitrage," CFS Working Paper Series 551, Center for Financial Studies (CFS).
    12. Li, Ken, 2022. "Textual fundamentals in earnings press releases," Advances in accounting, Elsevier, vol. 57(C).
    13. Kothari, Pratik & Chance, Don M. & Ferris, Stephen P., 2021. "Bragging rights: Does corporate boasting imply value creation?," Journal of Corporate Finance, Elsevier, vol. 67(C).
    14. Tim Loughran & Bill Mcdonald, 2016. "Textual Analysis in Accounting and Finance: A Survey," Journal of Accounting Research, Wiley Blackwell, vol. 54(4), pages 1187-1230, September.
    15. Blau, Benjamin M. & DeLisle, Jared R. & Price, S. McKay, 2015. "Do sophisticated investors interpret earnings conference call tone differently than investors at large? Evidence from short sales," Journal of Corporate Finance, Elsevier, vol. 31(C), pages 203-219.
    16. Daniele Ballinari & Simon Behrendt, 2021. "How to gauge investor behavior? A comparison of online investor sentiment measures," Digital Finance, Springer, vol. 3(2), pages 169-204, June.
    17. Kelvin K. F. Law & Lillian F. Mills, 2015. "Taxes and Financial Constraints: Evidence from Linguistic Cues," Journal of Accounting Research, Wiley Blackwell, vol. 53(4), pages 777-819, September.
    18. Harris, David G. & Shi, Linna & Xie, Hong, 2018. "Does benchmark-beating detect earnings management? Evidence from accounting irregularities," Advances in accounting, Elsevier, vol. 41(C), pages 25-45.
    19. Wisniewski, Tomasz Piotr & Yekini, Liafisu Sina, 2014. "Predicting Stock Market Returns Based on the Content of Annual Report Narrative: A New Anomaly," MPRA Paper 58107, University Library of Munich, Germany.
    20. Gu, Chen & Kurov, Alexander, 2020. "Informational role of social media: Evidence from Twitter sentiment," Journal of Banking & Finance, Elsevier, vol. 121(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ecl:stabus:2060. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/gsstaus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.