IDEAS home Printed from https://ideas.repec.org/a/bla/joares/v54y2016i2p341-395.html
   My bibliography  Save this article

Gathering Data for Archival, Field, Survey, and Experimental Accounting Research

Author

Listed:
  • ROBERT BLOOMFIELD
  • MARK W. NELSON
  • EUGENE SOLTES

Abstract

In the published proceedings of the first Journal of Accounting Research Conference, Vatter [1966] lamented that “Gathering direct and original facts is a tedious and difficult task, and it is not surprising that such work is avoided.” For the fiftieth JAR Conference, we introduce a framework to help researchers understand the complementary value of seven empirical methods that gather data in different ways: prestructured archives, unstructured (“hand‐collected”) archives, field studies, field experiments, surveys, laboratory studies, and laboratory experiments. The framework spells out five goals of an empirical literature and defines the seven methods according to researchers’ choices with respect to five data gathering tasks. We use the framework and examples of successful research studies in the financial reporting literature to clarify how data gathering choices affect a study's ability to achieve its goals, and conclude by showing how the complementary nature of different methods allows researchers to build a literature more effectively than they could with less diverse approaches to gathering data.

Suggested Citation

  • Robert Bloomfield & Mark W. Nelson & Eugene Soltes, 2016. "Gathering Data for Archival, Field, Survey, and Experimental Accounting Research," Journal of Accounting Research, Wiley Blackwell, vol. 54(2), pages 341-395, May.
  • Handle: RePEc:bla:joares:v:54:y:2016:i:2:p:341-395
    DOI: 10.1111/1475-679X.12104
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/1475-679X.12104
    Download Restriction: no

    File URL: https://libkey.io/10.1111/1475-679X.12104?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. David F. Larcker & Anastasia A. Zakolyukina, 2012. "Detecting Deceptive Discussions in Conference Calls," Journal of Accounting Research, Wiley Blackwell, vol. 50(2), pages 495-540, May.
    2. Dechow, Patricia & Ge, Weili & Schrand, Catherine, 2010. "Understanding earnings quality: A review of the proxies, their determinants and their consequences," Journal of Accounting and Economics, Elsevier, vol. 50(2-3), pages 344-401, December.
    3. Eugene Soltes, 2014. "Private Interaction Between Firm Management and Sell‐Side Analysts," Journal of Accounting Research, Wiley Blackwell, vol. 52(1), pages 245-272, March.
    4. Peter Iliev, 2010. "The Effect of SOX Section 404: Costs, Earnings Quality, and Stock Prices," Journal of Finance, American Finance Association, vol. 65(3), pages 1163-1196, June.
    5. Karthik Balakrishnan & Mary Brooke Billings & Bryan Kelly & Alexander Ljungqvist, 2014. "Shaping Liquidity: On the Causal Effects of Voluntary Disclosure," Journal of Finance, American Finance Association, vol. 69(5), pages 2237-2278, October.
    6. Smith, Vernon L., 2010. "Theory and experiment: What are the questions?," Journal of Economic Behavior & Organization, Elsevier, vol. 73(1), pages 3-15, January.
    7. Fama, Eugene F, 1970. "Efficient Capital Markets: A Review of Theory and Empirical Work," Journal of Finance, American Finance Association, vol. 25(2), pages 383-417, May.
    8. John Van Maanen, 2011. "Ethnography as Work: Some Rules of Engagement," Journal of Management Studies, Wiley Blackwell, vol. 48(1), pages 218-234, January.
    9. Harper, Rm & Mister, Wg & Strawser, Jr, 1987. "The Impact Of New Pension Disclosure Rules On Perceptions Of Debt," Journal of Accounting Research, Wiley Blackwell, vol. 25(2), pages 327-330.
    10. Steven D. Levitt & John A. List, 2011. "Was There Really a Hawthorne Effect at the Hawthorne Plant? An Analysis of the Original Illumination Experiments," American Economic Journal: Applied Economics, American Economic Association, vol. 3(1), pages 224-238, January.
    11. repec:feb:artefa:0110 is not listed on IDEAS
    12. John A. List, 2011. "Why Economists Should Conduct Field Experiments and 14 Tips for Pulling One Off," Journal of Economic Perspectives, American Economic Association, vol. 25(3), pages 3-16, Summer.
    13. Ahrens, Thomas & Chapman, Christopher S., 2006. "Doing qualitative field research in management accounting: Positioning data to contribute to theory," Accounting, Organizations and Society, Elsevier, vol. 31(8), pages 819-841, November.
    14. Marianne Bertrand & Sendhil Mullainathan, 2004. "Are Emily and Greg More Employable Than Lakisha and Jamal? A Field Experiment on Labor Market Discrimination," American Economic Review, American Economic Association, vol. 94(4), pages 991-1013, September.
    15. Angrist, Joshua D. & Krueger, Alan B., 1999. "Empirical strategies in labor economics," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 23, pages 1277-1366, Elsevier.
    16. Marianne Bertrand & Esther Duflo & Sendhil Mullainathan, 2004. "How Much Should We Trust Differences-In-Differences Estimates?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(1), pages 249-275.
    17. Boris Groysberg & Paul M. Healy & David A. Maber, 2011. "What Drives Sell‐Side Analyst Compensation at High‐Status Investment Banks?," Journal of Accounting Research, Wiley Blackwell, vol. 49(4), pages 969-1000, September.
    18. Costello, Anna M., 2013. "Mitigating incentive conflicts in inter-firm relationships: Evidence from long-term supply contracts," Journal of Accounting and Economics, Elsevier, vol. 56(1), pages 19-39.
    19. Vatter, Wj, 1966. "Critical Synthesis Of Conference Papers," Journal of Accounting Research, Wiley Blackwell, vol. 4, pages 228-233.
    20. Smith, Vernon L, 1982. "Microeconomic Systems as an Experimental Science," American Economic Review, American Economic Association, vol. 72(5), pages 923-955, December.
    21. Gow, Ian D. & Larcker, David F. & Reiss, Peter C., 2016. "Causal Inference in Accounting Research," Research Papers 3393, Stanford University, Graduate School of Business.
    22. Jennifer Brown & Tanjim Hossain & John Morgan, 2010. "Shrouded Attributes and Information Suppression: Evidence from the Field," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(2), pages 859-876.
    23. Jones, Jj, 1991. "Earnings Management During Import Relief Investigations," Journal of Accounting Research, Wiley Blackwell, vol. 29(2), pages 193-228.
    24. Jessen L. Hobson & William J. Mayew & Mohan Venkatachalam, 2012. "Analyzing Speech to Detect Financial Misreporting," Journal of Accounting Research, Wiley Blackwell, vol. 50(2), pages 349-392, May.
    25. Paquita Y. Davis†Friday & Chao†Shin Liu & H. Fred Mittelstaedt, 2004. "Recognition and Disclosure Reliability: Evidence from SFAS No. 106," Contemporary Accounting Research, John Wiley & Sons, vol. 21(2), pages 399-429, June.
    26. Abhijit V. Banerjee & Esther Duflo, 2009. "The Experimental Approach to Development Economics," Annual Review of Economics, Annual Reviews, vol. 1(1), pages 151-178, May.
    27. Esther Duflo & Michael Greenstone & Nicholas Ryan, 2013. "Truth-telling by Third-party Auditors and the Response of Polluting Firms: Experimental Evidence from India," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(4), pages 1499-1545.
    28. Gonedes, Nj & Dopuch, N, 1974. "Capital Market Equilibrium, Information Production, And Selecting Accounting Techniques - Theoretical Framework And Review Of Empirical Work," Journal of Accounting Research, Wiley Blackwell, vol. 12, pages 48-169.
    29. Eugene Soltes, 2014. "Incorporating Field Data into Archival Research," Journal of Accounting Research, Wiley Blackwell, vol. 52(2), pages 521-540, May.
    30. Hirst, DE & Hopkins, PE, 1998. "Comprehensive income reporting and analysts' valuation judgments," Journal of Accounting Research, Wiley Blackwell, vol. 36, pages 47-75.
    31. Dichev, Ilia D. & Graham, John R. & Harvey, Campbell R. & Rajgopal, Shiva, 2013. "Earnings quality: Evidence from the field," Journal of Accounting and Economics, Elsevier, vol. 56(2), pages 1-33.
    32. Shana M. Clor‐Proell & Laureen A. Maines, 2014. "The Impact of Recognition Versus Disclosure on Financial Information: A Preparer's Perspective," Journal of Accounting Research, Wiley Blackwell, vol. 52(3), pages 671-701, June.
    33. Ian D. Gow & David F. Larcker & Peter C. Reiss, 2016. "Causal Inference in Accounting Research," Journal of Accounting Research, Wiley Blackwell, vol. 54(2), pages 477-523, May.
    34. Robert Libby & Scott A. Emett, 2014. "Earnings presentation effects on manager reporting choices and investor decisions," Accounting and Business Research, Taylor & Francis Journals, vol. 44(4), pages 410-438, August.
    35. Schwartz-Ziv, Miriam & Weisbach, Michael S., 2013. "What do boards really do? Evidence from minutes of board meetings☆☆Miriam Schwartz-Ziv is from Harvard University and Northeastern University, e-mail: miriam.schwartz@mail.huji.ac.il. Michael S. Weisb," Journal of Financial Economics, Elsevier, vol. 108(2), pages 349-366.
    36. Kristina Rennekamp, 2012. "Processing Fluency and Investors’ Reactions to Disclosure Readability," Journal of Accounting Research, Wiley Blackwell, vol. 50(5), pages 1319-1354, December.
    37. Eric Floyd & John A. List, 2016. "Using Field Experiments in Accounting and Finance," Journal of Accounting Research, Wiley Blackwell, vol. 54(2), pages 437-475, May.
    38. Beyer, Anne & Cohen, Daniel A. & Lys, Thomas Z. & Walther, Beverly R., 2010. "The financial reporting environment: Review of the recent literature," Journal of Accounting and Economics, Elsevier, vol. 50(2-3), pages 296-343, December.
    39. Bloomfield, R & Libby, R, 1996. "Market reactions to differentially available information in the laboratory," Journal of Accounting Research, Wiley Blackwell, vol. 34(2), pages 183-207.
    40. Hong Qu, 2013. "How Do Market Prices and Cheap Talk Affect Coordination?," Journal of Accounting Research, Wiley Blackwell, vol. 51(5), pages 1221-1260, December.
    41. Gerakos, Joseph & Kovrijnykh, Andrei, 2013. "Performance shocks and misreporting," Journal of Accounting and Economics, Elsevier, vol. 56(1), pages 57-72.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Christian Leuz & Peter D. Wysocki, 2016. "The Economics of Disclosure and Financial Reporting Regulation: Evidence and Suggestions for Future Research," Journal of Accounting Research, Wiley Blackwell, vol. 54(2), pages 525-622, May.
    2. Blankespoor, Elizabeth & deHaan, Ed & Marinovic, Iván, 2020. "Disclosure processing costs, investors’ information choice, and equity market outcomes: A review," Journal of Accounting and Economics, Elsevier, vol. 70(2).
    3. Ian D. Gow & David F. Larcker & Peter C. Reiss, 2016. "Causal Inference in Accounting Research," Journal of Accounting Research, Wiley Blackwell, vol. 54(2), pages 477-523, May.
    4. Libby, Robert & Rennekamp, Kristina M. & Seybert, Nicholas, 2015. "Regulation and the interdependent roles of managers, auditors, and directors in earnings management and accounting choice," Accounting, Organizations and Society, Elsevier, vol. 47(C), pages 25-42.
    5. Christian Leuz, 2018. "Evidence-based policymaking: promise, challenges and opportunities for accounting and financial markets research," Accounting and Business Research, Taylor & Francis Journals, vol. 48(5), pages 582-608, July.
    6. Matthew Bamber & Santhosh Abraham, 2020. "On the “Realities” of Investor‐Manager Interactivity: Baudrillard, Hyperreality, and Management Q&A Sessions†," Contemporary Accounting Research, John Wiley & Sons, vol. 37(2), pages 1290-1325, June.
    7. Dichev, Ilia D. & Graham, John R. & Harvey, Campbell R. & Rajgopal, Shiva, 2013. "Earnings quality: Evidence from the field," Journal of Accounting and Economics, Elsevier, vol. 56(2), pages 1-33.
    8. Anastasia A. Zakolyukina, 2018. "How Common Are Intentional GAAP Violations? Estimates from a Dynamic Model," Journal of Accounting Research, Wiley Blackwell, vol. 56(1), pages 5-44, March.
    9. Jung Ho Choi, 2021. "Accrual Accounting and Resource Allocation: A General Equilibrium Analysis," Journal of Accounting Research, Wiley Blackwell, vol. 59(4), pages 1179-1219, September.
    10. Thomas Bourveau & Yun Lou & Rencheng Wang, 2018. "Shareholder Litigation and Corporate Disclosure: Evidence from Derivative Lawsuits," Journal of Accounting Research, Wiley Blackwell, vol. 56(3), pages 797-842, June.
    11. Fargher, Neil & Wee, Marvin, 2019. "The impact of Ball and Brown (1968) on generations of research," Pacific-Basin Finance Journal, Elsevier, vol. 54(C), pages 55-72.
    12. Eric Floyd & John A. List, 2016. "Using Field Experiments in Accounting and Finance," Journal of Accounting Research, Wiley Blackwell, vol. 54(2), pages 437-475, May.
    13. Beattie, Vivien, 2014. "Accounting narratives and the narrative turn in accounting research: Issues, theory, methodology, methods and a research framework," The British Accounting Review, Elsevier, vol. 46(2), pages 111-134.
    14. Emett, Scott A. & Nelson, Mark W., 2017. "Reporting accounting changes and their multi-period effects," Accounting, Organizations and Society, Elsevier, vol. 57(C), pages 52-72.
    15. Hariom Manchiraju & Shivaram Rajgopal, 2017. "Does Corporate Social Responsibility (CSR) Create Shareholder Value? Evidence from the Indian Companies Act 2013," Journal of Accounting Research, Wiley Blackwell, vol. 55(5), pages 1257-1300, December.
    16. Hoberg, Gerard & Lewis, Craig, 2017. "Do fraudulent firms produce abnormal disclosure?," Journal of Corporate Finance, Elsevier, vol. 43(C), pages 58-85.
    17. Miao Liu, 2022. "Assessing Human Information Processing in Lending Decisions: A Machine Learning Approach," Journal of Accounting Research, Wiley Blackwell, vol. 60(2), pages 607-651, May.
    18. S. P. Kothari & Charles Wasley, 2019. "Commemorating the 50‐Year Anniversary of Ball and Brown (1968): The Evolution of Capital Market Research over the Past 50 Years," Journal of Accounting Research, Wiley Blackwell, vol. 57(5), pages 1117-1159, December.
    19. Wei Chen & Paul Hribar & Samuel Melessa, 2018. "Incorrect Inferences When Using Residuals as Dependent Variables," Journal of Accounting Research, Wiley Blackwell, vol. 56(3), pages 751-796, June.
    20. Armstrong, Christopher & Kepler, John D. & Samuels, Delphine & Taylor, Daniel, 2022. "Causality redux: The evolution of empirical methods in accounting research and the growth of quasi-experiments," Journal of Accounting and Economics, Elsevier, vol. 74(2).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:joares:v:54:y:2016:i:2:p:341-395. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0021-8456 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.