IDEAS home Printed from https://ideas.repec.org/a/bla/joares/v56y2018i4p1139-1203.html
   My bibliography  Save this article

Inference with Dependent Data in Accounting and Finance Applications

Author

Listed:
  • TIMOTHY CONLEY
  • SILVIA GONÇALVES
  • CHRISTIAN HANSEN

Abstract

We review developments in conducting inference for model parameters in the presence of intertemporal and cross‐sectional dependence with an emphasis on panel data applications. We review the use of heteroskedasticity and autocorrelation consistent (HAC) standard error estimators, which include the standard clustered and multiway clustered estimators, and discuss alternative sample‐splitting inference procedures, such as the Fama–Macbeth procedure, within this context. We outline pros and cons of the different procedures. We then illustrate the properties of the discussed procedures within a simulation experiment designed to mimic the type of firm‐level panel data that might be encountered in accounting and finance applications. Our conclusion, based on theoretical properties and simulation performance, is that sample‐splitting procedures with suitably chosen splits are the most likely to deliver robust inferential statements with approximately correct coverage properties in the types of large, heterogeneous panels many researchers are likely to face.

Suggested Citation

  • Timothy Conley & Silvia Gonçalves & Christian Hansen, 2018. "Inference with Dependent Data in Accounting and Finance Applications," Journal of Accounting Research, Wiley Blackwell, vol. 56(4), pages 1139-1203, September.
  • Handle: RePEc:bla:joares:v:56:y:2018:i:4:p:1139-1203
    DOI: 10.1111/1475-679X.12219
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/1475-679X.12219
    Download Restriction: no

    File URL: https://libkey.io/10.1111/1475-679X.12219?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Levine, David, 1983. "A remark on serial correlation in maximum likelihood," Journal of Econometrics, Elsevier, vol. 23(3), pages 337-342, December.
    2. Guido W. Imbens & Michal Kolesár, 2016. "Robust Standard Errors in Small Samples: Some Practical Advice," The Review of Economics and Statistics, MIT Press, vol. 98(4), pages 701-712, October.
    3. A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2008. "Bootstrap-Based Improvements for Inference with Clustered Errors," The Review of Economics and Statistics, MIT Press, vol. 90(3), pages 414-427, August.
    4. Kiefer, Nicholas M. & Vogelsang, Timothy J., 2005. "A New Asymptotic Theory For Heteroskedasticity-Autocorrelation Robust Tests," Econometric Theory, Cambridge University Press, vol. 21(6), pages 1130-1164, December.
    5. Whitney K. Newey & Kenneth D. West, 1994. "Automatic Lag Selection in Covariance Matrix Estimation," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 61(4), pages 631-653.
    6. A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2011. "Robust Inference With Multiway Clustering," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(2), pages 238-249, April.
    7. Rustam Ibragimov & Ulrich K. Müller, 2016. "Inference with Few Heterogeneous Clusters," The Review of Economics and Statistics, MIT Press, vol. 98(1), pages 83-96, March.
    8. White, Halbert, 1980. "A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity," Econometrica, Econometric Society, vol. 48(4), pages 817-838, May.
    9. Vogelsang, Timothy J., 2012. "Heteroskedasticity, autocorrelation, and spatial correlation robust inference in linear panel models with fixed-effects," Journal of Econometrics, Elsevier, vol. 166(2), pages 303-319.
    10. Inoue, Atsushi & Shintani, Mototsugu, 2006. "Bootstrapping GMM estimators for time series," Journal of Econometrics, Elsevier, vol. 133(2), pages 531-555, August.
    11. Horowitz, J., 1996. "Bootstrap Critical Values For Tests Based On The Smoothed Maximum Score Estimator," SFB 373 Discussion Papers 1996,44, Humboldt University of Berlin, Interdisciplinary Research Project 373: Quantification and Simulation of Economic Processes.
    12. Kelejian, Harry H. & Prucha, Ingmar R., 2007. "HAC estimation in a spatial framework," Journal of Econometrics, Elsevier, vol. 140(1), pages 131-154, September.
    13. Kiefer, Nicholas M. & Vogelsang, Timothy J., 2002. "Heteroskedasticity-Autocorrelation Robust Testing Using Bandwidth Equal To Sample Size," Econometric Theory, Cambridge University Press, vol. 18(6), pages 1350-1366, December.
    14. Arellano, M, 1987. "Computing Robust Standard Errors for Within-Groups Estimators," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 49(4), pages 431-434, November.
    15. Mitchell A. Petersen, 2009. "Estimating Standard Errors in Finance Panel Data Sets: Comparing Approaches," The Review of Financial Studies, Society for Financial Studies, vol. 22(1), pages 435-480, January.
    16. Andrews, Donald W K, 1991. "Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation," Econometrica, Econometric Society, vol. 59(3), pages 817-858, May.
    17. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    18. Bester, C. Alan & Conley, Timothy G. & Hansen, Christian B., 2011. "Inference with dependent data using cluster covariance estimators," Journal of Econometrics, Elsevier, vol. 165(2), pages 137-151.
    19. John C. Driscoll & Aart C. Kraay, 1998. "Consistent Covariance Matrix Estimation With Spatially Dependent Panel Data," The Review of Economics and Statistics, MIT Press, vol. 80(4), pages 549-560, November.
    20. Ivan A. Canay & Joseph P. Romano & Azeem M. Shaikh, 2017. "Randomization Tests Under an Approximate Symmetry Assumption," Econometrica, Econometric Society, vol. 85, pages 1013-1030, May.
    21. Hansen, Christian B., 2007. "Asymptotic properties of a robust variance matrix estimator for panel data when T is large," Journal of Econometrics, Elsevier, vol. 141(2), pages 597-620, December.
    22. Marianne Bertrand & Esther Duflo & Sendhil Mullainathan, 2004. "How Much Should We Trust Differences-In-Differences Estimates?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(1), pages 249-275.
    23. Gonçalves, Sílvia & Vogelsang, Timothy J., 2011. "Block Bootstrap Hac Robust Tests: The Sophistication Of The Naive Bootstrap," Econometric Theory, Cambridge University Press, vol. 27(4), pages 745-791, August.
    24. Gonçalves, Sílvia, 2011. "The Moving Blocks Bootstrap For Panel Linear Regression Models With Individual Fixed Effects," Econometric Theory, Cambridge University Press, vol. 27(5), pages 1048-1082, October.
    25. Conley, T. G., 1999. "GMM estimation with cross sectional dependence," Journal of Econometrics, Elsevier, vol. 92(1), pages 1-45, September.
    26. White, Halbert & Domowitz, Ian, 1984. "Nonlinear Regression with Dependent Observations," Econometrica, Econometric Society, vol. 52(1), pages 143-161, January.
    27. Antoine A. Djogbenou & James G. MacKinnon & Morten Ø. Nielsen, 2017. "Validity Of Wild Bootstrap Inference With Clustered Errors," Working Paper 1383, Economics Department, Queen's University.
    28. Karthik Balakrishnan & John E. Core & Rodrigo S. Verdi, 2014. "The Relation Between Reporting Quality and Financing and Investment: Evidence from Changes in Financing Capacity," Journal of Accounting Research, Wiley Blackwell, vol. 52(1), pages 1-36, March.
    29. Wilhelm, Daniel, 2015. "Optimal Bandwidth Selection For Robust Generalized Method Of Moments Estimation," Econometric Theory, Cambridge University Press, vol. 31(5), pages 1054-1077, October.
    30. Joel L. Horowitz, 1996. "Bootstrap Critical Values for Tests Based on the Smoothed Maximum Score Estimator," Econometrics 9603003, University Library of Munich, Germany.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. MacKinnon, James G. & Nielsen, Morten Ørregaard & Webb, Matthew D., 2023. "Testing for the appropriate level of clustering in linear regression models," Journal of Econometrics, Elsevier, vol. 235(2), pages 2027-2056.
    2. MacKinnon, James G. & Nielsen, Morten Ørregaard & Webb, Matthew D., 2023. "Cluster-robust inference: A guide to empirical practice," Journal of Econometrics, Elsevier, vol. 232(2), pages 272-299.
    3. Jinhwan Kim & Rodrigo S. Verdi & Benjamin P. Yost, 2020. "Do Firms Strategically Internalize Disclosure Spillovers? Evidence from Cash‐Financed M&As," Journal of Accounting Research, Wiley Blackwell, vol. 58(5), pages 1249-1297, December.
    4. James G. MacKinnon & Morten {O}rregaard Nielsen & Matthew D. Webb, 2024. "Cluster-robust jackknife and bootstrap inference for binary response models," Papers 2406.00650, arXiv.org.
    5. Cao, Zhangfan & Chen, Steven Xianglong & Harakeh, Mostafa & Lee, Edward, 2022. "Do non-financial factors influence corporate dividend policies? Evidence from business strategy," International Review of Financial Analysis, Elsevier, vol. 82(C).
    6. Nicholas M. Guest, 2021. "The Information Role of the Media in Earnings News," Journal of Accounting Research, Wiley Blackwell, vol. 59(3), pages 1021-1076, June.
    7. James G. MacKinnon & Morten Ørregaard Nielsen & Matthew D. Webb, 2023. "Fast and reliable jackknife and bootstrap methods for cluster‐robust inference," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(5), pages 671-694, August.
    8. Balakrishnan, Karthik & De George, Emmanuel T. & Ertan, Aytekin & Scobie, Hannah, 2021. "Economic consequences of mandatory auditor reporting to bank regulators," Journal of Accounting and Economics, Elsevier, vol. 72(2).
    9. Darendeli, Alper & Fiechter, Peter & Hitz, Jörg-Markus & Lehmann, Nico, 2022. "The role of corporate social responsibility (CSR) information in supply-chain contracting: Evidence from the expansion of CSR rating coverage," Journal of Accounting and Economics, Elsevier, vol. 74(2).
    10. Dane M. Christensen & Hengda Jin & Suhas A. Sridharan & Laura A. Wellman, 2022. "Hedging on the Hill: Does Political Hedging Reduce Firm Risk?," Management Science, INFORMS, vol. 68(6), pages 4356-4379, June.
    11. Cai Yong & Canay Ivan A. & Kim Deborah & Shaikh Azeem M., 2023. "On the Implementation of Approximate Randomization Tests in Linear Models with a Small Number of Clusters," Journal of Econometric Methods, De Gruyter, vol. 12(1), pages 85-103, January.
    12. Frank S. Zhou & Yuqing Zhou, 2020. "The Dog that Did Not Bark: Limited Price Efficiency and Strategic Nondisclosure," Journal of Accounting Research, Wiley Blackwell, vol. 58(1), pages 155-197, March.
    13. Peter Fiechter & Jörg‐Markus Hitz & Nico Lehmann, 2022. "Real Effects of a Widespread CSR Reporting Mandate: Evidence from the European Union's CSR Directive," Journal of Accounting Research, Wiley Blackwell, vol. 60(4), pages 1499-1549, September.
    14. Michael P. Leung, 2023. "Network Cluster‐Robust Inference," Econometrica, Econometric Society, vol. 91(2), pages 641-667, March.
    15. James G. MacKinnon & Morten Ørregaard Nielsen & Matthew D. Webb, 2023. "Leverage, influence, and the jackknife in clustered regression models: Reliable inference using summclust," Stata Journal, StataCorp LP, vol. 23(4), pages 942-982, December.
    16. Kris Hardies & Sarowar Hossain & Larelle (Ellie) Chapple, 2021. "Archival research on audit partners: assessing the research field and recommendations for future research," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 61(3), pages 4209-4256, September.
    17. Kevin C. W. Chen & Tai‐Yuan Chen & Weifang Han & Hongqi Yuan, 2022. "Auditors Under Fire: The Association Between Audit Errors and the Career Setbacks of Individual Auditors," Journal of Accounting Research, Wiley Blackwell, vol. 60(3), pages 853-900, June.
    18. Abakah, Alex Annan & Kim, Gunchang & Somé, Hyacinthe Yirlier, 2024. "Social networks and start-up funding," Finance Research Letters, Elsevier, vol. 64(C).
    19. Harakeh, Mostafa, 2020. "Dividend policy and corporate investment under information shocks," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 65(C).
    20. Wessel M Badenhorst & Rieka von Well, 2023. "The Value‐relevance of Fair Value Measurement for Inventories," Australian Accounting Review, CPA Australia, vol. 33(2), pages 135-159, June.
    21. Huang, Yin-Siang & Lee, Cheng-Few & Lin, Chih-Yung, 2023. "Applications of fixed effect models to managerial risk-taking incentives," The Quarterly Review of Economics and Finance, Elsevier, vol. 92(C), pages 249-261.
    22. Fiechter, Peter & Landsman, Wayne R. & Peasnell, Kenneth & Renders, Annelies, 2024. "Do industry-specific accounting standards matter for capital allocation decisions?," Journal of Accounting and Economics, Elsevier, vol. 77(2).
    23. Miao Liu, 2022. "Assessing Human Information Processing in Lending Decisions: A Machine Learning Approach," Journal of Accounting Research, Wiley Blackwell, vol. 60(2), pages 607-651, May.
    24. Harakeh, Mostafa & El-Gammal, Walid & Matar, Ghida, 2019. "Female directors, earnings management, and CEO incentive compensation: UK evidence," Research in International Business and Finance, Elsevier, vol. 50(C), pages 153-170.
    25. Raphael Duguay, 2022. "The Economic Consequences of Financial Audit Regulation in the Charitable Sector," Journal of Accounting Research, Wiley Blackwell, vol. 60(4), pages 1463-1498, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kim, Min Seong & Sun, Yixiao, 2013. "Heteroskedasticity and spatiotemporal dependence robust inference for linear panel models with fixed effects," Journal of Econometrics, Elsevier, vol. 177(1), pages 85-108.
    2. Vogelsang, Timothy J., 2012. "Heteroskedasticity, autocorrelation, and spatial correlation robust inference in linear panel models with fixed-effects," Journal of Econometrics, Elsevier, vol. 166(2), pages 303-319.
    3. Hwang, Jungbin, 2021. "Simple and trustworthy cluster-robust GMM inference," Journal of Econometrics, Elsevier, vol. 222(2), pages 993-1023.
    4. Sun, Yu & Yan, Karen X., 2019. "Inference on Difference-in-Differences average treatment effects: A fixed-b approach," Journal of Econometrics, Elsevier, vol. 211(2), pages 560-588.
    5. Hansen, Bruce E. & Lee, Seojeong, 2019. "Asymptotic theory for clustered samples," Journal of Econometrics, Elsevier, vol. 210(2), pages 268-290.
    6. MacKinnon, James G. & Nielsen, Morten Ørregaard & Webb, Matthew D., 2023. "Cluster-robust inference: A guide to empirical practice," Journal of Econometrics, Elsevier, vol. 232(2), pages 272-299.
    7. A. Colin Cameron & Douglas L. Miller, 2010. "Robust Inference with Clustered Data," Working Papers 318, University of California, Davis, Department of Economics.
    8. A. Colin Cameron & Douglas L. Miller, 2010. "Robust Inference with Clustered Data," Working Papers 106, University of California, Davis, Department of Economics.
    9. Christian A. Vossler, 2013. "Analyzing repeated-game economics experiments: robust standard errors for panel data with serial correlation," Chapters, in: John A. List & Michael K. Price (ed.), Handbook on Experimental Economics and the Environment, chapter 3, pages 89-112, Edward Elgar Publishing.
    10. Bai, Jushan & Choi, Sung Hoon & Liao, Yuan, 2024. "Standard errors for panel data models with unknown clusters," Journal of Econometrics, Elsevier, vol. 240(2).
    11. Bruno Ferman, 2023. "Inference in difference‐in‐differences: How much should we trust in independent clusters?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(3), pages 358-369, April.
    12. Hwang, Jungbin & Sun, Yixiao, 2018. "Should we go one step further? An accurate comparison of one-step and two-step procedures in a generalized method of moments framework," Journal of Econometrics, Elsevier, vol. 207(2), pages 381-405.
    13. Kim, Min Seong & Sun, Yixiao, 2011. "Spatial heteroskedasticity and autocorrelation consistent estimation of covariance matrix," Journal of Econometrics, Elsevier, vol. 160(2), pages 349-371, February.
    14. Moscone, F. & Tosetti, Elisa, 2015. "Robust estimation under error cross section dependence," Economics Letters, Elsevier, vol. 133(C), pages 100-104.
    15. Hidalgo, Javier & Schafgans, Marcia, 2021. "Inference without smoothing for large panels with cross-sectional and temporal dependence," Journal of Econometrics, Elsevier, vol. 223(1), pages 125-160.
    16. Kaicheng Chen & Timothy J. Vogelsang, 2023. "Fixed-b Asymptotics for Panel Models with Two-Way Clustering," Papers 2309.08707, arXiv.org, revised Aug 2024.
    17. Hidalgo, Javier & Schafgans, Marcia, 2021. "Inference without smoothing for large panels with cross-sectional and temporal dependence," LSE Research Online Documents on Economics 107426, London School of Economics and Political Science, LSE Library.
    18. James G. MacKinnon & Matthew D. Webb, 2020. "When and How to Deal with Clustered Errors in Regression Models," Working Paper 1421, Economics Department, Queen's University.
    19. Hagemann, Andreas, 2019. "Placebo inference on treatment effects when the number of clusters is small," Journal of Econometrics, Elsevier, vol. 213(1), pages 190-209.
    20. Pakel, Cavit, 2019. "Bias reduction in nonlinear and dynamic panels in the presence of cross-section dependence," Journal of Econometrics, Elsevier, vol. 213(2), pages 459-492.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:joares:v:56:y:2018:i:4:p:1139-1203. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0021-8456 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.