IDEAS home Printed from https://ideas.repec.org/p/cdl/ucsdec/qt0ck2109g.html
   My bibliography  Save this paper

A Simple and Trustworthy Asymptotic t Test in Difference-in-Differences Regressions

Author

Listed:
  • Liu, Cheng
  • Sun, Yixiao

Abstract

We propose an asymptotically valid t test that uses Student's t distribution as the reference distribution in a difference-in-differences regression. For the asymptotic variance estimation, we adopt the clustering-by-time approach to accommodate cross-sectional dependence. This approach often assumes the clusters to be independent across time, but we allow them to be temporally dependent. The proposed t test is based on a special heteroscedasticity and autocorrelation robust (HAR) variance estimator. We target the type I and type II errors and develop a testing-oriented method to select the underlying smoothing parameter. By capturing the estimation uncertainty of the HAR variance estimator, the t test has more accurate size than the corresponding normal test and is just as powerful as the latter. Compared to the nonstandard test developed in the literature, the standard t test is just as accurate but much more convenient to use. Model-based and empirical-data-based Monte Carlo simulations show that the t test works quite well in finite samples.

Suggested Citation

  • Liu, Cheng & Sun, Yixiao, 2019. "A Simple and Trustworthy Asymptotic t Test in Difference-in-Differences Regressions," University of California at San Diego, Economics Working Paper Series qt0ck2109g, Department of Economics, UC San Diego.
  • Handle: RePEc:cdl:ucsdec:qt0ck2109g
    as

    Download full text from publisher

    File URL: https://www.escholarship.org/uc/item/0ck2109g.pdf;origin=repeccitec
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Phillips, Peter C.B., 2005. "Hac Estimation By Automated Regression," Econometric Theory, Cambridge University Press, vol. 21(1), pages 116-142, February.
    2. Yixiao Sun, 2013. "A heteroskedasticity and autocorrelation robust F test using an orthonormal series variance estimator," Econometrics Journal, Royal Economic Society, vol. 16(1), pages 1-26, February.
    3. Sun, Yixiao & Phillips, Peter C.B. & Jin, Sainan, 2011. "Power Maximization And Size Control In Heteroskedasticity And Autocorrelation Robust Tests With Exponentiated Kernels," Econometric Theory, Cambridge University Press, vol. 27(6), pages 1320-1368, December.
    4. John C. Driscoll & Aart C. Kraay, 1998. "Consistent Covariance Matrix Estimation With Spatially Dependent Panel Data," The Review of Economics and Statistics, MIT Press, vol. 80(4), pages 549-560, November.
    5. Hwang, Jungbin & Sun, Yixiao, 2017. "Asymptotic F and t tests in an efficient GMM setting," Journal of Econometrics, Elsevier, vol. 198(2), pages 277-295.
    6. Nicholas M. Kiefer & Timothy J. Vogelsang, 2002. "Heteroskedasticity-Autocorrelation Robust Standard Errors Using The Bartlett Kernel Without Truncation," Econometrica, Econometric Society, vol. 70(5), pages 2093-2095, September.
    7. Sun, Yixiao & Kim, Min Seong, 2012. "Simple and powerful GMM over-identification tests with accurate size," Journal of Econometrics, Elsevier, vol. 166(2), pages 267-281.
    8. Sun, Yixiao, 2014. "Let’s fix it: Fixed-b asymptotics versus small-b asymptotics in heteroskedasticity and autocorrelation robust inference," Journal of Econometrics, Elsevier, vol. 178(P3), pages 659-677.
    9. Kiefer, Nicholas M. & Vogelsang, Timothy J., 2005. "A New Asymptotic Theory For Heteroskedasticity-Autocorrelation Robust Tests," Econometric Theory, Cambridge University Press, vol. 21(6), pages 1130-1164, December.
    10. Kiefer, Nicholas M. & Vogelsang, Timothy J., 2002. "Heteroskedasticity-Autocorrelation Robust Testing Using Bandwidth Equal To Sample Size," Econometric Theory, Cambridge University Press, vol. 18(6), pages 1350-1366, December.
    11. Atchadé, Yves F. & Cattaneo, Matias D., 2014. "A martingale decomposition for quadratic forms of Markov chains (with applications)," Stochastic Processes and their Applications, Elsevier, vol. 124(1), pages 646-677.
    12. Yixiao Sun, 2014. "Fixed-smoothing Asymptotics and AsymptoticFandtTests in the Presence of Strong Autocorrelation," Advances in Econometrics, in: Essays in Honor of Peter C. B. Phillips, volume 14, pages 23-63, Emerald Group Publishing Limited.
    13. Marianne Bertrand & Esther Duflo & Sendhil Mullainathan, 2004. "How Much Should We Trust Differences-In-Differences Estimates?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(1), pages 249-275.
    14. Kim, Min Seong & Sun, Yixiao, 2013. "Heteroskedasticity and spatiotemporal dependence robust inference for linear panel models with fixed effects," Journal of Econometrics, Elsevier, vol. 177(1), pages 85-108.
    15. Sun, Yixiao, 2011. "Robust trend inference with series variance estimator and testing-optimal smoothing parameter," Journal of Econometrics, Elsevier, vol. 164(2), pages 345-366, October.
    16. Yixiao Sun & Peter C. B. Phillips & Sainan Jin, 2008. "Optimal Bandwidth Selection in Heteroskedasticity-Autocorrelation Robust Testing," Econometrica, Econometric Society, vol. 76(1), pages 175-194, January.
    17. Andrews, Donald W K, 1991. "Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation," Econometrica, Econometric Society, vol. 59(3), pages 817-858, May.
    18. Yixiao Sun & Min Seong Kim, 2015. "Asymptotic F-Test in a GMM Framework with Cross-Sectional Dependence," The Review of Economics and Statistics, MIT Press, vol. 97(1), pages 210-233, March.
    19. Hansen, Christian B., 2007. "Asymptotic properties of a robust variance matrix estimator for panel data when T is large," Journal of Econometrics, Elsevier, vol. 141(2), pages 597-620, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yixiao Sun & Xuexin Wang, 2019. "An Asymptotically F-Distributed Chow Test in the Presence of Heteroscedasticity and Autocorrelation," Papers 1911.03771, arXiv.org.
    2. Baogui Xin & Yongmei Qu, 2019. "Effects of Smart City Policies on Green Total Factor Productivity: Evidence from a Quasi-Natural Experiment in China," IJERPH, MDPI, vol. 16(13), pages 1-15, July.
    3. Rongrong Shi & Dian Song & Guoqiang Rui & Hainan Wu, 2022. "How the Establishment of the National Civilized City Promotes Urban Green Development: From the Perspective of Administrative Competing Theory—A Quasi Experiment Study in China," IJERPH, MDPI, vol. 19(17), pages 1-18, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Martínez-Iriarte, Julián & Sun, Yixiao & Wang, Xuexin, 2020. "Asymptotic F tests under possibly weak identification," Journal of Econometrics, Elsevier, vol. 218(1), pages 140-177.
    2. Hwang, Jungbin & Sun, Yixiao, 2017. "Asymptotic F and t tests in an efficient GMM setting," Journal of Econometrics, Elsevier, vol. 198(2), pages 277-295.
    3. Xiaoqing Ye & Yixiao Sun, 2018. "Heteroskedasticity- and autocorrelation-robust F and t tests in Stata," Stata Journal, StataCorp LP, vol. 18(4), pages 951-980, December.
    4. Hwang, Jungbin & Sun, Yixiao, 2018. "SIMPLE, ROBUST, AND ACCURATE F AND t TESTS IN COINTEGRATED SYSTEMS," Econometric Theory, Cambridge University Press, vol. 34(5), pages 949-984, October.
    5. Hwang, Jungbin & Sun, Yixiao, 2018. "Should we go one step further? An accurate comparison of one-step and two-step procedures in a generalized method of moments framework," Journal of Econometrics, Elsevier, vol. 207(2), pages 381-405.
    6. Kim, Min Seong & Sun, Yixiao, 2013. "Heteroskedasticity and spatiotemporal dependence robust inference for linear panel models with fixed effects," Journal of Econometrics, Elsevier, vol. 177(1), pages 85-108.
    7. Kim, Min Seong & Sun, Yixiao & Yang, Jingjing, 2017. "A fixed-bandwidth view of the pre-asymptotic inference for kernel smoothing with time series data," Journal of Econometrics, Elsevier, vol. 197(2), pages 298-322.
    8. Casini, Alessandro, 2023. "Theory of evolutionary spectra for heteroskedasticity and autocorrelation robust inference in possibly misspecified and nonstationary models," Journal of Econometrics, Elsevier, vol. 235(2), pages 372-392.
    9. Yixiao Sun & Xuexin Wang, 2019. "An Asymptotically F-Distributed Chow Test in the Presence of Heteroscedasticity and Autocorrelation," Papers 1911.03771, arXiv.org.
    10. Hwang, Jungbin & Valdés, Gonzalo, 2023. "Finite-sample corrected inference for two-step GMM in time series," Journal of Econometrics, Elsevier, vol. 234(1), pages 327-352.
    11. Rho, Seunghwa & Vogelsang, Timothy J., 2021. "Inference in time series models using smoothed-clustered standard errors," Journal of Econometrics, Elsevier, vol. 224(1), pages 113-133.
    12. Sun, Yixiao & Yang, Jingjing, 2020. "Testing-optimal kernel choice in HAR inference," Journal of Econometrics, Elsevier, vol. 219(1), pages 123-136.
    13. Sun, Yixiao, 2013. "Fixed-smoothing Asymptotics in a Two-step GMM Framework," University of California at San Diego, Economics Working Paper Series qt64x4z265, Department of Economics, UC San Diego.
    14. Hwang, Jungbin, 2021. "Simple and trustworthy cluster-robust GMM inference," Journal of Econometrics, Elsevier, vol. 222(2), pages 993-1023.
    15. Hirukawa, Masayuki, 2023. "Robust Covariance Matrix Estimation in Time Series: A Review," Econometrics and Statistics, Elsevier, vol. 27(C), pages 36-61.
    16. Preinerstorfer, David & Pötscher, Benedikt M., 2016. "On Size And Power Of Heteroskedasticity And Autocorrelation Robust Tests," Econometric Theory, Cambridge University Press, vol. 32(2), pages 261-358, April.
    17. Hidalgo, Javier & Schafgans, Marcia, 2021. "Inference without smoothing for large panels with cross-sectional and temporal dependence," Journal of Econometrics, Elsevier, vol. 223(1), pages 125-160.
    18. Sun, Yu & Yan, Karen X., 2019. "Inference on Difference-in-Differences average treatment effects: A fixed-b approach," Journal of Econometrics, Elsevier, vol. 211(2), pages 560-588.
    19. Zhang, Xianyang, 2016. "Fixed-smoothing asymptotics in the generalized empirical likelihood estimation framework," Journal of Econometrics, Elsevier, vol. 193(1), pages 123-146.
    20. Sun, Yixiao & Kim, Min Seong, 2012. "Simple and powerful GMM over-identification tests with accurate size," Journal of Econometrics, Elsevier, vol. 166(2), pages 267-281.

    More about this item

    Keywords

    Social and Behavioral Sciences; Basis Functions; Difference-in-Differences; Fixed-smoothing Asymptotics; Heteroscedasticity and Autocorrelation Robust; Student's t distribution; t test;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C33 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Models with Panel Data; Spatio-temporal Models

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cdl:ucsdec:qt0ck2109g. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Lisa Schiff (email available below). General contact details of provider: https://edirc.repec.org/data/deucsus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.