IDEAS home Printed from https://ideas.repec.org/p/bos/wpaper/wp2005-010.html
   My bibliography  Save this paper

Difference in Difference Meets Generalized Least Squares: Higher Order Properties of Hypotheses Tests

Author

Listed:
  • Jerry Hausman

    (MIT, Department of Economics)

  • Guido Kuersteiner

    (Department of Economics, Boston University)

Abstract

We investigate estimation and inference in difference in difference econometric models used in the analysis of treatment effects. When the innovations in such models display serial correlation, commonly used ordinary least squares (OLS) procedures are inefficient and may lead to tests with incorrect size. Implementation of feasible generalized least squares (FGLS) procedures is often hindered by too few observations in the cross section to allow for unrestricted estimation of the weight matrix without leading to tests with similar size distortions as conventional OLS based procedures. We analyze the small sample properties of FGLS based tests with a higher order Edgeworth expansion that allows us to construct a size corrected version of the test. We also address the question of optimal temporal aggregation as a method to reduce the dimension of the weight matrix. We apply our procedure to data on regulation of mobile telephone service prices. We find that a size corrected FGLS based test outperforms tests based on OLS.

Suggested Citation

  • Jerry Hausman & Guido Kuersteiner, 2005. "Difference in Difference Meets Generalized Least Squares: Higher Order Properties of Hypotheses Tests," Boston University - Department of Economics - Working Papers Series WP2005-010, Boston University - Department of Economics.
    • Handle: RePEc:bos:wpaper:wp2005-010
    as

    Download full text from publisher

    To our knowledge, this item is not available for download. To find whether it is available, there are three options:
    1. Check below whether another version of this item is available online.
    2. Check on the provider's web page whether it is in fact available.
    3. Perform a search for a similarly titled item that would be available.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Gabor Kezdi, 2005. "Robus Standard Error Estimation in Fixed-Effects Panel Models," Econometrics 0508018, University Library of Munich, Germany.
    2. Rothenberg, Thomas J, 1988. "Approximate Power Functions for Some Robust Tests of Regression Coefficients," Econometrica, Econometric Society, vol. 56(5), pages 997-1019, September.
    3. Hausman, Jerry, 2015. "Specification tests in econometrics," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 38(2), pages 112-134.
    4. Hansen, Christian B., 2007. "Generalized least squares inference in panel and multilevel models with serial correlation and fixed effects," Journal of Econometrics, Elsevier, vol. 140(2), pages 670-694, October.
    5. Jinyong Hahn & Guido Kuersteiner, 2002. "Asymptotically Unbiased Inference for a Dynamic Panel Model with Fixed Effects when Both "n" and "T" Are Large," Econometrica, Econometric Society, vol. 70(4), pages 1639-1657, July.
    6. Marianne Bertrand & Esther Duflo & Sendhil Mullainathan, 2004. "How Much Should We Trust Differences-In-Differences Estimates?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(1), pages 249-275.
    7. Moulton, Brent R., 1986. "Random group effects and the precision of regression estimates," Journal of Econometrics, Elsevier, vol. 32(3), pages 385-397, August.
    8. Rothernberg, Thomas J, 1984. "Hypothesis Testing in Linear Models When the Error Covariance Matrix Is Nonscalar," Econometrica, Econometric Society, vol. 52(4), pages 827-842, July.
    9. Mundlak, Yair, 1978. "On the Pooling of Time Series and Cross Section Data," Econometrica, Econometric Society, vol. 46(1), pages 69-85, January.
    10. Rothenberg, Thomas J, 1984. "Approximate Normality of Generalized Least Squares Estimates," Econometrica, Econometric Society, vol. 52(4), pages 811-825, July.
    11. Arellano, M, 1987. "Computing Robust Standard Errors for Within-Groups Estimators," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 49(4), pages 431-434, November.
    12. Nickell, Stephen J, 1981. "Biases in Dynamic Models with Fixed Effects," Econometrica, Econometric Society, vol. 49(6), pages 1417-1426, November.
    13. Jinyong Hahn & Jerry Hausman & Guido Kuersteiner, 2005. "Bias Corrected Instrumental Variables Estimation for Dynamic Panel Models with Fixed E¤ects," Boston University - Department of Economics - Working Papers Series WP2005-024, Boston University - Department of Economics.
    14. Kiefer, Nicholas M., 1980. "Estimation of fixed effect models for time series of cross-sections with arbitrary intertemporal covariance," Journal of Econometrics, Elsevier, vol. 14(2), pages 195-202, October.
    15. Magnus, J.R. & Neudecker, H., 1979. "The commutation matrix : Some properties and applications," Other publications TiSEM d0b1e779-7795-4676-ac98-1, Tilburg University, School of Economics and Management.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. A. Colin Cameron & Douglas L. Miller, 2010. "Robust Inference with Clustered Data," Working Papers 318, University of California, Davis, Department of Economics.
    2. Karlsson, Martin & Nilsson, Therese & Pichler, Stefan, 2012. "What Doesn't Kill You Makes You Stronger? The Impact of the 1918 Spanish Flu Epidemic on Economic Performance in Sweden," Working Paper Series 911, Research Institute of Industrial Economics.
    3. Sergio A. Contreras & Andrew J. Greenlee, 2021. "Evaluating the effectiveness of ChileCompra's Entrepreneurship Centers policy," Regional Science Policy & Practice, Wiley Blackwell, vol. 13(4), pages 1262-1282, August.
    4. Sudip Ranjan Basu & Victor Ognivtsev & Miho Shirotori, 2009. "Building Trade-Relating Institutions And Wto Accession," UNCTAD Blue Series Papers 41, United Nations Conference on Trade and Development.
    5. Avi Dor & William Encinosa & Kathleen Carey, 2016. "Do Good Reports Mean Higher Prices? The Impact of Hospital Compare Ratings on Cardiac Pricing," NBER Working Papers 22858, National Bureau of Economic Research, Inc.
    6. Yu, Yantuan & Zhang, Ning, 2021. "Low-carbon city pilot and carbon emission efficiency: Quasi-experimental evidence from China," Energy Economics, Elsevier, vol. 96(C).
    7. repec:fgv:eesptd:411 is not listed on IDEAS
    8. Ben Vollaard, 2005. "Police numbers up, crime rates down. The effect of police on crime in the Netherlands, 1996-2003," Law and Economics 0501006, University Library of Munich, Germany.
    9. Sudip Ranjan Basu, 2008. "Does WTO accession affect domestic economic policies and institutions?," IHEID Working Papers 03-2008, Economics Section, The Graduate Institute of International Studies, revised Feb 2008.
    10. A. Colin Cameron & Douglas L. Miller, 2015. "A Practitioner’s Guide to Cluster-Robust Inference," Journal of Human Resources, University of Wisconsin Press, vol. 50(2), pages 317-372.
    11. Jeffrey M. Wooldridge, 2009. "Difference-in-differences estimation (in Russian)," Quantile, Quantile, issue 6, pages 25-47, March.
    12. A. Colin Cameron & Douglas L. Miller, 2010. "Robust Inference with Clustered Data," Working Papers 107, University of California, Davis, Department of Economics.
    13. Tang, Chang & Xue, Yan & Wu, Haitao & Irfan, Muhammad & Hao, Yu, 2022. "How does telecommunications infrastructure affect eco-efficiency? Evidence from a quasi-natural experiment in China," Technology in Society, Elsevier, vol. 69(C).
    14. Fonseka, Mohan & Richardson, Grant & Shekhar, Chander & Yang, Xing, 2023. "The impact of social trust on loan grants and default risk: Evidence from China’s regional commercial banks during branching policy changes," Economics Letters, Elsevier, vol. 229(C).
    15. Tu, Zhengge & Hu, Tianyang & Shen, Renjun, 2019. "Evaluating public participation impact on environmental protection and ecological efficiency in China: Evidence from PITI disclosure," China Economic Review, Elsevier, vol. 55(C), pages 111-123.
    16. Song, Xueyin & Huang, Xianhai & Qing, Tao, 2021. "Intellectual property rights protection and quality upgrading: Evidence from China," Economic Modelling, Elsevier, vol. 103(C).
    17. Ferraz, Diogo & Ribeiro de Oliveira, Fabíola Cristina, 2018. "Impact of the National Professional Qualification Program (PNQ) on Income: An Econometric Analysis in Piracicaba/SP-Brazil," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 28(2), pages 105-123.
    18. Barli Suryanta & Arianto A. Patunru, 2023. "Determinants of Foreign Direct Investment in Indonesia," Global Journal of Emerging Market Economies, Emerging Markets Forum, vol. 15(1), pages 109-131, January.
    19. Hausman, Jerry & Palmer, Christopher, 2012. "Heteroskedasticity-robust inference in finite samples," Economics Letters, Elsevier, vol. 116(2), pages 232-235.
    20. Ronaldo Carpio & Meixin Guo, 2021. "Bayesian estimation of the Eurozone currency union effect," Review of International Economics, Wiley Blackwell, vol. 29(3), pages 511-532, August.
    21. Yunduan Gao, 2023. "Mechanisms of Forestry Carbon Sink Policies on Land Use Efficiency: A Perspective from the Drivers of Policy Implementation," Land, MDPI, vol. 12(10), pages 1-19, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hansen, Christian B., 2007. "Generalized least squares inference in panel and multilevel models with serial correlation and fixed effects," Journal of Econometrics, Elsevier, vol. 140(2), pages 670-694, October.
    2. Dmitry Arkhangelsky & Guido Imbens, 2023. "Causal Models for Longitudinal and Panel Data: A Survey," Papers 2311.15458, arXiv.org, revised Mar 2024.
    3. A. Colin Cameron & Douglas L. Miller, 2010. "Robust Inference with Clustered Data," Working Papers 318, University of California, Davis, Department of Economics.
    4. Han, Chirok & Phillips, Peter C. B. & Sul, Donggyu, 2014. "X-Differencing And Dynamic Panel Model Estimation," Econometric Theory, Cambridge University Press, vol. 30(1), pages 201-251, February.
    5. Dasgupta,Basab & Lall,Somik V. & Lozano Gracia,Nancy, 2014. "Urbanization and housing investment," Policy Research Working Paper Series 115004, The World Bank.
    6. Alberto Abadie & Susan Athey & Guido W Imbens & Jeffrey M Wooldridge, 2023. "When Should You Adjust Standard Errors for Clustering?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 138(1), pages 1-35.
    7. A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2008. "Bootstrap-Based Improvements for Inference with Clustered Errors," The Review of Economics and Statistics, MIT Press, vol. 90(3), pages 414-427, August.
    8. Inoue, Atsushi & Solon, Gary, 2006. "A Portmanteau Test For Serially Correlated Errors In Fixed Effects Models," Econometric Theory, Cambridge University Press, vol. 22(5), pages 835-851, October.
    9. Mayer, Alexander, 2022. "On the local power of some tests of strict exogeneity in linear fixed effects models," Econometrics and Statistics, Elsevier, vol. 24(C), pages 49-74.
    10. A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2008. "Bootstrap-Based Improvements for Inference with Clustered Errors," The Review of Economics and Statistics, MIT Press, vol. 90(3), pages 414-427, August.
    11. Jungmo Yoon & Antonio F. Galvao, 2020. "Cluster robust covariance matrix estimation in panel quantile regression with individual fixed effects," Quantitative Economics, Econometric Society, vol. 11(2), pages 579-608, May.
    12. Lung‐fei Lee & Jihai Yu, 2012. "Spatial Panels: Random Components Versus Fixed Effects," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 53(4), pages 1369-1412, November.
    13. Aleksey Oshchepkov & Anna Shirokanova, 2020. "Multilevel Modeling For Economists: Why, When And How," HSE Working papers WP BRP 233/EC/2020, National Research University Higher School of Economics.
    14. Massimo Armenise & Giorgia Giovannetti & Gianluca Santoni, 2011. "FDI in Business Services has general TFP effects : evidence from Italy," Working Papers - Economics wp2011_12.rdf, Universita' degli Studi di Firenze, Dipartimento di Scienze per l'Economia e l'Impresa.
    15. Hansen, Christian B., 2007. "Asymptotic properties of a robust variance matrix estimator for panel data when T is large," Journal of Econometrics, Elsevier, vol. 141(2), pages 597-620, December.
    16. James G. MacKinnon & Matthew D. Webb, 2020. "When and How to Deal with Clustered Errors in Regression Models," Working Paper 1421, Economics Department, Queen's University.
    17. Lippi Bruni, Matteo & Mammi, Irene & Ugolini, Cristina, 2016. "Does the extension of primary care practice opening hours reduce the use of emergency services?," Journal of Health Economics, Elsevier, vol. 50(C), pages 144-155.
    18. Sergio A. Contreras & Andrew J. Greenlee, 2021. "Evaluating the effectiveness of ChileCompra's Entrepreneurship Centers policy," Regional Science Policy & Practice, Wiley Blackwell, vol. 13(4), pages 1262-1282, August.
    19. Huy Quang Doan, 2019. "Trade, Institutional Quality and Income: Empirical Evidence for Sub-Saharan Africa," Economies, MDPI, vol. 7(2), pages 1-23, May.
    20. Mitchell A. Petersen, 2009. "Estimating Standard Errors in Finance Panel Data Sets: Comparing Approaches," Review of Financial Studies, Society for Financial Studies, vol. 22(1), pages 435-480, January.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bos:wpaper:wp2005-010. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Program Coordinator (email available below). General contact details of provider: https://edirc.repec.org/data/decbuus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.