IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/20325.html
   My bibliography  Save this paper

Finite Population Causal Standard Errors

Author

Listed:
  • Alberto Abadie
  • Susan Athey
  • Guido W. Imbens
  • Jeffrey M. Wooldridge

Abstract

When a researcher estimates the parameters of a regression function using information on all 50 states in the United States, or information on all visits to a website, what is the interpretation of the standard errors? Researchers typically report standard errors that are designed to capture sampling variation, based on viewing the data as a random sample drawn from a large population of interest, even in applications where it is difficult to articulate what that population of interest is and how it differs from the sample. In this paper we explore alternative interpretations for the uncertainty associated with regression estimates. As a leading example we focus on the case where some parameters of the regression function are intended to capture causal effects. We derive standard errors for causal effects using a generalization of randomization inference. Intuitively, these standard errors capture the fact that even if we observe outcomes for all units in the population of interest, there are for each unit missing potential outcomes for the treatment levels the unit was not exposed to. We show that our randomization-based standard errors in general are smaller than the conventional robust standard errors, and provide conditions under which they agree with them. More generally, correct statistical inference requires precise characterizations of the population of interest, the parameters that we aim to estimate within such population, and the sampling process. Estimation of causal parameters is one example where appropriate inferential methods may differ from conventional practice, but there are others.

Suggested Citation

  • Alberto Abadie & Susan Athey & Guido W. Imbens & Jeffrey M. Wooldridge, 2014. "Finite Population Causal Standard Errors," NBER Working Papers 20325, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:20325
    Note: IO LS PE
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w20325.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Davidson, James, 1994. "Stochastic Limit Theory: An Introduction for Econometricians," OUP Catalogue, Oxford University Press, number 9780198774037, Decembrie.
    2. White, Halbert, 1982. "Maximum Likelihood Estimation of Misspecified Models," Econometrica, Econometric Society, vol. 50(1), pages 1-25, January.
    3. White, Halbert, 1980. "A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity," Econometrica, Econometric Society, vol. 48(4), pages 817-838, May.
    4. Guido W. Imbens & Paul R. Rosenbaum, 2005. "Robust, accurate confidence intervals with a weak instrument: quarter of birth and education," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 168(1), pages 109-126, January.
    5. White, Halbert, 1983. "Corrigendum [Maximum Likelihood Estimation of Misspecified Models]," Econometrica, Econometric Society, vol. 51(2), pages 513-513, March.
    6. W. G. Cochran, 1969. "The Use of Covariance in Observational Studies," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 18(3), pages 270-275, November.
    7. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    8. Abadie, Alberto & Diamond, Alexis & Hainmueller, Jens, 2010. "Synthetic Control Methods for Comparative Case Studies: Estimating the Effect of California’s Tobacco Control Program," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 493-505.
    9. repec:mpr:mprres:6573 is not listed on IDEAS
    10. Samii, Cyrus & Aronow, Peter M., 2012. "On equivalencies between design-based and regression-based variance estimators for randomized experiments," Statistics & Probability Letters, Elsevier, vol. 82(2), pages 365-370.
    11. Peter Z. Schochet, "undated". "Is Regression Adjustment Supported by the Neyman Model for Causal Inference? (Presentation)," Mathematica Policy Research Reports abfc39d59c714499b2fe42f68, Mathematica Policy Research.
    12. Peter Z. Schochet, "undated". "Is Regression Adjustment Supported By the Neyman Model for Causal Inference?," Mathematica Policy Research Reports 782da2242fba458eb61752f96, Mathematica Policy Research.
    13. Thomas Barrios & Rebecca Diamond & Guido W. Imbens & Michal Kolesár, 2012. "Clustering, Spatial Correlations, and Randomization Inference," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(498), pages 578-591, June.
    14. Chow, Gregory C., 1984. "Maximum-likelihood estimation of misspecified models," Economic Modelling, Elsevier, vol. 1(2), pages 134-138, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alberto Abadie & Susan Athey & Guido W. Imbens & Jeffrey M. Wooldridge, 2017. "Sampling-based vs. Design-based Uncertainty in Regression Analysis," Papers 1706.01778, arXiv.org, revised Jun 2019.
    2. James Davidson & Andreea G. Halunga, 2013. "Consistent Model Specification Testing," Discussion Papers 1312, University of Exeter, Department of Economics.
    3. Susan Athey & Guido Imbens, 2016. "The Econometrics of Randomized Experiments," Papers 1607.00698, arXiv.org.
    4. Alberto Abadie & Susan Athey & Guido W. Imbens & Jeffrey M. Wooldridge, 2020. "Sampling‐Based versus Design‐Based Uncertainty in Regression Analysis," Econometrica, Econometric Society, vol. 88(1), pages 265-296, January.
    5. Gregory, Allan W. & McCurdy, Thomas H., 1986. "The unbiasedness hypothesis in the forward foreign exchange market: A specification analysis with application to France, Italy, Japan, the United Kingdom and West Germany," European Economic Review, Elsevier, vol. 30(2), pages 365-381, April.
    6. Reischmann, Markus, 2016. "Creative accounting and electoral motives: Evidence from OECD countries," Journal of Comparative Economics, Elsevier, vol. 44(2), pages 243-257.
    7. Towfiqul Islam Khan & Mashfique Ibne Akbar, 2015. "Illicit Financial Flow in view of Financing the Post-2015 Development Agenda," Southern Voice Occasional Paper 25, Southern Voice.
    8. Potrafke, Niklas, 2019. "Electoral cycles in perceived corruption: International empirical evidence," Journal of Comparative Economics, Elsevier, vol. 47(1), pages 215-224.
    9. Hendrik Thiel & Stephan L. Thomsen, 2015. "Individual Poverty Paths and the Stability of Control-Perception," SOEPpapers on Multidisciplinary Panel Data Research 794, DIW Berlin, The German Socio-Economic Panel (SOEP).
    10. Joachim Zietz, 2006. "Detecting neglected parameter heterogeneity with Chow tests," Applied Economics Letters, Taylor & Francis Journals, vol. 13(6), pages 369-374.
    11. McDonald, John, 2009. "Using least squares and tobit in second stage DEA efficiency analyses," European Journal of Operational Research, Elsevier, vol. 197(2), pages 792-798, September.
    12. Olivier Rubel & Prasad A. Naik, 2017. "Robust Dynamic Estimation," Marketing Science, INFORMS, vol. 36(3), pages 453-467, May.
    13. Crespí-Cladera, Rafel & Pascual-Fuster, Bartolomé, 2014. "Does the independence of independent directors matter?," Journal of Corporate Finance, Elsevier, vol. 28(C), pages 116-134.
    14. Kai Barron & Charles D. H. Parry & Debbie Bradshaw & Rob Dorrington & Pam Groenewald & Ria Laubscher & Richard Matzopoulos, 2024. "Alcohol, Violence, and Injury-Induced Mortality: Evidence from a Modern-Day Prohibition," The Review of Economics and Statistics, MIT Press, vol. 106(4), pages 938-955, July.
    15. Christopher Winship & Larry Radbill, 1994. "Sampling Weights and Regression Analysis," Sociological Methods & Research, , vol. 23(2), pages 230-257, November.
    16. Hansen, Bruce E. & Lee, Seojeong, 2019. "Asymptotic theory for clustered samples," Journal of Econometrics, Elsevier, vol. 210(2), pages 268-290.
    17. Susanne M. Schennach & Daniel Wilhelm, 2017. "A Simple Parametric Model Selection Test," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(520), pages 1663-1674, October.
    18. Gouriéroux, Christian, 1994. "Modèles économétriques : utilisation et interprétation (les)," CEPREMAP Working Papers (Couverture Orange) 9423, CEPREMAP.
    19. White, Halbert & Pettenuzzo, Davide, 2014. "Granger causality, exogeneity, cointegration, and economic policy analysis," Journal of Econometrics, Elsevier, vol. 178(P2), pages 316-330.
    20. Domac, Ilker & Martinez Peria, Maria Soledad, 2003. "Banking crises and exchange rate regimes: is there a link?," Journal of International Economics, Elsevier, vol. 61(1), pages 41-72, October.

    More about this item

    JEL classification:

    • C01 - Mathematical and Quantitative Methods - - General - - - Econometrics
    • C18 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Methodolical Issues: General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:20325. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.