This file is part of IDEAS, which uses RePEc data


[ Papers | Articles | Software | Books | Chapters | Authors | Institutions | JEL Classification | NEP reports | Search | New papers by email | Author registration | Rankings | Volunteers | FAQ | Blog | Help! ]

Moving the Goalposts: Addressing Limited Overlap in Estimation of Average Treatment Effects by Changing the Estimand

Author info | Abstract | Publisher info | Download info | Related research | Statistics
Author Info
Richard K. Crump (University of California at Berkeley)
V. Joseph Hotz (University of California at Los Angeles)
Guido W. Imbens (University of California at Berkeley)
Oscar A. Mitnik () (Department of Economics, University of Miami)

Additional information is available for the following registered author(s):

Abstract

Estimation of average treatment effects under unconfoundedness or exogenous treatment assignment is often hampered by lack of overlap in the covariate distributions. This lack of overlap can lead to imprecise estimates and can make commonly used estimators sensitive to the choice of specification. In such cases researchers have often used informal methods for trimming the sample. In this paper we develop a systematic approach to addressing such lack of overlap. We characterize optimal subsamples for which the average treatment effect can be estimated most precisely, as well as optimally weighted average treatment effects. Under some conditions the optimal selection rules depend solely on the propensity score. For a wide range of distributions a good approximation to the optimal rule is provided by the simple selection rule to drop all units with estimated propensity scores outside the range [0.1, 0.9].

Download Info
To download:

If you experience problems downloading a file, check if you have the proper application to view it first. Information about this may be contained in the File-Format links below. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://ftp.iza.org/dp2347.pdf
File Format: application/pdf
File Function: First version, 2006
Download Restriction: no

Publisher Info
Paper provided by University of Miami, Department of Economics in its series Working Papers with number 0608.

Download reference. The following formats are available: HTML (with abstract), plain text (with abstract), BibTeX, RIS (EndNote, RefMan, ProCite), ReDIF
Length: 49 pages
Date of creation:
Date of revision:
Handle: RePEc:mia:wpaper:0608

Contact details of provider:
Postal: P.O. Box 248126, Coral Gables, FL 33124-6550
Phone: (305) 284-5540
Fax: (305) 284-2985
Web page: http://www.bus.miami.edu/faculty-and-research/academic-departments/economics/index.html
More information through EDIRC

For technical questions regarding this item, or to correct its listing, contact: (David L. Kelly).

Related research
Keywords: average treatment effects; causality; unconfoundedness; overlap; treatment effect heterogeneity;

Other versions of this item:

Find related papers by JEL classification:
C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: General - - - Semiparametric and Nonparametric Methods
C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation and Testing

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

  1. Guido W. Imbens & Whitney Newey & Geert Ridder, 2006. "Mean-squared-error Calculations for Average Treatment Effects," IEPR Working Papers 06.57, Institute of Economic Policy Research (IEPR). [Downloadable!]
  2. Michael Lechner, 2005. "Some practical issues in the evaluation of heterogeneous labour market programmes by matching methods," Labor and Demography 0505006, EconWPA. [Downloadable!]
    Other versions:
  3. Newey, Whitney K., 1994. "Kernel Estimation of Partial Means and a General Variance Estimator," Econometric Theory, Cambridge University Press, vol. 10(02), pages 1-21, June. [Downloadable!]
  4. Michael Lechner, 2002. "Program Heterogeneity And Propensity Score Matching: An Application To The Evaluation Of Active Labor Market Policies," The Review of Economics and Statistics, MIT Press, vol. 84(2), pages 205-220, May. [Downloadable!] (restricted)
  5. James Heckman & Hidehiko Ichimura & Jeffrey Smith & Petra Todd, 1998. "Characterizing Selection Bias Using Experimental Data," Econometrica, Econometric Society, vol. 66(5), pages 1017-1098, September.
    Other versions:
  6. Richard K. Crump & V. Joseph Hotz & Guido W. Imbens & Oscar A. Mitnik, 2006. "Nonparametric Tests for Treatment Effect Heterogeneity," IZA Discussion Papers 2091, Institute for the Study of Labor (IZA). [Downloadable!]
    Other versions:
  7. LaLonde, Robert J, 1986. "Evaluating the Econometric Evaluations of Training Programs with Experimental Data," American Economic Review, American Economic Association, vol. 76(4), pages 604-20, September. [Downloadable!] (restricted)
  8. repec:cup:etheor:v:10:y:1994:i:2:p:233-53 is not listed on IDEAS
  9. Keisuke Hirano & Guido W. Imbens & Geert Ridder, 2003. "Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score," Econometrica, Econometric Society, vol. 71(4), pages 1161-1189, 07. [Downloadable!] (restricted)
    Other versions:
  10. Robinson, Peter M, 1988. "Root- N-Consistent Semiparametric Regression," Econometrica, Econometric Society, vol. 56(4), pages 931-54, July. [Downloadable!] (restricted)
  11. Guildo W. Imbens, 2003. "Sensitivity to Exogeneity Assumptions in Program Evaluation," American Economic Review, American Economic Association, vol. 93(2), pages 126-132, May. [Downloadable!]
  12. Heckman, James J & Ichimura, Hidehiko & Todd, Petra, 1998. "Matching as an Econometric Evaluation Estimator," Review of Economic Studies, Blackwell Publishing, vol. 65(2), pages 261-94, April. [Downloadable!] (restricted)
  13. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-75, March. [Downloadable!] (restricted)
    Other versions:
  14. Heckman, James J & Ichimura, Hidehiko & Todd, Petra E, 1997. "Matching as an Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," Review of Economic Studies, Blackwell Publishing, vol. 64(4), pages 605-54, October. [Downloadable!] (restricted)
  15. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353. [Downloadable!] (restricted)
    Other versions:
  16. Rajeev H. Dehejia & Sadek Wahba, 1998. "Causal Effects in Non-Experimental Studies: Re-Evaluating the Evaluation of Training Programs," NBER Working Papers 6586, National Bureau of Economic Research, Inc. [Downloadable!] (restricted)
  17. Alberto Abadie & Guido W. Imbens, 2006. "Large Sample Properties of Matching Estimators for Average Treatment Effects," Econometrica, Econometric Society, vol. 74(1), pages 235-267, 01. [Downloadable!] (restricted)
  18. Guido W. Imbens & Whitney Newey & Geert Ridder, 2005. "Mean-square-error Calculations for Average Treatment Effects," IEPR Working Papers 05.34, Institute of Economic Policy Research (IEPR). [Downloadable!]
  19. Joshua D. Angrist, 1998. "Estimating the Labor Market Impact of Voluntary Military Service Using Social Security Data on Military Applicants," Econometrica, Econometric Society, vol. 66(2), pages 249-288, March.
    Other versions:
  20. Richard Blundell & Monica Costa Dias, 2002. "Alternative approaches to evaluation in empirical microeconomics," CeMMAP working papers CWP10/02, Centre for Microdata Methods and Practice, Institute for Fiscal Studies. [Downloadable!]
    Other versions:
  21. Richard K. Crump & V. Joseph Hotz & Guido W. Imbens & Oscar A. Mitnik, 2006. "Moving the Goalposts: Addressing Limited Overlap in the Estimation of Average Treatment Effects by Changing the Estimand," NBER Technical Working Papers 0330, National Bureau of Economic Research, Inc. [Downloadable!] (restricted)
  22. Guido W. Imbens, 2004. "Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 4-29, 06. [Downloadable!] (restricted)
    Other versions:
  23. Jinyong Hahn, 1998. "On the Role of the Propensity Score in Efficient Semiparametric Estimation of Average Treatment Effects," Econometrica, Econometric Society, vol. 66(2), pages 315-332, March.
Full references

Cited by:
(explanations, Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.)

  1. Richard K. Crump & V. Joseph Hotz & Guido W. Imbens & Oscar A. Mitnik, 2006. "Nonparametric Tests for Treatment Effect Heterogeneity," NBER Technical Working Papers 0324, National Bureau of Economic Research, Inc. [Downloadable!] (restricted)
    Other versions:
  2. Allcott, Hunt & Ortega, Daniel E., 2009. "The performance of decentralized school systems : evidence from Fe y Alegría in Venezuela," Policy Research Working Paper Series 4879, The World Bank. [Downloadable!]
  3. Sudhanshu Handa & John Maluccio, 2008. "Matching the gold standard: Comparing experimental and non-experimental evaluation techniques for a geographically targeted program," Middlebury College Working Paper Series 0813, Middlebury College, Department of Economics. [Downloadable!]
  4. Christiano A. Coelho & João Manoel Pinho de Mello & Leonardo Rezende, 2007. "Are Public Banks pro-Competitive? Evidence from Concentrated Local Markets in Brazil," Textos para discussão 551, Department of Economics PUC-Rio (Brazil), revised Sep 2007. [Downloadable!]
  5. Onur Baser, 2007. "Propensity Score Matching with Limited Overlap," Economics Bulletin, Economics Bulletin, vol. 9(8), pages 1-8. [Downloadable!]
  6. Deininger, Klaus & Liu, Yanyan, 2008. "Economic and Social Impacts of Self-Help Groups in India," 2008 Annual Meeting, July 27-29, 2008, Orlando, Florida 6482, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association). [Downloadable!]
  7. Ciro Biderman & João Manoel Pinho de Mello & Alexandre A Schneider, 2006. "Dry law and homicides: evidence from the São Paulo metropolitan area," Textos para discussão 518, Department of Economics PUC-Rio (Brazil), revised Oct 2008. [Downloadable!]
  8. Matias Busso & Patrick Kline, 2008. "Do Local Economic Development Programs Work? Evidence from the Federal Empowerment Zone Program," Cowles Foundation Discussion Papers 1639, Cowles Foundation, Yale University. [Downloadable!]
    Other versions:
  9. Wagstaff, Adam & Lindelow, Magnus & Gao Jun & Xu Ling & Qian Juncheng, 2007. "Extending health insurance to the rural population : an impact evaluation of China's new cooperative medical scheme," Policy Research Working Paper Series 4150, The World Bank. [Downloadable!]
    Other versions:
  10. Chen, Shaohua & Mu, Ren & Ravallion, Martin, 2008. "Are there lasting impacts of aid to poor areas ? Evidence from rural China," Policy Research Working Paper Series 4084, The World Bank. [Downloadable!]
  11. Wagstaff, Adam, 2007. "Health insurance for the poor : initial impacts of Vietnam's health care fund for the poor," Policy Research Working Paper Series 4134, The World Bank. [Downloadable!]
  12. Richard K. Crump & V. Joseph Hotz & Guido W. Imbens & Oscar A. Mitnik, 2006. "Moving the Goalposts: Addressing Limited Overlap in the Estimation of Average Treatment Effects by Changing the Estimand," NBER Technical Working Papers 0330, National Bureau of Economic Research, Inc. [Downloadable!] (restricted)
Statistics
Access and download statistics

Did you know? All full texts are decentralized with the publishers, none reside on this server, thus making it possible to offer this service for free to all parties.

This page was last updated on 2009-11-18.

This information is provided to you by IDEAS at the Department of Economics, College of Liberal Arts and Sciences, University of Connecticut using RePEc data on a server sponsored by the Society for Economic Dynamics.