Do Instrumental Variables Belong in Propensity Scores?
AbstractPropensity score matching is a popular way to make causal inferences about a binary treatment in observational data. The validity of these methods depends on which variables are used to predict the propensity score. We ask: "Absent strong ignorability, what would be the effect of including an instrumental variable in the predictor set of a propensity score matching estimator?" In the case of linear adjustment, using an instrumental variable as a predictor variable for the propensity score yields greater inconsistency than the naive estimator. This additional inconsistency is increasing in the predictive power of the instrument. In the case of stratification, with a strong instrument, propensity score matching yields greater inconsistency than the naive estimator. Since the propensity score matching estimator with the instrument in the predictor set is both more biased and more variable than the naive estimator, it is conceivable that the confidence intervals for the matching estimator would have greater coverage rates. In a Monte Carlo simulation, we show that this need not be the case. Our results are further illustrated with two empirical examples: one, the Tennessee STAR experiment, with a strong instrument and the other, the Connors' (1996) Swan-Ganz catheterization dataset, with a weak instrument.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by National Bureau of Economic Research, Inc in its series NBER Technical Working Papers with number 0343.
Date of creation: Sep 2007
Date of revision:
Contact details of provider:
Postal: National Bureau of Economic Research, 1050 Massachusetts Avenue Cambridge, MA 02138, U.S.A.
Web page: http://www.nber.org
More information through EDIRC
Find related papers by JEL classification:
- C1 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General
- I1 - Health, Education, and Welfare - - Health
- I2 - Health, Education, and Welfare - - Education
This paper has been announced in the following NEP Reports:
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- James Heckman, 1997. "Instrumental Variables: A Study of Implicit Behavioral Assumptions Used in Making Program Evaluations," Journal of Human Resources, University of Wisconsin Press, vol. 32(3), pages 441-462.
- J.D. Angrist & Guido W. Imbens & D.B. Rubin, 1993. "Identification of Causal Effects Using Instrumental Variables," NBER Technical Working Papers 0136, National Bureau of Economic Research, Inc.
- Heckman, James J & Honore, Bo E, 1990. "The Empirical Content of the Roy Model," Econometrica, Econometric Society, vol. 58(5), pages 1121-49, September.
- Heckman, James J. & Robb, Richard Jr., 1985. "Alternative methods for evaluating the impact of interventions : An overview," Journal of Econometrics, Elsevier, vol. 30(1-2), pages 239-267.
- Christopher Taber & Hidehiko Ichimura, 2001. "Propensity-Score Matching with Instrumental Variables," American Economic Review, American Economic Association, vol. 91(2), pages 119-124, May.
- James J. Heckman & Edward Vytlacil, 2005.
"Structural Equations, Treatment Effects and Econometric Policy Evaluation,"
NBER Working Papers
11259, National Bureau of Economic Research, Inc.
- James J. Heckman & Edward Vytlacil, 2005. "Structural Equations, Treatment Effects, and Econometric Policy Evaluation," Econometrica, Econometric Society, vol. 73(3), pages 669-738, 05.
- James J. Heckman & Edward Vytlacil, 2005. "Structural Equations, Treatment Effects and Econometric Policy Evaluation," NBER Technical Working Papers 0306, National Bureau of Economic Research, Inc.
- Bhattacharya, Jay & Shaikh, Azeem M. & Vytlacil, Edward, 2012.
"Treatment effect bounds: An application to Swan–Ganz catheterization,"
Journal of Econometrics,
Elsevier, vol. 168(2), pages 223-243.
- Jay Bhattacharya & Azeem Shaikh & Edward Vytlacil, 2005. "Treatment Effect Bounds: An Application to Swan-Ganz Catheterization," NBER Working Papers 11263, National Bureau of Economic Research, Inc.
- Joshua D. Angrist & Guido W. Imbens, 1995.
"Identification and Estimation of Local Average Treatment Effects,"
NBER Technical Working Papers
0118, National Bureau of Economic Research, Inc.
- Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-75, March.
- Bisakha Sen & Stephen Mennemeyer & Lisa C. Gary, 2009. "The Relationship Between Neighborhood Quality and Obesity Among Children," NBER Working Papers 14985, National Bureau of Economic Research, Inc.
- Chabé-Ferret, Sylvain, 2012. "Matching vs Differencing when Estimating Treatment Effects with Panel Data: the Example of the Effect of Job Training Programs on Earnings," TSE Working Papers 12-356, Toulouse School of Economics (TSE).
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ().
If references are entirely missing, you can add them using this form.