Instrumental Variables: A Cautionary Tale
AbstractThis paper considers the use of instrumental variables to estimate the mean effect of treatment on the treated. It reviews previous work on this topic by Heckman and Robb (1985, 1986) and demonstrates that (a) unless the effect of treatment is the same for everyone (conditional on observables), or (b) treatment effects are variable across persons but the person-specific component of the variability not forecastable by observables does not determine participation in the program, widely-used instrumental variable methods produce inconsistent estimators of the parameter of interest. Neither assumption is very palatable. The first assumes a homogeneity that is implausible. The second assumes either very rich data available to the econometrician or that the persons being studied either do not have better information than the econometrician or that they do not use it. Instrumental variable methods do not provide a general solution to the evaluation problem.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by National Bureau of Economic Research, Inc in its series NBER Technical Working Papers with number 0185.
Date of creation: Sep 1995
Date of revision:
Contact details of provider:
Postal: National Bureau of Economic Research, 1050 Massachusetts Avenue Cambridge, MA 02138, U.S.A.
Web page: http://www.nber.org
More information through EDIRC
Find related papers by JEL classification:
- C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
- C31 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models; Quantile Regressions; Social Interaction Models
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Heckman, James J, 1978.
"Dummy Endogenous Variables in a Simultaneous Equation System,"
Econometric Society, vol. 46(4), pages 931-59, July.
- James J. Heckman, 1977. "Dummy Endogenous Variables in a Simultaneous Equation System," NBER Working Papers 0177, National Bureau of Economic Research, Inc.
- Nancy Clements & James Heckman & Jeffrey Smith, 1994. "Making the Most Out Of Social Experiments: Reducing the Intrinsic Uncertainty in Evidence from Randomized Trials with an Application to the JTPA Exp," NBER Technical Working Papers 0149, National Bureau of Economic Research, Inc.
- James J. Heckman & Jeffrey A. Smith, 1998. "Evaluating the Welfare State," NBER Working Papers 6542, National Bureau of Economic Research, Inc.
- Robert J. Willis & Sherwin Rosen, 1978.
"Education and Self-Selection,"
NBER Working Papers
0249, National Bureau of Economic Research, Inc.
- Angrist, Joshua D, 1990.
"Lifetime Earnings and the Vietnam Era Draft Lottery: Evidence from Social Security Administrative Records,"
American Economic Review,
American Economic Association, vol. 80(3), pages 313-36, June.
- Joshua Angrist, 1989. "Lifetime Earnings and the Vietnam Era Draft Lottery: Evidence from Social Security Administrative Records," Working Papers 631, Princeton University, Department of Economics, Industrial Relations Section..
- J.D. Angrist & Guido W. Imbens & D.B. Rubin, 1993. "Identification of Causal Effects Using Instrumental Variables," NBER Technical Working Papers 0136, National Bureau of Economic Research, Inc.
- Heckman, James J & Honore, Bo E, 1990. "The Empirical Content of the Roy Model," Econometrica, Econometric Society, vol. 58(5), pages 1121-49, September.
- Lach, Saul, 2002.
"Do R&D Subsidies Stimulate or Displace Private R&D? Evidence from Israel,"
Journal of Industrial Economics,
Wiley Blackwell, vol. 50(4), pages 369-90, December.
- Saul Lach, 2000. "Do R&D Subsidies Stimulate or Displace Private R&D? Evidence from Israel," NBER Working Papers 7943, National Bureau of Economic Research, Inc.
- Lorraine Dearden, 1999. "Qualifications and earnings in Britain: how reliable are conventional OLS estimates of the returns to education?," IFS Working Papers W99/07, Institute for Fiscal Studies.
- Francisco A. Gallego, 2002.
"Competencia y Resultados Educativos: Teoría y Evidencia para Chile,"
Working Papers Central Bank of Chile
150, Central Bank of Chile.
- Francisco Gallego, 2002. "Competencia y Resultados Educativos: Teoría y Evidencia para Chile," Latin American Journal of Economics-formerly Cuadernos de Economía, Instituto de Economía. Pontificia Universidad Católica de Chile., vol. 39(118), pages 309-352.
- Francisco Gallego, 2002. "Competencia y Resultados Educativos: TeorÃa y Evidencia para Chile," Documentos de Trabajo 217, Instituto de Economia. Pontificia Universidad Católica de Chile..
- Aki Kangasharju, 2007.
"Do Wage Subsidies Increase Employment in Subsidized Firms?,"
London School of Economics and Political Science, vol. 74(293), pages 51-67, 02.
- Aki Kangasharju, 2005. "Do Wages Subsidies Increase Employment in Subsidised Firms?," Discussion Papers 378, Government Institute for Economic Research Finland (VATT).
- Miguel Angel Malo & Fernando Muñoz-Bullón, 2006. "Employment promotion measures and the quality of the job match for persons with disabilities," Hacienda Pública Española, IEF, vol. 179(4), pages 79-111, September.
- Lorraine Dearden, 1998. "Ability, families, education and earnings in Britain," IFS Working Papers W98/14, Institute for Fiscal Studies.
- Lanot, G. & Walker, I., 1993.
"The Union/Non-Union Wage Differential: an Application of Semi-Parametric Methods,"
9337, Laval - Recherche en Politique Economique.
- Lanot, Gauthier & Walker, Ian, 1998. "The union/non-union wage differential: An application of semi-parametric methods," Journal of Econometrics, Elsevier, vol. 84(2), pages 327-349, June.
- Gauthier Lanot & Ian Walker, 1996. "The Union/Non-Union Wage Differential: An Application of Semi-Parametric Methods," Keele Department of Economics Discussion Papers (1995-2001) 96/9, Department of Economics, Keele University.
- Miguel A. Malo & Fernando Munoz-Bullon, 2005. "Job Matching Quality Effects Of Employment Promotion Measures For People With Disabilities," Business Economics Working Papers wb055315, Universidad Carlos III, Departamento de Economía de la Empresa.
- Shlomo Yitzhaki & Edna Schechtman, 2004. "The Gini Instrumental Variable, or the “double instrumental variable” estimator," Metron - International Journal of Statistics, Dipartimento di Statistica, Probabilità e Statistiche Applicate - University of Rome, vol. 0(3), pages 287-313.
- Yanovitzky, Itzhak & Zanutto, Elaine & Hornik, Robert, 2005. "Estimating causal effects of public health education campaigns using propensity score methodology," Evaluation and Program Planning, Elsevier, vol. 28(2), pages 209-220, May.
- Freund, D.A. & Kniesner, T.J. & LoSasso, A.T., 1996. "How Managed Care Affects Medicaid Utilization: A Synthetic Difference-in-Difference Zero-Inflated Count Model," Discussion Paper 1996-40, Tilburg University, Center for Economic Research.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ().
If references are entirely missing, you can add them using this form.