Better LATE Than Nothing: Some Comments on Deaton (2009) and Heckman and Urzua (2009)
Abstract
Two recent papers, Deaton (2009) and Heckman and Urzua (2009), argue against what they see as an excessive and inappropriate use of experimental and quasi-experimental methods in empirical work in economics in the last decade. They specifically question the increased use of instrumental variables and natural experiments in labor economics and of randomized experiments in development economics. In these comments, I will make the case that this move toward shoring up the internal validity of estimates, and toward clarifying the description of the population these estimates are relevant for, has been important and beneficial in increasing the credibility of empirical work in economics. I also address some other concerns raised by the Deaton and Heckman-Urzua papers. (JEL C21, C31)Download Info
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.
Bibliographic Info
Article provided by American Economic Association in its journal Journal of Economic Literature.
Volume (Year): 48 (2010)
Issue (Month): 2 (June)
Pages: 399-423
Note: DOI: 10.1257/jel.48.2.399
Contact details of provider:
Email:
Web page: http://www.aeaweb.org/journal
More information through EDIRC
Order Information:
Web: http://www.aeaweb.org/subscribe.html
Related research
Keywords:Other versions of this item:
- Guido W. Imbens, 2009. "Better LATE Than Nothing: Some Comments on Deaton (2009) and Heckman and Urzua (2009)," NBER Working Papers 14896, National Bureau of Economic Research, Inc.
- C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
- C31 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models; Quantile Regressions; Social Interaction Models
References
References listed on IDEASPlease report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Cook, Thomas D., 2008. ""Waiting for Life to Arrive": A history of the regression-discontinuity design in Psychology, Statistics and Economics," Journal of Econometrics, Elsevier, vol. 142(2), pages 636-654, February.
- Joshua D. Angrist & Victor Lavy, 1999. "Using Maimonides' Rule To Estimate The Effect Of Class Size On Scholastic Achievement," The Quarterly Journal of Economics, MIT Press, vol. 114(2), pages 533-575, May.
- Banerjee, Abhijit & Cole, Shawn & Duflo, Esther & Linden, Leigh, 2006.
"Remedying Education: Evidence from Two Randomized Experiments in India,"
CEPR Discussion Papers
5446, C.E.P.R. Discussion Papers.
- Abhijit V. Banerjee & Shawn Cole & Esther Duflo & Leigh Linden, 2007. "Remedying Education: Evidence from Two Randomized Experiments in India," The Quarterly Journal of Economics, MIT Press, vol. 122(3), pages 1235-1264, 08.
- Esther Duflo & Abhijit Banerjee & Shawn Cole & Leigh Linden, 2006. "Remedying Education: Evidence from Two Randomised Experiments in India," Working Papers id:360, eSocialSciences.
- Abhijit Banerjee & Shawn Cole & Esther Duflo & Leigh Linden, 2005. "Remedying Education: Evidence from Two Randomized Experiments in India," NBER Working Papers 11904, National Bureau of Economic Research, Inc.
- Abhijit Banerjee & Shawn Cole & Esther Duflo & Leigh Linden, 2005. "Remedying education: Evidence from two randomized experiments in india," Framed Field Experiments 00122, The Field Experiments Website.
- Jonathan Levin & Susan Athey & Enrique Seira, 2004.
"Comparing Open and Sealed Bid Auctions: Theory and Evidence from Timber Auctions,"
Working Papers
2004.142, Fondazione Eni Enrico Mattei.
- Susan Athey, 2005. "Comparing Open and Sealed Bid Auctions: Theory and Evidence from Timber Auctions," Theory workshop papers 658612000000000098, UCLA Department of Economics.
- Susan Athey & Jonathan Levin & Enrique Seira, 2004. "Comparing Open and Sealed Bid Auctions: Theory and Evidence from Timber Auctions," Levine's Bibliography 122247000000000524, UCLA Department of Economics.
- David Card & Jochen Kluve & Andrea Weber, 2009.
"Active Labor Market Policy Evaluations: A Meta-analysis,"
CESifo Working Paper Series
2570, CESifo Group Munich.
- David Card & Jochen Kluve & Andrea Weber, 2010. "Active Labour Market Policy Evaluations: A Meta-Analysis," Economic Journal, Royal Economic Society, vol. 120(548), pages F452-F477, November.
- Card, David & Kluve, Jochen & Weber, Andrea, 2009. "Active Labor Market Policy Evaluations: A Meta-Analysis," IZA Discussion Papers 4002, Institute for the Study of Labor (IZA).
- David Card & Jochen Kluve & Andrea Weber, 2010. "Active Labor Market Policy Evaluations: A Meta-Analysis," NBER Working Papers 16173, National Bureau of Economic Research, Inc.
- David Card & Jochen Kluve & Andrea Weber, 2009. "Active Labor Market Policy Evaluations – A Meta-analysis," Ruhr Economic Papers 0086, Rheinisch-Westfälisches Institut für Wirtschaftsforschung, Ruhr-Universität Bochum, Universität Dortmund, Universität Duisburg-Essen.
- David E. Card & Jochen Kluve & Andrea Weber, 2009. "Active Labor Market Policy Evaluations: A Meta-analysis," NRN working papers 2009-02, The Austrian Center for Labor Economics and the Analysis of the Welfare State, Johannes Kepler University Linz, Austria.
- Esther Duflo & Rachel Glennerster & Michael Kremer, 2006.
"Using Randomization in Development Economics Research: A Toolkit,"
NBER Technical Working Papers
0333, National Bureau of Economic Research, Inc.
- Duflo, Esther & Glennerster, Rachel & Kremer, Michael, 2008. "Using Randomization in Development Economics Research: A Toolkit," Handbook of Development Economics, Elsevier.
- Duflo, Esther & Glennerster, Rachel & Kremer, Michael, 2007. "Using Randomization in Development Economics Research: A Toolkit," CEPR Discussion Papers 6059, C.E.P.R. Discussion Papers.
- Imbens, Guido & Wooldridge, Jeffrey M., 2009. "Recent Developments in the Econometrics of Program Evaluation," Scholarly Articles 3043416, Harvard University Department of Economics.
- Duflo, Esther & Hanna, Rema & Ryan, Stephen, 2008.
"Monitoring Works: Getting Teachers to Come to School,"
CEPR Discussion Papers
6682, C.E.P.R. Discussion Papers.
- Esther Duflo & Rema Hanna, 2005. "Monitoring Works: Getting Teachers to Come to School," NBER Working Papers 11880, National Bureau of Economic Research, Inc.
- Duflo, Esther & Hanna, Rema, 2005. "Monitoring Works: Getting Teachers to Come to School," CEPR Discussion Papers 5426, C.E.P.R. Discussion Papers.
- Esther Duflo & Rema Hanna, 2005. "Monitoring Works: Getting Teachers to Come to School," Working Papers id:301, eSocialSciences.
- Jeffrey Smith & Petra Todd, 2003.
"Does Matching Overcome Lalonde's Critique of Nonexperimental Estimators?,"
University of Western Ontario, CIBC Centre for Human Capital and Productivity Working Papers
20035, University of Western Ontario, CIBC Centre for Human Capital and Productivity.
- A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
- James J. Heckman & Sergio Urzua, 2009.
"Comparing IV With Structural Models: What Simple IV Can and Cannot Identify,"
NBER Working Papers
14706, National Bureau of Economic Research, Inc.
- Heckman, James J. & Urzúa, Sergio, 2010. "Comparing IV with structural models: What simple IV can and cannot identify," Journal of Econometrics, Elsevier, vol. 156(1), pages 27-37, May.
- James Heckman & Sergio Urzua, 2010. "Comparing IV with structural models: what simple IV can and cannot identify," CeMMAP working papers CWP08/10, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Sergio Urzua & James J. Heckman, 2009. "Comparing IV with Structural Models: What Simple IV Can and Cannot Identify," Working Papers 200906, Geary Institute, University College Dublin.
- Heckman, James J. & Urzua, Sergio, 2009. "Comparing IV with Structural Models: What Simple IV Can and Cannot Identify," IZA Discussion Papers 3980, Institute for the Study of Labor (IZA).
- David S. Lee & Thomas Lemieux, 2009.
"Regression Discontinuity Designs in Economics,"
NBER Working Papers
14723, National Bureau of Economic Research, Inc.
- David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
- David S. Lee & Thomas Lemieux, 2009. "Regression Discontinuity Designs In Economics," Working Papers 1118, Princeton University, Department of Economics, Industrial Relations Section..
- Imbens, Guido W & Angrist, Joshua D, 1994.
"Identification and Estimation of Local Average Treatment Effects,"
Econometrica,
Econometric Society, vol. 62(2), pages 467-75, March.
- Joshua D. Angrist & Guido W. Imbens, 1995. "Identification and Estimation of Local Average Treatment Effects," NBER Technical Working Papers 0118, National Bureau of Economic Research, Inc.
- Alan Krueger, 1997.
"Experimental Estimates of Education Production Functions,"
Working Papers
758, Princeton University, Department of Economics, Industrial Relations Section..
- Alan B. Krueger, 1999. "Experimental Estimates Of Education Production Functions," The Quarterly Journal of Economics, MIT Press, vol. 114(2), pages 497-532, May.
- Alan B. Krueger, 1997. "Experimental Estimates of Education Production Functions," NBER Working Papers 6051, National Bureau of Economic Research, Inc.
- Chamberlain, Gary, 1986. "Asymptotic efficiency in semi-parametric models with censoring," Journal of Econometrics, Elsevier, vol. 32(2), pages 189-218, July.
- David Card, 1989.
"The Impact of the Mariel Boatlift on the Miami Labor Market,"
Working Papers
633, Princeton University, Department of Economics, Industrial Relations Section..
- David Card, 1990. "The impact of the Mariel boatlift on the Miami labor market," Industrial and Labor Relations Review, ILR Review, Cornell University, ILR School, vol. 43(2), pages 245-257, January.
- David Card, 1989. "The Impact of the Mariel Boatlift on the Miami Labor Market," NBER Working Papers 3069, National Bureau of Economic Research, Inc.
- Charles F. Manski, 1993.
"The Mixing Problem in Program Evaluation,"
NBER Technical Working Papers
0148, National Bureau of Economic Research, Inc.
- Manski, Charles F, 1997. "The Mixing Problem in Programme Evaluation," Review of Economic Studies, Wiley Blackwell, vol. 64(4), pages 537-53, October.
- Esther Duflo & Emmanuel Saez, 2003.
"The Role Of Information And Social Interactions In Retirement Plan Decisions: Evidence From A Randomized Experiment,"
The Quarterly Journal of Economics,
MIT Press, vol. 118(3), pages 815-842, August.
- Esther Duflo & Emmanuel Saez, 2002. "The Role of Information and Social Interactions in Retirement Plan Decisions: Evidence from a Randomized Experiment," NBER Working Papers 8885, National Bureau of Economic Research, Inc.
- Guido M. Imbens & Jeffrey M. Wooldridge, 2008.
"Recent Developments in the Econometrics of Program Evaluation,"
NBER Working Papers
14251, National Bureau of Economic Research, Inc.
- Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
- Imbens, Guido W. & Wooldridge, Jeffrey M., 2008. "Recent Developments in the Econometrics of Program Evaluation," IZA Discussion Papers 3640, Institute for the Study of Labor (IZA).
- Guido Imbens & Jeffrey Wooldridge, 2008. "Recent developments in the econometrics of program evaluation," CeMMAP working papers CWP24/08, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Raghabendra Chattopadhyay & Esther Duflo, 2004. "Women as Policy Makers: Evidence from a Randomized Policy Experiment in India," Econometrica, Econometric Society, vol. 72(5), pages 1409-1443, 09.
- Caroline M. Hoxby, 2000. "The Effects Of Class Size On Student Achievement: New Evidence From Population Variation," The Quarterly Journal of Economics, MIT Press, vol. 115(4), pages 1239-1285, November.
- repec:feb:natura:0036 is not listed on IDEAS
- Charles F. Manski, 1996. "Learning about Treatment Effects from Experiments with Random Assignment of Treatments," Journal of Human Resources, University of Wisconsin Press, vol. 31(4), pages 709-733.
- Abhijit V. Banerjee & Esther Duflo, 2008.
"The Experimental Approach to Development Economics,"
NBER Working Papers
14467, National Bureau of Economic Research, Inc.
- Abhijit V. Banerjee & Esther Duflo, 2009. "The Experimental Approach to Development Economics," Annual Review of Economics, Annual Reviews, vol. 1(1), pages 151-178, 05.
- Banerjee, Abhijit & Duflo, Esther, 2008. "The Experimental Approach to Development Economics," CEPR Discussion Papers 7037, C.E.P.R. Discussion Papers.
- James J. Heckman & Jeffrey A. Smith, 1995. "Assessing the Case for Social Experiments," Journal of Economic Perspectives, American Economic Association, vol. 9(2), pages 85-110, Spring.
- Angrist, Joshua D, 1990.
"Lifetime Earnings and the Vietnam Era Draft Lottery: Evidence from Social Security Administrative Records,"
American Economic Review,
American Economic Association, vol. 80(3), pages 313-36, June.
- Joshua Angrist, 1989. "Lifetime Earnings and the Vietnam Era Draft Lottery: Evidence from Social Security Administrative Records," Working Papers 631, Princeton University, Department of Economics, Industrial Relations Section..
- LaLonde, Robert J, 1986. "Evaluating the Econometric Evaluations of Training Programs with Experimental Data," American Economic Review, American Economic Association, vol. 76(4), pages 604-20, September.
- Imbens, Guido & Lemieux, Thomas, 2008. "Special issue editors' introduction: The regression discontinuity design--Theory and applications," Journal of Econometrics, Elsevier, vol. 142(2), pages 611-614, February.
- David Card & Dean R. Hyslop, 2004.
"Estimating the Effects of a Time Limited Earnings Subsidy for Welfare Leavers,"
NBER Working Papers
10647, National Bureau of Economic Research, Inc.
- David Card & Dean R. Hyslop, 2005. "Estimating the Effects of a Time-Limited Earnings Subsidy for Welfare-Leavers," Econometrica, Econometric Society, vol. 73(6), pages 1723-1770, November.
- repec:feb:natura:0028 is not listed on IDEAS
- Lee, David S., 2008. "Randomized experiments from non-random selection in U.S. House elections," Journal of Econometrics, Elsevier, vol. 142(2), pages 675-697, February.
- V. Joseph Hotz & Guido W. Imbens & Julie H. Mortimer, 1999. "Predicting the Efficacy of Future Training Programs Using Past Experiences," NBER Technical Working Papers 0238, National Bureau of Economic Research, Inc.
- Thomas Fraker & Rebecca Maynard, 1987. "The Adequacy of Comparison Group Designs for Evaluations of Employment-Related Programs," Journal of Human Resources, University of Wisconsin Press, vol. 22(2), pages 194-227.
- Hahn, Jinyong & Todd, Petra & Van der Klaauw, Wilbert, 2001. "Identification and Estimation of Treatment Effects with a Regression-Discontinuity Design," Econometrica, Econometric Society, vol. 69(1), pages 201-09, January.
Citations
Blog mentions
As found by EconAcademics.org, the blog aggregator for Economics research:- Rise and Fall of a Method
by Agent Continuum in Agent Continuum on 2010-04-21 13:53:35 - is not too LATE for empirical development!!!
by Dany in Rigotnomics on 2009-04-23 23:43:00
Cited by:
This item has more than 25 citations. To prevent cluttering this page, these citations are listed on a separate page.
Lists
This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.Statistics
Access and download statisticsCorrections
When requesting a correction, please mention this item's handle: RePEc:aea:jeclit:v:48:y:2010:i:2:p:399-423For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Jane Voros) or (Michael P. Albert).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.

