Alternative approaches to evaluation in empirical microeconomics
Abstract
Four alternative but related approaches to empirical evaluation of policy interventions are studied: social experiments, natural experiments, matching methods, and instrumental variables. In each case the necessary assumptions and the data requirements are considered for estimation of a number of key parameters of interest. These key parameters include the average treatment effect, the treatment of the treated and the local average treatment effect. Some issues of implementation and interpretation are discussed drawing on the labour market programme evaluation literature.Download Info
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.Bibliographic Info
Paper provided by Centre for Microdata Methods and Practice, Institute for Fiscal Studies in its series CeMMAP working papers with number CWP10/02.Length: 39 pp.
Date of creation: Oct 2002
Date of revision:
Handle: RePEc:ifs:cemmap:10/02
Contact details of provider:
Postal: The Institute for Fiscal Studies 7 Ridgmount Street LONDON WC1E 7AE
Phone: (+44) 020 7291 4800
Fax: (+44) 020 7323 4780
Email:
Web page: http://cemmap.ifs.org.uk
More information through EDIRC
Order Information:
Postal: The Institute for Fiscal Studies 7 Ridgmount Street LONDON WC1E 7AE
Email:
Related research
Keywords:Other versions of this item:
- Richard Blundell & Monica Costa Dias, 2009. "Alternative Approaches to Evaluation in Empirical Microeconomics," Journal of Human Resources, University of Wisconsin Press, vol. 44(3).
- Richard Blundell & Monica Costa Dias, 2008. "Alternative approaches to evaluation in empirical microeconomics," CeMMAP working papers CWP26/08, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Richard Blundell & Mónica Costa Dias, 2008. "Alternative Approaches to Evaluation in Empirical Microeconomics," CEF.UP Working Papers 0805, Universidade do Porto, Faculdade de Economia do Porto.
- Blundell, Richard & Costa Dias, Monica, 2008. "Alternative Approaches to Evaluation in Empirical Microeconomics," IZA Discussion Papers 3800, Institute for the Study of Labor (IZA).
- J21 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Labor Force and Employment, Size, and Structure
- J64 - Labor and Demographic Economics - - Mobility, Unemployment, and Vacancies - - - Unemployment: Models, Duration, Incidence, and Job Search
- C33 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Models with Panel Data; Longitudinal Data; Spatial Time Series
This paper has been announced in the following NEP Reports:
- NEP-ALL-2002-06-13 (All new papers)
- NEP-LTV-2002-06-13 (Unemployment, Inequality & Poverty)
References
References listed on IDEASPlease report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- James Heckman & Edward Vytlacil, 1998. "Instrumental Variables Methods for the Correlated Random Coefficient Model: Estimating the Average Rate of Return to Schooling When the Return is Correlated with Schooling," Journal of Human Resources, University of Wisconsin Press, vol. 33(4), pages 974-987.
- Richard Blundell & Alan Duncan & Costas Meghir, 1995.
"Estimating labour supply responses using tax reforms,"
IFS Working Papers
W95/07, Institute for Fiscal Studies.
- Richard Blundell & Alan Duncan & Costas Meghir, 1998. "Estimating Labor Supply Responses Using Tax Reforms," Econometrica, Econometric Society, vol. 66(4), pages 827-862, July.
- Carneiro, Pedro & Hansen, Karsten T. & Heckman, James J., 2002.
"Removing the Veil of Ignorance in Assessing the Distributional Impacts of Social Policies,"
IZA Discussion Papers
453, Institute for the Study of Labor (IZA).
- Carneiro, Pedro & Hansen, Karsten T & Heckman, James J, 2002. "Removing the veil of ignorance in assessing the distributional impacts of social policies," Working Paper Series 2002:2, IFAU - Institute for Evaluation of Labour Market and Education Policy.
- Pedro Carneiro & Karsten T. Hansen & James J. Heckman, 2002. "Removing the Veil of Ignorance in Assessing the Distributional Impacts of Social Policies," NBER Working Papers 8840, National Bureau of Economic Research, Inc.
- Jeffrey Smith & Petra Todd, 2003.
"Does Matching Overcome Lalonde's Critique of Nonexperimental Estimators?,"
University of Western Ontario, CIBC Centre for Human Capital and Productivity Working Papers
20035, University of Western Ontario, CIBC Centre for Human Capital and Productivity.
- A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
- Richard Blundell & Monica Costa Dias, 2000. "Evaluation methods for non-experimental data," Fiscal Studies, Institute for Fiscal Studies, vol. 21(4), pages 427-468, January.
- Richard Blundell & James Powell, 2001. "Endogeneity in nonparametric and semiparametric regression models," CeMMAP working papers CWP09/01, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Alberto Abadie & Joshua Angrist & Guido Imbens, 2002.
"Instrumental Variables Estimates of the Effect of Subsidized Training on the Quantiles of Trainee Earnings,"
Econometrica,
Econometric Society, vol. 70(1), pages 91-117, January.
- Alberto Abadie & Joshua Angrist & Guido Imbens, 1999. "Instrumental Variables Estimates of the Effect of Subsidized Training on the Quantiles of Trainee Earnings," Working papers 99-16, Massachusetts Institute of Technology (MIT), Department of Economics.
- Guido Imbens & Thomas Lemieux, 2007.
"Regression Discontinuity Designs: A Guide to Practice,"
NBER Working Papers
13039, National Bureau of Economic Research, Inc.
- Imbens, Guido W. & Lemieux, Thomas, 2008. "Regression discontinuity designs: A guide to practice," Journal of Econometrics, Elsevier, vol. 142(2), pages 615-635, February.
- Guido Imbens & Thomas Lemieux, 2007. "Regression Discontinuity Designs: A Guide to Practice," NBER Technical Working Papers 0337, National Bureau of Economic Research, Inc.
- Whitney K. Newey & James L. Powell & Francis Vella, 1999.
"Nonparametric Estimation of Triangular Simultaneous Equations Models,"
Econometrica,
Econometric Society, vol. 67(3), pages 565-604, May.
- Whitney K. Newey & James L. Powell & Francis Vella, 1998. "Nonparametric Estimation of Triangular Simultaneous Equations Models," Working papers 98-6, Massachusetts Institute of Technology (MIT), Department of Economics.
- Whitney Newey & James Powell & Francis Vella, 1998. "Nonparametric Estimation of Triangular Simultaneous Equations Models," Working papers 98-16, Massachusetts Institute of Technology (MIT), Department of Economics.
- David Card & Lara D. Shore-Sheppard, 2002.
"Using Discontinuous Eligibility Rules to Identify the Effects of the Federal Medicaid Expansions on Low Income Children,"
NBER Working Papers
9058, National Bureau of Economic Research, Inc.
- David Card & Lara D. Shore-Sheppard, 2004. "Using Discontinuous Eligibility Rules to Identify the Effects of the Federal Medicaid Expansions on Low-Income Children," The Review of Economics and Statistics, MIT Press, vol. 86(3), pages 752-766, August.
- David Card & Lara D. Shore-Sheppard, 2003. "Using Discontinuous Eligibility Rules to Identify the Effects of the Federal Medicaid Expansions on Low Income Children," Department of Economics Working Papers 2003-09, Department of Economics, Williams College.
- Ahn, Hyungtaik & Powell, James L., 1993. "Semiparametric estimation of censored selection models with a nonparametric selection mechanism," Journal of Econometrics, Elsevier, vol. 58(1-2), pages 3-29, July.
- Ashenfelter, Orley C, 1978. "Estimating the Effect of Training Programs on Earnings," The Review of Economics and Statistics, MIT Press, vol. 60(1), pages 47-57, February.
- Blundell, Richard & Macurdy, Thomas, 1999.
"Labor supply: A review of alternative approaches,"
Handbook of Labor Economics,
in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 27, pages 1559-1695
Elsevier.
- Richard Blundell & Thomas MaCurdy, 1998. "Labour supply: a review of alternative approaches," IFS Working Papers W98/18, Institute for Fiscal Studies.
- Richard W. Blundell & James L. Powell, 2004.
"Endogeneity in Semiparametric Binary Response Models,"
Review of Economic Studies,
Oxford University Press, vol. 71(3), pages 655-679.
- Richard W. Blundell & James L. Powell, 2004. "Endogeneity in Semiparametric Binary Response Models," Review of Economic Studies, Wiley Blackwell, vol. 71, pages 655-679, 07.
- Richard Blundell & James Powell, 2001. "Endogeneity in semiparametric binary response models," CeMMAP working papers CWP05/01, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Austan Goolsbee, 1997.
"What Happens When You Tax the Rich? Evidence from Executive Compensation,"
NBER Working Papers
6333, National Bureau of Economic Research, Inc.
- Austan Goolsbee, 2000. "What Happens When You Tax the Rich? Evidence from Executive Compensation," Journal of Political Economy, University of Chicago Press, vol. 108(2), pages 352-378, April.
- Barbara Sianesi, 2001. "Propensity score matching," United Kingdom Stata Users' Group Meetings 2001 12, Stata Users Group, revised 23 Aug 2001.
- Richard Blundell & Monica Costa Dias & Costas Meghir & John Van Reenen, 2004.
"Evaluating the Employment Impact of a Mandatory Job Search Program,"
Journal of the European Economic Association,
MIT Press, vol. 2(4), pages 569-606, 06.
- Blundell, R. & Costa-Dias, M. & Meghir, C. & van Reenen, J., 2004. "Evaluating the employment impact of a mandatory job search program," Open Access publications from University College London http://discovery.ucl.ac.u, University College London.
- Blundell, Richard William & Costa Dias, Monica & Meghir, Costas & Van Reenen, John, 2003. "Evaluating the Employment Impact of a Mandatory Job Search Programme," CEPR Discussion Papers 3786, C.E.P.R. Discussion Papers.
- Heckman, James J, 1979. "Sample Selection Bias as a Specification Error," Econometrica, Econometric Society, vol. 47(1), pages 153-61, January.
- Wilbert van der Klaauw, 2008. "Regression-Discontinuity Analysis: A Survey of Recent Developments in Economics," LABOUR, CEIS, vol. 22(2), pages 219-245, 06.
- Arulampalam, W. & Robin A. Naylor & Jeremy P. Smith, 2002. "University of Warwick," Royal Economic Society Annual Conference 2002 9, Royal Economic Society.
- Orley Ashenfelter & David Card, 1984.
"Using the Longitudinal Structure of Earnings to Estimate the Effect of Training Programs,"
Working Papers
554, Princeton University, Department of Economics, Industrial Relations Section..
- Ashenfelter, Orley & Card, David, 1985. "Using the Longitudinal Structure of Earnings to Estimate the Effect of Training Programs," The Review of Economics and Statistics, MIT Press, vol. 67(4), pages 648-60, November.
- Orley Ashenfelter & David Card, 1984. "Using the Longitudinal Structure of Earnings to Estimate the Effect of Training Programs," NBER Working Papers 1489, National Bureau of Economic Research, Inc.
- Richard Blundell & Lorraine Dearden & Barbara Sianesi, 2003.
"Evaluating the impact of education on earnings in the UK: Models, methods and results from the NCDS,"
IFS Working Papers
W03/20, Institute for Fiscal Studies.
- Blundell, R & Dearden, L & Sianesi, B, 2003. "Evaluating the impact of education on earnings in the UK:models, methods and results from the NCDS," Open Access publications from University College London http://discovery.ucl.ac.u, University College London.
- Richard Blundell & Lorraine Dearden & Barbara Sianesi, 2004. "Evaluating the Impact of Education on Earnings in the UK: Models, Methods and Results from the NCDS," CEE Discussion Papers 0047, Centre for the Economics of Education, LSE.
- Heckman, James J & Smith, Jeffrey, 1997. "Making the Most Out of Programme Evaluations and Social Experiments: Accounting for Heterogeneity in Programme Impacts," Review of Economic Studies, Wiley Blackwell, vol. 64(4), pages 487-535, October.
- Heckman, James J & Ichimura, Hidehiko & Todd, Petra, 1998. "Matching as an Econometric Evaluation Estimator," Review of Economic Studies, Wiley Blackwell, vol. 65(2), pages 261-94, April.
- Blundell, R & Dearden, L & Meghir, C, 1996. "The Determinants and Effects of Work Related Training in Britain," Open Access publications from University College London http://discovery.ucl.ac.u, University College London.
- Nickell, Stephen J, 1981. "Biases in Dynamic Models with Fixed Effects," Econometrica, Econometric Society, vol. 49(6), pages 1417-26, November.
- Susan Athey & Guido W. Imbens, 2002.
"Identification and Inference in Nonlinear Difference-In-Differences Models,"
NBER Technical Working Papers
0280, National Bureau of Economic Research, Inc.
- Susan Athey & Guido W. Imbens, 2006. "Identification and Inference in Nonlinear Difference-in-Differences Models," Econometrica, Econometric Society, vol. 74(2), pages 431-497, 03.
- Susan Athey & Guido Imbens, 2003. "Identification and Inference in Nonlinear Difference-in-Differences Models," Levine's Working Paper Archive 506439000000000079, David K. Levine.
- Robert Moffit, 2007. "Estimating Marginal Treatment Effects in Heterogeneous Populations," Economics Working Paper Archive 539, The Johns Hopkins University,Department of Economics.
- Daniel R. Feenberg & James M. Poterba, 1993.
"Income Inequality and the Incomes of Very High-Income Taxpayers: Evidence from Tax Returns,"
NBER Chapters,
in: Tax Policy and the Economy, Volume 7, pages 145-177
National Bureau of Economic Research, Inc.
- Daniel Feenberg & James Poterba, 1993. "Income Inequality and the Incomes of Very High Income Taxpayers: Evidence from Tax Returns," NBER Working Papers 4229, National Bureau of Economic Research, Inc.
- Feenberg, D.R. & Poterba, J.M., 1992. "Income Inequality and the Incomes of Very High Income Taxpayers: Evidence from Tax Returns," Working papers 92-16, Massachusetts Institute of Technology (MIT), Department of Economics.
- Nada Eissa & Jeffrey B. Liebman, 1995.
"Labor Supply Response to the Earned Income Tax Credit,"
NBER Working Papers
5158, National Bureau of Economic Research, Inc.
- Eissa, Nada & Liebman, Jeffrey B, 1996. "Labor Supply Response to the Earned Income Tax Credit," The Quarterly Journal of Economics, MIT Press, vol. 111(2), pages 605-37, May.
- James Heckman & Hidehiko Ichimura & Jeffrey Smith & Petra Todd, 1998.
"Characterizing Selection Bias Using Experimental Data,"
NBER Working Papers
6699, National Bureau of Economic Research, Inc.
- James Heckman & Hidehiko Ichimura & Jeffrey Smith & Petra Todd, 1998. "Characterizing Selection Bias Using Experimental Data," Econometrica, Econometric Society, vol. 66(5), pages 1017-1098, September.
- Hahn, Jinyong & Todd, Petra & Van der Klaauw, Wilbert, 2001. "Identification and Estimation of Treatment Effects with a Regression-Discontinuity Design," Econometrica, Econometric Society, vol. 69(1), pages 201-09, January.
- Feldstein, Martin, 1995. "Effect of Marginal Tax Rates on Taxable Income: A Panel Study of the 1986 Tax Reform Act," Scholarly Articles 2766676, Harvard University Department of Economics.
- Horowitz, Joel L., 2001. "The Bootstrap," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 52, pages 3159-3228 Elsevier.
- Battistin, Erich & Rettore, Enrico, 2008. "Ineligibles and eligible non-participants as a double comparison group in regression-discontinuity designs," Journal of Econometrics, Elsevier, vol. 142(2), pages 715-730, February.
- Mitali Das & Whitney K. Newey & Francis Vella, 2003. "Nonparametric Estimation of Sample Selection Models," Review of Economic Studies, Wiley Blackwell, vol. 70(1), pages 33-58, January.
- Gary Burtless, 1985. "Are targeted wage subsidies harmful? Evidence from a wage voucher experiment," Industrial and Labor Relations Review, ILR Review, Cornell University, ILR School, vol. 39(1), pages 105-114, October.
- Bassi, Laurie J, 1984. "Estimating the Effect of Training Programs with Non-Random Selection," The Review of Economics and Statistics, MIT Press, vol. 66(1), pages 36-43, February.
- James J. Heckman & Jeffrey A. Smith, 1999. "The Pre-Program Earnings Dip and the Determinants of Participation in a Social Program: Implications for Simple Program Evaluation Strategies," NBER Working Papers 6983, National Bureau of Economic Research, Inc.
- Lindsey, Lawrence B., 1987. "Individual taxpayer response to tax cuts: 1982-1984 : With implications for the revenue maximizing tax rate," Journal of Public Economics, Elsevier, vol. 33(2), pages 173-206, July.
- Imbens, Guido W & Angrist, Joshua D, 1994.
"Identification and Estimation of Local Average Treatment Effects,"
Econometrica,
Econometric Society, vol. 62(2), pages 467-75, March.
- Joshua D. Angrist & Guido W. Imbens, 1995. "Identification and Estimation of Local Average Treatment Effects," NBER Technical Working Papers 0118, National Bureau of Economic Research, Inc.
- Alberto Abadie & Joshua D. Angrist & Guido W. Imbens, 1998. "Instrumental Variables Estimation of Quantile Treatment Effects," NBER Technical Working Papers 0229, National Bureau of Economic Research, Inc.
- Machin, Stephen & Van Reenen, John, 2007. "Changes in wage inequality," Open Access publications from London School of Economics and Political Science CEPSP18, London School of Economics and Political Science.
- Heckman, James J. & Lalonde, Robert J. & Smith, Jeffrey A., 1999. "The economics and econometrics of active labor market programs," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 31, pages 1865-2097 Elsevier.
- Mitali Das & Whitney K. Newey & Francis Vella, 2003. "Nonparametric Estimation of Sample Selection Models," Review of Economic Studies, Oxford University Press, vol. 70(1), pages 33-58.
- Jerry A. Hausman & David A. Wise, 1985. "Social Experimentation," NBER Books, National Bureau of Economic Research, Inc, number haus85-1, October.
- Jaap H. Abbring & Gerard J. van den Berg, 2003. "The Nonparametric Identification of Treatment Effects in Duration Models," Econometrica, Econometric Society, vol. 71(5), pages 1491-1517, 09.
- Jinyong Hahn, 1998. "On the Role of the Propensity Score in Efficient Semiparametric Estimation of Average Treatment Effects," Econometrica, Econometric Society, vol. 66(2), pages 315-332, March.
- Heckman, James J, 1990. "Varieties of Selection Bias," American Economic Review, American Economic Association, vol. 80(2), pages 313-18, May.
- James J. Heckman & Edward J. Vytlacil, 2000. "Local Instrumental Variables," NBER Technical Working Papers 0252, National Bureau of Economic Research, Inc.
- Martin Feldstein, 1997.
"The Effect of Marginal Tax Rates on Taxable Income: A Panel Study of the1986 Tax Reform Act,"
NBER Working Papers
4496, National Bureau of Economic Research, Inc.
- Feldstein, Martin, 1995. "The Effect of Marginal Tax Rates on Taxable Income: A Panel Study of the 1986 Tax Reform Act," Journal of Political Economy, University of Chicago Press, vol. 103(3), pages 551-72, June.
- LaLonde, Robert J, 1986. "Evaluating the Econometric Evaluations of Training Programs with Experimental Data," American Economic Review, American Economic Association, vol. 76(4), pages 604-20, September.
- Bjorklund, Anders & Moffitt, Robert, 1987. "The Estimation of Wage Gains and Welfare Gains in Self-selection," The Review of Economics and Statistics, MIT Press, vol. 69(1), pages 42-49, February.
- Markus Frölich, 2006.
"A Note on Parametric and Nonparametric Regression in the Presence of Endogenous Control Variables,"
University of St. Gallen Department of Economics working paper series 2006
2006-11, Department of Economics, University of St. Gallen.
- Frölich, Markus, 2006. "A Note on Parametric and Nonparametric Regression in the Presence of Endogenous Control Variables," IZA Discussion Papers 2126, Institute for the Study of Labor (IZA).
- Lee, David S., 2008. "Randomized experiments from non-random selection in U.S. House elections," Journal of Econometrics, Elsevier, vol. 142(2), pages 675-697, February.
- Sascha O. Becker & Andrea Ichino, 2002. "Estimation of average treatment effects based on propensity scores," Stata Journal, StataCorp LP, vol. 2(4), pages 358-377, November.
- Edwin Leuven & Barbara Sianesi, 2003. "PSMATCH2: Stata module to perform full Mahalanobis and propensity score matching, common support graphing, and covariate imbalance testing," Statistical Software Components S432001, Boston College Department of Economics, revised 19 Jul 2012.
- Richard Blundell & Monica Costa Dias & Costas Meghir & John Van Reenen, 2001. "Evaluating the employment impact of a mandatory job search assistance program," IFS Working Papers W01/20, Institute for Fiscal Studies.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.Cited by:
This item has more than 25 citations. To prevent cluttering this page, these citations are listed on a separate page.
Lists
This item is featured on the following reading lists or Wikipedia pages:Statistics
Access and download statisticsCorrections
When requesting a correction, please mention this item's handle: RePEc:ifs:cemmap:10/02For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Stephanie Seavers).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.

