This file is part of IDEAS, which uses RePEc data


[ Papers | Articles | Software | Books | Chapters | Authors | Institutions | JEL Classification | NEP reports | Search | New papers by email | Author registration | Rankings | Volunteers | FAQ | Blog | Help! ]

Sample Attrition Bias in Randomized Experiments: A Tale of Two Surveys

Author info | Abstract | Publisher info | Download info | Related research | Statistics
Author Info
Behaghel, Luc () (CREST-INSEE)
Crépon, Bruno () (CREST-INSEE)
Gurgand, Marc () (CREST-INSEE)
Le Barbanchon, Thomas () (CREST-INSEE)

Additional information is available for the following registered author(s):

Abstract

The randomized trial literature has helped to renew the fields of microeconometric policy evaluation by emphasizing identification issues raised by endogenous program participation. Measurement and attrition issues have perhaps received less attention. This paper analyzes the dramatic impact of sample attrition in a large job search experiment. We take advantage of two independent surveys on the same initial sample of 8, 000 persons. The first one is a long telephone survey that had a strikingly low and unbalanced response rate of about 50%. The second one is a combination of administrative data and a short telephone survey targeted at those leaving the unemployment registers; this enriched data source has a balanced and much higher response rate (about 80%). With naive estimates that neglect non responses, these two sources yield puzzlingly different results. Using the enriched administrative data as benchmark, we find evidence that estimates from the long telephone survey lack external and internal validity. We turn to existing methods to bound the effects in the presence of sample selection; we extend them to the context of randomization with imperfect compliance. The bounds obtained from the two surveys are compatible but those from the long telephone survey are somewhat uninformative. We conclude on the consequences for data collection strategies.

Download Info
To download:

If you experience problems downloading a file, check if you have the proper application to view it first. Information about this may be contained in the File-Format links below. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://ftp.iza.org/dp4162.pdf
File Format: application/pdf
File Function:
Download Restriction: no

Publisher Info
Paper provided by Institute for the Study of Labor (IZA) in its series IZA Discussion Papers with number 4162.

Download reference. The following formats are available: HTML (with abstract), plain text (with abstract), BibTeX, RIS (EndNote, RefMan, ProCite), ReDIF
Length: 31 pages
Date of creation: May 2009
Date of revision:
Handle: RePEc:iza:izadps:dp4162

Contact details of provider:
Postal: IZA, P.O. Box 7240, D-53072 Bonn, Germany
Phone: +49 228 3894 223
Fax: +49 228 3894 180
Web page: http://www.iza.org

Order Information:
Postal: IZA, Margard Ody, P.O. Box 7240, D-53072 Bonn, Germany
Email:

For technical questions regarding this item, or to correct its listing, contact: (Mark Fallak).

Related research
Keywords: randomized evaluation; survey non response; bounds;

Other versions of this item:

Find related papers by JEL classification:
C31 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
J68 - Labor and Demographic Economics - - Mobility, Unemployment, and Vacancies - - - Public Policy

This paper has been announced in the following NEP Reports:

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
  1. Ashenfelter, Orley & Ashmore, David & Deschenes, Olivier, 2005. "Do unemployment insurance recipients actively seek work? Evidence from randomized trials in four U.S. States," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 53-75. [Downloadable!] (restricted)
    Other versions:
  2. David Card & Raj Chetty & Andrea Weber, 2007. "The Spike at Benefit Exhaustion: Leaving the Unemployment System or Starting a New Job?," American Economic Review, American Economic Association, vol. 97(2), pages 113-118, May. [Downloadable!]
    Other versions:
  3. Duflo, Esther & Glennerster, Rachel & Kremer, Michael, 2007. "Using Randomization in Development Economics Research: A Toolkit," CEPR Discussion Papers 6059, C.E.P.R. Discussion Papers. [Downloadable!] (restricted)
    Other versions:
Full references

Statistics
Access and download statistics

Did you know? All the bibliographic data shown here has been contributed by volunteers, thereby helping to keep this service free.

This page was last updated on 2009-11-16.

This information is provided to you by IDEAS at the Department of Economics, College of Liberal Arts and Sciences, University of Connecticut using RePEc data on a server sponsored by the Society for Economic Dynamics.