The use of client surveys to gauge the threat of contamination in welfare reform experiments
AbstractThis paper examines the type of evidence policy analysts have used to identify the presence and magnitude of contamination in welfare reform experiments. Peter Rossi's critique of the New Jersey Family Development Program evaluation motivates the following discussion. In this critique Rossi and others contend that client misperception about experimental control-group assignment resulted in contamination that negates reported treatment effectiveness. By applying the framework of the Rubin Causal Model (RCM) to isolate “pure” and “impure” experimental and control cases, the actual group assignment and not self-reported membership is shown to be a more accurate gauge of treatment level and effect. The analysis reveals that the form of contamination Rossi detected leads to underestimates of treatment effects, not their evaporation. While contamination is a legitimate threat in any research design its identification must be based on empirical measures. Â© 2003 by the Association for Public Policy Analysis and Management.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoArticle provided by John Wiley & Sons, Ltd. in its journal Journal of Policy Analysis and Management.
Volume (Year): 22 (2003)
Issue (Month): 2 ()
Contact details of provider:
Web page: http://www3.interscience.wiley.com/journal/34787/home
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Bradley R. Schiller, 1999. "State Welfare-Reform Impacts: Content And Enforcement Effects," Contemporary Economic Policy, Western Economic Association International, vol. 17(2), pages 210-222, 04.
- Carol Harvey & Michael J. Camasso & Radha Jagannathan, 2000. "Evaluating Welfare Reform Waivers under Section 1115," Journal of Economic Perspectives, American Economic Association, vol. 14(4), pages 165-188, Fall.
- Ted Joyce & Robert Kaestner & Sanders Korenman & Stanley Henshaw, 2004. "Family Cap Provisions and Changes in Births and Abortions," NBER Working Papers 10214, National Bureau of Economic Research, Inc.
- Robert A. Moffitt, 2003.
"The Role of Randomized Field Trials in Social Science Research: A Perspective from Evaluations of Reforms of Social Welfare Programs,"
NBER Technical Working Papers
0295, National Bureau of Economic Research, Inc.
- Robert Moffitt, 2002. "The role of randomized field trials in social science research: a perspective from evaluations of reforms of social welfare programs," CeMMAP working papers CWP23/02, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Gary King & Emmanuela Gakidou & Nirmala Ravishankar & Ryan T. Moore & Jason Lakin & Manett Vargas & Martha Mar�a Téllez-Rojo & Juan Eugenio Hernández �vila & Mauricio Hernández �vila & Hécto, 2007. "A “politically robust” experimental design for public policy evaluation, with application to the Mexican Universal Health Insurance program," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 26(3), pages 479-506.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Wiley-Blackwell Digital Licensing) or (Christopher F. Baum).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.