Technical Problems in Social Experimentation: Cost versus Ease of Analysis
Abstract
The goal of the paper is to set forth general guidelines that we believe would enhance the usefulness of future social experiments and to suggest ways of correcting for inherent limitations of them. Although the major motivation for an experiment is to overcome the inherent limitations of structural econometric models, in many instances the experimental designs have subverted this motivation. The primary advantages of randomized controlled experiments were often lost. The major complication for the analysis of the experiments was induced by an endogenous sample selection and treatment assignment procedure that selected the experimental participants and assigned them to controlversus treatment groups partly on the basis of the variable whose response the experiments were intended to measure. We propose that to overcome these difficulties, the goal of an experimental design should be as nearly as possible to allow analysis based on a simple analysis of variance model. Although complexities attendant to endogenous stratification can be avoided, there are inherent limitations of the experiments that cannot. Two major ones are self-determination of participation and self-selection out, through attrition.But these problems, we believe, can be corrected for with relative ease if endogenous stratification is eliminated. Finally, we propose that as a guiding principle, the experiments should have as a first priority the precise estimation of a single or a small number of treatment effects.Download Info
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.Bibliographic Info
Paper provided by National Bureau of Economic Research, Inc in its series NBER Working Papers with number 1061.Length:
Date of creation: Sep 1985
Date of revision:
Publication status: published as Jerry A. Hausman, David A. Wise. "Technical Problems in Social Experimentation: Cost versus Ease of Analysis," in Jerry A. Hausman and David A. Wise, eds., "Social Experimentation" University of Chicago Press (1985)
Handle: RePEc:nbr:nberwo:1061
Contact details of provider:
Postal: National Bureau of Economic Research, 1050 Massachusetts Avenue Cambridge, MA 02138, U.S.A.
Phone: 617-868-3900
Email:
Web page: http://www.nber.org
More information through EDIRC
Related research
Keywords:Other versions of this item:
- Jerry A. Hausman & David A. Wise, 1985. "Technical Problems in Social Experimentation: Cost versus Ease of Analysis," NBER Chapters, in: Social Experimentation, pages 187-220 National Bureau of Economic Research, Inc.
References
No references listed on IDEASYou can help add them by filling out this form.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.Cited by:
- Orley Ashenfelter & David Ashmore & Olivier Deschenes, 1999.
"Do Unemployment Insurance Recipients Actively Seek Work? Randomized Trials in Four U.S. States,"
NBER Working Papers
6982, National Bureau of Economic Research, Inc.
- Orley Ashenfelter & David Ashmore & Olivier Deschenes, 1998. "Do Unemployment Insurance Recipients Actively Seek Work? Randomized Trials in Four U.S. States," Working Papers 791, Princeton University, Department of Economics, Industrial Relations Section..
- V. Kerry Smith & William H. Desvousges & F. Reed Johnson & Ann Fisher, 1990. "Can public information programs affect risk perceptions?," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 9(1), pages 41-59.
- repec:fth:prinin:412 is not listed on IDEAS
- Guido W. Imbens & Donald B. Rubin & Bruce Sacerdote, 1999. "Estimating the Effects of Unearned Income on Labor Supply, Earnings, Savings, and Consumption: Evidence from a Survey of Lottery Players," NBER Working Papers 7001, National Bureau of Economic Research, Inc.
- Ashenfelter, Orley & Ashmore, David & Deschenes, Olivier, 2000.
"Do Unemployment Insurance Recipients Actively Seek Work? Evidence From Randomized Trials in Four U.S. States,"
IZA Discussion Papers
128, Institute for the Study of Labor (IZA).
- Ashenfelter, Orley & Ashmore, David & Deschenes, Olivier, 2005. "Do unemployment insurance recipients actively seek work? Evidence from randomized trials in four U.S. States," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 53-75.
- Mullahy, John & Sindelar, Jody, 1996.
"Employment, unemployment, and problem drinking,"
Journal of Health Economics,
Elsevier, vol. 15(4), pages 409-434, August.
- John Mullahy & Jody L. Sindelar, 1995. "Employment, Unemployment, and Problem Drinking," NBER Working Papers 5123, National Bureau of Economic Research, Inc.
- Guido W. Imbens & Donald B. Rubin & Bruce I. Sacerdote, 2001. "Estimating the Effect of Unearned Income on Labor Earnings, Savings, and Consumption: Evidence from a Survey of Lottery Players," American Economic Review, American Economic Association, vol. 91(4), pages 778-794, September.
- Imbens, G.W. & Rubin, D. & Sacerdote, B., 1999. "Estimating the effect of unearned income on labor supply, earnings, savings and consumption: Evidence from a survey of lottery players," Discussion Paper 99.34, Tilburg University, Center for Economic Research.
Lists
This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.Statistics
Access and download statisticsCorrections
When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:1061For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ().
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.

