Field Experiments in Economics: Comment on an article by Levitt and List
AbstractIn an article titled "Field Experiments in Economics: The Past, the Present, and the Future," Levitt and List (2009) make three important claims about the history, philosophy, and future of field experiments in economics. They claim that field experiments in economics began in the 1920s and 1930s, in agricultural work by Neyman and Fisher. Second, they claim that artificial randomization is the sine qua non of good experimental design; they claim that randomization is the only valid justification for use of Student‘s test of significance. Finally, they claim that the theory of the firm will be advanced by economists doing randomized controlled trials (RCTs) for private sector firms. Several areas of economics, for example the development economics of Banerjee and Duflo, have been influenced by the article, despite the absence of historical and methodological review. This comment seeks to fill that gap in the literature. Student has, it is found, priority over Fisher and Neyman; he compared balanced and random designs in the field—on crops from barley to timber—from 1905 to 1937. The power and efficiency of balanced over random designs - discovered by Student and confirmed by Pearson, Neyman, Jeffreys, and others adopting a decision-theoretic and/or Bayesian approach - is not mentioned by Levitt and List. Neglect of Student is especially regrettable, for he showed in his job as Head Brewer of Guinness that artificial randomization is neither necessary nor sufficient for improving efficiency, identifying causal relationships, or discovering economically significant differences. One way forward is to take a step backwards, from Fisher to Student.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by School of Economics and Management, University of Aarhus in its series CREATES Research Papers with number 2011-25.
Date of creation: 30 Jun 2011
Date of revision:
Contact details of provider:
Web page: http://www.econ.au.dk/afn/
field experiments; balanced; random;
Find related papers by JEL classification:
- B1 - Schools of Economic Thought and Methodology - - History of Economic Thought through 1925
- C9 - Mathematical and Quantitative Methods - - Design of Experiments
- C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
This paper has been announced in the following NEP Reports:
- NEP-ALL-2011-07-13 (All new papers)
- NEP-EVO-2011-07-13 (Evolutionary Economics)
- NEP-EXP-2011-07-13 (Experimental Economics)
- NEP-HME-2011-07-13 (Heterodox Microeconomics)
- NEP-HPE-2011-07-13 (History & Philosophy of Economics)
- NEP-PKE-2011-07-13 (Post Keynesian Economics)
You can help add them by filling out this form.
reading list or among the top items on IDEAS.Access and download statisticsgeneral information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ().
If references are entirely missing, you can add them using this form.