So you want to run an experiment, now what? Some Simple Rules of Thumb for Optimal Experimental Design
Abstract
Experimental economics represents a strong growth industry. In the past several decades the method has expanded beyond intellectual curiosity, now meriting consideration alongside the other more traditional empirical approaches used in economics. Accompanying this growth is an influx of new experimenters who are in need of straightforward direction to make their designs more powerful. This study provides several simple rules of thumb that researchers can apply to improve the efficiency of their experimental designs. We buttress these points by including empirical examples from the literature.Download Info
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.Bibliographic Info
Paper provided by Center for Research on Pensions and Welfare Policies, Turin (Italy) in its series CeRP Working Papers with number 94.Length: 27 pages
Date of creation: Feb 2010
Date of revision:
Handle: RePEc:crp:wpaper:94
Contact details of provider:
Postal: Via Real Collegio 30, 10024 Moncalieri (TO)
Phone: 39 011 6705040
Fax: +39 011 6705042
Email:
Web page: http://cerp.unito.it
More information through EDIRC
Related research
Keywords:Other versions of this item:
- John List & Sally Sadoff & Mathis Wagner, 2011. "So you want to run an experiment, now what? Some simple rules of thumb for optimal experimental design," Experimental Economics, Springer, vol. 14(4), pages 439-457, November.
- John List & Sally Sadoff & Mathis Wagner, 2010. "So you want to run an experiment, now what? Some simple rules of thumb for optimal experimental design," Artefactual Field Experiments 00094, The Field Experiments Website.
- John A. List & Sally Sadoff & Mathis Wagner, 2009. "So you want to run an experiment, now what? Some Simple Rules of Thumb for Optimal Experimental Design," Carlo Alberto Notebooks 125, Collegio Carlo Alberto.
- John A. List & Sally Sadoff & Mathis Wagner, 2010. "So you want to run an experiment, now what? Some Simple Rules of Thumb for Optimal Experimental Design," NBER Working Papers 15701, National Bureau of Economic Research, Inc.
- C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General
References
References listed on IDEASPlease report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Hahn, Jinyong & Hirano, Keisuke & Karlan, Dean, 2011.
"Adaptive Experimental Design Using the Propensity Score,"
Journal of Business & Economic Statistics,
American Statistical Association, vol. 29(1), pages 96-108.
- Hahn, Jinyong & Hirano, Keisuke & Karlan, Dean, 2009. "Adaptive Experimental Design Using the Propensity Score," Working Papers 59, Yale University, Department of Economics.
- Hahn, Jinyong & Hirano, Keisuke & Karlan, Dean, 2008. "Adaptive Experimental Design Using the Propensity Score," MPRA Paper 8315, University Library of Munich, Germany.
- Jinyong Hahn & Keisuke Hirano & Dean Karlan, 2009. "Adaptive Experimental Design Using the Propensity Score," Working Papers 969, Economic Growth Center, Yale University.
- Glenn W. Harrison & John A. List, 2004.
"Field Experiments,"
Journal of Economic Literature,
American Economic Association, vol. 42(4), pages 1009-1055, December.
- Glenn Harrison & John List, 2004. "Field experiments," Artefactual Field Experiments 00058, The Field Experiments Website.
- John List & David Reiley, 2008. "Field experiments," Artefactual Field Experiments 00091, The Field Experiments Website.
- Steven D. Levitt & John A. List, 2008.
"Field Experiments in Economics: The Past, The Present, and The Future,"
NBER Working Papers
14356, National Bureau of Economic Research, Inc.
- Levitt, Steven D. & List, John A., 2009. "Field experiments in economics: The past, the present, and the future," European Economic Review, Elsevier, vol. 53(1), pages 1-18, January.
- Steven Levitt & John List, 2009. "Field experiments in economics: The past, the present, and the future," Artefactual Field Experiments 00079, The Field Experiments Website.
- Rutström, E. Elisabet & Wilcox, Nathaniel T., 2009. "Stated beliefs versus inferred beliefs: A methodological inquiry and experimental test," Games and Economic Behavior, Elsevier, vol. 67(2), pages 616-632, November.
- Dean Karlan & John A. List, 2006.
"Does Price Matter in Charitable Giving? Evidence from a Large-Scale Natural Field Experiment,"
Working Papers
1, The Field Experiments Website.
- Dean Karlan & John A. List, 2007. "Does Price Matter in Charitable Giving? Evidence from a Large-Scale Natural Field Experiment," American Economic Review, American Economic Association, vol. 97(5), pages 1774-1793, December.
- Dean Karlan & John A. List, 2006. "Does Price Matter in Charitable Giving? Evidence From a Large-Scale Natural Field Experiment," NBER Working Papers 12338, National Bureau of Economic Research, Inc.
- Karlan, Dean & List, John, 2006. "Does Price Matter in Charitable Giving? Evidence from a Large-Scale Natural Field Experiment," Working Papers 13, Yale University, Department of Economics.
- Dean Karlan & John List, 2006. "Does price matter in charitable giving? Evidence from a large-scale natural field experiment," Natural Field Experiments 00279, The Field Experiments Website.
- John A. List, 2007.
"Field Experiments: A Bridge between Lab and Naturally Occurring Data,"
The B.E. Journal of Economic Analysis & Policy,
De Gruyter, vol. 0(2), pages 8.
- John List, 2006. "Field experiments: A bridge between lab and naturally occurring data," Artefactual Field Experiments 00083, The Field Experiments Website.
- John A. List, 2007. "Field Experiments: A Bridge Between Lab and Naturally-Occurring Data," NBER Working Papers 12992, National Bureau of Economic Research, Inc.
- Camerer, Colin F & Hogarth, Robin M, 1999.
"The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework,"
Journal of Risk and Uncertainty,
Springer, vol. 19(1-3), pages 7-42, December.
- Camerer, Colin F. & Hogarth, Robin M., 1999. "The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework," Working Papers 1059, California Institute of Technology, Division of the Humanities and Social Sciences.
- repec:feb:artefa:0090 is not listed on IDEAS
- Richard Blundell & Monica Costa Dias, 2009.
"Alternative Approaches to Evaluation in Empirical Microeconomics,"
Journal of Human Resources,
University of Wisconsin Press, vol. 44(3).
- Richard Blundell & Monica Costa Dias, 2008. "Alternative approaches to evaluation in empirical microeconomics," CeMMAP working papers CWP26/08, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Richard Blundell & Monica Costa Dias, 2002. "Alternative approaches to evaluation in empirical microeconomics," CeMMAP working papers CWP10/02, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Richard Blundell & Mónica Costa Dias, 2008. "Alternative Approaches to Evaluation in Empirical Microeconomics," CEF.UP Working Papers 0805, Universidade do Porto, Faculdade de Economia do Porto.
- Blundell, Richard & Costa Dias, Monica, 2008. "Alternative Approaches to Evaluation in Empirical Microeconomics," IZA Discussion Papers 3800, Institute for the Study of Labor (IZA).
- Harrison, Glenn W. & Lau, Morten I. & Elisabet Rutström, E., 2009. "Risk attitudes, randomization to treatment, and self-selection into experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 70(3), pages 498-507, June.
- Steven D. Levitt & John A. List, 2007. "What Do Laboratory Experiments Measuring Social Preferences Reveal About the Real World?," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 153-174, Spring.
- John List, 2001.
"Do explicit warnings eliminate the hypothetical bias in elicitation procedures? Evidence from field auctions for sportscards,"
Framed Field Experiments
00163, The Field Experiments Website.
- John A. List, 2001. "Do Explicit Warnings Eliminate the Hypothetical Bias in Elicitation Procedures? Evidence from Field Auctions for Sportscards," American Economic Review, American Economic Association, vol. 91(5), pages 1498-1507, December.
- Lenth R. V., 2001. "Some Practical Guidelines for Effective Sample Size Determination," The American Statistician, American Statistical Association, vol. 55, pages 187-193, August.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.Cited by:
- Oriana Bandiera & Iwan Baranky & Imran Rasul, 2011.
"Field Experiments with Firms,"
STICERD - Economic Organisation and Public Policy Discussion Papers Series
028, Suntory and Toyota International Centres for Economics and Related Disciplines, LSE.
- Oriana Bandiera & Iwan Barankay & Imran Rasul, 2011. "Field Experiments with Firms," Journal of Economic Perspectives, American Economic Association, vol. 25(3), pages 63-82, Summer.
- Bandiera, Oriana & Barankay, Iwan & Rasul, Imran, 2011. "Field Experiments with Firms," IZA Discussion Papers 5723, Institute for the Study of Labor (IZA).
- Bandiera, Oriana & Barankay, Iwan & Rasul, Imran, 2011. "Field Experiments with Firms," CEPR Discussion Papers 8412, C.E.P.R. Discussion Papers.
- repec:pra:mprapa:27237 is not listed on IDEAS
- Sule Alan & Ruxandra Dumitrescu & Gyongyi Loranth, 2011. "Subprime Consumer Credit Demand: Evidence from a Lender?sPricing Experiment," BCL working papers 60, Central Bank of Luxembourg.
- Bellemare, Marc F., 2010.
"As You Sow, So Shall You Reap: The Welfare Impacts of Contract Farming,"
MPRA Paper
23638, University Library of Munich, Germany.
- Bellemare, Marc F., 2012. "As You Sow, So Shall You Reap: The Welfare Impacts of Contract Farming," World Development, Elsevier, vol. 40(7), pages 1418-1434.
- Bellemare, Marc F., 2010. "As You Sow, So Shall You Reap: The Welfare Impacts of Contract Farming," MPRA Paper 27259, University Library of Munich, Germany.
Lists
This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.Statistics
Access and download statisticsCorrections
When requesting a correction, please mention this item's handle: RePEc:crp:wpaper:94For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Silvia Maero).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.

