So you want to run an experiment, now what? Some Simple Rules of Thumb for Optimal Experimental Design
Author
Abstract
Suggested Citation
Download full text from publisher
Other versions of this item:
- John List & Sally Sadoff & Mathis Wagner, 2011. "So you want to run an experiment, now what? Some simple rules of thumb for optimal experimental design," Experimental Economics, Springer;Economic Science Association, vol. 14(4), pages 439-457, November.
- John List & Sally Sadoff & Mathis Wagner, 2010. "So you want to run an experiment, now what? Some simple rules of thumb for optimal experimental design," Artefactual Field Experiments 00094, The Field Experiments Website.
- John A. List & Sally Sadoff & Mathis Wagner, 2010. "So you want to run an experiment, now what? Some Simple Rules of Thumb for Optimal Experimental Design," NBER Working Papers 15701, National Bureau of Economic Research, Inc.
- John A. List & Sally Sadoff & Mathis Wagner, 2010. "So you want to run an experiment, now what? Some Simple Rules of Thumb for Optimal Experimental Design," CeRP Working Papers 94, Center for Research on Pensions and Welfare Policies, Turin (Italy).
References listed on IDEAS
- Jinyong Hahn & Keisuke Hirano & Dean Karlan, 2011.
"Adaptive Experimental Design Using the Propensity Score,"
Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(1), pages 96-108, January.
- Hahn, Jinyong & Hirano, Keisuke & Karlan, Dean, 2011. "Adaptive Experimental Design Using the Propensity Score," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(1), pages 96-108.
- Hahn, Jinyong & Hirano, Keisuke & Karlan, Dean, 2008. "Adaptive Experimental Design Using the Propensity Score," MPRA Paper 8315, University Library of Munich, Germany.
- Jinyong Hahn & Keisuke Hirano & Dean Karlan, 2009. "Adaptive Experimental Design Using the Propensity Score," Working Papers 969, Economic Growth Center, Yale University.
- Hahn, Jinyong & Hirano, Keisuke & Karlan, Dean, 2009. "Adaptive Experimental Design Using the Propensity Score," Working Papers 59, Yale University, Department of Economics.
- Hahn, Jinyong & Hirano, Keisuke & Karlan, Dean S., 2009. "Adaptive Experimental Design Using the Propensity Score," Center Discussion Papers 47107, Yale University, Economic Growth Center.
- Rutström, E. Elisabet & Wilcox, Nathaniel T., 2009. "Stated beliefs versus inferred beliefs: A methodological inquiry and experimental test," Games and Economic Behavior, Elsevier, vol. 67(2), pages 616-632, November.
- Duflo, Esther & Glennerster, Rachel & Kremer, Michael, 2008.
"Using Randomization in Development Economics Research: A Toolkit,"
Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 61, pages 3895-3962,
Elsevier.
- Esther Duflo & Rachel Glennerster & Michael Kremer, 2006. "Using Randomization in Development Economics Research: A Toolkit," NBER Technical Working Papers 0333, National Bureau of Economic Research, Inc.
- Kremer, Michael & Glennerster, Rachel & Duflo, Esther, 2007. "Using Randomization in Development Economics Research: A Toolkit," CEPR Discussion Papers 6059, C.E.P.R. Discussion Papers.
- Esther Duflo & Rachel Glennerster & Michael Kremer, 2006. "Using Randomization in Development Economics Research: A Toolkit," CID Working Papers 138, Center for International Development at Harvard University.
- Glenn W. Harrison & John A. List, 2004.
"Field Experiments,"
Journal of Economic Literature, American Economic Association, vol. 42(4), pages 1009-1055, December.
- Glenn Harrison & John List, 2004. "Field experiments," Artefactual Field Experiments 00058, The Field Experiments Website.
- John List & David Reiley, 2008. "Field experiments," Artefactual Field Experiments 00091, The Field Experiments Website.
- Richard Blundell & Monica Costa Dias, 2009.
"Alternative Approaches to Evaluation in Empirical Microeconomics,"
Journal of Human Resources, University of Wisconsin Press, vol. 44(3).
- Richard Blundell & Monica Costa Dias, 2002. "Alternative approaches to evaluation in empirical microeconomics," Portuguese Economic Journal, Springer;Instituto Superior de Economia e Gestao, vol. 1(2), pages 91-115, August.
- Richard Blundell & Monica Costa Dias, 2002. "Alternative approaches to evaluation in empirical microeconomics," CeMMAP working papers CWP10/02, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Richard Blundell & Monica Costa Dias, 2008. "Alternative approaches to evaluation in empirical microeconomics," CeMMAP working papers CWP26/08, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Richard Blundell & Monica Costa Dias, 2002. "Alternative approaches to evaluation in empirical microeconomics," CeMMAP working papers 10/02, Institute for Fiscal Studies.
- Richard Blundell & Mónica Costa Dias, 2008. "Alternative Approaches to Evaluation in Empirical Microeconomics," CEF.UP Working Papers 0805, Universidade do Porto, Faculdade de Economia do Porto.
- Richard Blundell & Monica Costa Dias, 2008. "Alternative approaches to evaluation in empirical microeconomics," CeMMAP working papers 26/08, Institute for Fiscal Studies.
- Blundell, Richard & Costa Dias, Monica, 2008. "Alternative Approaches to Evaluation in Empirical Microeconomics," IZA Discussion Papers 3800, Institute of Labor Economics (IZA).
- Camerer, Colin F & Hogarth, Robin M, 1999.
"The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework,"
Journal of Risk and Uncertainty, Springer, vol. 19(1-3), pages 7-42, December.
- Camerer, Colin F. & Hogarth, Robin M., 1999. "The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework," Working Papers 1059, California Institute of Technology, Division of the Humanities and Social Sciences.
- repec:feb:artefa:0087 is not listed on IDEAS
- Dean Karlan & John A. List, 2007.
"Does Price Matter in Charitable Giving? Evidence from a Large-Scale Natural Field Experiment,"
American Economic Review, American Economic Association, vol. 97(5), pages 1774-1793, December.
- Karlan, Dean & List, John, 2006. "Does Price Matter in Charitable Giving? Evidence from a Large-Scale Natural Field Experiment," Working Papers 13, Yale University, Department of Economics.
- Dean Karlan & John List, 2006. "Does price matter in charitable giving? Evidence from a large-scale natural field experiment," Natural Field Experiments 00279, The Field Experiments Website.
- Dean Karlan & John A. List, 2006. "Does Price Matter in Charitable Giving? Evidence from a Large-Scale Natural Field Experiment," Working Papers 1, The Field Experiments Website.
- Dean Karlan & John A. List, 2006. "Does Price Matter in Charitable Giving? Evidence From a Large-Scale Natural Field Experiment," NBER Working Papers 12338, National Bureau of Economic Research, Inc.
- Harrison, Glenn W. & Lau, Morten I. & Elisabet Rutström, E., 2009.
"Risk attitudes, randomization to treatment, and self-selection into experiments,"
Journal of Economic Behavior & Organization, Elsevier, vol. 70(3), pages 498-507, June.
- Glenn Harrison & Morten Lau & Elisabet Rutstrom, 2005. "Risk attitudes, randomization to treatment, and self-selection into experiments," Artefactual Field Experiments 00061, The Field Experiments Website.
- El-Gamal, Mahmoud A & Palfrey, Thomas R, 1996.
"Economical Experiments: Bayesian Efficient Experimental Design,"
International Journal of Game Theory, Springer;Game Theory Society, vol. 25(4), pages 495-517.
- El-Gamal, Mahmoud A. & Palfrey, Thomas R., 1994. "Economical Experiments: Bayesian Efficient Experimental Design," Working Papers 884, California Institute of Technology, Division of the Humanities and Social Sciences.
- List John A., 2007.
"Field Experiments: A Bridge between Lab and Naturally Occurring Data,"
The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 6(2), pages 1-47, April.
- John List, 2006. "Field experiments: A bridge between lab and naturally occurring data," Artefactual Field Experiments 00083, The Field Experiments Website.
- John A. List, 2007. "Field Experiments: A Bridge Between Lab and Naturally-Occurring Data," NBER Working Papers 12992, National Bureau of Economic Research, Inc.
- Levitt, Steven D. & List, John A., 2009.
"Field experiments in economics: The past, the present, and the future,"
European Economic Review, Elsevier, vol. 53(1), pages 1-18, January.
- Steven D. Levitt & John A. List, 2008. "Field Experiments in Economics: The Past, The Present, and The Future," NBER Working Papers 14356, National Bureau of Economic Research, Inc.
- Steven Levitt & John List, 2008. "Field experiments in economics: The past, the present, and the future," Artefactual Field Experiments 00079, The Field Experiments Website.
- Graham Loomes, 2005. "Modelling the Stochastic Component of Behaviour in Experiments: Some Issues for the Interpretation of Data," Experimental Economics, Springer;Economic Science Association, vol. 8(4), pages 301-323, December.
- repec:feb:artefa:0090 is not listed on IDEAS
- Steven D. Levitt & John A. List, 2007.
"What Do Laboratory Experiments Measuring Social Preferences Reveal About the Real World?,"
Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 153-174, Spring.
- Steven Levitt & John List, 2007. "What do Laboratory Experiments Measuring Social Preferences Reveal About the Real World," Artefactual Field Experiments 00480, The Field Experiments Website.
- John A. List, 2001.
"Do Explicit Warnings Eliminate the Hypothetical Bias in Elicitation Procedures? Evidence from Field Auctions for Sportscards,"
American Economic Review, American Economic Association, vol. 91(5), pages 1498-1507, December.
- John List, 2001. "Do explicit warnings eliminate the hypothetical bias in elicitation procedures? Evidence from field auctions for sportscards," Framed Field Experiments 00163, The Field Experiments Website.
- Lenth R. V., 2001. "Some Practical Guidelines for Effective Sample Size Determination," The American Statistician, American Statistical Association, vol. 55, pages 187-193, August.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Glenn W. Harrison & John A. List, 2004.
"Field Experiments,"
Journal of Economic Literature, American Economic Association, vol. 42(4), pages 1009-1055, December.
- Glenn Harrison & John List, 2004. "Field experiments," Artefactual Field Experiments 00058, The Field Experiments Website.
- John List & David Reiley, 2008. "Field experiments," Artefactual Field Experiments 00091, The Field Experiments Website.
- Levitt, Steven D. & List, John A., 2009.
"Field experiments in economics: The past, the present, and the future,"
European Economic Review, Elsevier, vol. 53(1), pages 1-18, January.
- Steven Levitt & John List, 2008. "Field experiments in economics: The past, the present, and the future," Artefactual Field Experiments 00079, The Field Experiments Website.
- Steven D. Levitt & John A. List, 2008. "Field Experiments in Economics: The Past, The Present, and The Future," NBER Working Papers 14356, National Bureau of Economic Research, Inc.
- Hallsworth, Michael & List, John A. & Metcalfe, Robert D. & Vlaev, Ivo, 2017.
"The behavioralist as tax collector: Using natural field experiments to enhance tax compliance,"
Journal of Public Economics, Elsevier, vol. 148(C), pages 14-31.
- Michael Hallsworth & John List & Robert Metcalfe & Ivo Vlaev, 2014. "The Behavioralist As Tax Collector: Using Natural Field Experiments to Enhance Tax Compliance," NBER Working Papers 20007, National Bureau of Economic Research, Inc.
- John List & Robert Metcalfe & Michael Taylor & Ivo Vlaev, 2014. "The behavioralist as tax collector: Using natural field experiments to enhance tax compliance," Natural Field Experiments 00391, The Field Experiments Website.
- Omar Al-Ubaydli & John A. List, 2013. "On the Generalizability of Experimental Results in Economics: With a Response to Commentors," CESifo Working Paper Series 4543, CESifo.
- Omar Al-Ubaydli & John List, 2013.
"On the Generalizability of Experimental Results in Economics: With A Response To Camerer,"
Artefactual Field Experiments
j0001, The Field Experiments Website.
- Omar Al-Ubaydli & John A. List, 2013. "On the Generalizability of Experimental Results in Economics: With A Response To Camerer," NBER Working Papers 19666, National Bureau of Economic Research, Inc.
- Eszter Czibor & David Jimenez‐Gomez & John A. List, 2019.
"The Dozen Things Experimental Economists Should Do (More of),"
Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 371-432, October.
- Eszter Czibor & David Jimenez-Gomez & John List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," Artefactual Field Experiments 00648, The Field Experiments Website.
- Eszter Czibor & David Jimenez-Gomez & John A. List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," NBER Working Papers 25451, National Bureau of Economic Research, Inc.
- List John A., 2007.
"Field Experiments: A Bridge between Lab and Naturally Occurring Data,"
The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 6(2), pages 1-47, April.
- John List, 2006. "Field experiments: A bridge between lab and naturally occurring data," Artefactual Field Experiments 00083, The Field Experiments Website.
- John A. List, 2007. "Field Experiments: A Bridge Between Lab and Naturally-Occurring Data," NBER Working Papers 12992, National Bureau of Economic Research, Inc.
- Omar Al-Ubaydli & John List, 2016.
"Field Experiments in Markets,"
Artefactual Field Experiments
j0002, The Field Experiments Website.
- Omar Al-Ubaydli & John List, 2017. "Field Experiments in Markets," Artefactual Field Experiments 00663, The Field Experiments Website.
- Omar Al-Ubaydli & John A. List, 2016. "Field Experiments in Markets," NBER Working Papers 22113, National Bureau of Economic Research, Inc.
- Eric Floyd & John A. List, 2016.
"Using Field Experiments in Accounting and Finance,"
Journal of Accounting Research, Wiley Blackwell, vol. 54(2), pages 437-475, May.
- Eric Floyd & John List, 2016. "Using Field Experiments in Accounting and Finance," Artefactual Field Experiments 00410, The Field Experiments Website.
- G�nther Fink & Margaret McConnell & Sebastian Vollmer, 2014.
"Testing for heterogeneous treatment effects in experimental data: false discovery risks and correction procedures,"
Journal of Development Effectiveness, Taylor & Francis Journals, vol. 6(1), pages 44-57, January.
- Fink, Günther & McConnell, Margaret & Vollmer, Sebastian, 2011. "Testing for Heterogeneous Treatment Effects in Experimental Data: False Discovery Risks and Correction Procedures," Hannover Economic Papers (HEP) dp-477, Leibniz Universität Hannover, Wirtschaftswissenschaftliche Fakultät.
- John List, 2008.
"Introduction to field experiments in economics with applications to the economics of charity,"
Experimental Economics, Springer;Economic Science Association, vol. 11(3), pages 203-212, September.
- John List, 2008. "Introduction to field experiments in economics with applications to the economics of charity," Artefactual Field Experiments 00085, The Field Experiments Website.
- John List, 2007. "Experimenting with Fish has some Advantages," Artefactual Field Experiments 00387, The Field Experiments Website.
- List, John A. & Reiley, David, 2008. "Field Experiments in Economics: Palgrave Entry," IZA Discussion Papers 3273, Institute of Labor Economics (IZA).
- Daniel Rondeau & John List, 2008.
"Matching and challenge gifts to charity: evidence from laboratory and natural field experiments,"
Experimental Economics, Springer;Economic Science Association, vol. 11(3), pages 253-267, September.
- John List & Daniel Rondeau, 2008. "Matching and challenge gifts to charity: Evidence from laboratory and natural field experiments," Natural Field Experiments 00330, The Field Experiments Website.
- Rondeau, Daniel & List, John A., 2008. "Matching and Challenge Gifts to Charity: Evidence from Laboratory and Natural Field Experiments," IZA Discussion Papers 3278, Institute of Labor Economics (IZA).
- Daniel Rondeau & John A. List, 2008. "Matching and Challenge Gifts to Charity:Evidence from Laboratory and Natural Field Experiments," NBER Working Papers 13728, National Bureau of Economic Research, Inc.
- Ouazad, Amine & Page, Lionel, 2013.
"Students' perceptions of teacher biases: Experimental economics in schools,"
Journal of Public Economics, Elsevier, vol. 105(C), pages 116-130.
- Amine Ouazad & Lionel Page, 2012. "Students’ Perceptions of Teacher Biases: Experimental Economics in Schools," CEE Discussion Papers 0133, Centre for the Economics of Education, LSE.
- Nicolas Jacquemet & Olivier L’Haridon & Isabelle Vialle, 2014.
"Marché du travail, évaluation et économie expérimentale,"
Revue française d'économie, Presses de Sciences-Po, vol. 0(1), pages 189-226.
- Nicolas Jacquemet & Olivier l'Haridon & Isabelle Vialle, 2013. "Marché du travail, évaluation et économie expérimentale," Economics Working Paper Archive (University of Rennes & University of Caen) 201322, Center for Research in Economics and Management (CREM), University of Rennes, University of Caen and CNRS.
- Nicolas Jacquemet & Olivier L’haridon & Isabelle Vialle, 2014. "Marché du travail, évaluation et économie expérimentale," Post-Print halshs-01082352, HAL.
- John A. List, 2014.
"Using Field Experiments to Change the Template of How We Teach Economics,"
The Journal of Economic Education, Taylor & Francis Journals, vol. 45(2), pages 81-89, June.
- John List, 2013. "Using field experiments to change the template of how we teach economics," Artefactual Field Experiments 00389, The Field Experiments Website.
- Buchholz, Matthias & Holst, Gesa & Musshoff, Oliver, 2015.
"Water and irrigation policy impact assessment using business simulation games: evidence from northern Germany,"
Department of Agricultural and Rural Development (DARE) Discussion Papers
260781, Georg-August-Universitaet Goettingen, Department of Agricultural Economics and Rural Development (DARE).
- Buchholz, Matthias & Holst, Gesa & Musshoff, Oliver, 2015. "Water and irrigation policy impact assessment using business simulation games: Evidence from northern Germany," DARE Discussion Papers 1505, Georg-August University of Göttingen, Department of Agricultural Economics and Rural Development (DARE).
- Hans-Martin Gaudecker & Arthur Soest & Erik Wengström, 2012.
"Experts in experiments,"
Journal of Risk and Uncertainty, Springer, vol. 45(2), pages 159-190, October.
- von Gaudecker, Martin & van Soest, Arthur & Wengström, Erik, 2008. "Selection and Mode Effects in Risk Preference Elicitation Experiments," Sonderforschungsbereich 504 Publications 08-46, Sonderforschungsbereich 504, Universität Mannheim;Sonderforschungsbereich 504, University of Mannheim.
- Gaudecker, Hans-Martin von & van Soest, Arthur & Wengström, Erik, 2008. "Selection and Mode Effects in Risk Preference Elicitation Experiments," IZA Discussion Papers 3321, Institute of Labor Economics (IZA).
- Gaudecker, Hans-Martin von & van Soest, Arthur & Wengström, Erik, 2011. "Experts in Experiments: How Selection Matters for Estimated Distributions of Risk Preferences," IZA Discussion Papers 5575, Institute of Labor Economics (IZA).
- Omar Al-Ubaydli & John List, 2012.
"On the Generalizability of Experimental Results in Economics,"
Artefactual Field Experiments
00467, The Field Experiments Website.
- Omar Al-Ubaydli & John A. List, 2012. "On the Generalizability of Experimental Results in Economics," NBER Working Papers 17957, National Bureau of Economic Research, Inc.
More about this item
JEL classification:
- C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cca:wpaper:125. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Giovanni Bert (email available below). General contact details of provider: https://edirc.repec.org/data/fccaait.html .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.