Advanced Search
MyIDEAS: Login

The Role of Theory in Field Experiments

Contents:

Author Info

  • David Card
  • Stefano DellaVigna
  • Ulrike Malmendier

Abstract

We classify all published field experiments in five top economics journals from 1975 to 2010 according to how closely the experimental design and analysis are linked to economic theory. We find that the vast majority of field experiments (68 percent) are Descriptive studies that lack any explicit model; 18 percent are Single Model studies that test a single model-based hypothesis; 6 percent are Competing Models studies that test competing model-based hypotheses; and 8 percent are Parameter Estimation studies that estimate structural parameters in a completely specified model. We also classify laboratory experiments published in these journals over the same period and find that economic theory has played a more central role in the laboratory than in the field. Finally, we discuss in detail three sets of field experiments—on gift exchange, on charitable giving, and on negative income tax—that illustrate both the benefits and the potential costs of a tighter link between experimental design and theoretical underpinnings.

Download Info

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
File URL: http://www.aeaweb.org/articles.php?doi=10.1257/jep.25.3.39
Download Restriction: no

Bibliographic Info

Article provided by American Economic Association in its journal Journal of Economic Perspectives.

Volume (Year): 25 (2011)
Issue (Month): 3 (Summer)
Pages: 39-62

as in new window
Handle: RePEc:aea:jecper:v:25:y:2011:i:3:p:39-62

Note: DOI: 10.1257/jep.25.3.39
Contact details of provider:
Email:
Web page: http://www.aeaweb.org/jep/
More information through EDIRC

Order Information:
Web: http://www.aeaweb.org/subscribe.html

Related research

Keywords:

Other versions of this item:

Find related papers by JEL classification:

References

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
as in new window
  1. Ernst Fehr & Lorenz Götte, 2005. "Do Workers Work More if Wages are High? Evidence from a Randomized Field Experiment," IEW - Working Papers 125, Institute for Empirical Research in Economics - University of Zurich.
  2. Tuma, Nancy Brandon & Robins, Philip K, 1980. "A Dynamic Model of Employment Behavior: An Application to the Seattle and Denver Income Maintenance Experiments," Econometrica, Econometric Society, vol. 48(4), pages 1031-52, May.
  3. Daniel Nagin & James Rebitzer & Seth Sanders & Lowell Taylor, 2002. "Monitoring, Motivation and Management: The Determinants of Opportunistic Behavior in a Field Experiment," NBER Working Papers 8811, National Bureau of Economic Research, Inc.
  4. Uri Gneezy & John List, 2006. "Putting behavioral economics to work: Testing for gift exchange in labor markets using field experiments," Natural Field Experiments 00259, The Field Experiments Website.
  5. Bandiera, Oriana & Barankay, Iwan & Rasul, Imran, 2006. "Incentives for Managers and Inequality Among Workers: Evidence from a Firm Level Experiment," IZA Discussion Papers 2062, Institute for the Study of Labor (IZA).
  6. Fehr, Ernst & Kirchsteiger, George & Riedl, Arno, 1993. "Does Fairness Prevent Market Clearing? An Experimental Investigation," The Quarterly Journal of Economics, MIT Press, vol. 108(2), pages 437-59, May.
  7. M. Rabin, 2001. "Incorporating Fairness into Game Theory and Economics," Levine's Working Paper Archive 511, David K. Levine.
  8. Bruce Sacerdote, 2000. "Peer Effects with Random Assignment: Results for Dartmouth Roommates," NBER Working Papers 7469, National Bureau of Economic Research, Inc.
  9. David K. Levine, 1998. "Modeling Altruism and Spitefulness in Experiment," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 1(3), pages 593-622, July.
  10. Bandiera, Oriana & Barankay, Iwan & Rasul, Imran, 2008. "Social Connections and Incentives in the Workplace: Evidence from Personnel Data," IZA Discussion Papers 3917, Institute for the Study of Labor (IZA).
  11. Stefano DellaVigna & John A. List & Ulrike Malmendier, 2012. "Testing for Altruism and Social Pressure in Charitable Giving," The Quarterly Journal of Economics, Oxford University Press, vol. 127(1), pages 1-56.
  12. LaLonde, Robert J, 1986. "Evaluating the Econometric Evaluations of Training Programs with Experimental Data," American Economic Review, American Economic Association, vol. 76(4), pages 604-20, September.
  13. Angrist, Joshua D, 1990. "Lifetime Earnings and the Vietnam Era Draft Lottery: Evidence from Social Security Administrative Records: Errata," American Economic Review, American Economic Association, vol. 80(5), pages 1284-86, December.
  14. Joshua Angrist, 1989. "Lifetime Earnings and the Vietnam Era Draft Lottery: Evidence from Social Security Administrative Records," Working Papers 631, Princeton University, Department of Economics, Industrial Relations Section..
  15. Edward Miguel & Michael Kremer, 2004. "Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities," Econometrica, Econometric Society, vol. 72(1), pages 159-217, 01.
  16. Angus S. Deaton, 2010. "Understanding the mechanisms of economic development," NBER Working Papers 15891, National Bureau of Economic Research, Inc.
  17. Axel Ockenfels & Gary E. Bolton, 2000. "ERC: A Theory of Equity, Reciprocity, and Competition," American Economic Review, American Economic Association, vol. 90(1), pages 166-193, March.
  18. Terry R. Johnson & John Pencavel, 1982. "Forecasting the effects of a negative income tax program," Industrial and Labor Relations Review, ILR Review, Cornell University, ILR School, vol. 35(2), pages 221-234, January.
  19. James J. Heckman & Jeffrey A. Smith, 1995. "Assessing the Case for Social Experiments," Journal of Economic Perspectives, American Economic Association, vol. 9(2), pages 85-110, Spring.
  20. Nicholas Barberis & Wei Xiong, 2006. "What Drives the Disposition Effect? An Analysis of a Long-Standing Preference-Based Explanation," NBER Working Papers 12397, National Bureau of Economic Research, Inc.
  21. Akerlof, George A, 1982. "Labor Contracts as Partial Gift Exchange," The Quarterly Journal of Economics, MIT Press, vol. 97(4), pages 543-69, November.
  22. Terrance Odean, 1998. "Are Investors Reluctant to Realize Their Losses?," Journal of Finance, American Finance Association, vol. 53(5), pages 1775-1798, October.
  23. Michael C. Keeley & Philip K. Robins, 1980. "Experimental Design, the Conlisk-Watts Assignment Model, and the Proper Estimation of Behavioral Response," Journal of Human Resources, University of Wisconsin Press, vol. 15(4), pages 480-498.
  24. repec:pri:rpdevs:deaton_understanding_mechanisms_of_economic_development_with_abstract_apr is not listed on IDEAS
Full references (including those not matched with items on IDEAS)

Citations

Blog mentions

As found by EconAcademics.org, the blog aggregator for Economics research:
  1. An incrementalist view of Impact Evaluation and knowledge
    by Jed Friedman in Development Impact on 2012-05-02 13:27:23
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
as in new window

Cited by:
  1. Rodney J. Andrews & Trevon D. Logan & Michael J. Sinkey, 2012. "Identifying Confirmatory Bias in the Field: Evidence from a Poll of Experts," NBER Working Papers 18064, National Bureau of Economic Research, Inc.
  2. Axel Franzen & Sonja Pointner, 2013. "The external validity of giving in the dictator game," Experimental Economics, Springer, vol. 16(2), pages 155-169, June.
  3. van der Klaauw, Bas, 2014. "From Micro Data to Causality: Forty Years of Empirical Labor Economics," IZA Discussion Papers 8047, Institute for the Study of Labor (IZA).
  4. Stefano DellaVigna & John A. List & Ulrike Malmendier & Gautam Rao, 2014. "Voting to Tell Others," NBER Working Papers 19832, National Bureau of Economic Research, Inc.
  5. Vojtech Bartos & Michal Bauer & Julie Chytilova & Filip Matejka, 2013. "Attention Discrimination: Theory and Field Experiments," CERGE-EI Working Papers wp499, The Center for Economic Research and Graduate Education - Economic Institute, Prague.
  6. Fink, Günther & McConnell, Margaret & Vollmer, Sebastian, 2011. "Testing for Heterogeneous Treatment Effects in Experimental Data: False Discovery Risks and Correction Procedures," Hannover Economic Papers (HEP) dp-477, Leibniz Universität Hannover, Wirtschaftswissenschaftliche Fakultät.
  7. Michèle Belot (University of Edinburgh) and Jonathan James (University of Bath), 2013. "Partner Selection into Policy Relevant Field Experiments," ESE Discussion Papers 236, Edinburgh School of Economics, University of Edinburgh.

Lists

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

Statistics

Access and download statistics

Corrections

When requesting a correction, please mention this item's handle: RePEc:aea:jecper:v:25:y:2011:i:3:p:39-62. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Jane Voros) or (Michael P. Albert).

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.