Advanced Search
MyIDEAS: Login

The Role of Theory in Field Experiments

Contents:

Author Info

  • David Card
  • Stefano DellaVigna
  • Ulrike Malmendier

Abstract

We propose a new classification of experiments that captures the extent to which the experimental design and analysis are linked to economic theory. We then use this system to classify all published field experiments in the five top economics journals from 1975 to 2010. We find that the vast majority of field experiments (68%) are Descriptive studies that lack any explicit model; 18% are Single Model studies that test a single model-based hypothesis; 6% are Competing Models studies that test competing model-based hypotheses; and 8% are Parameter Estimation studies that estimate structural parameters in a completely specified model. Using the same system to classify laboratory experiments published over the same period, we find that economic theory has played a more central role in the laboratory than in the field. Finally, we discuss in detail three sets of field experiments, on gift exchange, on charitable giving, and on negative income tax, that illustrate both the benefits and the potential costs of a tighter link between experimental design and theoretical underpinnings.

Download Info

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
File URL: http://www.nber.org/papers/w17047.pdf
Download Restriction: no

Bibliographic Info

Paper provided by National Bureau of Economic Research, Inc in its series NBER Working Papers with number 17047.

as in new window
Length:
Date of creation: May 2011
Date of revision:
Publication status: published as David Card & Stefano DellaVigna & Ulrike Malmendier, 2011. "The Role of Theory in Field Experiments," Journal of Economic Perspectives, American Economic Association, vol. 25(3), pages 39-62, Summer.
Handle: RePEc:nbr:nberwo:17047

Note: CH ED EEE HC HE IO LE LS PE POL
Contact details of provider:
Postal: National Bureau of Economic Research, 1050 Massachusetts Avenue Cambridge, MA 02138, U.S.A.
Phone: 617-868-3900
Email:
Web page: http://www.nber.org
More information through EDIRC

Related research

Keywords:

Other versions of this item:

Find related papers by JEL classification:

This paper has been announced in the following NEP Reports:

References

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
as in new window
  1. James J. Heckman & Jeffrey A. Smith, 1995. "Assessing the Case for Social Experiments," Journal of Economic Perspectives, American Economic Association, vol. 9(2), pages 85-110, Spring.
  2. David K Levine, 1997. "Modeling Altruism and Spitefulness in Experiments," Levine's Working Paper Archive 2047, David K. Levine.
  3. Angrist, Joshua D, 1990. "Lifetime Earnings and the Vietnam Era Draft Lottery: Evidence from Social Security Administrative Records," American Economic Review, American Economic Association, vol. 80(3), pages 313-36, June.
  4. Angus Deaton, 2010. "Understanding the Mechanisms of Economic Development," Journal of Economic Perspectives, American Economic Association, vol. 24(3), pages 3-16, Summer.
  5. Daniel S. Nagin & James B. Rebitzer & Seth Sanders & Lowell J. Taylor, 2002. "Monitoring, Motivation, and Management: The Determinants of Opportunistic Behavior in a Field Experiment," American Economic Review, American Economic Association, vol. 92(4), pages 850-873, September.
  6. Orana Bandiera & Iwan Barankay & Imran Rasul, 2006. "Incentives for managers and inequality among workers: Evidence from a firm level experiment," Natural Field Experiments 00213, The Field Experiments Website.
  7. Terrance Odean, 1998. "Are Investors Reluctant to Realize Their Losses?," Journal of Finance, American Finance Association, vol. 53(5), pages 1775-1798, October.
  8. Matthew Rabin., 1992. "Incorporating Fairness into Game Theory and Economics," Economics Working Papers 92-199, University of California at Berkeley.
  9. Stefano DellaVigna & John List & Ulrike Malmendier, 2012. "Testing for altruism and social pressure in charitable giving," Natural Field Experiments 00137, The Field Experiments Website.
  10. Ernst Fehr & Lorenz Goette, 2007. "Do Workers Work More if Wages Are High? Evidence from a Randomized Field Experiment," American Economic Review, American Economic Association, vol. 97(1), pages 298-317, March.
  11. Bruce Sacerdote, 2001. "Peer Effects With Random Assignment: Results For Dartmouth Roommates," The Quarterly Journal of Economics, MIT Press, vol. 116(2), pages 681-704, May.
  12. Bandiera, Oriana & Barankay, Iwan & Rasul, Imran, 2009. "Social Connections and Incentives in the Workplace: Evidence from Personnel Data," CEPR Discussion Papers 7114, C.E.P.R. Discussion Papers.
  13. Uri Gneezy & John A List, 2006. "Putting Behavioral Economics to Work: Testing for Gift Exchange in Labor Markets Using Field Experiments," Econometrica, Econometric Society, vol. 74(5), pages 1365-1384, 09.
  14. Terry R. Johnson & John Pencavel, 1982. "Forecasting the effects of a negative income tax program," Industrial and Labor Relations Review, ILR Review, Cornell University, ILR School, vol. 35(2), pages 221-234, January.
  15. Georg Kirchsteiger & Ernst Fehr & Arno Riedl, 1993. "Does Fairness Prevent Market Clearing? An Experimental Investigation," ULB Institutional Repository 2013/5927, ULB -- Universite Libre de Bruxelles.
  16. Nicholas Barberis & Wei Xiong, 2009. "What Drives the Disposition Effect? An Analysis of a Long-Standing Preference-Based Explanation," Journal of Finance, American Finance Association, vol. 64(2), pages 751-784, 04.
  17. Tuma, Nancy Brandon & Robins, Philip K, 1980. "A Dynamic Model of Employment Behavior: An Application to the Seattle and Denver Income Maintenance Experiments," Econometrica, Econometric Society, vol. 48(4), pages 1031-52, May.
  18. LaLonde, Robert J, 1986. "Evaluating the Econometric Evaluations of Training Programs with Experimental Data," American Economic Review, American Economic Association, vol. 76(4), pages 604-20, September.
  19. Angrist, Joshua D, 1990. "Lifetime Earnings and the Vietnam Era Draft Lottery: Evidence from Social Security Administrative Records: Errata," American Economic Review, American Economic Association, vol. 80(5), pages 1284-86, December.
  20. Axel Ockenfels & Gary E. Bolton, 2000. "ERC: A Theory of Equity, Reciprocity, and Competition," American Economic Review, American Economic Association, vol. 90(1), pages 166-193, March.
  21. Akerlof, George A, 1982. "Labor Contracts as Partial Gift Exchange," The Quarterly Journal of Economics, MIT Press, vol. 97(4), pages 543-69, November.
  22. Michael C. Keeley & Philip K. Robins, 1980. "Experimental Design, the Conlisk-Watts Assignment Model, and the Proper Estimation of Behavioral Response," Journal of Human Resources, University of Wisconsin Press, vol. 15(4), pages 480-498.
  23. Edward Miguel & Michael Kremer, 2004. "Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities," Econometrica, Econometric Society, vol. 72(1), pages 159-217, 01.
  24. repec:pri:rpdevs:deaton_understanding_mechanisms_of_economic_development_with_abstract_apr is not listed on IDEAS
Full references (including those not matched with items on IDEAS)

Citations

Blog mentions

As found by EconAcademics.org, the blog aggregator for Economics research:
  1. An incrementalist view of Impact Evaluation and knowledge
    by Jed Friedman in Development Impact on 2012-05-02 13:27:23
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
as in new window

Cited by:
  1. Vojtech Bartos & Michal Bauer & Julie Chytilova & Filip Matejka, 2013. "Attention Discrimination: Theory and Field Experiments," CERGE-EI Working Papers wp499, The Center for Economic Research and Graduate Education - Economic Institute, Prague.
  2. Fink, Günther & McConnell, Margaret & Vollmer, Sebastian, 2011. "Testing for Heterogeneous Treatment Effects in Experimental Data: False Discovery Risks and Correction Procedures," Hannover Economic Papers (HEP) dp-477, Leibniz Universität Hannover, Wirtschaftswissenschaftliche Fakultät.
  3. Michèle Belot (University of Edinburgh) and Jonathan James (University of Bath), 2013. "Partner Selection into Policy Relevant Field Experiments," ESE Discussion Papers 236, Edinburgh School of Economics, University of Edinburgh.
  4. Rodney J. Andrews & Trevon D. Logan & Michael J. Sinkey, 2012. "Identifying Confirmatory Bias in the Field: Evidence from a Poll of Experts," NBER Working Papers 18064, National Bureau of Economic Research, Inc.
  5. van der Klaauw, Bas, 2014. "From Micro Data to Causality: Forty Years of Empirical Labor Economics," IZA Discussion Papers 8047, Institute for the Study of Labor (IZA).
  6. Stefano DellaVigna & John A. List & Ulrike Malmendier & Gautam Rao, 2014. "Voting to Tell Others," NBER Working Papers 19832, National Bureau of Economic Research, Inc.
  7. Axel Franzen & Sonja Pointner, 2013. "The external validity of giving in the dictator game," Experimental Economics, Springer, vol. 16(2), pages 155-169, June.

Lists

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

Statistics

Access and download statistics

Corrections

When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:17047. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ().

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.