Advanced Search
MyIDEAS: Login to save this article or follow this journal

Field Experiments: A Bridge between Lab and Naturally Occurring Data

Contents:

Author Info

  • List John A.

    ()
    (University of Chicago and NBER)

Abstract

Laboratory experiments have been used extensively in economics in the past several decades to lend both positive and normative insights into a myriad of important economic issues. This study discusses a related approach that has increasingly grown in prominence of late—field experiments. I argue that field experiments serve as a useful bridge between data generated in the lab and empirical studies using naturally-occurring data. In discussing this relationship, I highlight that field experiments can yield important insights into economic theory and provide useful guidance to policymakers. I also draw attention to an important methodological contribution of field experiments: they provide an empirical account of behavioral principles that are shared across different domains. In this regard, at odds with conventional wisdom, I argue that representativeness of the environment, rather than representative of the sampled population, is the most crucial variable in determining generalizability of results for a large class of experimental laboratory games.

Download Info

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
File URL: http://www.degruyter.com/view/j/bejeap.2006.5.2/bejeap.2006.5.2.1747/bejeap.2006.5.2.1747.xml?format=INT
Download Restriction: For access to full text, subscription to the journal or payment for the individual article is required.

As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.

Bibliographic Info

Article provided by De Gruyter in its journal The B.E. Journal of Economic Analysis & Policy.

Volume (Year): 5 (2007)
Issue (Month): 2 (April)
Pages: 1-47

as in new window
Handle: RePEc:bpj:bejeap:v:advances.6:y:2007:i:2:n:8

Contact details of provider:
Web page: http://www.degruyter.com

Order Information:
Web: http://www.degruyter.com/view/j/bejeap

Related research

Keywords:

Other versions of this item:

Find related papers by JEL classification:

References

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
as in new window
  1. Dean S. Karlan, 2005. "Using Experimental Economics to Measure Social Capital and Predict Financial Decisions," Working Papers, Princeton University, Woodrow Wilson School of Public and International Affairs, Research Program in Development Studies. 182, Princeton University, Woodrow Wilson School of Public and International Affairs, Research Program in Development Studies..
  2. Riach Peter A & Rich Judith, 2006. "An Experimental Investigation of Sexual Discrimination in Hiring in the English Labor Market," The B.E. Journal of Economic Analysis & Policy, De Gruyter, De Gruyter, vol. 5(2), pages 1-22, January.
  3. Carpenter, Jeffrey P. & Daniere, Amrita G. & Takahashi, Lois M., 2004. "Cooperation, trust, and social capital in Southeast Asian urban slums," Journal of Economic Behavior & Organization, Elsevier, Elsevier, vol. 55(4), pages 533-551, December.
  4. Neumark, David, 1996. "Sex Discrimination in Restaurant Hiring: An Audit Study," The Quarterly Journal of Economics, MIT Press, MIT Press, vol. 111(3), pages 915-41, August.
  5. Goldberg, Pinelopi Koujianou, 1996. "Dealer Price Discrimination in New Car Purchases: Evidence from the Consumer Expenditure Survey," Journal of Political Economy, University of Chicago Press, University of Chicago Press, vol. 104(3), pages 622-54, June.
  6. Glenn Harrison & John List, 2004. "Field experiments," Artefactual Field Experiments 00058, The Field Experiments Website.
  7. Matthias Benz & Stephan Meier, 2006. "Do people behave in experiments as in the field?: evidence from donations," Working Papers, Federal Reserve Bank of Boston 06-8, Federal Reserve Bank of Boston.
  8. John A. List & David Lucking-Reiley, 2000. "The Effects of Seed Money and Refunds on Charitable Giving: Experimental Evidence from a University Capital Campaign," Vanderbilt University Department of Economics Working Papers 0008, Vanderbilt University Department of Economics.
  9. Oriana Bandiera & Iwan Barankay & Imran Rasul, 2005. "Social Preferences and the Response to Incentives: Evidence from Personnel Data," The Quarterly Journal of Economics, MIT Press, MIT Press, vol. 120(3), pages 917-962, August.
  10. Richard Blundell & Monica Costa Dias, 2008. "Alternative approaches to evaluation in empirical microeconomics," CeMMAP working papers, Centre for Microdata Methods and Practice, Institute for Fiscal Studies CWP26/08, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
  11. Jan Kmenta & James B. Ramsey, 1980. "Evaluation of Econometric Models," NBER Books, National Bureau of Economic Research, Inc, number kmen80-1.
  12. List John A. & Sinha Paramita & Taylor Michael H., 2006. "Using Choice Experiments to Value Non-Market Goods and Services: Evidence from Field Experiments," The B.E. Journal of Economic Analysis & Policy, De Gruyter, De Gruyter, vol. 5(2), pages 1-39, January.
  13. Ernst Fehr & John A. List, 2004. "THE HIDDEN COSTS AND RETURNS OF INCENTIVES — TRUST AND TRUSTWORTHINESS AMONG CEOs," Labor and Demography, EconWPA 0409012, EconWPA.
  14. Bruno S. Frey & Stephan Meier, 2004. "Social Comparisons and Pro-social Behavior: Testing "Conditional Cooperation" in a Field Experiment," American Economic Review, American Economic Association, American Economic Association, vol. 94(5), pages 1717-1722, December.
  15. Roth, Alvin E, 1988. "Laboratory Experimentation in Economics: A Methodological Overview," Economic Journal, Royal Economic Society, Royal Economic Society, vol. 98(393), pages 974-1031, December.
  16. Arthur Schram, 2005. "Artificiality: The tension between internal and external validity in economic experiments," Journal of Economic Methodology, Taylor & Francis Journals, Taylor & Francis Journals, vol. 12(2), pages 225-237.
  17. R. Isaac & David Schmidtz & James Walker, 1989. "The assurance problem in a laboratory market," Public Choice, Springer, Springer, vol. 62(3), pages 217-236, September.
  18. Craig Landry & Andreas Lange & John A. List & Michael K. Price & Nicholas G. Rupp, 2005. "Toward an Understanding of the Economics of Charity: Evidence from a Field Experiment," NBER Working Papers 11611, National Bureau of Economic Research, Inc.
  19. Catherine Eckel & Philip Grossman, 2005. "Subsidizing charitable contributions: A field test comparing matching and rebate subsidies," Framed Field Experiments 00145, The Field Experiments Website.
  20. Jonathan Alevy & Michael Haigh & John List, 2005. "Information cascades: Evidence from a field experiment with financial market professionals," Framed Field Experiments 00116, The Field Experiments Website.
  21. Juan-Camilo Cardenas, 2002. "Real wealth and experimental cooperation: Evidence from field experiments," Artefactual Field Experiments 00019, The Field Experiments Website.
  22. Dean Karlan & John A. List, 2006. "Does Price Matter in Charitable Giving? Evidence from a Large-Scale Natural Field Experiment," Working Papers, The Field Experiments Website 1, The Field Experiments Website.
  23. Kremer, Michael R. & Miguel, Edward & Thornton, Rebecca, 2009. "Incentives to Learn," Scholarly Articles 3716457, Harvard University Department of Economics.
  24. John List, 2006. "The behavioralist meets the market: Measuring social preferences and reputation effects in actual transactions," Natural Field Experiments 00300, The Field Experiments Website.
  25. John A. List, 2003. "Does Market Experience Eliminate Market Anomalies?," The Quarterly Journal of Economics, MIT Press, MIT Press, vol. 118(1), pages 41-71, February.
  26. Dean Karlan & Xavier Giné, 2007. "Group Versus Individual Liability: A Field Experiment in the Philippines," Working Papers, Center for Global Development 111, Center for Global Development.
  27. Peter Riach & Judith Rich, 2006. "An experimental investigation of sexual discrimination in hiring in the english labor market," Natural Field Experiments 00329, The Field Experiments Website.
  28. Carpenter, Jeffrey P. & Seki, Erika, 2005. "Competitive Work Environments and Social Preferences: Field Experimental Evidence from a Japanese Fishing Community," IZA Discussion Papers 1691, Institute for the Study of Labor (IZA).
  29. John List & Imran Rasul, 2010. "Field experiments in labor economics," Artefactual Field Experiments 00092, The Field Experiments Website.
  30. Nava Ashraf & Dean S. Karlan & Wesley Yin, 2005. "Tying Odysseus to the Mast: Evidence from a Commitment Savings Product in the Philippines," Working Papers, Economic Growth Center, Yale University 917, Economic Growth Center, Yale University.
  31. Cummings, Ronald G, et al, 1997. "Are Hypothetical Referenda Incentive Compatible?," Journal of Political Economy, University of Chicago Press, University of Chicago Press, vol. 105(3), pages 609-21, June.
  32. Fehr, Ernst & Kirchsteiger, George & Riedl, Arno, 1993. "Does Fairness Prevent Market Clearing? An Experimental Investigation," The Quarterly Journal of Economics, MIT Press, MIT Press, vol. 108(2), pages 437-59, May.
  33. Bailey Norwood & Jayson Lusk, 2006. "Instrument-induced bias in donation mechanisms: Evidence from the field," Framed Field Experiments 00194, The Field Experiments Website.
  34. Abhijit Banerjee & Shawn Cole & Esther Duflo & Leigh Linden, 2005. "Remedying education: Evidence from two randomized experiments in india," Framed Field Experiments 00122, The Field Experiments Website.
  35. John Yinger, 1998. "Evidence on Discrimination in Consumer Markets," Journal of Economic Perspectives, American Economic Association, American Economic Association, vol. 12(2), pages 23-40, Spring.
  36. David Lucking-Reiley, 1999. "Using Field Experiments to Test Equivalence between Auction Formats: Magic on the Internet," American Economic Review, American Economic Association, American Economic Association, vol. 89(5), pages 1063-1080, December.
  37. Joseph Henrich & Robert Boyd & Samuel Bowles & Colin Camerer & Herbert Gintis & Richard McElreath & Ernst Fehr, 2001. "In search of homo economicus: Experiments in 15 small-scale societies," Artefactual Field Experiments 00068, The Field Experiments Website.
  38. John List, 2004. "Neoclassical theory versus prospect theory: Evidence from the marketplace," Framed Field Experiments 00174, The Field Experiments Website.
  39. repec:feb:artefa:00073 is not listed on IDEAS
  40. David Porter & Roumen Vragov, 2006. "An experimental examination of demand reduction in multi-unit versions of the Uniform-price, Vickrey, and English auctions," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 27(6), pages 445-458.
  41. John G. Cross, 1980. "Some Comments on the Papers by Kagel and Battalio and by Smith," NBER Chapters, in: Evaluation of Econometric Models, pages 403-406 National Bureau of Economic Research, Inc.
  42. Marianne Bertrand & Sendhil Mullainathan, 2004. "Are Emily and Greg More Employable Than Lakisha and Jamal? A Field Experiment on Labor Market Discrimination," American Economic Review, American Economic Association, American Economic Association, vol. 94(4), pages 991-1013, September.
  43. repec:feb:framed:0081 is not listed on IDEAS
  44. John List, 2004. "The nature and extent of discrimination in the marketplace: Evidence from the field," Natural Field Experiments 00299, The Field Experiments Website.
  45. Smith, Vernon L, 1982. "Microeconomic Systems as an Experimental Science," American Economic Review, American Economic Association, American Economic Association, vol. 72(5), pages 923-55, December.
  46. Dean Karlan & Xavier Gine & Jonathan Morduch & Pamela Jakiela, 2006. "Microfinance Games," Working Papers, Economic Growth Center, Yale University 936, Economic Growth Center, Yale University.
  47. Phelps, Edmund S, 1972. "The Statistical Theory of Racism and Sexism," American Economic Review, American Economic Association, American Economic Association, vol. 62(4), pages 659-61, September.
  48. P. A. Riach & J. Rich, 2002. "Field Experiments of Discrimination in the Market Place," Economic Journal, Royal Economic Society, Royal Economic Society, vol. 112(483), pages 480-518, November.
  49. David Lucking-Reiley & John A. List, 2000. "Demand Reduction in Multiunit Auctions: Evidence from a Sportscard Field Experiment," American Economic Review, American Economic Association, American Economic Association, vol. 90(4), pages 961-972, September.
  50. Cooper David J, 2006. "Are Experienced Managers Experts at Overcoming Coordination Failure?," The B.E. Journal of Economic Analysis & Policy, De Gruyter, De Gruyter, vol. 5(2), pages 1-52, May.
  51. Rapoport, Amnon & Eshed-Levy, Dalit, 1989. "Provision of step-level public goods: Effects of greed and fear of being gypped," Organizational Behavior and Human Decision Processes, Elsevier, Elsevier, vol. 44(3), pages 325-344, December.
  52. Jonathan E. Alevy & Michael S. Haigh & John List, 2006. "Information Cascades: Evidence from An Experiment with Financial Market Professionals," NBER Working Papers 12767, National Bureau of Economic Research, Inc.
  53. John List, 2004. "Testing neoclassical competitive theory in multi-lateral decentralized markets," Framed Field Experiments 00176, The Field Experiments Website.
  54. Akerlof, George A, 1980. "A Theory of Social Custom, of Which Unemployment May be One Consequence," The Quarterly Journal of Economics, MIT Press, MIT Press, vol. 94(4), pages 749-75, June.
  55. David Cooper, 2006. "Are experienced managers experts at overcoming coordination failure?," Artefactual Field Experiments 00037, The Field Experiments Website.
  56. Bohm, Peter, 1972. "Estimating demand for public goods: An experiment," European Economic Review, Elsevier, Elsevier, vol. 3(2), pages 111-130.
  57. Chris Starmer, 1999. "Experiments in economics: should we trust the dismal scientists in white coats?," Journal of Economic Methodology, Taylor & Francis Journals, Taylor & Francis Journals, vol. 6(1), pages 1-30.
  58. Jeff Carpenter & Glenn Harrison & John List, 2005. "Field experiments in economics: An introduction," Artefactual Field Experiments 00034, The Field Experiments Website.
  59. John A. List & Robert P. Berrens & Alok K. Bohara & Joe Kerkvliet, 2004. "Examining the Role of Social Isolation on Stated Preferences," American Economic Review, American Economic Association, American Economic Association, vol. 94(3), pages 741-752, June.
  60. Graham Loomes & Chris Starmer & Robert Sugden, 2003. "Do Anomalies Disappear in Repeated Markets?," Economic Journal, Royal Economic Society, Royal Economic Society, vol. 113(486), pages C153-C166, March.
  61. repec:feb:artefa:0109 is not listed on IDEAS
  62. Hossain Tanjim & Morgan John, 2006. "...Plus Shipping and Handling: Revenue (Non) Equivalence in Field Experiments on eBay," The B.E. Journal of Economic Analysis & Policy, De Gruyter, De Gruyter, vol. 5(2), pages 1-30, January.
  63. John List & Craig Gallet, 2001. "What Experimental Protocol Influence Disparities Between Actual and Hypothetical Stated Values?," Environmental & Resource Economics, European Association of Environmental and Resource Economists, European Association of Environmental and Resource Economists, vol. 20(3), pages 241-254, November.
  64. John List, 2001. "Do explicit warnings eliminate the hypothetical bias in elicitation procedures? Evidence from field auctions for sportscards," Framed Field Experiments 00163, The Field Experiments Website.
  65. Vernon L. Smith, 1962. "An Experimental Study of Competitive Market Behavior," Journal of Political Economy, University of Chicago Press, University of Chicago Press, vol. 70, pages 111.
  66. Chen Yan & Li Xin & MacKie-Mason Jeffrey K, 2005. "Online Fund-Raising Mechanisms: A Field Experiment," The B.E. Journal of Economic Analysis & Policy, De Gruyter, De Gruyter, vol. 5(2), pages 1-39, December.
  67. James T. Hong & Charles R. Plott, 1982. "Rate Filing Policies for Inland Water Transportation: An Experimental Approach," Bell Journal of Economics, The RAND Corporation, The RAND Corporation, vol. 13(1), pages 1-19, Spring.
  68. Benjamin Olken, 2005. "Monitoring corruption: Evidence from a field experiment in indonesia," Natural Field Experiments 00317, The Field Experiments Website.
  69. Dirk Engelmann & Veronika Grimm, 2009. "Bidding Behaviour in Multi-Unit Auctions - An Experimental Investigation," Economic Journal, Royal Economic Society, Royal Economic Society, vol. 119(537), pages 855-882, 04.
  70. Yan Chen & Xin Li & Jeffrey MacKie-Mason, 2006. "Online fund-raising mechanisms: A field experiment," Natural Field Experiments 00225, The Field Experiments Website.
  71. Peter Riach & Judith Rich, 2002. "Field experiments of discrimination in the market place," Natural Field Experiments 00328, The Field Experiments Website.
  72. Catherine Eckel & Philip Grossman, 2008. "Subsidizing charitable contributions: a natural field experiment comparing matching and rebate subsidies," Experimental Economics, Springer, Springer, vol. 11(3), pages 234-252, September.
  73. Duflo, Esther & Dupas, Pascaline & Kremer, Michael & Sinei, Samuel, 2006. "Education and HIV/AIDS prevention : evidence from a randomized evaluation in Western Kenya," Policy Research Working Paper Series 4024, The World Bank.
  74. Kagel, John H & Levin, Dan, 2001. "Behavior in Multi-unit Demand Auctions: Experiments with Uniform Price and Dynamic Vickrey Auctions," Econometrica, Econometric Society, Econometric Society, vol. 69(2), pages 413-54, March.
  75. Meier Stephan, 2005. "Does Framing Matter for Conditional Cooperation? Evidence from a Natural Field Experiment," The B.E. Journal of Economic Analysis & Policy, De Gruyter, De Gruyter, vol. 5(2), pages 1-21, December.
  76. Laura O. Taylor & Ronald G. Cummings, 1999. "Unbiased Value Estimates for Environmental Goods: A Cheap Talk Design for the Contingent Valuation Method," American Economic Review, American Economic Association, American Economic Association, vol. 89(3), pages 649-665, June.
  77. Bandiera Oriana & Barankay Iwan & Rasul Imran, 2006. "The Evolution of Cooperative Norms: Evidence from a Natural Field Experiment," The B.E. Journal of Economic Analysis & Policy, De Gruyter, De Gruyter, vol. 5(2), pages 1-28, March.
  78. Juan-Camilo Cardenas, 2004. "Norms from outside and from inside: An experimental analysis on the governance of local ecosystems," Artefactual Field Experiments 00025, The Field Experiments Website.
  79. Joseph Henrich, 2001. "In Search of Homo Economicus: Behavioral Experiments in 15 Small-Scale Societies," American Economic Review, American Economic Association, American Economic Association, vol. 91(2), pages 73-78, May.
  80. Ayres, Ian & Siegelman, Peter, 1995. "Race and Gender Discrimination in Bargaining for a New Car," American Economic Review, American Economic Association, American Economic Association, vol. 85(3), pages 304-21, June.
  81. Bagnoli, Mark & McKee, Michael, 1991. "Voluntary Contribution Games: Efficient Private Provision of Public Goods," Economic Inquiry, Western Economic Association International, Western Economic Association International, vol. 29(2), pages 351-66, April.
  82. Frank P. Stafford, 1980. "Some Comments on the Papers by Kagel and Battalio and by Smith," NBER Chapters, in: Evaluation of Econometric Models, pages 407-410 National Bureau of Economic Research, Inc.
  83. Starmer, C., 1998. "Experimental Economics: Hard Science or Wasteful Tinkering," University of East Anglia Discussion Papers in Economics, School of Economics, University of East Anglia, Norwich, UK. 9802, School of Economics, University of East Anglia, Norwich, UK..
  84. Peter Bohm, 1972. "Estimating the demand for public goods: An experiment," Framed Field Experiments 00126, The Field Experiments Website.
  85. Bagnoli, Mark & Lipman, Barton L, 1989. "Provision of Public Goods: Fully Implementing the Core through Private Contributions," Review of Economic Studies, Wiley Blackwell, Wiley Blackwell, vol. 56(4), pages 583-601, October.
  86. Kahneman, Daniel & Knetsch, Jack L & Thaler, Richard H, 1990. "Experimental Tests of the Endowment Effect and the Coase Theorem," Journal of Political Economy, University of Chicago Press, University of Chicago Press, vol. 98(6), pages 1325-48, December.
  87. Steven D. Levitt & John A. List, 2007. "What Do Laboratory Experiments Measuring Social Preferences Reveal About the Real World?," Journal of Economic Perspectives, American Economic Association, American Economic Association, vol. 21(2), pages 153-174, Spring.
  88. John List & David Lucking-Reiley, 2000. "Demand reduction in a multi-unit auction: Evidence from a sportscard field experiment," Framed Field Experiments 00180, The Field Experiments Website.
  89. Camerer, Colin & Weigelt, Keith, 1988. "Experimental Tests of a Sequential Equilibrium Reputation Model," Econometrica, Econometric Society, Econometric Society, vol. 56(1), pages 1-36, January.
  90. repec:feb:framed:0052 is not listed on IDEAS
Full references (including those not matched with items on IDEAS)

Citations

Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
as in new window

Cited by:
This item has more than 25 citations. To prevent cluttering this page, these citations are listed on a separate page.

Lists

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

Statistics

Access and download statistics

Corrections

When requesting a correction, please mention this item's handle: RePEc:bpj:bejeap:v:advances.6:y:2007:i:2:n:8. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Peter Golla).

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.