IDEAS home Printed from https://ideas.repec.org/p/feb/artefa/00001.html
   My bibliography  Save this paper

Viewpoint: On the generalizability of lab behaviour to the field

Author

Listed:
  • Steven Levitt
  • John List

Abstract

We can think of no question more fundamental to experimental economics than understanding whether, and under what circumstances, laboratory results generalize to naturally occurring environments. In this paper, we extend Levitt and List (2006) to the class of games in which financial payoffs and doing the right thing are not necessarily in conflict. We argue that behaviour is crucially linked to not only the preferences of people, but also the properties of the situation. By doing so, we are able to provide a road map of the psychological and economic properties of people and situations that might interfere with generalizability of laboratory result from a broad class of games.

Suggested Citation

  • Steven Levitt & John List, 2007. "Viewpoint: On the generalizability of lab behaviour to the field," Artefactual Field Experiments 00001, The Field Experiments Website.
  • Handle: RePEc:feb:artefa:00001
    as

    Download full text from publisher

    File URL: http://s3.amazonaws.com/fieldexperiments-papers2/papers/00001.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Ernst Fehr & Simon Gächter, 2000. "Fairness and Retaliation: The Economics of Reciprocity," Journal of Economic Perspectives, American Economic Association, vol. 14(3), pages 159-181, Summer.
    2. Becker, Gary S, 1974. "A Theory of Social Interactions," Journal of Political Economy, University of Chicago Press, vol. 82(6), pages 1063-1093, Nov.-Dec..
    3. Camerer, Colin F & Hogarth, Robin M, 1999. "The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework," Journal of Risk and Uncertainty, Springer, vol. 19(1-3), pages 7-42, December.
    4. Edi Karni, 1998. "Impartiality: Definition and Representation," Econometrica, Econometric Society, vol. 66(6), pages 1405-1416, November.
    5. Camerer, Colin, 1992. "The rationality of prices and volume in experimental markets," Organizational Behavior and Human Decision Processes, Elsevier, vol. 51(2), pages 237-272, March.
    6. Muriel Niederle & Alvin E. Roth, 2003. "Unraveling Reduces Mobility in a Labor Market: Gastroenterology with and without a Centralized Match," Journal of Political Economy, University of Chicago Press, vol. 111(6), pages 1342-1352, December.
    7. Conlin, Michael & Lynn, Michael & O'Donoghue, Ted, 2003. "The norm of restaurant tipping," Journal of Economic Behavior & Organization, Elsevier, vol. 52(3), pages 297-321, November.
    8. Charles R. Plott, 1997. "Laboratory Experimental Testbeds: Application to the PCS Auction," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 6(3), pages 605-638, September.
    9. Glenn W. Harrison & John A. List, 2004. "Field Experiments," Journal of Economic Literature, American Economic Association, vol. 42(4), pages 1009-1055, December.
    10. George A. Akerlof & Rachel E. Kranton, 2005. "Identity and the Economics of Organizations," Journal of Economic Perspectives, American Economic Association, vol. 19(1), pages 9-32, Winter.
    11. Roth, Alvin E, 1991. "A Natural Experiment in the Organization of Entry-Level Labor Markets: Regional Markets for New Physicians and Surgeons in the United Kingdom," American Economic Review, American Economic Association, vol. 81(3), pages 415-440, June.
    12. Gary Charness & Dan Levin, 2009. "The Origin of the Winner's Curse: A Laboratory Study," American Economic Journal: Microeconomics, American Economic Association, vol. 1(1), pages 207-236, February.
    13. Chris Starmer, 1999. "Experiments in economics: should we trust the dismal scientists in white coats?," Journal of Economic Methodology, Taylor & Francis Journals, vol. 6(1), pages 1-30.
    14. Starmer, Chris, 1999. "Experimental Economics: Hard Science or Wasteful Tinkering?," Economic Journal, Royal Economic Society, vol. 109(453), pages 5-15, February.
    15. Dean S. Karlan, 2005. "Using Experimental Economics to Measure Social Capital and Predict Financial Decisions," American Economic Review, American Economic Association, vol. 95(5), pages 1688-1699, December.
    16. Vernon L. Smith, 1962. "An Experimental Study of Competitive Market Behavior," Journal of Political Economy, University of Chicago Press, vol. 70(2), pages 111-111.
    17. John H. Kagel & Dan Levin, 1999. "Common Value Auctions with Insider Information," Econometrica, Econometric Society, vol. 67(5), pages 1219-1238, September.
    18. David Lucking-Reiley & John A. List, 2000. "Demand Reduction in Multiunit Auctions: Evidence from a Sportscard Field Experiment," American Economic Review, American Economic Association, vol. 90(4), pages 961-972, September.
    19. Myagkov, Mikhail & Plott, Charles R, 1997. "Exchange Economies and Loss Exposure: Experiments Exploring Prospect Theory and Competitive Equilibria in Market Environments," American Economic Review, American Economic Association, vol. 87(5), pages 801-828, December.
    20. Stefano DellaVigna & Ulrike Malmendier, 2006. "Paying Not to Go to the Gym," American Economic Review, American Economic Association, vol. 96(3), pages 694-719, June.
    21. Kotchen, Matthew J., 2005. "Impure public goods and the comparative statics of environmentally friendly consumption," Journal of Environmental Economics and Management, Elsevier, vol. 49(2), pages 281-300, March.
    22. John A. List, 2004. "Neoclassical Theory Versus Prospect Theory: Evidence from the Marketplace," Econometrica, Econometric Society, vol. 72(2), pages 615-625, March.
    23. Plott, Charles R, 1982. "Industrial Organization Theory and Experimental Economics," Journal of Economic Literature, American Economic Association, vol. 20(4), pages 1485-1527, December.
    24. Ernst Fehr & Georg Kirchsteiger & Arno Riedl, 1993. "Does Fairness Prevent Market Clearing? An Experimental Investigation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 108(2), pages 437-459.
    25. James Cox & Sam Dinkin & James Swarthout, 2001. "Endogenous Entry and Exit in Common Value Auctions," Experimental Economics, Springer;Economic Science Association, vol. 4(2), pages 163-181, October.
    26. Smith, Vernon L, 1982. "Microeconomic Systems as an Experimental Science," American Economic Review, American Economic Association, vol. 72(5), pages 923-955, December.
    27. John A. List, 2004. "Testing Neoclassical Competitive Theory in Multilateral Decentralized Markets," Journal of Political Economy, University of Chicago Press, vol. 112(5), pages 1131-1156, October.
    28. Levine, Michael E. & Plott, Charles R., "undated". "Agenda Influence and Its Implications," Working Papers 151, California Institute of Technology, Division of the Humanities and Social Sciences.
    29. George A. Akerlof & Rachel E. Kranton, 2000. "Economics and Identity," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 115(3), pages 715-753.
    30. Smith, Vernon L & Walker, James M, 1993. "Rewards, Experience and Decision Costs in First Price Auctions," Economic Inquiry, Western Economic Association International, vol. 31(2), pages 237-245, April.
    31. Kreps,David M. & Wallis,Kenneth F. (ed.), 1997. "Advances in Economics and Econometrics: Theory and Applications," Cambridge Books, Cambridge University Press, number 9780521589819, September.
    32. William D. Grampp, 1948. "Adam Smith and the Economic Man," Journal of Political Economy, University of Chicago Press, vol. 56(4), pages 315-315.
    33. David Genesove & Christopher Mayer, 2001. "Loss Aversion and Seller Behavior: Evidence from the Housing Market," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(4), pages 1233-1260.
    34. Jonathan E. Alevy & Michael S. Haigh & John List, 2006. "Information Cascades: Evidence from An Experiment with Financial Market Professionals," NBER Working Papers 12767, National Bureau of Economic Research, Inc.
    35. Steffen Andersen & Glenn Harrison & Morten Lau & Elisabet Rutstrom, 2004. "Preference heterogeneity in experiments: Comparing the field and lab," Artefactual Field Experiments 00004, The Field Experiments Website.
    36. John Haltiwanger & Michael Waldman, 1989. "Limited Rationality and Strategic Complements: The Implications for Macroeconomics," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 104(3), pages 463-483.
    37. John A. List, 2003. "Does Market Experience Eliminate Market Anomalies?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(1), pages 41-71.
    38. C. Nicholas McKinney & Muriel Niederle & Alvin E. Roth, 2005. "The Collapse of a Medical Labor Clearinghouse (and Why Such Failures Are Rare)," American Economic Review, American Economic Association, vol. 95(3), pages 878-889, June.
    39. repec:bla:econom:v:42:y:1975:i:168:p:430-37 is not listed on IDEAS
    40. Camerer, Colin & Weigelt, Keith, 1988. "Experimental Tests of a Sequential Equilibrium Reputation Model," Econometrica, Econometric Society, vol. 56(1), pages 1-36, January.
    41. Knez, Peter & Smith, Vernon L & Williams, Arlington W, 1985. "Individual Rationality, Market Rationality, and Value Estimation," American Economic Review, American Economic Association, vol. 75(2), pages 397-402, May.
    42. Harrison, Glenn W. & Lau, Morten I. & Elisabet Rutström, E., 2009. "Risk attitudes, randomization to treatment, and self-selection into experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 70(3), pages 498-507, June.
    43. Frey, Bruno S & Oberholzer-Gee, Felix & Eichenberger, Reiner, 1996. "The Old Lady Visits Your Backyard: A Tale of Morals and Markets," Journal of Political Economy, University of Chicago Press, vol. 104(6), pages 1297-1313, December.
    44. Kreps,David M. & Wallis,Kenneth F. (ed.), 1997. "Advances in Economics and Econometrics: Theory and Applications," Cambridge Books, Cambridge University Press, number 9780521589826, September.
    45. Sugden, Robert, 1984. "Reciprocity: The Supply of Public Goods through Voluntary Contributions," Economic Journal, Royal Economic Society, vol. 94(376), pages 772-787, December.
    46. Roth, Alvin E, 1988. "Laboratory Experimentation in Economics: A Methodological Overview," Economic Journal, Royal Economic Society, vol. 98(393), pages 974-1031, December.
    47. repec:feb:framed:0081 is not listed on IDEAS
    48. Glenn W. Harrison & Morten I. Lau & E. Elisabet Rutström, 2007. "Estimating Risk Attitudes in Denmark: A Field Experiment," Scandinavian Journal of Economics, Wiley Blackwell, vol. 109(2), pages 341-368, June.
    49. Marco Casari & John C. Ham & John H. Kagel, 2007. "Selection Bias, Demographic Effects, and Ability Effects in Common Value Auction Experiments," American Economic Review, American Economic Association, vol. 97(4), pages 1278-1304, September.
    50. repec:pri:rpdevs:gamespaper.pdf is not listed on IDEAS
    51. repec:feb:artefa:00073 is not listed on IDEAS
    52. Bernheim, B Douglas, 1994. "A Theory of Conformity," Journal of Political Economy, University of Chicago Press, vol. 102(5), pages 841-877, October.
    53. Brookshire, David S & Coursey, Don L & Schulze, William D, 1987. "The External Validity of Experimental Economics Techniques: Analysis of Demand Behavior," Economic Inquiry, Western Economic Association International, vol. 25(2), pages 239-250, April.
    54. Kreps,David M. & Wallis,Kenneth F. (ed.), 1997. "Advances in Economics and Econometrics: Theory and Applications," Cambridge Books, Cambridge University Press, number 9780521589833, September.
    55. David J. Cooper, 1999. "Gaming against Managers in Incentive Systems: Experimental Results with Chinese Students and Chinese Managers," American Economic Review, American Economic Association, vol. 89(4), pages 781-804, September.
    56. Kahneman, Daniel & Knetsch, Jack L & Thaler, Richard H, 1990. "Experimental Tests of the Endowment Effect and the Coase Theorem," Journal of Political Economy, University of Chicago Press, vol. 98(6), pages 1325-1348, December.
    57. Ernst Fehr & Jean-Robert Tyran, 2001. "Does Money Illusion Matter?," American Economic Review, American Economic Association, vol. 91(5), pages 1239-1262, December.
    58. Haltiwanger, John & Waldman, Michael, 1985. "Rational Expectations and the Limits of Rationality: An Analysis of Heterogeneity," American Economic Review, American Economic Association, vol. 75(3), pages 326-340, June.
    59. Don L. Coursey & John L. Hovis & William D. Schulze, 1987. "The Disparity Between Willingness to Accept and Willingness to Pay Measures of Value," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 102(3), pages 679-690.
    60. John H. Kagel & Alvin E. Roth, 2000. "The Dynamics of Reorganization in Matching Markets: A Laboratory Experiment Motivated by a Natural Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 115(1), pages 201-235.
    61. Ernst Fehr & Jean-Robert Tyran, 2005. "Individual Irrationality and Aggregate Outcomes," Journal of Economic Perspectives, American Economic Association, vol. 19(4), pages 43-66, Fall.
    62. Kagel, John H & Levin, Dan & Harstad, Ronald M, 1995. "Comparative Static Effects of Number of Bidders and Public Information on Behavior in Second-Price Common Value Auctions," International Journal of Game Theory, Springer;Game Theory Society, vol. 24(3), pages 293-319.
    63. Douglas Dyer & John H. Kagel, 1996. "Bidding in Common Value Auctions: How the Commercial Construction Industry Corrects for the Winner's Curse," Management Science, INFORMS, vol. 42(10), pages 1463-1475, October.
    64. Edward L. Glaeser, 2004. "Psychology and the Market," American Economic Review, American Economic Association, vol. 94(2), pages 408-413, May.
    65. Roth,Alvin E. (ed.), 1988. "Laboratory Experimentation in Economics," Cambridge Books, Cambridge University Press, number 9780521333924, September.
    66. George A. Akerlof, 1982. "Labor Contracts as Partial Gift Exchange," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 97(4), pages 543-569.
    67. Camerer, Colin F, 1987. "Do Biases in Probability Judgment Matter in Markets? Experimental Evidence," American Economic Review, American Economic Association, vol. 77(5), pages 981-997, December.
    68. Arthur Schram, 2005. "Artificiality: The tension between internal and external validity in economic experiments," Journal of Economic Methodology, Taylor & Francis Journals, vol. 12(2), pages 225-237.
    69. Nicholas Bardsley, 2005. "Experimental economics and the artificiality of alteration," Journal of Economic Methodology, Taylor & Francis Journals, vol. 12(2), pages 239-251.
    70. Nava Ashraf & Colin F. Camerer & George Loewenstein, 2005. "Adam Smith, Behavioral Economist," Journal of Economic Perspectives, American Economic Association, vol. 19(3), pages 131-145, Summer.
    71. Steven D. Levitt, 2004. "Why are gambling markets organised so differently from financial markets?," Economic Journal, Royal Economic Society, vol. 114(495), pages 223-246, April.
    72. Brookshire, David S & Coursey, Don L, 1987. "Measuring the Value of a Public Good: An Empirical Comparison of Elicitation Procedures," American Economic Review, American Economic Association, vol. 77(4), pages 554-566, September.
    73. Ortmann, Andreas, 2003. "Charles R. Plott's collected papers on the experimental foundations of economic and political science," Journal of Economic Psychology, Elsevier, vol. 24(4), pages 555-575, August.
    74. John G. Cross, 1980. "Some Comments on the Papers by Kagel and Battalio and by Smith," NBER Chapters, in: Evaluation of Econometric Models, pages 403-406, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. List John A., 2007. "Field Experiments: A Bridge between Lab and Naturally Occurring Data," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 6(2), pages 1-47, April.
    2. Fiore, Annamaria, 2009. "Experimental Economics: Some Methodological Notes," MPRA Paper 12498, University Library of Munich, Germany.
    3. Glenn W. Harrison & John A. List, 2004. "Field Experiments," Journal of Economic Literature, American Economic Association, vol. 42(4), pages 1009-1055, December.
    4. Etchart-Vincent, Nathalie, 2007. "Expérimentation de laboratoire et économie : contre quelques idées reçues et faux problèmes," L'Actualité Economique, Société Canadienne de Science Economique, vol. 83(1), pages 91-116, mars.
    5. Zonna, Davide, 2016. "Sprechi di cibo e tentativi di riduzione. Un caso sperimentale [Avoiding food waste. A field experiment]," MPRA Paper 76097, University Library of Munich, Germany.
    6. Ernst Fehr & Jean-Robert Tyran, 2008. "Limited Rationality and Strategic Interaction: The Impact of the Strategic Environment on Nominal Inertia," Econometrica, Econometric Society, vol. 76(2), pages 353-394, March.
    7. John A. List & Michael S. Haigh, 2010. "Investment Under Uncertainty: Testing the Options Model with Professional Traders," The Review of Economics and Statistics, MIT Press, vol. 92(4), pages 974-984, November.
    8. Yan Chen & Peter Cramton & John A. List & Axel Ockenfels, 2021. "Market Design, Human Behavior, and Management," Management Science, INFORMS, vol. 67(9), pages 5317-5348, September.
    9. Stefano DellaVigna, 2009. "Psychology and Economics: Evidence from the Field," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 315-372, June.
    10. Omar Al-Ubaydli & John List, 2016. "Field Experiments in Markets," Artefactual Field Experiments j0002, The Field Experiments Website.
    11. Dohmen, Thomas, 2014. "Behavioral labor economics: Advances and future directions," Labour Economics, Elsevier, vol. 30(C), pages 71-85.
    12. Matteo M. Galizzi & Daniel Navarro-Martinez, 2019. "On the External Validity of Social Preference Games: A Systematic Lab-Field Study," Management Science, INFORMS, vol. 65(3), pages 976-1002, March.
    13. Charness, Gary & Kuhn, Peter, 2011. "Lab Labor: What Can Labor Economists Learn from the Lab?," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 3, pages 229-330, Elsevier.
    14. Ernst Fehr & Jean-Robert Tyran, 2005. "Individual Irrationality and Aggregate Outcomes," Journal of Economic Perspectives, American Economic Association, vol. 19(4), pages 43-66, Fall.
    15. Eduard Marinov, 2017. "The 2017 Nobel Prize in Economics," Economic Thought journal, Bulgarian Academy of Sciences - Economic Research Institute, issue 6, pages 117-159.
    16. Crawford, Vincent P., 2002. "Introduction to Experimental Game Theory," Journal of Economic Theory, Elsevier, vol. 104(1), pages 1-15, May.
    17. John A. List, 2006. "Using Hicksian Surplus Measures to Examine Consistency of Individual Preferences: Evidence from a Field Experiment," Scandinavian Journal of Economics, Wiley Blackwell, vol. 108(1), pages 115-134, March.
    18. Committee, Nobel Prize, 2017. "Richard H. Thaler: Integrating Economics with Psychology," Nobel Prize in Economics documents 2017-1, Nobel Prize Committee.
    19. Nicolas Jacquemet & Olivier L’Haridon & Isabelle Vialle, 2014. "Marché du travail, évaluation et économie expérimentale," Revue française d'économie, Presses de Sciences-Po, vol. 0(1), pages 189-226.
    20. List, John A., 2004. "Substitutability, experience, and the value disparity: evidence from the marketplace," Journal of Environmental Economics and Management, Elsevier, vol. 47(3), pages 486-509, May.

    More about this item

    JEL classification:

    • C9 - Mathematical and Quantitative Methods - - Design of Experiments

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:feb:artefa:00001. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Francesca Pagnotta (email available below). General contact details of provider: http://www.fieldexperiments.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.