IDEAS home Printed from https://ideas.repec.org/a/eee/jeborg/v91y2013icp93-100.html
   My bibliography  Save this article

Experimental methods: Extra-laboratory experiments-extending the reach of experimental economics

Author

Listed:
  • Charness, Gary
  • Gneezy, Uri
  • Kuhn, Michael A.

Abstract

We propose a new organizing scheme for classifying types of experiments. In addition to the standard categories of laboratory and field experiments, we suggest a new category: “extra-laboratory experiments.” These are experiments that have the same spirit as laboratory experiments, but are conducted in a non-standard manner. We also suggest some organizing principles to distinguish amongst the three types of experiments.

Suggested Citation

  • Charness, Gary & Gneezy, Uri & Kuhn, Michael A., 2013. "Experimental methods: Extra-laboratory experiments-extending the reach of experimental economics," Journal of Economic Behavior & Organization, Elsevier, vol. 91(C), pages 93-100.
    • Handle: RePEc:eee:jeborg:v:91:y:2013:i:c:p:93-100
    DOI: 10.1016/j.jebo.2013.04.002
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167268113000966
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jebo.2013.04.002?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Joseph Henrich, 2001. "In Search of Homo Economicus: Behavioral Experiments in 15 Small-Scale Societies," American Economic Review, American Economic Association, vol. 91(2), pages 73-78, May.
    2. Antoni Bosch-Domènech & José G. Montalvo & Rosemarie Nagel & Albert Satorra, 2002. "One, Two, (Three), Infinity, ...: Newspaper and Lab Beauty-Contest Experiments," American Economic Review, American Economic Association, vol. 92(5), pages 1687-1701, December.
    3. Michael S. Haigh & John A. List, 2005. "Do Professional Traders Exhibit Myopic Loss Aversion? An Experimental Analysis," Journal of Finance, American Finance Association, vol. 60(1), pages 523-534, February.
    4. Gary Charness & Marie-Claire Villeval, 2009. "Cooperation and Competition in Intergenerational Experiments in the Field and the Laboratory," American Economic Review, American Economic Association, vol. 99(3), pages 956-978, June.
    5. Charness, Gary & Haruvy, Ernan & Sonsino, Doron, 2007. "Social distance and reciprocity: An Internet experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 63(1), pages 88-103, May.
    6. Glenn W. Harrison & John A. List, 2004. "Field Experiments," Journal of Economic Literature, American Economic Association, vol. 42(4), pages 1009-1055, December.
    7. Eckel, Catherine C. & El-Gamal, Mahmoud A. & Wilson, Rick K., 2009. "Risk loving after the storm: A Bayesian-Network study of Hurricane Katrina evacuees," Journal of Economic Behavior & Organization, Elsevier, vol. 69(2), pages 110-124, February.
    8. Charles A. Holt & Susan K. Laury, 2002. "Risk Aversion and Incentive Effects," American Economic Review, American Economic Association, vol. 92(5), pages 1644-1655, December.
    9. List John A., 2007. "Field Experiments: A Bridge between Lab and Naturally Occurring Data," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 5(2), pages 1-47, April.
    10. Catherine C. Eckel & Philip J. Grossman, 2000. "Volunteers and Pseudo-Volunteers: The Effect of Recruitment Method in Dictator Experiments," Experimental Economics, Springer;Economic Science Association, vol. 3(2), pages 107-120, October.
    11. Blair Cleave & Nikos Nikiforakis & Robert Slonim, 2013. "Is there selection bias in laboratory experiments? The case of social and risk preferences," Experimental Economics, Springer;Economic Science Association, vol. 16(3), pages 372-382, September.
    12. Steven Levitt & John List & David Reiley, 2010. "What happens in the field stays in the field: Professionals do not play minimax in laboratory experiments," Artefactual Field Experiments 00080, The Field Experiments Website.
    13. repec:cup:judgdm:v:5:y:2010:i:5:p:411-419 is not listed on IDEAS
    14. Nagel, Rosemarie, 1995. "Unraveling in Guessing Games: An Experimental Study," American Economic Review, American Economic Association, vol. 85(5), pages 1313-1326, December.
    15. David Lucking-Reiley, 1999. "Using Field Experiments to Test Equivalence between Auction Formats: Magic on the Internet," American Economic Review, American Economic Association, vol. 89(5), pages 1063-1080, December.
    16. James Andreoni & Michael A. Kuhn & Charles Sprenger, 2013. "On Measuring Time Preferences," NBER Working Papers 19392, National Bureau of Economic Research, Inc.
    17. Roth, Alvin E. & Vesna Prasnikar & Masahiro Okuno-Fujiwara & Shmuel Zamir, 1991. "Bargaining and Market Behavior in Jerusalem, Ljubljana, Pittsburgh, and Tokyo: An Experimental Study," American Economic Review, American Economic Association, vol. 81(5), pages 1068-1095, December.
    18. Steven D. Levitt & John A. List & David H. Reiley, 2010. "What Happens in the Field Stays in the Field: Exploring Whether Professionals Play Minimax in Laboratory Experiments," Econometrica, Econometric Society, vol. 78(4), pages 1413-1434, July.
    19. John A. List, 2004. "The Nature and Extent of Discrimination in the Marketplace: Evidence from the Field," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(1), pages 49-89.
    20. Glenn W. Harrison & Morten I. Lau & Melonie B. Williams, 2002. "Estimating Individual Discount Rates in Denmark: A Field Experiment," American Economic Review, American Economic Association, vol. 92(5), pages 1606-1617, December.
    21. John A. List, 2004. "Young, Selfish and Male: Field evidence of social preferences," Economic Journal, Royal Economic Society, vol. 114(492), pages 121-149, January.
    22. Steffen Andersen & Seda Ertac & Uri Gneezy & Moshe Hoffman & John A. List, 2011. "Stakes Matter in Ultimatum Games," American Economic Review, American Economic Association, vol. 101(7), pages 3427-3439, December.
    23. Gary Charness & Uri Gneezy, 2009. "Incentives to Exercise," Econometrica, Econometric Society, vol. 77(3), pages 909-931, May.
    24. Guth, Werner & Schmittberger, Rolf & Schwarze, Bernd, 1982. "An experimental analysis of ultimatum bargaining," Journal of Economic Behavior & Organization, Elsevier, vol. 3(4), pages 367-388, December.
    25. Harbaugh, William T & Krause, Kate, 2000. "Children's Altruism in Public Good and Dictator Experiments," Economic Inquiry, Western Economic Association International, vol. 38(1), pages 95-109, January.
    26. Dan Ariely & Uri Gneezy & George Loewenstein & Nina Mazar, 2009. "Large Stakes and Big Mistakes," Review of Economic Studies, Oxford University Press, vol. 76(2), pages 451-469.
    27. John A. List, 2001. "Do Explicit Warnings Eliminate the Hypothetical Bias in Elicitation Procedures? Evidence from Field Auctions for Sportscards," American Economic Review, American Economic Association, vol. 91(5), pages 1498-1507, December.
    28. Acland, Dan & Levy, Matthew, 2013. "Naivete, projection bias, and habit formation in gym attendance," LSE Research Online Documents on Economics 46827, London School of Economics and Political Science, LSE Library.
    29. Sutter, Matthias & Glätzle-Rützler, Daniela, 2010. "Gender Differences in Competition Emerge Early in Life," IZA Discussion Papers 5015, Institute of Labor Economics (IZA).
    30. Andreoni, James, 1988. "Why free ride? : Strategies and learning in public goods experiments," Journal of Public Economics, Elsevier, vol. 37(3), pages 291-304, December.
    31. Uri Gneezy & Kenneth L. Leonard & John A. List, 2009. "Gender Differences in Competition: Evidence From a Matrilineal and a Patriarchal Society," Econometrica, Econometric Society, vol. 77(5), pages 1637-1664, September.
    32. Burger, Nicholas & Charness, Gary & Lynham, John, 2011. "Field and online experiments on self-control," Journal of Economic Behavior & Organization, Elsevier, vol. 77(3), pages 393-404, March.
    33. Steffen Andersen & Glenn W. Harrison & Morten I. Lau & E. Elisabet Rutström, 2008. "Eliciting Risk and Time Preferences," Econometrica, Econometric Society, vol. 76(3), pages 583-618, May.
    34. Philip Babcock & Kelly Bedard & Gary Charness & John Hartman & Heather Royer, 2011. "Letting Down the Team? Evidence of Social Effects of Team Incentives," NBER Working Papers 16687, National Bureau of Economic Research, Inc.
    35. Hoffman, Elizabeth & McCabe, Kevin A & Smith, Vernon L, 1996. "On Expectations and the Monetary Stakes in Ultimatum Games," International Journal of Game Theory, Springer;Game Theory Society, vol. 25(3), pages 289-301.
    36. Samuel Bowles & Robert Boyd & Colin Camerer & Ernst Fehr & Herbert Gintis & Joseph Henrich & Richard McElreath, 2001. "In search of homo economicus: Experiments in 15 small-scale societies," Artefactual Field Experiments 00068, The Field Experiments Website.
    37. repec:feb:artefa:0094 is not listed on IDEAS
    38. Robert Slonim & Alvin E. Roth, 1998. "Learning in High Stakes Ultimatum Games: An Experiment in the Slovak Republic," Econometrica, Econometric Society, vol. 66(3), pages 569-596, May.
    39. repec:feb:framed:0088 is not listed on IDEAS
    40. Simon Gachter & Ernst Fehr, 2000. "Cooperation and Punishment in Public Goods Experiments," American Economic Review, American Economic Association, vol. 90(4), pages 980-994, September.
    41. Fiedler, Marina & Haruvy, Ernan & Li, Sherry Xin, 2011. "Social distance in a virtual world experiment," Games and Economic Behavior, Elsevier, vol. 72(2), pages 400-426, June.
    42. Joshua Angrist & Victor Lavy, 2009. "The Effects of High Stakes High School Achievement Awards: Evidence from a Randomized Trial," American Economic Review, American Economic Association, vol. 99(4), pages 1384-1414, September.
    43. Isaac, R. Mark & Walker, James M. & Williams, Arlington W., 1994. "Group size and the voluntary provision of public goods : Experimental evidence utilizing large groups," Journal of Public Economics, Elsevier, vol. 54(1), pages 1-36, May.
    44. Marwell, Gerald & Ames, Ruth E., 1981. "Economists free ride, does anyone else? : Experiments on the provision of public goods, IV," Journal of Public Economics, Elsevier, vol. 15(3), pages 295-310, June.
    45. Straub, Paul G. & Murnighan, J. Keith, 1995. "An experimental investigation of ultimatum games: information, fairness, expectations, and lowest acceptable offers," Journal of Economic Behavior & Organization, Elsevier, vol. 27(3), pages 345-364, August.
    46. Cameron, Lisa A, 1999. "Raising the Stakes in the Ultimatum Game: Experimental Evidence from Indonesia," Economic Inquiry, Western Economic Association International, vol. 37(1), pages 47-59, January.
    47. Uri Gneezy & Ernan Haruvy & Hadas Yafe, 2004. "The inefficiency of splitting the bill," Economic Journal, Royal Economic Society, vol. 114(495), pages 265-280, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Glenn W. Harrison & John A. List, 2004. "Field Experiments," Journal of Economic Literature, American Economic Association, vol. 42(4), pages 1009-1055, December.
    2. Matteo M. Galizzi & Daniel Navarro-Martinez, 2019. "On the External Validity of Social Preference Games: A Systematic Lab-Field Study," Management Science, INFORMS, vol. 65(3), pages 976-1002, March.
    3. Murnighan, J. Keith & Wang, Long, 2016. "The social world as an experimental game," Organizational Behavior and Human Decision Processes, Elsevier, vol. 136(C), pages 80-94.
    4. Emin Karagözoğlu & Ümit Barış Urhan, 2017. "The Effect of Stake Size in Experimental Bargaining and Distribution Games: A Survey," Group Decision and Negotiation, Springer, vol. 26(2), pages 285-325, March.
    5. Larney, Andrea & Rotella, Amanda & Barclay, Pat, 2019. "Stake size effects in ultimatum game and dictator game offers: A meta-analysis," Organizational Behavior and Human Decision Processes, Elsevier, vol. 151(C), pages 61-72.
    6. Juan Camilo Cardenas & Jeffrey P. Carpenter, 2005. "Experiments and Economic Development: Lessons from Field Labs in the Developing World," Middlebury College Working Paper Series 0505, Middlebury College, Department of Economics.
    7. Lata Gangadharan & Tarun Jain & Pushkar Maitra & Joe Vecci, 2022. "Lab-in-the-field experiments: perspectives from research on gender," The Japanese Economic Review, Springer, vol. 73(1), pages 31-59, January.
    8. Charness, Gary & Kuhn, Peter, 2011. "Lab Labor: What Can Labor Economists Learn from the Lab?," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 3, pages 229-330, Elsevier.
    9. Levitt, Steven D. & List, John A., 2009. "Field experiments in economics: The past, the present, and the future," European Economic Review, Elsevier, vol. 53(1), pages 1-18, January.
    10. Juan Camilo Cardenas & Jeffrey Carpenter, 2008. "Behavioural Development Economics: Lessons from Field Labs in the Developing World," Journal of Development Studies, Taylor & Francis Journals, vol. 44(3), pages 311-338.
    11. Gizatulina, Alia & Gorelkina, Olga, 2021. "Selling “Money” on eBay: A field study of surplus division," Journal of Economic Behavior & Organization, Elsevier, vol. 181(C), pages 19-38.
    12. Uri Gneezy & Alex Imas, 2016. "Lab in the Field: Measuring Preferences in the Wild," CESifo Working Paper Series 5953, CESifo.
    13. van Hoorn, André, 2018. "The use of identity primes to explain behavioral differences between groups: A methodological note," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 74(C), pages 146-150.
    14. Slonim, Robert & Wang, Carmen & Garbarino, Ellen & Merrett, Danielle, 2012. "Opting-In: Participation Biases in the Lab," IZA Discussion Papers 6865, Institute of Labor Economics (IZA).
    15. Gautam Gupta, 2019. "Experiments in Economics: A Survey," Studies in Microeconomics, , vol. 7(1), pages 89-109, June.
    16. Gulyás, Attila, 2007. "A méltányosságelmélet alapjai. Modellek és nézőpontok [The foundations of quity theory. Models and viewpoints]," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(2), pages 167-183.
    17. Ehmke, Mariah & Lusk, Jayson & Tyner, Wallace, 2010. "Multidimensional tests for economic behavior differences across cultures," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 39(1), pages 37-45, January.
    18. repec:tiu:tiucen:200457 is not listed on IDEAS
    19. Bodo Sturm & Joachim Weimann, 2006. "Experiments in Environmental Economics and Some Close Relatives," Journal of Economic Surveys, Wiley Blackwell, vol. 20(3), pages 419-457, July.
    20. Bellemare, Charles & Kroger, Sabine, 2007. "On representative social capital," European Economic Review, Elsevier, vol. 51(1), pages 183-202, January.
    21. Bolton, Gary E. & Ockenfels, Axel, 2014. "Does laboratory trading mirror behavior in real world markets? Fair bargaining and competitive bidding on eBay," Journal of Economic Behavior & Organization, Elsevier, vol. 97(C), pages 143-154.

    More about this item

    Keywords

    Extra-laboratory experiments; Laboratory experiments; Field experiments; Experimental methodology;
    All these keywords.

    JEL classification:

    • C91 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Individual Behavior
    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • C99 - Mathematical and Quantitative Methods - - Design of Experiments - - - Other

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jeborg:v:91:y:2013:i:c:p:93-100. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jebo .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.