IDEAS home Printed from
MyIDEAS: Login to save this paper or follow this series

Self-Selection into Economics Experiments Is Driven by Monetary Rewards

  • Abeler, Johannes


    (University of Oxford)

  • Nosenzo, Daniele


    (University of Nottingham)

Laboratory experiments have become a wide-spread tool in economic research. Yet, there is still doubt about how well the results from lab experiments generalize to other settings. In this paper, we investigate the self-selection process of potential subjects into the subject pool. We alter the recruitment email sent to first-year students, either mentioning the monetary reward associated with participation in experiments; or appealing to the importance of helping research; or both. We find that the sign-up rate drops by two-thirds if we do not mention monetary rewards. Appealing to subjects' willingness to help research has no effect on sign-up. We then invite the so-recruited subjects to the laboratory to measure a range of preferences in incentivized experiments. We do not find any differences between the three groups. Our results show that student subjects participate in experiments foremost to earn money, and that it is therefore unlikely that this selection leads to an over-estimation of social preferences in the student population.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL:
Download Restriction: no

Paper provided by Institute for the Study of Labor (IZA) in its series IZA Discussion Papers with number 7374.

in new window

Length: 38 pages
Date of creation: Apr 2013
Date of revision:
Handle: RePEc:iza:izadps:dp7374
Contact details of provider: Postal: IZA, P.O. Box 7240, D-53072 Bonn, Germany
Phone: +49 228 3894 223
Fax: +49 228 3894 180
Web page:

Order Information: Postal: IZA, Margard Ody, P.O. Box 7240, D-53072 Bonn, Germany

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. Michal Krawczyk, 2011. "What brings your subjects to the lab? A field experiment," Experimental Economics, Springer, vol. 14(4), pages 482-489, November.
  2. Offerman, Theo & Sonnemans, Joep & Schram, Arthur, 1996. "Value Orientations, Expectations and Voluntary Contributions in Public Goods," Economic Journal, Royal Economic Society, vol. 106(437), pages 817-45, July.
  3. Thomas Dohmen & Armin Falk & David Huffman & Uwe Sunde & Jürgen Schupp & Gert G. Wagner, 2011. "Individual Risk Attitudes: Measurement, Determinants, And Behavioral Consequences," Journal of the European Economic Association, European Economic Association, vol. 9(3), pages 522-550, 06.
  4. Steven D. Levitt & John A. List, 2007. "What Do Laboratory Experiments Measuring Social Preferences Reveal About the Real World?," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 153-174, Spring.
  5. Glaeser, Edward Ludwig & Laibson, David I. & Scheinkman, Jose A. & Soutter, Christine L., 2000. "Measuring Trust," Scholarly Articles 4481497, Harvard University Department of Economics.
  6. Thomas Dohmen & Armin Falk, 2010. "You Get What You Pay For: Incentives and Selection in the Education System," Economic Journal, Royal Economic Society, vol. 120(546), pages F256-F271, 08.
  7. John List, 2006. "Field experiments: A bridge between lab and naturally occurring data," Artefactual Field Experiments 00083, The Field Experiments Website.
  8. M. Vittoria Levati & Matteo Ploner & Stefan Traub, 2011. "Are conditional cooperators willing to forgo efficiency gains? Evidence from a public goods experiment," New Zealand Economic Papers, Taylor & Francis Journals, vol. 45(1-2), pages 47-57.
  9. Hans-Martin Gaudecker & Arthur Soest & Erik Wengström, 2012. "Experts in experiments," Journal of Risk and Uncertainty, Springer, vol. 45(2), pages 159-190, October.
  10. Urs Fischbacher & Simon Gachter, 2010. "Social Preferences, Beliefs, and the Dynamics of Free Riding in Public Goods Experiments," American Economic Review, American Economic Association, vol. 100(1), pages 541-56, March.
  11. Stoop, Jan & Noussair, Charles & van Soest, Daan, 2010. "From the lab to the field: Cooperation among fishermen," MPRA Paper 28924, University Library of Munich, Germany.
  12. D Nosenzo & Jon Anderson & Stephen V Burks & Jeffrey Carpenter & Lorenz Gotte & Karsten Maurer & Ruth Potter & Kim Rocha & Aldo Rustichini, 2012. "Self-Selection and Variations in the Laboratory Measurment of Other-Regarding Preferences Across Subject Pools: Evidence from One College Student and Two Adult Samples," Discussion Papers 2012-14, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
  13. Slonim, Robert & Wang, Carmen & Garbarino, Ellen & Merrett, Danielle, 2012. "Opting-In: Participation Biases in the Lab," IZA Discussion Papers 6865, Institute for the Study of Labor (IZA).
  14. Kocher, Martin G. & Cherry, Todd & Kroll, Stephan & Netzer, Robert J. & Sutter, Matthias, 2008. "Conditional cooperation on three continents," Economics Letters, Elsevier, vol. 101(3), pages 175-178, December.
  15. Sonnemans, Joep & Schram, Arthur & Offerman, Theo, 1998. "Public good provision and public bad prevention: The effect of framing," Journal of Economic Behavior & Organization, Elsevier, vol. 34(1), pages 143-161, January.
  16. Burks, Stephen & Carpenter, Jeffrey & Goette, Lorenz, 2009. "Performance pay and worker cooperation: Evidence from an artefactual field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 70(3), pages 458-469, June.
  17. Kei Tsutsui & Daniel John Zizzo, 2010. "Group status, minorities, and trust," Working Paper series, University of East Anglia, Centre for Behavioural and Experimental Social Science (CBESS) 10-10, School of Economics, University of East Anglia, Norwich, UK..
  18. Robin P. Cubitt & Michalis Drouvelis & Simon Gaechter & Ruslan Kabalin, 2010. "Moral Judgments in Social Dilemmas: How Bad is Free Riding?," Discussion Papers 2010-18, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
  19. Benedikt Herrmann & Christian Thöni, 2009. "Measuring conditional cooperation: a replication study in Russia," Experimental Economics, Springer, vol. 12(1), pages 87-92, March.
  20. Laurent Muller & Martin Sefton & Richard Steinberg & Lise Vesterlund, 2005. "Strategic Behavior and Learning in Repeated Voluntary-Contribution Experiments," Discussion Papers 2005-13, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
  21. Dohmen Thomas & Falk Armin, 2010. "Performance Pay and Multi-dimensional Sorting - Productivity, Preferences and Gender," ROA Research Memorandum 003, Maastricht University, Research Centre for Education and the Labour Market (ROA).
  22. Jenni, Karen E & Loewenstein, George, 1997. "Explaining the "Identifiable Victim Effect."," Journal of Risk and Uncertainty, Springer, vol. 14(3), pages 235-57, May-June.
  23. Falk, Armin & Heckman, James J, 2010. "Lab Experiments are a Major Source of Knowledge in the Social Sciences," CEPR Discussion Papers 7620, C.E.P.R. Discussion Papers.
  24. Shane Frederick, 2005. "Cognitive Reflection and Decision Making," Journal of Economic Perspectives, American Economic Association, vol. 19(4), pages 25-42, Fall.
  25. Urs Fischbacher & Simon Gaechter & Ernst Fehr, . "Are People Conditionally Cooperative? Evidence from a Public Goods Experiment," IEW - Working Papers 016, Institute for Empirical Research in Economics - University of Zurich.
  26. Michèle Belot & Raymond Duch & Luis Miller, 2010. "Who should be called to the lab? A comprehensive comparison of students and non-students in classic experimental games," Discussion Papers 2010001, University of Oxford, Nuffield College.
  27. Blair Cleave & Nikos Nikiforakis & Robert Slonim, 2013. "Is there selection bias in laboratory experiments? The case of social and risk preferences," Experimental Economics, Springer, vol. 16(3), pages 372-382, September.
  28. Hoffman, Elizabeth & McCabe, Kevin & Smith, Vernon L, 1996. "Social Distance and Other-Regarding Behavior in Dictator Games," American Economic Review, American Economic Association, vol. 86(3), pages 653-60, June.
  29. Neil Buckley & Kenneth Chan & James Chowhan & Stuart Mestelman & Mohamed Shehata, 2001. "Value Orientations, Income and Displacement Effects, and Voluntary Contributions," Experimental Economics, Springer, vol. 4(2), pages 183-195, October.
  30. Charness, Gary & Gneezy, Uri, 2008. "What's in a name? Anonymity and social distance in dictator and ultimatum games," Journal of Economic Behavior & Organization, Elsevier, vol. 68(1), pages 29-35, October.
  31. Urs Fischbacher, 2007. "z-Tree: Zurich toolbox for ready-made economic experiments," Experimental Economics, Springer, vol. 10(2), pages 171-178, June.
  32. Roberto Burlando & Francesco Guala, 2005. "Heterogeneous Agents in Public Goods Experiments," Experimental Economics, Springer, vol. 8(1), pages 35-54, April.
  33. repec:oup:qjecon:v:115:y:2000:i:3:p:811-846 is not listed on IDEAS
  34. Park, Eun-Soo, 2000. "Warm-glow versus cold-prickle: a further experimental study of framing effects on free-riding," Journal of Economic Behavior & Organization, Elsevier, vol. 43(4), pages 405-421, December.
  35. Daniel Zizzo, 2010. "Experimenter demand effects in economic experiments," Experimental Economics, Springer, vol. 13(1), pages 75-98, March.
  36. Catherine Eckel & Philip Grossman, 2000. "Volunteers and Pseudo-Volunteers: The Effect of Recruitment Method in Dictator Experiments," Experimental Economics, Springer, vol. 3(2), pages 107-120, October.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp7374. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Mark Fallak)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.