IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp5475.html
   My bibliography  Save this paper

Did We Overestimate the Role of Social Preferences? The Case of Self-Selected Student Samples

Author

Listed:
  • Falk, Armin

    (University of Bonn)

  • Meier, Stephan

    (Columbia University)

  • Zehnder, Christian

    (University of Lausanne)

Abstract

Social preference research has received considerable attention among economists in recent years. However, the empirical foundation of social preferences is largely based on laboratory experiments with self-selected students as participants. This is potentially problematic as students participating in experiments may behave systematically different than non-participating students or non-students. In this paper we empirically investigate whether laboratory experiments with student samples misrepresent the importance of social preferences. Our first study shows that students who exhibit stronger prosocial inclinations in an unrelated field donation are not more likely to participate in experiments. This suggests that self-selection of more prosocial students into experiments is not a major issue. Our second study compares behavior of students and the general population in a trust experiment. We find very similar behavioral patterns for the two groups. If anything, the level of reciprocation seems higher among non-students suggesting that results from student samples might be seen as a lower bound for the importance of prosocial behavior.

Suggested Citation

  • Falk, Armin & Meier, Stephan & Zehnder, Christian, 2011. "Did We Overestimate the Role of Social Preferences? The Case of Self-Selected Student Samples," IZA Discussion Papers 5475, Institute of Labor Economics (IZA).
  • Handle: RePEc:iza:izadps:dp5475
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp5475.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Ernst Fehr & Simon Gächter, 2000. "Fairness and Retaliation: The Economics of Reciprocity," Journal of Economic Perspectives, American Economic Association, vol. 14(3), pages 159-181, Summer.
    2. Burks, Stephen & Carpenter, Jeffrey & Goette, Lorenz, 2009. "Performance pay and worker cooperation: Evidence from an artefactual field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 70(3), pages 458-469, June.
    3. Falk, Armin & Fischbacher, Urs, 2006. "A theory of reciprocity," Games and Economic Behavior, Elsevier, vol. 54(2), pages 293-315, February.
    4. Thomas Dohmen & Armin Falk & David Huffman & Uwe Sunde, 2008. "Representative Trust And Reciprocity: Prevalence And Determinants," Economic Inquiry, Western Economic Association International, vol. 46(1), pages 84-90, January.
    5. Jean Tirole & Roland Bénabou, 2006. "Incentives and Prosocial Behavior," American Economic Review, American Economic Association, vol. 96(5), pages 1652-1678, December.
    6. Nicholas Bardsley & Robin Cubitt & Graham Loomes & Peter Moffatt & Chris Starmer & Robert Sugden, 2009. "Experimental Economics: Rethinking the Rules," Economics Books, Princeton University Press, edition 1, number 9074.
    7. Martin Brown & Armin Falk & Ernst Fehr, 2004. "Relational Contracts and the Nature of Market Interactions," Econometrica, Econometric Society, vol. 72(3), pages 747-780, May.
    8. Armin Falk & James J. Heckman, 2009. "Lab Experiments are a Major Source of Knowledge in the Social Sciences," Working Papers 200935, Geary Institute, University College Dublin.
    9. Bartling, Björn & von Siemens, Ferdinand A., 2010. "The intensity of incentives in firms and markets: Moral hazard with envious agents," Labour Economics, Elsevier, vol. 17(3), pages 598-607, June.
    10. Ernst Fehr & Alexander Klein & Klaus M Schmidt, 2007. "Fairness and Contract Design," Econometrica, Econometric Society, vol. 75(1), pages 121-154, January.
    11. Bellemare, Charles & Kroger, Sabine, 2007. "On representative social capital," European Economic Review, Elsevier, vol. 51(1), pages 183-202, January.
    12. repec:feb:artefa:0080 is not listed on IDEAS
    13. Matthias Benz & Stephan Meier, 2008. "Do people behave in experiments as in the field?—evidence from donations," Experimental Economics, Springer;Economic Science Association, vol. 11(3), pages 268-281, September.
    14. Ernst Fehr & Georg Kirchsteiger & Arno Riedl, 1993. "Does Fairness Prevent Market Clearing? An Experimental Investigation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 108(2), pages 437-459.
    15. Dufwenberg, Martin & Kirchsteiger, Georg, 2004. "A theory of sequential reciprocity," Games and Economic Behavior, Elsevier, vol. 47(2), pages 268-298, May.
    16. Michael Kosfeld & Akira Okada & Arno Riedl, 2009. "Institution Formation in Public Goods Games," American Economic Review, American Economic Association, vol. 99(4), pages 1335-1355, September.
    17. Sutter, Matthias & Kocher, Martin G., 2007. "Trust and trustworthiness across different age groups," Games and Economic Behavior, Elsevier, vol. 59(2), pages 364-382, May.
    18. Ernst Fehr & John A. List, 2004. "The Hidden Costs and Returns of Incentives-Trust and Trustworthiness Among CEOs," Journal of the European Economic Association, MIT Press, vol. 2(5), pages 743-771, September.
    19. James Andreoni, 1995. "Warm-Glow versus Cold-Prickle: The Effects of Positive and Negative Framing on Cooperation in Experiments," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 110(1), pages 1-21.
    20. Ernst Fehr & Klaus M. Schmidt, 1999. "A Theory of Fairness, Competition, and Cooperation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(3), pages 817-868.
    21. Axel Ockenfels & Gary E. Bolton, 2000. "ERC: A Theory of Equity, Reciprocity, and Competition," American Economic Review, American Economic Association, vol. 90(1), pages 166-193, March.
    22. Seabright Paul B, 2009. "Continuous Preferences and Discontinuous Choices: How Altruists Respond to Incentives," The B.E. Journal of Theoretical Economics, De Gruyter, vol. 9(1), pages 1-28, April.
    23. Tyran, Jean-Robert & Sausgruber, Rupert, 2006. "A little fairness may induce a lot of redistribution in democracy," European Economic Review, Elsevier, vol. 50(2), pages 469-485, February.
    24. Bruno S. Frey & Stephan Meier, 2004. "Social Comparisons and Pro-social Behavior: Testing "Conditional Cooperation" in a Field Experiment," American Economic Review, American Economic Association, vol. 94(5), pages 1717-1722, December.
    25. John A. List, 2009. "Social Preferences: Some Thoughts from the Field," Annual Review of Economics, Annual Reviews, vol. 1(1), pages 563-583, May.
    26. Bowles, Samuel & Hwang, Sung-Ha, 2008. "Social preferences and public economics: Mechanism design when social preferences depend on incentives," Journal of Public Economics, Elsevier, vol. 92(8-9), pages 1811-1820, August.
    27. Joseph Henrich & Steve J. Heine & Ara Norenzayan, 2010. "The Weirdest People in the World?," RatSWD Working Papers 139, German Data Forum (RatSWD).
    28. Croson, Rachel & Gächter, Simon, 2010. "The science of experimental economics," Journal of Economic Behavior & Organization, Elsevier, vol. 73(1), pages 122-131, January.
    29. Gächter, Simon & Herrmann, Benedikt, 2011. "The limits of self-governance when cooperators get punished: Experimental evidence from urban and rural Russia," European Economic Review, Elsevier, vol. 55(2), pages 193-210, February.
    30. Armin Falk & Ernst Fehr & Christian Zehnder, "undated". "The Behavioral Effects of Minimum Wages," IEW - Working Papers 247, Institute for Empirical Research in Economics - University of Zurich.
    31. Tore Ellingsen & Magnus Johannesson, 2008. "Pride and Prejudice: The Human Side of Incentive Theory," American Economic Review, American Economic Association, vol. 98(3), pages 990-1008, June.
    32. Lucy F. Ackert & Ann B. Gillette & Jorge Martinez-Vazquez & Mark Rider, 2009. "Risk Tolerance, Self-Interest, and Social Preferences," Experimental Economics Center Working Paper Series 2009-04, Experimental Economics Center, Andrew Young School of Policy Studies, Georgia State University, revised Feb 2011.
    33. MacLeod, W Bentley & Malcomson, James M, 1998. "Motivation and Markets," American Economic Review, American Economic Association, vol. 88(3), pages 388-411, June.
    34. Rabin, Matthew, 1993. "Incorporating Fairness into Game Theory and Economics," American Economic Review, American Economic Association, vol. 83(5), pages 1281-1302, December.
    35. Steven D. Levitt & John A. List, 2007. "What Do Laboratory Experiments Measuring Social Preferences Reveal About the Real World?," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 153-174, Spring.
    36. Goeree, Jacob K. & Holt, Charles A., 2000. "Asymmetric inequality aversion and noisy behavior in alternating-offer bargaining games," European Economic Review, Elsevier, vol. 44(4-6), pages 1079-1089, May.
    37. W. Bentley MacLeod, 2007. "Can Contract Theory Explain Social Preferences?," American Economic Review, American Economic Association, vol. 97(2), pages 187-192, May.
    38. Berg Joyce & Dickhaut John & McCabe Kevin, 1995. "Trust, Reciprocity, and Social History," Games and Economic Behavior, Elsevier, vol. 10(1), pages 122-142, July.
    39. David Masclet & Marie-Claire Villeval, 2008. "Punishment, inequality, and welfare: a public good experiment," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 31(3), pages 475-502, October.
    40. Charles Bellemare & Sabine Kröger & Arthur van Soest, 2008. "Measuring Inequity Aversion in a Heterogeneous Population Using Experimental Decisions and Subjective Probabilities," Econometrica, Econometric Society, vol. 76(4), pages 815-839, July.
    41. Jeffrey Carpenter & Cristina Connolly & Caitlin Myers, 2008. "Altruistic behavior in a representative dictator experiment," Experimental Economics, Springer;Economic Science Association, vol. 11(3), pages 282-298, September.
    42. repec:dgr:kubcen:200347 is not listed on IDEAS
    43. Simon Gächter, 2010. "(Dis)advantages of student subjects: what is your research question?," RatSWD Working Papers 141, German Data Forum (RatSWD).
    44. Ernst Fehr & Oliver Hart & Christian Zehnder, 2011. "Contracts as Reference Points--Experimental Evidence," American Economic Review, American Economic Association, vol. 101(2), pages 493-525, April.
    45. Frey, Bruno S. & Meier, Stephan, 2004. "Pro-social behavior in a natural setting," Journal of Economic Behavior & Organization, Elsevier, vol. 54(1), pages 65-88, May.
    46. Bellemare, Charles & Kroger, Sabine, 2007. "On representative social capital," European Economic Review, Elsevier, vol. 51(1), pages 183-202, January.
    47. Bruno Frey & Stephan Meier, 2004. "In a field experiment," Natural Field Experiments 00243, The Field Experiments Website.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jan Stoop, 2014. "From the lab to the field: envelopes, dictators and manners," Experimental Economics, Springer;Economic Science Association, vol. 17(2), pages 304-313, June.
    2. Alexander W. Cappelen & Knut Nygaard & Erik Ø. Sørensen & Bertil Tungodden, 2015. "Social Preferences in the Lab: A Comparison of Students and a Representative Population," Scandinavian Journal of Economics, Wiley Blackwell, vol. 117(4), pages 1306-1326, October.
    3. Blair Cleave & Nikos Nikiforakis & Robert Slonim, 2013. "Is there selection bias in laboratory experiments? The case of social and risk preferences," Experimental Economics, Springer;Economic Science Association, vol. 16(3), pages 372-382, September.
    4. Elsayyad, May & Konrad, Kai A., 2012. "Fighting multiple tax havens," Journal of International Economics, Elsevier, vol. 86(2), pages 295-305.
    5. Cubitt, Robin P. & Drouvelis, Michalis & Gächter, Simon & Kabalin, Ruslan, 2011. "Moral judgments in social dilemmas: How bad is free riding?," Journal of Public Economics, Elsevier, vol. 95(3), pages 253-264.
    6. Barham, Bradford L. & Chavas, Jean-Paul & Fitz, Dylan & Salas, Vanessa Ríos & Schechter, Laura, 2014. "The roles of risk and ambiguity in technology adoption," Journal of Economic Behavior & Organization, Elsevier, vol. 97(C), pages 204-218.
    7. Cubitt, Robin P. & Drouvelis, Michalis & Gächter, Simon & Kabalin, Ruslan, 2011. "Moral judgments in social dilemmas: How bad is free riding?," Journal of Public Economics, Elsevier, vol. 95(3), pages 253-264.
    8. Griffin, John & Nickerson, David & Wozniak, Abigail, 2012. "Racial differences in inequality aversion: Evidence from real world respondents in the ultimatum game," Journal of Economic Behavior & Organization, Elsevier, vol. 84(2), pages 600-617.
    9. Birkeland, Sigbjørn & Cappelen, Alexander W. & Sørensen, Erik Ø. & Tungodden, Bertil, 2011. "Immoral criminals? An experimental study of social preferences among prisoners," Discussion Paper Series in Economics 15/2011, Norwegian School of Economics, Department of Economics.
    10. Samuel Bowles & Sandra Polania-Reyes, 2011. "Economic incentives and social preferences: substitutes or complements?," Department of Economics University of Siena 617, Department of Economics, University of Siena.
    11. Mark Hudson & Ian Hudson & Jason D. Edgerton, 2013. "Political Consumerism in Context: An Experiment on Status and Information in Ethical Consumption Decisions," American Journal of Economics and Sociology, Wiley Blackwell, vol. 72(4), pages 1009-1037, October.
    12. Samuel Bowles & Sandra Polania-Reyes, 2012. "Economic Incentives and Social Preferences: Substitutes or Complements?," Journal of Economic Literature, American Economic Association, vol. 50(2), pages 368-425, June.
    13. Johnson, Noel D. & Mislin, Alexandra A., 2011. "Trust games: A meta-analysis," Journal of Economic Psychology, Elsevier, vol. 32(5), pages 865-889.
    14. Pelligra, Vittorio & Stanca, Luca, 2013. "To give or not to give? Equity, efficiency and altruistic behavior in an artefactual field experiment," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 46(C), pages 1-9.
    15. Hennig-Schmidt, Heike & Selten, Reinhard & Wiesen, Daniel, 2011. "How payment systems affect physicians' provision behaviour--An experimental investigation," Journal of Health Economics, Elsevier, vol. 30(4), pages 637-646, July.
    16. Avner Ben-Ner & Matthew Ellman, 2013. "The contributions of behavioural economics to understanding and advancing the sustainability of worker cooperatives," Journal of Entrepreneurial and Organizational Diversity, European Research Institute on Cooperative and Social Enterprises, vol. 2(1), pages 75-100, August.
    17. Sanjit Dhami & Ali al-Nowaihi, 2013. "Dominance Concepts for Fehr-Schmidt Preferences," Discussion Papers in Economics 13/09, Division of Economics, School of Business, University of Leicester.
    18. Slonim, Robert & Wang, Carmen & Garbarino, Ellen & Merrett, Danielle, 2012. "Opting-In: Participation Biases in the Lab," IZA Discussion Papers 6865, Institute of Labor Economics (IZA).
    19. L. Becchetti & V. Pelligra, 2011. "Don't Be Ashamed to Say You Didn't Get Much: Redistributive Effects of Information Disclosure in Donations and Inequity-Aversion in Charitable Giving," Working Paper CRENoS 201111, Centre for North South Economic Research, University of Cagliari and Sassari, Sardinia.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Barmettler, Franziska & Fehr, Ernst & Zehnder, Christian, 2012. "Big experimenter is watching you! Anonymity and prosocial behavior in the laboratory," Games and Economic Behavior, Elsevier, vol. 75(1), pages 17-34.
    2. Samuel Bowles & Sandra Polania-Reyes, 2011. "Economic incentives and social preferences: substitutes or complements?," Department of Economics University of Siena 617, Department of Economics, University of Siena.
    3. Charness, Gary & Kuhn, Peter, 2011. "Lab Labor: What Can Labor Economists Learn from the Lab?," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 3, pages 229-330, Elsevier.
    4. Dohmen, Thomas, 2014. "Behavioral labor economics: Advances and future directions," Labour Economics, Elsevier, vol. 30(C), pages 71-85.
    5. Martijn J. van den Assem & Dennie van Dolder & Richard H. Thaler, 2012. "Split or Steal? Cooperative Behavior When the Stakes Are Large," Management Science, INFORMS, vol. 58(1), pages 2-20, January.
    6. Matteo M. Galizzi & Daniel Navarro-Martinez, 2019. "On the External Validity of Social Preference Games: A Systematic Lab-Field Study," Management Science, INFORMS, vol. 65(3), pages 976-1002, March.
    7. Simon Gaechter & Esther Kessler & Manfred Koenigstein, 2011. "The roles of incentives and voluntary cooperation for contractual compliance," Discussion Papers 2011-06, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
    8. Croson, Rachel & Gächter, Simon, 2010. "The science of experimental economics," Journal of Economic Behavior & Organization, Elsevier, vol. 73(1), pages 122-131, January.
    9. Christian Thoeni & Simon Gaechter, 2011. "Peer Effects and Social Preferences in Voluntary Cooperation," Discussion Papers 2011-09, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
    10. Klaus M. Schmidt, 2011. "Social Preferences and Competition," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 43, pages 207-231, August.
    11. Samuel Bowles & Sandra Polania-Reyes, 2012. "Economic Incentives and Social Preferences: Substitutes or Complements?," Journal of Economic Literature, American Economic Association, vol. 50(2), pages 368-425, June.
    12. Cleave, Blair L. & Nikiforakis, Nikos & Slonim, Robert, 2010. "Is There Selection Bias in Laboratory Experiments?," Working Papers 2010-01, University of Sydney, School of Economics.
    13. Fehr, Ernst & Schmidt, Klaus M., 2005. "The Economics of Fairness, Reciprocity and Altruism – Experimental Evidence and New Theories," Discussion Paper Series of SFB/TR 15 Governance and the Efficiency of Economic Systems 66, Free University of Berlin, Humboldt University of Berlin, University of Bonn, University of Mannheim, University of Munich.
    14. Simon Gaechter, 2014. "Human Pro-Social Motivation and the Maintenance of Social Order," Discussion Papers 2014-02, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
    15. Blair Cleave & Nikos Nikiforakis & Robert Slonim, 2013. "Is there selection bias in laboratory experiments? The case of social and risk preferences," Experimental Economics, Springer;Economic Science Association, vol. 16(3), pages 372-382, September.
    16. Martin G. Kocher, 2015. "How Trust in Social Dilemmas Evolves with Age," CESifo Working Paper Series 5447, CESifo.
    17. Bjorn Bartling & Ernst Fehr & Klaus M. Schmidt, 2012. "Screening, Competition, and Job Design: Economic Origins of Good Jobs," American Economic Review, American Economic Association, vol. 102(2), pages 834-864, April.
    18. Ola Kvaløy & Miguel Luzuriaga, 2014. "Playing the trust game with other people’s money," Experimental Economics, Springer;Economic Science Association, vol. 17(4), pages 615-630, December.
    19. Slonim, Robert & Wang, Carmen & Garbarino, Ellen & Merrett, Danielle, 2012. "Opting-In: Participation Biases in the Lab," IZA Discussion Papers 6865, Institute of Labor Economics (IZA).
    20. Jeongbin Kim & Louis Putterman & Xinyi Zhang, 2019. ""Trust, Beliefs and Cooperation: Excavating a Foundation of Strong Economics," Working Papers 2019-10, Brown University, Department of Economics.

    More about this item

    Keywords

    selection; methodology; prosocial behavior; experiments;
    All these keywords.

    JEL classification:

    • C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General
    • D03 - Microeconomics - - General - - - Behavioral Microeconomics: Underlying Principles

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp5475. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.