IDEAS home Printed from https://ideas.repec.org/p/hal/journl/halshs-00943212.html
   My bibliography  Save this paper

Is there selection bias in laboratory experiments? The case of social and risk preferences

Author

Listed:
  • Nikos Nikiforakis

    (GATE Lyon Saint-Étienne - Groupe d'Analyse et de Théorie Economique Lyon - Saint-Etienne - ENS de Lyon - École normale supérieure de Lyon - UL2 - Université Lumière - Lyon 2 - UCBL - Université Claude Bernard Lyon 1 - Université de Lyon - UJM - Université Jean Monnet - Saint-Étienne - CNRS - Centre National de la Recherche Scientifique, Departement of Economics [Melbourne] - Faculty of Business and Economics [Melbourne] - University of Melbourne)

  • Blair L. Cleave

    (Departement of Economics [Melbourne] - Faculty of Business and Economics [Melbourne] - University of Melbourne)

  • Robert Slonim

    (University of Sydney, School of economics - The University of Sydney)

Abstract

Laboratory experiments are frequently used to examine the nature of individual preferences and inform economic theory. However, it is unknown whether the preferences of volunteer participants are representative of the population from which the participants are drawn or whether they differ due to selection bias. We examine whether the social and risk preferences of participants in a laboratory experiment represent the preferences of the population from which they are recruited. To answer this question, we measured the preferences of 1,173 students in a classroom experiment. Separately, we invited all students to participate in a laboratory experiment. We find that the social and risk preferences of students who attend the laboratory experiment do not differ significantly from the preferences of the population from which they were recruited. Moreover, participation decisions based on social and risk preferences do not differ significantly across most subgroups, with the exception that female participants are on average less risk averse than female non-participants, and male participants are more risk averse than male non-participants.
(This abstract was borrowed from another version of this item.)

Suggested Citation

  • Nikos Nikiforakis & Blair L. Cleave & Robert Slonim, 2013. "Is there selection bias in laboratory experiments? The case of social and risk preferences," Post-Print halshs-00943212, HAL.
  • Handle: RePEc:hal:journl:halshs-00943212
    as

    Download full text from publisher

    To our knowledge, this item is not available for download. To find whether it is available, there are three options:
    1. Check below whether another version of this item is available online.
    2. Check on the provider's web page whether it is in fact available.
    3. Perform a search for a similarly titled item that would be available.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Ernst Fehr & Simon Gächter, 2000. "Fairness and Retaliation: The Economics of Reciprocity," Journal of Economic Perspectives, American Economic Association, vol. 14(3), pages 159-181, Summer.
    2. Joseph Henrich, 2001. "In Search of Homo Economicus: Behavioral Experiments in 15 Small-Scale Societies," American Economic Review, American Economic Association, vol. 91(2), pages 73-78, May.
    3. Robert H. Frank & Thomas Gilovich & Dennis T. Regan, 1993. "Does Studying Economics Inhibit Cooperation?," Journal of Economic Perspectives, American Economic Association, vol. 7(2), pages 159-171, Spring.
    4. David K. Levine & Drew Fudenberg, 2006. "A Dual-Self Model of Impulse Control," American Economic Review, American Economic Association, vol. 96(5), pages 1449-1476, December.
    5. Jean Tirole & Roland Bénabou, 2006. "Incentives and Prosocial Behavior," American Economic Review, American Economic Association, vol. 96(5), pages 1652-1678, December.
    6. Nicholas Bardsley & Robin Cubitt & Graham Loomes & Peter Moffatt & Chris Starmer & Robert Sugden, 2009. "Experimental Economics: Rethinking the Rules," Economics Books, Princeton University Press, edition 1, number 9074.
    7. Matthias Benz & Stephan Meier, "undated". "Do People Behave in Experiments as in the Field? � Evidence from Donations," IEW - Working Papers 248, Institute for Empirical Research in Economics - University of Zurich.
    8. Cox, James C., 2004. "How to identify trust and reciprocity," Games and Economic Behavior, Elsevier, vol. 46(2), pages 260-281, February.
    9. Bellemare, Charles & Kroger, Sabine, 2007. "On representative social capital," European Economic Review, Elsevier, vol. 51(1), pages 183-202, January.
    10. Jeffrey P. Carpenter & Stephen Burks & Eric Verhoogen, 2005. "Comparing Students To Workers: The Effects Of Social Framing On Behavior In Distribution Games," Research in Experimental Economics, in: Field Experiments in Economics, pages 261-289, Emerald Group Publishing Limited.
    11. Werner Güth & Carsten Schmidt & Matthias Sutter, 2007. "Bargaining outside the lab - a newspaper experiment of a three-person ultimatum game," Economic Journal, Royal Economic Society, vol. 117(518), pages 449-469, March.
    12. Marco Casari & John C. Ham & John H. Kagel, 2007. "Selection Bias, Demographic Effects, and Ability Effects in Common Value Auction Experiments," American Economic Review, American Economic Association, vol. 97(4), pages 1278-1304, September.
    13. Matthias Benz & Stephan Meier, 2008. "Do people behave in experiments as in the field?—evidence from donations," Experimental Economics, Springer;Economic Science Association, vol. 11(3), pages 268-281, September.
    14. repec:pri:rpdevs:gamespaper.pdf is not listed on IDEAS
    15. Cleave, Blair L. & Nikiforakis, Nikos & Slonim, Robert, 2010. "Is There Selection Bias in Laboratory Experiments?," Working Papers 2010-01, University of Sydney, School of Economics.
    16. Andersen, Steffen & Harrison, Glenn W. & Lau, Morten Igel & Rutström, E. Elisabet, 2010. "Preference heterogeneity in experiments: Comparing the field and laboratory," Journal of Economic Behavior & Organization, Elsevier, vol. 73(2), pages 209-224, February.
    17. Ernst Fehr & John A. List, 2004. "The Hidden Costs and Returns of Incentives-Trust and Trustworthiness Among CEOs," Journal of the European Economic Association, MIT Press, vol. 2(5), pages 743-771, September.
    18. Charles A. Holt & Susan K. Laury, 2002. "Risk Aversion and Incentive Effects," American Economic Review, American Economic Association, vol. 92(5), pages 1644-1655, December.
    19. Cameron, Lisa & Chaudhuri, Ananish & Erkal, Nisvan & Gangadharan, Lata, 2009. "Propensities to engage in and punish corrupt behavior: Experimental evidence from Australia, India, Indonesia and Singapore," Journal of Public Economics, Elsevier, vol. 93(7-8), pages 843-851, August.
    20. Charles R. Plott & Vernon L. Smith (ed.), 2008. "Handbook of Experimental Economics Results," Handbook of Experimental Economics Results, Elsevier, edition 1, volume 1, number 4.
    21. Charles R. Plott & Vernon L. Smith (ed.), 2008. "Handbook of Experimental Economics Results," Handbook of Experimental Economics Results, Elsevier, edition 1, volume 1, number 2.
    22. Catherine C. Eckel & Philip J. Grossman, 2000. "Volunteers and Pseudo-Volunteers: The Effect of Recruitment Method in Dictator Experiments," Experimental Economics, Springer;Economic Science Association, vol. 3(2), pages 107-120, October.
    23. R. Lynn Hannan & John H. Kagel & Donald V. Moser, 2002. "Partial Gift Exchange in an Experimental Labor Market: Impact of Subject Population Differences, Productivity Differences, and Effort Requests on Behavior," Journal of Labor Economics, University of Chicago Press, vol. 20(4), pages 923-951, October.
    24. Dean S. Karlan, 2005. "Using Experimental Economics to Measure Social Capital and Predict Financial Decisions," American Economic Review, American Economic Association, vol. 95(5), pages 1688-1699, December.
    25. Falk, Armin & Zehnder, Christian & Meier, Stephan, 2010. "Did We Overestimate the Role of Social Preferences? The Case of Self-Selected Student Samples," CEPR Discussion Papers 8019, C.E.P.R. Discussion Papers.
    26. David J. Cooper, 1999. "Gaming against Managers in Incentive Systems: Experimental Results with Chinese Students and Chinese Managers," American Economic Review, American Economic Association, vol. 89(4), pages 781-804, September.
    27. Slonim, Robert & Wang, Carmen & Garbarino, Ellen & Merrett, Danielle, 2012. "Opting-In: Participation Biases in the Lab," IZA Discussion Papers 6865, Institute of Labor Economics (IZA).
    28. Ben Greiner, 2004. "The Online Recruitment System ORSEE 2.0 - A Guide for the Organization of Experiments in Economics," Working Paper Series in Economics 10, University of Cologne, Department of Economics.
    29. Harrison, Glenn W. & Lau, Morten I. & Elisabet Rutström, E., 2009. "Risk attitudes, randomization to treatment, and self-selection into experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 70(3), pages 498-507, June.
    30. Steven D. Levitt & John A. List, 2007. "Viewpoint: On the generalizability of lab behaviour to the field," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 40(2), pages 347-370, May.
    31. Anderson, Jon E. & Burks, Stephen V. & Carpenter, Jeffrey P. & Götte, Lorenz & Maurer, Karsten & Nosenzo, Daniele & Potter, Ruth & Rocha, Kim & Rustichini, Aldo, 2010. "Self Selection Does Not Increase Other-Regarding Preferences among Adult Laboratory Subjects, but Student Subjects May Be More Self-Regarding than Adults," IZA Discussion Papers 5389, Institute of Labor Economics (IZA).
    32. Roe, Brian E. & Haab, Timothy C. & Beversdorf, David Q. & Gu, Howard H. & Tilley, Michael R., 2009. "Risk-attitude selection bias in subject pools for experiments involving neuroimaging and blood samples," Journal of Economic Psychology, Elsevier, vol. 30(2), pages 181-189, April.
    33. Binswanger, Hans P, 1981. "Attitudes toward Risk: Theoretical Implications of an Experiment in Rural India," Economic Journal, Royal Economic Society, vol. 91(364), pages 867-890, December.
    34. Friedman, Daniel, 2010. "Preferences, beliefs and equilibrium: What have experiments taught us?," Journal of Economic Behavior & Organization, Elsevier, vol. 73(1), pages 29-33, January.
    35. James Heckman & Hidehiko Ichimura & Jeffrey Smith & Petra Todd, 1998. "Characterizing Selection Bias Using Experimental Data," Econometrica, Econometric Society, vol. 66(5), pages 1017-1098, September.
    36. Catherine C. Eckel & Philip J. Grossman, 2008. "Forecasting Risk Attitudes: An Experimental Study Using Actual and Forecast Gamble Choices," Monash Economics Working Papers archive-01, Monash University, Department of Economics.
    37. Fehr, Ernst & Schmidt, Klaus M., 2006. "The Economics of Fairness, Reciprocity and Altruism - Experimental Evidence and New Theories," Handbook on the Economics of Giving, Reciprocity and Altruism, in: S. Kolm & Jean Mercier Ythier (ed.), Handbook of the Economics of Giving, Altruism and Reciprocity, edition 1, volume 1, chapter 8, pages 615-691, Elsevier.
    38. Rabin, Matthew, 1993. "Incorporating Fairness into Game Theory and Economics," American Economic Review, American Economic Association, vol. 83(5), pages 1281-1302, December.
    39. Steven D. Levitt & John A. List, 2007. "What Do Laboratory Experiments Measuring Social Preferences Reveal About the Real World?," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 153-174, Spring.
    40. Rachel Croson & Uri Gneezy, 2009. "Gender Differences in Preferences," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 448-474, June.
    41. Heckman, James, 2013. "Sample selection bias as a specification error," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 31(3), pages 129-137.
    42. Berg Joyce & Dickhaut John & McCabe Kevin, 1995. "Trust, Reciprocity, and Social History," Games and Economic Behavior, Elsevier, vol. 10(1), pages 122-142, July.
    43. Charles R. Plott & Vernon L. Smith (ed.), 2008. "Handbook of Experimental Economics Results," Handbook of Experimental Economics Results, Elsevier, edition 1, volume 1, number 6.
    44. Zingales, Luigi & Sapienza, Paola & Baran, Nicole M., 2010. "Can we infer social preferences from the lab? Evidence from the trust game," CEPR Discussion Papers 7634, C.E.P.R. Discussion Papers.
    45. Friedman,Daniel & Sunder,Shyam, 1994. "Experimental Methods," Cambridge Books, Cambridge University Press, number 9780521456821.
    46. Colin F. Camerer & Ernst Fehr, "undated". "Measuring Social Norms and Preferences using Experimental Games: A Guide for Social Scientists," IEW - Working Papers 097, Institute for Empirical Research in Economics - University of Zurich.
    47. Jeffrey Carpenter & Cristina Connolly & Caitlin Myers, 2008. "Altruistic behavior in a representative dictator experiment," Experimental Economics, Springer;Economic Science Association, vol. 11(3), pages 282-298, September.
    48. repec:dgr:kubcen:200347 is not listed on IDEAS
    49. Charles R. Plott & Vernon L. Smith (ed.), 2008. "Handbook of Experimental Economics Results," Handbook of Experimental Economics Results, Elsevier, edition 1, volume 1, number 7.
    50. Bohnet, Iris & Zeckhauser, Richard, 2004. "Trust, risk and betrayal," Journal of Economic Behavior & Organization, Elsevier, vol. 55(4), pages 467-484, December.
    51. Samuel Bowles & Robert Boyd & Colin Camerer & Ernst Fehr & Herbert Gintis & Joseph Henrich & Richard McElreath, 2001. "In search of homo economicus: Experiments in 15 small-scale societies," Artefactual Field Experiments 00068, The Field Experiments Website.
    52. Charles R. Plott & Vernon L. Smith (ed.), 2008. "Handbook of Experimental Economics Results," Handbook of Experimental Economics Results, Elsevier, edition 1, volume 1, number 1.
    53. Ben Greiner, 2004. "The Online Recruitment System ORSEE - A Guide for the Organization of Experiments in Economics," Papers on Strategic Interaction 2003-10, Max Planck Institute of Economics, Strategic Interaction Group.
    54. Bellemare, Charles & Kroger, Sabine, 2007. "On representative social capital," European Economic Review, Elsevier, vol. 51(1), pages 183-202, January.
    55. Charles R. Plott & Vernon L. Smith (ed.), 2008. "Handbook of Experimental Economics Results," Handbook of Experimental Economics Results, Elsevier, edition 1, volume 1, number 3.
    56. Nava Ashraf & Iris Bohnet & Nikita Piankov, 2006. "Decomposing trust and trustworthiness," Experimental Economics, Springer;Economic Science Association, vol. 9(3), pages 193-208, September.
    57. Garbarino, Ellen & Slonim, Robert, 2009. "The robustness of trust and reciprocity across a heterogeneous U.S. population," Journal of Economic Behavior & Organization, Elsevier, vol. 69(3), pages 226-240, March.
    58. Charles R. Plott & Vernon L. Smith (ed.), 2008. "Handbook of Experimental Economics Results," Handbook of Experimental Economics Results, Elsevier, edition 1, volume 1, number 8.
    59. Charles R. Plott & Vernon L. Smith (ed.), 2008. "Handbook of Experimental Economics Results," Handbook of Experimental Economics Results, Elsevier, edition 1, volume 1, number 5.
    60. James Andreoni & John Miller, 2002. "Giving According to GARP: An Experimental Test of the Consistency of Preferences for Altruism," Econometrica, Econometric Society, vol. 70(2), pages 737-753, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cleave, Blair L. & Nikiforakis, Nikos & Slonim, Robert, 2010. "Is There Selection Bias in Laboratory Experiments?," Working Papers 2010-01, University of Sydney, School of Economics.
    2. Slonim, Robert & Wang, Carmen & Garbarino, Ellen & Merrett, Danielle, 2013. "Opting-in: Participation bias in economic experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 90(C), pages 43-70.
    3. Slonim, Robert & Wang, Carmen & Garbarino, Ellen & Merrett, Danielle, 2012. "Opting-In: Participation Biases in the Lab," IZA Discussion Papers 6865, Institute of Labor Economics (IZA).
    4. Charness, Gary & Kuhn, Peter, 2011. "Lab Labor: What Can Labor Economists Learn from the Lab?," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 3, pages 229-330, Elsevier.
    5. Matteo M. Galizzi & Daniel Navarro-Martinez, 2019. "On the External Validity of Social Preference Games: A Systematic Lab-Field Study," Management Science, INFORMS, vol. 65(3), pages 976-1002, March.
    6. Martijn J. van den Assem & Dennie van Dolder & Richard H. Thaler, 2012. "Split or Steal? Cooperative Behavior When the Stakes Are Large," Management Science, INFORMS, vol. 58(1), pages 2-20, January.
    7. Giovanni Di Bartolomeo & Stefano Papa, 2019. "The Effects of Physical Activity on Social Interactions: The Case of Trust and Trustworthiness," Journal of Sports Economics, , vol. 20(1), pages 50-71, January.
    8. Croson, Rachel & Gächter, Simon, 2010. "The science of experimental economics," Journal of Economic Behavior & Organization, Elsevier, vol. 73(1), pages 122-131, January.
    9. Rigdon, Mary, 2009. "Trust and reciprocity in incentive contracting," Journal of Economic Behavior & Organization, Elsevier, vol. 70(1-2), pages 93-105, May.
    10. Sanjit Dhami, 2017. "Human Ethics and Virtues: Rethinking the Homo-Economicus Model," CESifo Working Paper Series 6836, CESifo.
    11. Johansson-Stenman, Olof & Mahmud, Minhaj & Martinsson, Peter, 2013. "Trust, trust games and stated trust: Evidence from rural Bangladesh," Journal of Economic Behavior & Organization, Elsevier, vol. 95(C), pages 286-298.
    12. Samuel Bowles & Sandra Polania-Reyes, 2011. "Economic incentives and social preferences: substitutes or complements?," Department of Economics University of Siena 617, Department of Economics, University of Siena.
    13. Stephen V. Burks & Erin L. Krupka, 2012. "A Multimethod Approach to Identifying Norms and Normative Expectations Within a Corporate Hierarchy: Evidence from the Financial Services Industry," Management Science, INFORMS, vol. 58(1), pages 203-217, January.
    14. Ciril Bosch-Rosa & Thomas Meissner & Antoni Bosch-Domènech, 2018. "Cognitive bubbles," Experimental Economics, Springer;Economic Science Association, vol. 21(1), pages 132-153, March.
    15. Pearson, Matthew & Schipper, Burkhard C., 2013. "Menstrual cycle and competitive bidding," Games and Economic Behavior, Elsevier, vol. 78(C), pages 1-20.
    16. Jon Anderson & Stephen Burks & Jeffrey Carpenter & Lorenz Götte & Karsten Maurer & Daniele Nosenzo & Ruth Potter & Kim Rocha & Aldo Rustichini, 2013. "Self-selection and variations in the laboratory measurement of other-regarding preferences across subject pools: evidence from one college student and two adult samples," Experimental Economics, Springer;Economic Science Association, vol. 16(2), pages 170-189, June.
    17. Güth, Werner & Kocher, Martin G., 2014. "More than thirty years of ultimatum bargaining experiments: Motives, variations, and a survey of the recent literature," Journal of Economic Behavior & Organization, Elsevier, vol. 108(C), pages 396-409.
    18. Falk, Armin & Zehnder, Christian & Meier, Stephan, 2010. "Did We Overestimate the Role of Social Preferences? The Case of Self-Selected Student Samples," CEPR Discussion Papers 8019, C.E.P.R. Discussion Papers.
    19. Ernesto Reuben & Matthew Wiswall & Basit Zafar, 2017. "Preferences and Biases in Educational Choices and Labour Market Expectations: Shrinking the Black Box of Gender," Economic Journal, Royal Economic Society, vol. 127(604), pages 2153-2186, September.
    20. Jiří Špalek & Zuzana Berná, 2011. "Threshold Effectiveness in Contributing to the Public Goods: Experiments Involving Czech Students," Prague Economic Papers, Prague University of Economics and Business, vol. 2011(3), pages 250-267.

    More about this item

    Keywords

    Selection bias; Laboratory experiments; External validity; Social preferences; Risk preferences;
    All these keywords.

    JEL classification:

    • C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General
    • D03 - Microeconomics - - General - - - Behavioral Microeconomics: Underlying Principles

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hal:journl:halshs-00943212. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CCSD (email available below). General contact details of provider: https://hal.archives-ouvertes.fr/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.