IDEAS home Printed from https://ideas.repec.org/p/nad/wpaper/20200046.html
   My bibliography  Save this paper

Does selection bias cause us to overestimate gender differences in competitiveness?

Author

Listed:
  • Aurélie Dariel
  • Nikos Nikiforakis
  • Jan Stoop

    (Division of Social Science)

Abstract

Experimental evidence suggests there is a substantial difference in the willingness of men and women to compete that could help explain the gender gap in labor market outcomes. The use of volunteer samples, however, raises a question about whether self-selection into experiments biases the estimated difference in competitiveness. To address it, we first measure the willingness of 1,145 individuals to compete in a classroom experiment. We then identify among them the subset of ‘lab volunteers’ by observing who accepts an invitation to participate in lab experiments. To test for the existence of selection bias, we compare the gender gap among lab volunteers to that in the population from which they were recruited. We find that selection causes us to overestimate the gender gap in competitiveness by 16 percentage points in absolute terms and, in relative terms, by a factor of 2 to 3 depending on the econometric model. We also show that selection causes us to significantly overestimate the gender gap in risk attitudes and the tendency of low performing men to select into competition. We present evidence men and women select differently into the lab, and discuss the implications of our findings for future research.

Suggested Citation

  • Aurélie Dariel & Nikos Nikiforakis & Jan Stoop, 2020. "Does selection bias cause us to overestimate gender differences in competitiveness?," Working Papers 20200046, New York University Abu Dhabi, Department of Social Science, revised May 2020.
  • Handle: RePEc:nad:wpaper:20200046
    as

    Download full text from publisher

    File URL: https://nyuad.nyu.edu/content/dam/nyuad/academics/divisions/social-science/working-papers/2020/0046.pdf
    File Function: First version, 2020
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Uri Gneezy & Kenneth L. Leonard & John A. List, 2009. "Gender Differences in Competition: Evidence From a Matrilineal and a Patriarchal Society," Econometrica, Econometric Society, vol. 77(5), pages 1637-1664, September.
    2. Armin Falk & James J. Heckman, 2009. "Lab Experiments are a Major Source of Knowledge in the Social Sciences," Working Papers 200935, Geary Institute, University College Dublin.
    3. Jonathan Schulz & Uwe Sunde & Petra Thiemann & Christian Thoeni, 2019. "Selection into Experiments: Evidence from a Population of Students," Discussion Papers 2019-09, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
    4. Ben Greiner, 2015. "Subject pool recruitment procedures: organizing experiments with ORSEE," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 1(1), pages 114-125, July.
    5. Steffen Andersen & Seda Ertac & Uri Gneezy & John A. List & Sandra Maximiano, 2013. "Gender, Competitiveness, and Socialization at a Young Age: Evidence From a Matrilineal and a Patriarchal Society," The Review of Economics and Statistics, MIT Press, vol. 95(4), pages 1438-1443, October.
    6. Ben Gillen & Erik Snowberg & Leeat Yariv, 2019. "Experimenting with Measurement Error: Techniques with Applications to the Caltech Cohort Study," Journal of Political Economy, University of Chicago Press, vol. 127(4), pages 1826-1863.
    7. Samak, Anya C., 2013. "Is there a gender gap in preschoolers’ competitiveness? An experiment in the U.S," Journal of Economic Behavior & Organization, Elsevier, vol. 92(C), pages 22-31.
    8. Francine D. Blau & Lawrence M. Kahn, 2017. "The Gender Wage Gap: Extent, Trends, and Explanations," Journal of Economic Literature, American Economic Association, vol. 55(3), pages 789-865, September.
    9. Ingvild Almås & Alexander W. Cappelen & Kjell G. Salvanes & Erik Ø. Sørensen & Bertil Tungodden, 2016. "Willingness to Compete: Family Matters," Management Science, INFORMS, vol. 62(8), pages 2149-2162, August.
    10. Khachatryan, Karen & Dreber, Anna & von Essen, Emma & Ranehill, Eva, 2015. "Gender and preferences at a young age: Evidence from Armenia," Journal of Economic Behavior & Organization, Elsevier, vol. 118(C), pages 318-332.
    11. Lee, Soohyung & Niederle, Muriel & Kang, Namwook, 2014. "Do single-sex schools make girls more competitive?," Economics Letters, Elsevier, vol. 124(3), pages 474-477.
    12. Cadsby, C. Bram & Servátka, Maroš & Song, Fei, 2013. "How competitive are female professionals? A tale of identity conflict," Journal of Economic Behavior & Organization, Elsevier, vol. 92(C), pages 284-303.
    13. Olga Shurchkov, 2012. "Under Pressure: Gender Differences In Output Quality And Quantity Under Competition And Time Constraints," Journal of the European Economic Association, European Economic Association, vol. 10(5), pages 1189-1213, October.
    14. Anna Dreber & Emma Essen & Eva Ranehill, 2014. "Gender and competition in adolescence: task matters," Experimental Economics, Springer;Economic Science Association, vol. 17(1), pages 154-172, March.
    15. Matthias Sutter & Daniela Glätzle-Rützler, 2015. "Gender Differences in the Willingness to Compete Emerge Early in Life and Persist," Management Science, INFORMS, vol. 61(10), pages 2339-23354, October.
    16. Banerjee, Ritwik & Gupta, Nabanita Datta & Villeval, Marie Claire, 2018. "The spillover effects of affirmative action on competitiveness and unethical behavior," European Economic Review, Elsevier, vol. 101(C), pages 567-604.
    17. Johannes Abeler & Daniele Nosenzo, 2015. "Self-selection into laboratory experiments: pro-social motives versus monetary incentives," Experimental Economics, Springer;Economic Science Association, vol. 18(2), pages 195-214, June.
    18. Thomas Buser & Noemi Peter & Stefan C. Wolter, 2017. "Gender, Competitiveness, and Study Choices in High School: Evidence from Switzerland," American Economic Review, American Economic Association, vol. 107(5), pages 125-130, May.
    19. Claudia Goldin, 2014. "A Grand Gender Convergence: Its Last Chapter," American Economic Review, American Economic Association, vol. 104(4), pages 1091-1119, April.
    20. Cárdenas, Juan-Camilo & Dreber, Anna & von Essen, Emma & Ranehill, Eva, 2012. "Gender differences in competitiveness and risk taking: Comparing children in Colombia and Sweden," Journal of Economic Behavior & Organization, Elsevier, vol. 83(1), pages 11-23.
    21. Martin G. Kocher & David Schindler & Stefan T. Trautmann & Yilong Xu, 2019. "Risk, time pressure, and selection effects," Experimental Economics, Springer;Economic Science Association, vol. 22(1), pages 216-246, March.
    22. Aurelie Dariel & Curtis Kephart & Nikos Nikiforakis & Christina Zenker, 2017. "Emirati women do not shy away from competition: evidence from a patriarchal society in transition," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 3(2), pages 121-136, December.
    23. Muriel Niederle & Lise Vesterlund, 2007. "Do Women Shy Away From Competition? Do Men Compete Too Much?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(3), pages 1067-1101.
    24. Balafoutas, Loukas & Kerschbamer, Rudolf & Sutter, Matthias, 2012. "Distributional preferences and competitive behavior," Journal of Economic Behavior & Organization, Elsevier, vol. 83(1), pages 125-135.
    25. Berlin, Noémi & Dargnies, Marie-Pierre, 2016. "Gender differences in reactions to feedback and willingness to compete," Journal of Economic Behavior & Organization, Elsevier, vol. 130(C), pages 320-336.
    26. Eckel, Catherine C. & Grossman, Philip J., 2008. "Men, Women and Risk Aversion: Experimental Evidence," Handbook of Experimental Economics Results, in: Charles R. Plott & Vernon L. Smith (ed.), Handbook of Experimental Economics Results, edition 1, volume 1, chapter 113, pages 1061-1073, Elsevier.
    27. David Wozniak & William T. Harbaugh & Ulrich Mayr, 2014. "The Menstrual Cycle and Performance Feedback Alter Gender Differences in Competitive Choices," Journal of Labor Economics, University of Chicago Press, vol. 32(1), pages 161-198.
    28. Thomas Buser & Leonie Gerhards & Joël Weele, 2018. "Responsiveness to feedback as a personal trait," Journal of Risk and Uncertainty, Springer, vol. 56(2), pages 165-192, April.
    29. Blair Cleave & Nikos Nikiforakis & Robert Slonim, 2013. "Is there selection bias in laboratory experiments? The case of social and risk preferences," Experimental Economics, Springer;Economic Science Association, vol. 16(3), pages 372-382, September.
    30. Curtis R. Price, 2012. "Gender, Competition, and Managerial Decisions," Management Science, INFORMS, vol. 58(1), pages 114-122, January.
    31. Kamas, Linda & Preston, Anne, 2012. "The importance of being confident; gender, career choice, and willingness to compete," Journal of Economic Behavior & Organization, Elsevier, vol. 83(1), pages 82-97.
    32. Coren L. Apicella & Elif E. Demiral & Johanna Mollerstrom, 2017. "No Gender Difference in Willingness to Compete When Competing against Self," American Economic Review, American Economic Association, vol. 107(5), pages 136-140, May.
    33. Muriel Niederle & Carmit Segal & Lise Vesterlund, 2013. "How Costly Is Diversity? Affirmative Action in Light of Gender Differences in Competitiveness," Management Science, INFORMS, vol. 59(1), pages 1-16, May.
    34. Benndorf, Volker & Moellers, Claudia & Normann, Hans-Theo, 2017. "Experienced vs. inexperienced participants in the lab: Do they behave differently?," DICE Discussion Papers 251, Heinrich Heine University Düsseldorf, Düsseldorf Institute for Competition Economics (DICE).
    35. Marie-Pierre Dargnies, 2012. "Men Too Sometimes Shy Away from Competition: The Case of Team Competition," Management Science, INFORMS, vol. 58(11), pages 1982-2000, November.
    36. Thomas Buser & Muriel Niederle & Hessel Oosterbeek, 2014. "Gender, Competitiveness, and Career Choices," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 129(3), pages 1409-1447.
    37. Müller, Julia & Schwieren, Christiane, 2012. "Can personality explain what is underlying women’s unwillingness to compete?," Journal of Economic Psychology, Elsevier, vol. 33(3), pages 448-460.
    38. Slonim, Robert & Wang, Carmen & Garbarino, Ellen & Merrett, Danielle, 2012. "Opting-In: Participation Biases in the Lab," IZA Discussion Papers 6865, Institute of Labor Economics (IZA).
    39. Nabanita Datta Gupta & Anders Poulsen & Marie Claire Villeval, 2013. "Gender Matching And Competitiveness: Experimental Evidence," Economic Inquiry, Western Economic Association International, vol. 51(1), pages 816-835, January.
    40. Harrison, Glenn W. & Lau, Morten I. & Elisabet Rutström, E., 2009. "Risk attitudes, randomization to treatment, and self-selection into experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 70(3), pages 498-507, June.
    41. Volker Benndorf & Claudia Moellers & Hans-Theo Normann, 2017. "Experienced vs. inexperienced participants in the lab: do they behave differently?," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 3(1), pages 12-25, July.
    42. Marie-Pierre Dargnies, 2012. "Men Too Sometimes Shy Away from Competition : The Case of Team Competition," Post-Print hal-01492284, HAL.
    43. Y Jane Zhang, 2019. "Culture, Institutions and the Gender Gap in Competitive Inclination: Evidence from the Communist Experiment in China," The Economic Journal, Royal Economic Society, vol. 129(617), pages 509-552.
    44. Armin Falk & Stephan Meier & Christian Zehnder, 2013. "Do Lab Experiments Misrepresent Social Preferences? The Case Of Self-Selected Student Samples," Journal of the European Economic Association, European Economic Association, vol. 11(4), pages 839-852, August.
    45. Steven D. Levitt & John A. List, 2007. "What Do Laboratory Experiments Measuring Social Preferences Reveal About the Real World?," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 153-174, Spring.
    46. Filippos Exadaktylos & Antonio M. Espin & Pablo Branas-Garza, 2012. "Experimental Subjects are Not Different," Working Papers 12-11, Chapman University, Economic Science Institute.
    47. Halko, Marja-Liisa & Sääksvuori, Lauri, 2017. "Competitive behavior, stress, and gender," Journal of Economic Behavior & Organization, Elsevier, vol. 141(C), pages 96-109.
    48. Rachel Croson & Uri Gneezy, 2009. "Gender Differences in Preferences," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 448-474, June.
    49. Andrew Healy & Jennifer Pate, 2011. "Can Teams Help to Close the Gender Competition Gap?," Economic Journal, Royal Economic Society, vol. 121(555), pages 1192-1204, September.
    50. Slonim, Robert & Wang, Carmen & Garbarino, Ellen & Merrett, Danielle, 2013. "Opting-in: Participation bias in economic experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 90(C), pages 43-70.
    51. Werner Bönte & Vivien Procher & Diemo Urbig, 2018. "Gender differences in selection into self-competition," Applied Economics Letters, Taylor & Francis Journals, vol. 25(8), pages 539-543, May.
    52. Matthias Sutter & Daniela Glätzle-Rützler & Loukas Balafoutas & Simon Czermak, 2016. "Cancelling out early age gender differences in competition: an analysis of policy interventions," Experimental Economics, Springer;Economic Science Association, vol. 19(2), pages 412-432, June.
    53. Ernesto Reuben & Paola Sapienza & Luigi Zingales, 2019. "Taste for competition and the gender gap among young business professionals," Working Papers 20190031, New York University Abu Dhabi, Department of Social Science, revised Nov 2019.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Aurelie Dariel & Nikos Nikiforakis & Jan Stoop, 2022. "Competition, Selection Bias and Gender Differences Among Economics Majors," Working Papers 20220074, New York University Abu Dhabi, Department of Social Science, revised Jan 2022.
    2. Jørgensen, Lotte Kofoed & Piovesan, Marco & Willadsen, Helene, 2022. "Gender differences in competitiveness: Friends matter," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 101(C).
    3. Aurelie Dariel & Curtis Kephart & Nikos Nikiforakis & Christina Zenker, 2017. "Emirati women do not shy away from competition: evidence from a patriarchal society in transition," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 3(2), pages 121-136, December.
    4. Carpenter, Jeffrey & Frank, Rachel & Huet-Vaughn, Emiliano, 2018. "Gender differences in interpersonal and intrapersonal competitive behavior," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 77(C), pages 170-176.
    5. Cassar, Alessandra & Zhang, Y. Jane, 2022. "The competitive woman: Evolutionary insights and cross-cultural evidence into finding the Femina Economica," Journal of Economic Behavior & Organization, Elsevier, vol. 197(C), pages 447-471.
    6. Buser, Thomas & van den Assem, Martijn J. & van Dolder, Dennie, 2023. "Gender and willingness to compete for high stakes," Journal of Economic Behavior & Organization, Elsevier, vol. 206(C), pages 350-370.
    7. Kessel, Dany & Mollerstrom, Johanna & van Veldhuizen, Roel, 2021. "Can simple advice eliminate the gender gap in willingness to compete?," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 138, pages 1-1.
    8. Eber, Nicolas & François, Abel & Weill, Laurent, 2021. "Gender, age, and attitude toward competition," Journal of Economic Behavior & Organization, Elsevier, vol. 192(C), pages 668-690.
    9. Balafoutas, Loukas & Sutter, Matthias, 2019. "How uncertainty and ambiguity in tournaments affect gender differences in competitive behavior," European Economic Review, Elsevier, vol. 118(C), pages 1-13.
    10. Helena Fornwagner & Monika Pompeo & Nina Serdarevic, 2023. "Choosing Competition on Behalf of Someone Else," Management Science, INFORMS, vol. 69(3), pages 1555-1574, March.
    11. Muriel Niederle, 2014. "Gender," NBER Working Papers 20788, National Bureau of Economic Research, Inc.
    12. Jeworrek, Sabrina, 2019. "Gender stereotypes still in MIND: Information on relative performance and competition entry," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 82(C).
    13. Charness, Gary & Dao, Lien & Shurchkov, Olga, 2022. "Competing now and then: The effects of delay on competitiveness across gender," Journal of Economic Behavior & Organization, Elsevier, vol. 198(C), pages 612-630.
    14. Johnsen, Åshild A. & Finseraas, Henning & Hanson, Torbjørn & Kotsadam, Andreas, 2023. "The malleability of competitive preferences," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 104(C).
    15. Markowsky, Eva & Beblo, Miriam, 2022. "When do we observe a gender gap in competition entry? A meta-analysis of the experimental literature," Journal of Economic Behavior & Organization, Elsevier, vol. 198(C), pages 139-163.
    16. Horn, Dániel & Kiss, Hubert János & Lénárd, Tünde, 2022. "Gender differences in preferences of adolescents: Evidence from a large-scale classroom experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 194(C), pages 478-522.
    17. John Ifcher & Homa Zarghamee, 2016. "Do Gender-Variant Preferences For Competition Persist In The Absence Of Performance?," Economic Inquiry, Western Economic Association International, vol. 54(4), pages 1918-1930, October.
    18. Buser, Thomas & Ranehill, Eva & van Veldhuizen, Roel, 2021. "Gender differences in willingness to compete: The role of public observability," Journal of Economic Psychology, Elsevier, vol. 83(C).
    19. Silvia Saccardo & Aniela Pietrasz & Uri Gneezy, 2018. "On the Size of the Gender Difference in Competitiveness," Management Science, INFORMS, vol. 64(4), pages 1541-1554, April.
    20. Jeworrek, Sabrina, 2016. "Competition Entry and Relative Performance Feedback: The Importance of Information Disaggregated by Gender," VfS Annual Conference 2016 (Augsburg): Demographic Change 145859, Verein für Socialpolitik / German Economic Association.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nad:wpaper:20200046. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Alizeh Batra (email available below). General contact details of provider: https://edirc.repec.org/data/ecnyuae.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.