IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp17632.html

Gender Bias in Student Evaluations of Teaching: Do Debiasing Campaigns Work?

Author

Listed:
  • Ayllón, Sara

    (Universitat de Girona)

  • Zamora, Camila

    (Autonomous University of Barcelona)

Abstract

This paper presents the results of a field experiment aimed at reducing the gender bias in teaching evaluations at a higher education institution. In the intervention, before they completed the teaching evaluation questionnaire, students were individually randomized in three groups. One third received an email invitation to watch a video that informed them of the existence of implicit bias (treatment 1). Another third of the students received an email invitation to watch a video with an explicit message that made them aware of the presence of gender bias in teaching evaluations (treatment 2). This second video also mentioned the fact that the academic literature has shown that this form of discrimination often originates with male students. At the end of both videos, all the students treated were asked to avoid displaying prejudice when they completed the questionnaire. The final third of students was assigned to the control group and did not receive any message. The results indicate that the video on implicit bias served to reduce the score gap between male and female lecturers. However, the video on gender bias had an unintended consequence: male students in the treatment group awarded their female teachers even lower scores than did the control group — confirming the risk of backlash or reactance in this kind of debiasing campaign. Such an effect was found to be particularly strong in female-dominated academic contexts.

Suggested Citation

  • Ayllón, Sara & Zamora, Camila, 2025. "Gender Bias in Student Evaluations of Teaching: Do Debiasing Campaigns Work?," IZA Discussion Papers 17632, IZA Network @ LISER.
  • Handle: RePEc:iza:izadps:dp17632
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp17632.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Rooth, Dan-Olof, 2010. "Automatic associations and discrimination in hiring: Real world evidence," Labour Economics, Elsevier, vol. 17(3), pages 523-534, June.
    2. Neckermann, Susanne & Turmunkh, Uyanga & van Dolder, Dennie & Wang, Tong V., 2022. "Nudging student participation in online evaluations of teaching: Evidence from a field experiment," European Economic Review, Elsevier, vol. 141(C).
    3. Erin Hengel, 2022. "Publishing While Female: are Women Held to Higher Standards? Evidence from Peer Review," The Economic Journal, Royal Economic Society, vol. 132(648), pages 2951-2991.
    4. Eliana Avitzour & Adi Choen & Daphna Joel & Victor Lavy, 2020. "On the Origins of Gender-Biased Behavior: The Role of Explicit and Implicit Stereotypes," NBER Working Papers 27818, National Bureau of Economic Research, Inc.
    5. Alexia Delfino, 2024. "Breaking Gender Barriers: Experimental Evidence on Men in Pink-Collar Jobs," American Economic Review, American Economic Association, vol. 114(6), pages 1816-1853, June.
    6. Markus Eberhardt & Giovanni Facchini & Valeria Rueda, 2023. "Gender Differences in Reference Letters: Evidence from the Economics Job Market," The Economic Journal, Royal Economic Society, vol. 133(655), pages 2676-2708.
    7. Rieger, Matthias & Voorvelt, Katherine, 2016. "Gender, ethnicity and teaching evaluations: Evidence from mixed teaching teamsAuthor-Name: Wagner, Natascha," Economics of Education Review, Elsevier, vol. 54(C), pages 79-94.
    8. Philip Oreopoulos, 2011. "Why Do Skilled Immigrants Struggle in the Labor Market? A Field Experiment with Thirteen Thousand Resumes," American Economic Journal: Economic Policy, American Economic Association, vol. 3(4), pages 148-171, November.
    9. Boring, Anne & Philippe, Arnaud, 2021. "Reducing discrimination in the field: Evidence from an awareness raising intervention targeting gender biases in student evaluations of teaching," Journal of Public Economics, Elsevier, vol. 193(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Claudia Curi & Andreas Dibiasi & Matteo Ploner & Mirco Tonin, 2026. "Gender Differences in Pension Investment: The Role of Biased Advice," CESifo Working Paper Series 12569, CESifo.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ayllón, Sara, 2022. "Online teaching and gender bias," Economics of Education Review, Elsevier, vol. 89(C).
    2. Baltrunaite, Audinga & Casarico, Alessandra & Rizzica, Lucia, 2025. "Women in economics: The role of gendered references at entry in the profession," European Economic Review, Elsevier, vol. 180(C).
    3. Boring, Anne & Philippe, Arnaud, 2021. "Reducing discrimination in the field: Evidence from an awareness raising intervention targeting gender biases in student evaluations of teaching," Journal of Public Economics, Elsevier, vol. 193(C).
    4. Robert Dur & Carlos Gomez-Gonzalez & Cornel Nesseler, 2022. "How to reduce discrimination? Evidence from a field experiment in amateur soccer," Tinbergen Institute Discussion Papers 22-005/VII, Tinbergen Institute.
    5. Gordon B. Dahl & Matthew Knepper, 2023. "Age Discrimination across the Business Cycle," American Economic Journal: Economic Policy, American Economic Association, vol. 15(4), pages 75-112, November.
    6. Kai Barron & Ruth Ditlmann & Stefan Gehrig & Sebastian Schweighofer-Kodritsch, 2025. "Explicit and Implicit Belief-Based Gender Discrimination: A Hiring Experiment," Management Science, INFORMS, vol. 71(2), pages 1600-1622, February.
    7. David Neumark, 2018. "Experimental Research on Labor Market Discrimination," Journal of Economic Literature, American Economic Association, vol. 56(3), pages 799-866, September.
    8. Joanna Tyrowicz & Lucas Augusto van der Velde & Magdalena Smyk, 2024. "Gender-neutral hiring of junior scholars," GRAPE Working Papers 94, GRAPE Group for Research in Applied Economics.
    9. Sara Ayllón & Lars J. Lefgren & Richard W. Patterson & Olga B. Stoddard & Nicolás Urdaneta Andrade, 2025. "‘Sorting’ Out Gender Discrimination and Disadvantage: Evidence from Student Evaluations of Teaching," NBER Working Papers 33911, National Bureau of Economic Research, Inc.
    10. Gaddis, S. Michael, 2018. "An Introduction to Audit Studies in the Social Sciences," SocArXiv e5hfc, Center for Open Science.
    11. Achim Ahrens & Christian B. Hansen & Mark E. Schaffer & Thomas Wiemann, 2025. "Model Averaging and Double Machine Learning," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 40(3), pages 249-269, April.
    12. Singhal, Karan & Sierminska, Eva, 2024. "Inequality in the Economics Profession," IZA Discussion Papers 17584, IZA Network @ LISER.
    13. Veit, Susanne & Thijsen, Lex, 2019. "Almost identical but still treated differently: hiring discrimination against foreign-born and domestic-born minorities," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 47(6), pages 1285-1304.
    14. Valentina Paredes & M. Daniele Paserman & Francisco J. Pino, 2025. "Does Economics Make You Sexist?," The Review of Economics and Statistics, MIT Press, vol. 107(5), pages 1247-1259, September.
    15. Ayaita, Adam, 2021. "Labor Market Discrimination and Statistical Differences in Unobserved Characteristics of Applicants," EconStor Preprints 236615, ZBW - Leibniz Information Centre for Economics.
    16. Lieselotte Blommaert & Marcel Coenders & Frank Tubergen, 2014. "Ethnic Discrimination in Recruitment and Decision Makers’ Features: Evidence from Laboratory Experiment and Survey Data using a Student Sample," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 116(3), pages 731-754, May.
    17. Agata Czech & Marcelo Olarreaga & Olivia Peila, 2024. "Gender gap in faculty promotion," PLOS ONE, Public Library of Science, vol. 19(11), pages 1-12, November.
    18. Ronald B. Davies & Zuzanna Studnicka, 2023. "A review of submissions to International Tax and Public Finance, 2010–2020," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 30(4), pages 1185-1201, August.
    19. Stansbury, Anna & Rodriguez, Kyra, 2026. "The Class Gap in Career Progression: Evidence from U.S. Academia," SocArXiv ugdjf_v1, Center for Open Science.
    20. Sona Badalyan & Darya Korlyakova & Rastislav Rehak, 2023. "Disclosure Discrimination: An Experiment Focusing on Communication in the Hiring Process," CERGE-EI Working Papers wp743, The Center for Economic Research and Graduate Education - Economics Institute, Prague.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • J71 - Labor and Demographic Economics - - Labor Discrimination - - - Hiring and Firing

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp17632. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Mark Fallak (email available below). General contact details of provider: https://edirc.repec.org/data/izaaalu.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.