IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v65y2019i7p2966-2981.html
   My bibliography  Save this article

Algorithmic Bias? An Empirical Study of Apparent Gender-Based Discrimination in the Display of STEM Career Ads

Author

Listed:
  • Anja Lambrecht

    (Marketing, London Business School, London NW1 4SA, United Kingdom)

  • Catherine Tucker

    (Marketing, Massachusetts Institute of Technology, Cambridge, Massachusetts 02142)

Abstract

We explore data from a field test of how an algorithm delivered ads promoting job opportunities in the science, technology, engineering and math fields. This ad was explicitly intended to be gender neutral in its delivery. Empirically, however, fewer women saw the ad than men. This happened because younger women are a prized demographic and are more expensive to show ads to. An algorithm that simply optimizes cost-effectiveness in ad delivery will deliver ads that were intended to be gender neutral in an apparently discriminatory way, because of crowding out. We show that this empirical regularity extends to other major digital platforms.

Suggested Citation

  • Anja Lambrecht & Catherine Tucker, 2019. "Algorithmic Bias? An Empirical Study of Apparent Gender-Based Discrimination in the Display of STEM Career Ads," Management Science, INFORMS, vol. 65(7), pages 2966-2981, July.
    • Handle: RePEc:inm:ormnsc:v:65:y:2019:i:7:p:2966-2981
    DOI: 10.1287/mnsc.2018.3093
    as

    Download full text from publisher

    File URL: https://doi.org/10.1287/mnsc.2018.3093
    Download Restriction: no
    File URL: https://libkey.io/10.1287/mnsc.2018.3093?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Brown, Charles & Corcoran, Mary, 1997. "Sex-Based Differences in School Content and the Male-Female Wage Gap," Journal of Labor Economics, University of Chicago Press, vol. 15(3), pages 431-465, July.
    2. Becker, Gary S, 1993. "Nobel Lecture: The Economic Way of Looking at Behavior," Journal of Political Economy, University of Chicago Press, vol. 101(3), pages 385-409, June.
    3. Oaxaca, Ronald, 1973. "Male-Female Wage Differentials in Urban Labor Markets," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 14(3), pages 693-709, October.
    4. Gunderson, Morley, 1989. "Male-Female Wage Differentials and Policy Responses," Journal of Economic Literature, American Economic Association, vol. 27(1), pages 46-72, March.
    5. Claudia Goldin, 2014. "A Grand Gender Convergence: Its Last Chapter," American Economic Review, American Economic Association, vol. 104(4), pages 1091-1119, April.
    6. Devin G. Pope & Justin R. Sydnor, 2011. "What’s in a Picture?: Evidence of Discrimination from Prosper.com," Journal of Human Resources, University of Wisconsin Press, vol. 46(1), pages 53-92.
    7. Jon Kleinberg & Himabindu Lakkaraju & Jure Leskovec & Jens Ludwig & Sendhil Mullainathan, 2018. "Human Decisions and Machine Predictions," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(1), pages 237-293.
    8. Benjamin Edelman & Michael Luca & Dan Svirsky, 2017. "Racial Discrimination in the Sharing Economy: Evidence from a Field Experiment," American Economic Journal: Applied Economics, American Economic Association, vol. 9(2), pages 1-22, April.
    9. Sendhil Mullainathan & Jann Spiess, 2017. "Machine Learning: An Applied Econometric Approach," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 87-106, Spring.
    10. Joseph G. Altonji & Peter Arcidiacono & Arnaud Maurel, 2015. "The Analysis of Field Choice in College and Graduate School: Determinants and Wage Effects," NBER Working Papers 21655, National Bureau of Economic Research, Inc.
    11. Avi Goldfarb & Catherine Tucker, 2011. "Search Engine Advertising: Channel Substitution When Pricing Ads to Context," Management Science, INFORMS, vol. 57(3), pages 458-470, March.
    12. Fiona Morton & Florian Zettelmeyer & Jorge Silva-Risso, 2003. "Consumer Information and Discrimination: Does the Internet Affect the Pricing of New Cars to Women and Minorities?," Quantitative Marketing and Economics (QME), Springer, vol. 1(1), pages 65-92, March.
    13. Anja Lambrecht & Catherine Tucker & Caroline Wiertz, 2018. "Advertising to Early Trend Propagators: Evidence from Twitter," Marketing Science, INFORMS, vol. 37(2), pages 177-199, March.
    14. Benjamin Edelman & Micahel Luca, 2014. "Digital Discrimination: The Case of Airbnb.com," Harvard Business School Working Papers 14-054, Harvard Business School.
    15. Yanbo Ge & Christopher R. Knittel & Don MacKenzie & Stephen Zoepf, 2016. "Racial and Gender Discrimination in Transportation Network Companies," NBER Working Papers 22776, National Bureau of Economic Research, Inc.
    16. Susan Athey & Joshua S. Gans, 2010. "The Impact of Targeting Technology on Advertising Markets and Media Competition," American Economic Review, American Economic Association, vol. 100(2), pages 608-613, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Priyanga Gunarathne & Huaxia Rui & Abraham Seidmann, 2022. "Racial Bias in Customer Service: Evidence from Twitter," Information Systems Research, INFORMS, vol. 33(1), pages 43-54, March.
    2. Kas, Judith, 2022. "The effect of online reputation systems on intergroup inequality," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 96(C).
    3. Farajallah, Mehdi & Hammond, Robert G. & Pénard, Thierry, 2019. "What drives pricing behavior in Peer-to-Peer markets? Evidence from the carsharing platform BlaBlaCar," Information Economics and Policy, Elsevier, vol. 48(C), pages 15-31.
    4. Caliendo, Marco & Lee, Wang-Sheng & Mahlstedt, Robert, 2017. "The gender wage gap and the role of reservation wages: New evidence for unemployed workers," Journal of Economic Behavior & Organization, Elsevier, vol. 136(C), pages 161-173.
    5. Will Dobbie & Andres Liberman & Daniel Paravisini & Vikram Pathania, 2021. "Measuring Bias in Consumer Lending [Loan Prospecting and the Loss of Soft Information]," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 88(6), pages 2799-2832.
    6. Bonaccolto-Töpfer, Marina & Briel, Stephanie, 2022. "The gender pay gap revisited: Does machine learning offer new insights?," Labour Economics, Elsevier, vol. 78(C).
    7. Nathan Blascak & Anna Tranfaglia, 2021. "Decomposing Gender Differences in Bankcard Credit Limits," Finance and Economics Discussion Series 2021-072, Board of Governors of the Federal Reserve System (U.S.).
    8. Michal Myck & Gillian Paull, 2001. "The role of employment experience in explaining the gender wage gap," IFS Working Papers W01/18, Institute for Fiscal Studies.
    9. C Dougherty, 2003. "Why is the Rate of Return to Schooling Higher For Women Than For Men?," CEP Discussion Papers dp0581, Centre for Economic Performance, LSE.
    10. Christopher Dougherty, 2005. "Why Are the Returns to Schooling Higher for Women than for Men?," Journal of Human Resources, University of Wisconsin Press, vol. 40(4), pages 969-988.
    11. Marchenko, Anya, 2019. "The impact of host race and gender on prices on Airbnb," Journal of Housing Economics, Elsevier, vol. 46(C).
    12. Ewens, Michael, 2022. "Race and Gender in Entrepreneurial Finance," SocArXiv djf8z, Center for Open Science.
    13. Jorge Mejia & Chris Parker, 2021. "When Transparency Fails: Bias and Financial Incentives in Ridesharing Platforms," Management Science, INFORMS, vol. 67(1), pages 166-184, January.
    14. Tromp, Nikolas & Kwak, Juwon, 2022. "Graduating to a gender wage gap in South Korea," Journal of Asian Economics, Elsevier, vol. 78(C).
    15. Sophie-Charlotte Klose & Johannes Lederer, 2020. "A Pipeline for Variable Selection and False Discovery Rate Control With an Application in Labor Economics," Papers 2006.12296, arXiv.org, revised Jun 2020.
    16. Töpfer, Marina, 2017. "Detailed RIF decomposition with selection: The gender pay gap in Italy," Hohenheim Discussion Papers in Business, Economics and Social Sciences 26-2017, University of Hohenheim, Faculty of Business, Economics and Social Sciences.
    17. Katie Meara & Francesco Pastore & Allan Webster, 2020. "The gender pay gap in the USA: a matching study," Journal of Population Economics, Springer;European Society for Population Economics, vol. 33(1), pages 271-305, January.
    18. Daniela Andrén & Thomas Andrén, 2015. "Gender and occupational wage gaps in Romania: from planned equality to market inequality?," IZA Journal of European Labor Studies, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 4(1), pages 1-27, December.
    19. repec:eee:labchp:v:3:y:1999:i:pc:p:3573-3630 is not listed on IDEAS
    20. Lutz, Christoph & Newlands, Gemma, 2018. "Consumer segmentation within the sharing economy: The case of Airbnb," Journal of Business Research, Elsevier, vol. 88(C), pages 187-196.
    21. P.W. Miller & S. Rummery, 1989. "Gender Wage Discrimination in Australia: A reassessment," Economics Discussion / Working Papers 89-21, The University of Western Australia, Department of Economics.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:65:y:2019:i:7:p:2966-2981. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.