IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/22278.html
   My bibliography  Save this paper

Do Field Experiments on Labor and Housing Markets Overstate Discrimination? A Re-examination of the Evidence

Author

Listed:
  • David Neumark
  • Judith Rich

Abstract

There have been over 80 field experiments on traditional dimensions of discrimination in labor and housing markets since 2000, in 23 countries. These studies nearly always find evidence of discrimination against minorities. However, the estimates of discrimination in these studies can be biased if there is differential variation in the unobservable determinants of productivity or quality of majority and minority groups, so it is possible that this experimental literature as a whole overstates the evidence of discrimination. We re-assess the evidence from the 10 existing studies of discrimination that have sufficient information to correct for this bias. For the housing market studies, the estimated effect of discrimination is robust to this correction. For the labor market studies, in contrast, the evidence is less robust, as just over half of the estimates of discrimination either fall to near zero, become statistically insignificant, or change sign.

Suggested Citation

  • David Neumark & Judith Rich, 2016. "Do Field Experiments on Labor and Housing Markets Overstate Discrimination? A Re-examination of the Evidence," NBER Working Papers 22278, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:22278
    Note: LS
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w22278.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Ali M. Ahmed & Lina Andersson & Mats Hammarstedt, 2010. "Can Discrimination in the Housing Market Be Reduced by Increasing the Information about the Applicants?," Land Economics, University of Wisconsin Press, vol. 86(1), pages 79-90.
    2. Stijn Baert & Bart Cockx & Niels Gheyle & Cora Vandamme, 2015. "Is There Less Discrimination in Occupations Where Recruitment Is Difficult?," ILR Review, Cornell University, ILR School, vol. 68(3), pages 467-500, May.
    3. Carlsson, Magnus & Eriksson, Stefan, 2014. "Discrimination in the rental market for apartments," Journal of Housing Economics, Elsevier, vol. 23(C), pages 41-54.
    4. Jacob A. Mincer, 1974. "Introduction to "Schooling, Experience, and Earnings"," NBER Chapters, in: Schooling, Experience, and Earnings, pages 1-4, National Bureau of Economic Research, Inc.
    5. Carlsson, Magnus & Rooth, Dan-Olof, 2007. "Evidence of ethnic discrimination in the Swedish labor market using experimental data," Labour Economics, Elsevier, vol. 14(4), pages 716-729, August.
    6. Carlsson, Magnus & Fumarco, Luca & Rooth, Dan-Olof, 2013. "Artifactual evidence of discrimination in correspondence studies? A replication of the Neumark method," POLIS Working Papers 172, Institute of Public Policy and Public Choice - POLIS.
    7. Jacob A. Mincer, 1974. "Schooling, Experience, and Earnings," NBER Books, National Bureau of Economic Research, Inc, number minc74-1, March.
    8. Marianne Bertrand & Dolly Chugh & Sendhil Mullainathan, 2005. "Implicit Discrimination," American Economic Review, American Economic Association, vol. 95(2), pages 94-98, May.
    9. Michael Ewens & Bryan Tomlin & Liang Choon Wang, 2014. "Statistical Discrimination or Prejudice? A Large Sample Field Experiment," The Review of Economics and Statistics, MIT Press, vol. 96(1), pages 119-134, March.
    10. David Neumark & Ian Burn & Patrick Button, 2019. "Is It Harder for Older Workers to Find Jobs? New and Improved Evidence from a Field Experiment," Journal of Political Economy, University of Chicago Press, vol. 127(2), pages 922-970.
    11. James J. Heckman, 1998. "Detecting Discrimination," Journal of Economic Perspectives, American Economic Association, vol. 12(2), pages 101-116, Spring.
    12. David Neumark, 2012. "Detecting Discrimination in Audit and Correspondence Studies," Journal of Human Resources, University of Wisconsin Press, vol. 47(4), pages 1128-1157.
    13. David Neumark, 2016. "Experimental Research on Labor Market Discrimination," NBER Working Papers 22022, National Bureau of Economic Research, Inc.
    14. Bosch, Mariano & Carnero, M. Angeles & Farré, Lídia, 2010. "Information and discrimination in the rental housing market: Evidence from a field experiment," Regional Science and Urban Economics, Elsevier, vol. 40(1), pages 11-19, January.
    15. Marianne Bertrand & Sendhil Mullainathan, 2004. "Are Emily and Greg More Employable Than Lakisha and Jamal? A Field Experiment on Labor Market Discrimination," American Economic Review, American Economic Association, vol. 94(4), pages 991-1013, September.
    16. Rich, Judy, 2014. "What Do Field Experiments of Discrimination in Markets Tell Us? A Meta Analysis of Studies Conducted since 2000," IZA Discussion Papers 8584, Institute of Labor Economics (IZA).
    17. Jacob A. Mincer, 1974. "Schooling and Earnings," NBER Chapters, in: Schooling, Experience, and Earnings, pages 41-63, National Bureau of Economic Research, Inc.
    18. Baert, Stijn, 2015. "Field experimental evidence on gender discrimination in hiring: Biased as Heckman and Siegelman predicted?," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 9, pages 1-11.
    19. Philip Oreopoulos, 2011. "Why Do Skilled Immigrants Struggle in the Labor Market? A Field Experiment with Thirteen Thousand Resumes," American Economic Journal: Economic Policy, American Economic Association, vol. 3(4), pages 148-171, November.
    20. Dennis J. Aigner & Glen G. Cain, 1977. "Statistical Theories of Discrimination in Labor Markets," ILR Review, Cornell University, ILR School, vol. 30(2), pages 175-187, January.
    21. David L. Dickinson & Ronald L. Oaxaca, 2009. "Statistical Discrimination in Labor Markets: An Experimental Analysis," Southern Economic Journal, John Wiley & Sons, vol. 76(1), pages 16-31, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Berson, Clémence & Laouénan, Morgane & Valat, Emmanuel, 2020. "Outsourcing recruitment as a solution to prevent discrimination: A correspondence study," Labour Economics, Elsevier, vol. 64(C).
    2. Becker, Sascha O. & Fernandes, Ana & Weichselbaumer, Doris, 2019. "Discrimination in hiring based on potential and realized fertility: Evidence from a large-scale field experiment," Labour Economics, Elsevier, vol. 59(C), pages 139-152.
    3. Marina Mileo Gorzig & Deborah Rho, 2022. "The effect of the 2016 United States presidential election on employment discrimination," Journal of Population Economics, Springer;European Society for Population Economics, vol. 35(1), pages 45-88, January.
    4. Horváth Gergely, 2020. "The Impact of Marital Status on Job Finding: A Field Experiment in the Chinese Labor Market," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 20(4), pages 1-10, October.
    5. Alec Brandon & Justin E. Holz & Andrew Simon & Haruka Uchida, 2023. "Minimum Wages and Racial Discrimination in Hiring: Evidence from a Field Experiment," Upjohn Working Papers 23-389, W.E. Upjohn Institute for Employment Research.
    6. Ian Gregory-Smith & Alex Bryson & Rafael Gomez, 2023. "Discrimination in a Rank Order Contest: Evidence from the NFL Draft," Journal of Economics, Race, and Policy, Springer, vol. 6(3), pages 215-231, September.
    7. Nicolás Abbate & Inés Berniell & Joaquín Coleff & Luis Laguinge & Margarita Machelett & Mariana Marchionni & Julián Pedrazzi & María Florencia Pinto, 2022. "Discrimination Against Gay and Transgender People in Latin America: A Correspondence Study in the Rental Housing Market," CEDLAS, Working Papers 0306, CEDLAS, Universidad Nacional de La Plata.
    8. repec:hal:spmain:info:hdl:2441/26s2fhqla9901btt78qnrel14d is not listed on IDEAS
    9. Acolin, Arthur & Bostic, Raphael & Painter, Gary, 2016. "A field study of rental market discrimination across origins in France," Journal of Urban Economics, Elsevier, vol. 95(C), pages 49-63.
    10. Gaddis, S. Michael, 2018. "An Introduction to Audit Studies in the Social Sciences," SocArXiv e5hfc, Center for Open Science.
    11. Ewens, Michael, 2022. "Race and Gender in Entrepreneurial Finance," SocArXiv djf8z, Center for Open Science.
    12. James D. Paul & Albert A. Cheng & Jay P. Greene & Josh B. McGee, 2023. "The Value of College Athletics in the Labor Market: Results from a Resume Audit Field Experiment," Journal of Sports Economics, , vol. 24(3), pages 329-351, April.
    13. Taryn Eames, 2024. "Taryn versus Taryn (she/her) versus Taryn (they/them): A Field Experiment on Pronoun Disclosure and Hiring Discrimination," Working Papers tecipa-766, University of Toronto, Department of Economics.
    14. Drydakis, Nick & Zimmermann, Klaus F., 2020. "Sexual Orientation, Gender Identity and Labour Market Outcomes: New Patterns and Insights," GLO Discussion Paper Series 627, Global Labor Organization (GLO).
    15. Gouveia, Filipe & Nilsson, Therese & Berggren, Niclas, 2020. "Religiosity and discrimination against same-sex couples: The case of Portugal's rental market," Journal of Housing Economics, Elsevier, vol. 50(C).
    16. Kübler, Dorothea & Schmid, Julia & Stüber, Robert, 2018. "Gender discrimination in hiring across occupations: a nationally-representative vignette study," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 55, pages 215-229.
    17. William A. Darity Jr. & Darrick Hamilton & Samuel L. Myers Jr. & Gregory N. Price & Man Xu, 2022. "Racial Differences in Time at Work Not Working," ILR Review, Cornell University, ILR School, vol. 75(3), pages 552-572, May.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gaddis, S. Michael, 2018. "An Introduction to Audit Studies in the Social Sciences," SocArXiv e5hfc, Center for Open Science.
    2. David Neumark, 2018. "Experimental Research on Labor Market Discrimination," Journal of Economic Literature, American Economic Association, vol. 56(3), pages 799-866, September.
    3. Rich, Judy, 2014. "What Do Field Experiments of Discrimination in Markets Tell Us? A Meta Analysis of Studies Conducted since 2000," IZA Discussion Papers 8584, Institute of Labor Economics (IZA).
    4. Button, Patrick & Walker, Brigham, 2020. "Employment discrimination against Indigenous Peoples in the United States: Evidence from a field experiment," Labour Economics, Elsevier, vol. 65(C).
    5. Baert, Stijn, 2017. "Hiring Discrimination: An Overview of (Almost) All Correspondence Experiments Since 2005," GLO Discussion Paper Series 61, Global Labor Organization (GLO).
    6. Marianne Bertrand & Esther Duflo, 2016. "Field Experiments on Discrimination," NBER Working Papers 22014, National Bureau of Economic Research, Inc.
    7. David Neumark, 2016. "Experimental Research on Labor Market Discrimination," NBER Working Papers 22022, National Bureau of Economic Research, Inc.
    8. Flage, Alexandre, 2018. "Ethnic and gender discrimination in the rental housing market: Evidence from a meta-analysis of correspondence tests, 2006–2017," Journal of Housing Economics, Elsevier, vol. 41(C), pages 251-273.
    9. Luca Fumarco, 2017. "Disability Discrimination in the Italian Rental Housing Market: A Field Experiment with Blind Tenants," Land Economics, University of Wisconsin Press, vol. 93(4), pages 567-584.
    10. Marianne Bertrand & Esther Duflo, 2016. "Field Experiments on Discrimination," NBER Working Papers 22014, National Bureau of Economic Research, Inc.
    11. Alexandre Flage, 2018. "Ethnic and Gender Discrimination in Rental Housing Market, Evidence from Meta-Analysis of Correspondence Tests, 2006-2017," Working Papers 2018-04, CRESE.
    12. Fumarco, Luca, 2015. "Disability Discrimination in the Rental Housing Market – A Field Experiment on Blind Tenants," MPRA Paper 63899, University Library of Munich, Germany.
    13. Auspurg, Katrin & Schneck, Andreas & Thiel, Fabian, 2020. "Different samples, different results? How sampling techniques affect the results of field experiments on ethnic discrimination," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 0.
    14. Morten Størling Hedegaard & Jean-Robert Tyran, 2018. "The Price of Prejudice," American Economic Journal: Applied Economics, American Economic Association, vol. 10(1), pages 40-63, January.
    15. repec:hal:spmain:info:hdl:2441/26s2fhqla9901btt78qnrel14d is not listed on IDEAS
    16. David Neumark & Ian Burn & Patrick Button & Nanneh Chehras, 2016. "Do State Laws Protecting Older Workers from Discrimination Reduce Age Discrimination in Hiring? Experimental (and Nonexperimental) Evidence," Working Papers wp349, University of Michigan, Michigan Retirement Research Center.
    17. Tjaden, Jasper Dag & Schwemmer, Carsten & Khadjavi, Menusch, 2018. "Ride with Me - Ethnic Discrimination, Social Markets and the Sharing Economy," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 34(4), pages 418-432.
    18. Finseraas, Henning & Johnsen, Åshild A. & Kotsadam, Andreas & Torsvik, Gaute, 2016. "Exposure to female colleagues breaks the glass ceiling—Evidence from a combined vignette and field experiment," European Economic Review, Elsevier, vol. 90(C), pages 363-374.
    19. Carlsson, Magnus & Eriksson, Stefan, 2014. "Discrimination in the rental market for apartments," Journal of Housing Economics, Elsevier, vol. 23(C), pages 41-54.
    20. Carlsson, Magnus & Eriksson, Stefan, 2019. "Age discrimination in hiring decisions: Evidence from a field experiment in the labor market," Labour Economics, Elsevier, vol. 59(C), pages 173-183.
    21. Berson, Clémence & Laouénan, Morgane & Valat, Emmanuel, 2020. "Outsourcing recruitment as a solution to prevent discrimination: A correspondence study," Labour Economics, Elsevier, vol. 64(C).

    More about this item

    JEL classification:

    • J71 - Labor and Demographic Economics - - Labor Discrimination - - - Hiring and Firing

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:22278. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.