IDEAS home Printed from https://ideas.repec.org/a/zbw/espost/213856.html
   My bibliography  Save this article

Different samples, different results? How sampling techniques affect the results of field experiments on ethnic discrimination

Author

Listed:
  • Auspurg, Katrin
  • Schneck, Andreas
  • Thiel, Fabian

Abstract

This paper explores a possible sampling bias in field experiments through a unique combination of a large-scale field experiment on ethnic discrimination in the German rental housing market (N = 2,992 tested apartments) and data on the internet housing market where the apartments were sampled from (observation of the whole platform for about one year). Up to now, most field experiments sampled on the level of suppliers (not apartments) and selected the tested suppliers within a short field period (point sampling). This probably led to an over-representation of small suppliers and apartments that had already been advertised for a long time, resulting in an under-representation of large suppliers and new vacancies. We analyze how both issues affect the measurement of ethnic discrimination and its underlying mechanisms. With our case study on the German housing market, we first observed the expected sampling bias: There was a strong over-sampling of small suppliers and apartments already offered for a long time. Second, this bias was found to have only little impact on the descriptive result of substantial discrimination against Turkish applicants. There was only a slight tendency that discrimination was higher for small suppliers and offers advertised for a relatively short time (i.e. new vacancies). Overall, we conclude that evidence on ethnic discrimination and its underlying risk factors is remarkably robust to the used sampling technique. Although there were no indications of a severe bias, our market data illustrate opportunities to test the effects of market conditions that often remained unnoticed.

Suggested Citation

  • Auspurg, Katrin & Schneck, Andreas & Thiel, Fabian, 2020. "Different samples, different results? How sampling techniques affect the results of field experiments on ethnic discrimination," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 0.
  • Handle: RePEc:zbw:espost:213856
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/213856/1/Auspurg_Schneck_Thiel2020_AAM.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ali M. Ahmed & Lina Andersson & Mats Hammarstedt, 2010. "Can Discrimination in the Housing Market Be Reduced by Increasing the Information about the Applicants?," Land Economics, University of Wisconsin Press, vol. 86(1), pages 79-90.
    2. Mariano Bosch & M. Carnero & Lídia Farré, 2015. "Rental housing discrimination and the persistence of ethnic enclaves," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 6(2), pages 129-152, June.
    3. Carlsson, Magnus & Eriksson, Stefan, 2014. "Discrimination in the rental market for apartments," Journal of Housing Economics, Elsevier, vol. 23(C), pages 41-54.
    4. Anita I. Drever & William A. V. Clark, 2002. "Gaining Access to Housing in Germany: The Foreign Minority Experience," Discussion Papers of DIW Berlin 283, DIW Berlin, German Institute for Economic Research.
    5. Ben Jann, 2014. "A new command for plotting regression coefficients and other estimates," German Stata Users' Group Meetings 2014 09, Stata Users Group.
    6. Charness, Gary & Gneezy, Uri & Kuhn, Michael A., 2012. "Experimental methods: Between-subject and within-subject design," Journal of Economic Behavior & Organization, Elsevier, vol. 81(1), pages 1-8.
    7. Mathieu Bunel & Samuel Gorohouna & Yannick L’Horty & Pascale Petit & Catherine Ris, 2019. "Ethnic Discrimination in the Rental Housing Market: An Experiment in New Caledonia," International Regional Science Review, , vol. 42(1), pages 65-97, January.
    8. Edward C. Norton & Hua Wang & Chunrong Ai, 2004. "Computing interaction effects and standard errors in logit and probit models," Stata Journal, StataCorp LP, vol. 4(2), pages 154-167, June.
    9. Jeff Biddle & Daniel Hamermesh, 2013. "Wage discrimination over the business cycle," IZA Journal of Labor Policy, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 2(1), pages 1-19, December.
    10. Marianne Bertrand & Dolly Chugh & Sendhil Mullainathan, 2005. "Implicit Discrimination," American Economic Review, American Economic Association, vol. 95(2), pages 94-98, May.
    11. Michael Ewens & Bryan Tomlin & Liang Choon Wang, 2014. "Statistical Discrimination or Prejudice? A Large Sample Field Experiment," The Review of Economics and Statistics, MIT Press, vol. 96(1), pages 119-134, March.
    12. Acolin, Arthur & Bostic, Raphael & Painter, Gary, 2016. "A field study of rental market discrimination across origins in France," Journal of Urban Economics, Elsevier, vol. 95(C), pages 49-63.
    13. Hanson, Andrew & Hawley, Zackary & Taylor, Aryn, 2011. "Subtle discrimination in the rental housing market: Evidence from e-mail correspondence with landlords," Journal of Housing Economics, Elsevier, vol. 20(4), pages 276-284.
    14. Peter A. Riach & Judith Rich, 2004. "Deceptive Field Experiments of Discrimination: Are they Ethical?," Kyklos, Wiley Blackwell, vol. 57(3), pages 457-470, August.
    15. James J. Heckman, 1998. "Detecting Discrimination," Journal of Economic Perspectives, American Economic Association, vol. 12(2), pages 101-116, Spring.
    16. David Neumark, 2012. "Detecting Discrimination in Audit and Correspondence Studies," Journal of Human Resources, University of Wisconsin Press, vol. 47(4), pages 1128-1157.
    17. Kristof Heylen & Katleen Van den Broeck, 2016. "Discrimination and selection in the Belgian private rental market," Housing Studies, Taylor & Francis Journals, vol. 31(2), pages 223-236, March.
    18. Kenneth J. Arrow, 1998. "What Has Economics to Say about Racial Discrimination?," Journal of Economic Perspectives, American Economic Association, vol. 12(2), pages 91-100, Spring.
    19. Yinger, John, 1986. "Measuring Racial Discrimination with Fair Housing Audits: Caught in the Act," American Economic Review, American Economic Association, vol. 76(5), pages 881-893, December.
    20. Bosch, Mariano & Carnero, M. Angeles & Farré, Lídia, 2010. "Information and discrimination in the rental housing market: Evidence from a field experiment," Regional Science and Urban Economics, Elsevier, vol. 40(1), pages 11-19, January.
    21. Stijn Baert & Bart Cockx & Niels Gheyle & Cora Vandamme, 2013. "Do Employers Discriminate Less if Vacancies are Difficult to Fill? Evidence from a Field Experiment," CESifo Working Paper Series 4093, CESifo.
    22. Flage, Alexandre, 2018. "Ethnic and gender discrimination in the rental housing market: Evidence from a meta-analysis of correspondence tests, 2006–2017," Journal of Housing Economics, Elsevier, vol. 41(C), pages 251-273.
    23. Orley Ashenfelter & Timothy Hannan, 1986. "Sex Discrimination and Product Market Competition: The Case of the Banking Industry," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 101(1), pages 149-173.
    24. Judith K. Hellerstein & David Neumark & Kenneth R. Troske, 2002. "Market Forces and Sex Discrimination," Journal of Human Resources, University of Wisconsin Press, vol. 37(2), pages 353-380.
    25. Margery A. Turner & Stephen Ross & George C. Galster & John Yinger, 2002. "Discrimination in Metropolitan Housing Markets: National Results from Phase 1 of the Housing Discrimination Study (HDS)," Working papers 2002-16, University of Connecticut, Department of Economics.
    26. Auspurg, Katrin & Hinz, Thomas & Schmid, Laura, 2017. "Contexts and conditions of ethnic discrimination: Evidence from a field experiment in a German housing market," Journal of Housing Economics, Elsevier, vol. 35(C), pages 26-36.
    27. Davíð Freyr Björnsson & Fredrik Kopsch & Gylfi Zoega, 2018. "Discrimination in the Housing Market as an Impediment to European Labour Force Integration: the Case of Iceland," Journal of International Migration and Integration, Springer, vol. 19(3), pages 829-847, August.
    28. Ragnar Bengtsson & Ellis Iverman & Björn Tyrefors Hinnerich, 2012. "Gender and ethnic discrimination in the rental housing market," Applied Economics Letters, Taylor & Francis Journals, vol. 19(1), pages 1-5, January.
    29. Ben Jann, 2014. "Plotting regression coefficients and other estimates," Stata Journal, StataCorp LP, vol. 14(4), pages 708-737, December.
    30. Baldini, Massimo & Federici, Marta, 2011. "Ethnic discrimination in the Italian rental housing market," Journal of Housing Economics, Elsevier, vol. 20(1), pages 1-14, March.
    31. Alexandre Flage, 2018. "Ethnic and Gender Discrimination in Rental Housing Market, Evidence from Meta-Analysis of Correspondence Tests, 2006-2017," Working Papers 2018-04, CRESE.
    32. Gabriel Metcalf, 2018. "Sand Castles before the Tide? Affordable Housing in Expensive Cities," Journal of Economic Perspectives, American Economic Association, vol. 32(1), pages 59-80, Winter.
    33. Lisa Andersson & Niklas Jakobsson & Andreas Kotsadam, 2012. "A Field Experiment of Discrimination in the Norwegian Housing Market: Gender, Class, and Ethnicity," Land Economics, University of Wisconsin Press, vol. 88(2), pages 233-240.
    34. Phelps, Edmund S, 1972. "The Statistical Theory of Racism and Sexism," American Economic Review, American Economic Association, vol. 62(4), pages 659-661, September.
    35. repec:wly:soecon:v:81:1:y:2014:p:135-167 is not listed on IDEAS
    36. Carlsson, Magnus & Fumarco, Luca & Rooth, Dan-Olof, 2018. "Does Labor Market Tightness Affect Ethnic Discrimination in Hiring?," IZA Discussion Papers 11285, Institute of Labor Economics (IZA).
    37. Murchie, Judson & Pang, Jindong, 2018. "Rental housing discrimination across protected classes: Evidence from a randomized experiment," Regional Science and Urban Economics, Elsevier, vol. 73(C), pages 170-179.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ghekiere, Abel & Verhaeghe, Pieter-Paul, 2022. "How does ethnic discrimination on the housing market differ across neighborhoods and real estate agencies?," Journal of Housing Economics, Elsevier, vol. 55(C).
    2. Hellyer, Joshua, 2021. "Homophobia and the home search: Rental market discrimination against same-sex couples in rural and urban housing markets," Journal of Housing Economics, Elsevier, vol. 51(C).
    3. Gaddis, S. Michael & DiRago, Nicholas V., 2021. "Audit Studies of Housing in the United States: Established, Emerging, and Future Research," SocArXiv fn4ta, Center for Open Science.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Flage, Alexandre, 2018. "Ethnic and gender discrimination in the rental housing market: Evidence from a meta-analysis of correspondence tests, 2006–2017," Journal of Housing Economics, Elsevier, vol. 41(C), pages 251-273.
    2. Alexandre Flage, 2018. "Ethnic and Gender Discrimination in Rental Housing Market, Evidence from Meta-Analysis of Correspondence Tests, 2006-2017," Working Papers 2018-04, CRESE.
    3. Gaddis, S. Michael, 2018. "An Introduction to Audit Studies in the Social Sciences," SocArXiv e5hfc, Center for Open Science.
    4. Ghekiere, Abel & Verhaeghe, Pieter-Paul, 2022. "How does ethnic discrimination on the housing market differ across neighborhoods and real estate agencies?," Journal of Housing Economics, Elsevier, vol. 55(C).
    5. Auspurg, Katrin & Hinz, Thomas & Schmid, Laura, 2017. "Contexts and conditions of ethnic discrimination: Evidence from a field experiment in a German housing market," Journal of Housing Economics, Elsevier, vol. 35(C), pages 26-36.
    6. Rich, Judy, 2014. "What Do Field Experiments of Discrimination in Markets Tell Us? A Meta Analysis of Studies Conducted since 2000," IZA Discussion Papers 8584, Institute of Labor Economics (IZA).
    7. Moritz, Raphael & Manger, Christian, 2022. "Somebody that I want to know: The non-monotonic effect of personality information on ethnic and gender discrimination in the market for shared housing," Journal of Housing Economics, Elsevier, vol. 57(C).
    8. Souleymane Mbaye, 2019. "Trois évaluations d’actions de lutte contre les discriminations," Erudite Ph.D Dissertations, Erudite, number ph19-01 edited by Pascale Petit, September.
    9. Mathieu Bunel & Samuel Gorohouna & Yannick L’Horty & Pascale Petit & Catherine Ris, 2019. "Ethnic Discrimination in the Rental Housing Market: An Experiment in New Caledonia," International Regional Science Review, , vol. 42(1), pages 65-97, January.
    10. Carlsson, Magnus & Fumarco, Luca & Rooth, Dan-Olof, 2013. "Artifactual Evidence of Discrimination in Correspondence Studies? A Replication of the Neumark Method," IZA Discussion Papers 7619, Institute of Labor Economics (IZA).
    11. Mourelatos, Evangelos & Oikarinen, Elias, 2023. "Ethnic discrimination during wartime: Evidence from a field experiment in the Finnish housing market," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 107(C).
    12. Acolin, Arthur & Bostic, Raphael & Painter, Gary, 2016. "A field study of rental market discrimination across origins in France," Journal of Urban Economics, Elsevier, vol. 95(C), pages 49-63.
    13. Sylvain Chareyron & Samuel Gorohouna & Yannick L'Horty & Pascale Petit & Catherine Ris, 2019. "Seeking for tipping point in the housing market : evidence from a field experiment," Working Papers hal-02334132, HAL.
    14. Marianne Bertrand & Esther Duflo, 2016. "Field Experiments on Discrimination," NBER Working Papers 22014, National Bureau of Economic Research, Inc.
    15. Mathieu Bunel & Yannick L'Horty & Loïc du Parquet & Pascale Petit, 2017. "Identifying preference-based discrimination in rental market: A field experiment in Paris," TEPP Working Paper 2017-06, TEPP.
    16. Carlsson, Magnus & Eriksson, Stefan, 2014. "Discrimination in the rental market for apartments," Journal of Housing Economics, Elsevier, vol. 23(C), pages 41-54.
    17. Sylvain Chareyron & Yannick L'Horty & Pascale Petit & Souleymane Mbaye, 2019. "Mesurer l’impact d’un courrier d’alerte sur les discriminations liées à l’origine," Working Papers hal-02333840, HAL.
    18. Marianne Bertrand & Esther Duflo, 2016. "Field Experiments on Discrimination," NBER Working Papers 22014, National Bureau of Economic Research, Inc.
    19. Cochard, François & Flage, Alexandre & Peterle, Emmanuel, 2019. "Intermediation and discrimination in an investment game: An experimental study," Journal of Economic Behavior & Organization, Elsevier, vol. 168(C), pages 196-208.
    20. Murchie, Judson & Pang, Jindong, 2018. "Rental housing discrimination across protected classes: Evidence from a randomized experiment," Regional Science and Urban Economics, Elsevier, vol. 73(C), pages 170-179.

    More about this item

    Keywords

    Field experiment; Ethnic discrimination; Housing market; External validity; Sampling bias; Length bias; Market conditions;
    All these keywords.

    JEL classification:

    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods
    • J15 - Labor and Demographic Economics - - Demographic Economics - - - Economics of Minorities, Races, Indigenous Peoples, and Immigrants; Non-labor Discrimination
    • R39 - Urban, Rural, Regional, Real Estate, and Transportation Economics - - Real Estate Markets, Spatial Production Analysis, and Firm Location - - - Other

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:espost:213856. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/zbwkide.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.