IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/19508.html
   My bibliography  Save this paper

The Size of the LGBT Population and the Magnitude of Anti-Gay Sentiment are Substantially Underestimated

Author

Listed:
  • Katherine B. Coffman
  • Lucas C. Coffman
  • Keith M. Marzilli Ericson

Abstract

Measuring sexual orientation, behavior, and related opinions is difficult because responses are biased towards socially acceptable answers. We test whether measurements are biased even when responses are private and anonymous and use our results to identify sexuality-related norms and how they vary. We run an experiment on 2,516 U.S. participants. Participants were randomly assigned to either a "best practices method" that was computer-based and provides privacy and anonymity, or to a "veiled elicitation method" that further conceals individual responses. Answers in the veiled method preclude inference about any particular individual, but can be used to accurately estimate statistics about the population. Comparing the two methods shows sexuality-related questions receive biased responses even under current best practices, and, for many questions, the bias is substantial. The veiled method increased self-reports of non-heterosexual identity by 65% (p

Suggested Citation

  • Katherine B. Coffman & Lucas C. Coffman & Keith M. Marzilli Ericson, 2013. "The Size of the LGBT Population and the Magnitude of Anti-Gay Sentiment are Substantially Underestimated," NBER Working Papers 19508, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:19508
    Note: EH LS PE POL
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w19508.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. John Horton & David Rand & Richard Zeckhauser, 2011. "The online laboratory: conducting experiments in a real labor market," Experimental Economics, Springer;Economic Science Association, vol. 14(3), pages 399-425, September.
    2. Oreffice, Sonia, 2011. "Sexual orientation and household decision making.: Same-sex couples' balance of power and labor supply choices," Labour Economics, Elsevier, vol. 18(2), pages 145-158, April.
    3. Jamison, Julian & Karlan, Dean & Raffler, Pia, 2013. "Mixed Method Evaluation of a Passive mHealth Sexual Information Texting Service in Uganda," Working Papers 116, Yale University, Department of Economics.
    4. Gerty Lensvelt-Mulders & Joop Hox & Peter Heijden, 2005. "How to Improve the Efficiency of Randomised Response Designs," Quality & Quantity: International Journal of Methodology, Springer, vol. 39(3), pages 253-265, June.
    5. Elisabeth Coutts & Ben Jann, 2011. "Sensitive Questions in Online Surveys: Experimental Results for the Randomized Response Technique (RRT) and the Unmatched Count Technique (UCT)," Sociological Methods & Research, , vol. 40(1), pages 169-193, February.
    6. Nathan Berg & Donald Lien, 2006. "Same-sex sexual behaviour: US frequency estimates from survey data with simultaneous misreporting and non-response," Applied Economics, Taylor & Francis Journals, vol. 38(7), pages 757-769.
    7. Marianne Bertrand & Dolly Chugh & Sendhil Mullainathan, 2005. "Implicit Discrimination," American Economic Review, American Economic Association, vol. 95(2), pages 94-98, May.
    8. repec:cup:judgdm:v:5:y:2010:i:5:p:411-419 is not listed on IDEAS
    9. Bloom, David E. & Glied, Sherry, 1992. "Projecting the number of new AIDS cases in the United States," International Journal of Forecasting, Elsevier, vol. 8(3), pages 339-365, November.
    10. Shelly Lundberg & Robert A. Pollak, 2007. "The American Family and Family Economics," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 3-26, Spring.
    11. Weichselbaumer, Doris, 2003. "Sexual orientation discrimination in hiring," Labour Economics, Elsevier, vol. 10(6), pages 629-642, December.
    12. Ayres, Ian & Siegelman, Peter, 1995. "Race and Gender Discrimination in Bargaining for a New Car," American Economic Review, American Economic Association, vol. 85(3), pages 304-321, June.
    13. Suzanne Heller Clain & Karen Leppel, 2001. "An investigation into sexual orientation discrimination as an explanation for wage differences," Applied Economics, Taylor & Francis Journals, vol. 33(1), pages 37-47.
    14. Ori Heffetz & Katrina Ligett, 2014. "Privacy and Data-Based Research," Journal of Economic Perspectives, American Economic Association, vol. 28(2), pages 75-98, Spring.
    15. Dan A. Black & Hoda R. Makar & Seth G. Sanders & Lowell J. Taylor, 2003. "The Earnings Effects of Sexual Orientation," ILR Review, Cornell University, ILR School, vol. 56(3), pages 449-469, April.
    16. Feng Li & Venky Nagar, 2013. "Diversity and Performance," Management Science, INFORMS, vol. 59(3), pages 529-544, September.
    17. Lisa Jepsen & Christopher Jepsen, 2002. "An empirical analysis of the matching patterns of same-sex and opposite-sex couples," Demography, Springer;Population Association of America (PAA), vol. 39(3), pages 435-453, August.
    18. Blair, Graeme & Imai, Kosuke, 2012. "Statistical Analysis of List Experiments," Political Analysis, Cambridge University Press, vol. 20(1), pages 47-77, January.
    19. Dan Black & Gary Gates & Seth Sanders & Lowell Taylor, 2000. "Demographics of the gay and lesbian population in the United States: Evidence from available systematic data sources," Demography, Springer;Population Association of America (PAA), vol. 37(2), pages 139-154, May.
    20. Wasserman, Larry & Zhou, Shuheng, 2010. "A Statistical Framework for Differential Privacy," Journal of the American Statistical Association, American Statistical Association, vol. 105(489), pages 375-389.
    21. Chaim Fershtman & Uri Gneezy, 2001. "Discrimination in a Segmented Society: An Experimental Approach," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(1), pages 351-377.
    22. George A. Akerlof & Rachel E. Kranton, 2000. "Economics and Identity," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 115(3), pages 715-753.
    23. Fisher, Robert J, 1993. "Social Desirability Bias and the Validity of Indirect Questioning," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 20(2), pages 303-315, September.
    24. Black, Dan & Gates, Gary & Sanders, Seth & Taylor, Lowell, 2002. "Why Do Gay Men Live in San Francisco?," Journal of Urban Economics, Elsevier, vol. 51(1), pages 54-76, January.
    25. Eric Luis Uhlmann & Anthony Greenwald & Andrew Poehlmann & Mahzarin Banaji, 2009. "Understanding and Using the Implicit Association Test: III. Meta-Analysis of Predictive Validity," Post-Print hal-00516146, HAL.
    26. Dan A. Black & Seth G. Sanders & Lowell J. Taylor, 2007. "The Economics of Lesbian and Gay Families," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 53-70, Spring.
    27. Badgett, M.V. Lee, 2001. "Money, Myths, and Change," University of Chicago Press Economics Books, University of Chicago Press, edition 1, number 9780226034003, September.
    28. Graeme Blair & Kosuke Imai & Jason Lyall, 2014. "Comparing and Combining List and Endorsement Experiments: Evidence from Afghanistan," American Journal of Political Science, John Wiley & Sons, vol. 58(4), pages 1043-1063, October.
    29. Ali Ahmed & Mats Hammarstedt, 2010. "Sexual orientation and earnings: a register data-based approach to identify homosexuals," Journal of Population Economics, Springer;European Society for Population Economics, vol. 23(3), pages 835-849, June.
    30. David E. Bloom & Sherry Glied, 1992. "Projecting the Number of New AIDS Cases in the U.S," NBER Working Papers 4180, National Bureau of Economic Research, Inc.
    31. Carpenter, Christopher S., 2009. "Sexual orientation and outcomes in college," Economics of Education Review, Elsevier, vol. 28(6), pages 693-703, December.
    32. Marieka M. Klawitter & Victor Flatt, 1998. "The effects of state and local antidiscrimination policies on earnings for gays and lesbians," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 17(4), pages 658-686.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Maryam Dilmaghani, 2018. "Sexual Orientation, Labour Earnings, and Household Income in Canada," Journal of Labor Research, Springer, vol. 39(1), pages 41-55, March.
    2. Ali M. Ahmed & Lina Andersson & Mats Hammarstedt, 2013. "Are Gay Men and Lesbians Discriminated against in the Hiring Process?," Southern Economic Journal, John Wiley & Sons, vol. 79(3), pages 565-585, January.
    3. Stephan Humpert, 2012. "Somewhere over the Rainbow: Sexual Orientation Discrimination in Germany," Working Paper Series in Economics 245, University of Lüneburg, Institute of Economics.
    4. Jepsen, Christopher & Jepsen, Lisa K., 2009. "Does home ownership vary by sexual orientation?," Regional Science and Urban Economics, Elsevier, vol. 39(3), pages 307-315, May.
    5. Josef Montag, 2015. "What Drives the Gender Gap? An Analysis Using Sexual Orientation," Kyklos, Wiley Blackwell, vol. 68(4), pages 577-608, November.
    6. Doris Weichselbaumer, 2013. "Discrimination in gay and lesbian lives," Chapters, in: Deborah M. Figart & Tonia L. Warnecke (ed.), Handbook of Research on Gender and Economic Life, chapter 15, pages 236-254, Edward Elgar Publishing.
    7. Ali Ahmed & Lina Andersson & Mats Hammarstedt, 2013. "Sexual orientation and full-time monthly earnings, by public and private sector: evidence from Swedish register data," Review of Economics of the Household, Springer, vol. 11(1), pages 83-108, March.
    8. Mary Eschelbach Hansen & Michael E. Martell, 2014. "Self-Identified Sexual Orientation and the Lesbian Earnings Differential," Working Papers 2014-13, American University, Department of Economics.
    9. Thierry Laurent & Ferhat Mihoubi, 2012. "Sexual Orientation and Wage Discrimination in France: The Hidden Side of the Rainbow," Journal of Labor Research, Springer, vol. 33(4), pages 487-527, December.
    10. Doris Weichselbaumer, 2015. "Testing for Discrimination against Lesbians of Different Marital Status: A Field Experiment," Industrial Relations: A Journal of Economy and Society, Wiley Blackwell, vol. 54(1), pages 131-161, January.
    11. Christafore, David & Leguizamon, Sebastian, 2012. "Earnings differences between homosexuals and heterosexuals and the effects of anti-discriminatory laws: equal but still unmarried," MPRA Paper 45267, University Library of Munich, Germany.
    12. Erik Plug & Dinand Webbink & Nick Martin, 2014. "Sexual Orientation, Prejudice, and Segregation," Journal of Labor Economics, University of Chicago Press, vol. 32(1), pages 123-159.
    13. Sanghoon Lee, 2021. "Social Tolerance and Economic Development," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 158(3), pages 1087-1103, December.
    14. Christopher S. Carpenter, 2008. "Sexual orientation, work, and income in Canada," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 41(4), pages 1239-1261, November.
    15. Christopher Jepsen & Lisa K. Jepsen, 2017. "Self-employment, earnings, and sexual orientation," Review of Economics of the Household, Springer, vol. 15(1), pages 287-305, March.
    16. Michael E. Martell, 2014. "HOW ENDAs EXTEND THE WORKWEEK: LEGAL PROTECTION AND THE LABOR SUPPLY OF BEHAVIORALLY GAY MEN," Contemporary Economic Policy, Western Economic Association International, vol. 32(3), pages 560-577, July.
    17. Chen, Shuai, 2019. "Marriage, minorities, and mass movements," Other publications TiSEM 9cb1b11d-12e6-46a8-adca-4, Tilburg University, School of Economics and Management.
    18. Michael E. Martell & Peyton Nash, 2020. "For Love and Money? Earnings and Marriage Among Same-Sex Couples," Journal of Labor Research, Springer, vol. 41(3), pages 260-294, September.
    19. Edoardo Ciscato & Alfred Galichon & Marion Goussé, 2020. "Like Attract Like? A Structural Comparison of Homogamy across Same-Sex and Different-Sex Households," Journal of Political Economy, University of Chicago Press, vol. 128(2), pages 740-781.
    20. Sansone, Dario, 2019. "Pink work: Same-sex marriage, employment and discrimination," Journal of Public Economics, Elsevier, vol. 180(C).

    More about this item

    JEL classification:

    • C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General
    • D10 - Microeconomics - - Household Behavior - - - General
    • J10 - Labor and Demographic Economics - - Demographic Economics - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:19508. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.