IDEAS home Printed from https://ideas.repec.org/p/ajk/ajkdps/365.html
   My bibliography  Save this paper

The Social Desirability Atlas

Author

Listed:
  • Leonardo Bursztyn

    (University of Chicago & NBER)

  • Ingar Haaland

    (NHH Norwegian School of Economics, FAIR, & CEPR)

  • Nicolas Röver

    (University of Cologne)

  • Christopher Roth

    (University of Cologne, NHH Norwegian School of Economics, Max Planck Institute for Research on Collective Goods, & CEPR)

Abstract

Social desirability bias (SDB) is a pervasive threat to the validity of survey and experimental data. Respondents might often misreport sensitive attitudes and behaviors to appear more socially acceptable. We begin by synthesizing empirical evidence on the prevalence and magnitude of SDB across various domains, focusing on studies with individual-level benchmarks. We then critically assess commonly used strategies to mitigate SDB, highlighting how they can sometimes fail by creating confusion or inadvertently increasing perceived sensitivity. To help researchers navigate these challenges, we offer practical guidance on selecting the most suitable tools for different research contexts. Finally, we examine how SDB can distort treatment effects in experiments and discuss mitigation strategies.

Suggested Citation

  • Leonardo Bursztyn & Ingar Haaland & Nicolas Röver & Christopher Roth, 2025. "The Social Desirability Atlas," ECONtribute Discussion Papers Series 365, University of Bonn and University of Cologne, Germany.
  • Handle: RePEc:ajk:ajkdps:365
    as

    Download full text from publisher

    File URL: https://www.econtribute.de/RePEc/ajk/ajkdps/ECONtribute_365_2025.pdf
    File Function: First version, 2025
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jonathan de Quidt & Johannes Haushofer & Christopher Roth, 2018. "Measuring and Bounding Experimenter Demand," American Economic Review, American Economic Association, vol. 108(11), pages 3266-3302, November.
    2. Kuhn, Patrick M. & Vivyan, Nick, 2022. "The Misreporting Trade-Off Between List Experiments and Direct Questions in Practice: Partition Validation Evidence from Two Countries," Political Analysis, Cambridge University Press, vol. 30(3), pages 381-402, July.
    3. Marc Höglinger & Ben Jann, 2018. "More is not always better: An experimental individual-level validation of the randomized response technique and the crosswise model," PLOS ONE, Public Library of Science, vol. 13(8), pages 1-22, August.
    4. Katherine B. Coffman & Lucas C. Coffman & Keith M. Marzilli Ericson, 2017. "The Size of the LGBT Population and the Magnitude of Antigay Sentiment Are Substantially Underestimated," Management Science, INFORMS, vol. 63(10), pages 3168-3186, October.
    5. Hunt Allcott & Dmitry Taubinsky, 2015. "Evaluating Behaviorally Motivated Policy: Experimental Evidence from the Lightbulb Market," American Economic Review, American Economic Association, vol. 105(8), pages 2501-2538, August.
    6. Haaland, Ingar & Roth, Christopher, 2020. "Labor market concerns and support for immigration," Journal of Public Economics, Elsevier, vol. 191(C).
    7. Stefanie Stantcheva, 2023. "How to Run Surveys: A Guide to Creating Your Own Identifying Variation and Revealing the Invisible," Annual Review of Economics, Annual Reviews, vol. 15(1), pages 205-234, September.
    8. Chuang, Erica & Dupas, Pascaline & Huillery, Elise & Seban, Juliette, 2021. "Sex, lies, and measurement: Consistency tests for indirect response survey methods," Journal of Development Economics, Elsevier, vol. 148(C).
    9. repec:cup:apsrev:v:98:y:2004:i:01:p:191-207_00 is not listed on IDEAS
    10. Chuang, Erica & Dupas, Pascaline & Huillery, Elise & Seban, Juliette, 2021. "Sex, lies, and measurement: Consistency tests for indirect response survey methods," Journal of Development Economics, Elsevier, vol. 148(C).
    11. Loewenstein, George, 1999. "Experimental Economics from the Vantage-Point of Behavioural Economics," Economic Journal, Royal Economic Society, vol. 109(453), pages 23-34, February.
    12. Jun-Wu Yu & Guo-Liang Tian & Man-Lai Tang, 2008. "Two new models for survey sampling with sensitive characteristic: design and analysis," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 67(3), pages 251-263, April.
    13. Alexis Grigorieff & Christopher Roth & Diego Ubfal, 2020. "Does Information Change Attitudes Toward Immigrants?," Demography, Springer;Population Association of America (PAA), vol. 57(3), pages 1117-1143, June.
    14. Felix Chopra & Ingar Haaland, 2023. "Conducting qualitative interviews with AI," CEBI working paper series 23-06, University of Copenhagen. Department of Economics. The Center for Economic Behavior and Inequality (CEBI).
    15. Alem, Yonas & Eggert, Håkan & Kocher, Martin G. & Ruhinduka, Remidius D., 2018. "Why (field) experiments on unethical behavior are important: Comparing stated and revealed behavior," Journal of Economic Behavior & Organization, Elsevier, vol. 156(C), pages 71-85.
    16. Harrison, Glenn W. & Martínez-Correa, Jimmy & Swarthout, J. Todd & Ulm, Eric R., 2017. "Scoring rules for subjective probability distributions," Journal of Economic Behavior & Organization, Elsevier, vol. 134(C), pages 430-448.
    17. Sendhil Mullainathan & Marianne Bertrand, 2001. "Do People Mean What They Say? Implications for Subjective Survey Data," American Economic Review, American Economic Association, vol. 91(2), pages 67-72, May.
    18. Anatol-Fiete Näher & Ivar Krumpal, 2012. "Asking sensitive questions: the impact of forgiving wording and question context on social desirability bias," Quality & Quantity: International Journal of Methodology, Springer, vol. 46(5), pages 1601-1616, August.
    19. Ingar Haaland & Christopher Roth & Stefanie Stantcheva & Johannes Wohlfart, 2025. "Understanding Economic Behavior Using Open-Ended Survey Data," ECONtribute Discussion Papers Series 362, University of Bonn and University of Cologne, Germany.
    20. Fisher, Robert J, 1993. "Social Desirability Bias and the Validity of Indirect Questioning," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 20(2), pages 303-315, September.
    21. Steven D. Levitt & John A. List, 2007. "What Do Laboratory Experiments Measuring Social Preferences Reveal About the Real World?," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 153-174, Spring.
    22. Reisinger, James, 2022. "Subjective well-being and social desirability," Journal of Public Economics, Elsevier, vol. 214(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Leonardo Bursztyn & Ingar Haaland & Nicolas Röver & Christopher Roth & Ingar K. Haaland, 2025. "The Social Desirability Atlas," CESifo Working Paper Series 11911, CESifo.
    2. Lergetporer, Philipp & Piopiunik, Marc & Simon, Lisa, 2021. "Does the education level of refugees affect natives’ attitudes?," European Economic Review, Elsevier, vol. 134(C).
    3. Lergetporer, Philipp & Werner, Katharina & Woessmann, Ludger, 2020. "Educational inequality and public policy preferences: Evidence from representative survey experiments," Journal of Public Economics, Elsevier, vol. 188(C).
    4. Lasse J. Jessen & Sebastian Koehne & Patrick Nüß & Jens Ruhose, 2024. "Socioeconomic Inequality in Life Expectancy: Perception and Policy Demand," CESifo Working Paper Series 10940, CESifo.
    5. Aycinena, Diego & Bogliacino, Francesco & Kimbrough, Erik O., 2024. "Measuring norms: Assessing the threat of social desirability bias to the Bicchieri and Xiao elicitation method," Journal of Economic Behavior & Organization, Elsevier, vol. 222(C), pages 225-239.
    6. Cattaneo, Maria & Lergetporer, Philipp & Schwerdt, Guido & Werner, Katharina & Woessmann, Ludger & Wolter, Stefan C., 2020. "Information provision and preferences for education spending: Evidence from representative survey experiments in three countries," European Journal of Political Economy, Elsevier, vol. 63(C).
    7. Cattaneo, Cristina & Grieco, Daniela, 2021. "Turning opposition into support to immigration: The role of narratives," Journal of Economic Behavior & Organization, Elsevier, vol. 190(C), pages 785-801.
    8. Chopra, Felix & Haaland, Ingar & Roth, Christopher, 2021. "The Demand for Fact-Checking," The Warwick Economics Research Paper Series (TWERPS) 1357, University of Warwick, Department of Economics.
    9. Burgstaller, Lilith & Feld, Lars P. & Pfeil, Katharina, 2022. "Working in the shadow: Survey techniques for measuring and explaining undeclared work," Journal of Economic Behavior & Organization, Elsevier, vol. 200(C), pages 661-671.
    10. Manzoni, Elena & Murard, Elie & Quercia, Simone & Tonini, Sara, 2024. "News, Emotions, and Policy Views on Immigration," IZA Discussion Papers 17017, Institute of Labor Economics (IZA).
    11. Leonardo Bursztyn & Ingar K. Haaland & Aakaash Rao & Christopher P. Roth, 2020. "Disguising Prejudice: Popular Rationales as Excuses for Intolerant Expression," NBER Working Papers 27288, National Bureau of Economic Research, Inc.
    12. Chopra, Felix & Haaland, Ingar & Roth, Christopher, 2022. "Do people demand fact-checked news? Evidence from U.S. Democrats," Journal of Public Economics, Elsevier, vol. 205(C).
    13. Lergetporer, Philipp & Woessmann, Ludger, 2023. "Earnings information and public preferences for university tuition: Evidence from representative experiments," Journal of Public Economics, Elsevier, vol. 226(C).
    14. Eszter Czibor & David Jimenez‐Gomez & John A. List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 371-432, October.
    15. Lergetporer, Philipp & Woessmann, Ludger, 2019. "The Political Economy of Higher Education Finance: How Information and Design Affect Public Preferences for Tuition," Rationality and Competition Discussion Paper Series 145, CRC TRR 190 Rationality and Competition.
    16. Carlos Alos Ferrer & Michele Garagnani, 2025. "Who Likes It More?," Working Papers 424225030, Lancaster University Management School, Economics Department.
    17. Roth, Christopher & Schwardmann, Peter & Tripodi, Egon, 2024. "Depression Stigma," CEPR Discussion Papers 18919, C.E.P.R. Discussion Papers.
    18. David Sungho Park & Shilpa Aggarwal & Dahyeon Jeong & Naresh Kumar & Jonathan Robinson & Alan Spearot, 2021. "Private but Misunderstood? Evidence on Measuring Intimate Partner Violence via Self-Interviewing in Rural Liberia and Malawi," NBER Working Papers 29584, National Bureau of Economic Research, Inc.
    19. Eugen Dimant & Tobias Gesche, 2021. "Nudging Enforcers: How Norm Perceptions and Motives for Lying Shape Sanctions," CESifo Working Paper Series 9385, CESifo.
    20. Ham, Andrés & Guarín, Ángela & Ruiz, Juanita, 2024. "How accurately are household surveys measuring the LGBT population in Colombia? Evidence from a list experiment," Labour Economics, Elsevier, vol. 87(C).

    More about this item

    Keywords

    Social Desirability; Surveys; Experiments; Mitigation Strategies;
    All these keywords.

    JEL classification:

    • B41 - Schools of Economic Thought and Methodology - - Economic Methodology - - - Economic Methodology
    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ajk:ajkdps:365. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ECONtribute Office (email available below). General contact details of provider: https://www.econtribute.de .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.