IDEAS home Printed from https://ideas.repec.org/a/eee/pubeco/v214y2022ics0047272722001475.html

Subjective well-being and social desirability

Author

Listed:
  • Reisinger, James

Abstract

Survey measures of depression are increasingly used by economics researchers to provide a nuanced account of well-being. I show that levels of depression reported using such measures are significantly understated and levels of happiness significantly overstated in survey interviews conducted using a response mode that does not allow for anonymous reporting compared to a mode that does in three longitudinal surveys widely used in economics research. I exploit randomized assignment to survey mode, as well as panel methods, to show that this reflects the causal effect of survey mode, not selection. The difference in reported depression and happiness between modes is comparable to the difference between individuals in the 25th and 75th income percentiles. This finding suggests perceptions of social desirability may substantially bias measures of subjective well-being.

Suggested Citation

  • Reisinger, James, 2022. "Subjective well-being and social desirability," Journal of Public Economics, Elsevier, vol. 214(C).
  • Handle: RePEc:eee:pubeco:v:214:y:2022:i:c:s0047272722001475
    DOI: 10.1016/j.jpubeco.2022.104745
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047272722001475
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jpubeco.2022.104745?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Ori Heffetz & Matthew Rabin, 2013. "Conclusions Regarding Cross-Group Differences in Happiness Depend on Difficulty of Reaching Respondents," American Economic Review, American Economic Association, vol. 103(7), pages 3001-3021, December.
    2. Crossley, Thomas F. & Kennedy, Steven, 2002. "The reliability of self-assessed health status," Journal of Health Economics, Elsevier, vol. 21(4), pages 643-658, July.
    3. Gabriella Conti & Stephen Pudney, 2011. "Survey Design and the Analysis of Satisfaction," The Review of Economics and Statistics, MIT Press, vol. 93(3), pages 1087-1093, August.
    4. Ivar Krumpal, 2013. "Determinants of social desirability bias in sensitive surveys: a literature review," Quality & Quantity: International Journal of Methodology, Springer, vol. 47(4), pages 2025-2047, June.
    5. Daniel Kahneman & Alan B. Krueger, 2006. "Developments in the Measurement of Subjective Well-Being," Journal of Economic Perspectives, American Economic Association, vol. 20(1), pages 3-24, Winter.
    6. Chaoyang Li & Earl Ford & Guixiang Zhao & James Tsai & Lina Balluz, 2012. "A comparison of depression prevalence estimates measured by the Patient Health Questionnaire with two administration modes: computer-assisted telephone interviewing versus computer-assisted personal interviewing," International Journal of Public Health, Springer;Swiss School of Public Health (SSPH+), vol. 57(1), pages 225-233, February.
    7. Anne Case & Angus Deaton, 2017. "Mortality and Morbidity in the 21st Century," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 48(1 (Spring), pages 397-476.
    8. Dolan, Paul & Kavetsos, Georgios, 2012. "Happy talk: mode of administration effects on subjective well-being," LSE Research Online Documents on Economics 45273, London School of Economics and Political Science, LSE Library.
    9. Philip M. Clarke & Chris Ryan, 2006. "Self‐reported health: reliability and consequences for health inequality measurement," Health Economics, John Wiley & Sons, Ltd., vol. 15(6), pages 645-652, June.
    10. John A. List & Robert P. Berrens & Alok K. Bohara & Joe Kerkvliet, 2004. "Examining the Role of Social Isolation on Stated Preferences," American Economic Review, American Economic Association, vol. 94(3), pages 741-752, June.
    11. Black, Nicole & Johnston, David W. & Shields, Michael A. & Suziedelyte, Agne, 2017. "Who provides inconsistent reports of their health status? The importance of age, cognitive ability and socioeconomic status," Social Science & Medicine, Elsevier, vol. 191(C), pages 9-18.
    12. Hatzenbuehler, M.L. & Phelan, J.C. & Link, B.G., 2013. "Stigma as a fundamental cause of population health inequalities," American Journal of Public Health, American Public Health Association, vol. 103(5), pages 813-821.
    13. Holford, Angus J. & Pudney, Stephen, 2015. "Survey Design and the Determinants of Subjective Wellbeing: An Experimental Analysis," IZA Discussion Papers 8760, IZA Network @ LISER.
    14. Anne Case & Angua Deaton, 2015. "Rising morbidity and mortality in midlife among white non-Hispanic Americans in the 21st century," Working Papers 15078.full.pdf, Princeton University, Woodrow Wilson School of Public and International Affairs, Research Program in Development Studies..
    15. Karlan, Dean S. & Zinman, Jonathan, 2012. "List randomization for sensitive behavior: An application for measuring use of loan proceeds," Journal of Development Economics, Elsevier, vol. 98(1), pages 71-75.
    16. Matthew W. Ridley & Gautam Rao & Frank Schilbach & Vikram H. Patel, 2020. "Poverty, Depression, and Anxiety: Causal Evidence and Mechanisms," NBER Working Papers 27157, National Bureau of Economic Research, Inc.
    17. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    18. Lumsdaine, Robin L. & Exterkate, Anneke, 2013. "How survey design affects self-assessed health responses in the Survey of Health, Ageing, and Retirement in Europe (SHARE)," European Economic Review, Elsevier, vol. 63(C), pages 299-307.
    19. Jeffrey R Kling & Jeffrey B Liebman & Lawrence F Katz, 2007. "Experimental Analysis of Neighborhood Effects," Econometrica, Econometric Society, vol. 75(1), pages 83-119, January.
    20. Steven D. Levitt & John A. List, 2007. "What Do Laboratory Experiments Measuring Social Preferences Reveal About the Real World?," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 153-174, Spring.
    21. Lawrence F. Katz & Jeffrey R. Kling & Jeffrey B. Liebman, 2001. "Moving to Opportunity in Boston: Early Results of a Randomized Mobility Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(2), pages 607-654.
    22. Erik Lindqvist & Robert Östling & David Cesarini, 2020. "Long-Run Effects of Lottery Wealth on Psychological Well-Being," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 87(6), pages 2703-2726.
    23. Amy Finkelstein & Sarah Taubman & Bill Wright & Mira Bernstein & Jonathan Gruber & Joseph P. Newhouse & Heidi Allen & Katherine Baicker, 2012. "The Oregon Health Insurance Experiment: Evidence from the First Year," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 127(3), pages 1057-1106.
    24. Sarah Baird & Jacobus de Hoop & Berk Özler, 2013. "Income Shocks and Adolescent Mental Health," Journal of Human Resources, University of Wisconsin Press, vol. 48(2), pages 370-403.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Leonardo Bursztyn & Ingar Haaland & Nicolas Röver & Christopher Roth & Ingar K. Haaland, 2025. "The Social Desirability Atlas," CESifo Working Paper Series 11911, CESifo.
    2. Djaker, Sharnic & Ganimian, Alejandro J. & Sabarwal, Shwetlena, 2024. "Out of sight, out of mind? The gap between students’ test performance and teachers’ estimations in India and Bangladesh," Economics of Education Review, Elsevier, vol. 102(C).
    3. Tomova, Georgia D & Silverwood, Richard J. & Wright, Liam, 2026. "Mode effects on survey item measurement: A systematic review of the experimental evidence," SocArXiv bc7qn_v1, Center for Open Science.
    4. David G. Blanchflower & Alex Bryson, 2026. "The mental health of the young in Asia and the Middle East: the importance of self-reports," Quality & Quantity: International Journal of Methodology, Springer, vol. 60(1), pages 965-993, February.
    5. repec:osf:socarx:gzt7a_v1 is not listed on IDEAS
    6. Di Francesco, Riccardo & Mellace, Giovanni, 2025. "Causal inference for qualitative outcomes," Economics Letters, Elsevier, vol. 256(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Davillas, Apostolos & de Oliveira, Victor Hugo & Jones, Andrew M., 2023. "Is inconsistent reporting of self-assessed health persistent and systematic? Evidence from the UKHLS," Economics & Human Biology, Elsevier, vol. 49(C).
    2. Black, Nicole & Johnston, David W. & Shields, Michael A. & Suziedelyte, Agne, 2017. "Who provides inconsistent reports of their health status? The importance of age, cognitive ability and socioeconomic status," Social Science & Medicine, Elsevier, vol. 191(C), pages 9-18.
    3. Mateus Dias & Luiz Felipe Fontes, 2024. "The Effects of a Large-Scale Mental Health Reform: Evidence from Brazil," American Economic Journal: Economic Policy, American Economic Association, vol. 16(3), pages 257-289, August.
    4. Li, Wenchao, 2021. "The “miseries” of sex imbalance: Evidence using subjective well-being data," Journal of Development Economics, Elsevier, vol. 151(C).
    5. Nikolova, Elena & Sanfey, Peter, 2016. "How much should we trust life satisfaction data? Evidence from the Life in Transition Survey," Journal of Comparative Economics, Elsevier, vol. 44(3), pages 720-731.
    6. Aycinena, Diego & Bogliacino, Francesco & Kimbrough, Erik O., 2024. "Measuring norms: Assessing the threat of social desirability bias to the Bicchieri and Xiao elicitation method," Journal of Economic Behavior & Organization, Elsevier, vol. 222(C), pages 225-239.
    7. Malavasi, Chiara & Ye, Han, 2024. "Live Longer and Healthier: Impact of Pension Income for Low-Income Retirees," VfS Annual Conference 2024 (Berlin): Upcoming Labor Market Challenges 302374, Verein für Socialpolitik / German Economic Association.
    8. Alloush, Mo & Bloem, Jeffrey R., 2022. "Neighborhood violence, poverty, and psychological well-being," Journal of Development Economics, Elsevier, vol. 154(C).
    9. Robert Collinson & John Eric Humphries & Nicholas Mader & Davin Reed & Daniel Tannenbaum & Winnie van Dijk, 2024. "Eviction and Poverty in American Cities," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 139(1), pages 57-120.
    10. Jan-Emmanuel De Neve & George Ward & Femke De Keulenaer & Bert Van Landeghem & Georgios Kavetsos & Michael I. Norton, 2018. "The Asymmetric Experience of Positive and Negative Economic Growth: Global Evidence Using Subjective Well-Being Data," The Review of Economics and Statistics, MIT Press, vol. 100(2), pages 362-375, May.
    11. Achyuta Adhvaryu & James Fenske & Anant Nyshadham, 2019. "Early Life Circumstance and Adult Mental Health," Journal of Political Economy, University of Chicago Press, vol. 127(4), pages 1516-1549.
    12. Michael R.M. Abrigo & Timothy J. Halliday & Teresa Molina, 2022. "Expanding health insurance for the elderly of the Philippines," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(3), pages 500-520, April.
    13. Benjamin A. Olken & Junko Onishi & Susan Wong, 2014. "Should Aid Reward Performance? Evidence from a Field Experiment on Health and Education in Indonesia," American Economic Journal: Applied Economics, American Economic Association, vol. 6(4), pages 1-34, October.
    14. Gong, Jie & Lu, Yi & Xie, Huihua, 2020. "The average and distributional effects of teenage adversity on long-term health," Journal of Health Economics, Elsevier, vol. 71(C).
    15. Rucker C. Johnson, 2018. "Addressing Racial Health Disparities: Looking Back to Point the Way Forward," The ANNALS of the American Academy of Political and Social Science, , vol. 680(1), pages 132-171, November.
    16. Nicolas R. Ziebarth, 2018. "Social Insurance and Health," Contributions to Economic Analysis, in: Health Econometrics, volume 127, pages 57-84, Emerald Group Publishing Limited.
    17. Jiayi Wen & Zixi Ye & Xuan Zhang, 2024. "A New Testing Method for Justification Bias Using High-Frequency Data of Health and Employment," Papers 2403.06368, arXiv.org.
    18. Black, Nicole & Johnston, David W. & Suziedelyte, Agne, 2017. "Justification bias in self-reported disability: New evidence from panel data," Journal of Health Economics, Elsevier, vol. 54(C), pages 124-134.
    19. Chen, Linkun & Clarke, Philip M. & Petrie, Dennis J. & Staub, Kevin E., 2021. "The effects of self-assessed health: Dealing with and understanding misclassification bias," Journal of Health Economics, Elsevier, vol. 78(C).
    20. Chadi, Adrian, 2013. "Third Person Effects in Interview Responses on Life Satisfaction," Schmollers Jahrbuch : Journal of Applied Social Science Studies / Zeitschrift für Wirtschafts- und Sozialwissenschaften, Duncker & Humblot, Berlin, vol. 133(2), pages 323-333.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    JEL classification:

    • D9 - Microeconomics - - Micro-Based Behavioral Economics
    • C8 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs
    • I3 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:pubeco:v:214:y:2022:i:c:s0047272722001475. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/505578 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.