IDEAS home Printed from https://ideas.repec.org/a/eee/jeborg/v243y2026ics0167268126000521.html

Measuring social norms: direct and indirect methods and the role of financial incentives in reducing misreporting

Author

Listed:
  • Reitmann, Ann-Kristin
  • Mahé, Clotilde
  • Goedhuys, Micheline
  • Nillesen, Eleonora

Abstract

We test two common features of the opinion-matching method to elicit personal beliefs and perceived social norms regarding female labor force participation among a sample of young Tunisian men and women. Our survey experiment contains two orthogonal treatment arms. In the first treatment arm, respondents were randomly assigned to answer a direct question about their personal beliefs regarding women working outside the home and an indirect questioning technique that provides more cover for the respondent: the list experiment. We find significant discrepancies between the two, particularly among male respondents – suggesting either biased personal beliefs in the direct question or non-strategic misreporting in the list experiment. It follows that, depending on which method is deemed more credible and which gender sample is considered, the prevalence of pluralistic ignorance varies widely in our setting. For the second treatment arm, we provided half of our sample with a financial incentive when eliciting perceived social norms regarding the appropriateness of women working. We find that financial incentives are necessary for both men and women to distinguish their personal beliefs from their perception of what others believe.

Suggested Citation

  • Reitmann, Ann-Kristin & Mahé, Clotilde & Goedhuys, Micheline & Nillesen, Eleonora, 2026. "Measuring social norms: direct and indirect methods and the role of financial incentives in reducing misreporting," Journal of Economic Behavior & Organization, Elsevier, vol. 243(C).
  • Handle: RePEc:eee:jeborg:v:243:y:2026:i:c:s0167268126000521
    DOI: 10.1016/j.jebo.2026.107465
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167268126000521
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jebo.2026.107465?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or

    for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Simon Gächter & Elke Renner, 2010. "The effects of (incentivized) belief elicitation in public goods experiments," Experimental Economics, Springer;Economic Science Association, vol. 13(3), pages 364-377, September.
    2. Nazier, Hanan & Ezzat, Asmaa, 2022. "Gender differences and time allocation: A comparative analysis of Egypt and Tunisia," The Quarterly Review of Economics and Finance, Elsevier, vol. 85(C), pages 174-193.
    3. Aycinena, Diego & Bogliacino, Francesco & Kimbrough, Erik O., 2024. "Measuring norms: Assessing the threat of social desirability bias to the Bicchieri and Xiao elicitation method," Journal of Economic Behavior & Organization, Elsevier, vol. 222(C), pages 225-239.
    4. Kuhn, Patrick M. & Vivyan, Nick, 2022. "The Misreporting Trade-Off Between List Experiments and Direct Questions in Practice: Partition Validation Evidence from Two Countries," Political Analysis, Cambridge University Press, vol. 30(3), pages 381-402, July.
    5. Erik O. Kimbrough & Alexander Vostroknutov, 2016. "Norms Make Preferences Social," Journal of the European Economic Association, European Economic Association, vol. 14(3), pages 608-638, June.
    6. Ernst Fehr & Ivo Schurtenberger, 2018. "Normative foundations of human cooperation," Nature Human Behaviour, Nature, vol. 2(7), pages 458-468, July.
    7. repec:osf:socarx:7n4xd_v1 is not listed on IDEAS
    8. David Y. Yang & Leonardo Bursztyn, 2022. "Misperceptions About Others," Annual Review of Economics, Annual Reviews, vol. 14(1), pages 425-452, August.
    9. Claire Cullen, 2023. "Method Matters: The Underreporting of Intimate Partner Violence," The World Bank Economic Review, World Bank, vol. 37(1), pages 49-73.
    10. Lassassi, Moundir & Tansel, Aysit, 2020. "Female Labor Force Participation in Five Selected MENA Countries: An Age-Period-Cohort Analysis (Algeria, Egypt, Jordan, Palestine and Tunisia)," GLO Discussion Paper Series 693, Global Labor Organization (GLO).
    11. Jean Tirole & Roland Bénabou, 2006. "Incentives and Prosocial Behavior," American Economic Review, American Economic Association, vol. 96(5), pages 1652-1678, December.
    12. Transue, John E. & Lee, Daniel J. & Aldrich, John H., 2009. "Treatment Spillover Effects across Survey Experiments," Political Analysis, Cambridge University Press, vol. 17(2), pages 143-161, April.
    13. Andrew Schotter & Isabel Trevino, 2014. "Belief Elicitation in the Laboratory," Annual Review of Economics, Annual Reviews, vol. 6(1), pages 103-128, August.
    14. Billur Aksoy & Christopher S. Carpenter & Dario Sansone, 2025. "Understanding Labor Market Discrimination Against Transgender People: Evidence from a Double List Experiment and a Survey," Management Science, INFORMS, vol. 71(1), pages 659-677, January.
    15. Ernst Fehr & Urs Fischbacher, 2004. "Social norms and human cooperation," Macroeconomics 0409026, University Library of Munich, Germany.
    16. Ahlquist, John S., 2018. "List Experiment Design, Non-Strategic Respondent Error, and Item Count Technique Estimators," Political Analysis, Cambridge University Press, vol. 26(1), pages 34-53, January.
    17. Charness, Gary & Dimant, Eugen & Gneezy, Uri & Krupka, Erin, 2025. "Experimental methods: Eliciting and measuring social norms," Journal of Economic Behavior & Organization, Elsevier, vol. 237(C).
    18. Leonardo Bursztyn & Alessandra L. González & David Yanagizawa-Drott, 2020. "Misperceived Social Norms: Women Working Outside the Home in Saudi Arabia," American Economic Review, American Economic Association, vol. 110(10), pages 2997-3029, October.
    19. Bertelli, Olivia & Calvo, Thomas & Lavallée, Emmanuelle & Mercier, Marion & Mesplé-Somps, Sandrine, 2025. "What one thinks, what one says and what one does: Male justifications and practices of gender-based violence in Mali," Journal of Development Economics, Elsevier, vol. 176(C).
    20. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    21. repec:plo:pone00:0193985 is not listed on IDEAS
    22. Gauri,Varun & Rahman,Tasmia & Sen,Iman Kalyan, 2019. "Measuring Social Norms About Female Labor Force Participation in Jordan," Policy Research Working Paper Series 8916, The World Bank.
    23. Boring, Anne & Delfgaauw, Josse, 2024. "Social desirability bias in attitudes towards sexism and DEI policies in the workplace," Journal of Economic Behavior & Organization, Elsevier, vol. 225(C), pages 465-482.
    24. Reitmann, Ann-Kristin & Goedhuys, Micheline & Grimm, Michael & Nillesen, Eleonora E.M., 2020. "Gender attitudes in the Arab region – The role of framing and priming effects," Journal of Economic Psychology, Elsevier, vol. 80(C).
    25. Bryn Rosenfeld & Kosuke Imai & Jacob N. Shapiro, 2016. "An Empirical Validation Study of Popular Survey Methodologies for Sensitive Questions," American Journal of Political Science, John Wiley & Sons, vol. 60(3), pages 783-802, July.
    26. Erin L. Krupka & Roberto A. Weber, 2013. "Identifying Social Norms Using Coordination Games: Why Does Dictator Game Sharing Vary?," Journal of the European Economic Association, European Economic Association, vol. 11(3), pages 495-524, June.
    27. M. Niaz Asadullah & Elisabetta De Cao & Fathema Zhura Khatoon & Zahra Siddique, 2021. "Measuring gender attitudes using list experiments," Journal of Population Economics, Springer;European Society for Population Economics, vol. 34(2), pages 367-400, April.
    28. Marianne Bertrand & Emir Kamenica & Jessica Pan, 2015. "Gender Identity and Relative Income within Households," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 130(2), pages 571-614.
    29. David Danz & Lise Vesterlund & Alistair J. Wilson, 2022. "Belief Elicitation and Behavioral Incentive Compatibility," American Economic Review, American Economic Association, vol. 112(9), pages 2851-2883, September.
    30. Kadam, Aditi & McCullough, Ellen B. & McGavock, Tamara J. & Magnan, Nicholas, 2025. "Who is asking and how? Effects of survey mode and enumerator gender on measuring women’s life experience," World Development, Elsevier, vol. 195(C).
    31. Blair, Graeme & Imai, Kosuke, 2012. "Statistical Analysis of List Experiments," Political Analysis, Cambridge University Press, vol. 20(1), pages 47-77, January.
    32. Gaines, Brian J. & Kuklinski, James H. & Quirk, Paul J., 2007. "The Logic of the Survey Experiment Reexamined," Political Analysis, Cambridge University Press, vol. 15(1), pages 1-20, January.
    33. Nillesen, Eleonora & Grimm, Michael & Goedhuys, Micheline & Reitmann, Ann-Kristin & Meysonnat, Aline, 2021. "On the malleability of gender attitudes: Evidence from implicit and explicit measures in Tunisia," World Development, Elsevier, vol. 138(C).
    34. Kaushik Basu, 2003. "Analytical Development Economics: The Less Developed Economy Revisited," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262523442, December.
    35. Elster, Jon, 1989. "Social Norms and Economic Theory," Journal of Economic Perspectives, American Economic Association, vol. 3(4), pages 99-117, Fall.
    36. Tom Lane & Daniele Nosenzo & Silvia Sonderegger, 2023. "Law and Norms: Empirical Evidence," American Economic Review, American Economic Association, vol. 113(5), pages 1255-1293, May.
    37. Eliana La Ferrara & Alberto Chong & Suzanne Duryea, 2012. "Soap Operas and Fertility: Evidence from Brazil," American Economic Journal: Applied Economics, American Economic Association, vol. 4(4), pages 1-31, October.
    38. Monira Essa Aloud & Sara Al-Rashood & Ina Ganguli & Basit Zafar, 2020. "Information and Social Norms: Experimental Evidence on the Labor Market Aspirations of Saudi Women," NBER Working Papers 26693, National Bureau of Economic Research, Inc.
    39. Chi-lin Tsai, 2019. "Statistical analysis of the item-count technique using Stata," Stata Journal, StataCorp LLC, vol. 19(2), pages 390-434, June.
    40. Bernheim, B Douglas, 1994. "A Theory of Conformity," Journal of Political Economy, University of Chicago Press, vol. 102(5), pages 841-877, October.
    41. Bicchieri, Cristina & Das, Upasak & Gant, Samuel & Sander, Rachel, 2022. "Examining norms and social expectations surrounding exclusive breastfeeding: Evidence from Mali," World Development, Elsevier, vol. 153(C).
    42. Graeme Blair & Kosuke Imai & Jason Lyall, 2014. "Comparing and Combining List and Endorsement Experiments: Evidence from Afghanistan," American Journal of Political Science, John Wiley & Sons, vol. 58(4), pages 1043-1063, October.
    43. Barigozzi, Francesca & Montinari, Natalia, 2025. "Social norms in survey experiments: Personal beliefs versus normative expectations," Journal of Economic Behavior & Organization, Elsevier, vol. 239(C).
    44. Daniel Zizzo, 2010. "Experimenter demand effects in economic experiments," Experimental Economics, Springer;Economic Science Association, vol. 13(1), pages 75-98, March.
    45. Lépine, Aurélia & Treibich, Carole & D’Exelle, Ben, 2020. "Nothing but the truth: Consistency and efficiency of the list experiment method for the measurement of sensitive health behaviours," Social Science & Medicine, Elsevier, vol. 266(C).
    46. James Andreoni & B. Douglas Bernheim, 2009. "Social Image and the 50-50 Norm: A Theoretical and Experimental Analysis of Audience Effects," Econometrica, Econometric Society, vol. 77(5), pages 1607-1636, September.
    47. Ernst Fehr & Simon Gächter, 2002. "Altruistic punishment in humans," Nature, Nature, vol. 415(6868), pages 137-140, January.
    48. Alberto Alesina & Paola Giuliano & Nathan Nunn, 2013. "On the Origins of Gender Roles: Women and the Plough," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(2), pages 469-530.
    49. Elisabetta De Cao & Clemens Lutz, 2018. "Sensitive Survey Questions: Measuring Attitudes Regarding Female Genital Cutting Through a List Experiment," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 80(5), pages 871-892, October.
    50. Dimant, Eugen, 2023. "Beyond average: A method for measuring the tightness, looseness, and polarization of social norms," Economics Letters, Elsevier, vol. 233(C).
    51. Ragui Assaad & Caroline Krafft & Irene Selwaness, 2022. "The Impact of Marriage on Women's Employment in the Middle East and North Africa," Feminist Economics, Taylor & Francis Journals, vol. 28(2), pages 247-279, April.
    52. Burdea, Valeria & Woon, Jonathan, 2022. "Online belief elicitation methods," Journal of Economic Psychology, Elsevier, vol. 90(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Charness, Gary & Dimant, Eugen & Gneezy, Uri & Krupka, Erin, 2025. "Experimental methods: Eliciting and measuring social norms," Journal of Economic Behavior & Organization, Elsevier, vol. 237(C).
    2. d'Adda, Giovanna & Dufwenberg, Martin & Passarelli, Francesco & Tabellini, Guido, 2020. "Social norms with private values: Theory and experiments," Games and Economic Behavior, Elsevier, vol. 124(C), pages 288-304.
    3. Bertelli, Olivia & Calvo, Thomas & Lavallée, Emmanuelle & Mercier, Marion & Mesplé-Somps, Sandrine, 2025. "Attitudes and behaviors in a fragile state. A list experiment in Mali," World Development, Elsevier, vol. 196(C).
    4. Aycinena, Diego & Bogliacino, Francesco & Kimbrough, Erik O., 2024. "Measuring norms: Assessing the threat of social desirability bias to the Bicchieri and Xiao elicitation method," Journal of Economic Behavior & Organization, Elsevier, vol. 222(C), pages 225-239.
    5. Folco Panizza & Eugen Dimant & Erik O. Kimbrough & Alexander Vostroknutov, 2026. "Pluralism Breeds Tolerance," CESifo Working Paper Series 12689, CESifo.
    6. Simon Gächter & Lucas Molleman & Daniele Nosenzo, 2025. "Why people follow rules," Nature Human Behaviour, Nature, vol. 9(7), pages 1342-1354, July.
    7. Werner, Peter, 2024. "On common evaluation standards and the acceptance of wage inequality," Games and Economic Behavior, Elsevier, vol. 145(C), pages 137-156.
    8. Christian Thoeni & Simon Gaechter, 2011. "Peer Effects and Social Preferences in Voluntary Cooperation," Discussion Papers 2011-09, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
    9. Apffelstaedt, Arno & Freundt, Jana & Oslislo, Christoph, 2022. "Social norms and elections: How elected rules can make behavior (in)appropriate," Journal of Economic Behavior & Organization, Elsevier, vol. 196(C), pages 148-177.
    10. Martinez-Felip, Daniel & Schilizzi, Steven G.M. & Nguyen, Chi, 2026. "How does experienced behaviour change normative expectations regarding socially beneficial actions?," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 122(C).
    11. Kölle, Felix & Quercia, Simone, 2021. "The influence of empirical and normative expectations on cooperation," Journal of Economic Behavior & Organization, Elsevier, vol. 190(C), pages 691-703.
    12. Bartling, Björn & Özdemir, Yagiz, 2023. "The limits to moral erosion in markets: Social norms and the replacement excuse," Games and Economic Behavior, Elsevier, vol. 138(C), pages 143-160.
    13. Thöni, Christian & Gächter, Simon, 2015. "Peer effects and social preferences in voluntary cooperation: A theoretical and experimental analysis," Journal of Economic Psychology, Elsevier, vol. 48(C), pages 72-88.
    14. Bertelli, Olivia & Calvo, Thomas & Lavallée, Emmanuelle & Mercier, Marion & Mesplé-Somps, Sandrine, 2025. "What one thinks, what one says and what one does: Male justifications and practices of gender-based violence in Mali," Journal of Development Economics, Elsevier, vol. 176(C).
    15. Mats Ekman, 2022. "Buildings and welfare," Rationality and Society, , vol. 34(4), pages 526-547, November.
    16. Graf, Caroline & Suanet, Bianca & Wiepking, Pamala & Merz, Eva-Maria, 2023. "Social norms offer explanation for inconsistent effects of incentives on prosocial behavior," Journal of Economic Behavior & Organization, Elsevier, vol. 211(C), pages 429-441.
    17. Bašić, Zvonimir & Verrina, Eugenio, 2024. "Personal norms — and not only social norms — shape economic behavior," Journal of Public Economics, Elsevier, vol. 239(C).
    18. Arroyos-Calvera, Danae & Lohse, Johannes & McDonald, Rebecca, 2024. "Beyond social influence: Examining the efficacy of non-social recommendations," European Economic Review, Elsevier, vol. 168(C).
    19. Angerer, Silvia & Glätzle-Rützler, Daniela & Lergetporer, Philipp & Rittmannsberger, Thomas, 2024. "Beliefs about social norms and gender-based polarization of COVID-19 vaccination readiness," European Economic Review, Elsevier, vol. 163(C).
    20. Olivia Bertelli & Thomas Calvo & Emmanuelle Lavallée & Marion Mercier & Sandrine Mesplé-Somps, 2023. "Measuring insecurity-related experiences and preferences in a fragile state : a list experiment in Mali," Working Papers hal-04891546, HAL.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods
    • C99 - Mathematical and Quantitative Methods - - Design of Experiments - - - Other
    • D91 - Microeconomics - - Micro-Based Behavioral Economics - - - Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making
    • J29 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Other
    • O12 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Microeconomic Analyses of Economic Development

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jeborg:v:243:y:2026:i:c:s0167268126000521. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jebo .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.