IDEAS home Printed from https://ideas.repec.org/p/ajk/ajkdps/362.html
   My bibliography  Save this paper

Understanding Economic Behavior Using Open-Ended Survey Data

Author

Listed:
  • Ingar Haaland

    (NHH Norwegian School of Economics, FAIR & CEPR)

  • Christopher Roth

    (University of Cologne, Max Planck Institute for Research on Collective Goods, CEPR & NHH Norwegian School of Economics)

  • Stefanie Stantcheva

    (Harvard University, NBER & CEPR)

  • Johannes Wohlfart

    (University of Cologne, Max Planck Institute for Research on Collective Goods, CEBI & CESifo)

Abstract

We survey the recent literature in economics using open-ended survey data to uncover mechanisms behind economic beliefs and behaviors. We first provide an overview of different applications, including the measurement of motives, mental models, narratives, attention, information transmission, and recall. We next describe different ways of eliciting open-ended responses, including single-item open-ended questions, speech recordings, and AI-powered qualitative interviews. Subsequently, we discuss methods to annotate and analyze such data with a focus on recent advances in large language models. Our review concludes with a discussion of promising avenues for future research.

Suggested Citation

  • Ingar Haaland & Christopher Roth & Stefanie Stantcheva & Johannes Wohlfart, 2025. "Understanding Economic Behavior Using Open-Ended Survey Data," ECONtribute Discussion Papers Series 362, University of Bonn and University of Cologne, Germany.
  • Handle: RePEc:ajk:ajkdps:362
    as

    Download full text from publisher

    File URL: https://www.econtribute.de/RePEc/ajk/ajkdps/ECONtribute_362_2025.pdf
    File Function: First version, 2025
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Alberto Alesina & Armando Miano & Stefanie Stantcheva, 2023. "Immigration and Redistribution," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 90(1), pages 1-39.
    2. Peter Andrebriq & Carlo Pizzinelli & Christopher Roth & Johannes Wohlfart, 2022. "Subjective Models of the Macroeconomy: Evidence From Experts and Representative Samples," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 89(6), pages 2958-2991.
    3. Rob Bauer & Katrin Gödker & Paul Smeets & Florian Zimmermann, 2024. "Mental Models in Financial Markets: How Do Experts Reason about the Pricing of Climate Risk?," CESifo Working Paper Series 11149, CESifo.
    4. Liscow, Zachary & Fox, Edward, 2022. "The psychology of taxing capital income: Evidence from a survey experiment on the realization rule," Journal of Public Economics, Elsevier, vol. 213(C).
    5. Leonardo Bursztyn & Ingar K. Haaland & Aakaash Rao & Christopher P. Roth, 2020. "Disguising Prejudice: Popular Rationales as Excuses for Intolerant Expression," NBER Working Papers 27288, National Bureau of Economic Research, Inc.
    6. Abeler, Johannes & Huffman, David B. & Raymond, Collin, 2023. "Incentive Complexity, Bounded Rationality and Effort Provision," IZA Discussion Papers 16284, Institute of Labor Economics (IZA).
    7. Sarah Baird & Craig McIntosh & Berk Özler, 2011. "Cash or Condition? Evidence from a Cash Transfer Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(4), pages 1709-1753.
    8. Castagnetti, Alessandro & Schmacker, Renke, 2022. "Protecting the ego: Motivated information selection and updating," European Economic Review, Elsevier, vol. 142(C).
    9. Felix Chopras & Ingar Haaland & Christopher Roth, 2024. "The Demand for News: Accuracy Concerns Versus Belief Confirmation Motives," The Economic Journal, Royal Economic Society, vol. 134(661), pages 1806-1834.
    10. Anselm Hager & Lukas Hensel & Johannes Hermle & Christopher Roth, 2023. "Political Activists as Free Riders: Evidence from a Natural Field Experiment," The Economic Journal, Royal Economic Society, vol. 133(653), pages 2068-2084.
    11. Marina Agranov & Pietro Ortoleva, 2017. "Stochastic Choice and Preferences for Randomization," Journal of Political Economy, University of Chicago Press, vol. 125(1), pages 40-68.
    12. Vincenzo Galasso & Massimo Morelli & Tommaso Nannicini & Piero Stanig, 2024. "The Populist Dynamic: Experimental Evidence on the Effects of Countering Populism," CESifo Working Paper Series 10949, CESifo.
    13. Romero, Mauricio & Bedoya, Juan & Yanez-Pagans, Monica & Silveyra, Marcela & de Hoyos, Rafael, 2022. "Direct vs indirect management training: Experimental evidence from schools in Mexico," Journal of Development Economics, Elsevier, vol. 154(C).
    14. Lasse J. Jessen & Sebastian Koehne & Patrick Nüß & Jens Ruhose, 2024. "Socioeconomic Inequality in Life Expectancy: Perception and Policy Demand," CESifo Working Paper Series 10940, CESifo.
    15. Roth, Christopher & Schwardmann, Peter & Tripodi, Egon, 2024. "Misperceived effectiveness and the demand for psychotherapy," Journal of Public Economics, Elsevier, vol. 240(C).
    16. Karl E. Case & Robert J. Shiller & Anne K. Thompson, 2012. "What Have They Been Thinking? Homebuyer Behavior in Hot and Cold Markets," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 43(2 (Fall)), pages 265-315.
    17. Johannes Abeler & David Huffman & Colin Raymond, 2023. "Incentive Complexity, Bounded Rationality and Effort Provision," Economics Series Working Papers 1012, University of Oxford, Department of Economics.
    18. Lilith Burgstaller & Annabelle Doerr & Sarah Necker, 2023. "Do Household Tax Credits Increase the Demand for Legally Provided Services?," CESifo Working Paper Series 10211, CESifo.
    19. Ingar Haaland & Christopher Roth & Stefanie Stantcheva & Johannes Wohlfart, 2024. "Measuring What Is Top of Mind," ECONtribute Discussion Papers Series 298, University of Bonn and University of Cologne, Germany.
    20. Brad Nathan & Ricardo Perez-Truglia & Alejandro Zentner, 2025. "My Taxes Are Too Darn High: Why Do Households Protest Their Taxes?," American Economic Journal: Economic Policy, American Economic Association, vol. 17(1), pages 273-310, February.
    21. Karl E. Case & Robert J. Shiller, 2003. "Is There a Bubble in the Housing Market?," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 34(2), pages 299-362.
    22. Michael Bailey & Eduardo Dávila & Theresa Kuchler & Johannes Stroebel, 2019. "House Price Beliefs And Mortgage Leverage Choice," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 86(6), pages 2403-2452.
    23. Arindrajit Dube & Suresh Naidu & Adam D. Reich, 2022. "Power and Dignity in the Low-Wage Labor Market: Theory and Evidence from Wal-Mart Workers," NBER Working Papers 30441, National Bureau of Economic Research, Inc.
    24. Himelein,Kristen, 2015. "Interviewer effects in subjective survey questions: evidence from Timor-Leste," Policy Research Working Paper Series 7208, The World Bank.
    25. Bustos, Sebastian & Pomeranz, Dina & Suárez Serrato, Juan Carlos & Vila-Belda, José & Zucman, Gabriel, 2022. "The Race Between Tax Enforcement and Tax Planning: Evidence From a Natural Experiment in Chile," CEPR Discussion Papers 17347, C.E.P.R. Discussion Papers.
    26. Garret Christensen & Edward Miguel, 2018. "Transparency, Reproducibility, and the Credibility of Economics Research," Journal of Economic Literature, American Economic Association, vol. 56(3), pages 920-980, September.
    27. Dillon, Andrew & Bardasi, Elena & Beegle, Kathleen & Serneels, Pieter, 2012. "Explaining variation in child labor statistics," Journal of Development Economics, Elsevier, vol. 98(1), pages 136-147.
    28. Bocar A. Ba & Roman Rivera & Alexander Whitefield, 2023. "Forecasting the Impact of Racial Uprisings, Market versus Stakeholders' Expectations," NBER Working Papers 31857, National Bureau of Economic Research, Inc.
    29. Silvia Saccardo & Marta Serra-Garcia, 2023. "Enabling or Limiting Cognitive Flexibility? Evidence of Demand for Moral Commitment," American Economic Review, American Economic Association, vol. 113(2), pages 396-429, February.
    30. Rob Bauer & Katrin Gödker & Paul Smeets & Florian Zimmermann, 2024. "Mental Models in Financial Markets: How Do Experts Reason About the Pricing of Climate Change?," CRC TR 224 Discussion Paper Series crctr224_2024_569, University of Bonn and University of Mannheim, Germany.
    31. Parker, Barbara & Kozel, Valerie, 2007. "Understanding Poverty and Vulnerability in India's Uttar Pradesh and Bihar: A Q-squared Approach," World Development, Elsevier, vol. 35(2), pages 296-311, February.
    32. Filippini, Massimo & Leippold, Markus & Wekhof, Tobias, 2024. "Sustainable finance literacy and the determinants of sustainable investing," Journal of Banking & Finance, Elsevier, vol. 163(C).
    33. Alessandra Casarico & Jana Schuetz & Silke Uebelmesser, 2024. "Gender Inequality over the Life Cycle, Information Provision and Policy Preferences," CESifo Working Paper Series 10916, CESifo.
    34. Stefanie Stantcheva, 2021. "Understanding Tax Policy: How do People Reason?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 136(4), pages 2309-2369.
    35. Stefanie Stantcheva, 2023. "How to Run Surveys: A Guide to Creating Your Own Identifying Variation and Revealing the Invisible," Annual Review of Economics, Annual Reviews, vol. 15(1), pages 205-234, September.
    36. Leiser, David & Drori, Shelly, 2005. "NaIve understanding of inflation," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 34(2), pages 179-198, March.
    37. Anton Korinek, 2023. "Generative AI for Economic Research: Use Cases and Implications for Economists," Journal of Economic Literature, American Economic Association, vol. 61(4), pages 1281-1317, December.
    38. An, Zidong & Binder, Carola & Sheng, Xuguang Simon, 2023. "Gas price expectations of Chinese households," Energy Economics, Elsevier, vol. 120(C).
    39. Bewley, Truman, 2002. "Interviews as a valid empirical tool in economics," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 31(4), pages 343-353.
    40. Melissa Dell, 2025. "Deep Learning for Economists," Journal of Economic Literature, American Economic Association, vol. 63(1), pages 5-58, March.
    41. Peter Bergman & Raj Chetty & Stefanie DeLuca & Nathaniel Hendren & Lawrence F. Katz & Christopher Palmer, 2024. "Creating Moves to Opportunity: Experimental Evidence on Barriers to Neighborhood Choice," American Economic Review, American Economic Association, vol. 114(5), pages 1281-1337, May.
    42. Martha A. Starr, 2014. "Qualitative And Mixed-Methods Research In Economics: Surprising Growth, Promising Future," Journal of Economic Surveys, Wiley Blackwell, vol. 28(2), pages 238-264, April.
    43. Colin Camerer & George Loewenstein & Drazen Prelec, 2005. "Neuroeconomics: How Neuroscience Can Inform Economics," Journal of Economic Literature, American Economic Association, vol. 43(1), pages 9-64, March.
    44. Alejandro Martínez-Marquina & Muriel Niederle & Emanuel Vespa, 2019. "Failures in Contingent Reasoning: The Role of Uncertainty," American Economic Review, American Economic Association, vol. 109(10), pages 3437-3474, October.
    45. Tiezzi, Silvia & Xiao, Erte, 2016. "Time delay, complexity and support for taxation," Journal of Environmental Economics and Management, Elsevier, vol. 77(C), pages 117-141.
    46. Dani Rodrik & Stefanie Stantcheva, 2021. "A Policy Matrix for Inclusive Prosperity," NBER Working Papers 28736, National Bureau of Economic Research, Inc.
    47. Erzo F. P. Luttmer & Andrew A. Samwick, 2018. "The Welfare Cost of Perceived Policy Uncertainty: Evidence from Social Security," American Economic Review, American Economic Association, vol. 108(2), pages 275-307, February.
    48. Zhengyang Jiang & Hongqi Liu & Cameron Peng & Hongjun Yan, 2024. "Investor Memory and Biased Beliefs: Evidence from the Field," NBER Working Papers 33226, National Bureau of Economic Research, Inc.
    49. Ádám Stefkovics & Endre Sik, 2022. "What Drives Happiness? The Interviewer’s Happiness," Journal of Happiness Studies, Springer, vol. 23(6), pages 2745-2762, August.
    50. Cars Hommes & Julien Pinter & Isabelle Salle, 2023. "What People Believe about Monetary Finance and What We Can(‘t) Do about It: Evidence from a Large-Scale, Multi-Country Survey Experiment," CESifo Working Paper Series 10574, CESifo.
    51. Alex Imas & Michael A. Kuhn & Vera Mironova, 2022. "Waiting to Choose: The Role of Deliberation in Intertemporal Choice," American Economic Journal: Microeconomics, American Economic Association, vol. 14(3), pages 414-440, August.
    52. Tobias Wekhof & Sébastien Houde, 2023. "Using narratives to infer preferences in understanding the energy efficiency gap," Nature Energy, Nature, vol. 8(9), pages 965-977, September.
    53. Vincenzo Galasso & Tomasso Nannicini & Debora Nozza, 2024. "We Need to Talk: Audio Surveys and Information Extraction," CESifo Working Paper Series 11530, CESifo.
    54. Benjamin Handel & Joshua Schwartzstein, 2018. "Frictions or Mental Gaps: What's Behind the Information We (Don't) Use and When Do We Care?," Journal of Economic Perspectives, American Economic Association, vol. 32(1), pages 155-178, Winter.
    55. Roberto Colarieti & Pierfrancesco Mei & Stefanie Stantcheva, 2024. "The How and Why of Household Reactions to Income Shocks," NBER Working Papers 32191, National Bureau of Economic Research, Inc.
    56. Rema Hanna & Sendhil Mullainathan & Joshua Schwartzstein, 2014. "Learning Through Noticing: Theory and Evidence from a Field Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 129(3), pages 1311-1353.
    57. Bewley, Truman F, 1995. "A Depressed Labor Market as Explained by Participants," American Economic Review, American Economic Association, vol. 85(2), pages 250-254, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Marcel Preuss & Germán Reyes & Jason Somerville & Joy Wu, 2025. "Are Elites Meritocratic and Efficiency-Seeking? Evidence from MBA Students," CEDLAS, Working Papers 0356, CEDLAS, Universidad Nacional de La Plata.
    2. Leonardo Bursztyn & Ingar Haaland & Nicolas Röver & Christopher Roth, 2025. "The Social Desirability Atlas," ECONtribute Discussion Papers Series 365, University of Bonn and University of Cologne, Germany.
    3. Björn Bartling & Krishna Srinivasan, 2025. "Paternalistic interventions: determinants of demand and supply," ECON - Working Papers 469, Department of Economics - University of Zurich.
    4. Björn Bartling & Krishna Srinivasan, 2025. "Paternalistic Interventions: Determinants of Demand and Supply," CESifo Working Paper Series 11886, CESifo.
    5. Leonardo Bursztyn & Ingar Haaland & Nicolas Röver & Christopher Roth & Ingar K. Haaland, 2025. "The Social Desirability Atlas," CESifo Working Paper Series 11911, CESifo.
    6. Jianhao Lin & Lexuan Sun & Yixin Yan, 2025. "Simulating Macroeconomic Expectations using LLM Agents," Papers 2505.17648, arXiv.org, revised Jun 2025.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ingar Haaland & Christopher Roth & Stefanie Stantcheva & Johannes Wohlfart, 2024. "Measuring What Is Top of Mind," CEBI working paper series 24-10, University of Copenhagen. Department of Economics. The Center for Economic Behavior and Inequality (CEBI).
    2. Galasso, Vincenzo & Nannicini, Tommaso & Nozza, Debora, 2024. "We Need to Talk: Audio Surveys and Information Extraction," IZA Discussion Papers 17488, Institute of Labor Economics (IZA).
    3. Ingar Haaland & Christopher Roth & Johannes Wohlfart, 2023. "Designing Information Provision Experiments," Journal of Economic Literature, American Economic Association, vol. 61(1), pages 3-40, March.
    4. Peter Andre & Philipp Schirmer & Johannes Wohlfart, 2023. "Mental Models of the Stock Market," CESifo Working Paper Series 10691, CESifo.
    5. Binetti, Alberto & Nuzzi, Francesco & Stantcheva, Stefanie, 2024. "People’s understanding of inflation," Journal of Monetary Economics, Elsevier, vol. 148(S).
    6. Alice Pizzo & Christina Gravert & Jan M. Bauer & Lucia Reisch, 2024. "Carbon Taxes Crowd Out Climate Concern: Experimental Evidence from Sustainable Consumer Choices," CEBI working paper series 24-16, University of Copenhagen. Department of Economics. The Center for Economic Behavior and Inequality (CEBI).
    7. Theresa Kuchler & Monika Piazzesi & Johannes Stroebel, 2022. "Housing Market Expectations," CESifo Working Paper Series 9665, CESifo.
    8. Schnorpfeil, Philip & Weber, Michael & Hackethal, Andreas, 2023. "Households' response to the wealth effects of inflation," SAFE Working Paper Series 400, Leibniz Institute for Financial Research SAFE.
    9. Felix Chopra & Christopher Roth & Johannes Wohlfart, 2025. "Home Price Expectations and Spending: Evidence from a Field Experiment," American Economic Review, American Economic Association, vol. 115(7), pages 2267-2305, July.
    10. Tsegay Tekleselassie & Marc Witte & Jonas Radbruch & Lukas Hensel & Ingo E. Isphording, 2025. "Feedback, Confidence and Job Search Behavior," CRC TR 224 Discussion Paper Series crctr224_2025_668, University of Bonn and University of Mannheim, Germany.
    11. Bordalo, Pedro & Gennaioli, Nicola & Kwon, Spencer Yongwook & Shleifer, Andrei, 2021. "Diagnostic bubbles," Journal of Financial Economics, Elsevier, vol. 141(3), pages 1060-1077.
    12. Åkesson, Jesper & Hahn, Robert & Metcalfe, Robert & Rasooly, Itzhak, 2022. "Race and Redistribution in the United States: An Experimental Analysis," SocArXiv 9pr34, Center for Open Science.
    13. Starkov, Egor, 2023. "Only time will tell: Credible dynamic signaling," Journal of Mathematical Economics, Elsevier, vol. 109(C).
    14. Adeline Delavande & Gizem Koşar & Basit Zafar, 2025. "Information Spillovers Within Couples: Evidence from a Sequential Survey of Spouses," Staff Reports 1154, Federal Reserve Bank of New York.
    15. Ana Costa-Ramón & Ursina Schaede & Michaela Slotwinski & Anne Ardila Brenøe, 2024. "(Not) thinking about the future: inattention and maternal labor supply," ECON - Working Papers 452, Department of Economics - University of Zurich.
    16. repec:osf:socarx:9pr34_v1 is not listed on IDEAS
    17. Sarah Kiesl-Reiter & Melanie Lührmann & Jonathan Shaw & Joachim Winter, 2024. "The Formation of Subjective House Price Expectations," Rationality and Competition Discussion Paper Series 491, CRC TRR 190 Rationality and Competition.
    18. Michael E. Darden & Reginald B. Hebert & Michael F. Pesko & Samuel Sturm, 2025. "Cigarette Taxes and the Household Budget," NBER Working Papers 33746, National Bureau of Economic Research, Inc.
    19. Peter Andre, 2021. "Shallow Meritocracy: An Experiment on Fairness Views," CRC TR 224 Discussion Paper Series crctr224_2021_318v1, University of Bonn and University of Mannheim, Germany.
    20. Francesco Capozza & Ingar Haaland & Christopher Roth & Johannes Wohlfart, 2021. "Studying Information Acquisition in the Field: A Practical Guide and Review," CEBI working paper series 21-15, University of Copenhagen. Department of Economics. The Center for Economic Behavior and Inequality (CEBI).
    21. Jiao Li & Duccio Gamannossi degl'Innocenti & Matthew D. Rablen, 2023. "Marketed tax avoidance: an economic analysis," Scandinavian Journal of Economics, Wiley Blackwell, vol. 125(3), pages 753-788, July.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
    • D91 - Microeconomics - - Micro-Based Behavioral Economics - - - Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ajk:ajkdps:362. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ECONtribute Office (email available below). General contact details of provider: https://www.econtribute.de .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.