IDEAS home Printed from https://ideas.repec.org/p/ajk/ajkdps/362.html
   My bibliography  Save this paper

Understanding Economic Behavior Using Open-Ended Survey Data

Author

Listed:
  • Ingar Haaland

    (NHH Norwegian School of Economics, FAIR & CEPR)

  • Christopher Roth

    (University of Cologne, Max Planck Institute for Research on Collective Goods, CEPR & NHH Norwegian School of Economics)

  • Stefanie Stantcheva

    (Harvard University, NBER & CEPR)

  • Johannes Wohlfart

    (University of Cologne, Max Planck Institute for Research on Collective Goods, CEBI & CESifo)

Abstract

We survey the recent literature in economics using open-ended survey data to uncover mechanisms behind economic beliefs and behaviors. We first provide an overview of different applications, including the measurement of motives, mental models, narratives, attention, information transmission, and recall. We next describe different ways of eliciting open-ended responses, including single-item open-ended questions, speech recordings, and AI-powered qualitative interviews. Subsequently, we discuss methods to annotate and analyze such data with a focus on recent advances in large language models. Our review concludes with a discussion of promising avenues for future research.

Suggested Citation

  • Ingar Haaland & Christopher Roth & Stefanie Stantcheva & Johannes Wohlfart, 2025. "Understanding Economic Behavior Using Open-Ended Survey Data," ECONtribute Discussion Papers Series 362, University of Bonn and University of Cologne, Germany.
  • Handle: RePEc:ajk:ajkdps:362
    as

    Download full text from publisher

    File URL: https://www.econtribute.de/RePEc/ajk/ajkdps/ECONtribute_362_2025.pdf
    File Function: First version, 2025
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Alberto Alesina & Armando Miano & Stefanie Stantcheva, 2023. "Immigration and Redistribution," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 90(1), pages 1-39.
    2. Peter Andrebriq & Carlo Pizzinelli & Christopher Roth & Johannes Wohlfart, 2022. "Subjective Models of the Macroeconomy: Evidence From Experts and Representative Samples," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 89(6), pages 2958-2991.
    3. Abeler, Johannes & Huffman, David B. & Raymond, Collin, 2023. "Incentive Complexity, Bounded Rationality and Effort Provision," IZA Discussion Papers 16284, Institute of Labor Economics (IZA).
    4. Sarah Baird & Craig McIntosh & Berk Özler, 2011. "Cash or Condition? Evidence from a Cash Transfer Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(4), pages 1709-1753.
    5. Castagnetti, Alessandro & Schmacker, Renke, 2022. "Protecting the ego: Motivated information selection and updating," European Economic Review, Elsevier, vol. 142(C).
    6. Leonardo Bursztyn & Ingar Haaland & Aakaash Rao & Christopher Roth, 2020. "Disguising Prejudice: Popular Rationales as Excuses for Intolerant Expression," Working Papers 2020-73, Becker Friedman Institute for Research In Economics.
    7. Rob Bauer & Katrin Gödker & Paul Smeets & Florian Zimmermann, 2024. "Mental Models in Financial Markets: How Do Experts Reason about the Pricing of Climate Risk?," CESifo Working Paper Series 11149, CESifo.
    8. Romero, Mauricio & Bedoya, Juan & Yanez-Pagans, Monica & Silveyra, Marcela & de Hoyos, Rafael, 2022. "Direct vs indirect management training: Experimental evidence from schools in Mexico," Journal of Development Economics, Elsevier, vol. 154(C).
    9. Lasse J. Jessen & Sebastian Koehne & Patrick Nüß & Jens Ruhose, 2024. "Socioeconomic Inequality in Life Expectancy: Perception and Policy Demand," CESifo Working Paper Series 10940, CESifo.
    10. Karl E. Case & Robert J. Shiller & Anne K. Thompson, 2012. "What Have They Been Thinking? Homebuyer Behavior in Hot and Cold Markets," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 43(2 (Fall)), pages 265-315.
    11. Johannes Abeler & David Huffman & Colin Raymond, 2023. "Incentive Complexity, Bounded Rationality and Effort Provision," Economics Series Working Papers 1012, University of Oxford, Department of Economics.
    12. Galasso, Vincenzo & Morelli, Massimo & Nannicini, Tommaso & Stanig, Piero, 2024. "The Populist Dynamic: Experimental Evidence on the Effects of Countering Populism," IZA Discussion Papers 16796, Institute of Labor Economics (IZA).
    13. Ingar Haaland & Christopher Roth & Stefanie Stantcheva & Johannes Wohlfart, 2024. "Measuring What Is Top of Mind," ECONtribute Discussion Papers Series 298, University of Bonn and University of Cologne, Germany.
    14. Brad Nathan & Ricardo Perez-Truglia & Alejandro Zentner, 2025. "My Taxes Are Too Darn High: Why Do Households Protest Their Taxes?," American Economic Journal: Economic Policy, American Economic Association, vol. 17(1), pages 273-310, February.
    15. Anselm Hager & Lukas Hensel & Johannes Hermle & Christopher Roth, 2023. "Political Activists as Free Riders: Evidence from a Natural Field Experiment," The Economic Journal, Royal Economic Society, vol. 133(653), pages 2068-2084.
    16. Arindrajit Dube & Suresh Naidu & Adam D. Reich, 2022. "Power and Dignity in the Low-Wage Labor Market: Theory and Evidence from Wal-Mart Workers," NBER Working Papers 30441, National Bureau of Economic Research, Inc.
    17. Himelein,Kristen, 2015. "Interviewer effects in subjective survey questions: evidence from Timor-Leste," Policy Research Working Paper Series 7208, The World Bank.
    18. Garret Christensen & Edward Miguel, 2018. "Transparency, Reproducibility, and the Credibility of Economics Research," Journal of Economic Literature, American Economic Association, vol. 56(3), pages 920-980, September.
    19. Dillon, Andrew & Bardasi, Elena & Beegle, Kathleen & Serneels, Pieter, 2012. "Explaining variation in child labor statistics," Journal of Development Economics, Elsevier, vol. 98(1), pages 136-147.
    20. Bocar A. Ba & Roman Rivera & Alexander Whitefield, 2023. "Forecasting the Impact of Racial Uprisings, Market versus Stakeholders' Expectations," NBER Working Papers 31857, National Bureau of Economic Research, Inc.
    21. Rob Bauer & Katrin Gödker & Paul Smeets & Florian Zimmermann, 2024. "Mental Models in Financial Markets: How Do Experts Reason About the Pricing of Climate Change?," CRC TR 224 Discussion Paper Series crctr224_2024_569, University of Bonn and University of Mannheim, Germany.
    22. Filippini, Massimo & Leippold, Markus & Wekhof, Tobias, 2024. "Sustainable finance literacy and the determinants of sustainable investing," Journal of Banking & Finance, Elsevier, vol. 163(C).
    23. Michael Bailey & Eduardo Dávila & Theresa Kuchler & Johannes Stroebel, 2019. "House Price Beliefs And Mortgage Leverage Choice," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 86(6), pages 2403-2452.
    24. Stefanie Stantcheva, 2023. "How to Run Surveys: A Guide to Creating Your Own Identifying Variation and Revealing the Invisible," Annual Review of Economics, Annual Reviews, vol. 15(1), pages 205-234, September.
    25. Roth, Christopher & Schwardmann, Peter & Tripodi, Egon, 2024. "Misperceived effectiveness and the demand for psychotherapy," Journal of Public Economics, Elsevier, vol. 240(C).
    26. Anton Korinek, 2023. "Generative AI for Economic Research: Use Cases and Implications for Economists," Journal of Economic Literature, American Economic Association, vol. 61(4), pages 1281-1317, December.
    27. Felix Chopras & Ingar Haaland & Christopher Roth, 2024. "The Demand for News: Accuracy Concerns Versus Belief Confirmation Motives," The Economic Journal, Royal Economic Society, vol. 134(661), pages 1806-1834.
    28. An, Zidong & Binder, Carola & Sheng, Xuguang Simon, 2023. "Gas price expectations of Chinese households," Energy Economics, Elsevier, vol. 120(C).
    29. Bustos, Sebastian & Pomeranz, Dina & Suárez Serrato, Juan Carlos & Vila-Belda, José & Zucman, Gabriel, 2022. "The Race Between Tax Enforcement and Tax Planning: Evidence From a Natural Experiment in Chile," CEPR Discussion Papers 17347, C.E.P.R. Discussion Papers.
    30. Peter Bergman & Raj Chetty & Stefanie DeLuca & Nathaniel Hendren & Lawrence F. Katz & Christopher Palmer, 2024. "Creating Moves to Opportunity: Experimental Evidence on Barriers to Neighborhood Choice," American Economic Review, American Economic Association, vol. 114(5), pages 1281-1337, May.
    31. Martha A. Starr, 2014. "Qualitative And Mixed-Methods Research In Economics: Surprising Growth, Promising Future," Journal of Economic Surveys, Wiley Blackwell, vol. 28(2), pages 238-264, April.
    32. Alejandro Martínez-Marquina & Muriel Niederle & Emanuel Vespa, 2019. "Failures in Contingent Reasoning: The Role of Uncertainty," American Economic Review, American Economic Association, vol. 109(10), pages 3437-3474, October.
    33. Tiezzi, Silvia & Xiao, Erte, 2016. "Time delay, complexity and support for taxation," Journal of Environmental Economics and Management, Elsevier, vol. 77(C), pages 117-141.
    34. Dani Rodrik & Stefanie Stantcheva, 2021. "A Policy Matrix for Inclusive Prosperity," NBER Working Papers 28736, National Bureau of Economic Research, Inc.
    35. Ádám Stefkovics & Endre Sik, 2022. "What Drives Happiness? The Interviewer’s Happiness," Journal of Happiness Studies, Springer, vol. 23(6), pages 2745-2762, August.
    36. Stefanie Stantcheva, 2021. "Understanding Tax Policy: How do People Reason?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 136(4), pages 2309-2369.
    37. Erzo F. P. Luttmer & Andrew A. Samwick, 2018. "The Welfare Cost of Perceived Policy Uncertainty: Evidence from Social Security," American Economic Review, American Economic Association, vol. 108(2), pages 275-307, February.
    38. Galasso, Vincenzo & Nannicini, Tommaso & Nozza, Debora, 2024. "We Need to Talk: Audio Surveys and Information Extraction," IZA Discussion Papers 17488, Institute of Labor Economics (IZA).
    39. Roberto Colarieti & Pierfrancesco Mei & Stefanie Stantcheva, 2024. "The How and Why of Household Reactions to Income Shocks," NBER Working Papers 32191, National Bureau of Economic Research, Inc.
    40. Rema Hanna & Sendhil Mullainathan & Joshua Schwartzstein, 2014. "Learning Through Noticing: Theory and Evidence from a Field Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 129(3), pages 1311-1353.
    41. Alex Imas & Michael A. Kuhn & Vera Mironova, 2022. "Waiting to Choose: The Role of Deliberation in Intertemporal Choice," American Economic Journal: Microeconomics, American Economic Association, vol. 14(3), pages 414-440, August.
    42. Bewley, Truman F, 1995. "A Depressed Labor Market as Explained by Participants," American Economic Review, American Economic Association, vol. 85(2), pages 250-254, May.
    43. Liscow, Zachary & Fox, Edward, 2022. "The psychology of taxing capital income: Evidence from a survey experiment on the realization rule," Journal of Public Economics, Elsevier, vol. 213(C).
    44. Marina Agranov & Pietro Ortoleva, 2017. "Stochastic Choice and Preferences for Randomization," Journal of Political Economy, University of Chicago Press, vol. 125(1), pages 40-68.
    45. Lilith Burgstaller & Annabelle Doerr & Sarah Necker, 2023. "Do Household Tax Credits Increase the Demand for Legally Provided Services?," CESifo Working Paper Series 10211, CESifo.
    46. Karl E. Case & Robert J. Shiller, 2003. "Is There a Bubble in the Housing Market?," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 34(2), pages 299-362.
    47. Silvia Saccardo & Marta Serra-Garcia, 2023. "Enabling or Limiting Cognitive Flexibility? Evidence of Demand for Moral Commitment," American Economic Review, American Economic Association, vol. 113(2), pages 396-429, February.
    48. Parker, Barbara & Kozel, Valerie, 2007. "Understanding Poverty and Vulnerability in India's Uttar Pradesh and Bihar: A Q-squared Approach," World Development, Elsevier, vol. 35(2), pages 296-311, February.
    49. Alessandra Casarico & Jana Schuetz & Silke Uebelmesser, 2024. "Gender Inequality over the Life Cycle, Information Provision and Policy Preferences," CESifo Working Paper Series 10916, CESifo.
    50. Leiser, David & Drori, Shelly, 2005. "NaIve understanding of inflation," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 34(2), pages 179-198, March.
    51. Bewley, Truman, 2002. "Interviews as a valid empirical tool in economics," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 31(4), pages 343-353.
    52. Melissa Dell, 2025. "Deep Learning for Economists," Journal of Economic Literature, American Economic Association, vol. 63(1), pages 5-58, March.
    53. Zhengyang Jiang & Hongqi Liu & Cameron Peng & Hongjun Yan, 2024. "Investor Memory and Biased Beliefs: Evidence from the Field," NBER Working Papers 33226, National Bureau of Economic Research, Inc.
    54. Tobias Wekhof & Sébastien Houde, 2023. "Using narratives to infer preferences in understanding the energy efficiency gap," Nature Energy, Nature, vol. 8(9), pages 965-977, September.
    55. Benjamin Handel & Joshua Schwartzstein, 2018. "Frictions or Mental Gaps: What's Behind the Information We (Don't) Use and When Do We Care?," Journal of Economic Perspectives, American Economic Association, vol. 32(1), pages 155-178, Winter.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ingar Haaland & Christopher Roth & Stefanie Stantcheva & Johannes Wohlfart, 2024. "Measuring What Is Top of Mind," CEBI working paper series 24-10, University of Copenhagen. Department of Economics. The Center for Economic Behavior and Inequality (CEBI).
    2. Galasso, Vincenzo & Nannicini, Tommaso & Nozza, Debora, 2024. "We Need to Talk: Audio Surveys and Information Extraction," IZA Discussion Papers 17488, Institute of Labor Economics (IZA).
    3. Ingar Haaland & Christopher Roth & Johannes Wohlfart, 2023. "Designing Information Provision Experiments," Journal of Economic Literature, American Economic Association, vol. 61(1), pages 3-40, March.
    4. Andre, Peter & Schirmer, Philipp & Wohlfart, Johannes, 2023. "Mental models of the stock market," SAFE Working Paper Series 406, Leibniz Institute for Financial Research SAFE.
    5. Alice Pizzo & Christina Gravert & Jan M. Bauer & Lucia Reisch, 2025. "Carbon Taxes Crowd Out Climate Concern: Experimental Evidence from Sustainable Consumer Choices," CESifo Working Paper Series 11719, CESifo.
    6. Binetti, Alberto & Nuzzi, Francesco & Stantcheva, Stefanie, 2024. "People’s understanding of inflation," Journal of Monetary Economics, Elsevier, vol. 148(S).
    7. Theresa Kuchler & Monika Piazzesi & Johannes Stroebel, 2022. "Housing Market Expectations," CESifo Working Paper Series 9665, CESifo.
    8. Schnorpfeil, Philip & Weber, Michael & Hackethal, Andreas, 2023. "Households' response to the wealth effects of inflation," SAFE Working Paper Series 400, Leibniz Institute for Financial Research SAFE.
    9. Felix Chopra & Christopher Roth & Johannes Wohlfart, 2023. "Home Price Expectations and Spending: Evidence from a Field Experiment," CEBI working paper series 23-03, University of Copenhagen. Department of Economics. The Center for Economic Behavior and Inequality (CEBI).
    10. Tsegay Tekleselassie & Marc Witte & Jonas Radbruch & Lukas Hensel & Ingo E. Isphording, 2025. "Feedback, Confidence and Job Search Behavior," CRC TR 224 Discussion Paper Series crctr224_2025_668, University of Bonn and University of Mannheim, Germany.
    11. repec:osf:socarx:9pr34_v1 is not listed on IDEAS
    12. Starkov, Egor, 2023. "Only time will tell: Credible dynamic signaling," Journal of Mathematical Economics, Elsevier, vol. 109(C).
    13. Sarah Kiesl-Reiter & Melanie Lührmann & Jonathan Shaw & Joachim Winter, 2024. "The Formation of Subjective House Price Expectations," Rationality and Competition Discussion Paper Series 491, CRC TRR 190 Rationality and Competition.
    14. Bordalo, Pedro & Gennaioli, Nicola & Kwon, Spencer Yongwook & Shleifer, Andrei, 2021. "Diagnostic bubbles," Journal of Financial Economics, Elsevier, vol. 141(3), pages 1060-1077.
    15. Åkesson, Jesper & Hahn, Robert & Metcalfe, Robert & Rasooly, Itzhak, 2022. "Race and Redistribution in the United States: An Experimental Analysis," SocArXiv 9pr34, Center for Open Science.
    16. Michael E. Darden & Reginald B. Hebert & Michael F. Pesko & Samuel Sturm, 2025. "Cigarette Taxes and the Household Budget," NBER Working Papers 33746, National Bureau of Economic Research, Inc.
    17. Ana Costa-Ramón & Ursina Schaede & Michaela Slotwinski & Anne Ardila Brenoe, 2024. "(Not) Thinking about the Future: Inattention and Maternal Labor Supply," CESifo Working Paper Series 11359, CESifo.
    18. Peter Andre, 2021. "Shallow Meritocracy: An Experiment on Fairness Views," CRC TR 224 Discussion Paper Series crctr224_2021_318v1, University of Bonn and University of Mannheim, Germany.
    19. Francesco Capozza & Ingar Haaland & Christopher Roth & Johannes Wohlfart, 2021. "Studying Information Acquisition in the Field: A Practical Guide and Review," CEBI working paper series 21-15, University of Copenhagen. Department of Economics. The Center for Economic Behavior and Inequality (CEBI).
    20. Christopher Roth & Sonja Settele & Johannes Wohlfart, 2022. "Risk Exposure and Acquisition of Macroeconomic Information," American Economic Review: Insights, American Economic Association, vol. 4(1), pages 34-53, March.
    21. Jiao Li & Duccio Gamannossi degl'Innocenti & Matthew D. Rablen, 2023. "Marketed tax avoidance: an economic analysis," Scandinavian Journal of Economics, Wiley Blackwell, vol. 125(3), pages 753-788, July.

    More about this item

    Keywords

    Open-ended Questions; Text Data; Methodology; Surveys; Large Language Models;
    All these keywords.

    JEL classification:

    • C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
    • D91 - Microeconomics - - Micro-Based Behavioral Economics - - - Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ajk:ajkdps:362. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ECONtribute Office (email available below). General contact details of provider: https://www.econtribute.de .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.