IDEAS home Printed from https://ideas.repec.org/p/bis/biswps/1333.html

Generative AI for surveys on payment apps: AI views on privacy and technology

Author

Listed:
  • Koji Takahashi
  • Joon Suk Park

Abstract

This study uses ChatGPT to simulate survey responses about payment apps, focusing on privacy and perceived benefits. By designing prompts that mirror real user characteristics, the generated responses align with findings from a Dutch survey, especially when grouped by privacy concern. Privacy-concerned agents view apps less favorably, while users show more positive attitudes than non-users, even without such traits in the prompt. However, ChatGPT fails to match the real survey's response variability and tends to overstate privacy concerns. These results indicate that generative AI can complement but not replace human surveys for studying perceptions of payment tools.

Suggested Citation

  • Koji Takahashi & Joon Suk Park, 2026. "Generative AI for surveys on payment apps: AI views on privacy and technology," BIS Working Papers 1333, Bank for International Settlements.
    • Handle: RePEc:bis:biswps:1333
    as

    Download full text from publisher

    File URL: https://www.bis.org/publ/work1333.pdf
    File Function: Full PDF document
    Download Restriction: no
    File URL: https://www.bis.org/publ/work1333.htm
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jens Ludwig & Sendhil Mullainathan & Ashesh Rambachan, 2024. "Large Language Models: An Applied Econometric Framework," Papers 2412.07031, arXiv.org, revised Dec 2025.
    2. John J. Horton & Apostolos Filippas & Benjamin S. Manning, 2023. "Large Language Models as Simulated Economic Agents: What Can We Learn from Homo Silicus?," NBER Working Papers 31122, National Bureau of Economic Research, Inc.
    3. Avi Goldfarb & Verina F. Que, 2023. "The Economics of Digital Privacy," Annual Review of Economics, Annual Reviews, vol. 15(1), pages 267-286, September.
    4. Stephen C. Slota & Kenneth R. Fleischmann & Sherri Greenberg & Nitin Verma & Brenna Cummings & Lan Li & Chris Shenefiel, 2023. "Locating the work of artificial intelligence ethics," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 74(3), pages 311-322, March.
    5. ., 2023. "The artificial intelligence ecosystem," Chapters, in: The Rise of Algorithmic Society and the Strategic Role of Arts and Culture, chapter 2, pages 6-30, Edward Elgar Publishing.
    6. John J. Horton & Apostolos Filippas & Benjamin S. Manning, 2023. "Large Language Models as Simulated Economic Agents: What Can We Learn from Homo Silicus?," Papers 2301.07543, arXiv.org, revised Feb 2026.
    7. Xuemei Li & Alexander Sigov & Leonid Ratkin & Leonid A. Ivanov & Ling Li, 2023. "Artificial intelligence applications in finance: a survey," Journal of Management Analytics, Taylor & Francis Journals, vol. 10(4), pages 676-692, October.
    8. Henner Gimpel & Dominikus Kleindienst & Daniela Waldmann, 2018. "The disclosure of private data: measuring the privacy paradox in digital services," Electronic Markets, Springer;IIM University of St. Gallen, vol. 28(4), pages 475-490, November.
    9. Xiang Li & Shuo Zhang & Wei Zhang, 2023. "Applied Computing and Artificial Intelligence," Mathematics, MDPI, vol. 11(10), pages 1-4, May.
    10. Hans Brits & Nicole Jonker, 2023. "The Use of Financial Apps: Privacy Paradox or Privacy Calculus?," Working Papers 794, DNB.
    11. Li, Jiaqi, 2023. "Predicting the demand for central bank digital currency: A structural analysis with survey data," Journal of Monetary Economics, Elsevier, vol. 134(C), pages 73-85.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Koji Takahashi & Joon Suk Park, 2025. "Generative AI for Surveys on Payment Apps: AIs' View on Privacy and Technology," IMES Discussion Paper Series 25-E-13, Institute for Monetary and Economic Studies, Bank of Japan.
    2. Emanuela MIDOLO & Rosangela BARCARO, 2025. "Artificial Intelligence and Medicine in the Old Continent: How Europe is Trying to Define an Ethical Application of this New Technology," RAIS Journal for Social Sciences, Research Association for Interdisciplinary Studies, vol. 9(2), pages 424-432, November.
    3. Austin Mwange & Kampamba Clarence Chibesa & Windu Matoka & Lwando Kalaba, 2025. "An Investigation of the Impacts of Artificial Intelligence on Financial Inclusion in Developing Economies: Case of Sub-Saharan Africa," African Journal of Commercial Studies, African Journal of Commercial Studies, vol. 6(3).
    4. Deepak Mishra & Mansi Kedia & Aarti Reddy, 2026. "AI and Jobs: This time is no different," Indian Council for Research on International Economic Relations (ICRIER) Report 26-r-06, Indian Council for Research on International Economic Relations (ICRIER), New Delhi, India.
    5. Katharina Agethen & Luc Sandfort & Anja Iseke, 2026. "Are Collectivistic Leaders Necessary for Fluid Virtual Teams? A Multilevel Configurational Approach," Working Papers Dissertations 171, Paderborn University, Faculty of Business Administration and Economics.
    6. Lavaneesh Rama & Samuel Manickam & Yuvavatania Davudars & Mohd Haniff Mohd Tahir, 2026. "Exploring the Use of AI-Generated Contextual Sentences for English Vocabulary Acquisition Among Malaysian ESL Learners," International Journal of Research and Innovation in Social Science, International Journal of Research and Innovation in Social Science (IJRISS), vol. 10(1), pages 1468-1479, January.
    7. Berlinski, Elise & Morales, Jérémy & Sponem, Samuel, 2024. "Artificial imaginaries: Generative AIs as an advanced form of capitalism," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 99(C).
    8. Hongshen Sun & Juanjuan Zhang, 2025. "From Model Choice to Model Belief: Establishing a New Measure for LLM-Based Research," Papers 2512.23184, arXiv.org.
    9. Hui Chen & Antoine Didisheim & Mohammad & Pourmohammadi & Luciano Somoza & Hanqing Tian, 2025. "A Financial Brain Scan of the LLM," Papers 2508.21285, arXiv.org, revised Feb 2026.
    10. Didisheim, Antoine & Fraschini, Martina & Somoza, Luciano, 2025. "AI’s predictable memory in financial analysis," Economics Letters, Elsevier, vol. 256(C).
    11. Jiang, Yirui & Tran, Trung Hieu & Williams, Leon, 2023. "Machine learning and mixed reality for smart aviation: Applications and challenges," Journal of Air Transport Management, Elsevier, vol. 111(C).
    12. Agur, Itai & Ari, Anil & Dell’Ariccia, Giovanni, 2025. "Bank competition and household privacy in a digital payment monopoly," Journal of Financial Economics, Elsevier, vol. 166(C).
    13. Giuseppe Matera, 2025. "Corporate Earnings Calls and Analyst Beliefs," Papers 2511.15214, arXiv.org, revised Nov 2025.
    14. Wayne Gao & Sukjin Han & Annie Liang, 2026. "How Well Do LLMs Predict Human Behavior? A Measure of their Pretrained Knowledge," Papers 2601.12343, arXiv.org.
    15. Nikoleta Anesti & Edward Hill & Andreas Joseph, 2025. "Inflation Attitudes of Large Language Models," Papers 2512.14306, arXiv.org.
    16. Iñaki Aldasoro & Ajit Desai, 2025. "Money Talks: AI Agents for Cash Management in Payment Systems," Staff Working Papers 25-35, Bank of Canada.
    17. Kevin Leyton-Brown & Paul Milgrom & Neil Newman & Ilya Segal, 2024. "Artificial Intelligence and Market Design: Lessons Learned from Radio Spectrum Reallocation," NBER Chapters, in: New Directions in Market Design, pages 119-151, National Bureau of Economic Research, Inc.
    18. C. Monica Capra & Thomas J. Kniesner, 2025. "Daniel Kahneman’s underappreciated last published paper: Empirical implications for benefit-cost analysis and a chat session discussion with bots," Journal of Risk and Uncertainty, Springer, vol. 71(1), pages 29-51, August.
    19. Kirshner, Samuel N., 2024. "GPT and CLT: The impact of ChatGPT's level of abstraction on consumer recommendations," Journal of Retailing and Consumer Services, Elsevier, vol. 76(C).
    20. Shu Wang & Zijun Yao & Shuhuai Zhang & Jianuo Gai & Tracy Xiao Liu & Songfa Zhong, 2025. "When Experimental Economics Meets Large Language Models: Evidence-based Tactics," Papers 2505.21371, arXiv.org, revised Jul 2025.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • M31 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Marketing and Advertising - - - Marketing
    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods
    • C45 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Neural Networks and Related Topics
    • D12 - Microeconomics - - Household Behavior - - - Consumer Economics: Empirical Analysis
    • L86 - Industrial Organization - - Industry Studies: Services - - - Information and Internet Services; Computer Software

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bis:biswps:1333. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Martin Fessler (email available below). General contact details of provider: https://edirc.repec.org/data/bisssch.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.