IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2502.14708.html

Human Misperception of Generative-AI Alignment: A Laboratory Experiment

Author

Listed:
  • Kevin He
  • Ran Shorrer
  • Mengjia Xia

Abstract

We conduct an incentivized laboratory experiment to study people's perception of generative artificial intelligence (GenAI) alignment in the context of economic decision-making. Using a panel of economic problems spanning the domains of risk, time preference, social preference, and strategic interactions, we ask human subjects to make choices for themselves and to predict the choices made by GenAI on behalf of a human user. We find that people overestimate the degree of alignment between GenAI and human choices. In every problem, human subjects' average prediction about GenAI's choice is substantially closer to the average human-subject choice than it is to the GenAI choice. At the individual level, different subjects' predictions about GenAI's choice in a given problem are highly correlated with their own choices in the same problem. We explore the implications of people overestimating GenAI alignment in a simple theoretical model.

Suggested Citation

  • Kevin He & Ran Shorrer & Mengjia Xia, 2025. "Human Misperception of Generative-AI Alignment: A Laboratory Experiment," Papers 2502.14708, arXiv.org, revised Apr 2026.
    • Handle: RePEc:arx:papers:2502.14708
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2502.14708
    File Function: Latest version
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Sendhil Mullainathan & Joshua Schwartzstein & Andrei Shleifer, 2008. "Coarse Thinking and Persuasion," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 123(2), pages 577-619.
    2. Benjamin Enke, 2020. "What You See Is All There Is," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 135(3), pages 1363-1398.
    3. Benjamin S. Manning & Kehang Zhu & John J. Horton, 2024. "Automated Social Science: Language Models as Scientist and Subjects," NBER Working Papers 32381, National Bureau of Economic Research, Inc.
    4. Uri Gneezy & Jan Potters, 1997. "An Experiment on Risk Taking and Evaluation Periods," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 112(2), pages 631-645.
    5. Ashesh Rambachan & Jon Kleinberg & Sendhil Mullainathan & Jens Ludwig, 2020. "An Economic Approach to Regulating Algorithms," NBER Working Papers 27111, National Bureau of Economic Research, Inc.
    6. Benjamin S. Manning & Kehang Zhu & John J. Horton, 2024. "Automated Social Science: Language Models as Scientist and Subjects," Papers 2404.11794, arXiv.org, revised Apr 2024.
    7. Benjamin Bushong & Tristan Gagnon-Bartsch, 2024. "Failures in Forecasting: An Experiment on Interpersonal Projection Bias," Management Science, INFORMS, vol. 70(12), pages 8735-8752, December.
    8. Ignacio Esponda & Emanuel Vespa & Sevgi Yuksel, 2024. "Mental Models and Learning: The Case of Base-Rate Neglect," American Economic Review, American Economic Association, vol. 114(3), pages 752-782, March.
    9. Tristan Gagnon-Bartsch & Marco Pagnozzi & Antonio Rosato, 2021. "Projection of Private Values in Auctions," American Economic Review, American Economic Association, vol. 111(10), pages 3256-3298, October.
    10. Martino Banchio & Andrzej Skrzypacz, 2022. "Artificial Intelligence and Auction Design," NBER Chapters, in: Economics of Artificial Intelligence, National Bureau of Economic Research, Inc.
    11. Kaufmann, Marc, 2022. "Projection bias in effort choices," Games and Economic Behavior, Elsevier, vol. 135(C), pages 368-393.
    12. Nicole Immorlica & Brendan Lucier & Aleksandrs Slivkins, 2024. "Generative AI as Economic Agents," Papers 2406.00477, arXiv.org.
    13. George Loewenstein & Ted O'Donoghue & Matthew Rabin, 2003. "Projection Bias in Predicting Future Utility," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(4), pages 1209-1248.
    14. Madarász, Kristóf & Danz, David & Wang, Stephanie, 2018. "The Biases of Others: Projection Equilibrium in an Agency Setting," CEPR Discussion Papers 12867, C.E.P.R. Discussion Papers.
    15. Matteo Tranchero & Cecil-Francis Brenninkmeijer & Arul Murugan & Abhishek Nagaraj, 2024. "Theorizing with Large Language Models," NBER Working Papers 33033, National Bureau of Economic Research, Inc.
    16. Michael Conlin & Ted O'Donoghue & Timothy J. Vogelsang, 2007. "Projection Bias in Catalog Orders," American Economic Review, American Economic Association, vol. 97(4), pages 1217-1249, September.
    17. Michael Woodford, 2020. "Modeling Imprecision in Perception, Valuation, and Choice," Annual Review of Economics, Annual Reviews, vol. 12(1), pages 579-601, August.
    18. Erik Brynjolfsson & Danielle Li & Lindsey Raymond, 2025. "Generative AI at Work," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 140(2), pages 889-942.
    19. Erik Snowberg & Leeat Yariv, 2021. "Testing the Waters: Behavior across Participant Pools," American Economic Review, American Economic Association, vol. 111(2), pages 687-719, February.
    20. Pelster, Matthias & Val, Joel, 2024. "Can ChatGPT assist in picking stocks?," Finance Research Letters, Elsevier, vol. 59(C).
    21. Ko, Hyungjin & Lee, Jaewook, 2024. "Can ChatGPT improve investment decisions? From a portfolio management perspective," Finance Research Letters, Elsevier, vol. 64(C).
    22. Tristan Gagnon-Bartsch & Antonio Rosato, 2024. "Quality Is in the Eye of the Beholder: Taste Projection in Markets with Observational Learning," American Economic Review, American Economic Association, vol. 114(11), pages 3746-3787, November.
    23. Benjamin Enke & Florian Zimmermann, 2019. "Correlation Neglect in Belief Formation," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 86(1), pages 313-332.
    24. Andrew Caplin, 2016. "Measuring and Modeling Attention," Annual Review of Economics, Annual Reviews, vol. 8(1), pages 379-403, October.
    25. Pedro Bordalo & Nicola Gennaioli & Andrei Shleifer, 2012. "Salience Theory of Choice Under Risk," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 127(3), pages 1243-1285.
    26. Alex Rees-Jones & Ran Shorrer & Chloe Tergiman, 2024. "Correlation Neglect in Student-to-School Matching," American Economic Journal: Microeconomics, American Economic Association, vol. 16(3), pages 1-42, August.
    27. John J. Horton & Apostolos Filippas & Benjamin S. Manning, 2023. "Large Language Models as Simulated Economic Agents: What Can We Learn from Homo Silicus?," NBER Working Papers 31122, National Bureau of Economic Research, Inc.
    28. Alex Imas & Minah H. Jung & Silvia Saccardo & Joachim Vosgerau, 2022. "The Impact of Joint versus Separate Prediction Mode on Forecasting Accuracy," NBER Working Papers 30611, National Bureau of Economic Research, Inc.
    29. Chad Kendall & Ryan Oprea, 2024. "On the complexity of forming mental models," Quantitative Economics, Econometric Society, vol. 15(1), pages 175-211, January.
    30. John J. Horton & Apostolos Filippas & Benjamin S. Manning, 2023. "Large Language Models as Simulated Economic Agents: What Can We Learn from Homo Silicus?," Papers 2301.07543, arXiv.org, revised Feb 2026.
    31. Jon Kleinberg & Himabindu Lakkaraju & Jure Leskovec & Jens Ludwig & Sendhil Mullainathan, 2018. "Human Decisions and Machine Predictions," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(1), pages 237-293.
    32. Rema Hanna & Sendhil Mullainathan & Joshua Schwartzstein, 2014. "Learning Through Noticing: Theory and Evidence from a Field Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 129(3), pages 1311-1353.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Matthew O. Jackson & Qiaozhu Me & Stephanie W. Wang & Yutong Xie & Walter Yuan & Seth Benzell & Erik Brynjolfsson & Colin F. Camerer & James Evans & Brian Jabarian & Jon Kleinberg & Juanjuan Meng & Se, 2025. "AI Behavioral Science," Papers 2509.13323, arXiv.org.
    2. Xavier Gabaix, 2017. "Behavioral Inattention," NBER Working Papers 24096, National Bureau of Economic Research, Inc.
    3. Sugat Chaturvedi & Rochana Chaturvedi, 2025. "Who Gets the Callback? Generative AI and Gender Bias," Papers 2504.21400, arXiv.org.
    4. Didisheim, Antoine & Fraschini, Martina & Somoza, Luciano, 2025. "AI’s predictable memory in financial analysis," Economics Letters, Elsevier, vol. 256(C).
    5. Niederle, Muriel & Vespa, Emanuel, 2023. "Cognitive Limitations: Failures of Contingent Thinking," University of California at San Diego, Economics Working Paper Series qt5q14p1np, Department of Economics, UC San Diego.
    6. Alexander Erlei, 2025. "From Digital Distrust to Codified Honesty: Experimental Evidence on Generative AI in Credence Goods Markets," Papers 2509.06069, arXiv.org.
    7. Alejandro Lopez-Lira & Yuehua Tang & Mingyin Zhu, 2025. "The Memorization Problem: Can We Trust LLMs' Economic Forecasts?," Papers 2504.14765, arXiv.org, revised Dec 2025.
    8. Giuseppe Matera, 2025. "Corporate Earnings Calls and Analyst Beliefs," Papers 2511.15214, arXiv.org, revised Nov 2025.
    9. Wayne Gao & Sukjin Han & Annie Liang, 2026. "How Well Do LLMs Predict Human Behavior? A Measure of their Pretrained Knowledge," Papers 2601.12343, arXiv.org.
    10. Alejandro Lopez-Lira, 2025. "Can Large Language Models Trade? Testing Financial Theories with LLM Agents in Market Simulations," Papers 2504.10789, arXiv.org.
    11. Felipe A. Csaszar & Harsh Ketkar & Hyunjin Kim, 2024. "Artificial Intelligence and Strategic Decision-Making: Evidence from Entrepreneurs and Investors," Papers 2408.08811, arXiv.org.
    12. Benjamin S. Manning & John J. Horton, 2025. "General Social Agents," Papers 2508.17407, arXiv.org, revised Mar 2026.
    13. Gary Charness & Brian Jabarian & John A. List, 2023. "Generation Next: Experimentation with AI," NBER Working Papers 31679, National Bureau of Economic Research, Inc.
    14. Pedro Bordalo & John J. Conlon & Nicola Gennaioli & Spencer Yongwook Kwon & Andrei Shleifer, 2023. "How People Use Statistics," NBER Working Papers 31631, National Bureau of Economic Research, Inc.
      • Pedro Bordalo & John Conlon & Nicola Gennaioli & Spencer Kwon & Andrei Shleifer, 2023. "How People Use Statistics," Working Papers 699, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    15. George Loewenstein & Zachary Wojtowicz, 2023. "The Economics of Attention," CESifo Working Paper Series 10712, CESifo.
    16. Nikoleta Anesti & Edward Hill & Andreas Joseph, 2025. "Inflation Attitudes of Large Language Models," Papers 2512.14306, arXiv.org.
    17. Zara Contractor & Germ'an Reyes, 2025. "Generative AI in Higher Education: Evidence from an Elite College," Papers 2508.00717, arXiv.org.
    18. Zara Contractor & Germán Reyes, 2025. "Generative AI in Higher Education: Evidence from an Elite College," CEDLAS, Working Papers 0359, CEDLAS, Universidad Nacional de La Plata.
    19. Bonan, Jacopo & Cattaneo, Cristina & d’Adda, Giovanna & Tavoni, Massimo, 2024. "Heat of the Moment: How Temperature Influences the Search and Purchase of Energy-Using Appliances," Journal of Economic Behavior & Organization, Elsevier, vol. 227(C).
    20. Cardella, Eric & Ewing, Bradley T. & Williams, Ryan B., 2017. "Price volatility and residential electricity decisions: Experimental evidence on the convergence of energy generating source," Energy Economics, Elsevier, vol. 62(C), pages 428-437.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2502.14708. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.