IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2608.11371.html

Do People Follow AI Advice? Evidence from a Pension Portfolio Choice Experiment

Author

Listed:
  • Hongseok Choi
  • Jeongbin Kim
  • Matthew Kovach
  • Kyu-Min Lee
  • Euncheol Shin
  • Hector Tzavellas

Abstract

We study how differences in AI-generated financial recommendations are transmitted into individual portfolio choices. In an experiment with 400 employed adults enrolled in workplace defined contribution pension plans in South Korea, participants allocate a hypothetical pension balance across eleven products and may revise it after receiving one of two fixed AI-generated recommendations. A $2 \times 2$ design randomizes recommendation content and whether the recommendation includes a short rationale. Approximately 37$\%$ of the experimentally induced difference between the aggressive and conservative recommendations passes through to final portfolios. This causal contrast changes expected portfolio return, volatility, allocations across risk grades, and the number of products held, but produces no detectable difference in computed Sharpe ratios. 81$\%$ of participants revise. Among revisers, 95$\%$ move toward the assigned recommendation and implement about half of the suggested adjustment. Rationales do not detectably alter pass-through. These results show that users partially and selectively transmit recommendation content into economically meaningful differences in risk exposure while retaining substantial weight on their initial choices.

Suggested Citation

  • Hongseok Choi & Jeongbin Kim & Matthew Kovach & Kyu-Min Lee & Euncheol Shin & Hector Tzavellas, 2026. "Do People Follow AI Advice? Evidence from a Pension Portfolio Choice Experiment," Papers 2608.11371, arXiv.org.
  • Handle: RePEc:arx:papers:2608.11371
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2608.11371
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Milo Bianchi & Marie Brière, 2026. "Human-Robot Interactions in Investment Decisions," Management Science, INFORMS, vol. 72(1), pages 14-31, January.
    2. Utpal Bhattacharya & Andreas Hackethal & Simon Kaesler & Benjamin Loos & Steffen Meyer, 2012. "Is Unbiased Financial Advice to Retail Investors Sufficient? Answers from a Large Field Study," The Review of Financial Studies, Society for Financial Studies, vol. 25(4), pages 975-1032.
    3. Terrance Odean., 1996. "Volume, Volatility, Price and Profit When All Trader Are Above Average," Research Program in Finance Working Papers RPF-266, University of California at Berkeley.
    4. SeEun Jung & Sang-Hyun Kim, 2022. "Understanding Precautionary Behavior in the Time of COVID-19 (Covid-19 Special Issue)," Korean Economic Review, Korean Economic Association, vol. 38, pages 251-283.
    5. Shane Frederick, 2005. "Cognitive Reflection and Decision Making," Journal of Economic Perspectives, American Economic Association, vol. 19(4), pages 25-42, Fall.
    6. Niszczota, Paweł & Abbas, Sami, 2023. "GPT has become financially literate: Insights from financial literacy tests of GPT and a preliminary test of how people use it as a source of advice," Finance Research Letters, Elsevier, vol. 58(PA).
    7. Rossi, Alberto G. & Utkus, Stephen, 2024. "The diversification and welfare effects of robo-advising," Journal of Financial Economics, Elsevier, vol. 157(C).
    8. Kevin Bauer & Moritz von Zahn & Oliver Hinz, 2023. "Expl(AI)ned: The Impact of Explainable Artificial Intelligence on Users’ Information Processing," Information Systems Research, INFORMS, vol. 34(4), pages 1582-1602, December.
    9. Maya Balakrishnan & Kris Johnson Ferreira & Jordan Tong, 2026. "Human-Algorithm Collaboration with Private Information: Naïve Advice-Weighting Behavior and Mitigation," Management Science, INFORMS, vol. 72(1), pages 265-284, January.
    10. Jeongbin Kim & Matthew Kovach & Kyu-Min Lee & Euncheol Shin & Hector Tzavellas, 2024. "Can an LLM Learn Preferences from Choice Data?," Papers 2401.07345, arXiv.org, revised Apr 2026.
    11. Cathy (Liu) Yang & Kevin Bauer & Xitong Li & Oliver Hinz, 2026. "My Advisor, Her AI, and Me: Evidence from a Field Experiment on Human–AI Collaboration and Investment Decisions," Management Science, INFORMS, vol. 72(1), pages 242-264, January.
    12. Felipe Caro & Jean-Edouard Colliard & Elena Katok & Axel Ockenfels & Nicolas Stier-Moses & Catherine Tucker & D. J. Wu, 2026. "Introduction to the Special Issue on the Human-Algorithm Connection," Management Science, INFORMS, vol. 72(1), pages 1-13, January.
    13. Stephen Foerster & Juhani T. Linnainmaa & Brian T. Melzer & Alessandro Previtero, 2017. "Retail Financial Advice: Does One Size Fit All?," Journal of Finance, American Finance Association, vol. 72(4), pages 1441-1482, August.
    14. Reher, Michael & Sokolinski, Stanislav, 2024. "Robo advisors and access to wealth management," Journal of Financial Economics, Elsevier, vol. 155(C).
    15. Laurent E. Calvet & John Y. Campbell & Paolo Sodini, 2007. "Down or Out: Assessing the Welfare Costs of Household Investment Mistakes," Journal of Political Economy, University of Chicago Press, vol. 115(5), pages 707-747, October.
    16. Milo Bianchi & Marie Brière, 2026. "Human-Robot Interactions in Investment Decisions," Post-Print hal-05492345, HAL.
    17. Chao, Matthew & Shin, Euncheol, 2026. "Culture-specific social constructs and their implications for cross-cultural experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 245(C).
    18. Brigitte C. Madrian & Dennis F. Shea, 2001. "The Power of Suggestion: Inertia in 401(k) Participation and Savings Behavior," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(4), pages 1149-1187.
    19. repec:bla:jfinan:v:53:y:1998:i:6:p:1887-1934 is not listed on IDEAS
    20. Berkeley J. Dietvorst & Joseph P. Simmons & Cade Massey, 2018. "Overcoming Algorithm Aversion: People Will Use Imperfect Algorithms If They Can (Even Slightly) Modify Them," Management Science, INFORMS, vol. 64(3), pages 1155-1170, March.
    21. Pietro Ortoleva & Erik Snowberg, 2015. "Overconfidence in Political Behavior," American Economic Review, American Economic Association, vol. 105(2), pages 504-535, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gaudeul, Alexia & Giannetti, Caterina, 2025. "Beyond Performance: Exploring trade-offs in the design of financial algorithms," Journal of Behavioral and Experimental Finance, Elsevier, vol. 48(C).
    2. Alexia GAUDEUL & Caterina GIANNETTI, 2023. "Trade-offs in the design of financial algorithms," Discussion Papers 2023/288, Dipartimento di Economia e Management (DEM), University of Pisa, Pisa, Italy.
    3. Zhi Da & Borja Larrain & Clemens Sialm & José Tessada, 2016. "Coordinated Noise Trading: Evidence from Pension Fund Reallocations," NBER Working Papers 22161, National Bureau of Economic Research, Inc.
    4. Christian Fieberg & Lars Hornuf & Maximilian Meiler & David J. Streich, 2025. "Using Large Language Models for Financial Advice," CESifo Working Paper Series 11666, CESifo.
    5. Edelen, Roger M. & Fong, Kingsley Y.L. & Han, Jingyi, 2025. "Regulating inattention in fee-based financial advice," Journal of Financial Economics, Elsevier, vol. 164(C).
    6. Irina Gemmo & Pierre-Carl Michaud & Olivia S. Mitchell, 2023. "Selection into Financial Education and Effects on Portfolio Choice," NBER Working Papers 31682, National Bureau of Economic Research, Inc.
    7. Francisco Gomes & Michael Haliassos & Tarun Ramadorai, 2021. "Household Finance," Journal of Economic Literature, American Economic Association, vol. 59(3), pages 919-1000, September.
    8. Baeckström, Ylva & Tosun, Onur Kemal & Riefler, Raul, 2024. "Wealth as a moderating effect on gender differences in portfolio holdings," Global Finance Journal, Elsevier, vol. 60(C).
    9. Wang, Chenhao & Zhang, Ting & Zhu, Shanyi, 2026. "Big data recommendations and portfolio diversification: evidence from account-level data," Finance Research Letters, Elsevier, vol. 92(C).
    10. Cristian Badarinza & John Y. Campbell & Tarun Ramadorai, 2016. "International Comparative Household Finance," Annual Review of Economics, Annual Reviews, vol. 8(1), pages 111-144, October.
    11. John Y. Campbell, 2016. "Restoring Rational Choice: The Challenge of Consumer Financial Regulation," American Economic Review, American Economic Association, vol. 106(5), pages 1-30, May.
    12. Joshua Greubel & Henrik Guhling & Fabian Herweg, 2026. "AI Persuasion and Financial-Decision Making: Experimental Evidence on Dominated Investment Choices," CESifo Working Paper Series 12925, CESifo.
    13. Baeckström, Ylva & Marsh, Ian W. & Silvester, Joanne, 2021. "Variations in investment advice provision: A study of financial advisors of millionaire investors," Journal of Economic Behavior & Organization, Elsevier, vol. 188(C), pages 716-735.
    14. Bannier, Christina E. & Neubert, Milena, 2016. "Actual and perceived financial sophistication and wealth accumulation: The role of education and gender," CFS Working Paper Series 528, Center for Financial Studies (CFS).
    15. Boni, Leslie, 2025. "Green-curious retail investors and unmediated interactions with GenAI," Finance Research Letters, Elsevier, vol. 86(PE).
    16. Nourallah, Mustafa & Öhman, Peter & Walther, Thomas & Nguyen, Duc Khuong, 2026. "Financial robo-advisors: A scoping review and future research directions," Journal of Behavioral and Experimental Finance, Elsevier, vol. 49(C).
    17. de Bruin, Boudewijn & Cherednychenko, Olha & Hermes, Niels & Kramer, Marc & Meyer, Marco, 2024. "Demand for financial advice: Evidence from a randomized choice experiment," Journal of Banking & Finance, Elsevier, vol. 163(C).
    18. Chalmers, John & Reuter, Jonathan, 2020. "Is conflicted investment advice better than no advice?," Journal of Financial Economics, Elsevier, vol. 138(2), pages 366-387.
    19. Guiso, Luigi & Pozzi, Andrea & Tsoy, Anton & Gambacorta, Leonardo & Mistrulli, Paolo Emilio, 2022. "The cost of steering in financial markets: Evidence from the mortgage market," Journal of Financial Economics, Elsevier, vol. 143(3), pages 1209-1226.
    20. Kaawach, Said & Kowalewski, Oskar & Talavera, Oleksandr, 2024. "Automatic versus manual investing: Role of past performance," Journal of Financial Stability, Elsevier, vol. 74(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2608.11371. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.