IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2607.08706.html

Directional AI Advice: Experimental Evidence from Healthcare

Author

Listed:
  • Yuyu Chen
  • Hongbin Li
  • Lingsheng Meng
  • Xinyao Qiu
  • Qingxu Yang

Abstract

Generative AI is fast becoming the first place people turn for expert advice. The advice it provides can be directional rather than neutral, shaped in part by the choices of its designers and regulators. When clients consult AI before meeting an expert, they carry this directional advice into a relationship that once rested on the expert's judgment alone. We study its consequences in healthcare through a large-scale preregistered field experiment at a Chinese hospital, where we randomize patients' access to an AI chatbot before their outpatient visit. Examination of the conversation logs shows that the chatbot routinely cautions against the use of medications, especially Traditional Chinese Medicine and antibiotics, while issuing clean recommendations for diagnostic testing, consistent with the liability-driven guardrails encoded in AI training. This directionality propagates into clinical practice. Prescription rates decline among treated patients while diagnostic testing increases, and these effects are more pronounced among physicians who are receptive to patient input and those with more intensive prescribing styles. Beyond shifting healthcare utilization, survey results show that AI access reduces patient compliance and satisfaction, shifting the balance of authority between patients and physicians.

Suggested Citation

  • Yuyu Chen & Hongbin Li & Lingsheng Meng & Xinyao Qiu & Qingxu Yang, 2026. "Directional AI Advice: Experimental Evidence from Healthcare," Papers 2607.08706, arXiv.org.
  • Handle: RePEc:arx:papers:2607.08706
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2607.08706
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Stacey H. Chen & Jennjou Chen & Hongwei Chuang & Tzu-Hsin Lin, 2025. "Physicians Treating Physicians: Relational and Informational Advantages in Treatment and Survival," Journal of Labor Economics, University of Chicago Press, vol. 43(1), pages 15-46.
    2. Ivan Badinski & Amy Finkelstein & Matthew Gentzkow & Peter Hull, 2023. "Geographic Variation in Healthcare Utilization: The Role of Physicians," NBER Working Papers 31749, National Bureau of Economic Research, Inc.
    3. Felix Gottschalk & Wanda Mimra & Christian Waibe, 2020. "Health Services as Credence Goods: a Field Experiment," The Economic Journal, Royal Economic Society, vol. 130(629), pages 1346-1383.
    4. Conlon, John & Schwardmann, Peter, 2026. "AI Sycophancy and Decisions," CEPR Discussion Papers 21505, Centre for Economic Policy Research.
    5. Qingjun Li & Shuliang Zhao, 2023. "The Impact of Digital Economy Development on Industrial Restructuring: Evidence from China," Sustainability, MDPI, vol. 15(14), pages 1-19, July.
    6. Daniel Kessler & Mark McClellan, 1996. "Do Doctors Practice Defensive Medicine?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 111(2), pages 353-390.
    7. Janet Currie & W. Bentley MacLeod & Kate Musen, 2026. "Doctor Decision-Making and Patient Outcomes," Journal of Economic Literature, American Economic Association, vol. 64(1), pages 141-194, March.
    8. Bart J. Bronnenberg & Jean-Pierre Dubé & Matthew Gentzkow & Jesse M. Shapiro, 2015. "Do Pharmacists Buy Bayer? Informed Shoppers and the Brand Premium," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 130(4), pages 1669-1726.
    9. Daniel P. Kessler & Mark McClellan, 1996. "Do Doctors Practice Defensive Medicine?," NBER Working Papers 5466, National Bureau of Economic Research, Inc.
    10. Erin M. Johnson & M. Marit Rehavi, 2016. "Physicians Treating Physicians: Information and Incentives in Childbirth," American Economic Journal: Economic Policy, American Economic Association, vol. 8(1), pages 115-141, February.
    11. Darby, Michael R & Karni, Edi, 1973. "Free Competition and the Optimal Amount of Fraud," Journal of Law and Economics, University of Chicago Press, vol. 16(1), pages 67-88, April.
    12. John Conlon & Peter Schwardmann, 2026. "AI Sycophancy and Decisions," CESifo Working Paper Series 12681, CESifo.
    13. Ash, Elliott & Galletta, Sergio & Opocher, Giacomo, 2025. "BallotBot: Can AI Strengthen Democracy?," CEPR Discussion Papers 20070, Centre for Economic Policy Research.
    14. David Cutler & Jonathan S. Skinner & Ariel Dora Stern & David Wennberg, 2019. "Physician Beliefs and Patient Preferences: A New Look at Regional Variation in Health Care Spending," American Economic Journal: Economic Policy, American Economic Association, vol. 11(1), pages 192-221, February.
    15. Henry S. Schneider, 2012. "Agency Problems and Reputation in Expert Services: Evidence from Auto Repair," Journal of Industrial Economics, Wiley Blackwell, vol. 60(3), pages 406-433, September.
    16. Liu, Ya-Ming & Yang, Yea-Huei Kao & Hsieh, Chee-Ruey, 2009. "Financial incentives and physicians' prescription decisions on the choice between brand-name and generic drugs: Evidence from Taiwan," Journal of Health Economics, Elsevier, vol. 28(2), pages 341-349, March.
    17. Jonathan T. Kolstad, 2013. "Information and Quality When Motivation Is Intrinsic: Evidence from Surgeon Report Cards," American Economic Review, American Economic Association, vol. 103(7), pages 2875-2910, December.
    18. Loukas Balafoutas & Adrian Beck & Rudolf Kerschbamer & Matthias Sutter, 2013. "What Drives Taxi Drivers? A Field Experiment on Fraud in a Market for Credence Goods," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 80(3), pages 876-891.
    19. Yiqun Chen & Petra Persson & Maria Polyakova, 2022. "The Roots of Health Inequality and the Value of Intrafamily Expertise," American Economic Journal: Applied Economics, American Economic Association, vol. 14(3), pages 185-223, July.
    20. Eleanor W. Dillon & Sonia Jaffe & Nicole Immorlica & Christopher T. Stanton, 2025. "Shifting Work Patterns with Generative AI," NBER Working Papers 33795, National Bureau of Economic Research, Inc.
    21. Steven D. Levitt & Chad Syverson, 2008. "Market Distortions When Agents Are Better Informed: The Value of Information in Real Estate Transactions," The Review of Economics and Statistics, MIT Press, vol. 90(4), pages 599-611, November.
    22. Jonathan T. Kolstad, 2013. "Information and Quality when Motivation is Intrinsic: Evidence from Surgeon Report Cards," NBER Working Papers 18804, National Bureau of Economic Research, Inc.
    23. Elisabeth Artmann & Hessel Oosterbeek & Bas van der Klaauw, 2022. "Do Doctors Improve the Health Care of Their Parents? Evidence from Admission Lotteries," American Economic Journal: Applied Economics, American Economic Association, vol. 14(3), pages 164-184, July.
    24. Frakes, Michael & Gruber, Jonathan & Jena, Anupam, 2021. "Is great information good enough? Evidence from physicians as patients," Journal of Health Economics, Elsevier, vol. 75(C).
    25. Erik Brynjolfsson & Danielle Li & Lindsey Raymond, 2025. "Generative AI at Work," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 140(2), pages 889-942.
    26. Alberto Abadie & Susan Athey & Guido W Imbens & Jeffrey M Wooldridge, 2023. "When Should You Adjust Standard Errors for Clustering?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 138(1), pages 1-35.
    27. Yuk-Fai Fong & Ting Liu & Xiaoxuan Meng, 2022. "Trust Building in Credence Goods Markets," American Economic Journal: Microeconomics, American Economic Association, vol. 14(1), pages 490-528, February.
    28. Johanna Catherine Maclean & Justine Mallatt & Christopher J. Ruhm & Kosali Simon, 2020. "Economic Studies on the Opioid Crisis: A Review," NBER Working Papers 28067, National Bureau of Economic Research, Inc.
    29. Liu, Gordon & Yi, Junjian & Yuan, Ye & Zhao, Shaoyang, 2023. "The short- and long-run effects of medical malpractice lawsuits on medical spending and hospital operations in China," Journal of Comparative Economics, Elsevier, vol. 51(4), pages 1142-1161.
    30. Hanming Fang & Ming Li & Jia Xiang, 2025. "Fear and Risk Perception: Understanding Physicians' Dynamic Responses to Malpractice Lawsuits," NBER Working Papers 34115, National Bureau of Economic Research, Inc.
    31. Mimra, Wanda & Rasch, Alexander & Waibel, Christian, 2016. "Second opinions in markets for expert services: Experimental evidence," Journal of Economic Behavior & Organization, Elsevier, vol. 131(PB), pages 106-125.
    32. Imke Reimers & Joel Waldfogel, 2026. "AI and the Quantity and Usage of Creative Products: Have LLMs Boosted Creation of Valuable Books?," NBER Working Papers 34777, National Bureau of Economic Research, Inc.
    33. Toshiaki Iizuka, 2012. "Physician Agency and Adoption of Generic Pharmaceuticals," American Economic Review, American Economic Association, vol. 102(6), pages 2826-2858, October.
    34. Alexander Rasch & Christian Waibel, 2018. "What Drives Fraud in a Credence Goods Market? – Evidence from a Field Study," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 80(3), pages 605-624, June.
    35. Jonathan Gruber & Maria Owings, 1996. "Physician Financial Incentives and Cesarean Section Delivery," RAND Journal of Economics, The RAND Corporation, vol. 27(1), pages 99-123, Spring.
    36. Sendhil Mullainathan & Markus Noeth & Antoinette Schoar, 2012. "The Market for Financial Advice: An Audit Study," NBER Working Papers 17929, National Bureau of Economic Research, Inc.
    37. Lu, Fangwen, 2014. "Insurance coverage and agency problems in doctor prescriptions: Evidence from a field experiment in China," Journal of Development Economics, Elsevier, vol. 106(C), pages 156-167.
    38. Amy Finkelstein & Matthew Gentzkow & Heidi Williams, 2016. "Sources of Geographic Variation in Health Care: Evidence From PatientMigration," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(4), pages 1681-1726.
    39. Kerschbamer, Rudolf & Neururer, Daniel & Sutter, Matthias, 2023. "Credence goods markets, online information and repair prices: A natural field experiment," Journal of Public Economics, Elsevier, vol. 222(C).
    40. Bertomeu, Jeremy & Lin, Yupeng & Liu, Yibin & Ni, Zhenghui, 2025. "The impact of generative AI on information processing: Evidence from the ban of ChatGPT in Italy," Journal of Accounting and Economics, Elsevier, vol. 80(1).
    41. Felix Gottschalk & Wanda Mimra & Christian Waibel, 2020. "Health Services as Credence Goods: a Field Experiment," Post-Print hal-03137768, HAL.
    42. Jishnu Das & Alaka Holla & Aakash Mohpal & Karthik Muralidharan, 2016. "Quality and Accountability in Health Care Delivery: Audit-Study Evidence from Primary Care in India," American Economic Review, American Economic Association, vol. 106(12), pages 3765-3799, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Balafoutas, Loukas & Kerschbamer, Rudolf, 2020. "Credence goods in the literature: What the past fifteen years have taught us about fraud, incentives, and the role of institutions," Journal of Behavioral and Experimental Finance, Elsevier, vol. 26(C).
    2. Liu, Fang & Rasch, Alexander & Schwarz, Marco A. & Waibel, Christian, 2025. "The role of diagnostic ability in markets for expert services," European Economic Review, Elsevier, vol. 180(C).
    3. Maxime Perodaud & Michela Chessa, 2026. "Hey, what did you expect ? Confirmation bias in credence goods markets: Theoretical and experimental analyses," Post-Print hal-05441370, HAL.
    4. Parampreet Christopher Bindra & Rudolf Kerschbamer & Daniel Neururer & Matthias Sutter, 2020. "Reveal it or conceal it: On the value of second opinions in a low-entry-barriers credence goods market," Discussion Paper Series of the Max Planck Institute for Behavioral Economics 2020_11, Max Planck Institute for Behavioral Economics.
    5. Ben Greiner & Le Zhang & Chengxiang Tang, 2017. "Separation of prescription and treatment in health care markets: A laboratory experiment," Health Economics, John Wiley & Sons, Ltd., vol. 26(S3), pages 21-35, December.
    6. Angerer, Silvia & Glätzle-Rützler, Daniela & Waibel, Christian, 2023. "Framing and subject pool effects in healthcare credence goods," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 103(C).
    7. Silvia Angerer & Daniela Glätzle-Rützler & Christian Waibel, 2021. "Trust in health care credence goods: Experimental evidence on framing and subject pool effects," Working Papers 2021-13, Faculty of Economics and Statistics, Universität Innsbruck.
    8. Perodaud, Maxime & Chessa, Michela, 2026. "Hey, what did you expect ? Confirmation bias in credence goods markets: Theoretical and experimental analyses," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 120(C).
    9. Mengna Luan & Wenjing Shi & Zhigang Tao & Hongjie Yuan, 2023. "When patients have better insurance coverage in China: Provider incentives, costs, and quality of care," Economics of Transition and Institutional Change, John Wiley & Sons, vol. 31(4), pages 1073-1106, October.
    10. Bruno Lanz & Evert Reins, 2021. "Asymmetric Information on the Market for Energy Efficiency: Insights from the Credence Goods Literature," The Energy Journal, , vol. 42(4), pages 91-110, July.
    11. Lagarde, Mylène & Blaauw, Duane, 2022. "Overtreatment and benevolent provider moral hazard: Evidence from South African doctors," Journal of Development Economics, Elsevier, vol. 158(C).
    12. Iman Ahmadi, 2023. "Face/Off: The adverse effects of increased competition," Quantitative Marketing and Economics (QME), Springer, vol. 21(2), pages 183-279, June.
    13. Schneider, Tim & Meub, Lukas & Bizer, Kilian, 2021. "Consumer information in a market for expert services: Experimental evidence," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 94(C).
    14. Gerlach, Heiko & Li, Junqian, 2022. "Experts, trust and competition," Journal of Economic Behavior & Organization, Elsevier, vol. 198(C), pages 552-578.
    15. Lagarde, Mylène & Blaauw, Duane, 2022. "Overtreatment and benevolent provider moral hazard: evidence from South African doctors," LSE Research Online Documents on Economics 115383, London School of Economics and Political Science, LSE Library.
    16. Alexander Erlei & Lukas Meub, 2026. "LLM-Agent Interactions on Markets with Information Asymmetries," Papers 2603.08853, arXiv.org.
    17. Silvia Angerer & Daniela Glätzle‐Rützler & Christian Waibel, 2021. "Monitoring institutions in healthcare markets: Experimental evidence," Health Economics, John Wiley & Sons, Ltd., vol. 30(5), pages 951-971, May.
    18. Frakes, Michael & Gruber, Jonathan & Jena, Anupam, 2021. "Is great information good enough? Evidence from physicians as patients," Journal of Health Economics, Elsevier, vol. 75(C).
    19. Wu, Bingxiao, 2019. "Physician agency in China: Evidence from a drug-percentage incentive scheme," Journal of Development Economics, Elsevier, vol. 140(C), pages 72-89.
    20. Agarwal, Ritu & Liu, Che-Wei & Prasad, Kislaya, 2019. "Personal research, second opinions, and the diagnostic effort of experts," Journal of Economic Behavior & Organization, Elsevier, vol. 158(C), pages 44-61.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2607.08706. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.