IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2509.06069.html
   My bibliography  Save this paper

From Digital Distrust to Codified Honesty: Experimental Evidence on Generative AI in Credence Goods Markets

Author

Listed:
  • Alexander Erlei

Abstract

Generative AI is transforming the provision of expert services. This article uses a series of one-shot experiments to quantify the behavioral, welfare and distribution consequences of large language models (LLMs) on AI-AI, Human-Human, Human-AI and Human-AI-Human expert markets. Using a credence goods framework where experts have private information about the optimal service for consumers, we find that Human-Human markets generally achieve higher levels of efficiency than AI-AI and Human-AI markets through pro-social expert preferences and higher consumer trust. Notably, LLM experts still earn substantially higher surplus than human experts -- at the expense of consumer surplus - suggesting adverse incentives that may spur the harmful deployment of LLMs. Concurrently, a majority of human experts chooses to rely on LLM agents when given the opportunity in Human-AI-Human markets, especially if they have agency over the LLM's (social) objective function. Here, a large share of experts prioritizes efficiency-loving preferences over pure self-interest. Disclosing these preferences to consumers induces strong efficiency gains by marginalizing self-interested LLM experts and human experts. Consequently, Human-AI-Human markets outperform Human-Human markets under transparency rules. With obfuscation, however, efficiency gains disappear, and adverse expert incentives remain. Our results shed light on the potential opportunities and risks of disseminating LLMs in the context of expert services and raise several regulatory challenges. On the one hand, LLMs can negatively affect human trust in the presence of information asymmetries and partially crowd-out experts' other-regarding preferences through automation. On the other hand, LLMs allow experts to codify and communicate their objective function, which reduces information asymmetries and increases efficiency.

Suggested Citation

  • Alexander Erlei, 2025. "From Digital Distrust to Codified Honesty: Experimental Evidence on Generative AI in Credence Goods Markets," Papers 2509.06069, arXiv.org.
  • Handle: RePEc:arx:papers:2509.06069
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2509.06069
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Brosig-Koch, Jeannette & Hennig-Schmidt, Heike & Kairies-Schwarz, Nadja & Wiesen, Daniel, 2016. "Using artefactual field and lab experiments to investigate how fee-for-service and capitation affect medical service provision," Journal of Economic Behavior & Organization, Elsevier, vol. 131(PB), pages 17-23.
    2. Roman Inderst & Kiryl Khalmetski & Axel Ockenfels, 2019. "Sharing Guilt: How Better Access to Information May Backfire," Management Science, INFORMS, vol. 65(7), pages 3322-3336, July.
    3. Balafoutas, Loukas & Kerschbamer, Rudolf, 2020. "Credence goods in the literature: What the past fifteen years have taught us about fraud, incentives, and the role of institutions," Journal of Behavioral and Experimental Finance, Elsevier, vol. 26(C).
    4. Benjamin S. Manning & Kehang Zhu & John J. Horton, 2024. "Automated Social Science: Language Models as Scientist and Subjects," Papers 2404.11794, arXiv.org, revised Apr 2024.
    5. Loukas Balafoutas & Adrian Beck & Rudolf Kerschbamer & Matthias Sutter, 2014. "The Hidden Costs of Tax Evasion - Collaborative Tax Evasion in Markets for Expert Services," Working Papers 2014-01, Faculty of Economics and Statistics, Universität Innsbruck.
    6. John J. Horton, 2023. "Large Language Models as Simulated Economic Agents: What Can We Learn from Homo Silicus?," NBER Working Papers 31122, National Bureau of Economic Research, Inc.
    7. Lu, Fangwen, 2014. "Insurance coverage and agency problems in doctor prescriptions: Evidence from a field experiment in China," Journal of Development Economics, Elsevier, vol. 106(C), pages 156-167.
    8. Henry S. Schneider, 2012. "Agency Problems and Reputation in Expert Services: Evidence from Auto Repair," Journal of Industrial Economics, Wiley Blackwell, vol. 60(3), pages 406-433, September.
    9. Schneider, Tim & Meub, Lukas & Bizer, Kilian, 2021. "Consumer information in a market for expert services: Experimental evidence," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 94(C).
    10. Green, Ellen P. & Kloosterman, Andrew, 2022. "Agent sorting by incentive systems in mission firms: Implications for healthcare and other credence goods markets," Journal of Economic Behavior & Organization, Elsevier, vol. 200(C), pages 408-429.
    11. M. Kate Bundorf & Maria Polyakova & Ming Tai-Seale, 2024. "How Do Consumers Interact with Digital Expert Advice? Experimental Evidence from Health Insurance," Management Science, INFORMS, vol. 70(11), pages 7617-7643, November.
    12. John J. Horton, 2023. "Large Language Models as Simulated Economic Agents: What Can We Learn from Homo Silicus?," Papers 2301.07543, arXiv.org.
    13. Chugunova, Marina & Sele, Daniela, 2022. "We and It: An interdisciplinary review of the experimental evidence on how humans interact with machines," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 99(C).
    14. Benjamin S. Manning & Kehang Zhu & John J. Horton, 2024. "Automated Social Science: Language Models as Scientist and Subjects," NBER Working Papers 32381, National Bureau of Economic Research, Inc.
    15. Kerschbamer, Rudolf & Neururer, Daniel & Sutter, Matthias, 2023. "Credence goods markets, online information and repair prices: A natural field experiment," Journal of Public Economics, Elsevier, vol. 222(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Loukas Balafoutas & Helena Fornwagner & Rudolf Kerschbamer & Matthias Sutter & Maryna Tverdostup, 2020. "Diagnostic Uncertainty and Insurance Coverage in Credence Goods Markets," Working Papers 2020-21, Faculty of Economics and Statistics, Universität Innsbruck.
    2. Meub, Lukas & Reher, Leonie & Erlei, Alexander & Beuchel, Sebastian, 2025. "Handwerk als Vertrauensgut - ein theoretischer Rahmen zur experimentellen Forschung," ifh Forschungsberichte 31, Volkswirtschaftliches Institut für Mittelstand und Handwerk an der Universität Göttingen (ifh).
    3. Balafoutas & Helena Fornwagner & Rudolf Kerschbamer & Matthias Sutter & Maryna Tverdostup, 2023. "Serving consumers in an uncertain world: A credence goods experiment," Discussion Paper Series of the Max Planck Institute for Research on Collective Goods 2023_11, Max Planck Institute for Research on Collective Goods.
    4. Matthew O. Jackson & Qiaozhu Me & Stephanie W. Wang & Yutong Xie & Walter Yuan & Seth Benzell & Erik Brynjolfsson & Colin F. Camerer & James Evans & Brian Jabarian & Jon Kleinberg & Juanjuan Meng & Se, 2025. "AI Behavioral Science," Papers 2509.13323, arXiv.org.
    5. Balafoutas, Loukas & Kerschbamer, Rudolf, 2020. "Credence goods in the literature: What the past fifteen years have taught us about fraud, incentives, and the role of institutions," Journal of Behavioral and Experimental Finance, Elsevier, vol. 26(C).
    6. Sugat Chaturvedi & Rochana Chaturvedi, 2025. "Who Gets the Callback? Generative AI and Gender Bias," Papers 2504.21400, arXiv.org.
    7. Alejandro Lopez-Lira & Yuehua Tang & Mingyin Zhu, 2025. "The Memorization Problem: Can We Trust LLMs' Economic Forecasts?," Papers 2504.14765, arXiv.org.
    8. Alejandro Lopez-Lira, 2025. "Can Large Language Models Trade? Testing Financial Theories with LLM Agents in Market Simulations," Papers 2504.10789, arXiv.org.
    9. Kevin He & Ran Shorrer & Mengjia Xia, 2025. "Human Misperception of Generative-AI Alignment:A Laboratory Experiment," PIER Working Paper Archive 25-019, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    10. Felipe A. Csaszar & Harsh Ketkar & Hyunjin Kim, 2024. "Artificial Intelligence and Strategic Decision-Making: Evidence from Entrepreneurs and Investors," Papers 2408.08811, arXiv.org.
    11. Benjamin S. Manning & John J. Horton, 2025. "General Social Agents," Papers 2508.17407, arXiv.org, revised Sep 2025.
    12. Angerer, Silvia & Glätzle-Rützler, Daniela & Waibel, Christian, 2023. "Framing and subject pool effects in healthcare credence goods," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 103(C).
    13. Silvia Angerer & Daniela Glätzle-Rützler & Christian Waibel, 2021. "Trust in health care credence goods: Experimental evidence on framing and subject pool effects," Working Papers 2021-13, Faculty of Economics and Statistics, Universität Innsbruck.
    14. Ge, Ge & Cheo, Roland & Liu, Rugang & Wang, Jian & Wang, Qiqi, 2023. "Physician beneficence and profit-taking among private for profit clinics in China: A field study using a mystery shopper audit," HERO Online Working Paper Series 2023:6, University of Oslo, Health Economics Research Programme.
    15. Cao, Yiran & Chen, Yongmin & Ding, Yucheng & Zhang, Tianle, 2022. "Search and competition in expert markets," MPRA Paper 114170, University Library of Munich, Germany.
    16. Cheo, Roland & Ge, Ge & Liu, Rugang & Wang, Jian & Wang, Qiqi, 2023. "Physician beneficence and profit-taking among private for-profit clinics in China: A field study using a mystery shopper audit," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 107(C).
    17. Theodore Alysandratos & Sotiris Georganas & Matthias Sutter, 2022. "Reputation vs Selection Effects in Markets with Informational Asymmetries," ECONtribute Discussion Papers Series 205, University of Bonn and University of Cologne, Germany.
    18. Kevin Leyton-Brown & Paul Milgrom & Neil Newman & Ilya Segal, 2024. "Artificial Intelligence and Market Design: Lessons Learned from Radio Spectrum Reallocation," NBER Chapters, in: New Directions in Market Design, National Bureau of Economic Research, Inc.
    19. Parampreet Christopher Bindra & Rudolf Kerschbamer & Daniel Neururer & Matthias Sutter, 2020. "Reveal it or conceal it: On the value of second opinions in a low-entry-barriers credence goods market," Discussion Paper Series of the Max Planck Institute for Research on Collective Goods 2020_11, Max Planck Institute for Research on Collective Goods.
    20. C. Monica Capra & Thomas J. Kniesner, 2025. "Daniel Kahneman’s underappreciated last published paper: Empirical implications for benefit-cost analysis and a chat session discussion with bots," Journal of Risk and Uncertainty, Springer, vol. 71(1), pages 29-51, August.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2509.06069. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.