IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2503.05481.html

Maximum Hallucination Standards for Domain-Specific Large Language Models

Author

Listed:
  • Tingmingke Lu

Abstract

Large language models (LLMs) often generate inaccurate yet credible-sounding content, known as hallucinations. This inherent feature of LLMs poses significant risks, especially in critical domains. I analyze LLMs as a new class of engineering products, treating hallucinations as a product attribute. I demonstrate that, in the presence of imperfect awareness of LLM hallucinations and misinformation externalities, net welfare improves when the maximum acceptable level of LLM hallucinations is designed to vary with two domain-specific factors: the willingness to pay for reduced LLM hallucinations and the marginal damage associated with misinformation.

Suggested Citation

  • Tingmingke Lu, 2025. "Maximum Hallucination Standards for Domain-Specific Large Language Models," Papers 2503.05481, arXiv.org.
    • Handle: RePEc:arx:papers:2503.05481
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2503.05481
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Sebastien Houde & Erica Myers, 2019. "Heterogeneous (Mis-) Perceptions of Energy Costs: Implications for Measurement and Policy Design," CER-ETH Economics working paper series 19/314, CER-ETH - Center of Economic Research (CER-ETH) at ETH Zurich.
    2. Nicola Jones, 2025. "AI hallucinations can’t be stopped — but these techniques can limit their damage," Nature, Nature, vol. 637(8047), pages 778-780, January.
    3. Dirk Bergemann & Alessandro Bonatti & Alex Smolin, 2025. "The Economics of Large Language Models: Token Allocation, Fine Tuning, and Optimal Pricing," Cowles Foundation Discussion Papers 2425, Cowles Foundation for Research in Economics, Yale University.
    4. A. Denny Ellerman & Ian Sue Wing, 2003. "Absolute versus intensity-based emission caps," Climate Policy, Taylor & Francis Journals, vol. 3(sup2), pages 7-20, December.
    5. Mariarosaria Comunale & Andrea Manera, 2024. "The Economic Impacts and the Regulation of AI: A Review of the Academic Literature and Policy Actions," IMF Working Papers 2024/065, International Monetary Fund.
    6. Kellogg, Ryan, 2018. "Gasoline price uncertainty and the design of fuel economy standards," Journal of Public Economics, Elsevier, vol. 160(C), pages 14-32.
    7. Koichiro Ito & James M. Sallee, 2018. "The Economics of Attribute-Based Regulation: Theory and Evidence from Fuel Economy Standards," The Review of Economics and Statistics, MIT Press, vol. 100(2), pages 319-336, May.
    8. Dirk Bergemann & Alessandro Bonatti & Alex Smolin, 2025. "Menu Pricing of Large Language Models," Working Papers hal-05308118, HAL.
    9. Karan Singhal & Shekoofeh Azizi & Tao Tu & S. Sara Mahdavi & Jason Wei & Hyung Won Chung & Nathan Scales & Ajay Tanwani & Heather Cole-Lewis & Stephen Pfohl & Perry Payne & Martin Seneviratne & Paul G, 2023. "Publisher Correction: Large language models encode clinical knowledge," Nature, Nature, vol. 620(7973), pages 19-19, August.
    10. Mathias Reynaert & James M. Sallee, 2021. "Who Benefits When Firms Game Corrective Policies?," American Economic Journal: Economic Policy, American Economic Association, vol. 13(1), pages 372-412, February.
    11. Alon Eizenberg, 2014. "Upstream Innovation and Product Variety in the U.S. Home PC Market," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 81(3), pages 1003-1045.
    12. Mathias Reynaert, 2021. "Abatement Strategies and the Cost of Environmental Regulation: Emission Standards on the European Car Market," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 88(1), pages 454-488.
    13. Allcott, Hunt & Mullainathan, Sendhil & Taubinsky, Dmitry, 2014. "Energy policy with externalities and internalities," Journal of Public Economics, Elsevier, vol. 112(C), pages 72-88.
    14. Andreas Gerster & Michael Kramm, 2024. "Optimal Internality Taxation of Product Attributes," American Economic Journal: Economic Policy, American Economic Association, vol. 16(3), pages 394-419, August.
    15. Helen Pearson, 2025. "Are the Internet and AI affecting our memory? What the science says," Nature, Nature, vol. 638(8049), pages 26-28, February.
    16. Karan Singhal & Shekoofeh Azizi & Tao Tu & S. Sara Mahdavi & Jason Wei & Hyung Won Chung & Nathan Scales & Ajay Tanwani & Heather Cole-Lewis & Stephen Pfohl & Perry Payne & Martin Seneviratne & Paul G, 2023. "Large language models encode clinical knowledge," Nature, Nature, vol. 620(7972), pages 172-180, August.
    17. Rik Rozendaal & Herman Vollebergh, 2025. "Policy-Induced Innovation in Clean Technologies: Evidence from the Car Market," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 12(3), pages 565-598.
    18. Grégoire-Zawilski, Myriam & Popp, David, 2024. "Do technology standards induce innovation in environmental technologies when coordination is important?," Research Policy, Elsevier, vol. 53(1).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rik Rozendaal & Herman Vollebergh, 2025. "Policy-Induced Innovation in Clean Technologies: Evidence from the Car Market," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 12(3), pages 565-598.
    2. Lu, Tingmingke, 2023. "Response of new car buyers to alternative energy policies: The role of vehicle use heterogeneity," Economic Modelling, Elsevier, vol. 120(C).
    3. Eugenie Dugoua & Jacob Moscona, 2025. "The Economics of climate innovation: technology, climate policy, and the clean energy transition," CEP Discussion Papers dp2135, Centre for Economic Performance, LSE.
    4. Yujie Lin & Joshua Linn, 2023. "Environmental Regulation and Product Attributes: The Case of European Passenger Vehicle Greenhouse Gas Emissions Standards," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 10(1), pages 1-32.
    5. Eugenie Dugoua & Jacob Moscona, 2025. "The Economics of Climate Innovation: Technology, Climate Policy, and the Clean Energy Transition," CESifo Working Paper Series 12267, CESifo.
    6. Augustus Smith, 2025. "The consequences of a British combustion engine ban," Economics Series Working Papers 1083, University of Oxford, Department of Economics.
    7. Soren T. Anderson & James M. Sallee, 2016. "Designing Policies to Make Cars Greener: A Review of the Literature," NBER Working Papers 22242, National Bureau of Economic Research, Inc.
    8. Maxime Griot & Coralie Hemptinne & Jean Vanderdonckt & Demet Yuksel, 2025. "Large Language Models lack essential metacognition for reliable medical reasoning," Nature Communications, Nature, vol. 16(1), pages 1-10, December.
    9. Ching-Nam Hang & Pei-Duo Yu & Roberto Morabito & Chee-Wei Tan, 2024. "Large Language Models Meet Next-Generation Networking Technologies: A Review," Future Internet, MDPI, vol. 16(10), pages 1-29, October.
    10. Arslon Ruziboev & Dilmurod Turimov & Jiyoun Kim & Wooseong Kim, 2025. "Multiclass Classification of Sarcopenia Severity in Korean Adults Using Machine Learning and Model Fusion Approaches," Mathematics, MDPI, vol. 13(18), pages 1-22, September.
    11. Jingni Zhang & David Popp, 2026. "Driving Innovation: The Policy Tools Powering Electric Vehicle Technological Inventions," CESifo Working Paper Series 12421, CESifo.
    12. Chao-Chun Hsu & Ziad Obermeyer & Chenhao Tan, 2025. "A machine learning model using clinical notes to identify physician fatigue," Nature Communications, Nature, vol. 16(1), pages 1-10, December.
    13. Konishi, Yoshifumi & Kuroda, Sho, 2023. "Why is Japan’s carbon emissions from road transportation declining?," Japan and the World Economy, Elsevier, vol. 66(C).
    14. Ali Nemati & Mohammad Assadi Shalmani & Qiang Lu & Jake Luo, 2025. "Benchmarking Large Language Models from Open and Closed Source Models to Apply Data Annotation for Free-Text Criteria in Healthcare," Future Internet, MDPI, vol. 17(4), pages 1-27, March.
    15. Pavan, Giulia, 2017. "Green Car Adoption and the Supply of Alternative Fuels," TSE Working Papers 17-875, Toulouse School of Economics (TSE).
    16. Yang Zhao & Pu Wang & Yibo Zhao & Hongru Du & Hao Frank Yang, 2025. "SafeTraffic Copilot: adapting large language models for trustworthy traffic safety assessments and decision interventions," Nature Communications, Nature, vol. 16(1), pages 1-17, December.
    17. Zhao Shi & Bingqian Wu & Bin Hu & Jian Zhong & Zezhong Li & Fandong Zhang & Zijian Chen & Chun Yang & Bangjun Guo & Qinmei Xu & Huimin Pang & Han Wang & Yueyan Wang & Jinlong Zhao & Jing Xu & Yizhou Y, 2026. "A large language model for clinical outcome adjudication from telephone follow-up interviews: a secondary analysis of a multicenter randomized clinical trial," Nature Communications, Nature, vol. 17(1), pages 1-13, December.
    18. Ofir Ben Shoham & Nadav Rappoport, 2024. "CPLLM: Clinical prediction with large language models," PLOS Digital Health, Public Library of Science, vol. 3(12), pages 1-15, December.
    19. Wang, Banban & Pizer, William A. & Munnings, Clayton, 2022. "Price limits in a tradable performance standard," Journal of Environmental Economics and Management, Elsevier, vol. 116(C).
    20. Bergemann, Dirk & Bonatti, Alessandro & Wu, Nicholas, 2025. "Bidding with budgets: Data-driven bid algorithms in digital advertising," International Journal of Industrial Organization, Elsevier, vol. 102(C).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2503.05481. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.