IDEAS home Printed from https://ideas.repec.org/p/dpr/wpaper/1233rr.html

Do people rely on ChatGPT more than their peers to detect deepfake news?

Author

Listed:
  • Yuhao Fu
  • Nobuyuki Hanaki

Abstract

This experimental study investigates how people rely on different sources of advice when detecting AI-generated fake news (deepfake news). In a laboratory deepfake detection task, student participants identified the proportion of human-written (non-AI-generated) content in synthetic deepfake news articles and received advice from ChatGPT (GPT-4), human peers, or linguistic experts. The results show that participants rely more on ChatGPT than on human peers when detecting GPT-2-generated deepfake news. Participants also rely more on linguistic experts than on peers, while the relative reliance on experts versus ChatGPT is mixed across experimental waves, potentially reflecting time trends in beliefs about AI-based detection. Moreover, performance improvements reflect the joint role of reliance and advice quality, arising primarily when participants rely on high-quality advice. Overall, relying on AI to detect AI-generated deepfakes can improve detection outcomes, but only when AI-based detection tools are of sufficiently high quality. These findings highlight the dual role of GAI as both a source of deepfakes and a tool for mitigating related risks.

Suggested Citation

  • Yuhao Fu & Nobuyuki Hanaki, 2024. "Do people rely on ChatGPT more than their peers to detect deepfake news?," ISER Discussion Paper 1233rr, Institute of Social and Economic Research, The University of Osaka, revised Feb 2026.
    • Handle: RePEc:dpr:wpaper:1233rr
    as

    Download full text from publisher

    File URL: https://www.iser.osaka-u.ac.jp/static/resources/docs/dp/DP1233RR.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Thomas Schultze & Anne-Fernandine Rakotoarisoa & Stefan Schulz-Hardt, 2015. "Effects of distance between initial estimates and advice on advice utilization," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 10(2), pages 144-171, March.
    2. James Heckman, 2013. "Sample selection bias as a specification error," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 31(3), pages 129-137.
    3. Mandy Hütter & Fabian Ache, 2016. "Seeking advice: A sampling approach to advice taking," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 11(4), pages 401-415, July.
    4. Hütter, Mandy & Ache, Fabian, 2016. "Seeking advice: A sampling approach to advice taking," Judgment and Decision Making, Cambridge University Press, vol. 11(4), pages 401-415, July.
    5. Schultze, Thomas & Rakotoarisoa, Anne-Fernandine & Stefan, Schulz-Hardt, 2015. "Effects of distance between initial estimates and advice on advice utilization," Judgment and Decision Making, Cambridge University Press, vol. 10(2), pages 144-171, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ammeling, Jonas & Aubreville, Marc & Fritz, Alexis & Kießig, Angelika & Krügel, Sebastian & Uhl, Matthias, 2025. "An interdisciplinary perspective on AI-supported decision making in medicine," Technology in Society, Elsevier, vol. 81(C).
    2. Milyavsky, Maxim & Gvili, Yaniv, 2024. "Advice taking vs. combining opinions: Framing social information as advice increases source’s perceived helping intentions, trust, and influence," Organizational Behavior and Human Decision Processes, Elsevier, vol. 183(C).
    3. Wiemann, Paul F.V. & Klein, Nadja & Kneib, Thomas, 2022. "Correcting for sample selection bias in Bayesian distributional regression models," Computational Statistics & Data Analysis, Elsevier, vol. 168(C).
    4. Jack B. Soll & Asa B. Palley & Christina A. Rader, 2022. "The Bad Thing About Good Advice: Understanding When and How Advice Exacerbates Overconfidence," Management Science, INFORMS, vol. 68(4), pages 2949-2969, April.
    5. Darima Fotheringham & Michael A. Wiles, 2023. "The effect of implementing chatbot customer service on stock returns: an event study analysis," Journal of the Academy of Marketing Science, Springer, vol. 51(4), pages 802-822, July.
    6. Song, Wei-Ling & Uzmanoglu, Cihan, 2016. "TARP announcement, bank health, and borrowers’ credit risk," Journal of Financial Stability, Elsevier, vol. 22(C), pages 22-32.
    7. Raymundo M. Campos-Vázquez, 2013. "Efectos de los ingresos no reportados en el nivel y tendencia de la pobreza laboral en México," Ensayos Revista de Economia, Universidad Autonoma de Nuevo Leon, Facultad de Economia, vol. 0(2), pages 23-54, November.
    8. Ichev, Riste & Valentinčič, Aljoša, 2025. "The effect of impact investing on performance of private firms," Research in International Business and Finance, Elsevier, vol. 73(PA).
    9. Stephen Brown & William Goetzmann & Bing Liang & Christopher Schwarz, 2008. "Mandatory Disclosure and Operational Risk: Evidence from Hedge Fund Registration," Journal of Finance, American Finance Association, vol. 63(6), pages 2785-2815, December.
    10. Jonathan Gruber & Aaron Yelowitz, 1999. "Public Health Insurance and Private Savings," Journal of Political Economy, University of Chicago Press, vol. 107(6), pages 1249-1274, December.
    11. Jean-Louis Arcand & Linguère M'Baye, 2013. "Braving the waves: the role of time and risk preferences in illegal migration from Senegal," CERDI Working papers halshs-00855937, HAL.
    12. Sandra Müllbacher & Wolfgang Nagl, 2017. "Labour supply in Austria: an assessment of recent developments and the effects of a tax reform," Empirica, Springer;Austrian Institute for Economic Research;Austrian Economic Association, vol. 44(3), pages 465-486, August.
    13. Campbell, Randall C. & Nagel, Gregory L., 2016. "Private information and limitations of Heckman's estimator in banking and corporate finance research," Journal of Empirical Finance, Elsevier, vol. 37(C), pages 186-195.
    14. Leye Li & Louise Yi Lu & Dongyue Wang, 2022. "External labour market competitions and stock price crash risk: evidence from exposures to competitor CEOs’ award‐winning events," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 62(S1), pages 1421-1460, April.
    15. Jože P. Damijan & Mark Knell, 2005. "How Important Is Trade and Foreign Ownership in Closing the Technology Gap? Evidence from Estonia and Slovenia," Review of World Economics (Weltwirtschaftliches Archiv), Springer;Institut für Weltwirtschaft (Kiel Institute for the World Economy), vol. 141(2), pages 271-295, July.
    16. Calcagno, R. & Renneboog, L.D.R., 2004. "Capital Structure and Managerial Compensation : The Effects of Renumeration Seniority," Discussion Paper 2004-120, Tilburg University, Center for Economic Research.
    17. Nakashima, Kiyotaka & Ogawa, Toshiaki, 2020. "The Impacts of Strengthening Regulatory Surveillance on Bank Behavior: A Dynamic Analysis from Incomplete to Complete Enforcement of Capital Regulation in Microprudential Policy," MPRA Paper 99938, University Library of Munich, Germany.
    18. Sarah Bridges & David Lawson, 2008. "Health and Labour Market Participation in Uganda," WIDER Working Paper Series DP2008-07, World Institute for Development Economic Research (UNU-WIDER).
    19. Ahn T. Le, 2003. "Female Labour Market Participation: Differences Between Primary and Tied Movers," Economics Discussion / Working Papers 03-17, The University of Western Australia, Department of Economics.
    20. Inmaculada Garc�a-Mainar & V�ctor M. Montuenga-G�mez, 2017. "Subjective educational mismatch and signalling in Spain," Documentos de Trabajo dt2017-03, Facultad de Ciencias Económicas y Empresariales, Universidad de Zaragoza.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:dpr:wpaper:1233rr. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Librarian (email available below). General contact details of provider: https://edirc.repec.org/data/isosujp.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.