IDEAS home Printed from https://ideas.repec.org/a/pal/palcom/v12y2025i1d10.1057_s41599-025-04650-0.html
   My bibliography  Save this article

And Plato met ChatGPT: an ethical reflection on the use of chatbots in scientific research writing, with a particular focus on the social sciences

Author

Listed:
  • Reyes Calderon

    (Institute for Research in Technology, ICADE, Universidad Pontificia Comillas)

  • Francisco Herrera

    (University of Granada)

Abstract

This interdisciplinary paper analyzes the use of Large Language Models based chatbots (LLM-chatbots), with ChatGPT the most known exponent, in scientific research writing. By interacting with LLM-chatbots, researchers could reduce efforts and costs as well as improve efficiency, but taking important risks, limitations, and weaknesses, which could highly-order erosion scientific thought. While many scientific journals, as well as major publishers such as Springer-Nature or Taylor & Francis, are restricting its use, others advocate for its normalization. Debate focuses on two main questions: the possible authorship of LLM-chatbots, which is majority denied because their inability to meet the required standards; and the acceptance of hybrid articles (using LLM-chatbots). Very recently, focusing on the education area, literature has found analogical similarities between some issues involved in Chatbots and that of Plato criticisms of writing, contained in the Phaedrus. However, the research area has been neglected. Combining philosophical and technological analysis, we explore Plato’s myth of Theuth and Thamus, questioning if chatbots can improve science. From an interdisciplinary perspective, and according with Plato, we conclude LLM-chatbots cannot be considered as authors in a scientific context. Moreover, we offer some arguments and requirements to accept hybrid articles. We draw attention to the need for social science publishers, an area where conceptual hypotheses can take a long time to confirm, rather than solely on experimental observations. Finally, we advocate that publishers, communities, technical experts, and regulatory authorities collaborate to establish recommendations and best practices for chatbot use.

Suggested Citation

  • Reyes Calderon & Francisco Herrera, 2025. "And Plato met ChatGPT: an ethical reflection on the use of chatbots in scientific research writing, with a particular focus on the social sciences," Palgrave Communications, Palgrave Macmillan, vol. 12(1), pages 1-13, December.
  • Handle: RePEc:pal:palcom:v:12:y:2025:i:1:d:10.1057_s41599-025-04650-0
    DOI: 10.1057/s41599-025-04650-0
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1057/s41599-025-04650-0
    File Function: Abstract
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1057/s41599-025-04650-0?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Richard Van Noorden, 2022. "How language-generation AIs could transform science," Nature, Nature, vol. 605(7908), pages 21-21, May.
    2. Chris Stokel-Walker, 2023. "ChatGPT listed as author on research papers: many scientists disapprove," Nature, Nature, vol. 613(7945), pages 620-621, January.
    3. Hanchen Wang & Tianfan Fu & Yuanqi Du & Wenhao Gao & Kexin Huang & Ziming Liu & Payal Chandak & Shengchao Liu & Peter Katwyk & Andreea Deac & Anima Anandkumar & Karianne Bergen & Carla P. Gomes & Shir, 2023. "Publisher Correction: Scientific discovery in the age of artificial intelligence," Nature, Nature, vol. 621(7978), pages 33-33, September.
    4. Dowling, Michael & Lucey, Brian, 2023. "ChatGPT for (Finance) research: The Bananarama Conjecture," Finance Research Letters, Elsevier, vol. 53(C).
    5. Matthew Hutson, 2021. "Robo-writers: the rise and risks of language-generating AI," Nature, Nature, vol. 591(7848), pages 22-25, March.
    6. Davide Castelvecchi, 2016. "Can we open the black box of AI?," Nature, Nature, vol. 538(7623), pages 20-23, October.
    7. Zhisheng Chen, 2023. "Ethics and discrimination in artificial intelligence-enabled recruitment practices," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-12, December.
    8. Hanchen Wang & Tianfan Fu & Yuanqi Du & Wenhao Gao & Kexin Huang & Ziming Liu & Payal Chandak & Shengchao Liu & Peter Katwyk & Andreea Deac & Anima Anandkumar & Karianne Bergen & Carla P. Gomes & Shir, 2023. "Scientific discovery in the age of artificial intelligence," Nature, Nature, vol. 620(7972), pages 47-60, August.
    9. Efthyvoulou, Georgios, 2008. "Alphabet Economics: The link between names and reputation," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 37(3), pages 1266-1285, June.
    10. Rice, Stephen & Crouse, Sean R. & Winter, Scott R. & Rice, Connor, 2024. "The advantages and limitations of using ChatGPT to enhance technological research," Technology in Society, Elsevier, vol. 76(C).
    11. Holly Else, 2023. "Abstracts written by ChatGPT fool scientists," Nature, Nature, vol. 613(7944), pages 423-423, January.
    12. Laura Illia & Elanor Colleoni & Stelios Zyglidopoulos, 2023. "Ethical implications of text generation in the age of artificial intelligence," Business Ethics, the Environment & Responsibility, John Wiley & Sons, Ltd., vol. 32(1), pages 201-210, January.
    13. Ahmed A. Khalifa & Mariam A. Ibrahim, 2024. "Artificial intelligence (AI) and ChatGPT involvement in scientific and medical writing, a new concern for researchers. A scoping review," Arab Gulf Journal of Scientific Research, Emerald Group Publishing Limited, vol. 42(4), pages 1770-1787, January.
    14. Bastian Burger & Dominik K. Kanbach & Sascha Kraus & Matthias Breier & Vincenzo Corvello, 2023. "On the use of AI-based tools like ChatGPT to support management research," European Journal of Innovation Management, Emerald Group Publishing Limited, vol. 26(7), pages 233-241, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Giordano, Vito & Spada, Irene & Chiarello, Filippo & Fantoni, Gualtiero, 2024. "The impact of ChatGPT on human skills: A quantitative study on twitter data," Technological Forecasting and Social Change, Elsevier, vol. 203(C).
    2. Li-Yuan Huang & Xun Zhang & Qiang Wang & Zhen-Song Chen & Yang Liu, 2024. "Evaluating Media Knowledge Capabilities of Intelligent Search Dialogue Systems: A Case Study of ChatGPT and New Bing," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 15(4), pages 17284-17307, December.
    3. Song Tong & Kai Mao & Zhen Huang & Yukun Zhao & Kaiping Peng, 2024. "Automating psychological hypothesis generation with AI: when large language models meet causal graph," Palgrave Communications, Palgrave Macmillan, vol. 11(1), pages 1-14, December.
    4. Amina Badreddine & Hadjira Larbi Cherif, 2023. "ChatGPT in Academic Research: Demonstrating Limitations through Real Practical Examples," Post-Print hal-04379581, HAL.
    5. Khizar, Hafiz Muhammad Usman & Ashraf, Aqsa & Yuan, Jingbo & Al-Waqfi, Mohammed, 2025. "Insights into ChatGPT adoption (or resistance) in research practices: The behavioral reasoning perspective," Technological Forecasting and Social Change, Elsevier, vol. 215(C).
    6. Evangelos Katsamakas & Oleg V. Pavlov & Ryan Saklad, 2024. "Artificial intelligence and the transformation of higher education institutions," Papers 2402.08143, arXiv.org.
    7. Fabian Dvorak & Regina Stumpf & Sebastian Fehrler & Urs Fischbacher, 2024. "Generative AI Triggers Welfare-Reducing Decisions in Humans," Papers 2401.12773, arXiv.org.
    8. Koehler, Maximilian & Sauermann, Henry, 2024. "Algorithmic management in scientific research," Research Policy, Elsevier, vol. 53(4).
    9. Jianfeng Yao & Cancong Zhao & Xuefan Hu & Yingshan Jin & Yanling Li & Liming Cai & Zhuofan Li & Fang Li & Fang Liang, 2025. "A Method for Estimating Tree Growth Potential with Back Propagation Neural Network," Sustainability, MDPI, vol. 17(4), pages 1-15, February.
    10. Raghu Raman & Hiran H Lathabai & Santanu Mandal & Payel Das & Tavleen Kaur & Prema Nedungadi, 2024. "ChatGPT: Literate or intelligent about UN sustainable development goals?," PLOS ONE, Public Library of Science, vol. 19(4), pages 1-27, April.
    11. Meng, Kai & Ba, Zhichao & Wang, Chunying & Li, Gang, 2025. "Unveiling intrinsic interactions of science and technology in artificial intelligence using a network portrait divergence approach," Journal of Informetrics, Elsevier, vol. 19(1).
    12. Anil R. Doshi & Oliver P. Hauser, 2023. "Generative artificial intelligence enhances creativity but reduces the diversity of novel content," Papers 2312.00506, arXiv.org, revised Mar 2024.
    13. Hui Li & Yichi Zhang & Zhaoxiong Wu & Zhe Wang & Tong Wu, 2025. "An Importance Sampling Method for Generating Optimal Interpolation Points in Training Physics-Informed Neural Networks," Mathematics, MDPI, vol. 13(1), pages 1-20, January.
    14. Naudé, Wim, 2024. "What They Don't Teach You about Artificial Intelligence at Business School: Stagnation, Oil, and War," IZA Discussion Papers 17306, Institute of Labor Economics (IZA).
    15. Peres, Renana & Schreier, Martin & Schweidel, David & Sorescu, Alina, 2023. "On ChatGPT and beyond: How generative artificial intelligence may affect research, teaching, and practice," International Journal of Research in Marketing, Elsevier, vol. 40(2), pages 269-275.
    16. Damioli, Giacomo & Van Roy, Vincent & Vertesy, Daniel & Vivarelli, Marco, 2025. "Is artificial intelligence leading to a new technological paradigm?," Structural Change and Economic Dynamics, Elsevier, vol. 72(C), pages 347-359.
    17. Stefano Bianchini & Moritz Muller & Pierre Pelletier, 2023. "Drivers and Barriers of AI Adoption and Use in Scientific Research," Papers 2312.09843, arXiv.org, revised Feb 2024.
    18. Nicoleta Mihaela Doran & Gabriela Badareu & Marius Dalian Doran & Maria Enescu & Anamaria Liliana Staicu & Mariana Niculescu, 2024. "Greening Automation: Policy Recommendations for Sustainable Development in AI-Driven Industries," Sustainability, MDPI, vol. 16(12), pages 1-17, June.
    19. Almeida, Derick & Naudé, Wim & Sequeira, Tiago Neves, 2024. "Artificial Intelligence and the Discovery of New Ideas: Is an Economic Growth Explosion Imminent?," IZA Discussion Papers 16766, Institute of Labor Economics (IZA).
    20. Wenhao Wan & Yongzhong Tian & Jinglian Tian & Chengxi Yuan & Yan Cao & Kangning Liu, 2024. "Research Progress in Spatiotemporal Dynamic Simulation of LUCC," Sustainability, MDPI, vol. 16(18), pages 1-18, September.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pal:palcom:v:12:y:2025:i:1:d:10.1057_s41599-025-04650-0. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: https://www.nature.com/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.