IDEAS home Printed from https://ideas.repec.org/p/dar/wpaper/156355.html
   My bibliography  Save this paper

The Dialog Trap: Exploring Potentially Detrimental Effects of Dialog-Based Interfaces for Generative AI Content Creation

Author

Listed:
  • Glauben, Adrian
  • Zöll, Anne
  • Sharma, Bhavika
  • Kristo, Filip

Abstract

This paper investigates the dynamics of human-AI collaboration in content generation, focusing on the use of ChatGPT’s dialog-based interface. Through an exploratory experiment involving 304 participants rating various texts, we examine the impact of dialog-based interaction on the quality of content produced in different settings: Human Control, Human-AI without dialog, Human-AI with dialog and AI-AI with dialog. Our findings reveal that while incorporating AI can enhance content quality, dialog-based interactions often do not improve, and may even degrade, the quality of the initial output. As humans are easily drawn to engage in a dialog with AI, we term this phenomenon “the dialog trap”. This study contributes to the literature by highlighting the nuances of human-AI collaborative writing, particularly in the context of generative AI systems like ChatGPT. It also underscores the importance of considering interaction modes in AI-assisted content generation, offering insights for both researchers and practitioners.

Suggested Citation

  • Glauben, Adrian & Zöll, Anne & Sharma, Bhavika & Kristo, Filip, 2024. "The Dialog Trap: Exploring Potentially Detrimental Effects of Dialog-Based Interfaces for Generative AI Content Creation," Publications of Darmstadt Technical University, Institute for Business Studies (BWL) 156355, Darmstadt Technical University, Department of Business Administration, Economics and Law, Institute for Business Studies (BWL).
    • Handle: RePEc:dar:wpaper:156355
    Note: for complete metadata visit http://tubiblio.ulb.tu-darmstadt.de/156355/
    as

    Download full text from publisher

    File URL: https://aisel.aisnet.org/pacis2024/track01_aibussoc/track01_aibussoc/15/
    Download Restriction: no
    ---><---

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:dar:wpaper:156355. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Dekanatssekretariat (email available below). General contact details of provider: https://edirc.repec.org/data/ivthdde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.