IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2511.09877.html
   My bibliography  Save this paper

AI in the Pen: How Real-time AI Writing Guidance Shapes Online Reviews

Author

Listed:
  • Fangyan Wang
  • Sai Liang
  • Zaiyan Wei

Abstract

Recent advancements in artificial intelligence (AI) are reshaping user-generated content (UGC). Online reviews, an important form of UGC, exert significant influence on consumer decisions and business reputation. Yet, the impacts of AI-powered tools employed during review generation remain underexplored. We examine Yelp's AI writing guidance adopted in April 2023, a novel human-AI collaboration in content creation. Drawing on Self-Determination Theory, we evaluate the impacts of this intervention on review outcomes. Our findings reveal that, first, the AI guidance was effective in shaping topical composition, encouraging broader coverage across aspects of the dining experience. Second, the AI writing guidance increases review length while reducing overall review volume, revealing a trade-off between depth and productivity. Third, the expansion of topic coverage comes at the cost of increased textual complexity and reduced readability, ultimately diminishing the number of helpfulness votes. Lastly, effects are heterogeneous: less experienced users expand length and topic coverage more, whereas experienced users exhibit greater complexity and sharper declines in perceived helpfulness. These findings advance our understanding of AI-powered tools during content generation. We also discuss implications for platforms aiming to leverage AI in managing online content and for other stakeholders involved in the production and consumption of online content.

Suggested Citation

  • Fangyan Wang & Sai Liang & Zaiyan Wei, 2025. "AI in the Pen: How Real-time AI Writing Guidance Shapes Online Reviews," Papers 2511.09877, arXiv.org.
    • Handle: RePEc:arx:papers:2511.09877
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2511.09877
    File Function: Latest version
    Download Restriction: no
    ---><---

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2511.09877. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.