IDEAS home Printed from https://ideas.repec.org/a/kap/mktlet/v36y2025i3d10.1007_s11002-024-09747-1.html
   My bibliography  Save this article

Impacts of generative AI on user contributions: evidence from a coding Q &A platform

Author

Listed:
  • Xinyu Li

    (The Chinese University of Hong Kong)

  • Keongtae Kim

    (The Chinese University of Hong Kong)

Abstract

This study investigates the short-term impact of generative AI, exemplified by the introduction of ChatGPT, on user contributions in a coding Q&A platform. We find that the introduction of ChatGPT led to a reduction in the number of high-quality answers provided by users, particularly among highly engaged contributors, despite an overall increase in answers. We identify two key mechanisms: (1) increased perceived question sophistication despite no actual change in content and (2) reduced motivation of loyal users in providing answers in the face of AI-generated alternatives. The findings suggest that while generative AI can facilitate value creation on user-generated content (UGC) platforms, it also poses challenges in retaining core contributors and managing content quality. The paper contributes to the literature on the impact of AI adoption on platforms and suggests practical implications for UGC platform management, such as the need for AI content disclosure measures to retain engaged users.

Suggested Citation

  • Xinyu Li & Keongtae Kim, 2025. "Impacts of generative AI on user contributions: evidence from a coding Q &A platform," Marketing Letters, Springer, vol. 36(3), pages 577-591, September.
    • Handle: RePEc:kap:mktlet:v:36:y:2025:i:3:d:10.1007_s11002-024-09747-1
    DOI: 10.1007/s11002-024-09747-1
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11002-024-09747-1
    File Function: Abstract
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s11002-024-09747-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Chiara Longoni & Andrea Bonezzi & Carey K Morewedge, 2019. "Resistance to Medical Artificial Intelligence," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 46(4), pages 629-650.
    2. Anouk S Bergner & Christian Hildebrand & Gerald Häubl & J Jeffrey Inman & Richard J Lutz & Ellie J Kyung, 2023. "Machine Talk: How Verbal Embodiment in Conversational AI Shapes Consumer–Brand Relationships," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 50(4), pages 742-764.
    3. Erik Hermann, 2022. "Anthropomorphized artificial intelligence, attachment, and consumer behavior," Marketing Letters, Springer, vol. 33(1), pages 157-162, March.
    4. Brodeur, Abel & Clark, Andrew E. & Fleche, Sarah & Powdthavee, Nattavudh, 2021. "COVID-19, lockdowns and well-being: Evidence from Google Trends," Journal of Public Economics, Elsevier, vol. 193(C).
    5. Noah Castelo & Johannes Boegershausen & Christian Hildebrand & Alexander P Henkel & June Cotte & Klaus Wertenbroch, 2023. "Understanding and Improving Consumer Reactions to Service Bots," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 50(4), pages 848-863.
    6. Yuqian Xu & Anindya Ghose & Binqing Xiao, 2024. "Mobile Payment Adoption: An Empirical Investigation of Alipay," Information Systems Research, INFORMS, vol. 35(2), pages 807-828, June.
    7. Samuel G. Goldberg & Garrett A. Johnson & Scott K. Shriver, 2024. "Regulating Privacy Online: An Economic Evaluation of the GDPR," American Economic Journal: Economic Policy, American Economic Association, vol. 16(1), pages 325-358, February.
    8. Dae-Yong Ahn & Jason A. Duan & Carl F. Mela, 2016. "Managing User-Generated Content: A Dynamic Rational Expectations Equilibrium Approach," Marketing Science, INFORMS, vol. 35(2), pages 284-303, March.
    9. Anindya Ghose & Panagiotis G. Ipeirotis & Beibei Li, 2012. "Designing Ranking Systems for Hotels on Travel Search Engines by Mining User-Generated and Crowdsourced Content," Marketing Science, INFORMS, vol. 31(3), pages 493-520, May.
    10. Bernd Schmitt, 2020. "Speciesism: an obstacle to AI and robot adoption," Marketing Letters, Springer, vol. 31(1), pages 3-6, March.
    11. Erik Brynjolfsson & Xiang Hui & Meng Liu, 2019. "Does Machine Translation Affect International Trade? Evidence from a Large Digital Platform," Management Science, INFORMS, vol. 65(12), pages 5449-5460, December.
    12. Mikhail Lysyakov & Siva Viswanathan, 2023. "Threatened by AI: Analyzing Users’ Responses to the Introduction of AI in a Crowd-Sourcing Platform," Information Systems Research, INFORMS, vol. 34(3), pages 1191-1210, September.
    13. Gordon Burtch & Seth Carnahan & Brad N. Greenwood, 2018. "Can You Gig It? An Empirical Examination of the Gig Economy and Entrepreneurial Activity," Management Science, INFORMS, vol. 64(12), pages 5497-5520, December.
    14. Xiaolin Li & Chenxi Liao & Ying Xie, 2021. "Digital Piracy, Creative Productivity, and Customer Care Effort: Evidence from the Digital Publishing Industry," Marketing Science, INFORMS, vol. 40(4), pages 685-707, July.
    15. Ni Huang & Gordon Burtch & Bin Gu & Yili Hong & Chen Liang & Kanliang Wang & Dongpu Fu & Bo Yang, 2019. "Motivating User-Generated Content with Performance Feedback: Evidence from Randomized Field Experiments," Management Science, INFORMS, vol. 65(1), pages 327-345, January.
    16. Yuewen Liu & Juan Feng, 2021. "Does Money Talk? The Impact of Monetary Incentives on User-Generated Content Contributions," Information Systems Research, INFORMS, vol. 32(2), pages 394-409, June.
    17. Xiaoquan (Michael) Zhang & Feng Zhu, 2011. "Group Size and Incentives to Contribute: A Natural Experiment at Chinese Wikipedia," American Economic Review, American Economic Association, vol. 101(4), pages 1601-1615, June.
    18. Gordon Burtch & Qinglai He & Yili Hong & Dokyun Lee, 2022. "How Do Peer Awards Motivate Creative Content? Experimental Evidence from Reddit," Management Science, INFORMS, vol. 68(5), pages 3488-3506, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xinyi Zhang & Chenshuo Sun & Renyu Zhang & Khim-Yong Goh, 2024. "The Value of AI-Generated Metadata for UGC Platforms: Evidence from a Large-scale Field Experiment," Papers 2412.18337, arXiv.org.
    2. Maria Marchenko & Hendrik Sonnabend, 2025. "The never-ending book: the role of new material and peer feedback in user-generated content production," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 49(3), pages 435-458, September.
    3. Yipu Deng & Jinyang Zheng & Warut Khern-am-nuai & Karthik Kannan, 2022. "More than the Quantity: The Value of Editorial Reviews for a User-Generated Content Platform," Management Science, INFORMS, vol. 68(9), pages 6865-6888, September.
    4. Siliang Tong & Nan Jia & Xueming Luo & Zheng Fang, 2021. "The Janus face of artificial intelligence feedback: Deployment versus disclosure effects on employee performance," Strategic Management Journal, Wiley Blackwell, vol. 42(9), pages 1600-1631, September.
    5. Celiktutan, Begum & Klesse, Anne-Kathrin & Tuk, Mirjam A., 2024. "Acceptability lies in the eye of the beholder: Self-other biases in GenAI collaborations," International Journal of Research in Marketing, Elsevier, vol. 41(3), pages 496-512.
    6. Zhu, Yimin & Zhang, Jiemin & Wu, Jifei & Liu, Yingyue, 2022. "AI is better when I'm sure: The influence of certainty of needs on consumers' acceptance of AI chatbots," Journal of Business Research, Elsevier, vol. 150(C), pages 642-652.
    7. Dominik Gutt & Jürgen Neumann & Steffen Zimmermann & Dennis Kundisch & Jianqing Chen, 2018. "Design of Review Systems - A Strategic Instrument to shape Online Review Behavior and Economic Outcomes," Working Papers Dissertations 42, Paderborn University, Faculty of Business Administration and Economics.
    8. Chen, Nuoya & Mohanty, Smaraki & Jiao, Jinfeng & Fan, Xiucheng, 2021. "To err is human: Tolerate humans instead of machines in service failure," Journal of Retailing and Consumer Services, Elsevier, vol. 59(C).
    9. Lingli Wang & Ni Huang & Yili Hong & Luning Liu & Xunhua Guo & Guoqing Chen, 2023. "Voice‐based AI in call center customer service: A natural field experiment," Production and Operations Management, Production and Operations Management Society, vol. 32(4), pages 1002-1018, April.
    10. Guo, Xue & Cheng, Aaron & Pavlou, Paul A., 2025. "Skill-biased technical change, again? Online gig platforms and local employment," LSE Research Online Documents on Economics 124538, London School of Economics and Political Science, LSE Library.
    11. Han, Xintong & Li, Yushen & Wang, Tong, 2023. "Peer recognition, badge policies, and content contribution: An empirical study," Journal of Economic Behavior & Organization, Elsevier, vol. 214(C), pages 691-707.
    12. Tianyi Li & Xiaoquan (Michael) Zhang, 2024. "Development Trajectory of Blockchain Platforms: The Role of Multirole," Information Systems Research, INFORMS, vol. 35(3), pages 1296-1323, September.
    13. Alabed, Amani & Javornik, Ana & Gregory-Smith, Diana, 2022. "AI anthropomorphism and its effect on users' self-congruence and self–AI integration: A theoretical framework and research agenda," Technological Forecasting and Social Change, Elsevier, vol. 182(C).
    14. Guy Aridor & Rafael Jiménez-Durán & Ro'ee Levy & Lena Song, 2024. "The Economics of Social Media," Journal of Economic Literature, American Economic Association, vol. 62(4), pages 1422-1474, December.
    15. Zhang, Ke & Sun, Xinru & Li, Gang, 2025. "Virtual influencer and cultural heritage destination: Endorsement effectiveness of virtual versus human influencers," Annals of Tourism Research, Elsevier, vol. 110(C).
    16. Stephan Seiler & Song Yao & Wenbo Wang, 2017. "Does Online Word of Mouth Increase Demand? (And How?) Evidence from a Natural Experiment," Marketing Science, INFORMS, vol. 36(6), pages 838-861, November.
    17. Marchenko, Maria & Sonnabend, Hendrik, 2022. "The Never Ending Book: The role of external stimuli and peer feedback in user-generated content production," Department of Economics Working Paper Series 320, WU Vienna University of Economics and Business.
    18. Hao Zhang & Mingzheng Wang, 2024. "Tapping vs. Scrolling: Effects of Different Content Acquisition Modes on Content Consumption," Information Systems Frontiers, Springer, vol. 26(5), pages 1835-1855, October.
    19. Jialu Liu & Siqi Pei & Xiaoquan (Michael) Zhang, 2024. "Online Food Delivery Platforms and Female Labor Force Participation," Information Systems Research, INFORMS, vol. 35(3), pages 1074-1091, September.
    20. Xingyu Chen & Xing Li & Dai Yao & Zhimin Zhou, 2019. "Seeking the support of the silent majority: are lurking users valuable to UGC platforms?," Journal of the Academy of Marketing Science, Springer, vol. 47(6), pages 986-1004, November.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:mktlet:v:36:y:2025:i:3:d:10.1007_s11002-024-09747-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.