IDEAS home Printed from https://ideas.repec.org/a/eee/ijrema/v42y2025i2p467-486.html

If it ain’t broke, should you still fix it? Effects of incorporating user feedback in product development on mobile application ratings

Author

Listed:
  • Aydin Gokgoz, Zeynep
  • Ataman, M. Berk
  • van Bruggen, Gerrit H.

Abstract

How can firms utilize collective user feedback in reviews to better tailor their products to improve customer satisfaction? Based on an automated text analysis of 1,075,704 reviews and a content analysis of 3255 mobile application updates, observed over 460 apps’ first year on the market, this paper investigates the role of collective user feedback on user ratings during the process of developing successive mobile app generations. The results reveal that the rewards associated with responding to user feedback and the penalties due to ignoring this feedback can be substantial. The impact of the match/mismatch between user feedback and product development decisions depends on the topic of the feedback and the timing of the update. The findings provide app developers with guidance on the challenge of prioritizing possible development paths: (1) improve ratings by promptly matching user feedback that require new content or smooth functioning of the app; (2) avoid rating penalties by continuously improving existing content or ensuring compatibility with most recent operating systems and devices. The implications shed light on the fundamental question of whether and when to pro-act on or re-act to the voice of the customer.

Suggested Citation

  • Aydin Gokgoz, Zeynep & Ataman, M. Berk & van Bruggen, Gerrit H., 2025. "If it ain’t broke, should you still fix it? Effects of incorporating user feedback in product development on mobile application ratings," International Journal of Research in Marketing, Elsevier, vol. 42(2), pages 467-486.
    • Handle: RePEc:eee:ijrema:v:42:y:2025:i:2:p:467-486
    DOI: 10.1016/j.ijresmar.2024.10.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167811624000922
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ijresmar.2024.10.004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Artem Timoshenko & John R. Hauser, 2019. "Identifying Customer Needs from User-Generated Content," Marketing Science, INFORMS, vol. 38(1), pages 1-20, January.
    2. Zeynep Aydin-Gokgoz & M. Berk Ataman & Gerrit van Bruggen, 2022. "The Rise of Mobile Marketing: A Decade of Research in Review," Foundations and Trends(R) in Marketing, now publishers, vol. 17(3), pages 140-226, November.
    3. Dhar, Vasant & Chang, Elaine A., 2009. "Does Chatter Matter? The Impact of User-Generated Content on Music Sales," Journal of Interactive Marketing, Elsevier, vol. 23(4), pages 300-307.
    4. Michael Anderson & Jeremy Magruder, 2012. "Learning from the Crowd: Regression Discontinuity Estimates of the Effects of an Online Review Database," Economic Journal, Royal Economic Society, vol. 122(563), pages 957-989, September.
    5. Ashlee Humphreys & Rebecca Jen-Hui Wang & Eileen FischerEditor & Linda PriceAssociate Editor, 2018. "Automated Text Analysis for Consumer Research," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 44(6), pages 1274-1306.
    6. Anindya Ghose & Sang Pil Han, 2014. "Estimating Demand for Mobile Applications in the New Economy," Management Science, INFORMS, vol. 60(6), pages 1470-1488, June.
    7. Torsten Bornemann & Cornelia Hattula & Stefan Hattula, 2020. "Successive product generations: financial implications of industry release rhythm alignment," Journal of the Academy of Marketing Science, Springer, vol. 48(6), pages 1174-1191, November.
    8. Oded Netzer & Ronen Feldman & Jacob Goldenberg & Moshe Fresko, 2012. "Mine Your Own Business: Market-Structure Surveillance Through Text Mining," Marketing Science, INFORMS, vol. 31(3), pages 521-543, May.
    9. Abbie Griffin & John R. Hauser, 1993. "The Voice of the Customer," Marketing Science, INFORMS, vol. 12(1), pages 1-27.
    10. Liang Chen & Pengxiang Zhang & Sali Li & Scott F. Turner, 2022. "Growing pains: The effect of generational product innovation on mobile games performance," Strategic Management Journal, Wiley Blackwell, vol. 43(4), pages 792-821, April.
    11. Davide Proserpio & Georgios Zervas, 2017. "Online Reputation Management: Estimating the Impact of Management Responses on Consumer Reviews," Marketing Science, INFORMS, vol. 36(5), pages 645-665, September.
    12. Ron S. Kenett & Silvia Salini, 2011. "Rejoinder to ‘Modern analysis of customer satisfaction surveys: comparison of models and integrated analysis’," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 27(5), pages 484-486, September.
    13. Joachim Büschken & Greg M. Allenby, 2016. "Sentence-Based Text Analysis for Customer Reviews," Marketing Science, INFORMS, vol. 35(6), pages 953-975, November.
    14. Park, Jeongeun & Yang, Donguk & Kim, Ha Young, 2023. "Text mining-based four-step framework for smart speaker product improvement and sales planning," Journal of Retailing and Consumer Services, Elsevier, vol. 71(C).
    15. Nikolay Archak & Anindya Ghose & Panagiotis G. Ipeirotis, 2011. "Deriving the Pricing Power of Product Features by Mining Consumer Reviews," Management Science, INFORMS, vol. 57(8), pages 1485-1509, August.
    16. Eugene W. Anderson & Mary W. Sullivan, 1993. "The Antecedents and Consequences of Customer Satisfaction for Firms," Marketing Science, INFORMS, vol. 12(2), pages 125-143.
    17. Chris Forman & Anindya Ghose & Batia Wiesenfeld, 2008. "Examining the Relationship Between Reviews and Sales: The Role of Reviewer Identity Disclosure in Electronic Markets," Information Systems Research, INFORMS, vol. 19(3), pages 291-313, September.
    18. Pasquale Del Vecchio & Gioconda Mele & Giuseppina Passiante & Donata Serra, 2023. "Knowledge generation from Big Data for new product development: a structured literature review," Knowledge Management Research & Practice, Taylor & Francis Journals, vol. 21(4), pages 892-907, July.
    19. Choi, Jaewoong & Oh, Seunghyun & Yoon, Janghyeok & Lee, Jae-Min & Coh, Byoung-Youl, 2020. "Identification of time-evolving product opportunities via social media mining," Technological Forecasting and Social Change, Elsevier, vol. 156(C).
    20. Ron S. Kenett & Silvia Salini, 2011. "Modern analysis of customer satisfaction surveys: comparison of models and integrated analysis," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 27(5), pages 465-475, September.
    21. Lara Stocchi & Naser Pourazad & Nina Michaelidou & Arry Tanusondjaja & Paul Harrigan, 2022. "Marketing research on Mobile apps: past, present and future," Journal of the Academy of Marketing Science, Springer, vol. 50(2), pages 195-225, March.
    22. Judith A. Chevalier & Yaniv Dover & Dina MayzlinDina Mayzlin, 2018. "Channels of Impact: User Reviews When Quality Is Dynamic and Managers Respond," Marketing Science, INFORMS, vol. 37(5), pages 688-709, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bai, Ye & Yu-Buck, Grace, 2025. "Identifying targeted needs from online marketer- and user-generated data," Journal of Retailing and Consumer Services, Elsevier, vol. 84(C).
    2. Dominik Gutt & Jürgen Neumann & Steffen Zimmermann & Dennis Kundisch & Jianqing Chen, 2018. "Design of Review Systems - A Strategic Instrument to shape Online Review Behavior and Economic Outcomes," Working Papers Dissertations 42, Paderborn University, Faculty of Business Administration and Economics.
    3. Hasmat Malik & Asyraf Afthanorhan & Noor Aina Amirah & Nuzhat Fatema, 2021. "Machine Learning Approach for Targeting and Recommending a Product for Project Management," Mathematics, MDPI, vol. 9(16), pages 1-29, August.
    4. Mingwen Yang & Zhiqiang (Eric) Zheng & Vijay Mookerjee, 2019. "Prescribing Response Strategies to Manage Customer Opinions: A Stochastic Differential Equation Approach," Information Systems Research, INFORMS, vol. 30(2), pages 351-374, June.
    5. Alantari, Huwail J. & Currim, Imran S. & Deng, Yiting & Singh, Sameer, 2022. "An empirical comparison of machine learning methods for text-based sentiment analysis of online consumer reviews," International Journal of Research in Marketing, Elsevier, vol. 39(1), pages 1-19.
    6. Uttara Ananthakrishnan & Davide Proserpio & Siddhartha Sharma, 2023. "I Hear You: Does Quality Improve with Customer Voice?," Marketing Science, INFORMS, vol. 42(6), pages 1143-1161, November.
    7. Carlson, Keith & Kopalle, Praveen K. & Riddell, Allen & Rockmore, Daniel & Vana, Prasad, 2023. "Complementing human effort in online reviews: A deep learning approach to automatic content generation and review synthesis," International Journal of Research in Marketing, Elsevier, vol. 40(1), pages 54-74.
    8. Roelen-Blasberg, Tobias & Habel, Johannes & Klarmann, Martin, 2023. "Automated inference of product attributes and their importance from user-generated content: Can we replace traditional market research?," International Journal of Research in Marketing, Elsevier, vol. 40(1), pages 164-188.
    9. Pocchiari, Martina & Proserpio, Davide & Dover, Yaniv, 2025. "Online reviews: A literature review and roadmap for future research," International Journal of Research in Marketing, Elsevier, vol. 42(2), pages 275-297.
    10. Katsumata, Sotaro & Nishimoto, Akihiro & Kannan, P.K., 2023. "Brand competitiveness and resilience to exogenous shock: Usage of smartphone apps during the COVID-19 pandemic," Journal of Retailing and Consumer Services, Elsevier, vol. 75(C).
    11. Mariani, Marcello M. & Borghi, Matteo & Laker, Benjamin, 2023. "Do submission devices influence online review ratings differently across different types of platforms? A big data analysis," Technological Forecasting and Social Change, Elsevier, vol. 189(C).
    12. Venkatesh Shankar & Sohil Parsana, 2022. "An overview and empirical comparison of natural language processing (NLP) models and an introduction to and empirical application of autoencoder models in marketing," Journal of the Academy of Marketing Science, Springer, vol. 50(6), pages 1324-1350, November.
    13. Jianwei Liu & Karen Xie & Wei Chen & Yong Liu & Yunlong Sun, 2023. "How incumbents beat disruption? Evidence from hotel responses to home sharing," Production and Operations Management, Production and Operations Management Society, vol. 32(9), pages 2758-2774, September.
    14. Sheng, Jie & Amankwah-Amoah, Joseph & Wang, Xiaojun, 2017. "A multidisciplinary perspective of big data in management research," International Journal of Production Economics, Elsevier, vol. 191(C), pages 97-112.
    15. Anindya Ghose & Panagiotis G. Ipeirotis & Beibei Li, 2012. "Designing Ranking Systems for Hotels on Travel Search Engines by Mining User-Generated and Crowdsourced Content," Marketing Science, INFORMS, vol. 31(3), pages 493-520, May.
    16. Xin (Shane) Wang & Feng Mai & Roger H. L. Chiang, 2014. "Database Submission ---Market Dynamics and User-Generated Content About Tablet Computers," Marketing Science, INFORMS, vol. 33(3), pages 449-458, May.
    17. Zheng, Lili, 2021. "The classification of online consumer reviews: A systematic literature review and integrative framework," Journal of Business Research, Elsevier, vol. 135(C), pages 226-251.
    18. Tingting Song & Jinghua Huang & Yong Tan & Yifan Yu, 2019. "Using User- and Marketer-Generated Content for Box Office Revenue Prediction: Differences Between Microblogging and Third-Party Platforms," Service Science, INFORMS, vol. 30(1), pages 191-203, March.
    19. Cao, Jingcun & Li, Xiaolin & Zhang, Lingling, 2025. "Is relevancy everything? A deep-learning approach to understand the effect of image-text congruence," LSE Research Online Documents on Economics 128215, London School of Economics and Political Science, LSE Library.
    20. Anning Wang & Qiang Zhang & Shuangyao Zhao & Xiaonong Lu & Zhanglin Peng, 2020. "A review-driven customer preference measurement model for product improvement: sentiment-based importance–performance analysis," Information Systems and e-Business Management, Springer, vol. 18(1), pages 61-88, March.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ijrema:v:42:y:2025:i:2:p:467-486. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/international-journal-of-research-in-marketing/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.