IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v68y2022i6p4261-4278.html

When to Be Agile: Ratings and Version Updates in Mobile Apps

Author

Listed:
  • Gad Allon

    (The Wharton School, University of Pennsylvania, Philadelphia, Pennsylvania 19104)

  • Georgios Askalidis

    (Northwestern University, Evanston, Illinois 60208)

  • Randall Berry

    (Northwestern University, Evanston, Illinois 60208)

  • Nicole Immorlica

    (Microsoft Research, Redmond, Washington 98052)

  • Ken Moon

    (The Wharton School, University of Pennsylvania, Philadelphia, Pennsylvania 19104)

  • Amandeep Singh

    (The Wharton School, University of Pennsylvania, Philadelphia, Pennsylvania 19104)

Abstract

Lean and agile models of product development organize the flexible capacity to rapidly update individual products in response to customer feedback. Although agile operations have been adopted across numerous industries, neither the benefits nor the factors explaining when firms choose to become agile are validated and understood. We study these questions using data on the development of mobile apps, which occurs through the dynamic release of new versions into the mobile app marketplace, and the apps’ customer ratings. We develop a structural model estimating the dependence of product versioning on (a) market feedback in the form of customer ratings against (b) project and work-based considerations, such as development timelines, scale economies, and operational constraints. In contrast to when they actually benefit from operational agility, firms become agile when launching riskier products (in terms of uncertainty in initial customer reception) and less agile when they are able to exploit scale economies from coordinating development over a portfolio of apps. Agile operations increase firm payoffs by margins of 20% to 80%, and interestingly, partial agility is often sufficient to capture the bulk of these returns. Finally, turning to a question of marketplace design, we study how the mobile app marketplace should design the display of ratings to incentivize quality (increasing app categories’ average user satisfaction rates by as much as 22%).

Suggested Citation

  • Gad Allon & Georgios Askalidis & Randall Berry & Nicole Immorlica & Ken Moon & Amandeep Singh, 2022. "When to Be Agile: Ratings and Version Updates in Mobile Apps," Management Science, INFORMS, vol. 68(6), pages 4261-4278, June.
  • Handle: RePEc:inm:ormnsc:v:68:y:2022:i:6:p:4261-4278
    DOI: 10.1287/mnsc.2021.4112
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.2021.4112
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mnsc.2021.4112?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Svenja C. Sommer & Christoph H. Loch & Jing Dong, 2009. "Managing Complexity and Unforeseeable Uncertainty in Startup Companies: An Empirical Study," Organization Science, INFORMS, vol. 20(1), pages 118-133, February.
    2. Chrysanthos Dellarocas, 2006. "Strategic Manipulation of Internet Opinion Forums: Implications for Consumers and Firms," Management Science, INFORMS, vol. 52(10), pages 1577-1593, October.
    3. Ken Moon & Kostas Bimpikis & Haim Mendelson, 2018. "Randomized Markdowns and Online Monitoring," Management Science, INFORMS, vol. 64(3), pages 1271-1290, March.
    4. Drew Fudenberg & Jean Tirole, 1998. "Upgrades, Tradeins, and Buybacks," RAND Journal of Economics, The RAND Corporation, vol. 29(2), pages 235-258, Summer.
    5. Christoph H. Loch & Christian Terwiesch & Stefan Thomke, 2001. "Parallel and Sequential Testing of Design Alternatives," Management Science, INFORMS, vol. 47(5), pages 663-678, May.
    6. Vish Krishnan & Karthik Ramachandran, 2011. "Integrated Product Architecture and Pricing for Managing Sequential Innovation," Management Science, INFORMS, vol. 57(11), pages 2040-2053, November.
    7. Anirudh Dhebar, 1994. "Durable-Goods Monopolists, Rational Consumers, and Improving Products," Marketing Science, INFORMS, vol. 13(1), pages 100-120.
    8. Sanjiv Erat & Stylianos Kavadias, 2008. "Sequential Testing of Product Designs: Implications for Learning," Management Science, INFORMS, vol. 54(5), pages 956-968, May.
    9. Haim Mendelson, 2000. "Organizational Architecture and Success in the Information Technology Industry," Management Science, INFORMS, vol. 46(4), pages 513-529, April.
    10. Christian Terwiesch & Yi Xu, 2008. "Innovation Contests, Open Innovation, and Multiagent Problem Solving," Management Science, INFORMS, vol. 54(9), pages 1529-1543, September.
    11. Chris Forman & Anindya Ghose & Batia Wiesenfeld, 2008. "Examining the Relationship Between Reviews and Sales: The Role of Reviewer Identity Disclosure in Electronic Markets," Information Systems Research, INFORMS, vol. 19(3), pages 291-313, September.
    12. Kevin J. Boudreau & Nicola Lacetera & Karim R. Lakhani, 2011. "Incentives and Problem Uncertainty in Innovation Contests: An Empirical Analysis," Management Science, INFORMS, vol. 57(5), pages 843-863, May.
    13. Nicholas C. Petruzzi & Maqbool Dada, 2001. "Information and Inventory Recourse for a Two-Market, Price-Setting Retailer," Manufacturing & Service Operations Management, INFORMS, vol. 3(3), pages 242-263, October.
    14. Chrysanthos Dellarocas, 2005. "Reputation Mechanism Design in Online Trading Environments with Pure Moral Hazard," Information Systems Research, INFORMS, vol. 16(2), pages 209-230, June.
    15. Alan MacCormack & Roberto Verganti & Marco Iansiti, 2001. "Developing Products on "Internet Time": The Anatomy of a Flexible Development Process," Management Science, INFORMS, vol. 47(1), pages 133-150, January.
    16. Xinxin Li & Lorin M. Hitt, 2008. "Self-Selection and Information Role of Online Product Reviews," Information Systems Research, INFORMS, vol. 19(4), pages 456-474, December.
    17. Rajiv D. Banker & Sandra A. Slaughter, 1997. "A Field Study of Scale Economies in Software Maintenance," Management Science, INFORMS, vol. 43(12), pages 1709-1725, December.
    18. Serguei Netessine & Terry A. Taylor, 2007. "Product Line Design and Production Technology," Marketing Science, INFORMS, vol. 26(1), pages 101-117, 01-02.
    19. Marshall Fisher & Kamalini Ramdas & Karl Ulrich, 1999. "Component Sharing in the Management of Product Variety: A Study of Automotive Braking Systems," Management Science, INFORMS, vol. 45(3), pages 297-315, March.
    20. V. Krishnan & Karl T. Ulrich, 2001. "Product Development Decisions: A Review of the Literature," Management Science, INFORMS, vol. 47(1), pages 1-21, January.
    21. Donald E. Harter & Mayuram S. Krishnan & Sandra A. Slaughter, 2000. "Effects of Process Maturity on Quality, Cycle Time, and Effort in Software Product Development," Management Science, INFORMS, vol. 46(4), pages 451-466, April.
    22. Christian Terwiesch & Christoph H. Loch, 1999. "Measuring the Effectiveness of Overlapping Development Activities," Management Science, INFORMS, vol. 45(4), pages 455-465, April.
    23. Zeynep Akşin & Barış Ata & Seyed Morteza Emadi & Che-Lin Su, 2013. "Structural Estimation of Callers' Delay Sensitivity in Call Centers," Management Science, INFORMS, vol. 59(12), pages 2727-2746, December.
    24. Gad Allon & Awi Federgruen & Margaret Pierson, 2011. "How Much Is a Reduction of Your Customers' Wait Worth? An Empirical Study of the Fast-Food Drive-Thru Industry Based on Structural Estimation Methods," Manufacturing & Service Operations Management, INFORMS, vol. 13(4), pages 489-507, October.
    25. Daniel Ackerberg, 2009. "A new use of importance sampling to reduce computational burden in simulation estimation," Quantitative Marketing and Economics (QME), Springer, vol. 7(4), pages 343-376, December.
    26. Luís Cabral & Ali Hortaçsu, 2010. "The Dynamics Of Seller Reputation: Evidence From Ebay," Journal of Industrial Economics, Wiley Blackwell, vol. 58(1), pages 54-78, March.
    27. Hemant K. Bhargava & Vidyanand Choudhary, 2008. "Research Note--When Is Versioning Optimal for Information Goods?," Management Science, INFORMS, vol. 54(5), pages 1029-1035, May.
    28. Jun Li & Nelson Granados & Serguei Netessine, 2014. "Are Consumers Strategic? Structural Estimation from the Air-Travel Industry," Management Science, INFORMS, vol. 60(9), pages 2114-2137, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Wu, Xiangxiang & Zha, Yong, 2025. "App release strategy in the presence of competitive platforms’ quality upgrades," European Journal of Operational Research, Elsevier, vol. 320(3), pages 570-580.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sıdıka Tunç Candoğan & Philipp B. Cornelius & Bilal Gokpinar & Ersin Körpeoğlu & Christopher S. Tang, 2024. "Product Development in Crowdfunding: Theoretical and Empirical Analysis," Manufacturing & Service Operations Management, INFORMS, vol. 26(2), pages 701-721, March.
    2. Linyi Li & Shyam Gopinath & Stephen J. Carson, 2022. "History Matters: The Impact of Online Customer Reviews Across Product Generations," Management Science, INFORMS, vol. 68(5), pages 3878-3903, May.
    3. Dominik Gutt & Jürgen Neumann & Steffen Zimmermann & Dennis Kundisch & Jianqing Chen, 2018. "Design of Review Systems - A Strategic Instrument to shape Online Review Behavior and Economic Outcomes," Working Papers Dissertations 42, Paderborn University, Faculty of Business Administration and Economics.
    4. Sreekumar Bhaskaran & S. Sinan Erzurumlu & Karthik Ramachandran, 2021. "Sequential Product Development and Introduction by Cash-Constrained Start-Ups," Manufacturing & Service Operations Management, INFORMS, vol. 23(6), pages 1505-1523, November.
    5. Jochen Schlapp & Nektarios Oraiopoulos & Vincent Mak, 2015. "Resource Allocation Decisions Under Imperfect Evaluation and Organizational Dynamics," Management Science, INFORMS, vol. 61(9), pages 2139-2159, September.
    6. Liu, Jingchen & Zhai, Xin & Chen, Lihua, 2019. "Optimal pricing strategy under trade-in program in the presence of strategic consumers," Omega, Elsevier, vol. 84(C), pages 1-17.
    7. Onesun Steve Yoo & Tingliang Huang & Kenan Arifoğlu, 2021. "A Theoretical Analysis of the Lean Start-up Method," Marketing Science, INFORMS, vol. 40(3), pages 395-412, May.
    8. Teck-Hua Ho & Noah Lim & Sadat Reza & Xiaoyu Xia, 2017. "OM Forum—Causal Inference Models in Operations Management," Manufacturing & Service Operations Management, INFORMS, vol. 19(4), pages 509-525, October.
    9. Nilam Kaushik & Bilal Gokpinar, 2023. "Sequential Innovation in Mobile App Development," Manufacturing & Service Operations Management, INFORMS, vol. 25(1), pages 182-199, January.
    10. Kristina Brecko, 2023. "New Features Free of Charge? Intertemporal Product Versions and Pricing in the Software Market," Marketing Science, INFORMS, vol. 42(1), pages 61-86, January.
    11. Yixin (Iris) Wang & Jun Li & Ravi Anupindi, 2023. "Manufacturing and Regulatory Barriers to Generic Drug Competition: A Structural Model Approach," Management Science, INFORMS, vol. 69(3), pages 1449-1467, March.
    12. Zhen Li & Aoi Shimizu, 2018. "Impact of Online Customer Reviews on Sales Outcomes: An Empirical Study Based on Prospect Theory," The Review of Socionetwork Strategies, Springer, vol. 12(2), pages 135-151, December.
    13. Hallie S. Cho & Manuel E. Sosa & Sameer Hasija, 2022. "Reading Between the Stars: Understanding the Effects of Online Customer Reviews on Product Demand," Manufacturing & Service Operations Management, INFORMS, vol. 24(4), pages 1977-1996, July.
    14. Liu, Jingchen & Zhai, Xin & Chen, Lihua, 2018. "The interaction between product rollover strategy and pricing scheme," International Journal of Production Economics, Elsevier, vol. 201(C), pages 116-135.
    15. Christian Terwiesch & Marcelo Olivares & Bradley R. Staats & Vishal Gaur, 2020. "OM Forum—A Review of Empirical Operations Management over the Last Two Decades," Manufacturing & Service Operations Management, INFORMS, vol. 22(4), pages 656-668, July.
    16. Xitong Li, 2018. "Impact of Average Rating on Social Media Endorsement: The Moderating Role of Rating Dispersion and Discount Threshold," Information Systems Research, INFORMS, vol. 29(3), pages 739-754, September.
    17. Jochen Schlapp & Gerrit Schumacher, 2022. "Delegated Concept Testing in New Product Development," Operations Research, INFORMS, vol. 70(5), pages 2732-2748, September.
    18. Stylianos Kavadias & Karl T. Ulrich, 2020. "Innovation and New Product Development: Reflections and Insights from the Research Published in the First 20 Years of Manufacturing & Service Operations Management," Manufacturing & Service Operations Management, INFORMS, vol. 22(1), pages 84-92, January.
    19. Sreekumar Bhaskaran & Sanjiv Erat, 2025. "Optimal Prototyping with Noisy Measurements," Manufacturing & Service Operations Management, INFORMS, vol. 27(1), pages 322-338, January.
    20. Pnina Feldman & Jun Li & Hsin-Tien Tsai, 2022. "Welfare Implications of Congestion Pricing: Evidence from SF park," Manufacturing & Service Operations Management, INFORMS, vol. 24(2), pages 1091-1109, March.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:68:y:2022:i:6:p:4261-4278. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.