IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v68y2022i6p4261-4278.html
   My bibliography  Save this article

When to Be Agile: Ratings and Version Updates in Mobile Apps

Author

Listed:
  • Gad Allon

    (The Wharton School, University of Pennsylvania, Philadelphia, Pennsylvania 19104)

  • Georgios Askalidis

    (Northwestern University, Evanston, Illinois 60208)

  • Randall Berry

    (Northwestern University, Evanston, Illinois 60208)

  • Nicole Immorlica

    (Microsoft Research, Redmond, Washington 98052)

  • Ken Moon

    (The Wharton School, University of Pennsylvania, Philadelphia, Pennsylvania 19104)

  • Amandeep Singh

    (The Wharton School, University of Pennsylvania, Philadelphia, Pennsylvania 19104)

Abstract

Lean and agile models of product development organize the flexible capacity to rapidly update individual products in response to customer feedback. Although agile operations have been adopted across numerous industries, neither the benefits nor the factors explaining when firms choose to become agile are validated and understood. We study these questions using data on the development of mobile apps, which occurs through the dynamic release of new versions into the mobile app marketplace, and the apps’ customer ratings. We develop a structural model estimating the dependence of product versioning on (a) market feedback in the form of customer ratings against (b) project and work-based considerations, such as development timelines, scale economies, and operational constraints. In contrast to when they actually benefit from operational agility, firms become agile when launching riskier products (in terms of uncertainty in initial customer reception) and less agile when they are able to exploit scale economies from coordinating development over a portfolio of apps. Agile operations increase firm payoffs by margins of 20% to 80%, and interestingly, partial agility is often sufficient to capture the bulk of these returns. Finally, turning to a question of marketplace design, we study how the mobile app marketplace should design the display of ratings to incentivize quality (increasing app categories’ average user satisfaction rates by as much as 22%).

Suggested Citation

  • Gad Allon & Georgios Askalidis & Randall Berry & Nicole Immorlica & Ken Moon & Amandeep Singh, 2022. "When to Be Agile: Ratings and Version Updates in Mobile Apps," Management Science, INFORMS, vol. 68(6), pages 4261-4278, June.
  • Handle: RePEc:inm:ormnsc:v:68:y:2022:i:6:p:4261-4278
    DOI: 10.1287/mnsc.2021.4112
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.2021.4112
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mnsc.2021.4112?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Svenja C. Sommer & Christoph H. Loch & Jing Dong, 2009. "Managing Complexity and Unforeseeable Uncertainty in Startup Companies: An Empirical Study," Organization Science, INFORMS, vol. 20(1), pages 118-133, February.
    2. Chrysanthos Dellarocas, 2006. "Strategic Manipulation of Internet Opinion Forums: Implications for Consumers and Firms," Management Science, INFORMS, vol. 52(10), pages 1577-1593, October.
    3. Ken Moon & Kostas Bimpikis & Haim Mendelson, 2018. "Randomized Markdowns and Online Monitoring," Management Science, INFORMS, vol. 64(3), pages 1271-1290, March.
    4. Drew Fudenberg & Jean Tirole, 1998. "Upgrades, Tradeins, and Buybacks," RAND Journal of Economics, The RAND Corporation, vol. 29(2), pages 235-258, Summer.
    5. Christoph H. Loch & Christian Terwiesch & Stefan Thomke, 2001. "Parallel and Sequential Testing of Design Alternatives," Management Science, INFORMS, vol. 47(5), pages 663-678, May.
    6. Vish Krishnan & Karthik Ramachandran, 2011. "Integrated Product Architecture and Pricing for Managing Sequential Innovation," Management Science, INFORMS, vol. 57(11), pages 2040-2053, November.
    7. Anirudh Dhebar, 1994. "Durable-Goods Monopolists, Rational Consumers, and Improving Products," Marketing Science, INFORMS, vol. 13(1), pages 100-120.
    8. Sanjiv Erat & Stylianos Kavadias, 2008. "Sequential Testing of Product Designs: Implications for Learning," Management Science, INFORMS, vol. 54(5), pages 956-968, May.
    9. Haim Mendelson, 2000. "Organizational Architecture and Success in the Information Technology Industry," Management Science, INFORMS, vol. 46(4), pages 513-529, April.
    10. Christian Terwiesch & Yi Xu, 2008. "Innovation Contests, Open Innovation, and Multiagent Problem Solving," Management Science, INFORMS, vol. 54(9), pages 1529-1543, September.
    11. Chris Forman & Anindya Ghose & Batia Wiesenfeld, 2008. "Examining the Relationship Between Reviews and Sales: The Role of Reviewer Identity Disclosure in Electronic Markets," Information Systems Research, INFORMS, vol. 19(3), pages 291-313, September.
    12. Kevin J. Boudreau & Nicola Lacetera & Karim R. Lakhani, 2011. "Incentives and Problem Uncertainty in Innovation Contests: An Empirical Analysis," Management Science, INFORMS, vol. 57(5), pages 843-863, May.
    13. Nicholas C. Petruzzi & Maqbool Dada, 2001. "Information and Inventory Recourse for a Two-Market, Price-Setting Retailer," Manufacturing & Service Operations Management, INFORMS, vol. 3(3), pages 242-263, October.
    14. Chrysanthos Dellarocas, 2005. "Reputation Mechanism Design in Online Trading Environments with Pure Moral Hazard," Information Systems Research, INFORMS, vol. 16(2), pages 209-230, June.
    15. Xinxin Li & Lorin M. Hitt, 2008. "Self-Selection and Information Role of Online Product Reviews," Information Systems Research, INFORMS, vol. 19(4), pages 456-474, December.
    16. Rajiv D. Banker & Sandra A. Slaughter, 1997. "A Field Study of Scale Economies in Software Maintenance," Management Science, INFORMS, vol. 43(12), pages 1709-1725, December.
    17. Serguei Netessine & Terry A. Taylor, 2007. "Product Line Design and Production Technology," Marketing Science, INFORMS, vol. 26(1), pages 101-117, 01-02.
    18. Marshall Fisher & Kamalini Ramdas & Karl Ulrich, 1999. "Component Sharing in the Management of Product Variety: A Study of Automotive Braking Systems," Management Science, INFORMS, vol. 45(3), pages 297-315, March.
    19. V. Krishnan & Karl T. Ulrich, 2001. "Product Development Decisions: A Review of the Literature," Management Science, INFORMS, vol. 47(1), pages 1-21, January.
    20. Donald E. Harter & Mayuram S. Krishnan & Sandra A. Slaughter, 2000. "Effects of Process Maturity on Quality, Cycle Time, and Effort in Software Product Development," Management Science, INFORMS, vol. 46(4), pages 451-466, April.
    21. Christian Terwiesch & Christoph H. Loch, 1999. "Measuring the Effectiveness of Overlapping Development Activities," Management Science, INFORMS, vol. 45(4), pages 455-465, April.
    22. Daniel Ackerberg, 2009. "A new use of importance sampling to reduce computational burden in simulation estimation," Quantitative Marketing and Economics (QME), Springer, vol. 7(4), pages 343-376, December.
    23. Zeynep Akşin & Barış Ata & Seyed Morteza Emadi & Che-Lin Su, 2013. "Structural Estimation of Callers' Delay Sensitivity in Call Centers," Management Science, INFORMS, vol. 59(12), pages 2727-2746, December.
    24. Gad Allon & Awi Federgruen & Margaret Pierson, 2011. "How Much Is a Reduction of Your Customers' Wait Worth? An Empirical Study of the Fast-Food Drive-Thru Industry Based on Structural Estimation Methods," Manufacturing & Service Operations Management, INFORMS, vol. 13(4), pages 489-507, October.
    25. Luís Cabral & Ali Hortaçsu, 2010. "The Dynamics Of Seller Reputation: Evidence From Ebay," Journal of Industrial Economics, Wiley Blackwell, vol. 58(1), pages 54-78, March.
    26. Jun Li & Nelson Granados & Serguei Netessine, 2014. "Are Consumers Strategic? Structural Estimation from the Air-Travel Industry," Management Science, INFORMS, vol. 60(9), pages 2114-2137, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dominik Gutt & Jürgen Neumann & Steffen Zimmermann & Dennis Kundisch & Jianqing Chen, 2018. "Design of Review Systems - A Strategic Instrument to shape Online Review Behavior and Economic Outcomes," Working Papers Dissertations 42, Paderborn University, Faculty of Business Administration and Economics.
    2. Linyi Li & Shyam Gopinath & Stephen J. Carson, 2022. "History Matters: The Impact of Online Customer Reviews Across Product Generations," Management Science, INFORMS, vol. 68(5), pages 3878-3903, May.
    3. Jochen Schlapp & Nektarios Oraiopoulos & Vincent Mak, 2015. "Resource Allocation Decisions Under Imperfect Evaluation and Organizational Dynamics," Management Science, INFORMS, vol. 61(9), pages 2139-2159, September.
    4. Liu, Jingchen & Zhai, Xin & Chen, Lihua, 2019. "Optimal pricing strategy under trade-in program in the presence of strategic consumers," Omega, Elsevier, vol. 84(C), pages 1-17.
    5. Onesun Steve Yoo & Tingliang Huang & Kenan Arifoğlu, 2021. "A Theoretical Analysis of the Lean Start-up Method," Marketing Science, INFORMS, vol. 40(3), pages 395-412, May.
    6. Teck-Hua Ho & Noah Lim & Sadat Reza & Xiaoyu Xia, 2017. "OM Forum—Causal Inference Models in Operations Management," Manufacturing & Service Operations Management, INFORMS, vol. 19(4), pages 509-525, October.
    7. Yixin (Iris) Wang & Jun Li & Ravi Anupindi, 2023. "Manufacturing and Regulatory Barriers to Generic Drug Competition: A Structural Model Approach," Management Science, INFORMS, vol. 69(3), pages 1449-1467, March.
    8. Zhen Li & Aoi Shimizu, 2018. "Impact of Online Customer Reviews on Sales Outcomes: An Empirical Study Based on Prospect Theory," The Review of Socionetwork Strategies, Springer, vol. 12(2), pages 135-151, December.
    9. Pavel Kireyev, 2016. "Markets for Ideas: Prize Structure, Entry Limits, and the Design of Ideation Contests," Harvard Business School Working Papers 16-129, Harvard Business School.
    10. Sang Won Kim & Marcelo Olivares & Gabriel Y. Weintraub, 2014. "Measuring the Performance of Large-Scale Combinatorial Auctions: A Structural Estimation Approach," Management Science, INFORMS, vol. 60(5), pages 1180-1201, May.
    11. Angela Aerry Choi & Daegon Cho & Dobin Yim & Jae Yun Moon & Wonseok Oh, 2019. "When Seeing Helps Believing: The Interactive Effects of Previews and Reviews on E-Book Purchases," Information Systems Research, INFORMS, vol. 30(4), pages 1164-1183, December.
    12. Stylianos Kavadias & Svenja C. Sommer, 2009. "The Effects of Problem Structure and Team Diversity on Brainstorming Effectiveness," Management Science, INFORMS, vol. 55(12), pages 1899-1913, December.
    13. Hailiang Chen & Prabuddha De & Yu Jeffrey Hu, 2015. "IT-Enabled Broadcasting in Social Media: An Empirical Study of Artists’ Activities and Music Sales," Information Systems Research, INFORMS, vol. 26(3), pages 513-531, September.
    14. Young Kwark & Jianqing Chen & Srinivasan Raghunathan, 2014. "Online Product Reviews: Implications for Retailers and Competing Manufacturers," Information Systems Research, INFORMS, vol. 25(1), pages 93-110, March.
    15. Liu, Jingchen & Zhai, Xin & Chen, Lihua, 2018. "The interaction between product rollover strategy and pricing scheme," International Journal of Production Economics, Elsevier, vol. 201(C), pages 116-135.
    16. Kevin J. Boudreau & Nicola Lacetera & Karim R. Lakhani, 2011. "Incentives and Problem Uncertainty in Innovation Contests: An Empirical Analysis," Management Science, INFORMS, vol. 57(5), pages 843-863, May.
    17. Laurence Ales & Soo‐Haeng Cho & Ersin Körpeoğlu, 2021. "Innovation Tournaments with Multiple Contributors," Production and Operations Management, Production and Operations Management Society, vol. 30(6), pages 1772-1784, June.
    18. Christian Terwiesch & Marcelo Olivares & Bradley R. Staats & Vishal Gaur, 2020. "OM Forum—A Review of Empirical Operations Management over the Last Two Decades," Manufacturing & Service Operations Management, INFORMS, vol. 22(4), pages 656-668, July.
    19. Shunyuan Zhang & Param Vir Singh & Anindya Ghose, 2019. "A Structural Analysis of the Role of Superstars in Crowdsourcing Contests," Service Science, INFORMS, vol. 30(1), pages 15-33, March.
    20. Xitong Li, 2018. "Impact of Average Rating on Social Media Endorsement: The Moderating Role of Rating Dispersion and Discount Threshold," Information Systems Research, INFORMS, vol. 29(3), pages 739-754, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:68:y:2022:i:6:p:4261-4278. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.