IDEAS home Printed from https://ideas.repec.org/a/inm/orisre/v36y2025i3p1652-1669.html

Lost Time in Crowdsourcing Contests

Author

Listed:
  • Ho Cheung Brian Lee

    (Smeal College of Business, Pennsylvania State University, University Park, Pennsylvania 16802)

  • Anant Mishra

    (Carlson School of Management, University of Minnesota, Minneapolis, Minnesota 55455)

Abstract

Crowdsourcing contests have become increasingly popular as a means of seeking innovative solutions to business problems. However, the abundance of concurrent contests on platforms can lead to disparities in solvers’ contest awareness, resulting in “lost time”—the time elapsed between the start of a contest and a solver’s first visit. This study investigates how lost time influences solvers’ submission behavior and its subsequent impact on matching inefficacy as measured by solver disqualification, which occurs when a solver fails to produce a submission meeting the seeker’s baseline criteria. Utilizing a proprietary data set from a European crowdsourcing platform, we employ a mediation analysis framework to examine the relationship between lost time and two key dimensions of submission behavior: time to first submission and number of submissions. Our findings reveal that higher levels of lost time are associated with fewer submissions, indicating reduced solver persistence. However, this negative effect is partially mitigated by solvers’ faster initial submissions when facing lost time. Importantly, we demonstrate that changes in submission behavior fully mediate the negative impact of lost time on solver disqualification, highlighting the crucial role of submission behavior in influencing solver disqualification. Furthermore, we provide evidence supporting latecomer disadvantage as an important mechanism driving solvers’ behavioral responses to lost time. Our study contributes to the crowdsourcing literature by uncovering the impact of lost time on solvers’ behavior and performance, offering valuable insights for contest design. By understanding and mitigating the effects of latecomer disadvantage, platforms can enhance the effectiveness of crowdsourcing in solving problems.

Suggested Citation

  • Ho Cheung Brian Lee & Anant Mishra, 2025. "Lost Time in Crowdsourcing Contests," Information Systems Research, INFORMS, vol. 36(3), pages 1652-1669, September.
    • Handle: RePEc:inm:orisre:v:36:y:2025:i:3:p:1652-1669
    DOI: 10.1287/isre.2022.0502
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/isre.2022.0502
    Download Restriction: no
    File URL: https://libkey.io/10.1287/isre.2022.0502?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Juncai Jiang & Yu Wang, 2020. "A Theoretical and Empirical Investigation of Feedback in Ideation Contests," Production and Operations Management, Production and Operations Management Society, vol. 29(2), pages 481-500, February.
    2. Chen Liang & Yili Hong & Bin Gu, 2017. "Home Bias in Global Employment," Working Papers 17-06, NET Institute.
    3. Kevin J. Boudreau & Karim R. Lakhani & Michael Menietti, 2016. "Performance responses to competition across skill levels in rank-order tournaments: field evidence and implications for tournament design," RAND Journal of Economics, RAND Corporation, vol. 47(1), pages 140-165, February.
    4. Chen Liang & Yili Hong & Pei-Yu Chen & Benjamin B. M. Shao, 2022. "The Screening Role of Design Parameters for Service Procurement Auctions in Online Service Outsourcing Platforms," Information Systems Research, INFORMS, vol. 33(4), pages 1324-1343, December.
    5. Mark Armstrong, 2006. "Competition in two‐sided markets," RAND Journal of Economics, RAND Corporation, vol. 37(3), pages 668-691, September.
    6. Tat Koon Koh & Muller Y. M. Cheung, 2022. "Seeker Exemplars and Quantitative Ideation Outcomes in Crowdsourcing Contests," Information Systems Research, INFORMS, vol. 33(1), pages 265-284, March.
    7. Ying-Ju Chen & Tinglong Dai & C. Gizem Korpeoglu & Ersin Körpeoğlu & Ozge Sahin & Christopher S. Tang & Shihong Xiao, 2020. "OM Forum—Innovative Online Platforms: Research Opportunities," Manufacturing & Service Operations Management, INFORMS, vol. 22(3), pages 430-445, May.
    8. James Heckman, 2013. "Sample selection bias as a specification error," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 31(3), pages 129-137.
    9. Marc Rysman, 2009. "The Economics of Two-Sided Markets," Journal of Economic Perspectives, American Economic Association, vol. 23(3), pages 125-143, Summer.
    10. Evgeny Kagan & Stephen Leider & William S. Lovejoy, 2018. "Ideation–Execution Transition in Product Development: An Experimental Analysis," Management Science, INFORMS, vol. 64(5), pages 2238-2262, May.
    11. Emmanuel Dechenaux & Dan Kovenock & Roman Sheremeta, 2015. "A survey of experimental research on contests, all-pay auctions and tournaments," Experimental Economics, Springer;Economic Science Association, vol. 18(4), pages 609-669, December.
    12. Tracy Xiao Liu & Jiang Yang & Lada A. Adamic & Yan Chen, 2014. "Crowdsourcing with All-Pay Auctions: A Field Experiment on Taskcn," Management Science, INFORMS, vol. 60(8), pages 2020-2037, August.
    13. Jean-Charles Rochet & Jean Tirole, 2003. "Platform Competition in Two-Sided Markets," Journal of the European Economic Association, MIT Press, vol. 1(4), pages 990-1029, June.
    14. Malhotra, Deepak, 2010. "The desire to win: The effects of competitive arousal on motivation and behavior," Organizational Behavior and Human Decision Processes, Elsevier, vol. 111(2), pages 139-146, March.
    15. Sungho Park & Sachin Gupta, 2012. "Handling Endogenous Regressors by Joint Estimation Using Copulas," Marketing Science, INFORMS, vol. 31(4), pages 567-586, July.
    16. Jonah Berger & Devin Pope, 2011. "Can Losing Lead to Winning?," Management Science, INFORMS, vol. 57(5), pages 817-827, May.
    17. Xiahua Wei & Ming Fan & Weijia You & Yong Tan, 2021. "An Empirical Study of the Dynamic and Differential Effects of Prefunding," Production and Operations Management, Production and Operations Management Society, vol. 30(5), pages 1331-1349, May.
    18. Jesse Bockstedt & Cheryl Druehl & Anant Mishra, 2022. "Incentives and Stars: Competition in Innovation Contests with Participant and Submission Visibility," Production and Operations Management, Production and Operations Management Society, vol. 31(3), pages 1372-1393, March.
    19. Zhaohui (Zoey) Jiang & Yan Huang & Damian R. Beil, 2021. "The Role of Problem Specification in Crowdsourcing Contests for Design Problems: A Theoretical and Empirical Analysis," Manufacturing & Service Operations Management, INFORMS, vol. 23(3), pages 637-656, May.
    20. Joel O. Wooten & Karl T. Ulrich, 2017. "Idea Generation and the Role of Feedback: Evidence from Field Experiments with Innovation Tournaments," Production and Operations Management, Production and Operations Management Society, vol. 26(1), pages 80-99, January.
    21. Christian Terwiesch & Yi Xu, 2008. "Innovation Contests, Open Innovation, and Multiagent Problem Solving," Management Science, INFORMS, vol. 54(9), pages 1529-1543, September.
    22. Jorge Lemus & Guillermo Marshall, 2021. "Dynamic Tournament Design: Evidence from Prediction Contests," Journal of Political Economy, University of Chicago Press, vol. 129(2), pages 383-420.
    23. Ho Cheung Brian Lee & Sulin Ba & Xinxin Li & Jan Stallaert, 2018. "Salience Bias in Crowdsourcing Contests," Information Systems Research, INFORMS, vol. 29(2), pages 401-418, June.
    24. Yan Huang & Param Vir Singh & Kannan Srinivasan, 2014. "Crowdsourcing New Product Ideas Under Consumer Learning," Management Science, INFORMS, vol. 60(9), pages 2138-2159, September.
    25. Kevin J. Boudreau & Nicola Lacetera & Karim R. Lakhani, 2011. "Incentives and Problem Uncertainty in Innovation Contests: An Empirical Analysis," Management Science, INFORMS, vol. 57(5), pages 843-863, May.
    26. Uri Simonsohn, 2010. "eBay's Crowded Evenings: Competition Neglect in Market Entry Decisions," Management Science, INFORMS, vol. 56(7), pages 1060-1073, July.
    27. Lars Bo Jeppesen & Karim R. Lakhani, 2010. "Marginality and Problem-Solving Effectiveness in Broadcast Search," Organization Science, INFORMS, vol. 21(5), pages 1016-1033, October.
    28. Xue Bai & James R. Marsden & William T. Ross & Gang Wang, 2020. "A Note on the Impact of Daily Deals on Local Retailers’ Online Reputation: Mediation Effects of the Consumer Experience," Information Systems Research, INFORMS, vol. 31(4), pages 1132-1143, December.
    29. Swanand J. Deodhar & Samrat Gupta, 2023. "The Impact of Social Reputation Features in Innovation Tournaments: Evidence from a Natural Experiment," Information Systems Research, INFORMS, vol. 34(1), pages 178-193, March.
    30. Isabel Maria Bodas Freitas & Cornelia Lawson, 2019. "Imprints from idea origin on innovation and the development environment," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 28(6), pages 1533-1553.
    31. Barry L. Bayus, 2013. "Crowdsourcing New Product Ideas over Time: An Analysis of the Dell IdeaStorm Community," Management Science, INFORMS, vol. 59(1), pages 226-244, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jesse Bockstedt & Cheryl Druehl & Anant Mishra, 2022. "Incentives and Stars: Competition in Innovation Contests with Participant and Submission Visibility," Production and Operations Management, Production and Operations Management Society, vol. 31(3), pages 1372-1393, March.
    2. Ho Cheung Brian Lee & Sulin Ba & Xinxin Li & Jan Stallaert, 2018. "Salience Bias in Crowdsourcing Contests," Information Systems Research, INFORMS, vol. 29(2), pages 401-418, June.
    3. Swanand J. Deodhar & Samrat Gupta, 2023. "The Impact of Social Reputation Features in Innovation Tournaments: Evidence from a Natural Experiment," Information Systems Research, INFORMS, vol. 34(1), pages 178-193, March.
    4. Jörg Claussen & Maria A. Halbinger & Lior Zalmanson, 2026. "Challenge Accepted: The Effects of Contest Participation on a User-Generated Content Community," Manufacturing & Service Operations Management, INFORMS, vol. 28(2), pages 421-439, March.
    5. Yuan Jin & Ho Cheung Brian Lee & Sulin Ba & Jan Stallaert, 2021. "Winning by Learning? Effect of Knowledge Sharing in Crowdsourcing Contests," Information Systems Research, INFORMS, vol. 32(3), pages 836-859, September.
    6. Tat Koon Koh & Muller Y. M. Cheung, 2022. "Seeker Exemplars and Quantitative Ideation Outcomes in Crowdsourcing Contests," Information Systems Research, INFORMS, vol. 33(1), pages 265-284, March.
    7. Tat Koon Koh, 2025. "“Optimal” Feedback Use in Crowdsourcing Contests: Source Effect and Priming Intervention," Organization Science, INFORMS, vol. 36(4), pages 1489-1508, July.
    8. Pallab Sanyal & Shun Ye, 2024. "An Examination of the Dynamics of Crowdsourcing Contests: Role of Feedback Type," Information Systems Research, INFORMS, vol. 35(1), pages 394-413, March.
    9. Patel, Chirag & Ahmad Husairi, Mariyani & Haon, Christophe & Oberoi, Poonam, 2023. "Monetary rewards and self-selection in design crowdsourcing contests: Managing participation, contribution appropriateness, and winning trade-offs," Technological Forecasting and Social Change, Elsevier, vol. 191(C).
    10. Jiao, Yuanyuan & Wu, Yepeng & Lu, Steven, 2021. "The role of crowdsourcing in product design: The moderating effect of user expertise and network connectivity," Technology in Society, Elsevier, vol. 64(C).
    11. Hu, Feng & Bijmolt, Tammo H.A. & Huizingh, Eelko K.R.E., 2020. "The impact of innovation contest briefs on the quality of solvers and solutions," Technovation, Elsevier, vol. 90.
    12. Dargahi, Rambod & Namin, Aidin & Ketron, Seth C. & Saint Clair, Julian K., 2021. "Is self-knowledge the ultimate prize? A quantitative analysis of participation choice in online ideation crowdsourcing contests," Journal of Retailing and Consumer Services, Elsevier, vol. 62(C).
    13. Nirup Menon & Anant Mishra & Shun Ye, 2020. "Beyond Related Experience: Upstream vs. Downstream Experience in Innovation Contest Platforms with Interdependent Problem Domains," Manufacturing & Service Operations Management, INFORMS, vol. 22(5), pages 1045-1065, September.
    14. Pescher, Christian & Tellis, Gerard J. & Füller, Johann, 2025. "Ideators’ success in innovation tournaments: Participation, productivity, or pressure?," International Journal of Research in Marketing, Elsevier, vol. 42(2), pages 335-364.
    15. Joel O. Wooten, 2022. "Leaps in innovation and the Bannister effect in contests," Production and Operations Management, Production and Operations Management Society, vol. 31(6), pages 2646-2663, June.
    16. Andreas H. Heusler & Natasha Z. Foutz & Martin Spann & Lucas Stich, 2025. "The idea marketplace: Diversity, social capital, and innovation," Journal of the Academy of Marketing Science, Springer, vol. 53(1), pages 150-171, January.
    17. repec:eee:respol:v:48:y:2019:i:8:p:- is not listed on IDEAS
    18. Christoph Riedl & Victor P. Seidel, 2018. "Learning from Mixed Signals in Online Innovation Communities," Organization Science, INFORMS, vol. 29(6), pages 1010-1032, December.
    19. Dominik Mahr & Aric Rindfleisch & Rebecca Slotegraaf, 2015. "Enhancing Crowdsourcing Success: the Role of Creative and Deliberate Problem-Solving Styles," Customer Needs and Solutions, Springer;Institute for Sustainable Innovation and Growth (iSIG), vol. 2(3), pages 209-221, September.
    20. Shunyuan Zhang & Param Vir Singh & Anindya Ghose, 2019. "A Structural Analysis of the Role of Superstars in Crowdsourcing Contests," Service Science, INFORMS, vol. 30(1), pages 15-33, March.
    21. Abhishek Nagaraj & Henning Piezunka, 2024. "The Divergent Effect of Competition on Platforms: Deterring Recruits, Motivating Converts," Strategy Science, INFORMS, vol. 9(3), pages 277-296, September.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:orisre:v:36:y:2025:i:3:p:1652-1669. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.