IDEAS home Printed from https://ideas.repec.org/a/bla/popmgt/v32y2023i11p3752-3772.html
   My bibliography  Save this article

Designing contests for data science competitions: Number of stages and the prize structures

Author

Listed:
  • Jialu Liu
  • Keehyung Kim

Abstract

Firms have been proactively holding data science competitions via online contest platforms to look for innovative solutions from the crowd. When firms are designing such competitions, a key question is “What should be a better contest design to motivate contestants to exert more effort?” We model two commonly observed contest structures (one stage and two stage) and two widely adopted prize structures (high spread and low spread). We employ economic experiments to examine how contest design affects contestants’ effort level. The results reject the base model with rationality assumption. We find that contestants exert significantly more effort in both the first stage and the second stage of the two‐stage contest. Moreover, it is better to assign most prizes to the winner in the two‐stage contest while it does not matter in one stage. To explain the empirical regularities, we develop a behavioral economics model that captures contestants’ psychological aversion to falling behind and continuous exertion of effort. Our findings demonstrate that it is important for contest organizers to account for the nonpecuniary factors that can influence contestants’ behavior in designing a competition.

Suggested Citation

  • Jialu Liu & Keehyung Kim, 2023. "Designing contests for data science competitions: Number of stages and the prize structures," Production and Operations Management, Production and Operations Management Society, vol. 32(11), pages 3752-3772, November.
  • Handle: RePEc:bla:popmgt:v:32:y:2023:i:11:p:3752-3772
    DOI: 10.1111/poms.14061
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/poms.14061
    Download Restriction: no

    File URL: https://libkey.io/10.1111/poms.14061?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Benny Moldovanu & Aner Sela, 2008. "The Optimal Allocation of Prizes in Contests," Springer Books, in: Roger D. Congleton & Arye L. Hillman & Kai A. Konrad (ed.), 40 Years of Research on Rent Seeking 1, pages 615-631, Springer.
    2. Ernst Fehr & Georg Kirchsteiger & Arno Riedl, 1993. "Does Fairness Prevent Market Clearing? An Experimental Investigation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 108(2), pages 437-459.
    3. Maurice E. Schweitzer & Gérard P. Cachon, 2000. "Decision Bias in the Newsvendor Problem with a Known Demand Distribution: Experimental Evidence," Management Science, INFORMS, vol. 46(3), pages 404-420, March.
    4. Steve Alpern & J. V. Howard, 2017. "Winner-Take-All Games: The Strategic Optimisation of Rank," Operations Research, INFORMS, vol. 65(5), pages 1165-1176, October.
    5. Shunyuan Zhang & Param Vir Singh & Anindya Ghose, 2019. "A Structural Analysis of the Role of Superstars in Crowdsourcing Contests," Service Science, INFORMS, vol. 30(1), pages 15-33, March.
    6. Thaler, Richard H, 1988. "Anomalies: The Winner's Curse," Journal of Economic Perspectives, American Economic Association, vol. 2(1), pages 191-202, Winter.
    7. Alannah Orrison & Andrew Schotter & Keith Weigelt, 2004. "Multiperson Tournaments: An Experimental Examination," Management Science, INFORMS, vol. 50(2), pages 268-279, February.
    8. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    9. Kevin Chung & Keehyung Kim & Noah Lim, 2020. "Social Structures and Reputation in Expert Review Systems," Management Science, INFORMS, vol. 66(7), pages 3249-3276, July.
    10. Samuelson, William & Zeckhauser, Richard, 1988. "Status Quo Bias in Decision Making," Journal of Risk and Uncertainty, Springer, vol. 1(1), pages 7-59, March.
    11. Steffen Altmann & Armin Falk & Matthias Wibral, 2012. "Promotions and Incentives: The Case of Multistage Elimination Tournaments," Journal of Labor Economics, University of Chicago Press, vol. 30(1), pages 149-174.
    12. Harbring, Christine & Irlenbusch, Bernd, 2003. "An experimental study on tournament design," Labour Economics, Elsevier, vol. 10(4), pages 443-464, August.
    13. Christian Deutscher & Marco Sahm & Sandra Schneemann & Hendrik Sonnabend, 2022. "Strategic investment decisions in multi-stage contests with heterogeneous players," Theory and Decision, Springer, vol. 93(2), pages 281-317, September.
    14. Andrew M. Davis & Kyle Hyndman, 2018. "An Experimental Investigation of Managing Quality Through Monetary and Relational Incentives," Management Science, INFORMS, vol. 64(5), pages 2345-2365, May.
    15. Shakun D. Mago & Roman M. Sheremeta, 2019. "New Hampshire Effect: behavior in sequential and simultaneous multi-battle contests," Experimental Economics, Springer;Economic Science Association, vol. 22(2), pages 325-349, June.
    16. Emmanuel Dechenaux & Dan Kovenock & Roman Sheremeta, 2015. "A survey of experimental research on contests, all-pay auctions and tournaments," Experimental Economics, Springer;Economic Science Association, vol. 18(4), pages 609-669, December.
    17. Charness, Gary & Gneezy, Uri & Henderson, Austin, 2018. "Experimental methods: Measuring effort in economics experiments," Journal of Economic Behavior & Organization, Elsevier, vol. 149(C), pages 74-87.
    18. David Gill & Victoria Prowse, 2012. "A Structural Analysis of Disappointment Aversion in a Real Effort Competition," American Economic Review, American Economic Association, vol. 102(1), pages 469-503, February.
    19. Rudi Stracke & Wolfgang Höchtl & Rudolf Kerschbamer & Uwe Sunde, 2015. "Incentives and Selection in Promotion Contests: Is It Possible to Kill Two Birds with One Stone?," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 36(5), pages 275-285, July.
    20. Bull, Clive & Schotter, Andrew & Weigelt, Keith, 1987. "Tournaments and Piece Rates: An Experimental Study," Journal of Political Economy, University of Chicago Press, vol. 95(1), pages 1-33, February.
    21. Lakshminarayana Nittala & Sanjiv Erat & Vish Krishnan, 2022. "Designing internal innovation contests," Production and Operations Management, Production and Operations Management Society, vol. 31(5), pages 1963-1976, May.
    22. Josse Delfgaauw & Robert Dur & Arjan Non & Willem Verbeke, 2015. "The Effects of Prize Spread and Noise in Elimination Tournaments: A Natural Field Experiment," Journal of Labor Economics, University of Chicago Press, vol. 33(3), pages 521-569.
    23. Andrew M. Davis & Vishal Gaur & Dayoung Kim, 2021. "Consumer Learning from Own Experience and Social Information: An Experimental Study," Management Science, INFORMS, vol. 67(5), pages 2924-2943, May.
    24. Andrew M. Davis & Elena Katok & Natalia Santamaría, 2014. "Push, Pull, or Both? A Behavioral Study of How the Allocation of Inventory Risk Affects Channel Efficiency," Management Science, INFORMS, vol. 60(11), pages 2666-2683, November.
    25. Michael Becker‐Peth & Kai Hoberg & Margarita Protopappa‐Sieke, 2020. "Multiperiod Inventory Management with Budget Cycles: Rational and Behavioral Decision‐Making," Production and Operations Management, Production and Operations Management Society, vol. 29(3), pages 643-663, March.
    26. Guillaume Roels & Xuanming Su, 2014. "Optimal Design of Social Comparison Effects: Setting Reference Groups and Reference Points," Management Science, INFORMS, vol. 60(3), pages 606-627, March.
    27. Masatlioglu, Yusufcan & Ok, Efe A., 2005. "Rational choice with status quo bias," Journal of Economic Theory, Elsevier, vol. 121(1), pages 1-29, March.
    28. Xiaoyang Long & Javad Nasiry & Yaozhong Wu, 2020. "A Behavioral Study on Abandonment Decisions in Multistage Projects," Management Science, INFORMS, vol. 66(5), pages 1999-2016, May.
    29. Laurence Ales & Soo‐Haeng Cho & Ersin Körpeoğlu, 2021. "Innovation Tournaments with Multiple Contributors," Production and Operations Management, Production and Operations Management Society, vol. 30(6), pages 1772-1784, June.
    30. Fernandez, Raquel & Rodrik, Dani, 1991. "Resistance to Reform: Status Quo Bias in the Presence of Individual-Specific Uncertainty," American Economic Review, American Economic Association, vol. 81(5), pages 1146-1155, December.
    31. Nirup Menon & Anant Mishra & Shun Ye, 2020. "Beyond Related Experience: Upstream vs. Downstream Experience in Innovation Contest Platforms with Interdependent Problem Domains," Manufacturing & Service Operations Management, INFORMS, vol. 22(5), pages 1045-1065, September.
    32. Hua Chen & Sung H. Ham & Noah Lim, 2011. "Designing Multiperson Tournaments with Asymmetric Contestants: An Experimental Study," Management Science, INFORMS, vol. 57(5), pages 864-883, May.
    33. Gary E. Bolton & Elena Katok, 2008. "Learning by Doing in the Newsvendor Problem: A Laboratory Investigation of the Role of Experience and Feedback," Manufacturing & Service Operations Management, INFORMS, vol. 10(3), pages 519-538, September.
    34. Joel O. Wooten, 2022. "Leaps in innovation and the Bannister effect in contests," Production and Operations Management, Production and Operations Management Society, vol. 31(6), pages 2646-2663, June.
    35. Tat Koon Koh, 2019. "Adopting Seekers’ Solution Exemplars in Crowdsourcing Ideation Contests: Antecedents and Consequences," Information Systems Research, INFORMS, vol. 30(2), pages 486-506, June.
    36. Andrew M. Davis, 2015. "An Experimental Investigation of Pull Contracts in Supply Chains," Production and Operations Management, Production and Operations Management Society, vol. 24(2), pages 325-340, February.
    37. Ajay Kalra & Mengze Shi, 2001. "Designing Optimal Sales Contests: A Theoretical Perspective," Marketing Science, INFORMS, vol. 20(2), pages 170-193, December.
    38. Kostas Bimpikis & Shayan Ehsani & Mohamed Mostagir, 2019. "Designing Dynamic Contests," Operations Research, INFORMS, vol. 67(2), pages 339-356, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Emmanuel Dechenaux & Dan Kovenock & Roman Sheremeta, 2015. "A survey of experimental research on contests, all-pay auctions and tournaments," Experimental Economics, Springer;Economic Science Association, vol. 18(4), pages 609-669, December.
    2. Lauber, Arne & March, Christoph & Sahm, Marco, 2023. "Optimal and fair prizing in sequential round-robin tournaments: Experimental evidence," Games and Economic Behavior, Elsevier, vol. 141(C), pages 30-51.
    3. Bao, Zhengyang & Leibbrandt, Andreas, 2024. "Tournaments with safeguards: A blessing or a curse for women?," Journal of Economic Behavior & Organization, Elsevier, vol. 221(C), pages 292-306.
    4. Graff, Frederik & Grund, Christian & Harbring, Christine, 2021. "Competing on the Holodeck - The effect of virtual peers and heterogeneity in dynamic tournaments," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 90(C).
    5. De Paola, Maria & Gioia, Francesca & Scoppa, Vincenzo, 2018. "The adverse consequences of tournaments: Evidence from a field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 151(C), pages 1-18.
    6. Charness, Gary & Kuhn, Peter, 2011. "Lab Labor: What Can Labor Economists Learn from the Lab?," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 3, pages 229-330, Elsevier.
    7. Bedard, Kelly & Fischer, Stefanie, 2019. "Does the response to competition depend on perceived ability? Evidence from a classroom experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 159(C), pages 146-166.
    8. Hörtnagl-Pozzo, Tanja & Kerschbamer, Rudolf & Oexl, Regine & Stracke, Rudi & Sunde, Uwe, 2023. "Heterogeneity in rent-seeking contests with multiple stages: Theory and experimental evidence," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 105(C).
    9. Merve İntişah & Mürüvvet Büyükboyacı, 2024. "The role of noise variance on effort in group contests," Theory and Decision, Springer, vol. 97(2), pages 311-346, September.
    10. Yan Chen & Peter Cramton & John A. List & Axel Ockenfels, 2021. "Market Design, Human Behavior, and Management," Management Science, INFORMS, vol. 67(9), pages 5317-5348, September.
    11. Ivo Schedlinsky & Friedrich Sommer & Arnt Wöhrmann, 2016. "Risk-taking in tournaments: an experimental analysis," Journal of Business Economics, Springer, vol. 86(8), pages 837-866, November.
    12. Klein, Arnd Heinrich & Schmutzler, Armin, 2021. "Incentives and motivation in dynamic contests," Journal of Economic Behavior & Organization, Elsevier, vol. 189(C), pages 194-216.
    13. Eisenkopf, Gerald & Teyssier, Sabrina, 2013. "Envy and loss aversion in tournaments," Journal of Economic Psychology, Elsevier, vol. 34(C), pages 240-255.
    14. John A. List & Daan van Soest & Jan Stoop & Haiwen Zhou, 2020. "On the Role of Group Size in Tournaments: Theory and Evidence from Laboratory and Field Experiments," Management Science, INFORMS, vol. 66(10), pages 4359-4377, October.
    15. Simon Gächter & Lingbo Huang & Martin Sefton, 2016. "Combining “real effort” with induced effort costs: the ball-catching task," Experimental Economics, Springer;Economic Science Association, vol. 19(4), pages 687-712, December.
    16. Deck, Cary & Sheremeta, Roman M., 2019. "The tug-of-war in the laboratory," European Journal of Political Economy, Elsevier, vol. 60(C).
    17. Loukas Balafoutas & E. Glenn Dutcher & Florian Lindner & Dmitry Ryvkin, 2017. "The Optimal Allocation Of Prizes In Tournaments Of Heterogeneous Agents," Economic Inquiry, Western Economic Association International, vol. 55(1), pages 461-478, January.
    18. Gill, David & Stone, Rebecca, 2010. "Fairness and desert in tournaments," Games and Economic Behavior, Elsevier, vol. 69(2), pages 346-364, July.
    19. Llorente-Saguer, Aniol & Sheremeta, Roman M. & Szech, Nora, 2023. "Designing contests between heterogeneous contestants: An experimental study of tie-breaks and bid-caps in all-pay auctions," European Economic Review, Elsevier, vol. 154(C).
    20. Dutcher, E. Glenn & Balafoutas, Loukas & Lindner, Florian & Ryvkin, Dmitry & Sutter, Matthias, 2015. "Strive to be first or avoid being last: An experiment on relative performance incentives," Games and Economic Behavior, Elsevier, vol. 94(C), pages 39-56.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:popmgt:v:32:y:2023:i:11:p:3752-3772. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://onlinelibrary.wiley.com/journal/10.1111/(ISSN)1937-5956 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.