IDEAS home Printed from https://ideas.repec.org/a/eee/respol/v50y2021i4s0048733321000020.html
   My bibliography  Save this article

Evaluating proposals in innovation contests: Exploring negative scoring spillovers in the absence of a strict evaluation sequence

Author

Listed:
  • Elhorst, Paul
  • Faems, Dries

Abstract

Prior research demonstrated that, when a strict evaluation sequence is present in innovation contests, the score of the previously evaluated proposal negatively influences the scoring of a subsequent proposal. In this paper, we expand our understanding of such negative scoring spillovers by analysing a setting where not only the previously evaluated proposal, but all other proposals within the same meeting can potentially contribute to negative scoring spillovers. We rely on a sample of 561 proposals in 53 publicly funded innovation contests, launched within the scope of four regional innovation programs in the Netherlands. We also introduce an alternative methodological approach with peer effects to adequately model and test the existence of negative scoring spillovers in contests where a strict evaluation sequence is absent. We provide evidence that, in such contests, proposals can mutually influence each other and that the magnitude of these spillovers depends on the design of the innovation contest. We also discuss the implications of these findings for the specific literature on innovation contests and the broader literature on evaluation spillovers in decision-making processes.

Suggested Citation

  • Elhorst, Paul & Faems, Dries, 2021. "Evaluating proposals in innovation contests: Exploring negative scoring spillovers in the absence of a strict evaluation sequence," Research Policy, Elsevier, vol. 50(4).
  • Handle: RePEc:eee:respol:v:50:y:2021:i:4:s0048733321000020
    DOI: 10.1016/j.respol.2021.104198
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0048733321000020
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.respol.2021.104198?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Charles F. Manski, 1993. "Identification of Endogenous Social Effects: The Reflection Problem," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 60(3), pages 531-542.
    2. Felipe A. Csaszar & J. P. Eggers, 2013. "Organizational Decision Making: An Information Aggregation View," Management Science, INFORMS, vol. 59(10), pages 2257-2277, October.
    3. Uwe Cantner & Sarah Kösters, 2012. "Picking the winner? Empirical evidence on the targeting of R&D subsidies to start-ups," Small Business Economics, Springer, vol. 39(4), pages 921-936, November.
    4. Caloffi, Annalisa & Mariani, Marco & Rossi, Federica & Russo, Margherita, 2018. "A comparative evaluation of regional subsidies for collaborative and individual R&D in small and medium-sized enterprises," Research Policy, Elsevier, vol. 47(8), pages 1437-1447.
    5. Joris Pinkse & Margaret E. Slade & Craig Brett, 2002. "Spatial Price Competition: A Semiparametric Approach," Econometrica, Econometric Society, vol. 70(3), pages 1111-1153, May.
    6. Anna Bindler & Randi Hjalmarsson, 2019. "Path Dependency in Jury Decision Making," Journal of the European Economic Association, European Economic Association, vol. 17(6), pages 1971-2017.
    7. Eickelpasch, Alexander & Fritsch, Michael, 2005. "Contests for cooperation--A new approach in German innovation policy," Research Policy, Elsevier, vol. 34(8), pages 1269-1282, October.
    8. Kevin J. Boudreau & Eva C. Guinan & Karim R. Lakhani & Christoph Riedl, 2016. "Looking Across and Looking Beyond the Knowledge Frontier: Intellectual Distance, Novelty, and Resource Allocation in Science," Management Science, INFORMS, vol. 62(10), pages 2765-2783, October.
    9. Autio, Erkko & Rannikko, Heikki, 2016. "Retaining winners: Can policy boost high-growth entrepreneurship?," Research Policy, Elsevier, vol. 45(1), pages 42-55.
    10. Daniel Chen & Tobias J. Moskowitz & Kelly Shue, 2016. "Decision-Making under the Gambler's Fallacy: Evidence from Asylum Judges, Loan Officers, and Baseball Umpires," NBER Working Papers 22026, National Bureau of Economic Research, Inc.
    11. Lung-Fei Lee, 2004. "Asymptotic Distributions of Quasi-Maximum Likelihood Estimators for Spatial Autoregressive Models," Econometrica, Econometric Society, vol. 72(6), pages 1899-1925, November.
    12. Karasakal, Esra & Aker, Pınar, 2017. "A multicriteria sorting approach based on data envelopment analysis for R&D project selection problem," Omega, Elsevier, vol. 73(C), pages 79-92.
    13. Saurabh Bhargava & Ray Fisman, 2014. "Contrast Effects in Sequential Decisions: Evidence from Speed Dating," The Review of Economics and Statistics, MIT Press, vol. 96(3), pages 444-457, July.
    14. Thorbjørn Knudsen & Daniel A. Levinthal, 2007. "Two Faces of Search: Alternative Generation and Alternative Evaluation," Organization Science, INFORMS, vol. 18(1), pages 39-54, February.
    15. Liu, Xiaodong & Lee, Lung-fei, 2010. "GMM estimation of social interaction models with centrality," Journal of Econometrics, Elsevier, vol. 159(1), pages 99-115, November.
    16. Nishimura, Junichi & Okamuro, Hiroyuki, 2018. "Internal and external discipline: The effect of project leadership and government monitoring on the performance of publicly funded R&D consortia," Research Policy, Elsevier, vol. 47(5), pages 840-853.
    17. Christian Terwiesch & Yi Xu, 2008. "Innovation Contests, Open Innovation, and Multiagent Problem Solving," Management Science, INFORMS, vol. 54(9), pages 1529-1543, September.
    18. Daniel L. Chen & Tobias J. Moskowitz & Kelly Shue, 2016. "Decision Making Under the Gambler’s Fallacy: Evidence from Asylum Judges, Loan Officers, and Baseball Umpires," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(3), pages 1181-1242.
    19. Kevin J. Boudreau & Nicola Lacetera & Karim R. Lakhani, 2011. "Incentives and Problem Uncertainty in Innovation Contests: An Empirical Analysis," Management Science, INFORMS, vol. 57(5), pages 843-863, May.
    20. Lee, Lung-fei, 2007. "Identification and estimation of econometric models with group interactions, contextual factors and fixed effects," Journal of Econometrics, Elsevier, vol. 140(2), pages 333-374, October.
    21. Lo, Jade Y. & Li, Haiyang, 2018. "In the eyes of the beholder: The effect of participant diversity on perceived merits of collaborative innovations," Research Policy, Elsevier, vol. 47(7), pages 1229-1242.
    22. LeSage, James P. & Vance, Colin & Chih, Yao-Yu, 2017. "A Bayesian heterogeneous coefficients spatial autoregressive panel data model of retail fuel duopoly pricing," Regional Science and Urban Economics, Elsevier, vol. 62(C), pages 46-55.
    23. Lung-fei Lee & Xiaodong Liu & Xu Lin, 2010. "Specification and estimation of social interaction models with network structures," Econometrics Journal, Royal Economic Society, vol. 13(2), pages 145-176, July.
    24. Samuel M. Hartzmark & Kelly Shue, 2018. "A Tough Act to Follow: Contrast Effects in Financial Markets," Journal of Finance, American Finance Association, vol. 73(4), pages 1567-1613, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kok, Holmer & Faems, Dries & de Faria, Pedro, 2022. "Pork Barrel or Barrel of Gold? Examining the performance implications of earmarking in public R&D grants," Research Policy, Elsevier, vol. 51(7).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gibbons, Steve & Overman, Henry G. & Patacchini, Eleonora, 2015. "Spatial Methods," Handbook of Regional and Urban Economics, in: Gilles Duranton & J. V. Henderson & William C. Strange (ed.), Handbook of Regional and Urban Economics, edition 1, volume 5, chapter 0, pages 115-168, Elsevier.
    2. Martellosio, Federico & Hillier, Grant, 2020. "Adjusted QMLE for the spatial autoregressive parameter," Journal of Econometrics, Elsevier, vol. 219(2), pages 488-506.
    3. Dogan, Osman & Taspinar, Suleyman & Bera, Anil K., 2017. "Simple Tests for Social Interaction Models with Network Structures," MPRA Paper 82828, University Library of Munich, Germany.
    4. Horrace, William C. & Liu, Xiaodong & Patacchini, Eleonora, 2016. "Endogenous network production functions with selectivity," Journal of Econometrics, Elsevier, vol. 190(2), pages 222-232.
    5. Patacchini, Eleonora & Hsieh, Chih-Sheng & Lin, Xu, 2019. "Social Interaction Methods," CEPR Discussion Papers 14141, C.E.P.R. Discussion Papers.
    6. Guy Tchuente, 2016. "Estimation of social interaction models using regularization," Studies in Economics 1607, School of Economics, University of Kent.
    7. Federico Martellosio & Grant Hillier, 2019. "Adjusted QMLE for the spatial autoregressive parameter," Papers 1909.08141, arXiv.org.
    8. Guo, Juncong & Qu, Xi, 2022. "Competition in household human capital investments: Strength, motivations and consequences," Journal of Development Economics, Elsevier, vol. 158(C).
    9. Yann Bramoullé & Habiba Djebbari & Bernard Fortin, 2020. "Peer Effects in Networks: A Survey," Annual Review of Economics, Annual Reviews, vol. 12(1), pages 603-629, August.
    10. Rainone, Edoardo, 2020. "The network nature of over-the-counter interest rates," Journal of Financial Markets, Elsevier, vol. 47(C).
    11. Liu, Xiaodong & Lee, Lung-fei, 2010. "GMM estimation of social interaction models with centrality," Journal of Econometrics, Elsevier, vol. 159(1), pages 99-115, November.
    12. Ida Johnsson & Hyungsik Roger Moon, 2017. "Estimation of Peer Effects in Endogenous Social Networks: Control Function Approach," Papers 1709.10024, arXiv.org, revised Jul 2019.
    13. Kuersteiner, Guido M. & Prucha, Ingmar R. & Zeng, Ying, 2023. "Efficient peer effects estimators with group effects," Journal of Econometrics, Elsevier, vol. 235(2), pages 2155-2194.
    14. Topa, Giorgio & Zenou, Yves, 2015. "Neighborhood and Network Effects," Handbook of Regional and Urban Economics, in: Gilles Duranton & J. V. Henderson & William C. Strange (ed.), Handbook of Regional and Urban Economics, edition 1, volume 5, chapter 0, pages 561-624, Elsevier.
    15. Edoardo Rainone, 2015. "Price transmission in the unsecured money market," IFC Bulletins chapters, in: Bank for International Settlements (ed.), Indicators to support monetary and financial stability analysis: data sources and statistical methodologies, volume 39, Bank for International Settlements.
    16. Liu, Xiaodong & Prucha, Ingmar R., 2018. "A robust test for network generated dependence," Journal of Econometrics, Elsevier, vol. 207(1), pages 92-113.
    17. Hiwatari, Masato, 2016. "Social networks and migration decisions: The influence of peer effects in rural households in Central Asia," Journal of Comparative Economics, Elsevier, vol. 44(4), pages 1115-1131.
    18. Kwok, Hon Ho, 2019. "Identification and estimation of linear social interaction models," Journal of Econometrics, Elsevier, vol. 210(2), pages 434-458.
    19. Patacchini, Eleonora & Venanzoni, Giuseppe, 2014. "Peer effects in the demand for housing quality," Journal of Urban Economics, Elsevier, vol. 83(C), pages 6-17.
    20. Boucher, Vincent & Fortin, Bernard, 2015. "Some Challenges in the Empirics of the Effects of Networks," IZA Discussion Papers 8896, Institute of Labor Economics (IZA).

    More about this item

    Keywords

    Innovation; Funding; Peer effects; Evaluation spillovers;
    All these keywords.

    JEL classification:

    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • D7 - Microeconomics - - Analysis of Collective Decision-Making
    • H25 - Public Economics - - Taxation, Subsidies, and Revenue - - - Business Taxes and Subsidies
    • O3 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:respol:v:50:y:2021:i:4:s0048733321000020. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/respol .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.