IDEAS home Printed from https://ideas.repec.org/p/hal/journl/hal-03636260.html
   My bibliography  Save this paper

Assessment of the advancement of market-upstream innovations and of the performance of research and innovation projects

Author

Listed:
  • Svetlana Klessova

    (GREDEG - Groupe de Recherche en Droit, Economie et Gestion - UNS - Université Nice Sophia Antipolis (1965 - 2019) - CNRS - Centre National de la Recherche Scientifique - UniCA - Université Côte d'Azur)

  • Sebastian Engell

    (TU - Technische Universität Dortmund [Dortmund])

  • Catherine Thomas

    (GREDEG - Groupe de Recherche en Droit, Economie et Gestion - UNS - Université Nice Sophia Antipolis (1965 - 2019) - CNRS - Centre National de la Recherche Scientifique - UniCA - Université Côte d'Azur)

Abstract

The assessment of the advancement of technological innovations at their development stage is a difficult task, but important to judge on the performance of innovation projects. Assessments have so far been made by assessing technical characteristics, subjectively, or by counting patents. This paper proposes an approach to assess the advancement of market-upstream innovations directly and objectively, through the advancement of their technological maturity. On this basis, also the innovation performance of larger projects that were put in place to progress one or several innovations, can be assessed. The paper presents an exploratory qualitative multi-case study of 54 innovative technologies at different maturity levels, that were developed in 5 market-upstream large technological research and innovation projects with mostly engineering and IT dimensions, funded by the European Union's Research and Innovation Programmes under its sub-programme "Leadership in Enabling and Industrial Technologies". From extensive documentation and data from interviews, a refined technology readiness scale and a scoring method that reflects the increase in the required efforts to advance the maturity of the innovations is developed. The findings provide groundwork for future research on market-upstream innovation and how the innovation performance of projects can be measured at the early stages of the innovation process.

Suggested Citation

  • Svetlana Klessova & Sebastian Engell & Catherine Thomas, 2022. "Assessment of the advancement of market-upstream innovations and of the performance of research and innovation projects," Post-Print hal-03636260, HAL.
    • Handle: RePEc:hal:journl:hal-03636260
    DOI: 10.1016/j.technovation.2022.102495
    Note: View the original document on HAL open archive server: https://hal.science/hal-03636260
    as

    Download full text from publisher

    File URL: https://hal.science/hal-03636260/document
    Download Restriction: no
    File URL: https://libkey.io/10.1016/j.technovation.2022.102495?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Eric von Hippel, 1986. "Lead Users: A Source of Novel Product Concepts," Management Science, INFORMS, vol. 32(7), pages 791-805, July.
    2. Lazzarotti, Valentina & Manzini, Raffaella & Mari, Luca, 2011. "A model for R&D performance measurement," International Journal of Production Economics, Elsevier, vol. 134(1), pages 212-223, November.
    3. Messeni Petruzzelli, Antonio & Ardito, Lorenzo & Savino, Tommaso, 2018. "Maturity of knowledge inputs and innovation value: The moderating effect of firm age and size," Journal of Business Research, Elsevier, vol. 86(C), pages 190-201.
    4. Hung, Chia-Liang, 2017. "Social networks, technology ties, and gatekeeper functionality: Implications for the performance management of R&D projects," Research Policy, Elsevier, vol. 46(1), pages 305-315.
    5. Gault, Fred, 2018. "Defining and measuring innovation in all sectors of the economy," Research Policy, Elsevier, vol. 47(3), pages 617-622.
    6. Mannak, Remco S. & Meeus, Marius T.H. & Raab, Jörg & Smit, Alexander C., 2019. "A temporal perspective on repeated ties across university-industry R&D consortia," Research Policy, Elsevier, vol. 48(9), pages 1-1.
    7. Wanda Peters & Steven Doskey & James Moreland, 2017. "Technology Maturity Assessments and Confidence Intervals," Systems Engineering, John Wiley & Sons, vol. 20(2), pages 188-204, March.
    8. David Birchall & Jean-Jacques Chanaron & George Tovstiga, 2011. "Innovation performance measurement: current practices, issues and management challenges," Grenoble Ecole de Management (Post-Print) halshs-00651176, HAL.
    9. Janger, Jürgen & Schubert, Torben & Andries, Petra & Rammer, Christian & Hoskens, Machteld, 2017. "The EU 2020 innovation indicator: A step forward in measuring innovation outputs and outcomes?," Research Policy, Elsevier, vol. 46(1), pages 30-42.
    10. Aguiar, Luis & Gagnepain, Philippe, 2017. "European cooperative R&D and firm performance: Evidence based on funding differences in key actions," International Journal of Industrial Organization, Elsevier, vol. 53(C), pages 1-31.
    11. Eric von Hippel, 1994. ""Sticky Information" and the Locus of Problem Solving: Implications for Innovation," Management Science, INFORMS, vol. 40(4), pages 429-439, April.
    12. Arroyabe, Marta F. & Arranz, Nieves & Fdez. de Arroyabe, Juan Carlos, 2015. "R&D partnerships: An exploratory approach to the role of structural variables in joint project performance," Technological Forecasting and Social Change, Elsevier, vol. 90(PB), pages 623-634.
    13. Cooper, Robert G., 1990. "Stage-gate systems: A new tool for managing new products," Business Horizons, Elsevier, vol. 33(3), pages 44-54.
    14. Ben R. Martin, 2016. "Twenty challenges for innovation studies," Science and Public Policy, Oxford University Press, vol. 43(3), pages 432-450.
    15. Weiping Tan & Jose Ramirez‐Marquez & Brian Sauser, 2011. "A probabilistic approach to system maturity assessment," Systems Engineering, John Wiley & Sons, vol. 14(3), pages 279-293, September.
    16. Konstantinos C. Kostopoulos & Yiannis Spanos & Klas Eric Soderquist & Gregory Prastacos & Nicholas S. Vonortas, 2019. "Market-, Firm-, and Project-Level Effects on the Innovation Impact of Collaborative R&D Projects," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 10(4), pages 1384-1403, December.
    17. Elliot Bendoly, 2014. "System Dynamics Understanding in Projects: Information Sharing, Psychological Safety, and Performance Effects," Production and Operations Management, Production and Operations Management Society, vol. 23(8), pages 1352-1369, August.
    18. Torrisi, Salvatore & Gambardella, Alfonso & Giuri, Paola & Harhoff, Dietmar & Hoisl, Karin & Mariani, Myriam, 2016. "Used, blocking and sleeping patents: Empirical evidence from a large-scale inventor survey," Research Policy, Elsevier, vol. 45(7), pages 1374-1385.
    19. Hurmelinna-Laukkanen, Pia & Nätti, Satu & Pikkarainen, Minna, 2021. "Orchestrating for lead user involvement in innovation networks," Technovation, Elsevier, vol. 108(C).
    20. David Birchall & George Tovstiga, 2005. "Capabilities for strategic advantage," Palgrave Macmillan Books, Palgrave Macmillan, number 978-0-230-52249-7.
    21. David Birchall & George Tovstiga, 2005. "Strategic capabilities and innovation," Palgrave Macmillan Books, in: Capabilities for strategic advantage, chapter 0, pages 66-85, Palgrave Macmillan.
    22. Francesco Aiello & Lidia Mannarino & Valeria Pupo, 2020. "Innovation and productivity in family firms: evidence from a sample of European firms," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 29(4), pages 394-416, May.
    23. Alison L. Olechowski & Steven D. Eppinger & Nitin Joglekar & Katharina Tomaschek, 2020. "Technology readiness levels: Shortcomings and improvement opportunities," Systems Engineering, John Wiley & Sons, vol. 23(4), pages 395-408, July.
    24. Dziallas, Marisa, 2020. "How to evaluate innovative ideas and concepts at the front-end?," Journal of Business Research, Elsevier, vol. 110(C), pages 502-518.
    25. David Birchall & Jean-Jacques Chanaron & George Tovstiga, 2011. "Innovation performance measurement: current practices, issues and management challenges," Post-Print halshs-00651176, HAL.
    26. Dziallas, Marisa & Blind, Knut, 2019. "Innovation indicators throughout the innovation process: An extensive literature analysis," Technovation, Elsevier, vol. 80, pages 3-29.
    27. Kim, Eungdo & Kim, Soyoung & Kim, Hongbum, 2017. "Development of an evaluation framework for publicly funded R&D projects: The case of Korea's Next Generation Network," Evaluation and Program Planning, Elsevier, vol. 63(C), pages 18-28.
    28. Maietta, Ornella Wanda, 2015. "Determinants of university–firm R&D collaboration and its impact on innovation: A perspective from a low-tech industry," Research Policy, Elsevier, vol. 44(7), pages 1341-1359.
    29. Soh, Pek-Hooi & Subramanian, Annapoornima M., 2014. "When do firms benefit from university–industry R&D collaborations? The implications of firm R&D focus on scientific research and technological recombination," Journal of Business Venturing, Elsevier, vol. 29(6), pages 807-821.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Svetlana Klessova & Sebastian Engell & Catherine Thomas, 2022. "Dynamics of couplings and their implications in inter-organizational multi-actor research and innovation projects," Post-Print hal-03690108, HAL.
    2. Cai, Ying & Lin, Jun & Zhang, Ruxin, 2023. "When and how to implement design thinking in the innovation process: A longitudinal case study," Technovation, Elsevier, vol. 126(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Klessova, Svetlana & Engell, Sebastian & Thomas, Catherine, 2022. "Assessment of the advancement of market-upstream innovations and of the performance of research and innovation projects," Technovation, Elsevier, vol. 116(C).
    2. Svetlana Klessova & Sebastian Engell & Catherine Thomas, 2022. "Dynamics of couplings and their implications in inter-organizational multi-actor research and innovation projects," Post-Print hal-03690108, HAL.
    3. Dziallas, Marisa & Blind, Knut, 2019. "Innovation indicators throughout the innovation process: An extensive literature analysis," Technovation, Elsevier, vol. 80, pages 3-29.
    4. Jacqueline Tsz Yin Lo & Calvin Kam, 2021. "Innovation Performance Indicators for Architecture, Engineering and Construction Organization," Sustainability, MDPI, vol. 13(16), pages 1-25, August.
    5. Da Mota de Pina E Cunha, A.M., 1998. "Determinants of Product Innovation in Organizations : Practices and Performance in the Portugese Financial Sector," Other publications TiSEM e6e4e56e-b72a-4392-8d79-f, Tilburg University, School of Economics and Management.
    6. Meda Andrijauskiene & Daiva Dumciuviene & Alina Stundziene, 2021. "EU framework programmes: positive and negative effects on member states' innovation performance," Equilibrium. Quarterly Journal of Economics and Economic Policy, Institute of Economic Research, vol. 16(3), pages 471-502, September.
    7. Elias G. Carayannis & Luca Dezi & Gianluca Gregori & Ernesto Calo, 2022. "Smart Environments and Techno-centric and Human-Centric Innovations for Industry and Society 5.0: A Quintuple Helix Innovation System View Towards Smart, Sustainable, and Inclusive Solutions," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 13(2), pages 926-955, June.
    8. Dziallas, Marisa, 2020. "How to evaluate innovative ideas and concepts at the front-end?," Journal of Business Research, Elsevier, vol. 110(C), pages 502-518.
    9. Onea Ioana Alexandra, 2020. "Innovation indicators in the context of Romanian SMEs: A research agenda," Proceedings of the International Conference on Business Excellence, Sciendo, vol. 14(1), pages 149-158, July.
    10. Bernard Sinclair-Desgagné, 2022. "Measuring innovation and innovativeness: a data-mining approach," Quality & Quantity: International Journal of Methodology, Springer, vol. 56(4), pages 2415-2434, August.
    11. Franke, Nikolaus & von Hippel, Eric & Schreier, Martin, 2005. "Finding commercially attractive user innovations: A test of lead user theory," Working papers 4536-05, Massachusetts Institute of Technology (MIT), Sloan School of Management.
    12. Pamela D. Morrison & John H. Roberts & Eric von Hippel, 2000. "Determinants of User Innovation and Innovation Sharing in a Local Market," Management Science, INFORMS, vol. 46(12), pages 1513-1527, December.
    13. Salimi, Negin & Rezaei, Jafar, 2018. "Evaluating firms’ R&D performance using best worst method," Evaluation and Program Planning, Elsevier, vol. 66(C), pages 147-155.
    14. Bookhagen, Andrea & Sperber, Sonja, 2017. "Kundenintegration in den Entwicklungsprozess von Produktinnovationen durch Crowdsourcing," PraxisWISSEN Marketing: German Journal of Marketing, AfM – Arbeitsgemeinschaft für Marketing, vol. 2(01/2017), pages 21-37.
    15. Emilio Bellini & Giuseppe Piroli & Luca Pennacchio, 2019. "Collaborative know-how and trust in university–industry collaborations: empirical evidence from ICT firms," The Journal of Technology Transfer, Springer, vol. 44(6), pages 1939-1963, December.
    16. Davine N. G. Janssen & Eunice Pereira Ramos & Vincent Linderhof & Nico Polman & Chrysi Laspidou & Dennis Fokkinga & Duarte de Mesquita e Sousa, 2020. "The Climate, Land, Energy, Water and Food Nexus Challenge in a Land Scarce Country: Innovations in the Netherlands," Sustainability, MDPI, vol. 12(24), pages 1-27, December.
    17. Nicolai J. Foss & Keld Laursen & Torben Pedersen, 2011. "Linking Customer Interaction and Innovation: The Mediating Role of New Organizational Practices," Organization Science, INFORMS, vol. 22(4), pages 980-999, August.
    18. Sophie Urmetzer & Michael P. Schlaile & Kristina B. Bogner & Matthias Mueller & Andreas Pyka, 2018. "Exploring the Dedicated Knowledge Base of a Transformation towards a Sustainable Bioeconomy," Sustainability, MDPI, vol. 10(6), pages 1-22, May.
    19. Schweisfurth, Tim G. & Raasch, Christina, 2015. "Embedded lead users—The benefits of employing users for corporate innovation," Research Policy, Elsevier, vol. 44(1), pages 168-180.
    20. Chen, Xiaoyan & Locatelli, Giorgio & Zhang, Xinyue & Gong, Yunhao & He, Qinghua, 2022. "Firm and project innovation outcome measures in infrastructure megaprojects: An interpretive structural modelling approach," Technovation, Elsevier, vol. 109(C).

    More about this item

    Keywords

    Innovation; Innovative technologies; Market-upstream; Maturation; R&D; Technology readiness levels; Project; Innovation performance;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hal:journl:hal-03636260. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CCSD (email available below). General contact details of provider: https://hal.archives-ouvertes.fr/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.