IDEAS home Printed from https://ideas.repec.org/p/hal/journl/hal-04969613.html
   My bibliography  Save this paper

Knowledge production in technological innovation system: A comprehensive evaluation using a multi-criteria framework based on patent data—a case study on hydrogen storage

Author

Listed:
  • Marina Flamand

    (BSE - Bordeaux Sciences Economiques - UB - Université de Bordeaux - CNRS - Centre National de la Recherche Scientifique)

  • Vincent Frigant

    (BSE - Bordeaux Sciences Economiques - UB - Université de Bordeaux - CNRS - Centre National de la Recherche Scientifique)

  • Stéphane Miollan

    (BSE - Bordeaux Sciences Economiques - UB - Université de Bordeaux - CNRS - Centre National de la Recherche Scientifique)

Abstract

Knowledge production activity is central within a technological innovation system. The number of patent applications is commonly used to evaluate this activity. However, it is subject to bias and inaccurate evaluations can occur. This article proposes a multi-criteria framework based on seven complementary patent indicators, taking into account the persistence, commitment, and coherence of knowledge production activities for a more comprehensive evaluation. We demonstrate the value of our proposal through a case study on hydrogen storage, comparing patent data since 2000 about three technological solutions: physical, chemical and adsorption technologies. Our framework clearly shows that physical hydrogen storage is the most advanced in terms of knowledge production, despite not having the highest number of patent applications.

Suggested Citation

  • Marina Flamand & Vincent Frigant & Stéphane Miollan, 2025. "Knowledge production in technological innovation system: A comprehensive evaluation using a multi-criteria framework based on patent data—a case study on hydrogen storage," Post-Print hal-04969613, HAL.
    • Handle: RePEc:hal:journl:hal-04969613
    DOI: 10.1016/j.wpi.2025.102337
    Note: View the original document on HAL open archive server: https://hal.science/hal-04969613v1
    as

    Download full text from publisher

    File URL: https://hal.science/hal-04969613v1/document
    Download Restriction: no
    File URL: https://libkey.io/10.1016/j.wpi.2025.102337?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Christopher L Benson & Christopher L Magee, 2015. "Quantitative Determination of Technological Improvement from Patent Data," PLOS ONE, Public Library of Science, vol. 10(4), pages 1-23, April.
    2. Raghu Garud & Arun Kumaraswamy & Peter Karnøe, 2010. "Path Dependence or Path Creation?," Journal of Management Studies, Wiley Blackwell, vol. 47(4), pages 760-774, June.
    3. Manuel Trajtenberg, 1987. "Patents, Citations and Innovations: Tracing the Links," NBER Working Papers 2457, National Bureau of Economic Research, Inc.
    4. Blind, Knut & Cremers, Katrin & Mueller, Elisabeth, 2009. "The influence of strategic patenting on companies' patent portfolios," Research Policy, Elsevier, vol. 38(2), pages 428-436, March.
    5. Ludovic Dibiaggio & Lionel Nesta, 2005. "Patents Statistics, Knowledge Specialisation and the Organisation of Competencies," Revue d'Économie Industrielle, Programme National Persée, vol. 110(1), pages 103-126.
    6. Asna Ashari, Parsa & Blind, Knut & Koch, Claudia, 2023. "Knowledge and technology transfer via publications, patents, standards: Exploring the hydrogen technological innovation system," Technological Forecasting and Social Change, Elsevier, vol. 187(C).
    7. Adam B. Jaffe & Gaétan de Rassenfosse, 2017. "Patent citation data in social science research: Overview and best practices," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(6), pages 1360-1374, June.
    8. Jean O. Lanjouw & Ariel Pakes & Jonathan Putnam, 1998. "How to Count Patents and Value Intellectual Property: The Uses of Patent Renewal and Application Data," Journal of Industrial Economics, Wiley Blackwell, vol. 46(4), pages 405-432, December.
    9. Giovanni Dosi & Christopher Freeman & Richard Nelson & Gerarld Silverberg & Luc Soete (ed.), 1988. "Technical Change and Economic Theory," LEM Book Series, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy, number dosietal-1988, December.
    10. Donghui Meng & Xianjun Li & Yongfeng Cai & Jiaxin Shi, 2019. "Patterns of knowledge development and diffusion in the global autonomous vehicle technological innovation system: a patent-based analysis," International Journal of Automotive Technology and Management, Inderscience Enterprises Ltd, vol. 19(1/2), pages 144-177.
    11. Carlo Giglio & Gianluca Salvatore Vocaturo & Roberto Palmieri, 2023. "Patent Acquisitions in the Healthcare Industry: An Analysis of Learning Mechanisms," IJERPH, MDPI, vol. 20(5), pages 1-13, February.
    12. Dirk Czarnitzki & Katrin Hussinger & Bart Leten, 2020. "How Valuable are Patent Blocking Strategies?," Review of Industrial Organization, Springer;The Industrial Organization Society, vol. 56(3), pages 409-434, May.
    13. Carlo Giglio & Roberto Sbragia & Roberto Musmanno & Roberto Palmieri, 2021. "Cross-country learning from patents: an analysis of citations flows in innovation trajectories," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 7917-7936, September.
    14. Malhotra, Abhishek & Schmidt, Tobias S. & Huenteler, Joern, 2019. "The role of inter-sectoral learning in knowledge development and diffusion: Case studies on three clean energy technologies," Technological Forecasting and Social Change, Elsevier, vol. 146(C), pages 464-487.
    15. repec:bla:jindec:v:46:y:1998:i:4:p:405-32 is not listed on IDEAS
    16. Bergek, Anna & Jacobsson, Staffan & Carlsson, Bo & Lindmark, Sven & Rickne, Annika, 2008. "Analyzing the functional dynamics of technological innovation systems: A scheme of analysis," Research Policy, Elsevier, vol. 37(3), pages 407-429, April.
    17. Haupt, Reinhard & Kloyer, Martin & Lange, Marcus, 2007. "Patent indicators for the technology life cycle development," Research Policy, Elsevier, vol. 36(3), pages 387-398, April.
    18. Christopher L. Benson & Christopher L. Magee, 2013. "Erratum to: A hybrid keyword and patent class methodology for selecting relevant sets of patents for a technological field," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(1), pages 83-83, July.
    19. Mirzadeh Phirouzabadi, Amir & Savage, David & Blackmore, Karen & Juniper, James, 2020. "The evolution of dynamic interactions between the knowledge development of powertrain systems," Transport Policy, Elsevier, vol. 93(C), pages 1-16.
    20. Martin Andersson & Olof Ejermo, 2004. "Sectoral knowledge production in Swedish regions 1993-99," Chapters, in: Charlie Karlsson & Per Flensburg & Sven-Åke Hörte (ed.), Knowledge Spillovers and Knowledge Management, chapter 5, pages 143-170, Edward Elgar Publishing.
    21. Suurs, Roald A.A. & Hekkert, Marko P., 2009. "Competition between first and second generation technologies: Lessons from the formation of a biofuels innovation system in the Netherlands," Energy, Elsevier, vol. 34(5), pages 669-679.
    22. Reeb, David M. & Zhao, Wanli, 2020. "Patents Do Not Measure Innovation Success," Critical Finance Review, now publishers, vol. 9(1-2), pages 157-199, June.
    23. Markard, Jochen & Raven, Rob & Truffer, Bernhard, 2012. "Sustainability transitions: An emerging field of research and its prospects," Research Policy, Elsevier, vol. 41(6), pages 955-967.
    24. Christopher L. Benson & Christopher L. Magee, 2013. "A hybrid keyword and patent class methodology for selecting relevant sets of patents for a technological field," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(1), pages 69-82, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Flamand, Marina & Frigant, Vincent & Miollan, Stéphane & Dimitrova, Zlatina & Sauve, Henri, 2024. "Evaluating the TIS's knowledge production function using patent data: A multi-criteria approach applied to the technological bricks of the hydrogen storage," MPRA Paper 123050, University Library of Munich, Germany.
    2. Singh, Anuraag & Triulzi, Giorgio & Magee, Christopher L., 2021. "Technological improvement rate predictions for all technologies: Use of patent data and an extended domain description," Research Policy, Elsevier, vol. 50(9).
    3. Triulzi, Giorgio & Alstott, Jeff & Magee, Christopher L., 2020. "Estimating technology performance improvement rates by mining patent data," Technological Forecasting and Social Change, Elsevier, vol. 158(C).
    4. Carlsson , Bo, 2016. "Industrial Dynamics: A Review of the Literature 1990-2009," Papers in Innovation Studies 2016/3, Lund University, CIRCLE - Centre for Innovation Research.
    5. Tatiana Nevzorova & Vladimir Kutcherov, 2021. "The Role of Advocacy Coalitions in Shaping the Technological Innovation Systems: The Case of the Russian Renewable Energy Policy," Energies, MDPI, vol. 14(21), pages 1-24, October.
    6. Manuel Acosta & Daniel Coronado & Esther Ferrándiz & Manuel Jiménez, 2022. "Effects of knowledge spillovers between competitors on patent quality: what patent citations reveal about a global duopoly," The Journal of Technology Transfer, Springer, vol. 47(5), pages 1451-1487, October.
    7. Higham, Kyle & de Rassenfosse, Gaetan & Jaffe, Adam B, 2020. "Patent Quality: Towards a Systematic Framework for Analysis and Measurement," SocArXiv 49qxk_v1, Center for Open Science.
    8. Andersen, Allan Dahl & Markard, Jochen, 2020. "Multi-technology interaction in socio-technical transitions: How recent dynamics in HVDC technology can inform transition theories," Technological Forecasting and Social Change, Elsevier, vol. 151(C).
    9. Jonas Heiberg & Christian Binz & Bernhard Truffer, 2020. "The Geography of Technology Legitimation. How multi-scalar legitimation processes matter for path creation in emerging industries," Papers in Evolutionary Economic Geography (PEEG) 2034, Utrecht University, Department of Human Geography and Spatial Planning, Group Economic Geography, revised Aug 2020.
    10. Attila Havas & Doris Schartinger & K. Matthias Weber, 2022. "Innovation Studies, Social Innovation, and Sustainability Transitions Research: From mutual ignorance towards an integrative perspective?," CERS-IE WORKING PAPERS 2227, Institute of Economics, Centre for Economic and Regional Studies.
    11. Martin Kalthaus, 2020. "Knowledge recombination along the technology life cycle," Journal of Evolutionary Economics, Springer, vol. 30(3), pages 643-704, July.
    12. Yap, Xiao-Shan & Truffer, Bernhard, 2019. "Shaping selection environments for industrial catch-up and sustainability transitions: A systemic perspective on endogenizing windows of opportunity," Research Policy, Elsevier, vol. 48(4), pages 1030-1047.
    13. Higham, Kyle & de Rassenfosse, Gaétan & Jaffe, Adam B., 2021. "Patent Quality: Towards a Systematic Framework for Analysis and Measurement," Research Policy, Elsevier, vol. 50(4).
    14. Matthias Niggli & Christian Rutzer, 2023. "Digital technologies, technological improvement rates, and innovations “Made in Switzerland”," Swiss Journal of Economics and Statistics, Springer;Swiss Society of Economics and Statistics, vol. 159(1), pages 1-31, December.
    15. Bruns, Stephan B. & Kalthaus, Martin, 2020. "Flexibility in the selection of patent counts: Implications for p-hacking and evidence-based policymaking," Research Policy, Elsevier, vol. 49(1).
    16. Deyu Li & Floor Alkemade & Koen Frenken & Gaston Heimeriks, 2023. "Catching up in clean energy technologies: a patent analysis," The Journal of Technology Transfer, Springer, vol. 48(2), pages 693-715, April.
    17. Stephan, Annegret & Schmidt, Tobias S. & Bening, Catharina R. & Hoffmann, Volker H., 2017. "The sectoral configuration of technological innovation systems: Patterns of knowledge development and diffusion in the lithium-ion battery technology in Japan," Research Policy, Elsevier, vol. 46(4), pages 709-723.
    18. Changbae Mun & Sejun Yoon & Hyunseok Park, 2019. "Structural decomposition of technological domain using patent co-classification and classification hierarchy," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(2), pages 633-652, November.
    19. Ron Boschma & Koen Frenken, 2015. "Evolutionary Economic Geography," Papers in Evolutionary Economic Geography (PEEG) 1518, Utrecht University, Department of Human Geography and Spatial Planning, Group Economic Geography, revised May 2015.
    20. Grimaldi, Michele & Cricelli, Livio & Di Giovanni, Martina & Rogo, Francesco, 2015. "The patent portfolio value analysis: A new framework to leverage patent information for strategic technology planning," Technological Forecasting and Social Change, Elsevier, vol. 94(C), pages 286-302.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hal:journl:hal-04969613. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CCSD (email available below). General contact details of provider: https://hal.archives-ouvertes.fr/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.