IDEAS home Printed from https://ideas.repec.org/a/gam/jecomi/v12y2024i12p327-d1532424.html
   My bibliography  Save this article

Innovation Metrics: A Critical Review

Author

Listed:
  • Lyubomir Todorov

    (Department of Statistics and Applied Mathematics, Faculty of Economic Accounting, “D. A. Tsenov” Academy of Economics, 5250 Svishtov, Bulgaria)

  • Margarita Shopova

    (Department of Statistics and Applied Mathematics, Faculty of Economic Accounting, “D. A. Tsenov” Academy of Economics, 5250 Svishtov, Bulgaria)

  • Iskra Marinova Panteleeva

    (Department of Statistics and Applied Mathematics, Faculty of Economic Accounting, “D. A. Tsenov” Academy of Economics, 5250 Svishtov, Bulgaria)

  • Lyubomira Todorova

    (Department of Statistics and Applied Mathematics, Faculty of Economic Accounting, “D. A. Tsenov” Academy of Economics, 5250 Svishtov, Bulgaria)

Abstract

Innovations are complex phenomena with important impacts on firms, regions, the economy as a whole, society, and the environment. Measuring innovation is a challenging and time-consuming task with many problems ranging from the conceptual framework to data collection and interpretation. The development of the produced variety of single indicators and multidimensional metrics covers one or more innovation characteristics—inputs, stages, sources, mechanics, outputs, and impacts. While the abundance of metrics allowed measurement of many innovation aspects, it also created problems with comparability, coverage, timeliness, and reliability, making it difficult for academics, businesses and policymakers to efficiently use the information, perform correct analysis and make adequate decisions. To address this problem, this article aimed to review the literature, develop instruments for the structuring and assessment of the innovation measurements, systematize the variety of metrics, and evaluate their compliance with the requirements of users’ needs and the quality of statistical information. The literature review identified 23 innovation metrics and helped create a classification scheme with 11 attributes and a criteria checklist with seven criteria groups. The results from the application of the instrument for the identified metrics revealed that they could be divided into three groups: appropriate, needing refinement, and unsuitable, with the best ones being the European Innovation Scoreboard and Global Innovation Index. They too showed some data gaps, connected with cultural environment, sustainability, open innovations, structural changes, and regional development, thus reinforcing the necessity for further advancement of theory and methodology for innovation measurement to augment the high-quality macro-information that is readily available with firm-level qualitative data of the innovation at the place where they emerge.

Suggested Citation

  • Lyubomir Todorov & Margarita Shopova & Iskra Marinova Panteleeva & Lyubomira Todorova, 2024. "Innovation Metrics: A Critical Review," Economies, MDPI, vol. 12(12), pages 1-28, November.
  • Handle: RePEc:gam:jecomi:v:12:y:2024:i:12:p:327-:d:1532424
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7099/12/12/327/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7099/12/12/327/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. João Nuno Morais Lopes & Luís Farinha, 2018. "Measuring the Performance of Innovation and Entrepreneurship Networks," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 9(2), pages 402-423, June.
    2. Abdullah Gök & Alec Waterworth & Philip Shapira, 2015. "Use of web mining in studying innovation," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(1), pages 653-671, January.
    3. Dziallas, Marisa & Blind, Knut, 2019. "Innovation indicators throughout the innovation process: An extensive literature analysis," Technovation, Elsevier, vol. 80, pages 3-29.
    4. Rammer, Christian & Es-Sadki, Nordine, 2023. "Using big data for generating firm-level innovation indicators - a literature review," Technological Forecasting and Social Change, Elsevier, vol. 197(C).
    5. Reeb, David M. & Zhao, Wanli, 2020. "Patents Do Not Measure Innovation Success," Critical Finance Review, now publishers, vol. 9(1-2), pages 157-199, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zając Aleksandra & Pipino Benedetta & Nikulina Evgenia & Segovia Daniela Quintanilla, 2025. "Embedding Inclusive Innovation and Social Entrepreneurship in Higher Education," Journal of Intercultural Management, Sciendo, vol. 17(1), pages 109-137.
    2. Alexandra POPESCU-ZORICA, 2025. "How Innovation Is Supported In Romanian Business Units Of Multinational Organizations: Findings From Expert Interviews," Business Excellence and Management, Faculty of Management, Academy of Economic Studies, Bucharest, Romania, vol. 15(2), pages 49-62, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bottai, Carlo & Crosato, Lisa & Domenech, Josep & Guerzoni, Marco & Liberati, Caterina, 2024. "Scraping innovativeness from corporate websites: Empirical evidence on Italian manufacturing SMEs," Technological Forecasting and Social Change, Elsevier, vol. 207(C).
    2. Rammer, Christian & Es-Sadki, Nordine, 2023. "Using big data for generating firm-level innovation indicators - a literature review," Technological Forecasting and Social Change, Elsevier, vol. 197(C).
    3. Daniel Feser, 2023. "Innovation intermediaries revised: a systematic literature review on innovation intermediaries’ role for knowledge sharing," Review of Managerial Science, Springer, vol. 17(5), pages 1827-1862, July.
    4. Ashouri, Sajad & Hajikhani, Arash & Suominen, Arho & Pukelis, Lukas & Cunningham, Scott W., 2024. "Measuring digitalization at scale using web scraped data," Technological Forecasting and Social Change, Elsevier, vol. 207(C).
    5. Axenbeck, Janna & Breithaupt, Patrick, 2022. "Measuring the digitalisation of firms: A novel text mining approach," ZEW Discussion Papers 22-065, ZEW - Leibniz Centre for European Economic Research.
    6. Quevedo Cascante, Mónica & Acosta García, Nicolás & Fold, Niels, 2022. "The role of external forces in the adoption of aquaculture innovations: An ex-ante case study of fish farming in Colombia's southern Amazonian region," Technological Forecasting and Social Change, Elsevier, vol. 174(C).
    7. Bentivoglio, Deborah & Bucci, Giorgia & Belletti, Matteo & Finco, Adele, 2022. "A theoretical framework on network’s dynamics for precision agriculture technologies adoption," Revista de Economia e Sociologia Rural (RESR), Sociedade Brasileira de Economia e Sociologia Rural, vol. 60(4), January.
    8. Nils Grashof, 2020. "Sinking or swimming in the cluster labour pool? A firm-specific analysis of the effect of specialized labour," Jena Economics Research Papers 2020-006, Friedrich-Schiller-University Jena.
    9. Ting, Hsiu-I & Wang, Ming-Chun & Yang, J. Jimmy & Tuan, Kai-Wen, 2021. "Technical expert CEOs and corporate innovation," Pacific-Basin Finance Journal, Elsevier, vol. 68(C).
    10. Bedford, Anna & Ma, Le & Ma, Nelson & Vojvoda, Kristina, 2022. "Australian innovation: Patent database construction and first evidence," Pacific-Basin Finance Journal, Elsevier, vol. 73(C).
    11. Murphree, Michael & Petersen, Bui & Warrian, Peter & Gosine, Ray, 2022. "Scope and scale of technology challenge and MNE subsidiary knowledge sourcing in host countries," Technovation, Elsevier, vol. 116(C).
    12. Zhao Qu & Shanshan Zhang & Chunbo Zhang, 2017. "Patent research in the field of library and information science: Less useful or difficult to explore?," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(1), pages 205-217, April.
    13. Lorenzo Ardito & Roger Svensson, 2024. "Sourcing applied and basic knowledge for innovation and commercialization success," The Journal of Technology Transfer, Springer, vol. 49(3), pages 959-995, June.
    14. Li, Yin & Arora, Sanjay & Youtie, Jan & Shapira, Philip, 2018. "Using web mining to explore Triple Helix influences on growth in small and mid-size firms," Technovation, Elsevier, vol. 76, pages 3-14.
    15. Ashish Kumar Jha & Indranil Bose, 2021. "Linking Drivers and Outcomes of Innovation in IT Firms: The Role of Partnerships," Information Systems Frontiers, Springer, vol. 23(6), pages 1593-1607, December.
    16. Davine N. G. Janssen & Eunice Pereira Ramos & Vincent Linderhof & Nico Polman & Chrysi Laspidou & Dennis Fokkinga & Duarte de Mesquita e Sousa, 2020. "The Climate, Land, Energy, Water and Food Nexus Challenge in a Land Scarce Country: Innovations in the Netherlands," Sustainability, MDPI, vol. 12(24), pages 1-27, December.
    17. Rim Zouari‐Hadiji, 2023. "Financial innovation characteristics and banking performance: The mediating effect of risk management," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 28(2), pages 1214-1227, April.
    18. Breithaupt, Patrick & Kesler, Reinhold & Niebel, Thomas & Rammer, Christian, 2020. "Intangible capital indicators based on web scraping of social media," ZEW Discussion Papers 20-046, ZEW - Leibniz Centre for European Economic Research.
    19. Meda Andrijauskiene & Daiva Dumciuviene & Alina Stundziene, 2021. "EU framework programmes: positive and negative effects on member states' innovation performance," Equilibrium. Quarterly Journal of Economics and Economic Policy, Institute of Economic Research, vol. 16(3), pages 471-502, September.
    20. Peiró-Palomino, Jesús & Perugini, Francesco, 2022. "Regional innovation disparities in Italy: The role of governance," Economic Systems, Elsevier, vol. 46(4).

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jecomi:v:12:y:2024:i:12:p:327-:d:1532424. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.