IDEAS home Printed from https://ideas.repec.org/a/gam/jecomi/v12y2024i12p327-d1532424.html
   My bibliography  Save this article

Innovation Metrics: A Critical Review

Author

Listed:
  • Lyubomir Todorov

    (Department of Statistics and Applied Mathematics, Faculty of Economic Accounting, “D. A. Tsenov” Academy of Economics, 5250 Svishtov, Bulgaria)

  • Margarita Shopova

    (Department of Statistics and Applied Mathematics, Faculty of Economic Accounting, “D. A. Tsenov” Academy of Economics, 5250 Svishtov, Bulgaria)

  • Iskra Marinova Panteleeva

    (Department of Statistics and Applied Mathematics, Faculty of Economic Accounting, “D. A. Tsenov” Academy of Economics, 5250 Svishtov, Bulgaria)

  • Lyubomira Todorova

    (Department of Statistics and Applied Mathematics, Faculty of Economic Accounting, “D. A. Tsenov” Academy of Economics, 5250 Svishtov, Bulgaria)

Abstract

Innovations are complex phenomena with important impacts on firms, regions, the economy as a whole, society, and the environment. Measuring innovation is a challenging and time-consuming task with many problems ranging from the conceptual framework to data collection and interpretation. The development of the produced variety of single indicators and multidimensional metrics covers one or more innovation characteristics—inputs, stages, sources, mechanics, outputs, and impacts. While the abundance of metrics allowed measurement of many innovation aspects, it also created problems with comparability, coverage, timeliness, and reliability, making it difficult for academics, businesses and policymakers to efficiently use the information, perform correct analysis and make adequate decisions. To address this problem, this article aimed to review the literature, develop instruments for the structuring and assessment of the innovation measurements, systematize the variety of metrics, and evaluate their compliance with the requirements of users’ needs and the quality of statistical information. The literature review identified 23 innovation metrics and helped create a classification scheme with 11 attributes and a criteria checklist with seven criteria groups. The results from the application of the instrument for the identified metrics revealed that they could be divided into three groups: appropriate, needing refinement, and unsuitable, with the best ones being the European Innovation Scoreboard and Global Innovation Index. They too showed some data gaps, connected with cultural environment, sustainability, open innovations, structural changes, and regional development, thus reinforcing the necessity for further advancement of theory and methodology for innovation measurement to augment the high-quality macro-information that is readily available with firm-level qualitative data of the innovation at the place where they emerge.

Suggested Citation

  • Lyubomir Todorov & Margarita Shopova & Iskra Marinova Panteleeva & Lyubomira Todorova, 2024. "Innovation Metrics: A Critical Review," Economies, MDPI, vol. 12(12), pages 1-28, November.
  • Handle: RePEc:gam:jecomi:v:12:y:2024:i:12:p:327-:d:1532424
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7099/12/12/327/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7099/12/12/327/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Rammer, Christian & Es-Sadki, Nordine, 2023. "Using big data for generating firm-level innovation indicators - a literature review," Technological Forecasting and Social Change, Elsevier, vol. 197(C).
    2. João Nuno Morais Lopes & Luís Farinha, 2018. "Measuring the Performance of Innovation and Entrepreneurship Networks," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 9(2), pages 402-423, June.
    3. Abdullah Gök & Alec Waterworth & Philip Shapira, 2015. "Use of web mining in studying innovation," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(1), pages 653-671, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zając Aleksandra & Pipino Benedetta & Nikulina Evgenia & Segovia Daniela Quintanilla, 2025. "Embedding Inclusive Innovation and Social Entrepreneurship in Higher Education," Journal of Intercultural Management, Sciendo, vol. 17(1), pages 109-137.
    2. Alexandra POPESCU-ZORICA, 2025. "How Innovation Is Supported In Romanian Business Units Of Multinational Organizations: Findings From Expert Interviews," Business Excellence and Management, Faculty of Management, Academy of Economic Studies, Bucharest, Romania, vol. 15(2), pages 49-62, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ashouri, Sajad & Hajikhani, Arash & Suominen, Arho & Pukelis, Lukas & Cunningham, Scott W., 2024. "Measuring digitalization at scale using web scraped data," Technological Forecasting and Social Change, Elsevier, vol. 207(C).
    2. Bottai, Carlo & Crosato, Lisa & Domenech, Josep & Guerzoni, Marco & Liberati, Caterina, 2024. "Scraping innovativeness from corporate websites: Empirical evidence on Italian manufacturing SMEs," Technological Forecasting and Social Change, Elsevier, vol. 207(C).
    3. Axenbeck, Janna & Breithaupt, Patrick, 2022. "Measuring the digitalisation of firms: A novel text mining approach," ZEW Discussion Papers 22-065, ZEW - Leibniz Centre for European Economic Research.
    4. Li, Yin & Arora, Sanjay & Youtie, Jan & Shapira, Philip, 2018. "Using web mining to explore Triple Helix influences on growth in small and mid-size firms," Technovation, Elsevier, vol. 76, pages 3-14.
    5. Breithaupt, Patrick & Kesler, Reinhold & Niebel, Thomas & Rammer, Christian, 2020. "Intangible capital indicators based on web scraping of social media," ZEW Discussion Papers 20-046, ZEW - Leibniz Centre for European Economic Research.
    6. Blazquez, Desamparados & Domenech, Josep, 2018. "Big Data sources and methods for social and economic analyses," Technological Forecasting and Social Change, Elsevier, vol. 130(C), pages 99-113.
    7. Roberto Camerani & Daniele Rotolo & Nicola Grassano, 2018. "Do Firms Publish? A Multi-Sectoral Analysis," SPRU Working Paper Series 2018-21, SPRU - Science Policy Research Unit, University of Sussex Business School.
    8. Abbasiharofteh, Milad & Kinne, Jan & Krüger, Miriam, 2021. "The strength of weak and strong ties in bridging geographic and cognitive distances," ZEW Discussion Papers 21-049, ZEW - Leibniz Centre for European Economic Research.
    9. repec:osf:socarx:j2w8v_v1 is not listed on IDEAS
    10. Anna Misztal & Magdalena Kowalska, 2024. "Factors of green entrepreneurship in selected emerging markets in the European Union," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 26(11), pages 28269-28292, November.
    11. Dörr, Julian Oliver & Kinne, Jan & Lenz, David & Licht, Georg & Winker, Peter, 2021. "An integrated data framework for policy guidance in times of dynamic economic shocks," ZEW Discussion Papers 21-062, ZEW - Leibniz Centre for European Economic Research.
    12. Occhini, Giulia & Tranos, Emmanouil & Wolf, Levi John, 2023. "Occupational segregation in the digital economy? A Natural Language Processing approach using UK Web Data," SocArXiv z8xta, Center for Open Science.
    13. Motohashi, Kazuyuki & Zhu, Chen, 2023. "Identifying technology opportunity using dual-attention model and technology-market concordance matrix," Technological Forecasting and Social Change, Elsevier, vol. 197(C).
    14. Christoph Stich & Emmanouil Tranos & Max Nathan, 2023. "Modeling clusters from the ground up: A web data approach," Environment and Planning B, , vol. 50(1), pages 244-267, January.
    15. Cruciata, Pietro & Pulizzotto, Davide & Beaudry, Catherine, 2024. "First impressions on sustainable innovation matter: Using NLP to replicate B-lab environmental index by analyzing companies' homepages," Technological Forecasting and Social Change, Elsevier, vol. 205(C).
    16. Zhao, Guoqing & Xie, Xiaotian & Wang, Yi & Liu, Shaofeng & Jones, Paul & Lopez, Carmen, 2024. "Barrier analysis to improve big data analytics capability of the maritime industry: A mixed-method approach," Technological Forecasting and Social Change, Elsevier, vol. 203(C).
    17. Schubert, Torben & Ashouri, Sajad & Deschryvere, Matthias & Jäger, Angela & Visentin, Fabiana & Cunningham, Scott & Hajikhani, Arash & Pukelis, Lukas & Suominen, Arho, 2023. "The role of product digitization for productivity," MERIT Working Papers 2023-004, United Nations University - Maastricht Economic and Social Research Institute on Innovation and Technology (MERIT).
    18. Melika Mosleh & Saeed Roshani & Mario Coccia, 2022. "Scientific laws of research funding to support citations and diffusion of knowledge in life science," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(4), pages 1931-1951, April.
    19. Axenbeck, Janna & Breithaupt, Patrick, 2019. "Web-based innovation indicators: Which firm website characteristics relate to firm-level innovation activity?," ZEW Discussion Papers 19-063, ZEW - Leibniz Centre for European Economic Research.
    20. Ho, Kung-Cheng & Yan, Cheng & Kong, Xiaoran, 2024. "The impact of climate change on credit cycles: Evidence from China's bond market," Technological Forecasting and Social Change, Elsevier, vol. 206(C).
    21. Patricia Fuel & Manuela Pardo-del-Val & Lorenzo Revuelto-Taboada, 2022. "Does the ideal entrepreneurial team exist?," International Entrepreneurship and Management Journal, Springer, vol. 18(3), pages 1263-1289, September.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jecomi:v:12:y:2024:i:12:p:327-:d:1532424. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.