IDEAS home Printed from https://ideas.repec.org/a/eee/respol/v46y2017i1p30-42.html
   My bibliography  Save this article

The EU 2020 innovation indicator: A step forward in measuring innovation outputs and outcomes?

Author

Listed:
  • Janger, Jürgen
  • Schubert, Torben
  • Andries, Petra
  • Rammer, Christian
  • Hoskens, Machteld

Abstract

In October 2013, the European Commission presented a new indicator intended to capture innovation outputs and outcomes and thereby “support policy-makers in establishing new or reinforced actions to remove bottlenecks that prevent innovators from translating ideas into products and services that can be successful on the market”. This article aims to evaluate the usefulness of the new indicator against the background of the difficulties in measuring innovation outputs and outcomes. We develop a unique conceptual framework for measuring innovation outcomes that distinguishes structural change and structural upgrading as two key dimensions in both manufacturing and services. We conclude that the new indicator is biased towards a somewhat narrowly defined “high-tech” understanding of innovation outcomes. We illustrate our framework proposing a broader set of outcome indicators capturing also structural upgrading. We find that the results for the modified indicator differ substantially for a number of countries, with potentially wide-ranging consequences for innovation and industrial policies.

Suggested Citation

  • Janger, Jürgen & Schubert, Torben & Andries, Petra & Rammer, Christian & Hoskens, Machteld, 2017. "The EU 2020 innovation indicator: A step forward in measuring innovation outputs and outcomes?," Research Policy, Elsevier, vol. 46(1), pages 30-42.
    • Handle: RePEc:eee:respol:v:46:y:2017:i:1:p:30-42
    DOI: 10.1016/j.respol.2016.10.001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0048733316301597
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.respol.2016.10.001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Hölzl, Werner & Janger, Jürgen, 2014. "Distance to the frontier and the perception of innovation barriers across European countries," Research Policy, Elsevier, vol. 43(4), pages 707-725.
    2. Peneder, Michael, 2010. "Technological regimes and the variety of innovation behaviour: Creating integrated taxonomies of firms and sectors," Research Policy, Elsevier, vol. 39(3), pages 323-334, April.
    3. G. M.P. Swann, 2009. "The Economics of Innovation," Books, Edward Elgar Publishing, number 13211.
    4. Ghosal, Vivek & Nair-Reichert, Usha, 2009. "Investments in modernization, innovation and gains in productivity: Evidence from firms in the global paper industry," Research Policy, Elsevier, vol. 38(3), pages 536-547, April.
    5. Gene M. Grossman & Elhanan Helpman, 1991. "Quality Ladders in the Theory of Growth," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 58(1), pages 43-61.
    6. Christian Rammer & Dirk Czarnitzki & Alfred Spielkamp, 2009. "Innovation success of non-R&D-performers: substituting technology by management in SMEs," Small Business Economics, Springer, vol. 33(1), pages 35-58, June.
    7. Martin Srholec, 2007. "High-Tech Exports from Developing Countries: A Symptom of Technology Spurts or Statistical Illusion?," Review of World Economics (Weltwirtschaftliches Archiv), Springer;Institut für Weltwirtschaft (Kiel Institute for the World Economy), vol. 143(2), pages 227-255, July.
    8. Alfred Kleinknecht & Kees Van Montfort & Erik Brouwer, 2002. "The Non-Trivial Choice between Innovation Indicators," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 11(2), pages 109-121.
    9. Roper, Stephen & Du, Jun & Love, James H., 2008. "Modelling the innovation value chain," Research Policy, Elsevier, vol. 37(6-7), pages 961-977, July.
    10. Nicholas Bloom & Mirko Draca & John Van Reenen, 2016. "Trade Induced Technical Change? The Impact of Chinese Imports on Innovation, IT and Productivity," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 83(1), pages 87-117.
    11. Bruno Crepon & Emmanuel Duguet & Jacques Mairesse, 1998. "Research, Innovation And Productivity: An Econometric Analysis At The Firm Level," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 7(2), pages 115-158.
    12. Zoltan J. Acs & David B. Audretsch, 1989. "Patents' Innovative Activity," Eastern Economic Journal, Eastern Economic Association, vol. 15(4), pages 373-376, Oct-Dec.
    13. Edquist , Charles & Zabala-Iturriagagoitia , Jon Mikel, 2015. "The Innovation Union Scoreboard is Flawed: The case of Sweden – not being the innovation leader of the EU," Papers in Innovation Studies 2015/16, Lund University, CIRCLE - Centre for Innovation Research.
    14. Dosi, Giovanni & Nelson, Richard R., 2010. "Technical Change and Industrial Dynamics as Evolutionary Processes," Handbook of the Economics of Innovation, in: Bronwyn H. Hall & Nathan Rosenberg (ed.), Handbook of the Economics of Innovation, edition 1, volume 1, chapter 0, pages 51-127, Elsevier.
    15. Freeman, Christopher & Soete, Luc, 2009. "Developing science, technology and innovation indicators: What we can learn from the past," Research Policy, Elsevier, vol. 38(4), pages 583-589, May.
    16. Bronzini, Raffaello & Piselli, Paolo, 2016. "The impact of R&D subsidies on firm innovation," Research Policy, Elsevier, vol. 45(2), pages 442-457.
    17. Reinganum, Jennifer F, 1983. "Uncertain Innovation and the Persistence of Monopoly," American Economic Review, American Economic Association, vol. 73(4), pages 741-748, September.
    18. Jacques Mairesse & Pierre Mohnen, 2002. "Accounting for Innovation and Measuring Innovativeness: An Illustrative Framework and an Application," American Economic Review, American Economic Association, vol. 92(2), pages 226-230, May.
    19. Dosi, Giovanni, 1993. "Technological paradigms and technological trajectories : A suggested interpretation of the determinants and directions of technical change," Research Policy, Elsevier, vol. 22(2), pages 102-103, April.
    20. Ariel Pakes & Zvi Griliches, 1980. "Patents and R and D at the Firm Level: A First Look," NBER Working Papers 0561, National Bureau of Economic Research, Inc.
    21. Scherer, F. M., 1983. "The propensity to patent," International Journal of Industrial Organization, Elsevier, vol. 1(1), pages 107-128, March.
    22. Robertson, Paul & Smith, Keith & von Tunzelmann, Nick, 2009. "Innovation in low- and medium-technology industries," Research Policy, Elsevier, vol. 38(3), pages 441-446, April.
    23. Godin, Benoit, 2004. "The obsession for competitiveness and its impact on statistics: the construction of high-technology indicators," Research Policy, Elsevier, vol. 33(8), pages 1217-1229, October.
    24. K. J. Arrow, 1971. "The Economic Implications of Learning by Doing," Palgrave Macmillan Books, in: F. H. Hahn (ed.), Readings in the Theory of Growth, chapter 11, pages 131-149, Palgrave Macmillan.
    25. Kirner, Eva & Kinkel, Steffen & Jaeger, Angela, 2009. "Innovation paths and the innovation performance of low-technology firms--An empirical analysis of German industry," Research Policy, Elsevier, vol. 38(3), pages 447-458, April.
    26. Zoltan J. Acs & David B. Audretsch, 1989. "Patents as a Measure of Innovative Activity," Kyklos, Wiley Blackwell, vol. 42(2), pages 171-180, August.
    27. Pakes, Ariel & Griliches, Zvi, 1980. "Patents and R&D at the firm level: A first report," Economics Letters, Elsevier, vol. 5(4), pages 377-381.
    28. Edquist , Charles & Zabala-Iturriagagoitia , Jon Mikel, 2015. "The Innovation Union Scoreboard is flawed: The Case of Sweden – not the innovation leader of the EU – updated version," Papers in Innovation Studies 2015/27, Lund University, CIRCLE - Centre for Innovation Research.
    29. Azele Mathieu & Bruno van Pottelsberghe de la Potterie, 2010. "A Note on the Drivers of R&D Intensity," Research in World Economy, Research in World Economy, Sciedu Press, vol. 1(1), pages 56-65, November.
    30. Arundel, Anthony & Kabla, Isabelle, 1998. "What percentage of innovations are patented? empirical estimates for European firms," Research Policy, Elsevier, vol. 27(2), pages 127-141, June.
    31. Acs, Zoltan J & Audretsch, David B, 1989. "Patents as a Measure of Innovative Activity," Kyklos, Wiley Blackwell, vol. 42(2), pages 171-180.
    32. Grupp, Hariolf & Schubert, Torben, 2010. "Review and new evidence on composite innovation indicators for evaluating national performance," Research Policy, Elsevier, vol. 39(1), pages 67-78, February.
    33. Crepon, B. & Duguet, E. & Mairesse, J., 1998. "Research Investment, Innovation and Productivity: An Econometric Analysis at the Firm Level," Papiers d'Economie Mathématique et Applications 98.15, Université Panthéon-Sorbonne (Paris 1).
    34. Kleinknecht, Alfred & Reijnen, Jeroen O. N., 1993. "Towards literature-based innovation output indicators," Structural Change and Economic Dynamics, Elsevier, vol. 4(1), pages 199-207, June.
    35. Zvi Griliches, 1998. "Productivity and R&D at the Firm Level," NBER Chapters, in: R&D and Productivity: The Econometric Evidence, pages 100-133, National Bureau of Economic Research, Inc.
    36. Jürgen Janger & Werner Hölzl & Serguei Kaniovski & Johannes Kutsam & Michael Peneder & Andreas Reinstaller & Susanne Sieber & Isabel Stadler & Fabian Unterlass, 2011. "Structural Change and the Competitiveness of EU Member States," WIFO Studies, WIFO, number 42956, February.
    37. Michael Peneder, 2002. "special issue: Intangible investment and human resources," Journal of Evolutionary Economics, Springer, vol. 12(1), pages 107-134.
    38. Peneder, Michael, 2003. "Industrial structure and aggregate growth," Structural Change and Economic Dynamics, Elsevier, vol. 14(4), pages 427-448, December.
    39. Zvi Griliches, 1984. "R&D, Patents, and Productivity," NBER Books, National Bureau of Economic Research, Inc, number gril84-1, March.
    40. Aiginger, Karl, 1997. "The Use of Unit Values to Discriminate between Price and Quality Competition," Cambridge Journal of Economics, Oxford University Press, vol. 21(5), pages 571-592, September.
    41. Godin, Benoit, 2003. "The emergence of S&T indicators: why did governments supplement statistics with indicators?," Research Policy, Elsevier, vol. 32(4), pages 679-691, April.
    42. Brouwer, Erik & Kleinknecht, Alfred, 1999. "Innovative output, and a firm's propensity to patent.: An exploration of CIS micro data," Research Policy, Elsevier, vol. 28(6), pages 615-624, August.
    43. Jürgen Janger, 2012. "Strukturwandel und Wettbewerbsfähigkeit in der EU," WIFO Monatsberichte (monthly reports), WIFO, vol. 85(8), pages 625-640, August.
    44. Hylke Vandenbussche, 2014. "Quality in Exports," European Economy - Economic Papers 2008 - 2015 528, Directorate General Economic and Financial Affairs (DG ECFIN), European Commission.
    45. Hall, Bronwyn H & Ziedonis, Rosemarie Ham, 2001. "The Patent Paradox Revisited: An Empirical Study of Patenting in the U.S. Semiconductor Industry, 1979-1995," RAND Journal of Economics, The RAND Corporation, vol. 32(1), pages 101-128, Spring.
    46. McLaughlin, John A. & Jordan, Gretchen B., 1999. "Logic models: a tool for telling your programs performance story," Evaluation and Program Planning, Elsevier, vol. 22(1), pages 65-72.
    47. Godin, Benoit, 2007. "Science, accounting and statistics: The input-output framework," Research Policy, Elsevier, vol. 36(9), pages 1388-1403, November.
    48. Dosi, Giovanni, 1988. "Sources, Procedures, and Microeconomic Effects of Innovation," Journal of Economic Literature, American Economic Association, vol. 26(3), pages 1120-1171, September.
    49. Saviotti, P. P. & Metcalfe, J. S., 1984. "A theoretical approach to the construction of technological output indicators," Research Policy, Elsevier, vol. 13(3), pages 141-151, June.
    50. Peter K. Schott, 2008. "The relative sophistication of Chinese exports [‘Manufacturing Earnings and Compensation in China’]," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 23(53), pages 6-49.
    51. Ariel Pakes & Zvi Griliches, 1984. "Patents and R&D at the Firm Level: A First Look," NBER Chapters, in: R&D, Patents, and Productivity, pages 55-72, National Bureau of Economic Research, Inc.
    52. Coombs, R. & Narandren, P. & Richards, A., 1996. "A literature-based innovation output indicator," Research Policy, Elsevier, vol. 25(3), pages 403-413, May.
    53. Grupp, Hariolf, 1994. "The measurement of technical performance of innovations by technometrics and its impact on established technology indicators," Research Policy, Elsevier, vol. 23(2), pages 175-193, March.
    54. Blind, Knut & Edler, Jakob & Frietsch, Rainer & Schmoch, Ulrich, 2006. "Motives to patent: Empirical evidence from Germany," Research Policy, Elsevier, vol. 35(5), pages 655-672, June.
    55. Aija Leiponen & Constance E. Helfat, 2010. "Innovation objectives, knowledge sources, and the benefits of breadth," Strategic Management Journal, Wiley Blackwell, vol. 31(2), pages 224-236, February.
    56. Andreas Reinstaller & Fabian Unterlass, 2012. "Comparing business R&D across countries over time: a decomposition exercise using data for the EU 27," Applied Economics Letters, Taylor & Francis Journals, vol. 19(12), pages 1143-1148, August.
    57. Chris Freeman & Luc Soete, 1997. "The Economics of Industrial Innovation, 3rd Edition," MIT Press Books, The MIT Press, edition 3, volume 1, number 0262061953, December.
    58. Martin, Julien & Mejean, Isabelle, 2014. "Low-wage country competition and the quality content of high-wage country exports," Journal of International Economics, Elsevier, vol. 93(1), pages 140-152.
    59. Thomas Hatzichronoglou, 1997. "Revision of the High-Technology Sector and Product Classification," OECD Science, Technology and Industry Working Papers 1997/2, OECD Publishing.
    60. Petra Moser, 2013. "Patents and Innovation: Evidence from Economic History," Journal of Economic Perspectives, American Economic Association, vol. 27(1), pages 23-44, Winter.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jürgen Janger & Agnes Kügler & Andreas Reinstaller & Fabian Unterlass, 2017. "Austria 2025 – Looking Out For the Frontier(s): Towards a New Framework For Frontier Measurement in Science, Technology and Innovation," WIFO Studies, WIFO, number 59289, February.
    2. Dziallas, Marisa & Blind, Knut, 2019. "Innovation indicators throughout the innovation process: An extensive literature analysis," Technovation, Elsevier, vol. 80, pages 3-29.
    3. Hagedoorn, John & Cloodt, Myriam, 2003. "Measuring innovative performance: is there an advantage in using multiple indicators?," Research Policy, Elsevier, vol. 32(8), pages 1365-1379, September.
    4. Jürgen Janger & Agnes Kügler, 2018. "Innovationseffizienz. Österreich im internationalen Vergleich," WIFO Studies, WIFO, number 61111, February.
    5. Cohen, Wesley M., 2010. "Fifty Years of Empirical Studies of Innovative Activity and Performance," Handbook of the Economics of Innovation, in: Bronwyn H. Hall & Nathan Rosenberg (ed.), Handbook of the Economics of Innovation, edition 1, volume 1, chapter 0, pages 129-213, Elsevier.
    6. Landon Kleis & Paul Chwelos & Ronald V. Ramirez & Iain Cockburn, 2012. "Information Technology and Intangible Output: The Impact of IT Investment on Innovation Productivity," Information Systems Research, INFORMS, vol. 23(1), pages 42-59, March.
    7. Grazia Cecere & Sascha Rexhäuser & Patrick Schulte, 2019. "From less promising to green? Technological opportunities and their role in (green) ICT innovation," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 28(1), pages 45-63, January.
    8. Julia Bock-Schappelwein & Jürgen Janger & Andreas Reinstaller, 2012. "Bildung 2025 – Die Rolle von Bildung in der österreichischen Wirtschaft," WIFO Studies, WIFO, number 45200, February.
    9. Beneito, Pilar, 2006. "The innovative performance of in-house and contracted R&D in terms of patents and utility models," Research Policy, Elsevier, vol. 35(4), pages 502-517, May.
    10. Bettina Peters & Rebecca Riley & Iulia Siedschlag & Priit Vahter & John McQuinn, 2018. "Internationalisation, innovation and productivity in services: evidence from Germany, Ireland and the United Kingdom," Review of World Economics (Weltwirtschaftliches Archiv), Springer;Institut für Weltwirtschaft (Kiel Institute for the World Economy), vol. 154(3), pages 585-615, August.
    11. Danguy, Jérôme & de Rassenfosse, Gaétan & van Pottelsberghe de la Potterie, Bruno, 2010. "The R&D-patent relationship: An industry perspective," EIB Papers 7/2009, European Investment Bank, Economics Department.
    12. Baumann, Julian & Kritikos, Alexander S., 2016. "The link between R&D, innovation and productivity: Are micro firms different?," Research Policy, Elsevier, vol. 45(6), pages 1263-1274.
    13. Wadho, Waqar & Chaudhry, Azam, 2020. "Innovation Strategies and Productivity Growth in Developing Countries: Evidence from Pakistan," GLO Discussion Paper Series 466, Global Labor Organization (GLO).
    14. Nikulainen, Tuomo & Pajarinen, Mika & Palmberg, Christopher, 2005. "Patents and Technological Change - A Review with Focus on the FEPOCI Database," Discussion Papers 984, The Research Institute of the Finnish Economy.
    15. Pietro Moncada-Paternò-Castello, 2016. "Sector dynamics and demographics of top R&D firms in the global economy," JRC Working Papers on Corporate R&D and Innovation 2016-06, Joint Research Centre.
    16. Crespi, Gustavo & Zuniga, Pluvia, 2012. "Innovation and Productivity: Evidence from Six Latin American Countries," World Development, Elsevier, vol. 40(2), pages 273-290.
    17. Gamba, Simona, 2017. "The Effect of Intellectual Property Rights on Domestic Innovation in the Pharmaceutical Sector," World Development, Elsevier, vol. 99(C), pages 15-27.
    18. Hagedoorn, John & Wang, Ning, 2012. "Is there complementarity or substitutability between internal and external R&D strategies?," Research Policy, Elsevier, vol. 41(6), pages 1072-1083.
    19. Attila Havas, 2016. "Social and Business Innovations: Are Common Measurement Approaches Possible?," Foresight-Russia Форсайт, CyberLeninka;Федеральное государственное автономное образовательное учреждение высшего образования «Национальный исследовательский университет «Высшая школа экономики», vol. 10(2 (eng)), pages 58-80.
    20. de Rassenfosse, Gaetan & van Pottelsberghe de la Potterie, Bruno, 2009. "A policy insight into the R&D-patent relationship," Research Policy, Elsevier, vol. 38(5), pages 779-792, June.

    More about this item

    Keywords

    Innovation output; Innovation outcome; Innovation measurement; Structural change; Structural upgrading; EU 2020 strategy; Innovation policy;
    All these keywords.

    JEL classification:

    • O25 - Economic Development, Innovation, Technological Change, and Growth - - Development Planning and Policy - - - Industrial Policy
    • O31 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Innovation and Invention: Processes and Incentives
    • O38 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Government Policy
    • O52 - Economic Development, Innovation, Technological Change, and Growth - - Economywide Country Studies - - - Europe

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:respol:v:46:y:2017:i:1:p:30-42. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/respol .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.