IDEAS home Printed from https://ideas.repec.org/a/oup/scippl/v44y2017i2p246-258..html
   My bibliography  Save this article

Measuring the productivity of national R&D systems: Challenges in cross-national comparisons of R&D input and publication output indicators

Author

Listed:
  • Dag. W. Aksnes
  • Gunnar Sivertsen
  • Thed N. van Leeuwen
  • Kaja K. Wendt

Abstract

We investigate methodological problems in measuring research productivity at the national level by comparing official R&D statistics from the OECD with publication data from the Web of Science. Data from 18 countries are analysed. This paper problematizes the approach taken in studies where R&D statistics are used as an input variable and publications as an output variable to draw conclusions about the productivity or efficiency of national research and innovation systems. We consider possible pitfalls in such analyses and propose steps that can improve the comparability of these two data sources. We recommend that efforts are made among the OECD member countries to produce more reliable and commensurable international R&D statistics.

Suggested Citation

  • Dag. W. Aksnes & Gunnar Sivertsen & Thed N. van Leeuwen & Kaja K. Wendt, 2017. "Measuring the productivity of national R&D systems: Challenges in cross-national comparisons of R&D input and publication output indicators," Science and Public Policy, Oxford University Press, vol. 44(2), pages 246-258.
    • Handle: RePEc:oup:scippl:v:44:y:2017:i:2:p:246-258.
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1093/scipol/scw058
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Sean M. Dougherty & Robert Inklaar & Robert H. McGuckin & Bart van Ark, 2007. "International Comparisons of R&D Expenditure: Does an R&D PPP Make a Difference?," NBER Chapters, in: Hard-to-Measure Goods and Services: Essays in Honor of Zvi Griliches, pages 291-322, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ioan Ianoş & Alexandru-Ionuţ Petrişor, 2020. "An Overview of the Dynamics of Relative Research Performance in Central-Eastern Europe Using a Ranking-Based Analysis Derived from SCImago Data," Publications, MDPI, vol. 8(3), pages 1-25, July.
    2. Barbara S. Lancho-Barrantes & Hector G. Ceballos-Cancino & Francisco J. Cantu-Ortiz, 2021. "Comparing the efficiency of countries to assimilate and apply research investment," Quality & Quantity: International Journal of Methodology, Springer, vol. 55(4), pages 1347-1369, August.
    3. Bárbara S. Lancho-Barrantes & Francisco J. Cantú-Ortiz, 2019. "Science in Mexico: a bibliometric analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(2), pages 499-517, February.
    4. Bornmann, Lutz & Gralka, Sabine & Anegón, Félix de Moya & Wohlrabe, Klaus, 2023. "Efficiency of universities and research-focused institutions worldwide: The introduction of a new input indicator reflecting institutional staff numbers," Journal of Informetrics, Elsevier, vol. 17(2).
    5. Lutz Bornmann & Sabine Gralka & Félix de Moya Anegón & Klaus Wohlrabe, 2020. "Efficiency of Universities and Research-Focused Institutions Worldwide: An Empirical DEA Investigation Based on Institutional Publication Numbers and Estimated Academic Staff Numbers," CESifo Working Paper Series 8157, CESifo.
    6. Abramo, Giovanni & D'Angelo, Ciriaco Andrea & Di Costa, Flavia, 2022. "Revealing the scientific comparative advantage of nations: Common and distinctive features," Journal of Informetrics, Elsevier, vol. 16(1).
    7. Moriah B. Bostian & Cinzia Daraio & Rolf Fare & Shawna Grosskopf & Maria Grazia Izzo & Luca Leuzzi & Giancarlo Ruocco & William L. Weber, 2018. "Inference for Nonparametric Productivity Networks: A Pseudo-likelihood Approach," DIAG Technical Reports 2018-06, Department of Computer, Control and Management Engineering, Universita' degli Studi di Roma "La Sapienza".
    8. Fredrik Niclas Piro, 2019. "The R&D composition of European countries: concentrated versus dispersed profiles," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 1095-1119, May.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Carol Corrado & Jonathan Haskel & Cecilia Jona-Lasinio & Massimiliano Iommi, 2012. "Intangible Capital and Growth in Advanced Economies: Measurement Methods and Comparative Results," Economics Program Working Papers 12-03, The Conference Board, Economics Program.
    2. Lisa Evers & Helen Miller & Christoph Spengel, 2015. "Intellectual property box regimes: effective tax rates and tax policy considerations," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 22(3), pages 502-530, June.
    3. Ander Perez-Orive & Andrea Caggese, 2017. "Capital Misallocation and Secular Stagnation," 2017 Meeting Papers 382, Society for Economic Dynamics.
    4. Margareta Stela FLORESCU & Alina ªtefania CREÞU, 2013. "Management of Financial Resources for Scientific Research in Universities in Romania," REVISTA DE MANAGEMENT COMPARAT INTERNATIONAL/REVIEW OF INTERNATIONAL COMPARATIVE MANAGEMENT, Faculty of Management, Academy of Economic Studies, Bucharest, Romania, vol. 14(3), pages 415-424, July.
    5. Sabine Visser, 2007. "R&D in Worldscan," CPB Memorandum 189.rdf, CPB Netherlands Bureau for Economic Policy Analysis.
    6. Timmer, Marcel & Ypma, Gerard & van Ark, Bart van, 2007. "PPPs for Industry Output: A New Dataset for International Comparisons," GGDC Research Memorandum GD-82, Groningen Growth and Development Centre, University of Groningen.
    7. Richard M. H. Suen, 2013. "Research Policy and U.S. Economic Growth," Working papers 2013-18, University of Connecticut, Department of Economics.
    8. Carol Coorado & Jonathan Haskel & Cecilia Iona Lasinio & Massimiliano Iommi, 2012. "Intangible Capital and Growth Strategies for Advanced Economies: Measurement and Comparative Results," Working Papers LuissLab 12101, Dipartimento di Economia e Finanza, LUISS Guido Carli.
    9. Jakob Madsen, 2008. "Semi-endogenous versus Schumpeterian growth models: testing the knowledge production function using international data," Journal of Economic Growth, Springer, vol. 13(1), pages 1-26, March.
    10. repec:dgr:rugggd:gd-82 is not listed on IDEAS
    11. Heisey, Paul W & Fuglie, Keith O., 2018. "Agricultural Research Investment and Policy Reform in High-Income Countries," Economic Research Report 276235, United States Department of Agriculture, Economic Research Service.
    12. Gersbach, Hans & Schneider, Maik & Schetter, Ulrich, 2015. "How Much Science? The 5 Ws (and 1 H) of Investing in Basic Research," CEPR Discussion Papers 10482, C.E.P.R. Discussion Papers.
    13. Evers, Lisa & Spengel, Christoph, 2014. "Effective tax rates under IP tax planning," ZEW Discussion Papers 14-111, ZEW - Leibniz Centre for European Economic Research.
    14. Robert H. McGuckin & Robert Inklaar & Bart van Ark & Sean M. Dougherty, 2004. "The Structure of Business R&D: Recent Trends and Measurement Implications," Economics Program Working Papers 04-01, The Conference Board, Economics Program.
    15. Sabine Visser, 2007. "R&D in Worldscan," CPB Memorandum 189, CPB Netherlands Bureau for Economic Policy Analysis.
    16. Haskel, Jonathan & Iommi, Massimiliano, 2012. "Intangible Capital and Growth in Advanced Economies: Measurement and Comparative Results," CEPR Discussion Papers 9061, C.E.P.R. Discussion Papers.
    17. Russell Thomson & Paul Jensen, 2013. "The Effects of Government Subsidies on Business R&D Employment: Evidence From Oecd Countries," National Tax Journal, National Tax Association;National Tax Journal, vol. 66(2), pages 281-310, June.
    18. Stephane Lhuillery & Julio Raffo & Intan Hamdan-Livramento, 2016. "Measuring creativity: Learning from innovation measurement," WIPO Economic Research Working Papers 31, World Intellectual Property Organization - Economics and Statistics Division.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:oup:scippl:v:44:y:2017:i:2:p:246-258.. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Oxford University Press (email available below). General contact details of provider: https://academic.oup.com/spp .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.