IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v109y2016i2d10.1007_s11192-016-2098-8.html
   My bibliography  Save this article

University–industry R&D linkage metrics: validity and applicability in world university rankings

Author

Listed:
  • Robert J. W. Tijssen

    (Leiden University
    Stellenbosch University)

  • Alfredo Yegros-Yegros

    (Leiden University)

  • Jos J. Winnink

    (Leiden University
    NL Patent Office)

Abstract

In September 2015 Thomson Reuters published its Ranking of Innovative Universities (RIU). Covering 100 large research-intensive universities worldwide, Stanford University came in first, MIT was second and Harvard in third position. But how meaningful is this outcome? In this paper we will take a critical view from a methodological perspective. We focus our attention on the various types of metrics available, whether or not data redundancies are addressed, and if metrics should be assembled into a single composite overall score or not. We address these issues in some detail by emphasizing one metric in particular: university–industry co-authored publications (UICs). We compare the RIU with three variants of our own University–Industry R&D Linkage Index, which we derived from the bibliometric analysis of 750 research universities worldwide. Our findings highlight conceptual and methodological problems with UIC-based data, as well as computational weaknesses such university ranking systems. Avoiding choices between size-dependent or independent metrics, and between single-metrics and multi-metrics systems, we recommend an alternative ‘scoreboard’ approach: (1) without weighing systems of metrics and composite scores; (2) computational procedures and information sources are made more transparent; (3) size-dependent metrics are kept separate from size-independent metrics; (4) UIC metrics are selected according to the type of proximity relationship between universities and industry.

Suggested Citation

  • Robert J. W. Tijssen & Alfredo Yegros-Yegros & Jos J. Winnink, 2016. "University–industry R&D linkage metrics: validity and applicability in world university rankings," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 677-696, November.
    • Handle: RePEc:spr:scient:v:109:y:2016:i:2:d:10.1007_s11192-016-2098-8
    DOI: 10.1007/s11192-016-2098-8
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-016-2098-8
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-016-2098-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. J Calvert & P Patel, 2003. "University-industry research collaborations in the UK: Bibliometric trends," Science and Public Policy, Oxford University Press, vol. 30(2), pages 85-96, April.
    2. Valeria Arza & Claudia Vazquez, 2010. "Interactions between public research organisations and industry in Argentina," Science and Public Policy, Oxford University Press, vol. 37(7), pages 499-511, August.
    3. Corinne Autant‐Bernard & Pascal Billand & David Frachisse & Nadine Massard, 2007. "Social distance versus spatial distance in R&D cooperation: Empirical evidence from European collaboration choices in micro and nanotechnologies," Papers in Regional Science, Wiley Blackwell, vol. 86(3), pages 495-519, August.
    4. Keld Laursen & Toke Reichstein & Ammon Salter, 2011. "Exploring the Effect of Geographical Proximity and University Quality on University-Industry Collaboration in the United Kingdom," Regional Studies, Taylor & Francis Journals, vol. 45(4), pages 507-523.
    5. Roderik Ponds & Frank Van Oort & Koen Frenken, 2007. "The geographical and institutional proximity of research collaboration," Papers in Regional Science, Wiley Blackwell, vol. 86(3), pages 423-443, August.
    6. Tijssen, Robert J.W., 2006. "Universities and industrially relevant science: Towards measurement models and indicators of entrepreneurial orientation," Research Policy, Elsevier, vol. 35(10), pages 1569-1585, December.
    7. Alessandro Muscio & Giovanna Vallanti, 2014. "Perceived Obstacles to University-Industry Collaboration: Results from a Qualitative Survey of Italian Academic Departments," Industry and Innovation, Taylor & Francis Journals, vol. 21(5), pages 410-429, July.
    8. Poh Kam Wong & Annette Singh, 2013. "Do co-publications with industry lead to higher levels of university technology commercialization activity?," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(2), pages 245-265, November.
    9. Maribel Guerrero & David Urbano, 2012. "The development of an entrepreneurial university," The Journal of Technology Transfer, Springer, vol. 37(1), pages 43-74, February.
    10. Nooteboom, Bart & Van Haverbeke, Wim & Duysters, Geert & Gilsing, Victor & van den Oord, Ad, 2007. "Optimal cognitive distance and absorptive capacity," Research Policy, Elsevier, vol. 36(7), pages 1016-1034, September.
    11. Gabriela Dutrénit & Claudia De Fuentes & Arturo Torres, 2010. "Channels of interaction between public research organisations and industry and their benefits: evidence from Mexico," Science and Public Policy, Oxford University Press, vol. 37(7), pages 513-526, August.
    12. Alfredo Yegros-Yegros & Joaquín M. Azagra-Caro & Mayte López-Ferrer & Robert J.W. Tijssen, 2016. "Do university–industry co-publication outputs correspond with university funding from firms?," Research Evaluation, Oxford University Press, vol. 25(2), pages 136-150.
    13. Hong, Wei & Su, Yu-Sung, 2013. "The effect of institutional proximity in non-local university–industry collaborations: An analysis based on Chinese patent data," Research Policy, Elsevier, vol. 42(2), pages 454-464.
    14. Ludo Waltman & Clara Calero-Medina & Joost Kosten & Ed C.M. Noyons & Robert J.W. Tijssen & Nees Jan Eck & Thed N. Leeuwen & Anthony F.J. Raan & Martijn S. Visser & Paul Wouters, 2012. "The Leiden ranking 2011/2012: Data collection, indicators, and interpretation," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(12), pages 2419-2432, December.
    15. Narin, Francis & Hamilton, Kimberly S. & Olivastro, Dominic, 1997. "The increasing linkage between U.S. technology and public science," Research Policy, Elsevier, vol. 26(3), pages 317-330, October.
    16. Wolfgang Glänzel & Balázs Schlemmer, 2007. "National research profiles in a changing Europe (1983–2003) An exploratory study of sectoral characteristics in the Triple Helix," Scientometrics, Springer;Akadémiai Kiadó, vol. 70(2), pages 267-275, February.
    17. Robert J W Tijssen & Thed N van Leeuwen & Erik van Wijk, 2009. "Benchmarking university-industry research cooperation worldwide: performance measurements and indicators based on co-authorship data for the world's largest universities," Research Evaluation, Oxford University Press, vol. 18(1), pages 13-24, March.
    18. Xia Fan & Xiaowan Yang & Liming Chen, 2015. "Diversified resources and academic influence: patterns of university–industry collaboration in Chinese research-oriented universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(2), pages 489-509, August.
    19. Audretsch, David B & Feldman, Maryann P, 1996. "R&D Spillovers and the Geography of Innovation and Production," American Economic Review, American Economic Association, vol. 86(3), pages 630-640, June.
    20. Carpenter, Mark P. & Narin, Francis & Woolf, Patricia, 1981. "Citation rates to technologically important patents," World Patent Information, Elsevier, vol. 3(4), pages 160-163, October.
    21. Anet Weterings & Roderik Ponds, 2009. "Do Regional and Non-regional Knowledge Flows Differ? An Empirical Study on Clustered Firms in the Dutch Life Sciences and Computing Services Industry," Industry and Innovation, Taylor & Francis Journals, vol. 16(1), pages 11-31.
    22. Pierre-Alexandre Balland, 2012. "Proximity and the Evolution of Collaboration Networks: Evidence from Research and Development Projects within the Global Navigation Satellite System (GNSS) Industry," Regional Studies, Taylor & Francis Journals, vol. 46(6), pages 741-756, September.
    23. Briggs, Kristie, 2015. "Co-owner relationships conducive to high quality joint patents," Research Policy, Elsevier, vol. 44(8), pages 1566-1573.
    24. Valeria Arza, 2010. "Channels, benefits and risks of public—private interactions for knowledge transfer: conceptual framework inspired by Latin America," Science and Public Policy, Oxford University Press, vol. 37(7), pages 473-484, August.
    25. Michael Roach & Wesley M. Cohen, 2013. "Lens or Prism? Patent Citations as a Measure of Knowledge Flows from Public Research," Management Science, INFORMS, vol. 59(2), pages 504-525, October.
    26. Rachel Levy & Pascale Roux & Sandrine Wolff, 2009. "An analysis of science–industry collaborative patterns in a large European University," The Journal of Technology Transfer, Springer, vol. 34(1), pages 1-23, February.
    27. Tom Broekel & Ron Boschma, 2012. "Knowledge networks in the Dutch aviation industry: the proximity paradox," Journal of Economic Geography, Oxford University Press, vol. 12(2), pages 409-433, March.
    28. Bruno Cassiman & Reinhilde Veugelers & Pluvia Zuniga, 2008. "In search of performance effects of (in)direct industry science links," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 17(4), pages 611-646, August.
    29. Perkmann, Markus & Tartari, Valentina & McKelvey, Maureen & Autio, Erkko & Broström, Anders & D’Este, Pablo & Fini, Riccardo & Geuna, Aldo & Grimaldi, Rosa & Hughes, Alan & Krabel, Stefan & Kitson, Mi, 2013. "Academic engagement and commercialisation: A review of the literature on university–industry relations," Research Policy, Elsevier, vol. 42(2), pages 423-442.
    30. Yuan Sun & Masamitsu Negishi & Masaki Nishizawa, 2007. "Coauthorship linkages between universities and industry in Japan," Research Evaluation, Oxford University Press, vol. 16(4), pages 299-309, December.
    31. John Hagedoorn, 2003. "Sharing intellectual property rights--an exploratory study of joint patenting amongst companies," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 12(5), pages 1035-1050, October.
    32. R. J. W. Tussen & R. K. Buter & Th. N. van Leeuwen, 2000. "Technological Relevance of Science: An Assessment of Citation Linkages between Patents and Research Papers," Scientometrics, Springer;Akadémiai Kiadó, vol. 47(2), pages 389-412, February.
    33. Harvey Goldstein & David J. Spiegelhalter, 1996. "League Tables and Their Limitations: Statistical Issues in Comparisons of Institutional Performance," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 159(3), pages 385-409, May.
    34. Ron Boschma, 2005. "Proximity and Innovation: A Critical Assessment," Regional Studies, Taylor & Francis Journals, vol. 39(1), pages 61-74.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Santini, Mateus Augusto Fassina & Faccin, Kadígia & Balestrin, Alsones & Volkmer Martins, Bibiana, 2021. "How the relational structure of universities influences research and development results," Journal of Business Research, Elsevier, vol. 125(C), pages 155-163.
    2. Perkmann, Markus & Salandra, Rossella & Tartari, Valentina & McKelvey, Maureen & Hughes, Alan, 2021. "Academic engagement: A review of the literature 2011-2019," Research Policy, Elsevier, vol. 50(1).
    3. McAleer, M.J. & Nakamura, T. & Watkins, C., 2018. "Size, Internationalization and University Rankings: Evaluating Times Higher Education (THE) Data for Japan," Econometric Institute Research Papers EI2018-43, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    4. João Lopes & João Lussuamo, 2021. "Barriers to University-Industry Cooperation in a Developing Region," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 12(3), pages 1019-1035, September.
    5. Joaquín M. Azagra-Caro & Laura González-Salmerón & Pedro Marques, 2021. "Fiction lagging behind or non-fiction defending the indefensible? University–industry (et al.) interaction in science fiction," The Journal of Technology Transfer, Springer, vol. 46(6), pages 1889-1916, December.
    6. Johannes van Der Pol & Jean-Paul Rameshkoumar, 2021. "A method to reduce false positives in a patent query [Une méthode pour réduire les faux positifs dans une requête brevet]," Working Papers hal-03287970, HAL.
    7. Bertoletti, Alice & Berbegal-Mirabent, Jasmina & Agasisti, Tommaso, 2022. "Higher education systems and regional economic development in Europe: A combined approach using econometric and machine learning methods," Socio-Economic Planning Sciences, Elsevier, vol. 82(PA).
    8. Michael McAleer & Tamotsu Nakamura & Clinton Watkins, 2019. "Size, Internationalization, and University Rankings: Evaluating and Predicting Times Higher Education (THE) Data for Japan," Sustainability, MDPI, vol. 11(5), pages 1-12, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Christian Omobhude & Shih-Hsin Chen, 2019. "The Roles and Measurements of Proximity in Sustained Technology Development: A Literature Review," Sustainability, MDPI, vol. 11(1), pages 1-30, January.
    2. Villani, Elisa & Rasmussen, Einar & Grimaldi, Rosa, 2017. "How intermediary organizations facilitate university–industry technology transfer: A proximity approach," Technological Forecasting and Social Change, Elsevier, vol. 114(C), pages 86-102.
    3. Ferretti, Marco & Guerini, Massimiliano & Panetti, Eva & Parmentola, Adele, 2022. "The partner next door? The effect of micro-geographical proximity on intra-cluster inter-organizational relationships," Technovation, Elsevier, vol. 111(C).
    4. Claudia Fuentes & Gabriela Dutrénit, 2016. "Geographic proximity and university–industry interaction: the case of Mexico," The Journal of Technology Transfer, Springer, vol. 41(2), pages 329-348, April.
    5. Lorenzo Cassi & Anne Plunket, 2014. "Proximity, network formation and inventive performance: in search of the proximity paradox," The Annals of Regional Science, Springer;Western Regional Science Association, vol. 53(2), pages 395-422, September.
    6. Davids, Mila & Frenken, Koen, 2015. "Proximity, knowledge base and the innovation process The case of Unilever’s Becel diet margarine," Papers in Innovation Studies 2015/7, Lund University, CIRCLE - Centre for Innovation Research.
    7. Rune Dahl Fitjar & Franz Huber & Andrés Rodríguez-Pose, 2016. "Not too close, not too far: testing the Goldilocks principle of ‘optimal’ distance in innovation networks," Industry and Innovation, Taylor & Francis Journals, vol. 23(6), pages 465-487, August.
    8. Emerson Gomes Santos & Renato Garcia & Veneziano Araujo & Suelene Mascarini & Ariana Costa, 2021. "Spatial and non‐spatial proximity in university–industry collaboration: Mutual reinforcement and decreasing effects," Regional Science Policy & Practice, Wiley Blackwell, vol. 13(4), pages 1249-1261, August.
    9. Ana Fernández & Esther Ferrándiz & M. Dolores León, 2021. "Are organizational and economic proximity driving factors of scientific collaboration? Evidence from Spanish universities, 2001–2010," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 579-602, January.
    10. Massimo G. Colombo & Massimiliano Guerini & Cristina Rossi-Lamastra & Andrea Bonaccorsi, 2022. "The “first match” between high-tech entrepreneurial ventures and universities: the role of founders’ social ties," The Journal of Technology Transfer, Springer, vol. 47(1), pages 270-306, February.
    11. Maria Tsouri, 2022. "Knowledge networks and strong tie creation: the role of relative network position," Journal of Geographical Systems, Springer, vol. 24(1), pages 95-114, January.
    12. Negin Salimi & Rudi Bekkers & Koen Frenken, 2015. "Governance mode choice in collaborative Ph.D. projects," The Journal of Technology Transfer, Springer, vol. 40(5), pages 840-858, October.
    13. Steinmo, Marianne & Rasmussen, Einar, 2016. "How firms collaborate with public research organizations: The evolution of proximity dimensions in successful innovation projects," Journal of Business Research, Elsevier, vol. 69(3), pages 1250-1259.
    14. Ron Boschma & Pierre-Alexandre Balland & Mathijs de Vaan, 2014. "The formation of economic networks: a proximity approach," Chapters, in: André Torre & Frédéric Wallet (ed.), Regional Development and Proximity Relations, chapter 7, pages 243-266, Edward Elgar Publishing.
    15. Yongli Tang & Kazuyuki Motohashi & Xinyue Hu & Angeles Montoro-Sanchez, 2020. "University-industry interaction and product innovation performance of Guangdong manufacturing firms: the roles of regional proximity and research quality of universities," The Journal of Technology Transfer, Springer, vol. 45(2), pages 578-618, April.
    16. Poh Kam Wong & Annette Singh, 2013. "Do co-publications with industry lead to higher levels of university technology commercialization activity?," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(2), pages 245-265, November.
    17. Tolulope Paul Akinbobola & Oluwole Matthew Akinnagbe, 2023. "Determinants of linkages between agricultural institutions and agro-allied industries in Southwest, Nigeria," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 25(1), pages 228-248, January.
    18. Pierre-Alexandre Balland & Ron Boschma & Koen Frenken, 2015. "Proximity and Innovation: From Statics to Dynamics," Regional Studies, Taylor & Francis Journals, vol. 49(6), pages 907-920, June.
    19. Lorenzo Cassi & Anne Plunket, 2015. "Research Collaboration in Co-inventor Networks: Combining Closure, Bridging and Proximities," Regional Studies, Taylor & Francis Journals, vol. 49(6), pages 936-954, June.
    20. Tatiana Plotnikova & Bastian Rake, 2014. "Collaboration in pharmaceutical research: exploration of country-level determinants," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 1173-1202, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:109:y:2016:i:2:d:10.1007_s11192-016-2098-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.