IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v91y2012i2d10.1007_s11192-011-0573-9.html
   My bibliography  Save this article

Delineating the scientific footprint in technology: Identifying scientific publications within non-patent references

Author

Listed:
  • Julie Callaert

    (Faculty of Business and Economics, K.U. Leuven)

  • Joris Grouwels

    (Faculty of Business and Economics, K.U. Leuven)

  • Bart Looy

    (Faculty of Business and Economics, K.U. Leuven)

Abstract

Indicators based on non-patent references (NPRs) are increasingly being used for measuring and assessing science–technology interactions. But NPRs in patent documents contain noise, as not all of them can be considered ‘scientific’. In this article, we introduce the results of a machine-learning algorithm that allows identifying scientific references in an automated manner. Using the obtained results, we analyze indicators based on NPRs, with a focus on the difference between NPR- and scientific non-patent references-based indicators. Differences between both indicators are significant and dependent on the considered patent system, the applicant country and the technological domain. These results signal the relevancy of delineating scientific references when using NPRs to assess the occurrence and impact of science–technology interactions.

Suggested Citation

  • Julie Callaert & Joris Grouwels & Bart Looy, 2012. "Delineating the scientific footprint in technology: Identifying scientific publications within non-patent references," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(2), pages 383-398, May.
    • Handle: RePEc:spr:scient:v:91:y:2012:i:2:d:10.1007_s11192-011-0573-9
    DOI: 10.1007/s11192-011-0573-9
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-011-0573-9
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-011-0573-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Zi-Lin He & Min Deng, 2007. "The evidence of systematic noise in non-patent references: A study of New Zealand companies’ patents," Scientometrics, Springer;Akadémiai Kiadó, vol. 72(1), pages 149-166, July.
    2. Meyer, Martin, 2000. "Does science push technology? Patents citing scientific literature," Research Policy, Elsevier, vol. 29(3), pages 409-434, March.
    3. van Vianen, B. G. & Moed, H. F. & van Raan, A. F. J., 1990. "An exploration of the science base of recent technology," Research Policy, Elsevier, vol. 19(1), pages 61-81, February.
    4. Jiancheng Guan & Ying He, 2007. "Patent-bibliometric analysis on the Chinese science — technology linkages," Scientometrics, Springer;Akadémiai Kiadó, vol. 72(3), pages 403-425, September.
    5. onder Nomaler & Bart Verspagen, 2008. "Knowledge Flows, Patent Citations and the Impact of Science on Technology," Economic Systems Research, Taylor & Francis Journals, vol. 20(4), pages 339-366.
    6. Tom Magerman & Bart Looy & Xiaoyan Song, 2010. "Exploring the feasibility and accuracy of Latent Semantic Analysis based text mining techniques to detect similarity between patent documents and scientific publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 82(2), pages 289-306, February.
    7. Harhoff, Dietmar & Scherer, Frederic M. & Vopel, Katrin, 2003. "Citations, family size, opposition and the value of patent rights," Research Policy, Elsevier, vol. 32(8), pages 1343-1363, September.
    8. Bart Van Looy & Edwin Zimmermann & Reinhilde Veugelers & Arnold Verbeek & Johanna Mello & Koenraad Debackere, 2003. "Do science-technology interactions pay off when developing technology?," Scientometrics, Springer;Akadémiai Kiadó, vol. 57(3), pages 355-367, July.
    9. Martin Meyer, 2000. "What is Special about Patent Citations? Differences between Scientific and Patent Citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 49(1), pages 93-123, August.
    10. R. J. W. Tussen & R. K. Buter & Th. N. van Leeuwen, 2000. "Technological Relevance of Science: An Assessment of Citation Linkages between Patents and Research Papers," Scientometrics, Springer;Akadémiai Kiadó, vol. 47(2), pages 389-412, February.
    11. Julie Callaert & Bart Van Looy & Arnold Verbeek & Koenraad Debackere & Bart Thijs, 2006. "Traces of Prior Art: An analysis of non-patent references found in patent documents," Scientometrics, Springer;Akadémiai Kiadó, vol. 69(1), pages 3-20, October.
    12. Szu-chia S. Lo, 2010. "Scientific linkage of science research and technology development: a case of genetic engineering research," Scientometrics, Springer;Akadémiai Kiadó, vol. 82(1), pages 109-120, January.
    13. Nelson, Andrew J., 2009. "Measuring knowledge spillovers: What patents, licenses and publications reveal about innovation diffusion," Research Policy, Elsevier, vol. 38(6), pages 994-1005, July.
    14. Bart Looy & Tom Magerman & Koenraad Debackere, 2007. "Developing technology in the vicinity of science: An examination of the relationship between science intensity (of patents) and technological productivity within the field of biotechnology," Scientometrics, Springer;Akadémiai Kiadó, vol. 70(2), pages 441-458, February.
    15. Jacques Michel & Bernd Bettels, 2001. "Patent citation analysis.A closer look at the basic input data from patent search reports," Scientometrics, Springer;Akadémiai Kiadó, vol. 51(1), pages 185-201, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mu-Hsuan Huang & Ssu-Han Chen & Chia-Ying Lin & Dar-Zen Chen, 2014. "Exploring temporal relationships between scientific and technical fronts: a case of biotechnology field," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 1085-1100, February.
    2. Masashi Shirabe, 2014. "Identifying SCI covered publications within non-patent references in U.S. utility patents," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(2), pages 999-1014, November.
    3. Julie Callaert & Maikel Pellens & Bart Looy, 2014. "Sources of inspiration? Making sense of scientific references in patents," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(3), pages 1617-1629, March.
    4. Jaimin Goh & Jaehong Lee & Wonchang Hur & Yunchang Ju, 2019. "Do Analysts Fully Reflect Information in Patents about Future Earnings?," Sustainability, MDPI, vol. 11(10), pages 1-17, May.
    5. Cassiman, Bruno & Veugelers, Reinhilde & Arts, Sam, 2018. "Mind the gap: Capturing value from basic research through combining mobile inventors and partnerships," Research Policy, Elsevier, vol. 47(9), pages 1811-1824.
    6. Leonardo Costa Ribeiro & Glenda Kruss & Gustavo Britto & Américo Tristão Bernardes & Eduardo Motta e Albuquerque, 2014. "A methodology for unveiling global innovation networks: patent citations as clues to cross border knowledge flows," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(1), pages 61-83, October.
    7. Chen, Lixin, 2017. "Do patent citations indicate knowledge linkage? The evidence from text similarities between patents and their citations," Journal of Informetrics, Elsevier, vol. 11(1), pages 63-79.
    8. Chul Lee & Gunno Park & Klaus Marhold & Jina Kang, 2017. "Top management team’s innovation-related characteristics and the firm’s explorative R&D: an analysis based on patent data," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(2), pages 639-663, May.
    9. Appio, Francesco Paolo & Martini, Antonella & Fantoni, Gualtiero, 2017. "The light and shade of knowledge recombination: Insights from a general-purpose technology," Technological Forecasting and Social Change, Elsevier, vol. 125(C), pages 154-165.
    10. Alfonso Ávila-Robinson & Shintaro Sengoku, 2017. "Tracing the knowledge-building dynamics in new stem cell technologies through techno-scientific networks," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(3), pages 1691-1720, September.
    11. Matt Marx & Aaron Fuegi, 2020. "Reliance on science: Worldwide front‐page patent citations to scientific articles," Strategic Management Journal, Wiley Blackwell, vol. 41(9), pages 1572-1594, September.
    12. Lee, Changyong & Kwon, Ohjin & Kim, Myeongjung & Kwon, Daeil, 2018. "Early identification of emerging technologies: A machine learning approach using multiple patent indicators," Technological Forecasting and Social Change, Elsevier, vol. 127(C), pages 291-303.
    13. Leten, Bart & Landoni, Paolo & Van Looy, Bart, 2014. "Science or graduates: How do firms benefit from the proximity of universities?," Research Policy, Elsevier, vol. 43(8), pages 1398-1412.
    14. Bart Leten & Rene Belderbos & Bart Van Looy, 2016. "Entry and Technological Performance in New Technology Domains: Technological Opportunities, Technology Competition and Technological Relatedness," Journal of Management Studies, Wiley Blackwell, vol. 53(8), pages 1257-1291, December.
    15. Veugelers, Reinhilde & Wang, Jian, 2019. "Scientific novelty and technological impact," Research Policy, Elsevier, vol. 48(6), pages 1362-1372.
    16. Guijie Zhang & Luning Liu & Fangfang Wei, 2019. "Key nodes mining in the inventor–author knowledge diffusion network," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(3), pages 721-735, March.
    17. Kenneth Zahringer & Christos Kolympiris & Nicholas Kalaitzandonakes, 2017. "Academic knowledge quality differentials and the quality of firm innovation," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 26(5), pages 821-844.
    18. Yi-Ching Liaw & Te-Yi Chan & Chin-Yuan Fan & Cheng-Hsin Chiang, 2014. "Can the technological impact of academic journals be evaluated? The practice of non-patent reference (NPR) analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(1), pages 17-37, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bar-Ilan, Judit, 2008. "Informetrics at the beginning of the 21st century—A review," Journal of Informetrics, Elsevier, vol. 2(1), pages 1-52.
    2. Amalia Mas-Bleda & Mike Thelwall, 2016. "Can alternative indicators overcome language biases in citation counts? A comparison of Spanish and UK research," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 2007-2030, December.
    3. Xu, Haiyun & Winnink, Jos & Yue, Zenghui & Liu, Ziqiang & Yuan, Guoting, 2020. "Topic-linked innovation paths in science and technology," Journal of Informetrics, Elsevier, vol. 14(2).
    4. Xia Gao & Jiancheng Guan, 2009. "Networks of scientific journals: An exploration of Chinese patent data," Scientometrics, Springer;Akadémiai Kiadó, vol. 80(1), pages 283-302, July.
    5. Chen, Lixin, 2017. "Do patent citations indicate knowledge linkage? The evidence from text similarities between patents and their citations," Journal of Informetrics, Elsevier, vol. 11(1), pages 63-79.
    6. Chihmao Hsieh, 2011. "Explicitly searching for useful inventions: dynamic relatedness and the costs of connecting versus synthesizing," Scientometrics, Springer;Akadémiai Kiadó, vol. 86(2), pages 381-404, February.
    7. Wang, Jean J. & Ye, Fred Y., 2021. "Probing into the interactions between papers and patents of new CRISPR/CAS9 technology: A citation comparison," Journal of Informetrics, Elsevier, vol. 15(4).
    8. Jiancheng Guan & Ying He, 2007. "Patent-bibliometric analysis on the Chinese science — technology linkages," Scientometrics, Springer;Akadémiai Kiadó, vol. 72(3), pages 403-425, September.
    9. Guijie Zhang & Yuqiang Feng & Guang Yu & Luning Liu & Yanqiqi Hao, 2017. "Analyzing the time delay between scientific research and technology patents based on the citation distribution model," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(3), pages 1287-1306, June.
    10. Gazni, Ali, 2020. "The growing number of patent citations to scientific papers: Changes in the world, nations, and fields," Technology in Society, Elsevier, vol. 62(C).
    11. Sung, Hui-Yun & Wang, Chun-Chieh & Huang, Mu-Hsuan & Chen, Dar-Zen, 2015. "Measuring science-based science linkage and non-science-based linkage of patents through non-patent references," Journal of Informetrics, Elsevier, vol. 9(3), pages 488-498.
    12. Adam B. Jaffe & Gaétan de Rassenfosse, 2017. "Patent citation data in social science research: Overview and best practices," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(6), pages 1360-1374, June.
    13. von Wartburg, Iwan & Teichert, Thorsten & Rost, Katja, 2005. "Inventive progress measured by multi-stage patent citation analysis," Research Policy, Elsevier, vol. 34(10), pages 1591-1607, December.
    14. Bart Looy & Tom Magerman & Koenraad Debackere, 2007. "Developing technology in the vicinity of science: An examination of the relationship between science intensity (of patents) and technological productivity within the field of biotechnology," Scientometrics, Springer;Akadémiai Kiadó, vol. 70(2), pages 441-458, February.
    15. Acosta, Manuel & Coronado, Daniel, 2003. "Science-technology flows in Spanish regions: An analysis of scientific citations in patents," Research Policy, Elsevier, vol. 32(10), pages 1783-1803, December.
    16. Arnold Verbeek & Koenraad Debackere & Marc Luwel, 2003. "Science cited in patents: A geographic "flow" analysis of bibliographic citation patterns in patents," Scientometrics, Springer;Akadémiai Kiadó, vol. 58(2), pages 241-263, October.
    17. Masashi Shirabe, 2014. "Identifying SCI covered publications within non-patent references in U.S. utility patents," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(2), pages 999-1014, November.
    18. Jung Cheol Shin & Soo Jeung Lee & Yangson Kim, 2012. "Knowledge-based innovation and collaboration: a triple-helix approach in Saudi Arabia," Scientometrics, Springer;Akadémiai Kiadó, vol. 90(1), pages 311-326, January.
    19. Leten, Bart & Landoni, Paolo & Van Looy, Bart, 2014. "Science or graduates: How do firms benefit from the proximity of universities?," Research Policy, Elsevier, vol. 43(8), pages 1398-1412.
    20. Naomi Fukuzawa & Takanori Ida, 2016. "Science linkages between scientific articles and patents for leading scientists in the life and medical sciences field: the case of Japan," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(2), pages 629-644, February.

    More about this item

    Keywords

    Science–technology interaction; Non-patent references; Indicators; Machine learning;
    All these keywords.

    JEL classification:

    • O32 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Management of Technological Innovation and R&D
    • O34 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Intellectual Property and Intellectual Capital

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:91:y:2012:i:2:d:10.1007_s11192-011-0573-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.