IDEAS home Printed from https://ideas.repec.org/a/eee/infome/v19y2025i2s1751157725000082.html

Avoiding the pitfalls of direct linkage: A novelty-driven approach to measuring scientific impact on patents

Author

Listed:
  • Denter, Nils M.
  • Waterstraat, Joe
  • Moehrle, Martin G.

Abstract

Scientific knowledge plays a major role in the generation of new technological knowledge. We present a new novelty-driven approach to measure the influence of science on patents. We overcome the weaknesses of previous methods based on either citations or semantic similarities, both representing direct linkages between documents. We combine patent novelty measurement with technology-specific, scientific dictionaries, which allow us to measure a patent's nearness to science by stable indirect linkages. We apply our indicator “science-driven novelty” to the testbed of RFID technology and confirm its validity by conducting an expert survey. Subsequently, we test how science impacts patent value, finding that scientific influence increases the average value of a patent. Our results suggest several implications. For academics, we recommend not relying solely on analyzing direct links between papers and patents to determine the influence of science on technology. For management, we provide a new tool to assess scientific influences in patents and thus the value of their company's own patent portfolio as well as the portfolios of third parties. Using text as data, the tool is viable at a very early stage and can be helpful in go/no-go decisions for technology management.

Suggested Citation

  • Denter, Nils M. & Waterstraat, Joe & Moehrle, Martin G., 2025. "Avoiding the pitfalls of direct linkage: A novelty-driven approach to measuring scientific impact on patents," Journal of Informetrics, Elsevier, vol. 19(2).
    • Handle: RePEc:eee:infome:v:19:y:2025:i:2:s1751157725000082
    DOI: 10.1016/j.joi.2025.101644
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1751157725000082
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.joi.2025.101644?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Zhao, Shengchao & Zeng, Deming & Li, Jian & Feng, Ke & Wang, Yao, 2023. "Quantity or quality: The roles of technology and science convergence on firm innovation performance," Technovation, Elsevier, vol. 126(C).
    2. Hu, Mei-Chih & Mathews, John A., 2008. "China's national innovative capacity," Research Policy, Elsevier, vol. 37(9), pages 1465-1479, October.
    3. Wang, Jian & Verberne, Suzan, 2024. "Comparing patent in-text and front-page references to science," Journal of Informetrics, Elsevier, vol. 18(4).
    4. Manuel Trajtenberg, 1990. "A Penny for Your Quotes: Patent Citations and the Value of Innovations," RAND Journal of Economics, The RAND Corporation, vol. 21(1), pages 172-187, Spring.
    5. Barbieri, Nicolò & Marzucchi, Alberto & Rizzo, Ugo, 2020. "Knowledge sources and impacts on subsequent inventions: Do green technologies differ from non-green ones?," Research Policy, Elsevier, vol. 49(2).
    6. Mansfield, Edwin, 1991. "Academic research and industrial innovation," Research Policy, Elsevier, vol. 20(1), pages 1-12, February.
    7. Criscuolo, Paola & Verspagen, Bart, 2008. "Does it matter where patent citations come from? Inventor vs. examiner citations in European patents," Research Policy, Elsevier, vol. 37(10), pages 1892-1908, December.
    8. Higham, Kyle & de Rassenfosse, Gaétan & Jaffe, Adam B., 2021. "Patent Quality: Towards a Systematic Framework for Analysis and Measurement," Research Policy, Elsevier, vol. 50(4).
    9. Arts, Sam & Hou, Jianan & Gomez, Juan Carlos, 2021. "Natural language processing to identify the creation and impact of new technologies in patent text: Code, data, and new measures," Research Policy, Elsevier, vol. 50(2).
    10. Martin Meyer, 2000. "What is Special about Patent Citations? Differences between Scientific and Patent Citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 49(1), pages 93-123, August.
    11. Stéphane Malo & Aldo Geuna, 2000. "Science-Technology Linkages in an Emerging Research Platform: The Case of Combinatorial Chemistry and Biology," Scientometrics, Springer;Akadémiai Kiadó, vol. 47(2), pages 303-321, February.
    12. Eilers, Kathi & Frischkorn, Jonas & Eppinger, Elisabeth & Walter, Lothar & Moehrle, Martin G., 2019. "Patent-based semantic measurement of one-way and two-way technology convergence: The case of ultraviolet light emitting diodes (UV-LEDs)," Technological Forecasting and Social Change, Elsevier, vol. 140(C), pages 341-353.
    13. repec:adr:anecst:y:2005:i:79-80:p:05 is not listed on IDEAS
    14. Utterback, James M & Abernathy, William J, 1975. "A dynamic model of process and product innovation," Omega, Elsevier, vol. 3(6), pages 639-656, December.
    15. Sarah Kaplan & Keyvan Vakili, 2015. "The double-edged sword of recombination in breakthrough innovation," Strategic Management Journal, Wiley Blackwell, vol. 36(10), pages 1435-1457, October.
    16. Boyack, Kevin W. & Klavans, Richard, 2008. "Measuring science–technology interaction using rare inventor–author names," Journal of Informetrics, Elsevier, vol. 2(3), pages 173-182.
    17. Nasirov, Shukhrat & Joshi, Amol M., 2023. "Minding the communications gap: How can universities signal the availability and value of their scientific knowledge to commercial organizations?," Research Policy, Elsevier, vol. 52(9).
    18. Dornbusch, Friedrich & Schmoch, Ulrich & Schulze, Nicole & Bethke, Nadine, 2012. "Identification of university-based patents: A new large-scale approach," Discussion Papers "Innovation Systems and Policy Analysis" 32, Fraunhofer Institute for Systems and Innovation Research (ISI).
    19. Reitzig, Markus, 2004. "Improving patent valuations for management purposes--validating new indicators by analyzing application rationales," Research Policy, Elsevier, vol. 33(6-7), pages 939-957, September.
    20. Martin G. Moehrle & Jan M. Gerken, 2012. "Measuring textual patent similarity on the basis of combined concepts: design decisions and their consequences," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(3), pages 805-826, June.
    21. Sorenson, Olav & Fleming, Lee, 2004. "Science and the diffusion of knowledge," Research Policy, Elsevier, vol. 33(10), pages 1615-1634, December.
    22. Leo Egghe, 2000. "The Distribution of N-Grams," Scientometrics, Springer;Akadémiai Kiadó, vol. 47(2), pages 237-252, February.
    23. Matt Marx & Aaron Fuegi, 2020. "Reliance on science: Worldwide front‐page patent citations to scientific articles," Strategic Management Journal, Wiley Blackwell, vol. 41(9), pages 1572-1594, September.
    24. Michael Roach & Wesley M. Cohen, 2013. "Lens or Prism? Patent Citations as a Measure of Knowledge Flows from Public Research," Management Science, INFORMS, vol. 59(2), pages 504-525, October.
    25. Bryan Kelly & Dimitris Papanikolaou & Amit Seru & Matt Taddy, 2021. "Measuring Technological Innovation over the Long Run," American Economic Review: Insights, American Economic Association, vol. 3(3), pages 303-320, September.
    26. Matt Marx & Aaron Fuegi, 2022. "Reliance on science by inventors: Hybrid extraction of in‐text patent‐to‐article citations," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 31(2), pages 369-392, April.
    27. Shuo Xu & Dongsheng Zhai & Feifei Wang & Xin An & Hongshen Pang & Yirong Sun, 2019. "A novel method for topic linkages between scientific publications and patents," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 70(9), pages 1026-1042, September.
    28. Leonid Kogan & Dimitris Papanikolaou & Amit Seru & Noah Stoffman, 2017. "Technological Innovation, Resource Allocation, and Growth," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(2), pages 665-712.
    29. Adams, Stephen, 2010. "The text, the full text and nothing but the text: Part 1 - Standards for creating textual information in patent documents and general search implications," World Patent Information, Elsevier, vol. 32(1), pages 22-29, March.
    30. Jeffrey Kuhn & Kenneth Younge & Alan Marco, 2020. "Patent citations reexamined," RAND Journal of Economics, RAND Corporation, vol. 51(1), pages 109-132, March.
    31. Albert, M. B. & Avery, D. & Narin, F. & McAllister, P., 1991. "Direct validation of citation counts as indicators of industrially important patents," Research Policy, Elsevier, vol. 20(3), pages 251-259, June.
    32. Lothar Walter & Alfred Radauer & Martin G. Moehrle, 2017. "The beauty of brimstone butterfly: novelty of patents identified by near environment analysis based on text mining," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(1), pages 103-115, April.
    33. Schoenmakers, Wilfred & Duysters, Geert, 2010. "The technological origins of radical inventions," Research Policy, Elsevier, vol. 39(8), pages 1051-1059, October.
    34. Tom Magerman & Bart Looy & Xiaoyan Song, 2010. "Exploring the feasibility and accuracy of Latent Semantic Analysis based text mining techniques to detect similarity between patent documents and scientific publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 82(2), pages 289-306, February.
    35. Wang, Jean J. & Ye, Fred Y., 2021. "Probing into the interactions between papers and patents of new CRISPR/CAS9 technology: A citation comparison," Journal of Informetrics, Elsevier, vol. 15(4).
    36. Kang, Inje & Yang, Jiseong & Lee, Wonjae & Seo, Eun-Yeong & Lee, Duk Hee, 2023. "Delineating development trends of nanotechnology in the semiconductor industry: Focusing on the relationship between science and technology by employing structural topic model," Technology in Society, Elsevier, vol. 74(C).
    37. Dietmar Harhoff & Francis Narin & F. M. Scherer & Katrin Vopel, 1999. "Citation Frequency And The Value Of Patented Inventions," The Review of Economics and Statistics, MIT Press, vol. 81(3), pages 511-515, August.
    38. Adam B. Jaffe & Manuel Trajtenberg & Rebecca Henderson, 1993. "Geographic Localization of Knowledge Spillovers as Evidenced by Patent Citations," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 108(3), pages 577-598.
    39. Fang Han & Christopher L. Magee, 2018. "Testing the science/technology relationship by analysis of patent citations of scientific papers after decomposition of both science and technology," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(2), pages 767-796, August.
    40. Keijl, S. & Gilsing, V.A. & Knoben, J. & Duysters, G., 2016. "The two faces of inventions: The relationship between recombination and impact in pharmaceutical biotechnology," Research Policy, Elsevier, vol. 45(5), pages 1061-1074.
    41. Harhoff, Dietmar & Scherer, Frederic M. & Vopel, Katrin, 2004. "Erratum to "Citations, family size, opposition and the value of patent rights" [Research Policy 32 (2003) 1343-1363]," Research Policy, Elsevier, vol. 33(2), pages 363-364, March.
    42. Lee Branstetter, 2010. "Exploring the Link between Academic Science and Industrial Innovation," NBER Chapters, in: Contributions in Memory of Zvi Griliches, pages 119-142, National Bureau of Economic Research, Inc.
    43. Friedrich Dornbusch & Ulrich Schmoch & Nicole Schulze & Nadine Bethke, 2012. "Identification of university-based patents: A new large-scale approach," Research Evaluation, Oxford University Press, vol. 22(1), pages 52-63, November.
    44. Jon Schmid & Ayodeji Fajebe, 2019. "Variation in patent impact by organization type: An investigation of government, university, and corporate patents," Science and Public Policy, Oxford University Press, vol. 46(4), pages 589-598.
    45. Hall, Bronwyn H. & Helmers, Christian, 2013. "Innovation and diffusion of clean/green technology: Can patent commons help?," Journal of Environmental Economics and Management, Elsevier, vol. 66(1), pages 33-51.
    46. Verhoeven, Dennis & Bakker, Jurriën & Veugelers, Reinhilde, 2016. "Measuring technological novelty with patent-based indicators," Research Policy, Elsevier, vol. 45(3), pages 707-723.
    47. Harhoff, Dietmar & Gambardella, Alfonso & Verspagen, Bart, 2008. "The Value of European Patents," CEPR Discussion Papers 6848, Centre for Economic Policy Research.
    48. Lund, Peter D. & Lindgren, Juuso & Mikkola, Jani & Salpakari, Jyri, 2015. "Review of energy system flexibility measures to enable high levels of variable renewable electricity," Renewable and Sustainable Energy Reviews, Elsevier, vol. 45(C), pages 785-807.
    49. Jin, Qianqian & Chen, Hongshu & Wang, Xuefeng & Xiong, Fei, 2024. "How do network embeddedness and knowledge stock influence collaboration dynamics? Evidence from patents," Journal of Informetrics, Elsevier, vol. 18(4).
    50. Hirschey, Mark & Richardson, Vernon J., 2001. "Valuation effects of patent quality: A comparison for Japanese and U.S. firms," Pacific-Basin Finance Journal, Elsevier, vol. 9(1), pages 65-82, January.
    51. Felix Poege & Dietmar Harhoff & Fabian Gaessler & Stefano Baruffaldi, 2019. "Science Quality and the Value of Inventions," Papers 1903.05020, arXiv.org, revised Apr 2019.
    52. Ba, Zhichao & Liang, Zhentao, 2021. "A novel approach to measuring science-technology linkage: From the perspective of knowledge network coupling," Journal of Informetrics, Elsevier, vol. 15(3).
    53. Narin, Francis & Hamilton, Kimberly S. & Olivastro, Dominic, 1997. "The increasing linkage between U.S. technology and public science," Research Policy, Elsevier, vol. 26(3), pages 317-330, October.
    54. Bryan, Kevin A. & Ozcan, Yasin & Sampat, Bhaven, 2020. "In-text patent citations: A user's guide," Research Policy, Elsevier, vol. 49(4).
    55. Lee Fleming, 2001. "Recombinant Uncertainty in Technological Search," Management Science, INFORMS, vol. 47(1), pages 117-132, January.
    56. Lili Wang & Zexia Li, 2021. "Knowledge flows from public science to industrial technologies," The Journal of Technology Transfer, Springer, vol. 46(4), pages 1232-1255, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Fang, 2024. "Does the recombination of distant scientific knowledge generate valuable inventions? An analysis of pharmaceutical patents," Technovation, Elsevier, vol. 130(C).
    2. Manuel Acosta & Daniel Coronado & Esther Ferrándiz & Manuel Jiménez, 2022. "Effects of knowledge spillovers between competitors on patent quality: what patent citations reveal about a global duopoly," The Journal of Technology Transfer, Springer, vol. 47(5), pages 1451-1487, October.
    3. Fernández, Ana María & Ferrándiz, Esther & Medina, Jennifer, 2022. "The diffusion of energy technologies. Evidence from renewable, fossil, and nuclear energy patents," Technological Forecasting and Social Change, Elsevier, vol. 178(C).
    4. Fernández, Ana María & Ferrándiz, Esther & Medina, Jennifer, 2022. "The diffusion of energy technologies. Evidence from renewable, fossil, and nuclear energy patents," MPRA Paper 123361, University Library of Munich, Germany.
    5. Ugo Rizzo & Nicolò Barbieri & Laura Ramaciotti & Demian Iannantuono, 2020. "The division of labour between academia and industry for the generation of radical inventions," The Journal of Technology Transfer, Springer, vol. 45(2), pages 393-413, April.
    6. Valentin J. Schmitt, 2025. "Disentangling patent quality: using a large language model for a systematic literature review," Scientometrics, Springer;Akadémiai Kiadó, vol. 130(1), pages 267-311, January.
    7. Jianwei DANG & Kazuyuki MOTOHASHI & Quihan ZHAO, 2025. "Patent Information Disclosure and Market Reactions: Empirical investigation by using text-based novelty and impact indicators," Discussion papers 25097, Research Institute of Economy, Trade and Industry (RIETI).
    8. Jungpyo Lee & So Young Sohn, 2017. "What makes the first forward citation of a patent occur earlier?," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 279-298, October.
    9. Antonio Messeni Petruzzelli & Daniele Rotolo & Vito Albino, 2014. "Determinants of Patent Citations in Biotechnology: An Analysis of Patent Influence Across the Industrial and Organizational Boundaries," SPRU Working Paper Series 2014-05, SPRU - Science Policy Research Unit, University of Sussex Business School.
    10. Higham, Kyle & de Rassenfosse, Gaétan & Jaffe, Adam B., 2021. "Patent Quality: Towards a Systematic Framework for Analysis and Measurement," Research Policy, Elsevier, vol. 50(4).
    11. Adam B. Jaffe & Gaétan de Rassenfosse, 2017. "Patent citation data in social science research: Overview and best practices," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(6), pages 1360-1374, June.
    12. Lee, Honggi, 2023. "The heterogeneous effects of patent scope on licensing propensity," Research Policy, Elsevier, vol. 52(3).
    13. Manuel Acosta & Daniel Coronado & Jennifer Medina, 2024. "Effects of co-patenting across national boundaries on patent quality. An exploration in pharmaceuticals," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 33(2), pages 248-281, February.
    14. Capponi, Giovanna & Martinelli, Arianna & Nuvolari, Alessandro, 2022. "Breakthrough innovations and where to find them," Research Policy, Elsevier, vol. 51(1).
    15. Arts, Sam & Hou, Jianan & Gomez, Juan Carlos, 2021. "Natural language processing to identify the creation and impact of new technologies in patent text: Code, data, and new measures," Research Policy, Elsevier, vol. 50(2).
    16. Anckaert, Paul-Emmanuel, 2025. "When the drugs (don’t) work: The role of science in product commercialization," Research Policy, Elsevier, vol. 54(5).
    17. Xipeng Liu & Xinmiao Li & Jinpeng Liu & Ping Zhang, 2025. "A novel unsupervised learning framework for measuring the technological innovation of patents," Scientometrics, Springer;Akadémiai Kiadó, vol. 130(8), pages 4187-4219, August.
    18. Barbieri, Nicolò & Marzucchi, Alberto & Rizzo, Ugo, 2020. "Knowledge sources and impacts on subsequent inventions: Do green technologies differ from non-green ones?," Research Policy, Elsevier, vol. 49(2).
    19. Ziyan Zhang & Junyan Zhang & Pushi Wang, 2024. "Measurement of disruptive innovation and its validity based on improved disruption index," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(11), pages 6477-6531, November.
    20. Yuan Xu & Xi Chen & Jin Mao & Gang Li, 2025. "Will patents with more interdisciplinary scientific knowledge have higher technological impact? Empirical evidence from USPTO patents," Scientometrics, Springer;Akadémiai Kiadó, vol. 130(4), pages 2037-2068, April.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:infome:v:19:y:2025:i:2:s1751157725000082. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/joi .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.