IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v129y2024i11d10.1007_s11192-024-05134-9.html
   My bibliography  Save this article

Measurement of disruptive innovation and its validity based on improved disruption index

Author

Listed:
  • Ziyan Zhang

    (Tianjin University
    Tianjin University)

  • Junyan Zhang

    (Tianjin University
    Tianjin University)

  • Pushi Wang

    (Tianjin University)

Abstract

Measuring disruptive innovation is a critical and still-developing topic. Although the disruption (D) Index has been widely utilized, it ignores the structural differences between i- and j-type nodes and suffers from inconsistencies, biases related to reference lists, and little comparability across different clusters. To address these possible biases, we propose the improved disruptive Index (ID Index), using a dataset of 114,202 patents from Chinese listed firms to test its validity. The results show that the ID Index (i) provides a more precise measurement of disruptiveness, resolves inconsistencies, reduces biases related to reference lists, and enhances comparability across clusters; (ii) demonstrates better convergent validity, correlating more closely with expert evaluations and more effectively identifying determinants such as knowledge search, recombination, and coordination; (iii) shows better validity in predicting stock market reactions, renewal durations, firms’ short- and long-term performance. Finally, we separate the ID index to independently measure the extent of disrupting and consolidating existing knowledge, and the convergent and predictive validity are demonstrated.

Suggested Citation

  • Ziyan Zhang & Junyan Zhang & Pushi Wang, 2024. "Measurement of disruptive innovation and its validity based on improved disruption index," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(11), pages 6477-6531, November.
  • Handle: RePEc:spr:scient:v:129:y:2024:i:11:d:10.1007_s11192-024-05134-9
    DOI: 10.1007/s11192-024-05134-9
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-024-05134-9
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11192-024-05134-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Higham, Kyle & de Rassenfosse, Gaétan & Jaffe, Adam B., 2021. "Patent Quality: Towards a Systematic Framework for Analysis and Measurement," Research Policy, Elsevier, vol. 50(4).
    2. Faurel, Lucile & Li, Qin & Shanthikumar, Devin & Teoh, Siew H., 2024. "Bringing Innovation to Fruition: Insights From New Trademarks," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 59(2), pages 474-520, March.
    3. Yong-Gil Lee, 2009. "What affects a patent’s value? An analysis of variables that affect technological, direct economic, and indirect economic value: An exploratory conceptual approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 79(3), pages 623-633, June.
    4. Grimaldi, Michele & Cricelli, Livio & Di Giovanni, Martina & Rogo, Francesco, 2015. "The patent portfolio value analysis: A new framework to leverage patent information for strategic technology planning," Technological Forecasting and Social Change, Elsevier, vol. 94(C), pages 286-302.
    5. Michael Park & Erin Leahey & Russell J. Funk, 2023. "Papers and patents are becoming less disruptive over time," Nature, Nature, vol. 613(7942), pages 138-144, January.
    6. Adam B. Jaffe & Manuel Trajtenberg & Rebecca Henderson, 1993. "Geographic Localization of Knowledge Spillovers as Evidenced by Patent Citations," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 108(3), pages 577-598.
    7. Erin Leahey & Jina Lee & Russell J. Funk, 2023. "What Types of Novelty Are Most Disruptive?," American Sociological Review, , vol. 88(3), pages 562-597, June.
    8. Yang, Alex Jie & Wu, Linwei & Zhang, Qi & Wang, Hao & Deng, Sanhong, 2023. "The k-step h-index in citation networks at the paper, author, and institution levels," Journal of Informetrics, Elsevier, vol. 17(4).
    9. Nguyen, Justin Hung & Pham, Peter & Qiu, Buhui, 2023. "Proprietary Knowledge Protection and Product Market Performance," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 58(8), pages 3521-3546, December.
    10. Leonid Kogan & Dimitris Papanikolaou & Amit Seru & Noah Stoffman, 2017. "Technological Innovation, Resource Allocation, and Growth," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(2), pages 665-712.
    11. Gamal Atallah & Gabriel Rodríguez, 2006. "Indirect patent citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 67(3), pages 437-465, June.
    12. Hagedoorn, John & Cloodt, Myriam, 2003. "Measuring innovative performance: is there an advantage in using multiple indicators?," Research Policy, Elsevier, vol. 32(8), pages 1365-1379, September.
    13. Liu, Yunmei & Yang, Liu & Chen, Min, 2021. "A new citation concept: Triangular citation in the literature," Journal of Informetrics, Elsevier, vol. 15(2).
    14. Sarah Kaplan & Keyvan Vakili, 2015. "The double-edged sword of recombination in breakthrough innovation," Strategic Management Journal, Wiley Blackwell, vol. 36(10), pages 1435-1457, October.
    15. Aghion, Philippe & Howitt, Peter, 1992. "A Model of Growth through Creative Destruction," Econometrica, Econometric Society, vol. 60(2), pages 323-351, March.
    16. Mark A. Lemley & Bhaven Sampat, 2012. "Examiner Characteristics and Patent Office Outcomes," The Review of Economics and Statistics, MIT Press, vol. 94(3), pages 817-827, August.
    17. Sunder, Jayanthi & Sunder, Shyam V. & Zhang, Jingjing, 2017. "Pilot CEOs and corporate innovation," Journal of Financial Economics, Elsevier, vol. 123(1), pages 209-224.
    18. Keyvan Vakili & Sarah Kaplan, 2021. "Organizing for innovation: A contingency view on innovative team configuration," Strategic Management Journal, Wiley Blackwell, vol. 42(6), pages 1159-1183, June.
    19. Russell J. Funk & Jason Owen-Smith, 2017. "A Dynamic Network Measure of Technological Change," Management Science, INFORMS, vol. 63(3), pages 791-817, March.
    20. de Rassenfosse, Gaétan, 2013. "Do firms face a trade-off between the quantity and the quality of their inventions?," Research Policy, Elsevier, vol. 42(5), pages 1072-1079.
    21. Alcácer, Juan & Gittelman, Michelle & Sampat, Bhaven, 2009. "Applicant and examiner citations in U.S. patents: An overview and analysis," Research Policy, Elsevier, vol. 38(2), pages 415-427, March.
    22. Nan Deng & An Zeng, 2023. "Enhancing the robustness of the disruption metric against noise," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2419-2428, April.
    23. Persson, Olle, 2010. "Identifying research themes with weighted direct citation links," Journal of Informetrics, Elsevier, vol. 4(3), pages 415-422.
    24. Gaétan de Rassenfosse & Adam B. Jaffe, 2018. "Are patent fees effective at weeding out low‐quality patents?," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 27(1), pages 134-148, March.
    25. Manuel Trajtenberg & Rebecca Henderson & Adam Jaffe, 1997. "University Versus Corporate Patents: A Window On The Basicness Of Invention," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 5(1), pages 19-50.
    26. von Wartburg, Iwan & Teichert, Thorsten & Rost, Katja, 2005. "Inventive progress measured by multi-stage patent citation analysis," Research Policy, Elsevier, vol. 34(10), pages 1591-1607, December.
    27. Dietmar Harhoff & Francis Narin & F. M. Scherer & Katrin Vopel, 1999. "Citation Frequency And The Value Of Patented Inventions," The Review of Economics and Statistics, MIT Press, vol. 81(3), pages 511-515, August.
    28. Arthur, W. Brian, 2007. "The structure of invention," Research Policy, Elsevier, vol. 36(2), pages 274-287, March.
    29. Jiexun Li & Jiyao Chen, 2022. "Measuring destabilization and consolidation in scientific knowledge evolution," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(10), pages 5819-5839, October.
    30. Tahamtan, Iman & Bornmann, Lutz, 2018. "Creativity in science and the link to cited references: Is the creative potential of papers reflected in their cited references?," Journal of Informetrics, Elsevier, vol. 12(3), pages 906-930.
    31. Lutz Bornmann & Alexander Tekles, 2019. "Disruptive papers published in Scientometrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(1), pages 331-336, July.
    32. Madeline K. Kneeland & Melissa A. Schilling & Barak S. Aharonson, 2020. "Exploring Uncharted Territory: Knowledge Search Processes in the Origination of Outlier Innovation," Organization Science, INFORMS, vol. 31(3), pages 535-557, May.
    33. Scott Shane, 2001. "Technological Opportunities and New Firm Creation," Management Science, INFORMS, vol. 47(2), pages 205-220, February.
    34. Li Tang & Jennifer Kuzma & Xi Zhang & Xinyu Song & Yin Li & Hongxu Liu & Guangyuan Hu, 2023. "Synthetic biology and governance research in China: a 40-year evolution," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(9), pages 5293-5310, September.
    35. Natalia Ortiz-de-Mandojana & Pratima Bansal, 2016. "The long-term benefits of organizational resilience through sustainable business practices," Strategic Management Journal, Wiley Blackwell, vol. 37(8), pages 1615-1631, August.
    36. Josh Lerner & Amit Seru, 2022. "The Use and Misuse of Patent Data: Issues for Finance and Beyond," The Review of Financial Studies, Society for Financial Studies, vol. 35(6), pages 2667-2704.
    37. Lee Fleming, 2001. "Recombinant Uncertainty in Technological Search," Management Science, INFORMS, vol. 47(1), pages 117-132, January.
    38. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    39. Lingfei Wu & Dashun Wang & James A. Evans, 2019. "Large teams develop and small teams disrupt science and technology," Nature, Nature, vol. 566(7744), pages 378-382, February.
    40. Cao, Hongjian & Zhao, Yu & Yuan, Li & Li, Ke, 2024. "Does legislation promote technological innovation in renewable energy enterprises? Evidence from China," Energy Policy, Elsevier, vol. 188(C).
    41. Cassidy R. Sugimoto, 2021. "Scientific success by numbers," Nature, Nature, vol. 593(7857), pages 30-31, May.
    42. Shiyun Wang & Yaxue Ma & Jin Mao & Yun Bai & Zhentao Liang & Gang Li, 2023. "Quantifying scientific breakthroughs by a novel disruption indicator based on knowledge entities," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 74(2), pages 150-167, February.
    43. Ikujiro Nonaka, 1994. "A Dynamic Theory of Organizational Knowledge Creation," Organization Science, INFORMS, vol. 5(1), pages 14-37, February.
    44. Boris Forthmann & Mark A. Runco, 2020. "An Empirical Test of the Inter-Relationships between Various Bibliometric Creative Scholarship Indicators," Publications, MDPI, vol. 8(2), pages 1-16, June.
    45. Erjia Yan & Ying Ding, 2012. "Scholarly network similarities: How bibliographic coupling networks, citation networks, cocitation networks, topical networks, coauthorship networks, and coword networks relate to each other," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(7), pages 1313-1326, July.
    46. Erjia Yan & Ying Ding, 2012. "Scholarly network similarities: How bibliographic coupling networks, citation networks, cocitation networks, topical networks, coauthorship networks, and coword networks relate to each other," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 63(7), pages 1313-1326, July.
    47. Wagner, Caroline S. & Whetsell, Travis A. & Mukherjee, Satyam, 2019. "International research collaboration: Novelty, conventionality, and atypicality in knowledge recombination," Research Policy, Elsevier, vol. 48(5), pages 1260-1270.
    48. Hur, Wonchang & Oh, Junbyoung, 2021. "A man is known by the company he keeps?: A structural relationship between backward citation and forward citation of patents," Research Policy, Elsevier, vol. 50(1).
    49. Sergio Correia & Paulo Guimarães & Tom Zylkin, 2020. "Fast Poisson estimation with high-dimensional fixed effects," Stata Journal, StataCorp LP, vol. 20(1), pages 95-115, March.
    50. Jungpyo Lee & So Young Sohn, 2017. "What makes the first forward citation of a patent occur earlier?," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 279-298, October.
    51. An Zeng & Ying Fan & Zengru Di & Yougui Wang & Shlomo Havlin, 2021. "Fresh teams are associated with original and multidisciplinary research," Nature Human Behaviour, Nature, vol. 5(10), pages 1314-1322, October.
    52. Joshua Lerner, 1994. "The Importance of Patent Scope: An Empirical Analysis," RAND Journal of Economics, The RAND Corporation, vol. 25(2), pages 319-333, Summer.
    53. Yuyan Jiang & Xueli Liu, 2023. "A construction and empirical research of the journal disruption index based on open citation data," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(7), pages 3935-3958, July.
    54. Rosenberg, Nathan & Nelson, Richard R., 1994. "American universities and technical advance in industry," Research Policy, Elsevier, vol. 23(3), pages 323-348, May.
    55. Narayan, Paresh Kumar & Narayan, Seema & Tran, Vuong Thao, 2023. "Patent-related intellectual property and corporate investment," Finance Research Letters, Elsevier, vol. 52(C).
    56. Schoenmakers, Wilfred & Duysters, Geert, 2010. "The technological origins of radical inventions," Research Policy, Elsevier, vol. 39(8), pages 1051-1059, October.
    57. Huang, Ying & Chen, Lixin & Zhang, Lin, 2020. "Patent citation inflation: The phenomenon, its measurement, and relative indicators to temper its effects," Journal of Informetrics, Elsevier, vol. 14(2).
    58. Costantini, Valeria & Crespi, Francesco & Palma, Alessandro, 2017. "Characterizing the policy mix and its impact on eco-innovation: A patent analysis of energy-efficient technologies," Research Policy, Elsevier, vol. 46(4), pages 799-819.
    59. Chris Freeman & Luc Soete, 1997. "The Economics of Industrial Innovation, 3rd Edition," MIT Press Books, The MIT Press, edition 3, volume 1, number 0262061953, December.
    60. Pilkington, Alan & Dyerson, Romano & Tissier, Omid, 2002. "The electric vehicle:: Patent data as indicators of technological development," World Patent Information, Elsevier, vol. 24(1), pages 5-12, March.
    61. Jay Bhattacharya & Mikko Packalen, 2020. "Stagnation and Scientific Incentives," NBER Working Papers 26752, National Bureau of Economic Research, Inc.
    62. Nicholas Bloom & John Van Reenen, 2002. "Patents, Real Options and Firm Performance," Economic Journal, Royal Economic Society, vol. 112(478), pages 97-116, March.
    63. Daron Acemoglu & Ufuk Akcigit & Murat Alp Celik, 2022. "Radical and Incremental Innovation: The Roles of Firms, Managers, and Innovators," American Economic Journal: Macroeconomics, American Economic Association, vol. 14(3), pages 199-249, July.
    64. Dag W Aksnes, 2003. "Characteristics of highly cited papers," Research Evaluation, Oxford University Press, vol. 12(3), pages 159-170, December.
    65. Felix Poege & Dietmar Harhoff & Fabian Gaessler & Stefano Baruffaldi, 2019. "Science Quality and the Value of Inventions," Papers 1903.05020, arXiv.org, revised Apr 2019.
    66. Mariagrazia Squicciarini & Hélène Dernis & Chiara Criscuolo, 2013. "Measuring Patent Quality: Indicators of Technological and Economic Value," OECD Science, Technology and Industry Working Papers 2013/3, OECD Publishing.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hain, Daniel S. & Jurowetzki, Roman & Buchmann, Tobias & Wolf, Patrick, 2022. "A text-embedding-based approach to measuring patent-to-patent technological similarity," Technological Forecasting and Social Change, Elsevier, vol. 177(C).
    2. Wang, Fang, 2024. "Does the recombination of distant scientific knowledge generate valuable inventions? An analysis of pharmaceutical patents," Technovation, Elsevier, vol. 130(C).
    3. Dongqing Lyu & Kaile Gong & Xuanmin Ruan & Ying Cheng & Jiang Li, 2021. "Does research collaboration influence the “disruption” of articles? Evidence from neurosciences," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 287-303, January.
    4. Ugo Rizzo & Nicolò Barbieri & Laura Ramaciotti & Demian Iannantuono, 2020. "The division of labour between academia and industry for the generation of radical inventions," The Journal of Technology Transfer, Springer, vol. 45(2), pages 393-413, April.
    5. Libo Sheng & Dongqing Lyu & Xuanmin Ruan & Hongquan Shen & Ying Cheng, 2023. "The association between prior knowledge and the disruption of an article," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4731-4751, August.
    6. Manuel Acosta & Daniel Coronado & Esther Ferrándiz & Manuel Jiménez, 2022. "Effects of knowledge spillovers between competitors on patent quality: what patent citations reveal about a global duopoly," The Journal of Technology Transfer, Springer, vol. 47(5), pages 1451-1487, October.
    7. Barbieri, Nicolò & Marzucchi, Alberto & Rizzo, Ugo, 2020. "Knowledge sources and impacts on subsequent inventions: Do green technologies differ from non-green ones?," Research Policy, Elsevier, vol. 49(2).
    8. Michele Cincera & Ela Ince, 2019. "Types of Innovation and Firm performance," Working Papers TIMES² 2019-032, ULB -- Universite Libre de Bruxelles.
    9. Sun, Bixuan & Kolesnikov, Sergey & Goldstein, Anna & Chan, Gabriel, 2021. "A dynamic approach for identifying technological breakthroughs with an application in solar photovoltaics," Technological Forecasting and Social Change, Elsevier, vol. 165(C).
    10. Russell J. Funk & Jason Owen-Smith, 2017. "A Dynamic Network Measure of Technological Change," Management Science, INFORMS, vol. 63(3), pages 791-817, March.
    11. Hur, Wonchang & Oh, Junbyoung, 2021. "A man is known by the company he keeps?: A structural relationship between backward citation and forward citation of patents," Research Policy, Elsevier, vol. 50(1).
    12. Zhao, Shengchao & Zeng, Deming & Li, Jian & Feng, Ke & Wang, Yao, 2023. "Quantity or quality: The roles of technology and science convergence on firm innovation performance," Technovation, Elsevier, vol. 126(C).
    13. Keye Wu & Ziyue Xie & Jia Tina Du, 2024. "Does science disrupt technology? Examining science intensity, novelty, and recency through patent-paper citations in the pharmaceutical field," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(9), pages 5469-5491, September.
    14. Fernández, Ana María & Ferrándiz, Esther & Medina, Jennifer, 2022. "The diffusion of energy technologies. Evidence from renewable, fossil, and nuclear energy patents," Technological Forecasting and Social Change, Elsevier, vol. 178(C).
    15. Capponi, Giovanna & Martinelli, Arianna & Nuvolari, Alessandro, 2022. "Breakthrough innovations and where to find them," Research Policy, Elsevier, vol. 51(1).
    16. Wang, P.E.N.G.F.E.I., 2024. "Pricing innovation: The anchoring effect in patent valuation," Technovation, Elsevier, vol. 136(C).
    17. Higham, Kyle & Contisciani, Martina & De Bacco, Caterina, 2022. "Multilayer patent citation networks: A comprehensive analytical framework for studying explicit technological relationships," Technological Forecasting and Social Change, Elsevier, vol. 179(C).
    18. Arts, Sam & Hou, Jianan & Gomez, Juan Carlos, 2021. "Natural language processing to identify the creation and impact of new technologies in patent text: Code, data, and new measures," Research Policy, Elsevier, vol. 50(2).
    19. Chandra, Praveena & Dong, Andy, 2018. "The relation between knowledge accumulation and technical value in interdisciplinary technologies," Technological Forecasting and Social Change, Elsevier, vol. 128(C), pages 235-244.
    20. Guan-Can Yang & Gang Li & Chun-Ya Li & Yun-Hua Zhao & Jing Zhang & Tong Liu & Dar-Zen Chen & Mu-Hsuan Huang, 2015. "Using the comprehensive patent citation network (CPC) to evaluate patent value," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(3), pages 1319-1346, December.

    More about this item

    Keywords

    Disruptive innovation; Disruption index; Improved disruptive Index; Patent analysis; Validity test;
    All these keywords.

    JEL classification:

    • C10 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - General
    • O32 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Management of Technological Innovation and R&D
    • O33 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Technological Change: Choices and Consequences; Diffusion Processes
    • O34 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Intellectual Property and Intellectual Capital

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:129:y:2024:i:11:d:10.1007_s11192-024-05134-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.