IDEAS home Printed from https://ideas.repec.org/a/eee/infome/v19y2025i3s1751157725000495.html

Do OpenCitations and Dimensions serve as an alternative to Web of Science for calculating disruption indexes?

Author

Listed:
  • Xu, Shuo
  • Wang, Congcong
  • An, Xin
  • Deng, Yunkang
  • Liu, Jianhua

Abstract

As open access repositories become more prevalent worldwide, scholarly interests in comparative analysis of bibliographic databases are on the rise. Despite this, there is a remarkable scarcity of empirical studies evaluating the efficacy of open and restricted access databases as viable alternatives to traditional closed access models. This study employs the Disruption Index (DI) to analyze three bibliographic databases (WoS, Dimensions, and OpenCitations) across four research fields: Synthetic Biology, Astronomy & Astrophysics as established fields, and Blockchain-based Information System Management and Socio-Economic Impacts of Biological Invasions as emerging ones. After extensive experiments, three main findings are observed as follows. (1) The articles with higher citation counts typically exhibit higher DI values across all fields. (2) The WoS and Dimensions consistently demonstrate closer alignment across established and emerging fields. More missing citations in the OpenCitations lead to significant deviations from the WoS in term of DI values. (3) Compared to the OpenCitations, the Dimensions emerges as a superior alternative to the WoS to some extent.

Suggested Citation

  • Xu, Shuo & Wang, Congcong & An, Xin & Deng, Yunkang & Liu, Jianhua, 2025. "Do OpenCitations and Dimensions serve as an alternative to Web of Science for calculating disruption indexes?," Journal of Informetrics, Elsevier, vol. 19(3).
    • Handle: RePEc:eee:infome:v:19:y:2025:i:3:s1751157725000495
    DOI: 10.1016/j.joi.2025.101685
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1751157725000495
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.joi.2025.101685?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Martin-Martin, Alberto & Orduna-Malea, Enrique & Harzing, Anne-Wil & Delgado López-Cózar, Emilio, 2017. "Can we use Google Scholar to identify highly-cited documents?," Journal of Informetrics, Elsevier, vol. 11(1), pages 152-163.
    2. Shuo Xu & Junwan Liu & Dongsheng Zhai & Xin An & Zheng Wang & Hongshen Pang, 2018. "Overlapping thematic structures extraction with mixed-membership stochastic blockmodel," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(1), pages 61-84, October.
    3. Yuyan Jiang & Xueli Liu, 2023. "A construction and empirical research of the journal disruption index based on open citation data," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(7), pages 3935-3958, July.
    4. Lingfei Wu & Dashun Wang & James A. Evans, 2019. "Large teams develop and small teams disrupt science and technology," Nature, Nature, vol. 566(7744), pages 378-382, February.
    5. Christian Leibel & Lutz Bornmann, 2024. "What do we know about the disruption index in scientometrics? An overview of the literature," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(1), pages 601-639, January.
    6. Xu, Shuo & Hao, Liyuan & Yang, Guancan & Lu, Kun & An, Xin, 2021. "A topic models based framework for detecting and forecasting emerging technologies," Technological Forecasting and Social Change, Elsevier, vol. 162(C).
    7. Libo Sheng & Dongqing Lyu & Xuanmin Ruan & Hongquan Shen & Ying Cheng, 2023. "The association between prior knowledge and the disruption of an article," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4731-4751, August.
    8. Raminta Pranckutė, 2021. "Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World," Publications, MDPI, vol. 9(1), pages 1-59, March.
    9. C. Diagne & B. Leroy & Rodolphe Gozlan & A.-C. Vaissière & C. Assailly & L. Nuninger & David A Roiz & Frédéric Jourdain & I. Jarić & F. Courchamp, 2020. "InvaCost, a public database of the economic costs of biological invasions worldwide," Post-Print hal-03085161, HAL.
    10. Martín-Martín, Alberto & Costas, Rodrigo & van Leeuwen, Thed & Delgado López-Cózar, Emilio, 2018. "Evidence of open access of scientific publications in Google Scholar: A large-scale analysis," Journal of Informetrics, Elsevier, vol. 12(3), pages 819-841.
    11. Michael Park & Erin Leahey & Russell J. Funk, 2023. "Papers and patents are becoming less disruptive over time," Nature, Nature, vol. 613(7942), pages 138-144, January.
    12. Thelwall, Mike, 2018. "Dimensions: A competitor to Scopus and the Web of Science?," Journal of Informetrics, Elsevier, vol. 12(2), pages 430-435.
    13. Alex J. Yang & Hongcun Gong & Yuhao Wang & Chao Zhang & Sanhong Deng, 2024. "Rescaling the disruption index reveals the universality of disruption distributions in science," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(1), pages 561-580, January.
    14. Junwen Zhu & Guangyuan Hu & Weishu Liu, 2019. "DOI errors and possible solutions for Web of Science," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(2), pages 709-718, February.
    15. Stephan Stahlschmidt & Dimity Stephen, 2022. "From indexation policies through citation networks to normalized citation impacts: Web of Science, Scopus, and Dimensions as varying resonance chambers," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(5), pages 2413-2431, May.
    16. Enrique Orduna-Malea & Selenay Aytac & Clara Y. Tran, 2019. "Universities through the eyes of bibliographic databases: a retroactive growth comparison of Google Scholar, Scopus and Web of Science," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 433-450, October.
    17. Ivan Heibi & Silvio Peroni & David Shotton, 2019. "Software review: COCI, the OpenCitations Index of Crossref open DOI-to-DOI citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(2), pages 1213-1228, November.
    18. Liu, Weishu & Hu, Guangyuan & Tang, Li, 2018. "Missing author address information in Web of Science—An explorative study," Journal of Informetrics, Elsevier, vol. 12(3), pages 985-997.
    19. Vivek Kumar Singh & Prashasti Singh & Mousumi Karmakar & Jacqueline Leta & Philipp Mayr, 2021. "The journal coverage of Web of Science, Scopus and Dimensions: A comparative analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 5113-5142, June.
    20. Porter, Alan L. & Chiavetta, Denise & Newman, Nils C., 2020. "Measuring tech emergence: A contest," Technological Forecasting and Social Change, Elsevier, vol. 159(C).
    21. Fiorenzo Franceschini & Domenico Maisano & Luca Mastrogiacomo, 2015. "Errors in DOI indexing by bibliometric databases," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(3), pages 2181-2186, March.
    22. Igor Savchenko & Denis Kosyakov, 2022. "Lost in affiliation: apatride publications in international databases," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3471-3487, June.
    23. Hui Li & Xingmei Zhang, 2024. "Dr. Anonymous is still there: a revisit of legal scholarly publishing," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(1), pages 681-692, January.
    24. Alberto Martín-Martín & Mike Thelwall & Enrique Orduna-Malea & Emilio Delgado López-Cózar, 2021. "Google Scholar, Microsoft Academic, Scopus, Dimensions, Web of Science, and OpenCitations’ COCI: a multidisciplinary comparison of coverage via citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 871-906, January.
    25. Kousha, Kayvan & Thelwall, Mike, 2019. "Can Google Scholar and Mendeley help to assess the scholarly impacts of dissertations?," Journal of Informetrics, Elsevier, vol. 13(2), pages 467-484.
    26. Russell J. Funk & Jason Owen-Smith, 2017. "A Dynamic Network Measure of Technological Change," Management Science, INFORMS, vol. 63(3), pages 791-817, March.
    27. Ruan, Xuanmin & Lyu, Dongqing & Gong, Kaile & Cheng, Ying & Li, Jiang, 2021. "Rethinking the disruption index as a measure of scientific and technological advances," Technological Forecasting and Social Change, Elsevier, vol. 172(C).
    28. Jack H. Culbert & Anne Hobert & Najko Jahn & Nick Haupka & Marion Schmidt & Paul Donner & Philipp Mayr, 2025. "Reference coverage analysis of OpenAlex compared to Web of Science and Scopus," Scientometrics, Springer;Akadémiai Kiadó, vol. 130(4), pages 2475-2492, April.
    29. Shuo Xu & Liyuan Hao & Xin An & Dongsheng Zhai & Hongshen Pang, 2019. "Types of DOI errors of cited references in Web of Science with a cleaning method," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(3), pages 1427-1437, September.
    30. Anne-Wil Harzing, 2019. "Two new kids on the block: How do Crossref and Dimensions compare with Google Scholar, Microsoft Academic, Scopus and the Web of Science?," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(1), pages 341-349, July.
    31. Martín-Martín, Alberto & Orduna-Malea, Enrique & Thelwall, Mike & Delgado López-Cózar, Emilio, 2018. "Google Scholar, Web of Science, and Scopus: A systematic comparison of citations in 252 subject categories," Journal of Informetrics, Elsevier, vol. 12(4), pages 1160-1177.
    32. Alberto Martín-Martín & Mike Thelwall & Enrique Orduna-Malea & Emilio Delgado López-Cózar, 2021. "Correction to: Google Scholar, Microsoft Academic, Scopus, Dimensions, Web of Science, and OpenCitations’ COCI: a multidisciplinary comparison of coverage via citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 907-908, January.
    33. Ennas, Gianfranco & Di Guardo, Maria Chiara, 2015. "Features of top-rated gold open access journals: An analysis of the scopus database," Journal of Informetrics, Elsevier, vol. 9(1), pages 79-89.
    34. Zhentao Liang & Jin Mao & Kun Lu & Gang Li, 2021. "Finding citations for PubMed: a large-scale comparison between five freely available bibliographic data sources," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(12), pages 9519-9542, December.
    35. Jochen Gläser & Wolfgang Glänzel & Andrea Scharnhorst, 2017. "Same data—different results? Towards a comparative approach to the identification of thematic structures in science," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(2), pages 981-998, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Raminta Pranckutė, 2021. "Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World," Publications, MDPI, vol. 9(1), pages 1-59, March.
    2. Yuyan Jiang & Xueli Liu, 2023. "A construction and empirical research of the journal disruption index based on open citation data," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(7), pages 3935-3958, July.
    3. Gabriel Alves Vieira & Jacqueline Leta, 2024. "biblioverlap: an R package for document matching across bibliographic datasets," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(7), pages 4513-4527, July.
    4. Michael Gusenbauer, 2022. "Search where you will find most: Comparing the disciplinary coverage of 56 bibliographic databases," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(5), pages 2683-2745, May.
    5. Christian Leibel & Lutz Bornmann, 2024. "What do we know about the disruption index in scientometrics? An overview of the literature," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(1), pages 601-639, January.
    6. Weishu Liu & Meiting Huang & Haifeng Wang, 2021. "Same journal but different numbers of published records indexed in Scopus and Web of Science Core Collection: causes, consequences, and solutions," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(5), pages 4541-4550, May.
    7. Sam Arts & Nicola Melluso & Reinhilde Veugelers, 2023. "Beyond Citations: Measuring Novel Scientific Ideas and their Impact in Publication Text," Papers 2309.16437, arXiv.org, revised Dec 2024.
    8. Zhang, Ming-Ze & Wang, Tang-Rong & Lyu, Peng-Hui & Chen, Qi-Mei & Li, Ze-Xia & Ngai, Eric W.T., 2024. "Impact of gender composition of academic teams on disruptive output," Journal of Informetrics, Elsevier, vol. 18(2).
    9. Christian Leibel & Lutz Bornmann, 2024. "Specification uncertainty: what the disruption index tells us about the (hidden) multiverse of bibliometric indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(12), pages 7971-7979, December.
    10. Alex J. Yang & Hongcun Gong & Yuhao Wang & Chao Zhang & Sanhong Deng, 2024. "Rescaling the disruption index reveals the universality of disruption distributions in science," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(1), pages 561-580, January.
    11. Toluwase Asubiaro & Sodiq Onaolapo & David Mills, 2024. "Regional disparities in Web of Science and Scopus journal coverage," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(3), pages 1469-1491, March.
    12. Yang, Alex J., 2025. "Text vs. citations: A comparative analysis of breakthrough and disruption metrics in patent innovation," Research Policy, Elsevier, vol. 54(8).
    13. Hui Li, 2025. "Global or regional: the hidden truth behind ShanghaiRanking’s global university ranking by the subject of Law," Scientometrics, Springer;Akadémiai Kiadó, vol. 130(1), pages 515-530, January.
    14. Ziyan Zhang & Junyan Zhang & Pushi Wang, 2024. "Measurement of disruptive innovation and its validity based on improved disruption index," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(11), pages 6477-6531, November.
    15. Steve J. Bickley & Ho Fai Chan & Benno Torgler, 2022. "Artificial intelligence in the field of economics," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(4), pages 2055-2084, April.
    16. Jack H. Culbert & Anne Hobert & Najko Jahn & Nick Haupka & Marion Schmidt & Paul Donner & Philipp Mayr, 2025. "Reference coverage analysis of OpenAlex compared to Web of Science and Scopus," Scientometrics, Springer;Akadémiai Kiadó, vol. 130(4), pages 2475-2492, April.
    17. Hongkan Chen & Lutz Bornmann & Yi Bu, 2025. "Hot streaks and disruptiveness in the career of scientists: is there an association between both phenomena?," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 12(1), pages 1-15, December.
    18. Yuyan Jiang & Xueli Liu, 2023. "A Bibliometric Analysis and Disruptive Innovation Evaluation for the Field of Energy Security," Sustainability, MDPI, vol. 15(2), pages 1-29, January.
    19. Xu, Zhenzhen & Huang, Shengzhi & Zhang, Fan & Lu, Wei & Huang, Yong & Lu, Na, 2025. "Quantifying the disruptiveness of a paper by analyzing how it overshadows its successors," Journal of Informetrics, Elsevier, vol. 19(3).
    20. Alberto Martín-Martín & Mike Thelwall & Enrique Orduna-Malea & Emilio Delgado López-Cózar, 2021. "Google Scholar, Microsoft Academic, Scopus, Dimensions, Web of Science, and OpenCitations’ COCI: a multidisciplinary comparison of coverage via citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 871-906, January.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:infome:v:19:y:2025:i:3:s1751157725000495. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/joi .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.