IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0354129.html

Beyond citation-based metrics: Measuring interdisciplinarity via SBERT semantic embeddings and its heterogeneous effects on citation impact

Author

Listed:
  • Lu Liu
  • Yu Rong

Abstract

Background: Interdisciplinary research is a cornerstone of global science policy, yet decades of research have reached conflicting conclusions about its association with citation impact. This inconsistency stems primarily from traditional indicators, which rely on reference diversity rather than genuine semantic knowledge integration, and from small, discipline-specific samples that limit generalizability. Objective: This study introduces a novel semantic interdisciplinarity measure based on Sentence-BERT (SBERT) embeddings, which directly captures cross-disciplinary knowledge integration at the textual level, and tests its heterogeneous relationship with citation impact across the full spectrum of scientific disciplines. Methods: We analyzed 121,194 articles published 2015–2025 across all 19 root-level disciplines in OpenAlex. We validated the reliability of OpenAlex disciplinary classification using multi-dimensional semantic analyses, and compared our SBERT-based indicator with the Simpson Diversity Index and Rao–Stirling Index. We employed OLS and negative binomial regressions with discipline and year fixed effects (standard errors clustered at the discipline level), journal tier heterogeneity analysis, and domain-specific decomposition analyses. Results: The semantic interdisciplinarity indicator shows moderate convergent validity with conventional citation-based metrics (r = 0.333–0.347, p

Suggested Citation

  • Lu Liu & Yu Rong, 2026. "Beyond citation-based metrics: Measuring interdisciplinarity via SBERT semantic embeddings and its heterogeneous effects on citation impact," PLOS ONE, Public Library of Science, vol. 21(7), pages 1-20, July.
    • Handle: RePEc:plo:pone00:0354129
    DOI: 10.1371/journal.pone.0354129
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0354129
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0354129&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0354129?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jian Wang & Bart Thijs & Wolfgang Glänzel, 2015. "Interdisciplinarity and Impact: Distinct Effects of Variety, Balance, and Disparity," PLOS ONE, Public Library of Science, vol. 10(5), pages 1-18, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tetsuo Wada, 2018. "The choice of examiner patent citations for refusals: evidence from the trilateral offices," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(2), pages 825-843, November.
    2. Hackett, Edward J. & Leahey, Erin & Parker, John N. & Rafols, Ismael & Hampton, Stephanie E. & Corte, Ugo & Chavarro, Diego & Drake, John M. & Penders, Bart & Sheble, Laura & Vermeulen, Niki & Vision,, 2021. "Do synthesis centers synthesize? A semantic analysis of topical diversity in research," Research Policy, Elsevier, vol. 50(1).
    3. Zuo, Zhiya & Zhao, Kang, 2018. "The more multidisciplinary the better? – The prevalence and interdisciplinarity of research collaborations in multidisciplinary institutions," Journal of Informetrics, Elsevier, vol. 12(3), pages 736-756.
    4. Sándor Soós & Zsófia Vida & András Schubert, 2018. "Long-term trends in the multidisciplinarity of some typical natural and social sciences, and its implications on the SSH versus STM distinction," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(3), pages 795-822, March.
    5. Lina Xu & Steven Dellaportas & Zhiqiang Yang & Jin Wang, 2023. "More on the relationship between interdisciplinary accounting research and citation impact," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 63(4), pages 4779-4803, December.
    6. Mingyang Wang & Zhenyu Wang & Guangsheng Chen, 2019. "Which can better predict the future success of articles? Bibliometric indices or alternative metrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(3), pages 1575-1595, June.
    7. Maryam Nakhoda & Peter Whigham & Sander Zwanenburg, 2025. "How relevant is collaboration in interdisciplinary research? Bibliometric evidence from an institution’s publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 130(12), pages 6833-6846, December.
    8. Yu, Xiaoyao & Szymanski, Boleslaw K. & Jia, Tao, 2021. "Become a better you: Correlation between the change of research direction and the change of scientific performance," Journal of Informetrics, Elsevier, vol. 15(3).
    9. Xin Liu & Yi Bu & Ming Li & Jiang Li, 2024. "Monodisciplinary collaboration disrupts science more than multidisciplinary collaboration," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 75(1), pages 59-78, January.
    10. Min, Chao & Sun, Jianjun & Pei, Lei & Ding, Ying, 2016. "Measuring delayed recognition for papers: Uneven weighted summation and total citations," Journal of Informetrics, Elsevier, vol. 10(4), pages 1153-1165.
    11. Shang, Yuanyuan & Sivertsen, Gunnar & Cao, Zhe & Zhang, Lin, 2021. "Gender differences in research focused on the Sustainable Development Goal of Gender Equality," SocArXiv 3fapz, Center for Open Science.
    12. Feng Shi & James Evans, 2023. "Surprising combinations of research contents and contexts are related to impact and emerge with scientific outsiders from distant disciplines," Nature Communications, Nature, vol. 14(1), pages 1-13, December.
    13. Alfonso Ávila-Robinson & Cristian Mejia & Shintaro Sengoku, 2021. "Are bibliometric measures consistent with scientists’ perceptions? The case of interdisciplinarity in research," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 7477-7502, September.
    14. Bart Thijs, 2020. "Using neural-network based paragraph embeddings for the calculation of within and between document similarities," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 835-849, November.
    15. Tanmoy Chakraborty, 2018. "Role of interdisciplinarity in computer sciences: quantification, impact and life trajectory," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(3), pages 1011-1029, March.
    16. Fei Shu & Jesse David Dinneen & Shiji Chen, 2022. "Measuring the disparity among scientific disciplines using Library of Congress Subject Headings," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3613-3628, June.
    17. Liu, Jialin & Chen, Hongkan & Liu, Zhibo & Bu, Yi & Gu, Weiye, 2022. "Non-linearity between referencing behavior and citation impact: A large-scale, discipline-level analysis," Journal of Informetrics, Elsevier, vol. 16(3).
    18. Xiaojing Cai & Xiaozan Lyu & Ping Zhou, 2023. "The relationship between interdisciplinarity and citation impact—a novel perspective on citation accumulation," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 10(1), pages 1-12, December.
    19. Hongyu Zhou & Raf Guns & Tim C. E. Engels, 2022. "Are social sciences becoming more interdisciplinary? Evidence from publications 1960–2014," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 73(9), pages 1201-1221, September.
    20. Zafeiris, Anna & Koman, Zsombor & Mones, Enys & Vicsek, Tamás, 2017. "Phenomenological theory of collective decision-making," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 479(C), pages 287-298.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0354129. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.