IDEAS home Printed from https://ideas.repec.org/a/eee/infome/v18y2024i1s1751157723000937.html
   My bibliography  Save this article

Delayed citation impact of interdisciplinary research

Author

Listed:
  • Zhang, Yang
  • Wang, Yang
  • Du, Haifeng
  • Havlin, Shlomo

Abstract

Interdisciplinary research increasingly fuels innovation, and is a key input for future breakthroughs. Yet the timing of when interdisciplinary research achieves its highest citation impact remains unclear. Here, we use the time of a paper to reach its citation peak to quantify citation dynamics, and examine its relationship with paper interdisciplinarity. Using large scale publication datasets spanning over 37 years, our results suggest that interdisciplinary papers show significant delayed citation impact both at the individual paper level and collectively, as it takes longer for highly interdisciplinary papers to reach their citation peak as well as their half citations. Such relationships are nearly universal across various scientific disciplines and time periods. Furthermore, we study the underlying forces behind this delayed impact, finding that the effect goes beyond the Matthew effect (i.e., the rich-get-richer effect). Although team size and content conventionality are partly related to the citation delay, they cannot fully explain this effect. Overall, our results suggest that governments, research administrators, and funding agencies should be aware of this general feature of interdisciplinary science, which may have broad policy implications.

Suggested Citation

  • Zhang, Yang & Wang, Yang & Du, Haifeng & Havlin, Shlomo, 2024. "Delayed citation impact of interdisciplinary research," Journal of Informetrics, Elsevier, vol. 18(1).
    • Handle: RePEc:eee:infome:v:18:y:2024:i:1:s1751157723000937
    DOI: 10.1016/j.joi.2023.101468
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1751157723000937
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.joi.2023.101468?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Mike Thelwall, 2018. "Does Microsoft Academic find early citations?," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(1), pages 325-334, January.
    2. An Zeng & Zhesi Shen & Jianlin Zhou & Ying Fan & Zengru Di & Yougui Wang & H. Eugene Stanley & Shlomo Havlin, 2019. "Increasing trend of scientists to switch between topics," Nature Communications, Nature, vol. 10(1), pages 1-11, December.
    3. Joshua Ettinger & Friederike E. L. Otto & E. Lisa F. Schipper, 2021. "Storytelling can be a powerful tool for science," Nature, Nature, vol. 589(7842), pages 352-352, January.
    4. Wang, Jian & Veugelers, Reinhilde & Stephan, Paula, 2017. "Bias against novelty in science: A cautionary tale for users of bibliometric indicators," Research Policy, Elsevier, vol. 46(8), pages 1416-1436.
    5. Yifang Ma & Satyam Mukherjee & Brian Uzzi, 2020. "Mentorship and protégé success in STEM fields," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 117(25), pages 14077-14083, June.
    6. Weihua Li & Sam Zhang & Zhiming Zheng & Skyler J. Cranmer & Aaron Clauset, 2022. "Untangling the network effects of productivity and prominence among scientists," Nature Communications, Nature, vol. 13(1), pages 1-11, December.
    7. Richard Van Noorden, 2015. "Interdisciplinary research by the numbers," Nature, Nature, vol. 525(7569), pages 306-307, September.
    8. Rebekah R. Brown & Ana Deletic & Tony H. F. Wong, 2015. "Interdisciplinarity: How to catalyse collaboration," Nature, Nature, vol. 525(7569), pages 315-317, September.
    9. Jonathan M. Levitt & Mike Thelwall, 2009. "The most highly cited Library and Information Science articles: Interdisciplinarity, first authors and citation patterns," Scientometrics, Springer;Akadémiai Kiadó, vol. 78(1), pages 45-67, January.
    10. Yian Yin & Yang Wang & James A. Evans & Dashun Wang, 2019. "Quantifying the dynamics of failure across science, startups and security," Nature, Nature, vol. 575(7781), pages 190-194, November.
    11. Alexander J. Gates & Qing Ke & Onur Varol & Albert-László Barabási, 2019. "Nature’s reach: narrow work has broad impact," Nature, Nature, vol. 575(7781), pages 32-34, November.
    12. Sven E. Hug & Martin P. Brändle, 2017. "The coverage of Microsoft Academic: analyzing the publication output of a university," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(3), pages 1551-1571, December.
    13. Yang Yang & Tanya Y. Tian & Teresa K. Woodruff & Benjamin F. Jones & Brian Uzzi, 2022. "Gender-diverse teams produce more novel and higher-impact scientific ideas," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 119(36), pages 2200841119-, September.
    14. Andy Stirling, 2007. "A General Framework for Analysing Diversity in Science, Technology and Society," SPRU Working Paper Series 156, SPRU - Science Policy Research Unit, University of Sussex Business School.
    15. Ed J. Rinia & Thed. N. Van Leeuwen & Eppo E.W. Bruins & Hendrik G. Van Vuren & Anthony F.J. Van Raan, 2001. "Citation delay in interdisciplinary knowledge exchange," Scientometrics, Springer;Akadémiai Kiadó, vol. 51(1), pages 293-309, April.
    16. Lindell Bromham & Russell Dinnage & Xia Hua, 2016. "Interdisciplinary research has consistently lower funding success," Nature, Nature, vol. 534(7609), pages 684-687, June.
    17. Dag W. Aksnes & Liv Langfeldt & Paul Wouters, 2019. "Citations, Citation Indicators, and Research Quality: An Overview of Basic Concepts and Theories," SAGE Open, , vol. 9(1), pages 21582440198, February.
    18. Thomas W. Steele & Jeffrey C. Stier, 2000. "The impact of interdisciplinary research in the environmental sciences: a forestry case study," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 51(5), pages 476-484.
    19. Lin Zhang & Ronald Rousseau & Wolfgang Glänzel, 2016. "Diversity of references as an indicator of the interdisciplinarity of journals: Taking similarity between subject fields into account," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(5), pages 1257-1265, May.
    20. An Zeng & Ying Fan & Zengru Di & Yougui Wang & Shlomo Havlin, 2021. "Fresh teams are associated with original and multidisciplinary research," Nature Human Behaviour, Nature, vol. 5(10), pages 1314-1322, October.
    21. Johan S. G. Chu & James A. Evans, 2021. "Slowed canonical progress in large fields of science," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 118(41), pages 2021636118-, October.
    22. Bedoor K. AlShebli & Talal Rahwan & Wei Lee Woon, 2018. "The preeminence of ethnic diversity in scientific collaboration," Nature Communications, Nature, vol. 9(1), pages 1-10, December.
    23. Shiji Chen & Yanhui Song & Fei Shu & Vincent Larivière, 2022. "Interdisciplinarity and impact: the effects of the citation time window," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(5), pages 2621-2642, May.
    24. Yang Wang & Benjamin F. Jones & Dashun Wang, 2019. "Early-career setback and future career impact," Nature Communications, Nature, vol. 10(1), pages 1-10, December.
    25. Jian Wang & Bart Thijs & Wolfgang Glänzel, 2015. "Interdisciplinarity and Impact: Distinct Effects of Variety, Balance, and Disparity," PLOS ONE, Public Library of Science, vol. 10(5), pages 1-18, May.
    26. Yi Bu & Ying Ding & Xingkun Liang & Dakota S. Murray, 2018. "Understanding persistent scientific collaboration," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 69(3), pages 438-448, March.
    27. Chen, Shiji & Arsenault, Clément & Larivière, Vincent, 2015. "Are top-cited papers more interdisciplinary?," Journal of Informetrics, Elsevier, vol. 9(4), pages 1034-1046.
    28. Lin Zhang & Beibei Sun & Lidan Jiang & Ying Huang, 2021. "On the relationship between interdisciplinarity and impact: Distinct effects on academic and broader impact [A Comparison of Two Approaches for Measuring Interdisciplinary Research Output: The Disc," Research Evaluation, Oxford University Press, vol. 30(3), pages 256-268.
    29. Zhu, Wanying & Jin, Ching & Ma, Yifang & Xu, Cong, 2023. "Earlier recognition of scientific excellence enhances future achievements and promotes persistence," Journal of Informetrics, Elsevier, vol. 17(2).
    30. Yang Yang & Tanya Y. Tian & Teresa K. Woodruff & Benjamin F. Jones & Brian Uzzi, 2022. "Gender-diverse teams produce more novel and higher-impact scientific ideas," Decision Analysis, INFORMS, vol. 119(36), pages 2200841119-, September.
    31. Fengli Xu & Lingfei Wu & James Evans, 2022. "Flat teams drive scientific innovation," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 119(23), pages 2200927119-, June.
    32. Shouhuai Xu & Moti Yung & Jingguo Wang, 2021. "Seeking Foundations for the Science of Cyber Security," Information Systems Frontiers, Springer, vol. 23(2), pages 263-267, April.
    33. Lu Liu & Yang Wang & Roberta Sinatra & C. Lee Giles & Chaoming Song & Dashun Wang, 2018. "Hot streaks in artistic, cultural, and scientific careers," Nature, Nature, vol. 559(7714), pages 396-399, July.
    34. Rinia, E. J. & van Leeuwen, Th. N. & van Vuren, H. G. & van Raan, A. F. J., 2001. "Influence of interdisciplinarity on peer-review and bibliometric evaluations in physics research," Research Policy, Elsevier, vol. 30(3), pages 357-361, March.
    35. Leydesdorff, Loet & Wagner, Caroline S. & Bornmann, Lutz, 2019. "Interdisciplinarity as diversity in citation patterns among journals: Rao-Stirling diversity, relative variety, and the Gini coefficient," Journal of Informetrics, Elsevier, vol. 13(1), pages 255-269.
    36. Jian Wang, 2013. "Citation time window choice for research impact evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(3), pages 851-872, March.
    37. Lisa Mandle & Analisa Shields-Estrada & Rebecca Chaplin-Kramer & Matthew G. E. Mitchell & Leah L. Bremer & Jesse D. Gourevitch & Peter Hawthorne & Justin A. Johnson & Brian E. Robinson & Jeffrey R. Sm, 2021. "Increasing decision relevance of ecosystem service science," Nature Sustainability, Nature, vol. 4(2), pages 161-169, February.
    38. Alberto Martín-Martín & Mike Thelwall & Enrique Orduna-Malea & Emilio Delgado López-Cózar, 2021. "Google Scholar, Microsoft Academic, Scopus, Dimensions, Web of Science, and OpenCitations’ COCI: a multidisciplinary comparison of coverage via citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 871-906, January.
    39. Jean J. Wang & Sarah X. Shao & Fred Y. Ye, 2021. "Identifying 'seed' papers in sciences," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 6001-6011, July.
    40. Jonathan Adams, 2013. "The fourth age of research," Nature, Nature, vol. 497(7451), pages 557-560, May.
    41. Yi Bu & Ying Ding & Jian Xu & Xingkun Liang & Gege Gao & Yiming Zhao, 2018. "Understanding success through the diversity of collaborators and the milestone of career," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 69(1), pages 87-97, January.
    42. Jonathan M. Levitt & Mike Thelwall, 2008. "Is multidisciplinary research more highly cited? A macrolevel study," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 59(12), pages 1973-1984, October.
    43. Alberto Martín-Martín & Mike Thelwall & Enrique Orduna-Malea & Emilio Delgado López-Cózar, 2021. "Correction to: Google Scholar, Microsoft Academic, Scopus, Dimensions, Web of Science, and OpenCitations’ COCI: a multidisciplinary comparison of coverage via citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 907-908, January.
    44. Eric D. Green & James D. Watson & Francis S. Collins, 2015. "Human Genome Project: Twenty-five years of big biology," Nature, Nature, vol. 526(7571), pages 29-31, October.
    45. Heidi Ledford, 2015. "How to solve the world's biggest problems," Nature, Nature, vol. 525(7569), pages 308-311, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chen, Shiji & Qiu, Junping & Arsenault, Clément & Larivière, Vincent, 2021. "Exploring the interdisciplinarity patterns of highly cited papers," Journal of Informetrics, Elsevier, vol. 15(1).
    2. Yu, Xiaoyao & Szymanski, Boleslaw K. & Jia, Tao, 2021. "Become a better you: Correlation between the change of research direction and the change of scientific performance," Journal of Informetrics, Elsevier, vol. 15(3).
    3. Shiji Chen & Yanhui Song & Fei Shu & Vincent Larivière, 2022. "Interdisciplinarity and impact: the effects of the citation time window," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(5), pages 2621-2642, May.
    4. Yue Wang & Ning Li & Bin Zhang & Qian Huang & Jian Wu & Yang Wang, 2023. "The effect of structural holes on producing novel and disruptive research in physics," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(3), pages 1801-1823, March.
    5. Fei Shu & Jesse David Dinneen & Shiji Chen, 2022. "Measuring the disparity among scientific disciplines using Library of Congress Subject Headings," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3613-3628, June.
    6. Xiaojing Cai & Xiaozan Lyu & Ping Zhou, 2023. "The relationship between interdisciplinarity and citation impact—a novel perspective on citation accumulation," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-12, December.
    7. Jingjing Ren & Fang Wang & Minglu Li, 2023. "Dynamics and characteristics of interdisciplinary research in scientific breakthroughs: case studies of Nobel-winning research in the past 120 years," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4383-4419, August.
    8. Lu Liu & Benjamin F. Jones & Brian Uzzi & Dashun Wang, 2023. "Data, measurement and empirical methods in the science of science," Nature Human Behaviour, Nature, vol. 7(7), pages 1046-1058, July.
    9. Qing Ke, 2023. "Interdisciplinary research and technological impact: evidence from biomedicine," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2035-2077, April.
    10. Lina Xu & Steven Dellaportas & Zhiqiang Yang & Jin Wang, 2023. "More on the relationship between interdisciplinary accounting research and citation impact," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 63(4), pages 4779-4803, December.
    11. Andrea Bonaccorsi & Nicola Melluso & Francesco Alessandro Massucci, 2022. "Exploring the antecedents of interdisciplinarity at the European Research Council: a topic modeling approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 6961-6991, December.
    12. Liyin Zhang & Yuchen Qian & Chao Ma & Jiang Li, 2023. "Continued collaboration shortens the transition period of scientists who move to another institution," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(3), pages 1765-1784, March.
    13. Yang, Alex J., 2024. "Unveiling the impact and dual innovation of funded research," Journal of Informetrics, Elsevier, vol. 18(1).
    14. Michael Färber & Melissa Coutinho & Shuzhou Yuan, 2023. "Biases in scholarly recommender systems: impact, prevalence, and mitigation," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(5), pages 2703-2736, May.
    15. Yang, Alex Jie & Wu, Linwei & Zhang, Qi & Wang, Hao & Deng, Sanhong, 2023. "The k-step h-index in citation networks at the paper, author, and institution levels," Journal of Informetrics, Elsevier, vol. 17(4).
    16. Pierre Pelletier & Kevin Wirtz, 2023. "Sails and Anchors: The Complementarity of Exploratory and Exploitative Scientists in Knowledge Creation," Papers 2312.10476, arXiv.org.
    17. Liu, Meijun & Jaiswal, Ajay & Bu, Yi & Min, Chao & Yang, Sijie & Liu, Zhibo & Acuña, Daniel & Ding, Ying, 2022. "Team formation and team impact: The balance between team freshness and repeat collaboration," Journal of Informetrics, Elsevier, vol. 16(4).
    18. Jian Wang & Bart Thijs & Wolfgang Glänzel, 2015. "Interdisciplinarity and Impact: Distinct Effects of Variety, Balance, and Disparity," PLOS ONE, Public Library of Science, vol. 10(5), pages 1-18, May.
    19. Keisuke Okamura, 2019. "Interdisciplinarity revisited: evidence for research impact and dynamism," Palgrave Communications, Palgrave Macmillan, vol. 5(1), pages 1-9, December.
    20. Jiang, Zhuoren & Lin, Tianqianjin & Huang, Cui, 2023. "Deep representation learning of scientific paper reveals its potential scholarly impact," Journal of Informetrics, Elsevier, vol. 17(1).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:infome:v:18:y:2024:i:1:s1751157723000937. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/joi .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.