IDEAS home Printed from https://ideas.repec.org/a/eee/infome/v16y2022i4s1751157722000906.html
   My bibliography  Save this article

Citation bias in measuring knowledge flow: Evidence from the web of science at the discipline level

Author

Listed:
  • Lyu, Haihua
  • Bu, Yi
  • Zhao, Zhenyue
  • Zhang, Jiarong
  • Li, Jiang

Abstract

Knowledge flow between scientific disciplines has commonly been measured based on citation data. Previous studies using citing relationships have mostly considered direct citations but have paid little attention to indirect citations (IDC) to indicate how knowledge diffusion from one discipline to another via one or more intermediaries. In this study, we measured knowledge flow between disciplines from two perspectives: direct citations (DC) and discipline potential energy (DPE), which is proposed to combine both direct and indirect citations. Data were collected from the Web of Science (WoS) database. Findings include: (1) DPE overshadows previous measures by considering not only direct citations but also indirect citations between disciplines which was usually ignored in previous measures, and revealed that the knowledge contribution of some disciplines had been underestimated by previous measures, such as Physics and Engineering. (2) The proportion of IDC contribution is close to that of direct knowledge contribution when the discipline scale is removed, which suggests that it is essential to consider IDC to distinguish the knowledge relationship (net-outflow/inflow) between disciplines. (3) Both measurements show that Biology & Biochemistry has always been the top discipline with the highest net outflow of knowledge, which is inconsistent with the history of science that Mathematics, Physics and Chemistry would be the highest net outflow disciplines. The results show that even considering IDC does not fully reveal the knowledge contribution and academic influence of disciplines. This paper also analyzes the potential reasons for citation bias in revealing the contribution of disciplinary knowledge from a citation perspective. Therefore, caution should be taken in the use of citations as a primary measure of knowledge flow.

Suggested Citation

  • Lyu, Haihua & Bu, Yi & Zhao, Zhenyue & Zhang, Jiarong & Li, Jiang, 2022. "Citation bias in measuring knowledge flow: Evidence from the web of science at the discipline level," Journal of Informetrics, Elsevier, vol. 16(4).
    • Handle: RePEc:eee:infome:v:16:y:2022:i:4:s1751157722000906
    DOI: 10.1016/j.joi.2022.101338
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1751157722000906
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.joi.2022.101338?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Chaomei Chen & Diana Hicks, 2004. "Tracing knowledge diffusion," Scientometrics, Springer;Akadémiai Kiadó, vol. 59(2), pages 199-211, February.
    2. Fernanda Morillo & María Bordons & Isabel Gómez, 2003. "Interdisciplinarity in science: A tentative typology of disciplines and research areas," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 54(13), pages 1237-1249, November.
    3. Vincent Larivière & Éric Archambault & Yves Gingras & Étienne Vignola‐Gagné, 2006. "The place of serials in referencing practices: Comparing natural sciences and engineering with social sciences and humanities," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 57(8), pages 997-1004, June.
    4. Geoffrey G. Bell & Akbar Zaheer, 2007. "Geography, Networks, and Knowledge Flow," Organization Science, INFORMS, vol. 18(6), pages 955-972, December.
    5. Adam B. Jaffe & Manuel Trajtenberg & Rebecca Henderson, 1993. "Geographic Localization of Knowledge Spillovers as Evidenced by Patent Citations," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 108(3), pages 577-598.
    6. Jones, M. J. & Brinn, T. & Pendlebury, M., 1996. "Journal evaluation methodologies: A balanced response," Omega, Elsevier, vol. 24(5), pages 607-612, October.
    7. Saeed-Ul Hassan & Iqra Safder & Anam Akram & Faisal Kamiran, 2018. "A novel machine-learning approach to measuring scientific knowledge flows using citation context analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(2), pages 973-996, August.
    8. onder Nomaler & Bart Verspagen, 2008. "Knowledge Flows, Patent Citations and the Impact of Science on Technology," Economic Systems Research, Taylor & Francis Journals, vol. 20(4), pages 339-366.
    9. John Panaretos & Chrisovaladis Malesios, 2009. "Assessing scientific research performance and impact with single indices," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(3), pages 635-670, December.
    10. Hu, Xiaojun & Rousseau, Ronald, 2016. "Scientific influence is not always visible: The phenomenon of under-cited influential publications," Journal of Informetrics, Elsevier, vol. 10(4), pages 1079-1091.
    11. Yujia Zhai & Ying Ding & Fang Wang, 2018. "Measuring the diffusion of an innovation: A citation analysis," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 69(3), pages 368-379, March.
    12. Gamal Atallah & Gabriel Rodríguez, 2006. "Indirect patent citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 67(3), pages 437-465, June.
    13. Vivek Kumar Singh & Prashasti Singh & Mousumi Karmakar & Jacqueline Leta & Philipp Mayr, 2021. "The journal coverage of Web of Science, Scopus and Dimensions: A comparative analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 5113-5142, June.
    14. Michael H. MacRoberts & Barbara R. MacRoberts, 2018. "The mismeasure of science: Citation analysis," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 69(3), pages 474-482, March.
    15. Ed J. Rinia & Thed. N. Van Leeuwen & Eppo E.W. Bruins & Hendrik G. Van Vuren & Anthony F.J. Van Raan, 2001. "Citation delay in interdisciplinary knowledge exchange," Scientometrics, Springer;Akadémiai Kiadó, vol. 51(1), pages 293-309, April.
    16. Ludo Waltman & Nees Jan Eck, 2012. "A new methodology for constructing a publication-level classification system of science," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(12), pages 2378-2392, December.
    17. Anton J. Nederhof, 2006. "Bibliometric monitoring of research performance in the Social Sciences and the Humanities: A Review," Scientometrics, Springer;Akadémiai Kiadó, vol. 66(1), pages 81-100, January.
    18. Raf Vanderstraeten & Frédéric Vandermoere, 2021. "Inequalities in the growth of Web of Science," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(10), pages 8635-8651, October.
    19. Björn Hammarfelt, 2011. "Citation analysis on the micro level: The example of Walter Benjamin's Illuminations," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(5), pages 819-830, May.
    20. Erjia Yan, 2014. "Finding knowledge paths among scientific disciplines," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 65(11), pages 2331-2347, November.
    21. Björn Hammarfelt, 2011. "Citation analysis on the micro level: The example of Walter Benjamin's Illuminations," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(5), pages 819-830, May.
    22. Bart Verspagen & Marjolein C.J. Cani, ls, 2001. "Barriers to knowledge spillovers and regional convergence in an evolutionary model," Journal of Evolutionary Economics, Springer, vol. 11(3), pages 307-329.
    23. Xiaojun Hu & Ronald Rousseau & Jin Chen, 2012. "Structural indicators in citation networks," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(2), pages 451-460, May.
    24. Alexandru T. Balaban & Douglas J. Klein, 2006. "Is chemistry 'The Central Science'? How are different sciences related? Co-citations, reductionism, emergence, and posets," Scientometrics, Springer;Akadémiai Kiadó, vol. 69(3), pages 615-637, December.
    25. Ismael Rafols & Alan L. Porter & Loet Leydesdorff, 2010. "Science overlay maps: A new tool for research policy and library management," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 61(9), pages 1871-1887, September.
    26. Adam Jaffe & Manuel Trajtenberg, 1999. "International Knowledge Flows: Evidence From Patent Citations," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 8(1-2), pages 105-136.
    27. Bei Zeng & Haihua Lyu & Zhenyue Zhao & Jiang Li, 2021. "Exploring the direction and diversity of interdisciplinary knowledge diffusion: A case study of professor Zeyuan Liu's scientific publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 6253-6272, July.
    28. Xiaojun Hu & Ronald Rousseau & Jin Chen, 2012. "A new approach for measuring the value of patents based on structural indicators for ego patent citation networks," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 63(9), pages 1834-1842, September.
    29. Guo Zhang & Ying Ding & Staša Milojević, 2013. "Citation content analysis (CCA): A framework for syntactic and semantic analysis of citation content," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(7), pages 1490-1503, July.
    30. Agrawal, Ajay & Kapur, Devesh & McHale, John, 2008. "How do spatial and social proximity influence knowledge flows? Evidence from patent data," Journal of Urban Economics, Elsevier, vol. 64(2), pages 258-269, September.
    31. Yang, Siluo & Wang, Feifei, 2015. "Visualizing information science: Author direct citation analysis in China and around the world," Journal of Informetrics, Elsevier, vol. 9(1), pages 208-225.
    32. Jordi Ardanuy, 2013. "Sixty years of citation analysis studies in the humanities (1951–2010)," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(8), pages 1751-1755, August.
    33. Eleni Fragkiadaki & Georgios Evangelidis, 2014. "Review of the indirect citations paradigm: theory and practice of the assessment of papers, authors and journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 99(2), pages 261-288, May.
    34. Francis Narin & Mark Carpenter & Nancy C. Berlt, 1972. "Interrelationships of scientific journals," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 23(5), pages 323-331, September.
    35. Naumis, G.G. & Phillips, J.C., 2012. "Diffusion of knowledge and globalization in the web of twentieth century science," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 391(15), pages 3995-4003.
    36. Olav Sorenson & Jan W. Rivkin & Lee Fleming, 2010. "Complexity, Networks and Knowledge Flows," Chapters, in: Ron Boschma & Ron Martin (ed.), The Handbook of Evolutionary Economic Geography, chapter 15, Edward Elgar Publishing.
    37. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    38. Yan, Erjia & Ding, Ying & Cronin, Blaise & Leydesdorff, Loet, 2013. "A bird's-eye view of scientific trading: Dependency relations among fields of science," Journal of Informetrics, Elsevier, vol. 7(2), pages 249-264.
    39. Jordi Ardanuy, 2013. "Sixty years of citation analysis studies in the humanities (1951–2010)," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 64(8), pages 1751-1755, August.
    40. Ed J. Rinia & Thed N. van Leeuwen & Eppo E. W. Bruins & Hendrik G. van Vuren & Anthony F. J. van Raan, 2002. "Measuring knowledge transfer between fields of science," Scientometrics, Springer;Akadémiai Kiadó, vol. 54(3), pages 347-362, July.
    41. Ludo Waltman & Nees Jan van Eck, 2012. "A new methodology for constructing a publication‐level classification system of science," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 63(12), pages 2378-2392, December.
    42. Jiang, Xiaorui & Zhuge, Hai, 2019. "Forward search path count as an alternative indirect citation impact indicator," Journal of Informetrics, Elsevier, vol. 13(4).
    43. Hu, Xiaojun & Rousseau, Ronald & Chen, Jin, 2011. "On the definition of forward and backward citation generations," Journal of Informetrics, Elsevier, vol. 5(1), pages 27-36.
    44. Filippo Radicchi & Claudio Castellano, 2012. "A Reverse Engineering Approach to the Suppression of Citation Biases Reveals Universal Properties of Citation Distributions," PLOS ONE, Public Library of Science, vol. 7(3), pages 1-9, March.
    45. Guo Zhang & Ying Ding & Staša Milojević, 2013. "Citation content analysis (CCA): A framework for syntactic and semantic analysis of citation content," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 64(7), pages 1490-1503, July.
    46. Bernardo Monechi & Giulia Pullano & Vittorio Loreto, 2019. "Efficient team structures in an open-ended cooperative creativity experiment," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 116(44), pages 22088-22093, October.
    47. Ming-yueh Tsay, 2015. "Knowledge flow out of the domain of information science: a bibliometric and citation analysis study," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(1), pages 487-502, January.
    48. Loet Leydesdorff & Ismael Rafols, 2009. "A global map of science based on the ISI subject categories," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 60(2), pages 348-362, February.
    49. Ehsan Mohammadi & Mike Thelwall, 2014. "Mendeley readership altmetrics for the social sciences and humanities: Research evaluation and knowledge flows," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 65(8), pages 1627-1638, August.
    50. Xiaojun Hu & Ronald Rousseau & Jin Chen, 2012. "A new approach for measuring the value of patents based on structural indicators for ego patent citation networks," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(9), pages 1834-1842, September.
    51. Alan L. Porter & Ismael Rafols, 2009. "Is science becoming more interdisciplinary? Measuring and mapping six research fields over time," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(3), pages 719-745, December.
    52. Martin Meyer, 2002. "Tracing knowledge flows in innovation systems," Scientometrics, Springer;Akadémiai Kiadó, vol. 54(2), pages 193-212, June.
    53. Thed van Leeuwen & Robert Tijssen, 2000. "Interdisciplinary dynamics of modern science: analysis of cross-disciplinary citation flows," Research Evaluation, Oxford University Press, vol. 9(3), pages 183-187, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jiang, Xiaorui & Zhuge, Hai, 2019. "Forward search path count as an alternative indirect citation impact indicator," Journal of Informetrics, Elsevier, vol. 13(4).
    2. Ruimin Ma & Erjia Yan, 2016. "Uncovering inter-specialty knowledge communication using author citation networks," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 839-854, November.
    3. Yan, Erjia & Ding, Ying & Cronin, Blaise & Leydesdorff, Loet, 2013. "A bird's-eye view of scientific trading: Dependency relations among fields of science," Journal of Informetrics, Elsevier, vol. 7(2), pages 249-264.
    4. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    5. Chiara Carusi & Giuseppe Bianchi, 2020. "A look at interdisciplinarity using bipartite scholar/journal networks," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(2), pages 867-894, February.
    6. Yuanyuan Liu & Qiang Wu & Shijie Wu & Yong Gao, 2021. "Weighted citation based on ranking-related contribution: a new index for evaluating article impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(10), pages 8653-8672, October.
    7. Adam B. Jaffe & Gaétan de Rassenfosse, 2017. "Patent citation data in social science research: Overview and best practices," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(6), pages 1360-1374, June.
    8. Ismael Rafols & Alan Porter & Loet Leydesdorff, 2009. "Overlay Maps of Science: a New Tool for Research Policy," SPRU Working Paper Series 179, SPRU - Science Policy Research Unit, University of Sussex Business School.
    9. Kai Nishikawa, 2023. "How and why are citations between disciplines made? A citation context analysis focusing on natural sciences and social sciences and humanities," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(5), pages 2975-2997, May.
    10. Wang, Shiyun & Mao, Jin & Lu, Kun & Cao, Yujie & Li, Gang, 2021. "Understanding interdisciplinary knowledge integration through citance analysis: A case study on eHealth," Journal of Informetrics, Elsevier, vol. 15(4).
    11. Hu, Xiaojun & Rousseau, Ronald, 2016. "Scientific influence is not always visible: The phenomenon of under-cited influential publications," Journal of Informetrics, Elsevier, vol. 10(4), pages 1079-1091.
    12. John McLevey & Alexander V. Graham & Reid McIlroy-Young & Pierson Browne & Kathryn S. Plaisance, 2018. "Interdisciplinarity and insularity in the diffusion of knowledge: an analysis of disciplinary boundaries between philosophy of science and the sciences," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(1), pages 331-349, October.
    13. Jielan Ding & Per Ahlgren & Liying Yang & Ting Yue, 2018. "Disciplinary structures in Nature, Science and PNAS: journal and country levels," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 1817-1852, September.
    14. Mao, Jin & Liang, Zhentao & Cao, Yujie & Li, Gang, 2020. "Quantifying cross-disciplinary knowledge flow from the perspective of content: Introducing an approach based on knowledge memes," Journal of Informetrics, Elsevier, vol. 14(4).
    15. Meijun Liu & Xiao Hu & Jiang Li, 2018. "Knowledge flow in China’s humanities and social sciences," Quality & Quantity: International Journal of Methodology, Springer, vol. 52(2), pages 607-626, March.
    16. Wang, Qi & Waltman, Ludo, 2016. "Large-scale analysis of the accuracy of the journal classification systems of Web of Science and Scopus," Journal of Informetrics, Elsevier, vol. 10(2), pages 347-364.
    17. Seokbeom Kwon & Alan Porter & Jan Youtie, 2016. "Navigating the innovation trajectories of technology by combining specialization score analyses for publications and patents: graphene and nano-enabled drug delivery," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(3), pages 1057-1071, March.
    18. Iman Tahamtan & Lutz Bornmann, 2019. "What do citation counts measure? An updated review of studies on citations in scientific documents published between 2006 and 2018," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(3), pages 1635-1684, December.
    19. Hu, Xiaojun & Rousseau, Ronald, 2018. "A new approach to explore the knowledge transition path in the evolution of science & technology: From the biology of restriction enzymes to their application in biotechnology," Journal of Informetrics, Elsevier, vol. 12(3), pages 842-857.
    20. Loet Leydesdorff & Caroline S. Wagner & Lutz Bornmann, 2018. "Betweenness and diversity in journal citation networks as measures of interdisciplinarity—A tribute to Eugene Garfield," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(2), pages 567-592, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:infome:v:16:y:2022:i:4:s1751157722000906. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/joi .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.