IDEAS home Printed from https://ideas.repec.org/a/eee/infome/v17y2023i2s1751157723000226.html
   My bibliography  Save this article

Quantifying the impact of scientific collaboration and papers via motif-based heterogeneous networks

Author

Listed:
  • Bai, Xiaomei
  • Zhang, Fuli
  • Liu, Jiaying
  • Xia, Feng

Abstract

Structured measurements have been widely used to measure the impact of scholarly entities based on scholarly networks. Existing methods use heterogeneous scholarly networks and the PageRank algorithm to quantify the impact of scientific collaboration. However, by ignoring important higher-order relationships in citation networks, the impact of scientific collaboration is quantified by relying on first-order relationships, which leads to indistinguishable self-citations. In this paper, to address these shortcomings, we propose a Motif-based Scientific Collaboration Impact Rank framework, named as MSCIRank, which leverages the triangular motifs from the reconstructed collaboration-citation networks and integrates the first-order and higher-order relationships in the PageRank algorithm to quantify the impact of scientific collaboration and scholarly papers. MSCIRank consists of two models, i,e, linear and non-linear. Extensive experiments have demonstrated the effectiveness of MSCIRank. The experimental results show that MSCIRank is better than SCIRank in identifying Nobel Prize papers in terms of Recall. The MSCIRank model can weaken or strengthen the impact of self-citation. Linear MSCIRank is consistent with Pareto’s principle, while non-linear MSCIRank is inconsistent. In addition, the average impact of pairs of co-authors with high impact in the linear MSCIRank is much higher than that in the non-linear MSCIRank.

Suggested Citation

  • Bai, Xiaomei & Zhang, Fuli & Liu, Jiaying & Xia, Feng, 2023. "Quantifying the impact of scientific collaboration and papers via motif-based heterogeneous networks," Journal of Informetrics, Elsevier, vol. 17(2).
  • Handle: RePEc:eee:infome:v:17:y:2023:i:2:s1751157723000226
    DOI: 10.1016/j.joi.2023.101397
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1751157723000226
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.joi.2023.101397?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Xiaomei Bai & Fuli Zhang & Jie Hou & Ivan Lee & Xiangjie Kong & Amr Tolba & Feng Xia, 2018. "Quantifying the impact of scholarly papers based on higher-order weighted citations," PLOS ONE, Public Library of Science, vol. 13(3), pages 1-17, March.
    2. Jun Zhang & Yan Hu & Zhaolong Ning & Amr Tolba & Elsayed Elashkar & Feng Xia, 2018. "AIRank: Author Impact Ranking through Positions in Collaboration Networks," Complexity, Hindawi, vol. 2018, pages 1-16, June.
    3. Xiaojun Wan & Fang Liu, 2014. "Are all literature citations equally important? Automatic citation strength estimation and its applications," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 65(9), pages 1929-1938, September.
    4. Fuli Zhang, 2017. "Evaluating journal impact based on weighted citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(2), pages 1155-1169, November.
    5. Massucci, Francesco Alessandro & Docampo, Domingo, 2019. "Measuring the academic reputation through citation networks via PageRank," Journal of Informetrics, Elsevier, vol. 13(1), pages 185-201.
    6. Wang, Wei & Ren, Jing & Alrashoud, Mubarak & Xia, Feng & Mao, Mengyi & Tolba, Amr, 2020. "Early-stage reciprocity in sustainable scientific collaboration," Journal of Informetrics, Elsevier, vol. 14(3).
    7. Chen, P. & Xie, H. & Maslov, S. & Redner, S., 2007. "Finding scientific gems with Google’s PageRank algorithm," Journal of Informetrics, Elsevier, vol. 1(1), pages 8-15.
    8. Leo Egghe, 2006. "Theory and practise of the g-index," Scientometrics, Springer;Akadémiai Kiadó, vol. 69(1), pages 131-152, October.
    9. Zhang, Yu & Wang, Min & Gottwalt, Florian & Saberi, Morteza & Chang, Elizabeth, 2019. "Ranking scientific articles based on bibliometric networks with a weighting scheme," Journal of Informetrics, Elsevier, vol. 13(2), pages 616-634.
    10. Mott Greene, 2007. "The demise of the lone author," Nature, Nature, vol. 450(7173), pages 1165-1165, December.
    11. Xiaomei Bai & Fuli Zhang & Jinzhou Li & Zhong Xu & Zeeshan Patoli & Ivan Lee, 2021. "Quantifying scientific collaboration impact by exploiting collaboration-citation network," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 7993-8008, September.
    12. Jun Zhang & Zhaolong Ning & Xiaomei Bai & Xiangjie Kong & Jinmeng Zhou & Feng Xia, 2017. "Exploring time factors in measuring the scientific impact of scholars," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(3), pages 1301-1321, September.
    13. Qiang Wu, 2010. "The w-index: A measure to assess scientific impact by focusing on widely cited papers," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 61(3), pages 609-614, March.
    14. Anand Bihari & Sudhakar Tripathi, 2017. "EM-index: a new measure to evaluate the scientific impact of scientists," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(1), pages 659-677, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xiaomei Bai & Fuli Zhang & Jinzhou Li & Zhong Xu & Zeeshan Patoli & Ivan Lee, 2021. "Quantifying scientific collaboration impact by exploiting collaboration-citation network," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 7993-8008, September.
    2. Zhou Chunlei & Kong Xiangyi & Lin Zhipeng, 2019. "Research on Derek John de Solla Price Medal Prediction Based on Academic Credit Analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(1), pages 159-175, January.
    3. Eleni Fragkiadaki & Georgios Evangelidis, 2016. "Three novel indirect indicators for the assessment of papers and authors based on generations of citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(2), pages 657-694, February.
    4. Wei, Shelia X. & Tong, Tong & Rousseau, Ronald & Wang, Wanru & Ye, Fred Y., 2022. "Relations among the h-, g-, ψ-, and p-index and offset-ability," Journal of Informetrics, Elsevier, vol. 16(4).
    5. Hao Wang & Hua-Wei Shen & Xue-Qi Cheng, 2016. "Scientific credit diffusion: Researcher level or paper level?," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 827-837, November.
    6. Fang Zhang & Shengli Wu, 2021. "Measuring academic entities’ impact by content-based citation analysis in a heterogeneous academic network," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(8), pages 7197-7222, August.
    7. Yu, Dejian & Sheng, Libo, 2021. "Influence difference main path analysis: Evidence from DNA and blockchain domain citation networks," Journal of Informetrics, Elsevier, vol. 15(4).
    8. Vîiu, Gabriel-Alexandru, 2016. "A theoretical evaluation of Hirsch-type bibliometric indicators confronted with extreme self-citation," Journal of Informetrics, Elsevier, vol. 10(2), pages 552-566.
    9. Deming Lin & Tianhui Gong & Wenbin Liu & Martin Meyer, 2020. "An entropy-based measure for the evolution of h index research," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2283-2298, December.
    10. Alexander Kuchansky & Andrii Biloshchytskyi & Yurii Andrashko & Svitlana Biloshchytska & Adil Faizullin, 2022. "The Scientific Productivity of Collective Subjects Based on the Time-Weighted PageRank Method with Citation Intensity," Publications, MDPI, vol. 10(4), pages 1-17, October.
    11. Chen, Ying & Koch, Thorsten & Zakiyeva, Nazgul & Liu, Kailiang & Xu, Zhitong & Chen, Chun-houh & Nakano, Junji & Honda, Keisuke, 2023. "Article’s scientific prestige: Measuring the impact of individual articles in the web of science," Journal of Informetrics, Elsevier, vol. 17(1).
    12. L. Egghe, 2011. "Mathematical derivation of the scale-dependence of the h-index and other h-type indices," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(2), pages 287-292, May.
    13. Mingyang Wang & Jiaqi Zhang & Shijia Jiao & Xiangrong Zhang & Na Zhu & Guangsheng Chen, 2020. "Important citation identification by exploiting the syntactic and contextual information of citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2109-2129, December.
    14. Yu Zhang & Min Wang & Morteza Saberi & Elizabeth Chang, 2022. "Analysing academic paper ranking algorithms using test data and benchmarks: an investigation," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(7), pages 4045-4074, July.
    15. Corrêa Jr., Edilson A. & Silva, Filipi N. & da F. Costa, Luciano & Amancio, Diego R., 2017. "Patterns of authors contribution in scientific manuscripts," Journal of Informetrics, Elsevier, vol. 11(2), pages 498-510.
    16. Zhang, Fang & Wu, Shengli, 2020. "Predicting future influence of papers, researchers, and venues in a dynamic academic network," Journal of Informetrics, Elsevier, vol. 14(2).
    17. Chao Lu & Ying Ding & Chengzhi Zhang, 2017. "Understanding the impact change of a highly cited article: a content-based citation analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(2), pages 927-945, August.
    18. Jun Zhang & Yan Hu & Zhaolong Ning & Amr Tolba & Elsayed Elashkar & Feng Xia, 2018. "AIRank: Author Impact Ranking through Positions in Collaboration Networks," Complexity, Hindawi, vol. 2018, pages 1-16, June.
    19. Fuli Zhang, 2017. "Evaluating journal impact based on weighted citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(2), pages 1155-1169, November.
    20. Egghe, L., 2014. "Impact coverage of the success-index," Journal of Informetrics, Elsevier, vol. 8(2), pages 384-389.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:infome:v:17:y:2023:i:2:s1751157723000226. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/joi .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.