IDEAS home Printed from https://ideas.repec.org/a/eee/infome/v13y2019i4s1751157719300094.html
   My bibliography  Save this article

Forward search path count as an alternative indirect citation impact indicator

Author

Listed:
  • Jiang, Xiaorui
  • Zhuge, Hai

Abstract

Main path analysis is a popular method for extracting the backbone of scientific evolution from a (paper) citation network. The first and core step of main path analysis, called search path counting, is to weight citation arcs by the number of scientific influence paths from old to new papers. Search path counting shows high potential in scientific impact evaluation due to its semantic similarity to the meaning of scientific impact indicator, i.e. how many papers are influenced to what extent. In addition, the algorithmic idea of search path counting also resembles many known indirect citation impact indicators. Inspired by the above observations, this paper presents the FSPC (Forward Search Path Count) framework as an alternative scientific impact indicator based on indirect citations. Two critical assumptions are made to ensure the effectiveness of FSPC. First, knowledge decay is introduced to weight scientific influence paths in decreasing order of length. Second, path capping is introduced to mimic human literature search and citing behavior. By experiments on two well-studied datasets against two carefully created gold standard sets of papers, we have demonstrated that FSPC is able to achieve surprisingly good performance in not only recognizing high-impact papers but also identifying undercited papers.

Suggested Citation

  • Jiang, Xiaorui & Zhuge, Hai, 2019. "Forward search path count as an alternative indirect citation impact indicator," Journal of Informetrics, Elsevier, vol. 13(4).
    • Handle: RePEc:eee:infome:v:13:y:2019:i:4:s1751157719300094
    DOI: 10.1016/j.joi.2019.100977
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1751157719300094
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.joi.2019.100977?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. L. Egghe, 2011. "The single publication H-index and the indirect H-index of a researcher," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(3), pages 1003-1004, September.
    2. Hui Fang, 2018. "A Discussion of citations from the perspective of the contribution of the cited paper to the citing paper," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 69(12), pages 1513-1520, December.
    3. Giuffrida, Cristiano & Abramo, Giovanni & D’Angelo, Ciriaco Andrea, 2019. "Are all citations worth the same? Valuing citations by the value of the citing items," Journal of Informetrics, Elsevier, vol. 13(2), pages 500-514.
    4. Gamal Atallah & Gabriel Rodríguez, 2006. "Indirect patent citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 67(3), pages 437-465, June.
    5. Bart Verspagen, 2007. "Mapping Technological Trajectories As Patent Citation Networks: A Study On The History Of Fuel Cell Research," Advances in Complex Systems (ACS), World Scientific Publishing Co. Pte. Ltd., vol. 10(01), pages 93-115.
    6. L. Egghe, 2011. "The single publication H-index of papers in the Hirsch-core of a researcher and the indirect H-index," Scientometrics, Springer;Akadémiai Kiadó, vol. 89(3), pages 727-739, December.
    7. Gertrud Herlach, 1978. "Can retrieval of information from citation indexes be simplified? Multiple mention of a reference as a characteristic of the link between cited and citing article," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 29(6), pages 308-310, November.
    8. Mariani, Manuel Sebastian & Medo, Matúš & Zhang, Yi-Cheng, 2016. "Identification of milestone papers through time-balanced network centrality," Journal of Informetrics, Elsevier, vol. 10(4), pages 1207-1223.
    9. M. H. MacRoberts & B. R. MacRoberts, 1988. "Author motivation for not citing influences: A methodological note," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 39(6), pages 432-433, November.
    10. Hu, Xiaojun & Rousseau, Ronald, 2016. "Scientific influence is not always visible: The phenomenon of under-cited influential publications," Journal of Informetrics, Elsevier, vol. 10(4), pages 1079-1091.
    11. Su, Cheng & Pan, YunTao & Zhen, YanNing & Ma, Zheng & Yuan, JunPeng & Guo, Hong & Yu, ZhengLu & Ma, CaiFeng & Wu, YiShan, 2011. "PrestigeRank: A new evaluation method for papers and journals," Journal of Informetrics, Elsevier, vol. 5(1), pages 1-13.
    12. John S. Liu & Hsiao-Hui Chen & Mei Hsiu-Ching Ho & Yu-Chen Li, 2014. "Citations with different levels of relevancy: Tracing the main paths of legal opinions," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 65(12), pages 2479-2488, December.
    13. John S. Liu & Louis Y.Y. Lu, 2012. "An integrated approach for main path analysis: Development of the Hirsch index as an example," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(3), pages 528-542, March.
    14. Xiaojun Wan & Fang Liu, 2014. "Are all literature citations equally important? Automatic citation strength estimation and its applications," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 65(9), pages 1929-1938, September.
    15. Xiaorui Jiang & Xiaoping Sun & Hai Zhuge, 2013. "Graph-based algorithms for ranking researchers: not all swans are white!," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(3), pages 743-759, September.
    16. Hu, Xiaojun & Rousseau, Ronald & Chen, Jin, 2011. "On the definition of forward and backward citation generations," Journal of Informetrics, Elsevier, vol. 5(1), pages 27-36.
    17. Xiaojun Hu & Ronald Rousseau & Jin Chen, 2012. "Structural indicators in citation networks," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(2), pages 451-460, May.
    18. Eleni Fragkiadaki & Georgios Evangelidis, 2016. "Erratum to: Three novel indirect indicators for the assessment of papers and authors based on generations of citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(2), pages 1011-1011, August.
    19. Guo Zhang & Ying Ding & Staša Milojević, 2013. "Citation content analysis (CCA): A framework for syntactic and semantic analysis of citation content," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 64(7), pages 1490-1503, July.
    20. M. H. MacRoberts & B. R. MacRoberts, 1997. "Citation content analysis of a botany journal," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 48(3), pages 274-275, March.
    21. András Schubert, 2009. "Using the h-index for assessing single publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 78(3), pages 559-565, March.
    22. Xiaojun Wan & Fang Liu, 2014. "WL-index: Leveraging citation mention number to quantify an individual's scientific impact," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 65(12), pages 2509-2517, December.
    23. Xiaojun Hu & Ronald Rousseau & Jin Chen, 2012. "A new approach for measuring the value of patents based on structural indicators for ego patent citation networks," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 63(9), pages 1834-1842, September.
    24. Guo Zhang & Ying Ding & Staša Milojević, 2013. "Citation content analysis (CCA): A framework for syntactic and semantic analysis of citation content," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(7), pages 1490-1503, July.
    25. Parolo, Pietro Della Briotta & Pan, Raj Kumar & Ghosh, Rumi & Huberman, Bernardo A. & Kaski, Kimmo & Fortunato, Santo, 2015. "Attention decay in science," Journal of Informetrics, Elsevier, vol. 9(4), pages 734-745.
    26. María‐del‐Mar Camacho‐Miñano & Manuel Núñez‐Nickel, 2009. "The multilayered nature of reference selection," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 60(4), pages 754-777, April.
    27. Eleni Fragkiadaki & Georgios Evangelidis, 2016. "Three novel indirect indicators for the assessment of papers and authors based on generations of citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(2), pages 657-694, February.
    28. Howard D. White, 2001. "Authors as citers over time," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 52(2), pages 87-108.
    29. Ying Ding & Guo Zhang & Tamy Chambers & Min Song & Xiaolong Wang & Chengxiang Zhai, 2014. "Content-based citation analysis: The next generation of citation analysis," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 65(9), pages 1820-1833, September.
    30. Eleni Fragkiadaki & Georgios Evangelidis & Nikolaos Samaras & Dimitris A. Dervos, 2011. "f-Value: measuring an article’s scientific impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 86(3), pages 671-686, March.
    31. Kosmulski, Marek, 2010. "Hirsch-type approach to the 2nd generation citations," Journal of Informetrics, Elsevier, vol. 4(3), pages 257-264.
    32. Chen, P. & Xie, H. & Maslov, S. & Redner, S., 2007. "Finding scientific gems with Google’s PageRank algorithm," Journal of Informetrics, Elsevier, vol. 1(1), pages 8-15.
    33. Philippe Gorry & Pascal Ragouet, 2016. "“Sleeping beauty” and her restless sleep: Charles Dotter and the birth of interventional radiology," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(2), pages 773-784, May.
    34. Ren, Zhuo-Ming, 2019. "Age preference of metrics for identifying significant nodes in growing citation networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 513(C), pages 325-332.
    35. Xiaojun Hu & Ronald Rousseau & Jin Chen, 2012. "A new approach for measuring the value of patents based on structural indicators for ego patent citation networks," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(9), pages 1834-1842, September.
    36. John S. Liu & Louis Y.Y. Lu, 2012. "An integrated approach for main path analysis: Development of the Hirsch index as an example," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 63(3), pages 528-542, March.
    37. Leo Katz, 1953. "A new status index derived from sociometric analysis," Psychometrika, Springer;The Psychometric Society, vol. 18(1), pages 39-43, March.
    38. Eleni Fragkiadaki & Georgios Evangelidis, 2014. "Review of the indirect citations paradigm: theory and practice of the assessment of papers, authors and journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 99(2), pages 261-288, May.
    39. John S. Liu & Chung-Huei Kuan, 2016. "A new approach for main path analysis: Decay in knowledge diffusion," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(2), pages 465-476, February.
    40. Xiaorui Jiang & Xiaoping Sun & Zhe Yang & Hai Zhuge & Jianmin Yao, 2016. "Exploiting heterogeneous scientific literature networks to combat ranking bias: Evidence from the computational linguistics area," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(7), pages 1679-1702, July.
    41. Liu, John S. & Lu, Louis Y.Y. & Ho, Mei Hsiu-Ching, 2012. "Total influence and mainstream measures for scientific researchers," Journal of Informetrics, Elsevier, vol. 6(4), pages 496-504.
    42. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Nisar Ali & Zahid Halim & Syed Fawad Hussain, 2023. "An artificial intelligence-based framework for data-driven categorization of computer scientists: a case study of world’s Top 10 computing departments," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(3), pages 1513-1545, March.
    2. Lyu, Haihua & Bu, Yi & Zhao, Zhenyue & Zhang, Jiarong & Li, Jiang, 2022. "Citation bias in measuring knowledge flow: Evidence from the web of science at the discipline level," Journal of Informetrics, Elsevier, vol. 16(4).
    3. Lai, Kuei-Kuei & Bhatt, Priyanka C. & Kumar, Vimal & Chen, Hsueh-Chen & Chang, Yu-Hsin & Su, Fang-Pei, 2021. "Identifying the impact of patent family on the patent trajectory: A case of thin film solar cells technological trajectories," Journal of Informetrics, Elsevier, vol. 15(2).
    4. Dejian Yu & Zhaoping Yan, 2022. "Combining machine learning and main path analysis to identify research front: from the perspective of science-technology linkage," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(7), pages 4251-4274, July.
    5. Heng Huang & Donghua Zhu & Xuefeng Wang, 2022. "Evaluating scientific impact of publications: combining citation polarity and purpose," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(9), pages 5257-5281, September.
    6. Myeongji Oh & Hyejin Jang & Sunhye Kim & Byungun Yoon, 2023. "Main path analysis for technological development using SAO structure and DEMATEL based on keyword causality," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2079-2104, April.
    7. Xiaorui Jiang & Junjun Liu, 2023. "Extracting the evolutionary backbone of scientific domains: The semantic main path network analysis approach based on citation context analysis," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 74(5), pages 546-569, May.
    8. Yuanyuan Liu & Qiang Wu & Shijie Wu & Yong Gao, 2021. "Weighted citation based on ranking-related contribution: a new index for evaluating article impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(10), pages 8653-8672, October.
    9. Wang, Jingjing & Xu, Shuqi & Mariani, Manuel S. & Lü, Linyuan, 2021. "The local structure of citation networks uncovers expert-selected milestone papers," Journal of Informetrics, Elsevier, vol. 15(4).
    10. Yu Zhang & Min Wang & Morteza Saberi & Elizabeth Chang, 2022. "Analysing academic paper ranking algorithms using test data and benchmarks: an investigation," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(7), pages 4045-4074, July.
    11. Yu, Dejian & Yan, Zhaoping, 2023. "Main path analysis considering citation structure and content: Case studies in different domains," Journal of Informetrics, Elsevier, vol. 17(1).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lyu, Haihua & Bu, Yi & Zhao, Zhenyue & Zhang, Jiarong & Li, Jiang, 2022. "Citation bias in measuring knowledge flow: Evidence from the web of science at the discipline level," Journal of Informetrics, Elsevier, vol. 16(4).
    2. Cristina López-Duarte & Marta M. Vidal-Suárez & Belén González-Díaz, 2019. "Cross-national distance and international business: an analysis of the most influential recent models," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 173-208, October.
    3. Hu, Xiaojun & Rousseau, Ronald, 2016. "Scientific influence is not always visible: The phenomenon of under-cited influential publications," Journal of Informetrics, Elsevier, vol. 10(4), pages 1079-1091.
    4. Chao Min & Qingyu Chen & Erjia Yan & Yi Bu & Jianjun Sun, 2021. "Citation cascade and the evolution of topic relevance," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 72(1), pages 110-127, January.
    5. Yu, Dejian & Sheng, Libo, 2021. "Influence difference main path analysis: Evidence from DNA and blockchain domain citation networks," Journal of Informetrics, Elsevier, vol. 15(4).
    6. Eleni Fragkiadaki & Georgios Evangelidis, 2014. "Review of the indirect citations paradigm: theory and practice of the assessment of papers, authors and journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 99(2), pages 261-288, May.
    7. Yuanyuan Liu & Qiang Wu & Shijie Wu & Yong Gao, 2021. "Weighted citation based on ranking-related contribution: a new index for evaluating article impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(10), pages 8653-8672, October.
    8. Cristina López-Duarte & Marta M. Vidal-Suárez & Belén González-Díaz, 2018. "The early adulthood of the Asia Pacific Journal of Management: A literature review 2005–2014," Asia Pacific Journal of Management, Springer, vol. 35(2), pages 313-345, June.
    9. Yu, Dejian & Pan, Tianxing, 2021. "Tracing the main path of interdisciplinary research considering citation preference: A case from blockchain domain," Journal of Informetrics, Elsevier, vol. 15(2).
    10. Eleni Fragkiadaki & Georgios Evangelidis, 2016. "Three novel indirect indicators for the assessment of papers and authors based on generations of citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(2), pages 657-694, February.
    11. Wang, Jingjing & Xu, Shuqi & Mariani, Manuel S. & Lü, Linyuan, 2021. "The local structure of citation networks uncovers expert-selected milestone papers," Journal of Informetrics, Elsevier, vol. 15(4).
    12. Yu Zhang & Min Wang & Morteza Saberi & Elizabeth Chang, 2022. "Analysing academic paper ranking algorithms using test data and benchmarks: an investigation," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(7), pages 4045-4074, July.
    13. Chao Lu & Ying Ding & Chengzhi Zhang, 2017. "Understanding the impact change of a highly cited article: a content-based citation analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(2), pages 927-945, August.
    14. Huang, Chen-Hao & Liu, John S. & Ho, Mei Hsiu-Ching & Chou, Tzu-Chuan, 2022. "Towards more convergent main paths: A relevance-based approach," Journal of Informetrics, Elsevier, vol. 16(3).
    15. Xiaorui Jiang & Junjun Liu, 2023. "Extracting the evolutionary backbone of scientific domains: The semantic main path network analysis approach based on citation context analysis," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 74(5), pages 546-569, May.
    16. Hu, Xiaojun & Rousseau, Ronald, 2018. "A new approach to explore the knowledge transition path in the evolution of science & technology: From the biology of restriction enzymes to their application in biotechnology," Journal of Informetrics, Elsevier, vol. 12(3), pages 842-857.
    17. Vaccario, Giacomo & Medo, Matúš & Wider, Nicolas & Mariani, Manuel Sebastian, 2017. "Quantifying and suppressing ranking bias in a large citation network," Journal of Informetrics, Elsevier, vol. 11(3), pages 766-782.
    18. Dunaiski, Marcel & Geldenhuys, Jaco & Visser, Willem, 2019. "On the interplay between normalisation, bias, and performance of paper impact metrics," Journal of Informetrics, Elsevier, vol. 13(1), pages 270-290.
    19. Zhenbin Yan & Qiang Wu & Xingchen Li, 2016. "Do Hirsch-type indices behave the same in assessing single publications? An empirical study of 29 bibliometric indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 1815-1833, December.
    20. Andreas Reinstaller & Peter Reschenhofer, 2017. "Using PageRank in the analysis of technological progress through patents: an illustration for biotechnological inventions," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(3), pages 1407-1438, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:infome:v:13:y:2019:i:4:s1751157719300094. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/joi .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.