IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v112y2017i2d10.1007_s11192-017-2406-y.html
   My bibliography  Save this article

A relevance ranking method for citation-based search results

Author

Listed:
  • Christopher W. Belter

    (National Institutes of Health)

Abstract

A growing number of researchers are exploring the use of citation relationships such as direct citation, bibliographic coupling, and co-citation for information retrieval in scientific databases and digital libraries. In this paper, I propose a method of ranking the relevance of citation-based search results to a set of key, or seed, papers by measuring the number of citation relationships they share with those key papers. I tested the method against 23 published systematic reviews and found that the method retrieved 87% of the studies included in these reviews. The relevance ranking approach identified a subset of the citation search results that comprised 27% of the total documents retrieved by the method, and 7% of the documents retrieved by these reviews, but that contained 75% of the studies included in these reviews. Additional testing suggested that the method may be less appropriate for reviews that combine literature in ways that are not reflected in the literature itself. These results suggest that this ranking method could be useful in a range of information retrieval contexts.

Suggested Citation

  • Christopher W. Belter, 2017. "A relevance ranking method for citation-based search results," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(2), pages 731-746, August.
    • Handle: RePEc:spr:scient:v:112:y:2017:i:2:d:10.1007_s11192-017-2406-y
    DOI: 10.1007/s11192-017-2406-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-017-2406-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-017-2406-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Philipp Mayr & Andrea Scharnhorst, 2015. "Scientometrics and information retrieval: weak-links revitalized," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(3), pages 2193-2199, March.
    2. Birger Larsen, 2002. "Exploiting citation overlaps for Information Retrieval: Generating a boomerang effect from the network of scientific papers," Scientometrics, Springer;Akadémiai Kiadó, vol. 54(2), pages 155-178, June.
    3. Julie Bichteler & Edward A. Eaton, 1980. "The combined use of bibliographic coupling and cocitation for document retrieval," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 31(4), pages 278-282, August.
    4. Christopher W. Belter, 2016. "Citation analysis as a literature search method for systematic reviews," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(11), pages 2766-2777, November.
    5. Miranda Lee Pao & Dennis B. Worthen, 1989. "Retrieval effectiveness by semantic and citation searching," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 40(4), pages 226-235, July.
    6. Sebastian Hinde & Eldon Spackman, 2015. "Bidirectional Citation Searching to Completion: An Exploration of Literature Searching Methods," PharmacoEconomics, Springer, vol. 33(1), pages 5-11, January.
    7. Masaki Eto, 2013. "Evaluations of context-based co-citation searching," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(2), pages 651-673, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Müge Akbulut & Yaşar Tonta & Howard D. White, 2020. "Related records retrieval and pennant retrieval: an exploratory case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(2), pages 957-987, February.
    2. Juan Pablo Bascur & Suzan Verberne & Nees Jan Eck & Ludo Waltman, 2023. "Academic information retrieval using citation clusters: in-depth evaluation based on systematic reviews," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(5), pages 2895-2921, May.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Maryam Yaghtin & Hajar Sotudeh & Mahdieh Mirzabeigi & Seyed Mostafa Fakhrahmad & Mehdi Mohammadi, 2019. "In quest of new document relations: evaluating co-opinion relations between co-citations and its impact on Information retrieval effectiveness," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 987-1008, May.
    2. Müge Akbulut & Yaşar Tonta & Howard D. White, 2020. "Related records retrieval and pennant retrieval: an exploratory case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(2), pages 957-987, February.
    3. Juan Pablo Bascur & Suzan Verberne & Nees Jan Eck & Ludo Waltman, 2023. "Academic information retrieval using citation clusters: in-depth evaluation based on systematic reviews," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(5), pages 2895-2921, May.
    4. Masaki Eto, 2013. "Evaluations of context-based co-citation searching," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(2), pages 651-673, February.
    5. Michel Zitt, 2015. "Meso-level retrieval: IR-bibliometrics interplay and hybrid citation-words methods in scientific fields delineation," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(3), pages 2223-2245, March.
    6. Ruturaj Baber & Yogesh Upadhyay & Prerana Baber & Rahul Pratap Singh Kaurav, 2023. "Three Decades of Consumer Ethnocentrism Research: A Bibliometric Analysis," Business Perspectives and Research, , vol. 11(1), pages 137-158, January.
    7. Rob Koopman & Shenghui Wang & Andrea Scharnhorst, 2017. "Contextualization of topics: browsing through the universe of bibliographic information," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(2), pages 1119-1139, May.
    8. Theresa Velden & Kevin W. Boyack & Jochen Gläser & Rob Koopman & Andrea Scharnhorst & Shenghui Wang, 2017. "Comparison of topic extraction approaches and their results," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(2), pages 1169-1221, May.
    9. Mojisola Erdt & Aarthy Nagarajan & Sei-Ching Joanna Sin & Yin-Leng Theng, 2016. "Altmetrics: an analysis of the state-of-the-art in measuring research impact on social media," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 1117-1166, November.
    10. van Eck, Nees Jan & Waltman, Ludo, 2014. "CitNetExplorer: A new software tool for analyzing and visualizing citation networks," Journal of Informetrics, Elsevier, vol. 8(4), pages 802-823.
    11. Sven E. Hug & Mirjam Aeschbach, 2020. "Criteria for assessing grant applications: a systematic review," Palgrave Communications, Palgrave Macmillan, vol. 6(1), pages 1-15, December.
    12. Sebastian Hinde & Laura Bojke & Peter Coventry, 2021. "The Cost Effectiveness of Ecotherapy as a Healthcare Intervention, Separating the Wood from the Trees," IJERPH, MDPI, vol. 18(21), pages 1-13, November.
    13. Nassiri, Isar & Masoudi-Nejad, Ali & Jalili, Mahdi & Moeini, Ali, 2013. "Normalized Similarity Index: An adjusted index to prioritize article citations," Journal of Informetrics, Elsevier, vol. 7(1), pages 91-98.
    14. Muhammad Kamran Abbasi & Ingo Frommholz, 2015. "Cluster-based polyrepresentation as science modelling approach for information retrieval," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(3), pages 2301-2322, March.
    15. Dan Liu & Siqi Che & Wenzhong Zhu, 2022. "Visualizing the Knowledge Domain of Academic Mobility Research from 2010 to 2020: A Bibliometric Analysis Using CiteSpace," SAGE Open, , vol. 12(1), pages 21582440211, January.
    16. Lijun Yang & Liangxiu Han & Naxin Liu, 2019. "A new approach to journal co-citation matrix construction based on the number of co-cited articles in journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(2), pages 507-517, August.
    17. Marić, Josip & Opazo-Basáez, Marco & Vlačić, Božidar & Dabić, Marina, 2023. "Innovation management of three-dimensional printing (3DP) technology: Disclosing insights from existing literature and determining future research streams," Technological Forecasting and Social Change, Elsevier, vol. 193(C).
    18. Kim, Ha Jin & Jeong, Yoo Kyung & Song, Min, 2016. "Content- and proximity-based author co-citation analysis using citation sentences," Journal of Informetrics, Elsevier, vol. 10(4), pages 954-966.
    19. Mikkel Christoffersen, 2004. "Identifying core documents with a multiple evidence relevance filter," Scientometrics, Springer;Akadémiai Kiadó, vol. 61(3), pages 385-394, November.
    20. Jensen, Scott & Liu, Xiaozhong & Yu, Yingying & Milojevic, Staša, 2016. "Generation of topic evolution trees from heterogeneous bibliographic networks," Journal of Informetrics, Elsevier, vol. 10(2), pages 606-621.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:112:y:2017:i:2:d:10.1007_s11192-017-2406-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.