IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v126y2021i3d10.1007_s11192-020-03850-6.html
   My bibliography  Save this article

Ranking journals through the lens of active visibility

Author

Listed:
  • Rabishankar Giri

    (Presidency University)

  • Sabuj Kumar Chaudhuri

    (University of Calcutta)

Abstract

Use of citation as a proxy unit in deriving research impact indicators largely hinges on universal referencing norms promulgated by Robert K. Merton. However, signals arising out of research fields indicate that referencing practices have often been affected by prejudices and expectations. Journals’ citation oeuvre may also be inflated by intelligent mix of citation optimizing tools, which render it difficult to detect. This study reveals that reach of a research publication (measured by its distinct users) is not always proportional to its citation counts. The application of raw citations as units to derive impact of research publication entities like journals thus poses a great threat to research community itself. This study introduces a new ranking method for journals where distinct authors (contributing as well as citing) are taken as units rather than raw citations. By considering authors as building units in the new indicator, the method can nullify/lessen the effect of common citation optimizing factors like journal self-citations, author self-citations and recitations on it. To legitimate the proposed method, an experimental study is conducted on 30 semi-systematically selected ‘Library and Information Science’ journals. It reflects that the new indicator favors authority of those journals that have relatively low self-citations and recitations.

Suggested Citation

  • Rabishankar Giri & Sabuj Kumar Chaudhuri, 2021. "Ranking journals through the lens of active visibility," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(3), pages 2189-2208, March.
  • Handle: RePEc:spr:scient:v:126:y:2021:i:3:d:10.1007_s11192-020-03850-6
    DOI: 10.1007/s11192-020-03850-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-020-03850-6
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11192-020-03850-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. John P. A. Ioannidis & Richard Klavans & Kevin W. Boyack, 2018. "Thousands of scientists publish a paper every five days," Nature, Nature, vol. 561(7722), pages 167-169, September.
    2. Sei‐Ching Joanna Sin, 2011. "International coauthorship and citation impact: A bibliometric study of six LIS journals, 1980–2008," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(9), pages 1770-1783, September.
    3. Howard D. White & Barry Wellman & Nancy Nazer, 2004. "Does citation reflect social structure?: Longitudinal evidence from the “Globenet” interdisciplinary research group," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 55(2), pages 111-126, January.
    4. Henk F Moed, 2007. "The future of research evaluation rests with an intelligent combination of advanced metrics and transparent peer review," Science and Public Policy, Oxford University Press, vol. 34(8), pages 575-583, October.
    5. Rodrigo Costas & Thed N. Leeuwen & María Bordons, 2010. "Self-citations at the meso and individual levels: effects of different calculation methods," Scientometrics, Springer;Akadémiai Kiadó, vol. 82(3), pages 517-537, March.
    6. Christoph Bartneck & Servaas Kokkelmans, 2011. "Detecting h-index manipulation through self-citation analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(1), pages 85-98, April.
    7. Sei-Ching Joanna Sin, 2011. "International coauthorship and citation impact: A bibliometric study of six LIS journals, 1980–2008," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(9), pages 1770-1783, September.
    8. Howard D. White, 2001. "Authors as citers over time," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 52(2), pages 87-108.
    9. James H. Fowler & Dag W. Aksnes, 2007. "Does self-citation pay?," Scientometrics, Springer;Akadémiai Kiadó, vol. 72(3), pages 427-437, September.
    10. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    11. Wilhite, Allen & Fong, Eric A. & Wilhite, Seth, 2019. "The influence of editorial decisions and the academic network on self-citations and journal impact factors," Research Policy, Elsevier, vol. 48(6), pages 1513-1522.
    12. Li Tang & Philip Shapira & Jan Youtie, 2015. "Is there a clubbing effect underlying Chinese research citation Increases?," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(9), pages 1923-1932, September.
    13. E. Garfield & I. H. Sher, 1963. "New factors in the evaluation of scientific literature through citation indexing," American Documentation, Wiley Blackwell, vol. 14(3), pages 195-201, July.
    14. Paula Mählck & Olle Persson, 2000. "Socio-Bibliometric Mapping of Intra-Departmental Networks," Scientometrics, Springer;Akadémiai Kiadó, vol. 49(1), pages 81-91, August.
    15. Blaise Cronin & Debora Shaw, 2002. "Identity-creators and image-makers: Using citation analysis and thick description to put authors in their place," Scientometrics, Springer;Akadémiai Kiadó, vol. 54(1), pages 31-49, April.
    16. Kun Lu & Isola Ajiferuke & Dietmar Wolfram, 2014. "Extending citer analysis to journal impact evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 100(1), pages 245-260, July.
    17. Anthony F. J. van Raan, 2005. "Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods," Scientometrics, Springer;Akadémiai Kiadó, vol. 62(1), pages 133-143, January.
    18. Tibor Braun & Wolfgang Glänzel & András Schubert, 2006. "A Hirsch-type index for journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 69(1), pages 169-173, October.
    19. Franceschet, Massimo, 2010. "Journal influence factors," Journal of Informetrics, Elsevier, vol. 4(3), pages 239-248.
    20. Ken Hyland, 2003. "Self‐citation and self‐reference: Credibility and promotion in academic publication," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 54(3), pages 251-259, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. M. Ryan Haley & M. Kevin McGee, 2023. "A flexible functional method for jointly valuing journal visibility and author citation count," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(6), pages 3337-3346, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Martin Szomszor & David A. Pendlebury & Jonathan Adams, 2020. "How much is too much? The difference between research influence and self-citation excess," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(2), pages 1119-1147, May.
    2. Mathieu Leblond, 2012. "Author self-citations in the field of ecology," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(3), pages 943-953, June.
    3. Hui Li & Weishu Liu, 2020. "Same same but different: self-citations identified through Scopus and Web of Science Core Collection," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(3), pages 2723-2732, September.
    4. Mingkun Wei, 2020. "Research on impact evaluation of open access journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(2), pages 1027-1049, February.
    5. Abramo, Giovanni & D'Angelo, Ciriaco Andrea & Grilli, Leonardo, 2021. "The effects of citation-based research evaluation schemes on self-citation behavior," Journal of Informetrics, Elsevier, vol. 15(4).
    6. A. Velez-Estevez & P. García-Sánchez & J. A. Moral-Munoz & M. J. Cobo, 2022. "Why do papers from international collaborations get more citations? A bibliometric analysis of Library and Information Science papers," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 7517-7555, December.
    7. Mingers, John & Yang, Liying, 2017. "Evaluating journal quality: A review of journal citation indicators and ranking in business and management," European Journal of Operational Research, Elsevier, vol. 257(1), pages 323-337.
    8. Bar-Ilan, Judit, 2008. "Informetrics at the beginning of the 21st century—A review," Journal of Informetrics, Elsevier, vol. 2(1), pages 1-52.
    9. Ibrahim Shehatta & Abdullah M. Al-Rubaish, 2019. "Impact of country self-citations on bibliometric indicators and ranking of most productive countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(2), pages 775-791, August.
    10. Petersen, Alexander M. & Pan, Raj K. & Pammolli, Fabio & Fortunato, Santo, 2019. "Methods to account for citation inflation in research evaluation," Research Policy, Elsevier, vol. 48(7), pages 1855-1865.
    11. Ajiferuke, Isola & Lu, Kun & Wolfram, Dietmar, 2011. "Who are the research disciples of an author? Examining publication recitation and oeuvre citation exhaustivity," Journal of Informetrics, Elsevier, vol. 5(2), pages 292-302.
    12. Mingers, John & Leydesdorff, Loet, 2015. "A review of theory and practice in scientometrics," European Journal of Operational Research, Elsevier, vol. 246(1), pages 1-19.
    13. Danielle H. Lee, 2019. "Predictive power of conference-related factors on citation rates of conference papers," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(1), pages 281-304, January.
    14. Iman Tahamtan & Askar Safipour Afshar & Khadijeh Ahamdzadeh, 2016. "Factors affecting number of citations: a comprehensive review of the literature," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(3), pages 1195-1225, June.
    15. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    16. Leydesdorff, Loet & Bornmann, Lutz & Marx, Werner & Milojević, Staša, 2014. "Referenced Publication Years Spectroscopy applied to iMetrics: Scientometrics, Journal of Informetrics, and a relevant subset of JASIST," Journal of Informetrics, Elsevier, vol. 8(1), pages 162-174.
    17. Cappelletti-Montano, Beniamino & Columbu, Silvia & Montaldo, Stefano & Musio, Monica, 2021. "New perspectives in bibliometric indicators: Moving from citations to citing authors," Journal of Informetrics, Elsevier, vol. 15(3).
    18. Ziqiang Zeng & Lantian Shi, 2021. "A two-dimensional journal classification method based on output and input factors: perspectives from citation and authorship related indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(5), pages 3929-3964, May.
    19. Pu Han & Jin Shi & Xiaoyan Li & Dongbo Wang & Si Shen & Xinning Su, 2014. "International collaboration in LIS: global trends and networks at the country and institution level," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(1), pages 53-72, January.
    20. Isola Ajiferuke & Dietmar Wolfram, 2010. "Citer analysis as a measure of research impact: library and information science as a case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 83(3), pages 623-638, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:126:y:2021:i:3:d:10.1007_s11192-020-03850-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.