IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v128y2023i10d10.1007_s11192-023-04809-z.html
   My bibliography  Save this article

So, what if a journal is both at the ‘top’ and ‘bottom’: reply to Mason and Singh

Author

Listed:
  • Jeremiah Joven Joaquin

    (De La Salle University)

  • Raymond R. Tan

    (De La Salle University
    De La Salle University)

  • Hazel T. Biana

    (De La Salle University)

Abstract

In a recent paper in this journal, Mason and Singh (Scientometrics 127:3683–3694, 2022) argue that since there are cases where a research paper is published in an academic journal that is ‘top-ranked’ in one subject category (or research area) but ‘bottom-ranked’ in another (based on some citation-based metric such as SCImago Journal Rankings (SJR) or Journal Citation Reports (JCR)), it follows that it is illogical to use such rankings as a proxy for research quality, impact, and prestige. They conclude that using such rankings for academic hiring, tenure, promotion, and funding is likewise illogical. In this discussion note, we argue that while their premise is true, their conclusion is a non sequitur.

Suggested Citation

  • Jeremiah Joven Joaquin & Raymond R. Tan & Hazel T. Biana, 2023. "So, what if a journal is both at the ‘top’ and ‘bottom’: reply to Mason and Singh," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(10), pages 5859-5863, October.
    • Handle: RePEc:spr:scient:v:128:y:2023:i:10:d:10.1007_s11192-023-04809-z
    DOI: 10.1007/s11192-023-04809-z
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-023-04809-z
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-023-04809-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Meredith T Niles & Lesley A Schimanski & Erin C McKiernan & Juan Pablo Alperin, 2020. "Why we publish where we do: Faculty publishing values and their relationship to review, promotion and tenure expectations," PLOS ONE, Public Library of Science, vol. 15(3), pages 1-15, March.
    2. Guerrero-Bote, Vicente P. & Moya-Anegón, Félix, 2012. "A further step forward in measuring journals’ scientific prestige: The SJR2 indicator," Journal of Informetrics, Elsevier, vol. 6(4), pages 674-688.
    3. Mason, Shannon & Merga, Margaret K. & González Canché, Manuel S. & Mat Roni, Saiyidi, 2021. "The internationality of published higher education scholarship: How do the ‘top’ journals compare?," Journal of Informetrics, Elsevier, vol. 15(2).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Shannon Mason & Lenandlar Singh, 2022. "When a journal is both at the ‘top’ and the ‘bottom’: the illogicality of conflating citation-based metrics with quality," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3683-3694, June.
    2. Bornmann, Lutz & Leydesdorff, Loet & Wang, Jian, 2014. "How to improve the prediction based on citation impact percentiles for years shortly after the publication date?," Journal of Informetrics, Elsevier, vol. 8(1), pages 175-180.
    3. Aleš LEBEDA & Věra Kroftová & Václav KŮDELA & Marcela BRAUNOVÁ, 2014. "Fifty-year anniversary of Plant Protection Science," Plant Protection Science, Czech Academy of Agricultural Sciences, vol. 50(2), pages 53-63.
    4. Walters, William H., 2017. "Do subjective journal ratings represent whole journals or typical articles? Unweighted or weighted citation impact?," Journal of Informetrics, Elsevier, vol. 11(3), pages 730-744.
    5. Dejian Yu & Wanru Wang & Shuai Zhang & Wenyu Zhang & Rongyu Liu, 2017. "A multiple-link, mutually reinforced journal-ranking model to measure the prestige of journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(1), pages 521-542, April.
    6. Thor, Andreas & Marx, Werner & Leydesdorff, Loet & Bornmann, Lutz, 2016. "Introducing CitedReferencesExplorer (CRExplorer): A program for reference publication year spectroscopy with cited references standardization," Journal of Informetrics, Elsevier, vol. 10(2), pages 503-515.
    7. Ruhua Huang & Yuting Huang & Fan Qi & Leyi Shi & Baiyang Li & Wei Yu, 2022. "Exploring the characteristics of special issues: distribution, topicality, and citation impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(9), pages 5233-5256, September.
    8. Zoltán Krajcsák, 2021. "Researcher Performance in Scopus Articles ( RPSA ) as a New Scientometric Model of Scientific Output: Tested in Business Area of V4 Countries," Publications, MDPI, vol. 9(4), pages 1-23, October.
    9. Рубинштейн Александр Яковлевич, "undated". "Ранжирование Российских Экономических Журналов: Научный Метод Или «Игра В Цыфирь»? [Ran Ranking of Russian Economic Journals: The Scientific Method or “Numbers Game”?]," Working papers a:pru175:ye:2016:1, Institute of Economics.
    10. Jing Li & Qiushuang Long & Xiaoli Lu & Dengsheng Wu, 2023. "Citation beneficiaries of discipline-specific mega-journals: who and how much," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-10, December.
    11. Schmal, W. Benedikt & Haucap, Justus & Knoke, Leon, 2023. "The role of gender and coauthors in academic publication behavior," Research Policy, Elsevier, vol. 52(10).
    12. Judit Bar-Ilan & Mark Levene, 2015. "The hw-rank: an h-index variant for ranking web pages," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(3), pages 2247-2253, March.
    13. Félix Moya-Anegón & Vicente P. Guerrero-Bote & Lutz Bornmann & Henk F. Moed, 2013. "The research guarantors of scientific papers and the output counting: a promising new approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(2), pages 421-434, November.
    14. Chang, Yu-Wei, 2022. "Capability of non-English-speaking countries for securing a foothold in international journal publishing," Journal of Informetrics, Elsevier, vol. 16(3).
    15. Mingkun Wei, 2020. "Research on impact evaluation of open access journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(2), pages 1027-1049, February.
    16. Najko Jahn & Lisa Matthias & Mikael Laakso, 2022. "Toward transparency of hybrid open access through publisher‐provided metadata: An article‐level study of Elsevier," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 73(1), pages 104-118, January.
    17. Mingers, John & Yang, Liying, 2017. "Evaluating journal quality: A review of journal citation indicators and ranking in business and management," European Journal of Operational Research, Elsevier, vol. 257(1), pages 323-337.
    18. Zhang, Fang & Wu, Shengli, 2020. "Predicting future influence of papers, researchers, and venues in a dynamic academic network," Journal of Informetrics, Elsevier, vol. 14(2).
    19. Asier Minondo, 2022. "Comments are welcome," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(3), pages 1565-1582, March.
    20. Hendrik P. Dalen, 2021. "How the publish-or-perish principle divides a science: the case of economists," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1675-1694, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:128:y:2023:i:10:d:10.1007_s11192-023-04809-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.