IDEAS home Printed from https://ideas.repec.org/a/eee/infome/v18y2024i1s1751157724000075.html
   My bibliography  Save this article

“I'd like to publish in Q1, but there's no Q1 to be found”: Study of journal quartile distributions across subject categories and topics

Author

Listed:
  • Kosyakov, Denis
  • Pislyakov, Vladimir

Abstract

The choice to focus on a journal's impact factor, or its quartile, in authoritative rankings, when deciding where to publish research results can be driven by various reasons. These may include personal prestige, enhancing the appeal of a CV, the desire to increase publication-related rewards, meeting the conditions of scientific funds, or fulfilling qualification requirements. While these considerations deviate from the “pure science” perspective, the fact is that they are widely adopted. Our research demonstrates that the conventional division into journal quartiles may privilege certain disciplinary categories while disadvantaging others. Disciplinary categories in Journal Citation Reports (JCR) and similar rankings are imbalanced in terms of the number of articles across different journal quartiles. This is attributable to three factors: the distribution of journals across quartiles, the varying volume of journals, and the selection of the highest quartile when journals are categorized under multiple disciplines. Narrower research areas, such as Topic Clusters from SciVal, may completely lack Q1 journals dedicated to them, or even any such journals at all. This finding might also interest publishers when selecting topics for launching new titles. The apparent inequality between disciplines unveiled in our study offers a new perspective to argue against the use of quartile metrics, at least in a straightforward manner, when evaluating performance and shaping science policies.

Suggested Citation

  • Kosyakov, Denis & Pislyakov, Vladimir, 2024. "“I'd like to publish in Q1, but there's no Q1 to be found”: Study of journal quartile distributions across subject categories and topics," Journal of Informetrics, Elsevier, vol. 18(1).
    • Handle: RePEc:eee:infome:v:18:y:2024:i:1:s1751157724000075
    DOI: 10.1016/j.joi.2024.101494
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1751157724000075
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.joi.2024.101494?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Tatiana Lisitskaya & Pavel Taranov & Ekaterina Ugnich & Vladimir Pislyakov, 2024. "Pillar Universities in Russia: Bibliometrics of ‘the second best’," Quality & Quantity: International Journal of Methodology, Springer, vol. 58(1), pages 365-383, February.
    2. Klavans, Richard & Boyack, Kevin W., 2017. "Research portfolio analysis and topic prominence," Journal of Informetrics, Elsevier, vol. 11(4), pages 1158-1174.
    3. Zaida Chinchilla-Rodríguez & Ricardo Arencibia-Jorge & Félix Moya-Anegón & Elena Corera-Álvarez, 2015. "Somes patterns of Cuban scientific publication in Scopus: the current situation and challenges," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(3), pages 779-794, June.
    4. Guillaume Cabanac, 2012. "Shaping the landscape of research in information systems from the perspective of editorial boards: A scientometric study of 77 leading journals," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 63(5), pages 977-996, May.
    5. Pislyakov, Vladimir, 2022. "On some properties of medians, percentiles, baselines, and thresholds in empirical bibliometric analysis," Journal of Informetrics, Elsevier, vol. 16(4).
    6. Alfonso Ibáñez & Concha Bielza & Pedro Larrañaga, 2013. "Relationship among research collaboration, number of documents and number of citations: a case study in Spanish computer science production in 2000–2009," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(2), pages 689-716, May.
    7. Ruben Miranda & Esther Garcia-Carpintero, 2019. "Comparison of the share of documents and citations from different quartile journals in 25 research areas," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 479-501, October.
    8. Diana Hicks & Paul Wouters & Ludo Waltman & Sarah de Rijcke & Ismael Rafols, 2015. "Bibliometrics: The Leiden Manifesto for research metrics," Nature, Nature, vol. 520(7548), pages 429-431, April.
    9. Frank Havemann & Michael Heinz & Roland Wagner‐Döbler, 2005. "Firm‐like behavior of journals? Scaling properties of their output and impact growth dynamics," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 56(1), pages 3-12, January.
    10. Mike Thelwall & Kayvan Kousha & Meiko Makita & Mahshid Abdoli & Emma Stuart & Paul Wilson & Jonathan Levitt, 2023. "In which fields do higher impact journals publish higher quality articles?," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(7), pages 3915-3933, July.
    11. Manh-Toan Ho & Ngoc-Thang B. Le & Manh-Tung Ho & Quan-Hoang Vuong, 2022. "A bibliometric review on development economics research in Vietnam from 2008 to 2020," Quality & Quantity: International Journal of Methodology, Springer, vol. 56(5), pages 2939-2969, October.
    12. Guillaume Cabanac, 2012. "Shaping the landscape of research in information systems from the perspective of editorial boards: A scientometric study of 77 leading journals," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(5), pages 977-996, May.
    13. Giovanni Abramo & Ciriaco Andrea D’Angelo & Flavia Costa, 2023. "Correlating article citedness and journal impact: an empirical investigation by field on a large-scale dataset," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(3), pages 1877-1894, March.
    14. Weishu Liu & Guangyuan Hu & Mengdi Gu, 2016. "The probability of publishing in first-quartile journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(3), pages 1273-1276, March.
    15. Huang, Ding-wei, 2016. "Positive correlation between quality and quantity in academic journals," Journal of Informetrics, Elsevier, vol. 10(2), pages 329-335.
    16. Juan Miguel Campanario & William Cabos, 2014. "The effect of additional citations in the stability of Journal Citation Report categories," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 1113-1130, February.
    17. Dejan Pajić, 2015. "Globalization of the social sciences in Eastern Europe: genuine breakthrough or a slippery slope of the research evaluation practice?," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(3), pages 2131-2150, March.
    18. Pajić, Dejan, 2015. "On the stability of citation-based journal rankings," Journal of Informetrics, Elsevier, vol. 9(4), pages 990-1006.
    19. Zaida Chinchilla-Rodríguez & Grisel Zacca-González & Benjamín Vargas-Quesada & Félix Moya-Anegón, 2016. "Benchmarking scientific performance by decomposing leadership of Cuban and Latin American institutions in Public Health," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(3), pages 1239-1264, March.
    20. Denis Kosyakov & Andrey Guskov, 2022. "Reasons and consequences of changes in Russian research assessment policies," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(8), pages 4609-4630, August.
    21. Siler, Kyle & Larivière, Vincent, 2022. "Who games metrics and rankings? Institutional niches and journal impact factor inflation," Research Policy, Elsevier, vol. 51(10).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ruben Miranda & Esther Garcia-Carpintero, 2019. "Comparison of the share of documents and citations from different quartile journals in 25 research areas," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 479-501, October.
    2. Shannon Mason & Lenandlar Singh, 2022. "When a journal is both at the ‘top’ and the ‘bottom’: the illogicality of conflating citation-based metrics with quality," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3683-3694, June.
    3. Zsolt Kohus & Márton Demeter & László Kun & Eszter Lukács & Katalin Czakó & Gyula Péter Szigeti, 2022. "A Study of the Relation between Byline Positions of Affiliated/Non-Affiliated Authors and the Scientific Impact of European Universities in Times Higher Education World University Rankings," Sustainability, MDPI, vol. 14(20), pages 1-14, October.
    4. Gabriel-Alexandru Vîiu & Mihai Păunescu, 2021. "The citation impact of articles from which authors gained monetary rewards based on journal metrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 4941-4974, June.
    5. Gabriel-Alexandru Vȋiu & Mihai Păunescu, 2021. "The lack of meaningful boundary differences between journal impact factor quartiles undermines their independent use in research evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1495-1525, February.
    6. Katchanov, Yurij L. & Markova, Yulia V. & Shmatko, Natalia A., 2023. "Uncited papers in the structure of scientific communication," Journal of Informetrics, Elsevier, vol. 17(2).
    7. Eduardo Kunzel Teixeira & Mirian Oliveira, 2018. "Editorial board interlocking in knowledge management and intellectual capital research field," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(3), pages 1853-1869, December.
    8. Juan Miguel Campanario, 2018. "Are leaders really leading? Journals that are first in Web of Science subject categories in the context of their groups," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(1), pages 111-130, April.
    9. András Schubert, 2017. "Power positions in cardiology publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(3), pages 1721-1743, September.
    10. Weishu Liu & Guangyuan Hu & Mengdi Gu, 2016. "The probability of publishing in first-quartile journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(3), pages 1273-1276, March.
    11. Zsolt Kohus & Márton Demeter & Gyula Péter Szigeti & László Kun & Eszter Lukács & Katalin Czakó, 2022. "The Influence of International Collaboration on the Scientific Impact in V4 Countries," Publications, MDPI, vol. 10(4), pages 1-13, September.
    12. Fabio Lorensi Canto & Adilson Luiz Pinto & Edson Mário Gavron & Marcos Talau, 2022. "Latin American and Caribbean journals indexed in Google Scholar Metrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(2), pages 763-783, February.
    13. Alfonso Ibáñez & Concha Bielza & Pedro Larrañaga, 2013. "Relationship among research collaboration, number of documents and number of citations: a case study in Spanish computer science production in 2000–2009," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(2), pages 689-716, May.
    14. Luis de-Marcos & Manuel Goyanes & Adrián Domínguez-Díaz, 2024. "Mapping science through editorial board interlocking: connections and distance between fields of knowledge and institutional affiliations," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(6), pages 3385-3406, June.
    15. Raminta Pranckutė, 2021. "Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World," Publications, MDPI, vol. 9(1), pages 1-59, March.
    16. Siler, Kyle & Larivière, Vincent, 2022. "Who games metrics and rankings? Institutional niches and journal impact factor inflation," Research Policy, Elsevier, vol. 51(10).
    17. Sümeyye Akça & Özlem Şenyurt, 2023. "Geographical representation of editorial boards: a review in the field of library and information sciences," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(2), pages 1409-1427, February.
    18. Guillaume Cabanac, 2013. "Experimenting with the partnership ability φ-index on a million computer scientists," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(1), pages 1-9, July.
    19. Alfirević Nikša & Pavičić Jurica & Rendulić Darko, 2023. "A Bibliometric Analysis of Public Business School Scientific Productivity and Impact in South-East Europe (2017-2021)," South East European Journal of Economics and Business, Sciendo, vol. 18(1), pages 27-45, June.
    20. Ying Huang & Donghua Zhu & Qi Lv & Alan L. Porter & Douglas K. R. Robinson & Xuefeng Wang, 2017. "Early insights on the Emerging Sources Citation Index (ESCI): an overlay map-based bibliometric study," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(3), pages 2041-2057, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:infome:v:18:y:2024:i:1:s1751157724000075. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/joi .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.