IDEAS home Printed from https://ideas.repec.org/a/gam/jpubli/v6y2018i4p47-d185530.html
   My bibliography  Save this article

Journals that Rise from the Fourth Quartile to the First Quartile in Six Years or Less: Mechanisms of Change and the Role of Journal Self-Citations

Author

Listed:
  • Juan Miguel Campanario

    (Departamento de Física y Matemáticas, Universidad de Alcalá, Alcalá de Henares, 28871 Madrid, Spain)

Abstract

Journal self-citations may be increased artificially to inflate a journal’s scientometric indicators. The aim of this study was to identify possible mechanisms of change in a cohort of journals that rose from the fourth (Q4) to the first quartile (Q1) over six years or less in Journal Citation Reports (JCR), and the role of journal self-citations in these changes. A total of 51 different journals sampled from all JCR Science Citation Index (SCI) subject categories improved their rank position from Q4 in 2009 to Q1 in any year from 2010 to 2015. I identified changes in the numerator or denominator of the Journal Impact Factor (JIF) that were involved in each year-to-year transition. The main mechanism of change was the increase in the number of citations used to compute the JIF. The effect of journal self-citations in the increase of the JIF was studied. The main conclusion is that there was no evidence of widespread JIF manipulation through the overuse of journal self-citations.

Suggested Citation

  • Juan Miguel Campanario, 2018. "Journals that Rise from the Fourth Quartile to the First Quartile in Six Years or Less: Mechanisms of Change and the Role of Journal Self-Citations," Publications, MDPI, vol. 6(4), pages 1-15, November.
    • Handle: RePEc:gam:jpubli:v:6:y:2018:i:4:p:47-:d:185530
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2304-6775/6/4/47/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2304-6775/6/4/47/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Lidia González & Juan Miguel Campanario, 2007. "Structure of the impact factor of journals included in the Social Sciences Citation Index: Citations from documents labeled “editorial material”," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 58(2), pages 252-262, January.
    2. Antonia Ferrer-Sapena & Susana Díaz-Novillo & Enrique A. Sánchez-Pérez, 2017. "Measuring Time-Dynamics and Time-Stability of Journal Rankings in Mathematics and Physics by Means of Fractional p -Variations," Publications, MDPI, vol. 5(3), pages 1-14, September.
    3. Ju-fang Shao & Hui-yun Shen, 2012. "Research assessment and monetary rewards: the overemphasized impact factor in China," Research Evaluation, Oxford University Press, vol. 21(3), pages 199-203, June.
    4. Claudiu Herteliu & Marcel Ausloos & Bogdan Vasile Ileanu & Giulia Rotundo & Tudorel Andrei, 2017. "Quantitative and Qualitative Analysis of Editor Behavior through Potentially Coercive Citations," Publications, MDPI, vol. 5(2), pages 1-16, June.
    5. Yu, Tian & Yu, Guang & Wang, Ming-Yang, 2014. "Classification method for detecting coercive self-citation in journals," Journal of Informetrics, Elsevier, vol. 8(1), pages 123-135.
    6. Stefan N. Groesser, 2012. "Dynamics of Journal Impact Factors," Systems Research and Behavioral Science, Wiley Blackwell, vol. 29(6), pages 624-644, November.
    7. Alexander I. Pudovkin & Eugene Garfield, 2002. "Algorithmic procedure for finding semantically related journals," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 53(13), pages 1113-1119, November.
    8. Min Song & SuYeon Kim & Keeheon Lee, 2017. "Ensemble analysis of topical journal ranking in bioinformatics," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(6), pages 1564-1583, June.
    9. Jaroslav Fiala & Jiří J. Mareš & Jaroslav Šesták, 2017. "Reflections on how to evaluate the professional value of scientific papers and their corresponding citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(1), pages 697-709, July.
    10. Dong-Hui Yang & Xin Li & Xiaoxia Sun & Jie Wan, 2016. "Detecting impact factor manipulation with data mining techniques," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 1989-2005, December.
    11. Michael Mimouni & Motti Ratmansky & Yaron Sacher & Sharon Aharoni & Aviva Mimouni-Bloch, 2016. "Self-citation rate and impact factor in pediatrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(3), pages 1455-1460, September.
    12. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    13. Guang Yu & Liang Wang, 2007. "The self-cited rate of scientific journals and the manipulation of their impact factors," Scientometrics, Springer;Akadémiai Kiadó, vol. 73(3), pages 321-330, December.
    14. Steven M. Shugan, 2002. "The Mission of Marketing Science," Marketing Science, INFORMS, vol. 21(1), pages 1-13.
    15. Daniel Teodorescu & Tudorel Andrei, 2014. "An examination of “citation circles” for social sciences journals in Eastern European countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 99(2), pages 209-231, May.
    16. Juan Miguel Campanario, 2011. "Large increases and decreases in journal impact factors in only one year: The effect of journal self-citations," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(2), pages 230-235, February.
    17. R. Rousseau, 1999. "Temporal differences in self-citation rates of scientific journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 44(3), pages 521-531, March.
    18. Tobias Kiesslich & Silke B Weineck & Dorothea Koelblinger, 2016. "Reasons for Journal Impact Factor Changes: Influence of Changing Source Items," PLOS ONE, Public Library of Science, vol. 11(4), pages 1-12, April.
    19. Loet Leydesdorff & Lutz Bornmann, 2016. "The operationalization of “fields” as WoS subject categories (WCs) in evaluative bibliometrics: The cases of “library and information science” and “science & technology studies”," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(3), pages 707-714, March.
    20. Lutz Bornmann & Robin Haunschild, 2017. "Measuring field-normalized impact of papers on specific societal groups: An altmetrics study based on Mendeley Data," Research Evaluation, Oxford University Press, vol. 26(3), pages 230-241.
    21. Bluma C. Peritz & Judit Bar-Ilan, 2002. "The sources used by bibliometrics-scientometrics as reflected in references," Scientometrics, Springer;Akadémiai Kiadó, vol. 54(2), pages 269-284, June.
    22. Antonia Andrade & Raúl González-Jonte & Juan Miguel Campanario, 2009. "Journals that increase their impact factor at least fourfold in a few years: The role of journal self-citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 80(2), pages 515-528, August.
    23. Loet Leydesdorff & Ismael Rafols, 2009. "A global map of science based on the ISI subject categories," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 60(2), pages 348-362, February.
    24. Juan Miguel Campanario, 2011. "Large increases and decreases in journal impact factors in only one year: The effect of journal self‐citations," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(2), pages 230-235, February.
    25. Lutz Bornmann, 2017. "Confidence intervals for Journal Impact Factors," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(3), pages 1869-1871, June.
    26. Petr Heneberg, 2014. "Parallel worlds of citable documents and others: Inflated commissioned opinion articles enhance scientometric indicators," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 65(3), pages 635-643, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yangping Zhou, 2021. "Self-citation and citation of top journal publishers and their interpretation in the journal-discipline context," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 6013-6040, July.
    2. Chang, Yu-Wei, 2022. "Capability of non-English-speaking countries for securing a foothold in international journal publishing," Journal of Informetrics, Elsevier, vol. 16(3).
    3. Minxian Zheng & Kuangji Zhao & Shikui Zhao & Yantong Zhang, 2020. "Effecting variables of journal’s ranking in forestry field," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 135-151, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Martin Szomszor & David A. Pendlebury & Jonathan Adams, 2020. "How much is too much? The difference between research influence and self-citation excess," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(2), pages 1119-1147, May.
    2. Juan Miguel Campanario, 2018. "Are leaders really leading? Journals that are first in Web of Science subject categories in the context of their groups," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(1), pages 111-130, April.
    3. Mingyang Wang & Shijia Jiao & Kah-Hin Chai & Guangsheng Chen, 2019. "Building journal’s long-term impact: using indicators detected from the sustained active articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 261-283, October.
    4. Dong-Hui Yang & Xin Li & Xiaoxia Sun & Jie Wan, 2016. "Detecting impact factor manipulation with data mining techniques," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 1989-2005, December.
    5. Jerome K. Vanclay, 2012. "Impact factor: outdated artefact or stepping-stone to journal certification?," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 211-238, August.
    6. Yu-Wei Chang, 2019. "Are articles in library and information science (LIS) journals primarily contributed to by LIS authors?," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 81-104, October.
    7. Ricardo Arencibia-Jorge & Rosa Lidia Vega-Almeida & José Luis Jiménez-Andrade & Humberto Carrillo-Calvet, 2022. "Evolutionary stages and multidisciplinary nature of artificial intelligence research," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(9), pages 5139-5158, September.
    8. Juan Miguel Campanario, 2017. "JIF-Plots: using plots of citations versus citable items as a tool to study journals and subject categories and discover new scientometric relationships," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(2), pages 1141-1154, November.
    9. Antonia Andrade & Raúl González-Jonte & Juan Miguel Campanario, 2009. "Journals that increase their impact factor at least fourfold in a few years: The role of journal self-citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 80(2), pages 515-528, August.
    10. Gabriel-Alexandru Vȋiu & Mihai Păunescu, 2021. "The lack of meaningful boundary differences between journal impact factor quartiles undermines their independent use in research evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1495-1525, February.
    11. Marcelo Mendoza, 2021. "Differences in Citation Patterns across Areas, Article Types and Age Groups of Researchers," Publications, MDPI, vol. 9(4), pages 1-23, October.
    12. Shu, Fei & Julien, Charles-Antoine & Zhang, Lin & Qiu, Junping & Zhang, Jing & Larivière, Vincent, 2019. "Comparing journal and paper level classifications of science," Journal of Informetrics, Elsevier, vol. 13(1), pages 202-225.
    13. Taşkın, Zehra & Doğan, Güleda & Kulczycki, Emanuel & Zuccala, Alesia Ann, 2021. "Self-Citation Patterns of Journals Indexed in the Journal Citation Reports," Journal of Informetrics, Elsevier, vol. 15(4).
    14. Loet Leydesdorff & Paul Wouters & Lutz Bornmann, 2016. "Professional and citizen bibliometrics: complementarities and ambivalences in the development and use of indicators—a state-of-the-art report," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 2129-2150, December.
    15. Loet Leydesdorff & Lutz Bornmann & Caroline S. Wagner, 2017. "Generating clustered journal maps: an automated system for hierarchical classification," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(3), pages 1601-1614, March.
    16. Pajić, Dejan, 2015. "On the stability of citation-based journal rankings," Journal of Informetrics, Elsevier, vol. 9(4), pages 990-1006.
    17. Juan Miguel Campanario & Jesús Carretero & Vera Marangon & Antonio Molina & Germán Ros, 2011. "Effect on the journal impact factor of the number and document type of citing records: a wide-scale study," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(1), pages 75-84, April.
    18. Rosa Rodriguez-Sánchez & J. A. García & J. Fdez-Valdivia, 2014. "Evolutionary games between subject categories," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(1), pages 869-888, October.
    19. Lin Zhang & Beibei Sun & Fei Shu & Ying Huang, 2022. "Comparing paper level classifications across different methods and systems: an investigation of Nature publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 7633-7651, December.
    20. William Cabos & Juan Miguel Campanario, 2018. "Exploring the Hjif-Index, an Analogue to the H-Like Index for Journal Impact Factors," Publications, MDPI, vol. 6(2), pages 1-11, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jpubli:v:6:y:2018:i:4:p:47-:d:185530. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.