IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v87y2011i1d10.1007_s11192-010-0333-2.html
   My bibliography  Save this article

Effect on the journal impact factor of the number and document type of citing records: a wide-scale study

Author

Listed:
  • Juan Miguel Campanario

    (Universidad de Alcalá)

  • Jesús Carretero

    (Universidad de Alcalá)

  • Vera Marangon

    (Facultad de Ciencias Económicas, Universidad de Alcalá)

  • Antonio Molina

    (Universidad de Alcalá)

  • Germán Ros

    (Universidad de Alcalá)

Abstract

We studied the effect on journal impact factors (JIF) of citations from documents labeled as articles and reviews (usually peer reviewed) versus citations coming from other documents. In addition, we studied the effect on JIF of the number of citing records. This number is usually different from the number of citations. We selected a set of 700 journals indexed in the SCI section of JCR that receive a low number of citations. The reason for this choice is that in these instances some citations may have a greater impact on the JIF than in more highly-cited journals. After excluding some journals for different reasons, our sample consisted of 674 journals. We obtained data on citations that contributed to the JIF for the years 1998–2006. In general, we found that most journals obtained citations that contribute to the impact factor from documents labeled as articles and reviews. In addition, in most of journals the ratio between citations that contributed to the impact factor and citing records was greater than 80% in all years. Thus, in general, we did not find evidence that citations that contributed to the impact factor were dependent on non-peer reviewed documents or only a few citing records.

Suggested Citation

  • Juan Miguel Campanario & Jesús Carretero & Vera Marangon & Antonio Molina & Germán Ros, 2011. "Effect on the journal impact factor of the number and document type of citing records: a wide-scale study," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(1), pages 75-84, April.
    • Handle: RePEc:spr:scient:v:87:y:2011:i:1:d:10.1007_s11192-010-0333-2
    DOI: 10.1007/s11192-010-0333-2
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-010-0333-2
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-010-0333-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lidia González & Juan Miguel Campanario, 2007. "Structure of the impact factor of journals included in the Social Sciences Citation Index: Citations from documents labeled “editorial material”," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 58(2), pages 252-262, January.
    2. Juan Miguel Campanario & Lidia González & Cristina Rodríguez, 2006. "Structure of the impact factor of academic journals in the field of Education and Educational Psychology: Citations from editorial board members," Scientometrics, Springer;Akadémiai Kiadó, vol. 69(1), pages 37-56, October.
    3. Wolfgang Glänzel & Henk F. Moed, 2002. "Journal impact measures in bibliometric research," Scientometrics, Springer;Akadémiai Kiadó, vol. 53(2), pages 171-193, February.
    4. Juan Miguel Campanario & Antonio Molina, 2009. "Surviving bad times: The role of citations, self-citations and numbers of citable items in recovery of the journal impact factor after at least four years of continuous decreases," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(3), pages 859-864, December.
    5. Juan Miguel Campanario & Lidia González, 2006. "Journal self-citations that contribute to the impact factor: Documents labeled “editorial material” in journals covered by the Science Citation Index," Scientometrics, Springer;Akadémiai Kiadó, vol. 69(2), pages 365-386, November.
    6. Éric Archambault & Vincent Larivière, 2009. "History of the journal impact factor: Contingencies and consequences," Scientometrics, Springer;Akadémiai Kiadó, vol. 79(3), pages 635-649, June.
    7. Antonia Andrade & Raúl González-Jonte & Juan Miguel Campanario, 2009. "Journals that increase their impact factor at least fourfold in a few years: The role of journal self-citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 80(2), pages 515-528, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Daniel Torres-Salinas & Nicolás Robinson-García & Álvaro Cabezas-Clavijo & Evaristo Jiménez-Contreras, 2014. "Analyzing the citation characteristics of books: edited books, book series and publisher types in the book citation index," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(3), pages 2113-2127, March.
    2. David A. Pendlebury & Jonathan Adams, 2012. "Comments on a critique of the Thomson Reuters journal impact factor," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 395-401, August.
    3. Jerome K. Vanclay, 2012. "Impact factor: outdated artefact or stepping-stone to journal certification?," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 211-238, August.
    4. Thed Leeuwen & Rodrigo Costas & Clara Calero-Medina & Martijn Visser, 2013. "The role of editorial material in bibliometric research performance assessments," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(2), pages 817-828, May.
    5. Melika Mosleh & Saeed Roshani & Mario Coccia, 2022. "Scientific laws of research funding to support citations and diffusion of knowledge in life science," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(4), pages 1931-1951, April.
    6. Sánchez-Gil, Susana & Gorraiz, Juan & Melero-Fuentes, David, 2018. "Reference density trends in the major disciplines," Journal of Informetrics, Elsevier, vol. 12(1), pages 42-58.
    7. R. G. Raj & A. N. Zainab, 2012. "Relative measure index: a metric to measure the quality of journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 93(2), pages 305-317, November.
    8. Hou, Jianhua & Yang, Xiucai, 2020. "Social media-based sleeping beauties: Defining, identifying and features," Journal of Informetrics, Elsevier, vol. 14(2).
    9. Fei-Cheng Ma & Peng-Hui Lyu & Qiang Yao & Lan Yao & Shi-Jing Zhang, 2014. "Publication trends and knowledge maps of global translational medicine research," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(1), pages 221-246, January.
    10. Anne-Wil Harzing, 2013. "Document categories in the ISI Web of Knowledge: Misunderstanding the Social Sciences?," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(1), pages 23-34, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Antonia Andrade & Raúl González-Jonte & Juan Miguel Campanario, 2009. "Journals that increase their impact factor at least fourfold in a few years: The role of journal self-citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 80(2), pages 515-528, August.
    2. Juan Miguel Campanario & Antonio Molina, 2009. "Surviving bad times: The role of citations, self-citations and numbers of citable items in recovery of the journal impact factor after at least four years of continuous decreases," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(3), pages 859-864, December.
    3. Jerome K. Vanclay, 2012. "Impact factor: outdated artefact or stepping-stone to journal certification?," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 211-238, August.
    4. Francisco González-Sala & Julia Osca-Lluch & Julia Haba-Osca, 2019. "Are journal and author self-citations a visibility strategy?," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(3), pages 1345-1364, June.
    5. Juan Miguel Campanario, 2010. "Distribution of changes in impact factors over time," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(1), pages 35-42, July.
    6. Giovanni Abramo & Ciriaco Andrea D’Angelo & Flavia Costa, 2023. "Correlating article citedness and journal impact: an empirical investigation by field on a large-scale dataset," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(3), pages 1877-1894, March.
    7. William Cabos & Juan Miguel Campanario, 2018. "Exploring the Hjif-Index, an Analogue to the H-Like Index for Journal Impact Factors," Publications, MDPI, vol. 6(2), pages 1-11, April.
    8. Juan Miguel Campanario, 2014. "The effect of citations on the significance of decimal places in the computation of journal impact factors," Scientometrics, Springer;Akadémiai Kiadó, vol. 99(2), pages 289-298, May.
    9. Tingcan Ma & Gui-Fang Wang & Ke Dong & Mukun Cao, 2012. "The Journal’s Integrated Impact Index: a new indicator for journal evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 90(2), pages 649-658, February.
    10. Victoria Bakare & Grant Lewison, 2017. "Country over-citation ratios," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(2), pages 1199-1207, November.
    11. Guillaume Cabanac, 2012. "Shaping the landscape of research in information systems from the perspective of editorial boards: A scientometric study of 77 leading journals," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 63(5), pages 977-996, May.
    12. Juan Miguel Campanario, 2018. "Journals that Rise from the Fourth Quartile to the First Quartile in Six Years or Less: Mechanisms of Change and the Role of Journal Self-Citations," Publications, MDPI, vol. 6(4), pages 1-15, November.
    13. Xindi Wang & Zeshui Xu & Xinxin Wang & Marinko Skare, 2022. "A review of inflation from 1906 to 2022: a comprehensive analysis of inflation studies from a global perspective," Oeconomia Copernicana, Institute of Economic Research, vol. 13(3), pages 595-631, September.
    14. Juan Gorraiz & Ursula Ulrych & Wolfgang Glänzel & Wenceslao Arroyo-Machado & Daniel Torres-Salinas, 2022. "Measuring the excellence contribution at the journal level: an alternative to Garfield’s impact factor," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 7229-7251, December.
    15. Juan Miguel Campanario, 2011. "Empirical study of journal impact factors obtained using the classical two-year citation window versus a five-year citation window," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(1), pages 189-204, April.
    16. Derek R. Smith, 2012. "Impact factors, scientometrics and the history of citation-based research," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 419-427, August.
    17. Kun Lu & Isola Ajiferuke & Dietmar Wolfram, 2014. "Extending citer analysis to journal impact evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 100(1), pages 245-260, July.
    18. Sergio Copiello, 2020. "The alleged citation advantage of video abstracts may be a matter of self-citations and self-selection bias. Comment on “The impact of video abstract on citation counts” by Zong et al," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(1), pages 751-757, January.
    19. Antonio García Romero & José Navarrete Cortés & Cristina Escudero & Juan Antonio Fernández López & Juan Antonio Chaichío Moreno, 2009. "Measuring the influence of clinical trials citations on several bibliometric indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 80(3), pages 747-760, September.
    20. Mingyang Wang & Shijia Jiao & Kah-Hin Chai & Guangsheng Chen, 2019. "Building journal’s long-term impact: using indicators detected from the sustained active articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 261-283, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:87:y:2011:i:1:d:10.1007_s11192-010-0333-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.