IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v100y2014i1d10.1007_s11192-014-1274-y.html
   My bibliography  Save this article

Extending citer analysis to journal impact evaluation

Author

Listed:
  • Kun Lu

    (University of Oklahoma)

  • Isola Ajiferuke

    (University of Western Ontario)

  • Dietmar Wolfram

    (University of Wisconsin-Milwaukee)

Abstract

The concept of citer analysis investigated earlier by Ajiferuke and Wolfram (In: B. Larsen, J. Leta (eds.) Proceedings of the 12th international conference of the international society for scientometrics and informetrics (ISSI) pp. 798–808, 2009, Scientometrics 83:623–638, 2010) is extended to journals where different citing units (citers, citing articles, citing journals) are compared with the journal impact factor and each other to determine if differences in ranking arise from different measures. The citer measures for the 31 high impact journals studied from information science and library science are significantly correlated, even more so than the earlier citer analysis findings, indicating that there is a close relationship among the different units of measure. Still, notable differences in rankings for the journals examined were evident for the different measures used, especially from either 5-year impact factor or number of citing articles per publication to the number of citing journals per publication. The journals that are adversely affected seem to be those whose citations are concentrated in a few journals. This informed the need to develop a journal citation concentration index, which can serve as a complementary measure to the existing journal impact indices.

Suggested Citation

  • Kun Lu & Isola Ajiferuke & Dietmar Wolfram, 2014. "Extending citer analysis to journal impact evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 100(1), pages 245-260, July.
    • Handle: RePEc:spr:scient:v:100:y:2014:i:1:d:10.1007_s11192-014-1274-y
    DOI: 10.1007/s11192-014-1274-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-014-1274-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-014-1274-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Isola Ajiferuke & Dietmar Wolfram, 2010. "Citer analysis as a measure of research impact: library and information science as a case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 83(3), pages 623-638, June.
    2. Ronald Rousseau, 2012. "Updating the journal impact factor or total overhaul?," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 413-417, August.
    3. Benjamin M. Althouse & Jevin D. West & Carl T. Bergstrom & Theodore Bergstrom, 2009. "Differences in impact factor across fields and over time," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 60(1), pages 27-34, January.
    4. Wolfgang Glänzel & Henk F. Moed, 2002. "Journal impact measures in bibliometric research," Scientometrics, Springer;Akadémiai Kiadó, vol. 53(2), pages 171-193, February.
    5. Allan D. Pratt, 1977. "A measure of class concentration in bibliometrics," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 28(5), pages 285-292, September.
    6. Henk F. Moed & Lisa Colledge & Jan Reedijk & Felix Moya-Anegon & Vicente Guerrero-Bote & Andrew Plume & Mayur Amin, 2012. "Citation-based metrics are appropriate tools in journal assessment provided that they are accurate and used in an informed way," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 367-376, August.
    7. Isola Ajiferuke & Kun Lu & Dietmar Wolfram, 2010. "A comparison of citer and citation-based measure outcomes for multiple disciplines," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 61(10), pages 2086-2096, October.
    8. Isola Ajiferuke & Kun Lu & Dietmar Wolfram, 2010. "A comparison of citer and citation‐based measure outcomes for multiple disciplines," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 61(10), pages 2086-2096, October.
    9. E. Garfield & I. H. Sher, 1963. "New factors in the evaluation of scientific literature through citation indexing," American Documentation, Wiley Blackwell, vol. 14(3), pages 195-201, July.
    10. Michael H. MacRoberts & Barbara R. MacRoberts, 1989. "Problems of citation analysis: A critical review," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 40(5), pages 342-349, September.
    11. Ajiferuke, Isola & Lu, Kun & Wolfram, Dietmar, 2011. "Who are the research disciples of an author? Examining publication recitation and oeuvre citation exhaustivity," Journal of Informetrics, Elsevier, vol. 5(2), pages 292-302.
    12. Éric Archambault & Vincent Larivière, 2009. "History of the journal impact factor: Contingencies and consequences," Scientometrics, Springer;Akadémiai Kiadó, vol. 79(3), pages 635-649, June.
    13. González-Pereira, Borja & Guerrero-Bote, Vicente P. & Moya-Anegón, Félix, 2010. "A new approach to the metric of journals’ scientific prestige: The SJR indicator," Journal of Informetrics, Elsevier, vol. 4(3), pages 379-391.
    14. Fiorenzo Franceschini & Domenico Maisano & Anna Perotti & Andrea Proto, 2010. "Analysis of the ch-index: an indicator to evaluate the diffusion of scientific research output by citers," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(1), pages 203-217, October.
    15. Jerome K. Vanclay, 2012. "Impact factor: outdated artefact or stepping-stone to journal certification?," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 211-238, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Antonio Fernandez-Cano & Inés M. Fernández-Guerrero, 2017. "A multivariate model for evaluating emergency medicine journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 991-1003, February.
    2. Rabishankar Giri & Sabuj Kumar Chaudhuri, 2021. "Ranking journals through the lens of active visibility," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(3), pages 2189-2208, March.
    3. Cappelletti-Montano, Beniamino & Columbu, Silvia & Montaldo, Stefano & Musio, Monica, 2021. "New perspectives in bibliometric indicators: Moving from citations to citing authors," Journal of Informetrics, Elsevier, vol. 15(3).
    4. Ton Mooij, 2015. "Exploring a prototype framework of web-based and peer-reviewed “European Educational Research Quality Indicators” (EERQI)," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(1), pages 1037-1055, January.
    5. Hyoungjoo Park & Dietmar Wolfram, 2017. "An examination of research data sharing and re-use: implications for data citation practice," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(1), pages 443-461, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ziqiang Zeng & Lantian Shi, 2021. "A two-dimensional journal classification method based on output and input factors: perspectives from citation and authorship related indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(5), pages 3929-3964, May.
    2. Ajiferuke, Isola & Lu, Kun & Wolfram, Dietmar, 2011. "Who are the research disciples of an author? Examining publication recitation and oeuvre citation exhaustivity," Journal of Informetrics, Elsevier, vol. 5(2), pages 292-302.
    3. Juan Gorraiz & Ursula Ulrych & Wolfgang Glänzel & Wenceslao Arroyo-Machado & Daniel Torres-Salinas, 2022. "Measuring the excellence contribution at the journal level: an alternative to Garfield’s impact factor," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 7229-7251, December.
    4. Derek R. Smith, 2012. "Impact factors, scientometrics and the history of citation-based research," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 419-427, August.
    5. McAleer, M.J. & Oláh, J. & Popp, J., 2018. "Pros and Cons of the Impact Factor in a Rapidly Changing Digital World," Econometric Institute Research Papers EI2018-11, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    6. Jerome K. Vanclay, 2012. "Impact factor: outdated artefact or stepping-stone to journal certification?," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 211-238, August.
    7. Wolfgang Glänzel & Henk F. Moed, 2013. "Opinion paper: thoughts and facts on bibliometric indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(1), pages 381-394, July.
    8. Mingkun Wei, 2020. "Research on impact evaluation of open access journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(2), pages 1027-1049, February.
    9. Juan Miguel Campanario, 2014. "The effect of citations on the significance of decimal places in the computation of journal impact factors," Scientometrics, Springer;Akadémiai Kiadó, vol. 99(2), pages 289-298, May.
    10. Mingers, John & Yang, Liying, 2017. "Evaluating journal quality: A review of journal citation indicators and ranking in business and management," European Journal of Operational Research, Elsevier, vol. 257(1), pages 323-337.
    11. David A. Pendlebury & Jonathan Adams, 2012. "Comments on a critique of the Thomson Reuters journal impact factor," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 395-401, August.
    12. Xindi Wang & Zeshui Xu & Xinxin Wang & Marinko Skare, 2022. "A review of inflation from 1906 to 2022: a comprehensive analysis of inflation studies from a global perspective," Oeconomia Copernicana, Institute of Economic Research, vol. 13(3), pages 595-631, September.
    13. Cristina López-Duarte & Marta M. Vidal-Suárez & Belén González-Díaz & Nuno Rosa Reis, 2016. "Understanding the relevance of national culture in international business research: a quantitative analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(3), pages 1553-1590, September.
    14. Mingers, John & Leydesdorff, Loet, 2015. "A review of theory and practice in scientometrics," European Journal of Operational Research, Elsevier, vol. 246(1), pages 1-19.
    15. Franceschet, Massimo, 2010. "Journal influence factors," Journal of Informetrics, Elsevier, vol. 4(3), pages 239-248.
    16. Juan Miguel Campanario & William Cabos, 2014. "The effect of additional citations in the stability of Journal Citation Report categories," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 1113-1130, February.
    17. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    18. Yves Fassin, 2021. "Does the Financial Times FT50 journal list select the best management and economics journals?," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 5911-5943, July.
    19. Robert Lehmann & Klaus Wohlrabe, 2017. "An Elo ranking for economics journals," Economics Bulletin, AccessEcon, vol. 37(4), pages 2282-2291.
    20. Cappelletti-Montano, Beniamino & Columbu, Silvia & Montaldo, Stefano & Musio, Monica, 2021. "New perspectives in bibliometric indicators: Moving from citations to citing authors," Journal of Informetrics, Elsevier, vol. 15(3).

    More about this item

    Keywords

    Journal citer analysis; Citation analysis; Journal impact factor; Journal citation concentration index;
    All these keywords.

    JEL classification:

    • C4 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:100:y:2014:i:1:d:10.1007_s11192-014-1274-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.