IDEAS home Printed from https://ideas.repec.org/p/cte/werepe/we1303.html
   My bibliography  Save this paper

The effect on citation inequality of differences in citation practices at the Web of Sciences subject category level

Author

Listed:
  • Crespo, Juan A.
  • Herranz, Neus
  • Li, Yunrong
  • Ruiz-Castillo, Javier

Abstract

This paper studies the impact of differences in citation practices at the sub-field, or Web of Science subject category level using the model introduced in Crespo et al. (2012) according to which the number of citations received by an article depends on its underlying scientific influence and the field to which it belongs. We use the same Thomson Reuters dataset of about 4.4 million articles published in 1998-2003 with a fiveyear citation window used in Crespo et al. (2013) to analyze a classification system consisting of 22 broad fields. The main results are the following four. Firstly, as expected, when the classification system goes from 22 broad fields to 219 sub-fields the effect on citation inequality of differences in citation practices increases from approximately 14% at the field level to 18% at the sub-field level. Secondly, we estimate a set of exchange rates (ERs) to express the citation counts of articles in a wide quantile interval into the equivalent counts in the all-sciences case. For example, in the fractional case we find that in 187 out of 219 sub-fields the ERs are reliable in the sense that the coefficient of variation is smaller than or equal to 0.10. ERs are estimated over the [660, 978] interval that, on average, covers about 62% of all citations. Thirdly, in the fractional case the normalization of the raw data using the ERs (or sub-field mean citations) as normalization factors reduces the importance of the differences in citation practices from 18% to 3.8% (3.4%) of overall citation inequality. Fourthly, the results in the fractional case are essentially replicated when we adopt the multiplicative approach

Suggested Citation

  • Crespo, Juan A. & Herranz, Neus & Li, Yunrong & Ruiz-Castillo, Javier, 2013. "The effect on citation inequality of differences in citation practices at the Web of Sciences subject category level," UC3M Working papers. Economics we1303, Universidad Carlos III de Madrid. Departamento de Economía.
  • Handle: RePEc:cte:werepe:we1303
    as

    Download full text from publisher

    File URL: https://e-archivo.uc3m.es/bitstream/handle/10016/16327/we1303.pdf?sequence=1
    Download Restriction: no
    ---><---

    Other versions of this item:

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. John Mingers & Martin Meyer, 2017. "Normalizing Google Scholar data for use in research evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(2), pages 1111-1121, August.
    2. Perianes-Rodríguez, Antonio & Ruiz-Castillo, Javier, 2014. "Within and across department variability in individual productivity : the case of economics," UC3M Working papers. Economics we1404, Universidad Carlos III de Madrid. Departamento de Economía.
    3. Li, Yunrong & Ruiz-Castillo, Javier, 2013. "The comparison of normalization procedures based on different classification systems," Journal of Informetrics, Elsevier, vol. 7(4), pages 945-958.
    4. Lutz Bornmann & Klaus Wohlrabe, 2019. "Normalisation of citation impact in economics," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(2), pages 841-884, August.
    5. Perianes-Rodriguez, Antonio & Ruiz-Castillo, Javier, 2017. "A comparison of the Web of Science and publication-level classification systems of science," Journal of Informetrics, Elsevier, vol. 11(1), pages 32-45.
    6. Dunaiski, Marcel & Geldenhuys, Jaco & Visser, Willem, 2019. "Globalised vs averaged: Bias and ranking performance on the author level," Journal of Informetrics, Elsevier, vol. 13(1), pages 299-313.
    7. Antonio Perianes-Rodriguez & Javier Ruiz-Castillo, 2016. "University citation distributions," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(11), pages 2790-2804, November.
    8. Yifan Qian & Wenge Rong & Nan Jiang & Jie Tang & Zhang Xiong, 2017. "Citation regression analysis of computer science publications in different ranking categories and subfields," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(3), pages 1351-1374, March.
    9. Bouyssou, Denis & Marchant, Thierry, 2016. "Ranking authors using fractional counting of citations: An axiomatic approach," Journal of Informetrics, Elsevier, vol. 10(1), pages 183-199.
    10. Ruiz-Castillo, Javier & Costas, Rodrigo, 2018. "Individual and field citation distributions in 29 broad scientific fields," Journal of Informetrics, Elsevier, vol. 12(3), pages 868-892.
    11. Waltman, Ludo & van Eck, Nees Jan, 2013. "A systematic empirical comparison of different approaches for normalizing citation impact indicators," Journal of Informetrics, Elsevier, vol. 7(4), pages 833-849.
    12. Ruiz-Castillo, Javier & Costas, Rodrigo, 2014. "The skewness of scientific productivity," Journal of Informetrics, Elsevier, vol. 8(4), pages 917-934.
    13. Li, Yunrong & Radicchi, Filippo & Castellano, Claudio & Ruiz-Castillo, Javier, 2013. "Quantitative evaluation of alternative field normalization procedures," Journal of Informetrics, Elsevier, vol. 7(3), pages 746-755.
    14. Marcelo Mendoza, 2021. "Differences in Citation Patterns across Areas, Article Types and Age Groups of Researchers," Publications, MDPI, vol. 9(4), pages 1-23, October.
    15. Antonio Perianes-Rodriguez & Javier Ruiz-Castillo, 2016. "A comparison of two ways of evaluating research units working in different scientific fields," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(2), pages 539-561, February.
    16. Bornmann, Lutz & Marx, Werner, 2018. "Critical rationalism and the search for standard (field-normalized) indicators in bibliometrics," Journal of Informetrics, Elsevier, vol. 12(3), pages 598-604.
    17. Antonio Perianes-Rodriguez & Javier Ruiz-Castillo, 2015. "Within- and between-department variability in individual productivity: the case of economics," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(2), pages 1497-1520, February.
    18. Ruiz-Castillo, Javier & Waltman, Ludo, 2015. "Field-normalized citation impact indicators using algorithmically constructed classification systems of science," Journal of Informetrics, Elsevier, vol. 9(1), pages 102-117.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cte:werepe:we1303. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Ana Poveda (email available below). General contact details of provider: http://www.eco.uc3m.es/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.