IDEAS home Printed from https://ideas.repec.org/p/cte/werepe/we1308.html
   My bibliography  Save this paper

The impact of extreme observations in citation distributions

Author

Listed:
  • Li, Yunrong
  • Ruiz-Castillo, Javier

Abstract

This paper studies the role of extremely highly cited articles in two instances: the measurement of citation inequality, and mean citation rates. Using a dataset, acquired from Thomson Scientific, consisting of 4.4 million articles published in 1998-2003 in 22 broad fields with a five-year citation window, the main results are the following. Firstly, both within each of 22 broad fields and in the all-sciences case, citation inequality is strongly affected by the presence of a handful of extreme observations, particularly when it is measured by citation inequality indices that are very sensitive to citation differences in the upper tail of citation distributions. Secondly, the impact of extreme observations on citation averages is generally much smaller. The concluding Section includes some practical lessons for students of citation inequality and/or users of high-impact indicators

Suggested Citation

  • Li, Yunrong & Ruiz-Castillo, Javier, 2013. "The impact of extreme observations in citation distributions," UC3M Working papers. Economics we1308, Universidad Carlos III de Madrid. Departamento de Economía.
    • Handle: RePEc:cte:werepe:we1308
    as

    Download full text from publisher

    File URL: https://e-archivo.uc3m.es/bitstream/handle/10016/16919/we1308.pdf?sequence=1
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Herranz, Neus & Ruiz-Castillo, Javier, 2012. "Sub-field normalization in the multiplicative case: Average-based citation indicators," Journal of Informetrics, Elsevier, vol. 6(4), pages 543-556.
    2. Shorrocks, A F, 1980. "The Class of Additively Decomposable Inequality Measures," Econometrica, Econometric Society, vol. 48(3), pages 613-625, April.
    3. Pedro Albarrán & Juan A. Crespo & Ignacio Ortuño & Javier Ruiz-Castillo, 2011. "The skewness of science in 219 sub-fields and a number of aggregates," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(2), pages 385-397, August.
    4. Neus Herranz & Javier Ruiz-Castillo, 2012. "Sub-field normalization in the multiplicative case: High- and low-impact citation indicators," Research Evaluation, Oxford University Press, vol. 21(2), pages 113-125, April.
    5. Bourguignon, Francois, 1979. "Decomposable Income Inequality Measures," Econometrica, Econometric Society, vol. 47(4), pages 901-920, July.
    6. Waltman, Ludo & van Eck, Nees Jan, 2013. "A systematic empirical comparison of different approaches for normalizing citation impact indicators," Journal of Informetrics, Elsevier, vol. 7(4), pages 833-849.
    7. Bouyssou, D. & Marchant, T., 2010. "Consistent bibliometric rankings of authors and of journals," Journal of Informetrics, Elsevier, vol. 4(3), pages 365-378.
    8. Antonio Abatemarco & Roberto Dell’Anno, 2013. "Certainty equivalent citation: generalized classes of citation indexes," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(1), pages 263-271, January.
    9. Per O. Seglen, 1992. "The skewness of science," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 43(9), pages 628-638, October.
    10. Shorrocks, Anthony F, 1984. "Inequality Decomposition by Population Subgroups," Econometrica, Econometric Society, vol. 52(6), pages 1369-1385, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Albarrán, Pedro & Herrero, Carmen & Ruiz-Castillo, Javier & Villar, Antonio, 2017. "The Herrero-Villar approach to citation impact," Journal of Informetrics, Elsevier, vol. 11(2), pages 625-640.
    2. Lutz Bornmann & Klaus Wohlrabe, 2019. "Normalisation of citation impact in economics," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(2), pages 841-884, August.
    3. Antonio Perianes-Rodriguez & Javier Ruiz-Castillo, 2016. "University citation distributions," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(11), pages 2790-2804, November.
    4. Michal Brzezinski, 2015. "Power laws in citation distributions: evidence from Scopus," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(1), pages 213-228, April.
    5. Ruiz-Castillo, Javier & Costas, Rodrigo, 2014. "The skewness of scientific productivity," Journal of Informetrics, Elsevier, vol. 8(4), pages 917-934.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ruiz-Castillo, Javier & Costas, Rodrigo, 2018. "Individual and field citation distributions in 29 broad scientific fields," Journal of Informetrics, Elsevier, vol. 12(3), pages 868-892.
    2. Ruiz-Castillo, Javier & Waltman, Ludo, 2015. "Field-normalized citation impact indicators using algorithmically constructed classification systems of science," Journal of Informetrics, Elsevier, vol. 9(1), pages 102-117.
    3. Perianes-Rodríguez, Antonio & Ruiz-Castillo, Javier, 2014. "Within and across department variability in individual productivity : the case of economics," UC3M Working papers. Economics we1404, Universidad Carlos III de Madrid. Departamento de Economía.
    4. Ruiz-Castillo, Javier & Costas, Rodrigo, 2014. "The skewness of scientific productivity," Journal of Informetrics, Elsevier, vol. 8(4), pages 917-934.
    5. Raquel Carrasco & Javier Ruiz-Castillo, 2014. "The Evolution Of The Scientific Productivity Of Highly Productive Economists," Economic Inquiry, Western Economic Association International, vol. 52(1), pages 1-16, January.
    6. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    7. Herranz, Neus & Ruiz-Castillo, Javier, 2012. "Sub-field normalization in the multiplicative case: Average-based citation indicators," Journal of Informetrics, Elsevier, vol. 6(4), pages 543-556.
    8. Casilda Lasso de la Vega & Ana Urrutia & Oscar Volij, 2011. "An Axiomatic Characterization Of The Theil Inequality Order," Working Papers 1103, Ben-Gurion University of the Negev, Department of Economics.
    9. Tugce, Cuhadaroglu, 2013. "My Group Beats Your Group: Evaluating Non-Income Inequalities," SIRE Discussion Papers 2013-49, Scottish Institute for Research in Economics (SIRE).
    10. Teixidó Figueras, Jordi & Duro Moreno, Juan Antonio, 2012. "Ecological Footprint Inequality: A methodological review and some results," Working Papers 2072/203168, Universitat Rovira i Virgili, Department of Economics.
    11. Dunaiski, Marcel & Geldenhuys, Jaco & Visser, Willem, 2019. "On the interplay between normalisation, bias, and performance of paper impact metrics," Journal of Informetrics, Elsevier, vol. 13(1), pages 270-290.
    12. Hu'e Sullivan & Hurlin Christophe & P'erignon Christophe & Saurin S'ebastien, 2022. "Measuring the Driving Forces of Predictive Performance: Application to Credit Scoring," Papers 2212.05866, arXiv.org, revised Jun 2023.
    13. Frankel, David M. & Volij, Oscar, 2011. "Measuring school segregation," Journal of Economic Theory, Elsevier, vol. 146(1), pages 1-38, January.
    14. Stephen P. Jenkins & John Micklewright, 2007. "New Directions in the Analysis of Inequality and Poverty," Discussion Papers of DIW Berlin 700, DIW Berlin, German Institute for Economic Research.
    15. Yosr Abid & Cathal O'Donoghue & Denisa Sologon, 2016. "Decomposing Welfare Inequality in Egypt and Tunisia: an Oaxaca-Blinder Based Approach," Working Papers 1015, Economic Research Forum, revised Jun 2016.
    16. Nicole Palan, 2010. "Measurement of Specialization – The Choice of Indices," FIW Working Paper series 062, FIW.
    17. Arthur Charpentier & Stéphane Mussard, 2011. "Income inequality games," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 9(4), pages 529-554, December.
    18. Casilda Lasso de la Vega & Ana Urrutia, 2008. "The ‘Extended’ Atkinson family: The class of multiplicatively decomposable inequality measures, and some new graphical procedures for analysts," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 6(2), pages 211-225, June.
    19. Eva Camacho-Cuena & Tibor Neugebauer & Christian Seidl, 2007. "Leaky Buckets Versus Compensating Justice: An Experimental Investigation," Working Papers 74, ECINEQ, Society for the Study of Economic Inequality.
    20. Mussard, Stéphane & Pi Alperin, Maria Noel, 2011. "Poverty growth in Scandinavian countries: A Sen multi-decomposition," Economic Modelling, Elsevier, vol. 28(6), pages 2842-2853.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cte:werepe:we1308. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Ana Poveda (email available below). General contact details of provider: http://www.eco.uc3m.es/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.