IDEAS home Printed from https://ideas.repec.org/p/cte/werepe/we095735.html
   My bibliography  Save this paper

The measurement of low- and high-impact in citation distributions : technical results

Author

Listed:
  • Albarrán, Pedro
  • Ortuño, Ignacio
  • Ruiz-Castillo, Javier

Abstract

This paper introduces a novel methodology for comparing the citation distributions of research units working in the same homogeneous field. Given a critical citation level (CCL), we suggest using two real valued indicators to describe the shape of any distribution: a high-impact and a low-impact measure defined over the set of articles with citations above or below the CCL. The key to this methodology is the identification of a citation distribution with an income distribution. Once this step is taken, it is easy to realize that the measurement of low-impact coincides with the measurement of economic poverty. In turn, it is equally natural to identify the measurement of high-impact with the measurement of a certain notion of economic affluence. On the other hand, it is seen that the ranking of citation distributions according to a family of low-impact measures is essentially characterized by a number of desirable axioms. Appropriately redefined, these same axioms lead to the selection of an equally convenient class of decomposable high-impact measures. These two families are shown to satisfy other interesting properties that make them potentially useful in empirical applications, including the comparison of research units working in different fields.

Suggested Citation

  • Albarrán, Pedro & Ortuño, Ignacio & Ruiz-Castillo, Javier, 2009. "The measurement of low- and high-impact in citation distributions : technical results," UC3M Working papers. Economics we095735, Universidad Carlos III de Madrid. Departamento de Economía.
  • Handle: RePEc:cte:werepe:we095735
    as

    Download full text from publisher

    File URL: https://e-archivo.uc3m.es/bitstream/handle/10016/6113/we095735.pdf?sequence=5
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. Foster, James E & Shorrocks, Anthony F, 1991. "Subgroup Consistent Poverty Indices," Econometrica, Econometric Society, vol. 59(3), pages 687-709, May.
    2. Katz, J. Sylvan, 1999. "The self-similar science system1," Research Policy, Elsevier, vol. 28(5), pages 501-517, June.
    3. repec:spr:scient:v:88:y:2011:i:2:d:10.1007_s11192-011-0407-9 is not listed on IDEAS
    4. Albarrán, Pedro & Ortuño, Ignacio & Ruiz-Castillo, Javier, 2011. "High- and low-impact citation measures: Empirical applications," Journal of Informetrics, Elsevier, vol. 5(1), pages 122-145.
    5. Quesada, Antonio, 2009. "Monotonicity and the Hirsch index," Journal of Informetrics, Elsevier, vol. 3(2), pages 158-160.
    6. Foster, James & Greer, Joel & Thorbecke, Erik, 1984. "A Class of Decomposable Poverty Measures," Econometrica, Econometric Society, vol. 52(3), pages 761-766, May.
    7. Pedro Albarrán & Juan A. Crespo & Ignacio Ortuño & Javier Ruiz-Castillo, 2011. "The skewness of science in 219 sub-fields and a number of aggregates," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(2), pages 385-397, August.
    8. Moed, H. F. & Burger, W. J. M. & Frankfort, J. G. & Van Raan, A. F. J., 1985. "The use of bibliometric data for the measurement of university research performance," Research Policy, Elsevier, vol. 14(3), pages 131-149, June.
    9. Pedro Albarrán & Javier Ruiz-Castillo, 2011. "References made and citations received by scientific articles," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(1), pages 40-49, January.
    10. Martin, Ben R. & Irvine, John, 1993. "Assessing basic research : Some partial indicators of scientific progress in radio astronomy," Research Policy, Elsevier, vol. 22(2), pages 106-106, April.
    11. David Johnson, 1988. "The Measurement of Poverty in Australia: 1981-82 and 1985-86," Australian Economic Review, The University of Melbourne, Melbourne Institute of Applied Economic and Social Research, vol. 21(3), pages 13-24.
    12. Pyatt, Graham, 1987. "Measuring Welfare, Poverty and Inequality," Economic Journal, Royal Economic Society, vol. 97(386), pages 459-467, June.
    13. Sen, Amartya K, 1976. "Poverty: An Ordinal Approach to Measurement," Econometrica, Econometric Society, vol. 44(2), pages 219-231, March.
    14. Chakravarty, Satya R., 1983. "A new index of poverty," Mathematical Social Sciences, Elsevier, vol. 6(3), pages 307-313, December.
    15. Clark, Stephen & Hemming, Richard & Ulph, David, 1981. "On Indices for the Measurement of Poverty," Economic Journal, Royal Economic Society, vol. 91(362), pages 515-526, June.
    16. Zheng, Buhong, 1997. " Aggregate Poverty Measures," Journal of Economic Surveys, Wiley Blackwell, vol. 11(2), pages 123-162, June.
    17. Thon, Dominique, 1979. "On Measuring Poverty," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 25(4), pages 429-439, December.
    18. Woeginger, Gerhard J., 2008. "An axiomatic characterization of the Hirsch-index," Mathematical Social Sciences, Elsevier, vol. 56(2), pages 224-232, September.
    19. Alonso, S. & Cabrerizo, F.J. & Herrera-Viedma, E. & Herrera, F., 2009. "h-Index: A review focused in its variants, computation and standardization for different scientific fields," Journal of Informetrics, Elsevier, vol. 3(4), pages 273-289.
    20. J Sylvan Katz, 2000. "Scale-independent indicators and research evaluation," Science and Public Policy, Oxford University Press, vol. 27(1), pages 23-36, February.
    21. Jenkins, Stephen P & Lambert, Peter J, 1997. "Three 'I's of Poverty Curves, with an Analysis of UK Poverty Trends," Oxford Economic Papers, Oxford University Press, vol. 49(3), pages 317-327, July.
    22. Woeginger, Gerhard J., 2008. "A symmetry axiom for scientific impact indices," Journal of Informetrics, Elsevier, vol. 2(4), pages 298-303.
    23. Dasgupta, Partha & Sen, Amartya & Starrett, David, 1973. "Notes on the measurement of inequality," Journal of Economic Theory, Elsevier, vol. 6(2), pages 180-187, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Neus Herranz & Javier Ruiz-Castillo, 2012. "Multiplicative and fractional strategies when journals are assigned to several subfields," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(11), pages 2195-2205, November.
    2. Albarrán, Pedro & Herrero, Carmen & Ruiz-Castillo, Javier & Villar, Antonio, 2017. "The Herrero-Villar approach to citation impact," Journal of Informetrics, Elsevier, vol. 11(2), pages 625-640.
    3. Pedro Albarrán & Ignacio Ortuño & Javier Ruiz-Castillo, 2011. "Average-based versus high- and low-impact indicators for the evaluation of scientific distributions," Research Evaluation, Oxford University Press, vol. 20(4), pages 325-339, October.
    4. Neus Herranz & Javier Ruiz-Castillo, 2012. "Sub-field normalization in the multiplicative case: High- and low-impact citation indicators," Research Evaluation, Oxford University Press, vol. 21(2), pages 113-125, April.
    5. Li, Yunrong & Radicchi, Filippo & Castellano, Claudio & Ruiz-Castillo, Javier, 2013. "Quantitative evaluation of alternative field normalization procedures," Journal of Informetrics, Elsevier, vol. 7(3), pages 746-755.
    6. Perme, Maja Pohar & Stare, Janez & Žaucer, Rok & Žaucer, Matjaž, 2012. "Comparison of the citation distribution and h-index between groups of different sizes," Journal of Informetrics, Elsevier, vol. 6(4), pages 712-720.
    7. Ricardo Martínez & Antonio Villar, 2018. "Multilevel Proficiency Comparisons With An Application To Educational Outcomes In Pisa," Working Papers 18.04, Universidad Pablo de Olavide, Department of Economics.
    8. Antonio Perianes-Rodriguez & Javier Ruiz-Castillo, 2016. "A comparison of two ways of evaluating research units working in different scientific fields," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(2), pages 539-561, February.
    9. repec:spr:scient:v:98:y:2014:i:3:d:10.1007_s11192-013-1155-9 is not listed on IDEAS
    10. Herranz, Neus & Ruiz-Castillo, Javier, 2012. "Sub-field normalization in the multiplicative case: Average-based citation indicators," Journal of Informetrics, Elsevier, vol. 6(4), pages 543-556.
    11. repec:spr:scient:v:95:y:2013:i:1:d:10.1007_s11192-012-0865-8 is not listed on IDEAS
    12. Antonio Perianes-Rodriguez & Javier Ruiz-Castillo, 2016. "University citation distributions," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(11), pages 2790-2804, November.
    13. Javier Ruiz-Castillo, 2012. "The evaluation of citation distributions," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 3(1), pages 291-310, March.
    14. Neus Herranz & Javier Ruiz-Castillo, 2013. "The end of the “European Paradox”," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(1), pages 453-464, April.
    15. Perianes-Rodriguez, Antonio & Ruiz-Castillo, Javier, 2015. "Multiplicative versus fractional counting methods for co-authored publications. The case of the 500 universities in the Leiden Ranking," Journal of Informetrics, Elsevier, vol. 9(4), pages 974-989.
    16. Albarrán, Pedro & Ortuño, Ignacio & Ruiz-Castillo, Javier, 2011. "High- and low-impact citation measures: Empirical applications," Journal of Informetrics, Elsevier, vol. 5(1), pages 122-145.
    17. Abatemarco, Antonio & Dell'Anno, Roberto, 2011. "Certainty equivalent citation: a generalized class of citation indexes," MPRA Paper 36367, University Library of Munich, Germany.
    18. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    19. Andrea Bonaccorsi & Tindaro Cicero & Peter Haddawy & Saeed-UL Hassan, 2017. "Explaining the transatlantic gap in research excellence," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(1), pages 217-241, January.
    20. repec:eee:infome:v:11:y:2017:i:2:p:435-454 is not listed on IDEAS
    21. Albarrán, Pedro & Ruiz-Castillo, Javier, 2012. "The measurement of scientific excellence around the world," UC3M Working papers. Economics we1208, Universidad Carlos III de Madrid. Departamento de Economía.
    22. repec:eee:infome:v:12:y:2018:i:1:p:315-329 is not listed on IDEAS
    23. Bouyssou, Denis & Marchant, Thierry, 2014. "An axiomatic approach to bibliometric rankings and indices," Journal of Informetrics, Elsevier, vol. 8(3), pages 449-477.
    24. repec:spr:scient:v:102:y:2015:i:2:d:10.1007_s11192-014-1460-y is not listed on IDEAS
    25. repec:spr:scient:v:94:y:2013:i:1:d:10.1007_s11192-012-0758-x is not listed on IDEAS

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cte:werepe:we095735. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Ana Poveda). General contact details of provider: http://www.eco.uc3m.es/ .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.