IDEAS home Printed from https://ideas.repec.org/p/cte/werepe/we1040.html
   My bibliography  Save this paper

Average-based versus high-and low-impact indicators for the evaluation of scientific distributions

Author

Listed:
  • Albarrán, Pedro
  • Ortuño, Ignacio
  • Ruiz-Castillo, Javier

Abstract

Albarran et al. (2011a) introduced a novel methodology for the evaluation of citation distributions consisting of a pair of high- and a low-impact measures defined over the set of articles with citations below or above a critical citation level CCL. Albarran et al. (2011b) presented the first empirical applications to a situation in which the world citation distribution in 22 scientific fields is partitioned into three geographical areas: the U.S., the European Union, and the rest of the world. In this paper, we compare our results with those obtained with average-based indicators. For reasonable CCLs, such as the 80th percentile of the world citation distribution in each field, the cardinal differences between the results obtained with our high-impact index and the mean citation rate are of a large order of magnitude. When, in addition, the percentage in the top 5% of most cited articles or the percentage of uncited articles are used, there are still important quantitative differences with respect to the high- and low-impact indicators advocated in our approach when the CCL is fixed at the 80th or the 95th percentile.

Suggested Citation

  • Albarrán, Pedro & Ortuño, Ignacio & Ruiz-Castillo, Javier, 2010. "Average-based versus high-and low-impact indicators for the evaluation of scientific distributions," UC3M Working papers. Economics we1040, Universidad Carlos III de Madrid. Departamento de Economía.
  • Handle: RePEc:cte:werepe:we1040
    as

    Download full text from publisher

    File URL: https://e-archivo.uc3m.es/bitstream/handle/10016/8244/we1040.pdf?sequence=1
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. repec:spr:scient:v:88:y:2011:i:2:d:10.1007_s11192-011-0407-9 is not listed on IDEAS
    2. Pedro Albarrán & Juan A. Crespo & Ignacio Ortuño & Javier Ruiz-Castillo, 2011. "The skewness of science in 219 sub-fields and a number of aggregates," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(2), pages 385-397, August.
    3. Albarrán, Pedro & Ortuño, Ignacio & Ruiz-Castillo, Javier, 2011. "The measurement of low- and high-impact in citation distributions: Technical results," Journal of Informetrics, Elsevier, vol. 5(1), pages 48-63.
    4. Albarrán, Pedro & Crespo, Juan A. & Ortuño, Ignacio & Ruiz-Castillo, Javier, 2009. "A comparison of the scientific performance of the U. S. and the European Union at the turn of the XXI century," UC3M Working papers. Economics we095534, Universidad Carlos III de Madrid. Departamento de Economía.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Herranz, Neus & Ruiz-Castillo, Javier, 2012. "Sub-field normalization in the multiplicative case: Average-based citation indicators," Journal of Informetrics, Elsevier, vol. 6(4), pages 543-556.
    2. Neus Herranz & Javier Ruiz-Castillo, 2013. "The end of the “European Paradox”," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(1), pages 453-464, April.
    3. Albarrán, Pedro & Herrero, Carmen & Ruiz-Castillo, Javier & Villar, Antonio, 2017. "The Herrero-Villar approach to citation impact," Journal of Informetrics, Elsevier, vol. 11(2), pages 625-640.
    4. Tomaz Bartol & Gordana Budimir & Primoz Juznic & Karmen Stopar, 2016. "Mapping and classification of agriculture in Web of Science: other subject categories and research fields may benefit," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 979-996, November.
    5. Javier Ruiz-Castillo, 2012. "The evaluation of citation distributions," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 3(1), pages 291-310, March.
    6. Andrea Bonaccorsi & Tindaro Cicero & Peter Haddawy & Saeed-UL Hassan, 2017. "Explaining the transatlantic gap in research excellence," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(1), pages 217-241, January.
    7. repec:eee:infome:v:11:y:2017:i:2:p:435-454 is not listed on IDEAS

    More about this item

    JEL classification:

    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • I32 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty - - - Measurement and Analysis of Poverty

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cte:werepe:we1040. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Ana Poveda). General contact details of provider: http://www.eco.uc3m.es/ .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.