IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v97y2013i1d10.1007_s11192-013-1022-8.html
   My bibliography  Save this article

High-end performance or outlier? Evaluating the tail of scientometric distributions

Author

Listed:
  • Wolfgang Glänzel

    (Centre for R&D Monitoring and Department of MSI, KU Leuven
    Library of the Hungarian Academy of Sciences)

Abstract

The present paper attempts to shed light on outstanding research performance using the example of citation distributions. In order to answer the question of how the analysis of outstanding performance, in general, and highly cited papers, in particular, could be integrated into standard techniques of evaluative scientometrics. Two general methods are proposed: One solution aims at quantifying the performance represented by the tail of citation distributions independently of the “mainstream”, the second one, a parameter-free solution, provides performance classes for any level. Advantages and shortcoming of both methods are discussed.

Suggested Citation

  • Wolfgang Glänzel, 2013. "High-end performance or outlier? Evaluating the tail of scientometric distributions," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(1), pages 13-23, October.
  • Handle: RePEc:spr:scient:v:97:y:2013:i:1:d:10.1007_s11192-013-1022-8
    DOI: 10.1007/s11192-013-1022-8
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-013-1022-8
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11192-013-1022-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Ludo Waltman & Clara Calero‐Medina & Joost Kosten & Ed C.M. Noyons & Robert J.W. Tijssen & Nees Jan van Eck & Thed N. van Leeuwen & Anthony F.J. van Raan & Martijn S. Visser & Paul Wouters, 2012. "The Leiden ranking 2011/2012: Data collection, indicators, and interpretation," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 63(12), pages 2419-2432, December.
    2. Loet Leydesdorff & Lutz Bornmann & Rüdiger Mutz & Tobias Opthof, 2011. "Turning the tables on citation analysis one more time: Principles for comparing sets of documents," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(7), pages 1370-1381, July.
    3. Wolfgang Glänzel & Henk F. Moed, 2013. "Opinion paper: thoughts and facts on bibliometric indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(1), pages 381-394, July.
    4. Matthys, Gunther & Delafosse, Emmanuel & Guillou, Armelle & Beirlant, Jan, 2004. "Estimating catastrophic quantile levels for heavy-tailed distributions," Insurance: Mathematics and Economics, Elsevier, vol. 34(3), pages 517-537, June.
    5. Beirlant, Jan & Glänzel, Wolfgang & Carbonez, An & Leemans, Herlinde, 2007. "Scoring research output using statistical quantile plotting," Journal of Informetrics, Elsevier, vol. 1(3), pages 185-192.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Guoliang Lyu & Ganwei Shi, 2019. "On an approach to boosting a journal’s citation potential," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(3), pages 1387-1409, September.
    2. Qing Cheng & Xin Lu & Zhong Liu & Jincai Huang, 2015. "Mining research trends with anomaly detection models: the case of social computing research," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(2), pages 453-469, May.
    3. Campanario, Juan Miguel, 2014. "Analysis of the distribution of cited journals according to their positions in the h-core of citing journal listed in Journal Citation Reports," Journal of Informetrics, Elsevier, vol. 8(3), pages 534-545.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wolfgang Glänzel & Bart Thijs & Koenraad Debackere, 2014. "The application of citation-based performance classes to the disciplinary and multidisciplinary assessment in national comparison and institutional research assessment," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(2), pages 939-952, November.
    2. Pedro Albarrán & Antonio Perianes-Rodríguez & Javier Ruiz-Castillo, 2015. "Differences in citation impact across countries," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(3), pages 512-525, March.
    3. Wolfgang Glänzel & Henk F. Moed, 2013. "Opinion paper: thoughts and facts on bibliometric indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(1), pages 381-394, July.
    4. Lutz Bornmann & Werner Marx & Andreas Barth, 2013. "The Normalization of Citation Counts Based on Classification Systems," Publications, MDPI, vol. 1(2), pages 1-9, August.
    5. Loet Leydesdorff & Lutz Bornmann & Jonathan Adams, 2019. "The integrated impact indicator revisited (I3*): a non-parametric alternative to the journal impact factor," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(3), pages 1669-1694, June.
    6. Bornmann, Lutz & Leydesdorff, Loet, 2017. "Skewness of citation impact data and covariates of citation distributions: A large-scale empirical analysis based on Web of Science data," Journal of Informetrics, Elsevier, vol. 11(1), pages 164-175.
    7. Zhesi Shen & Liying Yang & Zengru Di & Jinshan Wu, 2019. "Large enough sample size to rank two groups of data reliably according to their means," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(2), pages 653-671, February.
    8. Emilio Gómez–Déniz & Pablo Dorta–González, 2024. "A field- and time-normalized Bayesian approach to measuring the impact of a publication," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(5), pages 2659-2676, May.
    9. Loet Leydesdorff & Ping Zhou & Lutz Bornmann, 2013. "How can journal impact factors be normalized across fields of science? An assessment in terms of percentile ranks and fractional counts," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(1), pages 96-107, January.
    10. Antonoyiannakis, Manolis, 2018. "Impact Factors and the Central Limit Theorem: Why citation averages are scale dependent," Journal of Informetrics, Elsevier, vol. 12(4), pages 1072-1088.
    11. Yves Fassin, 2020. "The HF-rating as a universal complement to the h-index," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 965-990, November.
    12. Ashraf Uddin & Jaideep Bhoosreddy & Marisha Tiwari & Vivek Kumar Singh, 2016. "A Sciento-text framework to characterize research strength of institutions at fine-grained thematic area level," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(3), pages 1135-1150, March.
    13. Hoekman, Jarno & Rake, Bastian, 2024. "Geography of authorship: How geography shapes authorship attribution in big team science," Research Policy, Elsevier, vol. 53(2).
    14. Marco Cavallaro & Benedetto Lepori, 2021. "Institutional barriers to participation in EU framework programs: contrasting the Swiss and UK cases," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1311-1328, February.
    15. Pedro Antonio Martín-Cervantes & Parisa Ziarati & Pablo de Frutos Madrazo & Iza Gigauri, 2025. "Digital Marketing as a Driver of Change Towards the Circular Economy," Sustainability, MDPI, vol. 17(11), pages 1-24, June.
    16. Ying Guo & Xiantao Xiao, 2022. "Author-level altmetrics for the evaluation of Chinese scholars," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(2), pages 973-990, February.
    17. Dunaiski, Marcel & Geldenhuys, Jaco & Visser, Willem, 2019. "On the interplay between normalisation, bias, and performance of paper impact metrics," Journal of Informetrics, Elsevier, vol. 13(1), pages 270-290.
    18. Jeffrey Demaine, 2022. "Fractionalization of research impact reveals global trends in university collaboration," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(5), pages 2235-2247, May.
    19. Chris W. Belter, 2013. "A bibliometric analysis of NOAA’s Office of Ocean Exploration and Research," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(2), pages 629-644, May.
    20. Schreiber, Michael, 2013. "A case study of the arbitrariness of the h-index and the highly-cited-publications indicator," Journal of Informetrics, Elsevier, vol. 7(2), pages 379-387.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:97:y:2013:i:1:d:10.1007_s11192-013-1022-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.