IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v97y2013i1d10.1007_s11192-013-1022-8.html
   My bibliography  Save this article

High-end performance or outlier? Evaluating the tail of scientometric distributions

Author

Listed:
  • Wolfgang Glänzel

    (Centre for R&D Monitoring and Department of MSI, KU Leuven
    Library of the Hungarian Academy of Sciences)

Abstract

The present paper attempts to shed light on outstanding research performance using the example of citation distributions. In order to answer the question of how the analysis of outstanding performance, in general, and highly cited papers, in particular, could be integrated into standard techniques of evaluative scientometrics. Two general methods are proposed: One solution aims at quantifying the performance represented by the tail of citation distributions independently of the “mainstream”, the second one, a parameter-free solution, provides performance classes for any level. Advantages and shortcoming of both methods are discussed.

Suggested Citation

  • Wolfgang Glänzel, 2013. "High-end performance or outlier? Evaluating the tail of scientometric distributions," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(1), pages 13-23, October.
  • Handle: RePEc:spr:scient:v:97:y:2013:i:1:d:10.1007_s11192-013-1022-8
    DOI: 10.1007/s11192-013-1022-8
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-013-1022-8
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11192-013-1022-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Loet Leydesdorff & Lutz Bornmann & Rüdiger Mutz & Tobias Opthof, 2011. "Turning the tables on citation analysis one more time: Principles for comparing sets of documents," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(7), pages 1370-1381, July.
    2. Wolfgang Glänzel & Henk F. Moed, 2013. "Opinion paper: thoughts and facts on bibliometric indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(1), pages 381-394, July.
    3. Matthys, Gunther & Delafosse, Emmanuel & Guillou, Armelle & Beirlant, Jan, 2004. "Estimating catastrophic quantile levels for heavy-tailed distributions," Insurance: Mathematics and Economics, Elsevier, vol. 34(3), pages 517-537, June.
    4. Beirlant, Jan & Glänzel, Wolfgang & Carbonez, An & Leemans, Herlinde, 2007. "Scoring research output using statistical quantile plotting," Journal of Informetrics, Elsevier, vol. 1(3), pages 185-192.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Guoliang Lyu & Ganwei Shi, 2019. "On an approach to boosting a journal’s citation potential," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(3), pages 1387-1409, September.
    2. Qing Cheng & Xin Lu & Zhong Liu & Jincai Huang, 2015. "Mining research trends with anomaly detection models: the case of social computing research," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(2), pages 453-469, May.
    3. Campanario, Juan Miguel, 2014. "Analysis of the distribution of cited journals according to their positions in the h-core of citing journal listed in Journal Citation Reports," Journal of Informetrics, Elsevier, vol. 8(3), pages 534-545.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wolfgang Glänzel & Bart Thijs & Koenraad Debackere, 2014. "The application of citation-based performance classes to the disciplinary and multidisciplinary assessment in national comparison and institutional research assessment," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(2), pages 939-952, November.
    2. Wolfgang Glänzel & Henk F. Moed, 2013. "Opinion paper: thoughts and facts on bibliometric indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(1), pages 381-394, July.
    3. Bornmann, Lutz & Leydesdorff, Loet, 2017. "Skewness of citation impact data and covariates of citation distributions: A large-scale empirical analysis based on Web of Science data," Journal of Informetrics, Elsevier, vol. 11(1), pages 164-175.
    4. Loet Leydesdorff & Ping Zhou & Lutz Bornmann, 2013. "How can journal impact factors be normalized across fields of science? An assessment in terms of percentile ranks and fractional counts," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(1), pages 96-107, January.
    5. Yves Fassin, 2020. "The HF-rating as a universal complement to the h-index," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 965-990, November.
    6. Ashraf Uddin & Jaideep Bhoosreddy & Marisha Tiwari & Vivek Kumar Singh, 2016. "A Sciento-text framework to characterize research strength of institutions at fine-grained thematic area level," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(3), pages 1135-1150, March.
    7. Juan A Crespo & Ignacio Ortuño-Ortín & Javier Ruiz-Castillo, 2012. "The Citation Merit of Scientific Publications," PLOS ONE, Public Library of Science, vol. 7(11), pages 1-9, November.
    8. Dunaiski, Marcel & Geldenhuys, Jaco & Visser, Willem, 2019. "On the interplay between normalisation, bias, and performance of paper impact metrics," Journal of Informetrics, Elsevier, vol. 13(1), pages 270-290.
    9. Chris W. Belter, 2013. "A bibliometric analysis of NOAA’s Office of Ocean Exploration and Research," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(2), pages 629-644, May.
    10. Schreiber, Michael, 2013. "A case study of the arbitrariness of the h-index and the highly-cited-publications indicator," Journal of Informetrics, Elsevier, vol. 7(2), pages 379-387.
    11. Ludo Waltman & Michael Schreiber, 2013. "On the calculation of percentile-based bibliometric indicators," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(2), pages 372-379, February.
    12. J. Martin Zyl, 2013. "The generalized Pareto distribution fitted to research outputs of countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(3), pages 1099-1109, March.
    13. Pedro Albarrán & Antonio Perianes-Rodríguez & Javier Ruiz-Castillo, 2015. "Differences in citation impact across countries," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(3), pages 512-525, March.
    14. Lutz Bornmann & Werner Marx, 2014. "How to evaluate individual researchers working in the natural and life sciences meaningfully? A proposal of methods based on percentiles of citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(1), pages 487-509, January.
    15. Wildgaard, Lorna, 2016. "A critical cluster analysis of 44 indicators of author-level performance," Journal of Informetrics, Elsevier, vol. 10(4), pages 1055-1078.
    16. Mutz, Rüdiger & Daniel, Hans-Dieter, 2012. "Skewed citation distributions and bias factors: Solutions to two core problems with the journal impact factor," Journal of Informetrics, Elsevier, vol. 6(2), pages 169-176.
    17. Albarrán, Pedro & Herrero, Carmen & Ruiz-Castillo, Javier & Villar, Antonio, 2017. "The Herrero-Villar approach to citation impact," Journal of Informetrics, Elsevier, vol. 11(2), pages 625-640.
    18. Csató, László, 2019. "Journal ranking should depend on the level of aggregation," Journal of Informetrics, Elsevier, vol. 13(4).
    19. Wolfgang Glänzel & András Schubert & Bart Thijs & Koenraad Debackere, 2011. "A priori vs. a posteriori normalisation of citation indicators. The case of journal ranking," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(2), pages 415-424, May.
    20. Gangan Prathap, 2012. "Energy indicators and percentile ranking normalization," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(3), pages 997-1003, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:97:y:2013:i:1:d:10.1007_s11192-013-1022-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.