IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v77y2008i1d10.1007_s11192-007-1934-2.html
   My bibliography  Save this article

Comparisons of results of publication counting using different methods

Author

Listed:
  • Marianne Gauffriau

    (Technical University of Denmark, Technical Knowledge Center of Denmark, D’ARC - DTU Analysis & Research Promotion Center)

  • Peder Olesen Larsen

    (Marievej 10A, 2)

  • Isabelle Maye

    (Center for Science and Technology Studies (CEST))

  • Anne Roulin-Perriard

    (Center for Science and Technology Studies (CEST))

  • Markus Ins

    (Center for Science and Technology Studies (CEST)
    Institute for Research Information and Quality Assurance)

Abstract

Using a database for publications established at CEST and covering the period from 1981 to 2002 the differences in national scores obtained by different counting methods have been measured. The results are supported by analysing data from the literature. Special attention has been paid to the comparison between the EU and the USA. There are big differences between scores obtained by different methods. In one instance the reduction in scores going from whole to complete-normalized (fractional) counting is 72 per cent. In the literature there is often not enough information given about methods used, and no sign of a clear and consistent terminology and of agreement on properties of and results from different methods. As a matter of fact, whole counting is favourable to certain countries, especially countries with a high level of international cooperation. The problems are increasing with time because of the ever-increasing national and international cooperation in research and the increasing average number of authors per publication. The need for a common understanding and a joint effort to rectify the situation is stressed.

Suggested Citation

  • Marianne Gauffriau & Peder Olesen Larsen & Isabelle Maye & Anne Roulin-Perriard & Markus Ins, 2008. "Comparisons of results of publication counting using different methods," Scientometrics, Springer;Akadémiai Kiadó, vol. 77(1), pages 147-176, October.
    • Handle: RePEc:spr:scient:v:77:y:2008:i:1:d:10.1007_s11192-007-1934-2
    DOI: 10.1007/s11192-007-1934-2
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-007-1934-2
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-007-1934-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Anthony F J van Raan, 1993. "Advanced bibliometric methods to assess research performance and scientific development: basic principles and recent practical applications," Research Evaluation, Oxford University Press, vol. 3(3), pages 151-166, December.
    2. Yoshiko Okubo, 1997. "Bibliometric Indicators and Analysis of Research Systems: Methods and Examples," OECD Science, Technology and Industry Working Papers 1997/1, OECD Publishing.
    3. Lydia L. Lange, 2001. "Citation Counts of Multi-Authored Papers — First-named Authors and Further Authors," Scientometrics, Springer;Akadémiai Kiadó, vol. 52(3), pages 457-470, November.
    4. Olle Persson & Wolfgang Glänzel & Rickard Danell, 2004. "Inflationary bibliometric values: The role of scientific collaboration and the need for relative indicators in evaluative studies," Scientometrics, Springer;Akadémiai Kiadó, vol. 60(3), pages 421-432, August.
    5. Leo Egghe & Ronald Rousseau & Guido Van Hooydonk, 2000. "Methods for accrediting publications to authors or countries: Consequences for evaluation studies," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 51(2), pages 145-157.
    6. Marianne Gauffriau & Peder Olesen Larsen & Isabelle Maye & Anne Roulin-Perriard & Markus Ins, 2007. "Publication, cooperation and productivity measures in scientific research," Scientometrics, Springer;Akadémiai Kiadó, vol. 73(2), pages 175-214, November.
    7. Masatsura Igami & Ayaka Saka, 2007. "Capturing the Evolving Nature of Science, the Development of New Scientific Indicators and the Mapping of Science," OECD Science, Technology and Industry Working Papers 2007/1, OECD Publishing.
    8. David A. King, 2004. "The scientific impact of nations," Nature, Nature, vol. 430(6997), pages 311-316, July.
    9. Frank J. Trueba & Héctor Guerrero, 2004. "A robust formula to credit authors for their publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 60(2), pages 181-204, June.
    10. Butler, Linda, 2003. "Explaining Australia's increased share of ISI publications--the effects of a funding formula based on publication counts," Research Policy, Elsevier, vol. 32(1), pages 143-155, January.
    11. N. Haeffner-Cavaillon & C. Graillot-Gak & C. Bréchot, 2005. "Automated grading of research performance clearly fails to measure up," Nature, Nature, vol. 438(7068), pages 559-559, December.
    12. Marianne Gauffriau & Peder Olesen Larsen, 2005. "Counting methods are decisive for rankings based on publication and citation studies," Scientometrics, Springer;Akadémiai Kiadó, vol. 64(1), pages 85-93, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marianne Gauffriau & Peder Olesen Larsen & Isabelle Maye & Anne Roulin-Perriard & Markus Ins, 2007. "Publication, cooperation and productivity measures in scientific research," Scientometrics, Springer;Akadémiai Kiadó, vol. 73(2), pages 175-214, November.
    2. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    3. Osório, António (António Miguel), 2019. "The value and credits of n-authors publications," Working Papers 2072/376026, Universitat Rovira i Virgili, Department of Economics.
    4. Bar-Ilan, Judit, 2008. "Informetrics at the beginning of the 21st century—A review," Journal of Informetrics, Elsevier, vol. 2(1), pages 1-52.
    5. Peder Olesen Larsen, 2008. "The state of the art in publication counting," Scientometrics, Springer;Akadémiai Kiadó, vol. 77(2), pages 235-251, November.
    6. Sandro Tarkhan-Mouravi, 2020. "Traditional indicators inflate some countries’ scientific impact over 10 times," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(1), pages 337-356, April.
    7. Tanel Hirv, 2022. "The interplay of the size of the research system, ways of collaboration, level, and method of funding in determining bibliometric outputs," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(3), pages 1295-1316, March.
    8. António Osório, 2018. "On the impossibility of a perfect counting method to allocate the credits of multi-authored publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 2161-2173, September.
    9. Alonso Rodríguez-Navarro & Francis Narin, 2018. "European Paradox or Delusion—Are European Science and Economy Outdated?," Science and Public Policy, Oxford University Press, vol. 45(1), pages 14-23.
    10. Bo Jarneving, 2010. "Regional research and foreign collaboration," Scientometrics, Springer;Akadémiai Kiadó, vol. 83(1), pages 295-320, April.
    11. Sonia R. Zanotto & Cristina Haeffner & Jorge A. Guimarães, 2016. "Unbalanced international collaboration affects adversely the usefulness of countries’ scientific output as well as their technological and social impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 1789-1814, December.
    12. Lowe, D. Jordan & Van Fleet, David D., 2009. "Scholarly achievement and accounting journal editorial board membership," Journal of Accounting Education, Elsevier, vol. 27(4), pages 197-209.
    13. Liu, Xuan Zhen & Fang, Hui, 2023. "A geometric counting method adaptive to the author number," Journal of Informetrics, Elsevier, vol. 17(2).
    14. Pär Sundling, 2023. "Author contributions and allocation of authorship credit: testing the validity of different counting methods in the field of chemical biology," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(5), pages 2737-2762, May.
    15. Jia Zheng & Zhiyun Zhao & Xu Zhang & Mu-hsuan Huang & Dar-zen Chen, 2014. "Influences of counting methods on country rankings: a perspective from patent analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(3), pages 2087-2102, March.
    16. de Oliveira, Thaiane Moreira & de Albuquerque, Sofia & Toth, Janderson Pereira & Bello, Debora Zava, 2018. "International cooperation networks of the BRICS bloc," SocArXiv b6x43, Center for Open Science.
    17. Kim, Jinseok & Kim, Jinmo, 2015. "Rethinking the comparison of coauthorship credit allocation schemes," Journal of Informetrics, Elsevier, vol. 9(3), pages 667-673.
    18. Rahman, Mohammad Tariqur & Regenstein, Joe Mac & Kassim, Noor Lide Abu & Haque, Nazmul, 2017. "The need to quantify authors’ relative intellectual contributions in a multi-author paper," Journal of Informetrics, Elsevier, vol. 11(1), pages 275-281.
    19. Bagues, Manuel & Sylos-Labini, Mauro & Zinovyeva, Natalia, 2019. "A walk on the wild side: ‘Predatory’ journals and information asymmetries in scientific evaluations," Research Policy, Elsevier, vol. 48(2), pages 462-477.
    20. Carmen Osuna & Laura Cruz Castro & Luis Sanz Menéndez, 2010. "Knocking down some Assumptions about the Effects of Evaluation Systems on Publications," Working Papers 1010, Instituto de Políticas y Bienes Públicos (IPP), CSIC.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:77:y:2008:i:1:d:10.1007_s11192-007-1934-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.