IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v77y2008i2d10.1007_s11192-007-1991-6.html
   My bibliography  Save this article

The state of the art in publication counting

Author

Listed:
  • Peder Olesen Larsen

Abstract

The proceedings of the ISSI conferences in Stockholm, 2005, and Madrid, 2007, contain 85 contributions based on publication counting. The methods used in these contributions have been analyzed. The counting methods used are stated explicitly in 26 contributions and can be derived implicitly from the discussion of methods in 10 contributions. In only five contributions, there is a justification for the choice of method. Only one contribution gives information about different results obtained by using different methods. The non-additive results from whole counting give problems in the calculation of shares in seven contributions, but these problems are not mentioned. Only 11 contributions give a term (terms) for the counting method(s) used. To illustrate the problems, 11 of the contributions are discussed in detail. The conclusion is that 40 years of publication counting have not resulted in general agreement on definitions of methods and terminology nor in any kind of standardization.

Suggested Citation

  • Peder Olesen Larsen, 2008. "The state of the art in publication counting," Scientometrics, Springer;Akadémiai Kiadó, vol. 77(2), pages 235-251, November.
    • Handle: RePEc:spr:scient:v:77:y:2008:i:2:d:10.1007_s11192-007-1991-6
    DOI: 10.1007/s11192-007-1991-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-007-1991-6
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-007-1991-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. J Sylvan Katz, 2000. "Scale-independent indicators and research evaluation," Science and Public Policy, Oxford University Press, vol. 27(1), pages 23-36, February.
    2. Marianne Gauffriau & Peder Olesen Larsen & Isabelle Maye & Anne Roulin-Perriard & Markus Ins, 2008. "Comparisons of results of publication counting using different methods," Scientometrics, Springer;Akadémiai Kiadó, vol. 77(1), pages 147-176, October.
    3. Olle Persson & Wolfgang Glänzel & Rickard Danell, 2004. "Inflationary bibliometric values: The role of scientific collaboration and the need for relative indicators in evaluative studies," Scientometrics, Springer;Akadémiai Kiadó, vol. 60(3), pages 421-432, August.
    4. Marianne Gauffriau & Peder Olesen Larsen & Isabelle Maye & Anne Roulin-Perriard & Markus Ins, 2007. "Publication, cooperation and productivity measures in scientific research," Scientometrics, Springer;Akadémiai Kiadó, vol. 73(2), pages 175-214, November.
    5. David A. King, 2004. "The scientific impact of nations," Nature, Nature, vol. 430(6997), pages 311-316, July.
    6. Marianne Gauffriau & Peder Olesen Larsen, 2005. "Counting methods are decisive for rankings based on publication and citation studies," Scientometrics, Springer;Akadémiai Kiadó, vol. 64(1), pages 85-93, July.
    7. Zhou, Ping & Leydesdorff, Loet, 2006. "The emergence of China as a leading nation in science," Research Policy, Elsevier, vol. 35(1), pages 83-104, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hagen, Nils T., 2014. "Reversing the byline hierarchy: The effect of equalizing bias on the accreditation of primary, secondary and senior authors," Journal of Informetrics, Elsevier, vol. 8(3), pages 618-627.
    2. R. Bjørk, 2020. "Response to the comments of Turki et al. on “The journals that publish Nobel Prize research”," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 791-793, July.
    3. Primož Južnič & Stojan Pečlin & Matjaž Žaucer & Tilen Mandelj & Miro Pušnik & Franci Demšar, 2010. "Scientometric indicators: peer-review, bibliometric methods and conflict of interests," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(2), pages 429-441, November.
    4. Nils T. Hagen, 2010. "Harmonic publication and citation counting: sharing authorship credit equitably – not equally, geometrically or arithmetically," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(3), pages 785-793, September.
    5. William H. Walters & Esther Isabelle Wilder, 2015. "Worldwide contributors to the literature of library and information science: top authors, 2007–2012," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(1), pages 301-327, April.
    6. Sjoerd Hardeman, 2013. "Organization level research in scientometrics: a plea for an explicit pragmatic approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(3), pages 1175-1194, March.
    7. Gauffriau, Marianne, 2017. "A categorization of arguments for counting methods for publication and citation indicators," Journal of Informetrics, Elsevier, vol. 11(3), pages 672-684.
    8. Waltman, Ludo & van Eck, Nees Jan, 2015. "Field-normalized citation impact indicators and the choice of an appropriate counting method," Journal of Informetrics, Elsevier, vol. 9(4), pages 872-894.
    9. Oguz K. Baskurt, 2011. "Time series analysis of publication counts of a university: what are the implications?," Scientometrics, Springer;Akadémiai Kiadó, vol. 86(3), pages 645-656, March.
    10. Fredrik Niclas Piro & Dag W. Aksnes & Kristoffer Rørstad, 2013. "A macro analysis of productivity differences across fields: Challenges in the measurement of scientific publishing," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(2), pages 307-320, February.
    11. Hagen, Nils T., 2014. "Counting and comparing publication output with and without equalizing and inflationary bias," Journal of Informetrics, Elsevier, vol. 8(2), pages 310-317.
    12. Mallig, Nicolai, 2010. "A relational database for bibliometric analysis," Journal of Informetrics, Elsevier, vol. 4(4), pages 564-580.
    13. Roberta Ruggieri & Fabrizio Pecoraro & Daniela Luzi, 2021. "An intersectional approach to analyse gender productivity and open access: a bibliometric analysis of the Italian National Research Council," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1647-1673, February.
    14. Korytkowski, Przemyslaw & Kulczycki, Emanuel, 2019. "Publication counting methods for a national research evaluation exercise," Journal of Informetrics, Elsevier, vol. 13(3), pages 804-816.
    15. Mallig, Nicolai, 2010. "A relational database for bibliometric analysis," Discussion Papers "Innovation Systems and Policy Analysis" 22, Fraunhofer Institute for Systems and Innovation Research (ISI).
    16. Emanuel Kulczycki & Przemysław Korytkowski, 2020. "Researchers publishing monographs are more productive and more local-oriented," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1371-1387, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marianne Gauffriau & Peder Olesen Larsen & Isabelle Maye & Anne Roulin-Perriard & Markus Ins, 2008. "Comparisons of results of publication counting using different methods," Scientometrics, Springer;Akadémiai Kiadó, vol. 77(1), pages 147-176, October.
    2. de Oliveira, Thaiane Moreira & de Albuquerque, Sofia & Toth, Janderson Pereira & Bello, Debora Zava, 2018. "International cooperation networks of the BRICS bloc," SocArXiv b6x43, Center for Open Science.
    3. Tanel Hirv, 2022. "The interplay of the size of the research system, ways of collaboration, level, and method of funding in determining bibliometric outputs," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(3), pages 1295-1316, March.
    4. Zhenyue Zhao & Xuelian Pan & Weina Hua, 2021. "Comparative analysis of the research productivity, publication quality, and collaboration patterns of top ranked library and information science schools in China and the United States," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 931-950, February.
    5. Jesper W. Schneider & Thed Leeuwen & Martijn Visser & Kaare Aagaard, 2019. "Examining national citation impact by comparing developments in a fixed and a dynamic journal set," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 973-985, May.
    6. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    7. Sandro Tarkhan-Mouravi, 2020. "Traditional indicators inflate some countries’ scientific impact over 10 times," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(1), pages 337-356, April.
    8. Tianwei He, 2009. "International scientific collaboration of China with the G7 countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 80(3), pages 571-582, September.
    9. Wolfgang G. Stock & Isabelle Dorsch & Gerhard Reichmann & Christian Schlögl, 2023. "Labor productivity, labor impact, and co-authorship of research institutions: publications and citations per full-time equivalents," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(1), pages 363-377, January.
    10. Sonia R. Zanotto & Cristina Haeffner & Jorge A. Guimarães, 2016. "Unbalanced international collaboration affects adversely the usefulness of countries’ scientific output as well as their technological and social impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 1789-1814, December.
    11. Ugo Finardi, 2015. "Scientific collaboration between BRICS countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(2), pages 1139-1166, February.
    12. Waltman, Ludo & van Eck, Nees Jan, 2015. "Field-normalized citation impact indicators and the choice of an appropriate counting method," Journal of Informetrics, Elsevier, vol. 9(4), pages 872-894.
    13. Jia Zheng & Zhiyun Zhao & Xu Zhang & Mu-hsuan Huang & Dar-zen Chen, 2014. "Influences of counting methods on country rankings: a perspective from patent analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(3), pages 2087-2102, March.
    14. Yves Gingras & Mahdi Khelfaoui, 2018. "Assessing the effect of the United States’ “citation advantage” on other countries’ scientific impact as measured in the Web of Science (WoS) database," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(2), pages 517-532, February.
    15. Jo Royle & Louisa Coles & Dorothy Williams & Paul Evans, 2007. "Publishing in international journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 71(1), pages 59-86, April.
    16. Maziar Montazerian & Edgar Dutra Zanotto & Hellmut Eckert, 2019. "A new parameter for (normalized) evaluation of H-index: countries as a case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(3), pages 1065-1078, March.
    17. Gregory J Hather & Winston Haynes & Roger Higdon & Natali Kolker & Elizabeth A Stewart & Peter Arzberger & Patrick Chain & Dawn Field & B Robert Franza & Biaoyang Lin & Folker Meyer & Vural Ozdemir & , 2010. "The United States of America and Scientific Research," PLOS ONE, Public Library of Science, vol. 5(8), pages 1-9, August.
    18. Chaocheng He & Jiang Wu & Qingpeng Zhang, 2021. "Characterizing research leadership on geographically weighted collaboration network," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(5), pages 4005-4037, May.
    19. Reinhilde Veugelers, 2010. "Towards a multipolar science world: trends and impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 82(2), pages 439-456, February.
    20. Albarrán, Pedro & Crespo, Juan A. & Ortuño, Ignacio & Ruiz-Castillo, Javier, 2009. "A comparison of the scientific performance of the U. S. and the European Union at the turn of the XXI century," UC3M Working papers. Economics we095534, Universidad Carlos III de Madrid. Departamento de Economía.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:77:y:2008:i:2:d:10.1007_s11192-007-1991-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.