IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v101y2014i2d10.1007_s11192-014-1291-x.html
   My bibliography  Save this article

Influence of a performance indicator on Danish research production and citation impact 2000–12

Author

Listed:
  • Peter Ingwersen

    (University of Copenhagen)

  • Birger Larsen

    (Aalborg University Copenhagen)

Abstract

This paper analyses the patterns of Danish research productivity, citation impact and (inter)national collaboration across document types 2000–2012, prior to and after the introduction of the Norwegian publication point-based performance indicator in 2008. Document types analysed are: research articles; conference proceedings papers excluding meeting abstracts; and review articles. The Danish Research & Innovation Agency’s basic statistics combined with Web of Science (WoS) are used for data collection and analyses. Findings demonstrate that the research article productivity increases steeply (37 %) after the start of the performance indicator and the citation impact progresses linearly over the entire period, regardless the introduction of the performance indicator. Academic staff progression is only 24 % during the same time period. The collaboration ratio between purely Danish and internationally cooperated research articles remains stable during the period, the number of collaborative countries increases while the ratio declines significantly for proceedings papers. The citation impact of internationally cooperated research articles increases since 2009 but drops for proceedings papers; also their productivity declines slightly from 2009 according to Research Agency statistics. Since 2006 the WoS indexing of proceedings papers is fast declining; as a consequence the ratio between Danish proceedings papers and research articles declines in WoS. According to Research Agency statistics a decline likewise takes place, starting from 2009. The positive growth in research articles mainly derives from the Science and Technology fields published in prestigious Level 2 journals; the development of articles published in less prestigious Level 1 journals derives from all fields. Three of the eight Danish universities have significantly altered their research publication profiles since 2009. The publication performance model is regarded as the significant accelerator of these processes in recent years.

Suggested Citation

  • Peter Ingwersen & Birger Larsen, 2014. "Influence of a performance indicator on Danish research production and citation impact 2000–12," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(2), pages 1325-1344, November.
    • Handle: RePEc:spr:scient:v:101:y:2014:i:2:d:10.1007_s11192-014-1291-x
    DOI: 10.1007/s11192-014-1291-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-014-1291-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-014-1291-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Waister Silva Martins & Marcos André Gonçalves & Alberto H. F. Laender & Nivio Ziviani, 2010. "Assessing the quality of scientific conferences based on bibliographic citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 83(1), pages 133-155, April.
    2. Linda Butler & Martijn S. Visser, 2006. "Extending citation analysis to non-source items," Scientometrics, Springer;Akadémiai Kiadó, vol. 66(2), pages 327-343, February.
    3. Anthony F. J. van Raan, 2005. "Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods," Scientometrics, Springer;Akadémiai Kiadó, vol. 62(1), pages 133-143, January.
    4. Butler, Linda, 2003. "Explaining Australia's increased share of ISI publications--the effects of a funding formula based on publication counts," Research Policy, Elsevier, vol. 32(1), pages 143-155, January.
    5. Ying He & Jiancheng Guan, 2008. "Contribution of Chinese publications in computer science: A case study on LNCS," Scientometrics, Springer;Akadémiai Kiadó, vol. 75(3), pages 519-534, June.
    6. Truyken L. B. Ossenblok & Tim C. E. Engels & Gunnar Sivertsen, 2012. "The representation of the social sciences and humanities in the Web of Science--a comparison of publication patterns and incentive structures in Flanders and Norway (2005--9)," Research Evaluation, Oxford University Press, vol. 21(4), pages 280-290, September.
    7. A. Raan, 1999. "Advanced bibliometric methods for the evaluation of universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 45(3), pages 417-423, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Iman Tahamtan & Askar Safipour Afshar & Khadijeh Ahamdzadeh, 2016. "Factors affecting number of citations: a comprehensive review of the literature," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(3), pages 1195-1225, June.
    2. Giovanni Abramo & Ciriaco Andrea D’Angelo & Myroslava Hladchenko, 2023. "Assessing the effects of publication requirements for professorship on research performance and publishing behaviour of Ukrainian academics," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4589-4609, August.
    3. Christian Schneijderberg & Nicolai Götze & Lars Müller, 2022. "A study of 25 years of publication outputs in the German academic profession," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 1-28, January.
    4. Laura Himanen & Hanna-Mari Puuska, 2022. "Does monitoring performance act as an incentive for improving research performance? National and organizational level analysis of Finnish universities," Research Evaluation, Oxford University Press, vol. 31(2), pages 236-248.
    5. Peter Ingwersen & Birger Larsen & J. Carlos Garcia-Zorita & Antonio Eleazar Serrano-López & Elias Sanz-Casado, 2014. "Influence of proceedings papers on citation impact in seven sub-fields of sustainable energy research 2005–2011," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(2), pages 1273-1292, November.
    6. Marina Pilkina & Andrey Lovakov, 2022. "Gender disparities in Russian academia: a bibliometric analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3577-3591, June.
    7. Alberto Baccini & Giuseppe De Nicolao & Eugenio Petrovich, 2019. "Citation gaming induced by bibliometric evaluation: A country-level comparative analysis," PLOS ONE, Public Library of Science, vol. 14(9), pages 1-16, September.
    8. Fan, Lingxu & Guo, Lei & Wang, Xinhua & Xu, Liancheng & Liu, Fangai, 2022. "Does the author’s collaboration mode lead to papers’ different citation impacts? An empirical analysis based on propensity score matching," Journal of Informetrics, Elsevier, vol. 16(4).
    9. Elea Giménez-Toledo & Jorge Mañana-Rodríguez & Tim C. E. Engels & Peter Ingwersen & Janne Pölönen & Gunnar Sivertsen & Frederik T. Verleysen & Alesia A. Zuccala, 2016. "Taking scholarly books into account: current developments in five European countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(2), pages 685-699, May.
    10. Mingyang Wang & Zhenyu Wang & Guangsheng Chen, 2019. "Which can better predict the future success of articles? Bibliometric indices or alternative metrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(3), pages 1575-1595, June.
    11. Daniela Filippo & Rafael Aleixandre-Benavent & Elías Sanz-Casado, 2020. "Toward a classification of Spanish scholarly journals in social sciences and humanities considering their impact and visibility," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1709-1732, November.
    12. Harlley Lima & Thiago H. P. Silva & Mirella M. Moro & Rodrygo L. T. Santos & Wagner Meira & Alberto H. F. Laender, 2015. "Assessing the profile of top Brazilian computer science researchers," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(3), pages 879-896, June.
    13. Truyken L. B. Ossenblok & Tim C. E. Engels, 2015. "Edited books in the Social Sciences and Humanities: Characteristics and collaboration analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(1), pages 219-237, July.
    14. Elías Sanz-Casado & Daniela Filippo & Rafael Aleixandre Benavent & Vidar Røeggen & Janne Pölönen, 2021. "Impact and visibility of Norwegian, Finnish and Spanish journals in the fields of humanities," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(11), pages 9031-9049, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mehdi Rhaiem & Nabil Amara, 2020. "Determinants of research efficiency in Canadian business schools: evidence from scholar-level data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 53-99, October.
    2. Peter Ingwersen & Birger Larsen & J. Carlos Garcia-Zorita & Antonio Eleazar Serrano-López & Elias Sanz-Casado, 2014. "Influence of proceedings papers on citation impact in seven sub-fields of sustainable energy research 2005–2011," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(2), pages 1273-1292, November.
    3. Auranen, Otto & Nieminen, Mika, 2010. "University research funding and publication performance--An international comparison," Research Policy, Elsevier, vol. 39(6), pages 822-834, July.
    4. Ruimin Ma & Chaoqun Ni & Junping Qiu, 2008. "Scientific research competitiveness of world universities in computer science," Scientometrics, Springer;Akadémiai Kiadó, vol. 76(2), pages 245-260, August.
    5. Giovanni Abramo & Ciriaco Andrea D’Angelo & Flavia Di Costa, 2011. "A national-scale cross-time analysis of university research performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(2), pages 399-413, May.
    6. Bar-Ilan, Judit, 2008. "Informetrics at the beginning of the 21st century—A review," Journal of Informetrics, Elsevier, vol. 2(1), pages 1-52.
    7. Mallig, Nicolai, 2010. "A relational database for bibliometric analysis," Journal of Informetrics, Elsevier, vol. 4(4), pages 564-580.
    8. Margit Osterloh & Bruno S. Frey, 2010. "Academic rankings and research governance," IEW - Working Papers 482, Institute for Empirical Research in Economics - University of Zurich.
    9. Margit Osterloh & Bruno S. Frey, 2009. "Research Governance in Academia: Are there Alternatives to Academic Rankings?," CREMA Working Paper Series 2009-17, Center for Research in Economics, Management and the Arts (CREMA).
    10. Danielle H. Lee, 2019. "Predictive power of conference-related factors on citation rates of conference papers," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(1), pages 281-304, January.
    11. Mallig, Nicolai, 2010. "A relational database for bibliometric analysis," Discussion Papers "Innovation Systems and Policy Analysis" 22, Fraunhofer Institute for Systems and Innovation Research (ISI).
    12. Thed N. Leeuwen & Erik Wijk & Paul F. Wouters, 2016. "Bibliometric analysis of output and impact based on CRIS data: a case study on the registered output of a Dutch university," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(1), pages 1-16, January.
    13. Berlemann, Michael & Haucap, Justus, 2015. "Which factors drive the decision to opt out of individual research rankings? An empirical study of academic resistance to change," Research Policy, Elsevier, vol. 44(5), pages 1108-1115.
    14. Gobinda Chowdhury & Kushwanth Koya & Pete Philipson, 2016. "Measuring the Impact of Research: Lessons from the UK’s Research Excellence Framework 2014," PLOS ONE, Public Library of Science, vol. 11(6), pages 1-15, June.
    15. Xiancheng Li & Wenge Rong & Haoran Shi & Jie Tang & Zhang Xiong, 2018. "The impact of conference ranking systems in computer science: a comparative regression analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(2), pages 879-907, August.
    16. Daniella Bayle Deutz & Thea Marie Drachen & Dorte Drongstrup & Niels Opstrup & Charlotte Wien, 2021. "Quantitative quality: a study on how performance-based measures may change the publication patterns of Danish researchers," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 3303-3320, April.
    17. Giovanni Abramo & Ciriaco Andrea D'Angelo, 2015. "The VQR, Italy's second national research assessment: Methodological failures and ranking distortions," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(11), pages 2202-2214, November.
    18. Alfonso Ibáñez & Pedro Larrañaga & Concha Bielza, 2013. "Cluster methods for assessing research performance: exploring Spanish computer science," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(3), pages 571-600, December.
    19. Giovanni Abramo & Ciriaco Andrea D’Angelo & Myroslava Hladchenko, 2023. "Assessing the effects of publication requirements for professorship on research performance and publishing behaviour of Ukrainian academics," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4589-4609, August.
    20. Mingers, John & Leydesdorff, Loet, 2015. "A review of theory and practice in scientometrics," European Journal of Operational Research, Elsevier, vol. 246(1), pages 1-19.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:101:y:2014:i:2:d:10.1007_s11192-014-1291-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.