IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v112y2017i3d10.1007_s11192-017-2450-7.html
   My bibliography  Save this article

Measuring, analysis and visualization of research capacity of university at the level of departments and staff members

Author

Listed:
  • Maxim Kotsemir

    (National Research University Higher School of Economics)

  • Sergey Shashnov

    (National Research University Higher School of Economics)

Abstract

This paper is devoted to the challenges of measuring, analyzing and visualizing research capacity of university. We identify the related methodological issues, propose solutions and apply these solutions to a complex analysis of the research potential of three departments of a Russian university. First, we briefly review the current literature on different aspects of an analysis of research capacity of university. The next step is a discussion on the key challenges faced when analyzing the publication activity of a university. Further, we discuss the opportunities offered by and limitations of using the Web of Science and Scopus databases to determine the research capabilities of universities. In the empirical section of the paper, we analyse the research capacity of university departments and individual employees using simple yet illustrative tools of bibliometric analysis. We also make recommendations for university administrative personnel, which can be derived from our analysis.

Suggested Citation

  • Maxim Kotsemir & Sergey Shashnov, 2017. "Measuring, analysis and visualization of research capacity of university at the level of departments and staff members," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(3), pages 1659-1689, September.
    • Handle: RePEc:spr:scient:v:112:y:2017:i:3:d:10.1007_s11192-017-2450-7
    DOI: 10.1007/s11192-017-2450-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-017-2450-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-017-2450-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jian Wang & Kaspars Berzins & Diana Hicks & Julia Melkers & Fang Xiao & Diogo Pinheiro, 2012. "A boosted-trees method for name disambiguation," Scientometrics, Springer;Akadémiai Kiadó, vol. 93(2), pages 391-411, November.
    2. Igor Podlubny, 2005. "Comparison of scientific impact expressed by the number of citations in different fields of science," Scientometrics, Springer;Akadémiai Kiadó, vol. 64(1), pages 95-99, July.
    3. Elizabeth S. Vieira & José A. N. F. Gomes, 2009. "A comparison of Scopus and Web of Science for a typical university," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(2), pages 587-600, November.
    4. Abramo, Giovanni & D’Angelo, Ciriaco Andrea & Soldatenkova, Anastasiia, 2016. "The ratio of top scientists to the academic staff as an indicator of the competitive strength of universities," Journal of Informetrics, Elsevier, vol. 10(2), pages 596-605.
    5. Moed, H. F. & Burger, W. J. M. & Frankfort, J. G. & Van Raan, A. F. J., 1985. "The use of bibliometric data for the measurement of university research performance," Research Policy, Elsevier, vol. 14(3), pages 131-149, June.
    6. Anthony F.J. van Raan, 2008. "Bibliometric statistical properties of the 100 largest European research universities: Prevalent scaling rules in the science system," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 59(3), pages 461-475, February.
    7. Loet Leydesdorff & Lutz Bornmann, 2011. "How fractional counting of citations affects the impact factor: Normalization in terms of differences in citation potentials among fields of science," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(2), pages 217-229, February.
    8. Hsuan-I Liu & Bi-Chun Chang & Kuan-Chia Chen, 2012. "Collaboration patterns of Taiwanese scientific publications in various research areas," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(1), pages 145-155, July.
    9. James D. O’Leary & Mark W. Crawford & Eva Jurczyk & Alison Buchan, 2015. "Benchmarking bibliometrics in biomedical research: research performance of the University of Toronto’s Faculty of Medicine, 2008–2012," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(1), pages 311-321, October.
    10. Thomas Gurney & Edwin Horlings & Peter van den Besselaar, 2012. "Author disambiguation using multi-aspect similarity indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(2), pages 435-449, May.
    11. Themis Lazaridis, 2010. "Ranking university departments using the mean h-index," Scientometrics, Springer;Akadémiai Kiadó, vol. 82(2), pages 211-216, February.
    12. Mohammad A. Abolghassemi Fakhree & Abolghasem Jouyban, 2011. "Scientometric analysis of the major Iranian medical universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(1), pages 205-220, April.
    13. Maxim Kotsemir, 2012. "Dynamics of Russian and World Science through the Prism of International Publications," Foresight and STI Governance (Foresight-Russia till No. 3/2015), National Research University Higher School of Economics, vol. 6(1), pages 38-58.
    14. Zehra Taşkın & Umut Al, 2014. "Standardization problem of author affiliations in citation indexes," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(1), pages 347-368, January.
    15. Courtault, Jean-Michel & Hayek, Naïla & Rimbaux, Eric & Zhu, Tong, 2010. "Research in economics and management in France: A bibliometric study using the h-index," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 39(2), pages 329-337, April.
    16. Abramo, Giovanni & Cicero, Tindaro & D’Angelo, Ciriaco Andrea, 2013. "The impact of unproductive and top researchers on overall university research performance," Journal of Informetrics, Elsevier, vol. 7(1), pages 166-175.
    17. Éric Archambault & David Campbell & Yves Gingras & Vincent Larivière, 2009. "Comparing bibliometric statistics obtained from the Web of Science and Scopus," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 60(7), pages 1320-1326, July.
    18. Grant Lewison, 2001. "The quantity and quality of female researchers: A bibliometric study of Iceland," Scientometrics, Springer;Akadémiai Kiadó, vol. 52(1), pages 29-43, September.
    19. Tian, Yangge & Wen, Cheng & Hong, Song, 2008. "Global scientific production on GIS research by bibliometric analysis from 1997 to 2006," Journal of Informetrics, Elsevier, vol. 2(1), pages 65-74.
    20. Pascal Cuxac & Jean-Charles Lamirel & Valerie Bonvallot, 2013. "Efficient supervised and semi-supervised approaches for affiliations disambiguation," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(1), pages 47-58, October.
    21. Anthony F. J. Raan, 2006. "Comparison of the Hirsch-index with standard bibliometric indicators and with peer judgment for 147 chemistry research groups," Scientometrics, Springer;Akadémiai Kiadó, vol. 67(3), pages 491-502, June.
    22. Loet Leydesdorff & Jung C. Shin, 2011. "How to evaluate universities in terms of their relative citation impacts: Fractional counting of citations and the normalization of differences among disciplines," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(6), pages 1146-1155, June.
    23. Shuiqing Huang & Bo Yang & Sulan Yan & Ronald Rousseau, 2014. "Institution name disambiguation for research assessment," Scientometrics, Springer;Akadémiai Kiadó, vol. 99(3), pages 823-838, June.
    24. Maria Bordons & M. T. Fernández & Isabel Gómez, 2002. "Advantages and limitations in the use of impact factor measures for the assessment of research performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 53(2), pages 195-206, February.
    25. José M. Soler, 2007. "Separating the articles of authors with the same name," Scientometrics, Springer;Akadémiai Kiadó, vol. 72(2), pages 281-290, August.
    26. Herman Van den Berghe & Josee A. Houben & Renger E. de Bruin & Henk F. Moed & André Kint & Marc Luwel & Eric H. J. Spruyt, 1998. "Bibliometric indicators of university research performance in Flanders," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 49(1), pages 59-67.
    27. Andreas Strotmann & Dangzhi Zhao, 2012. "Author name disambiguation: What difference does it make in author-based citation analysis?," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(9), pages 1820-1833, September.
    28. Amanda H Goodall, 2005. "Should top universities be led by top researchers, and are they?," General Economics and Teaching 0510003, University Library of Munich, Germany.
    29. Yong Jiang & Hai-Tao Zheng & Xinmin Wang & Binggan Lu & Kaihua Wu, 2011. "Affiliation disambiguation for constructing semantic digital libraries," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(6), pages 1029-1041, June.
    30. Andreas Strotmann & Dangzhi Zhao, 2012. "Author name disambiguation: What difference does it make in author‐based citation analysis?," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 63(9), pages 1820-1833, September.
    31. Nian Cai Liu & Ying Cheng & Li Liu, 2005. "Academic ranking of world universities using scientometrics - A comment to the “Fatal Attraction”," Scientometrics, Springer;Akadémiai Kiadó, vol. 64(1), pages 101-109, July.
    32. Nikolaos A. Kazakis, 2014. "Bibliometric evaluation of the research performance of the Greek civil engineering departments in National and European context," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(1), pages 505-525, October.
    33. Yong Jiang & Hai‐Tao Zheng & Xinmin Wang & Binggan Lu & Kaihua Wu, 2011. "Affiliation disambiguation for constructing semantic digital libraries," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(6), pages 1029-1041, June.
    34. Jung Cheol Shin & William K. Cummings, 2010. "Multilevel analysis of academic publishing across disciplines: research preference, collaboration, and time on research," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(2), pages 581-594, November.
    35. Franklin G. Mixon & Kamal P. Upadhyaya, 2016. "Ranking economics departments in the US South: an update," Applied Economics Letters, Taylor & Francis Journals, vol. 23(17), pages 1224-1228, November.
    36. Franklin Mixon & Kamal Upadhyaya, 2001. "Ranking economics departments in the US South," Applied Economics Letters, Taylor & Francis Journals, vol. 8(2), pages 115-119.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Köksal Şahin & Gökçe Candan, 2018. "Scientific productivity and cooperation in Turkic world: a bibliometric analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(3), pages 1199-1229, June.
    2. Maxim Kotsemir, 2019. "Unmanned aerial vehicles research in Scopus: an analysis and visualization of publication activity and research collaboration at the country level," Quality & Quantity: International Journal of Methodology, Springer, vol. 53(4), pages 2143-2173, July.
    3. Vadim N. Gureyev & Nikolay A. Mazov & Denis V. Kosyakov & Andrey E. Guskov, 2020. "Review and analysis of publications on scientific mobility: assessment of influence, motivation, and trends," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(2), pages 1599-1630, August.
    4. Renata Kudaibergenova & Sandugash Uzakbay & Asselya Makanova & Kymbat Ramadinkyzy & Erlan Kistaubayev & Ruslan Dussekeev & Kadyrzhan Smagulov, 2022. "Managing publication change at Al-Farabi Kazakh National University: a case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 453-479, January.
    5. Gennaro Guida, 2018. "Italian Economics Departments’ Scientific Research Performance: Comparison between VQR and ASN Methodologies," International Journal of Business and Management, Canadian Center of Science and Education, vol. 13(9), pages 182-182, August.
    6. Luigi Aldieri & Gennaro Guida & Maxim Kotsemir & Concetto Paolo Vinci, 2019. "An investigation of impact of research collaboration on academic performance in Italy," Quality & Quantity: International Journal of Methodology, Springer, vol. 53(4), pages 2003-2040, July.
    7. Sergey Shashnov & Maxim Kotsemir, 2018. "Research landscape of the BRICS countries: current trends in research output, thematic structures of publications, and the relative influence of partners," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(2), pages 1115-1155, November.
    8. Andrey E. Guskov & Denis V. Kosyakov & Irina V. Selivanova, 2018. "Boosting research productivity in top Russian universities: the circumstances of breakthrough," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(2), pages 1053-1080, November.
    9. Lin Zhu & Junjie Zhang & Scott W. Cunningham, 2022. "Domain expertise extraction for finding rising stars," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(9), pages 5475-5495, September.
    10. Koh Yamamoto & Takuo Yasunaga, 2022. "A percentile rank score of group productivity: an evaluation of publication productivity for researchers from various fields," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(4), pages 1737-1754, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andrea Ancona & Roy Cerqueti & Gianluca Vagnani, 2023. "A novel methodology to disambiguate organization names: an application to EU Framework Programmes data," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4447-4474, August.
    2. Hui-Zhen Fu & Yuh-Shan Ho, 2013. "Comparison of independent research of China’s top universities using bibliometric indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(1), pages 259-276, July.
    3. Ciriaco Andrea D’Angelo & Nees Jan Eck, 2020. "Collecting large-scale publication data at the level of individual researchers: a practical proposal for author name disambiguation," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(2), pages 883-907, May.
    4. Omar Hernando Avila-Poveda, 2014. "Technical report: the trend of author compound names and its implications for authorship identity identification," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(1), pages 833-846, October.
    5. Rehs, Andreas, 2021. "A supervised machine learning approach to author disambiguation in the Web of Science," Journal of Informetrics, Elsevier, vol. 15(3).
    6. Shuiqing Huang & Bo Yang & Sulan Yan & Ronald Rousseau, 2014. "Institution name disambiguation for research assessment," Scientometrics, Springer;Akadémiai Kiadó, vol. 99(3), pages 823-838, June.
    7. Giovanni Abramo & Corrado Costa & Ciriaco Andrea D’Angelo, 2015. "A multivariate stochastic model to assess research performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(2), pages 1755-1772, February.
    8. Pascal Cuxac & Jean-Charles Lamirel & Valerie Bonvallot, 2013. "Efficient supervised and semi-supervised approaches for affiliations disambiguation," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(1), pages 47-58, October.
    9. Yongwen Huang & Jiao Li & Tan Sun & Guojian Xian, 2020. "Institution information specification and correlation based on institutional PIDs and IND tool," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(1), pages 381-396, January.
    10. Franceschini, Fiorenzo & Maisano, Domenico, 2011. "Structured evaluation of the scientific output of academic research groups by recent h-based indicators," Journal of Informetrics, Elsevier, vol. 5(1), pages 64-74.
    11. Jinseok Kim & Jinmo Kim & Jason Owen-Smith, 2019. "Generating automatically labeled data for author name disambiguation: an iterative clustering method," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(1), pages 253-280, January.
    12. Lutz Bornmann & Werner Marx, 2014. "How to evaluate individual researchers working in the natural and life sciences meaningfully? A proposal of methods based on percentiles of citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(1), pages 487-509, January.
    13. Bar-Ilan, Judit, 2008. "Informetrics at the beginning of the 21st century—A review," Journal of Informetrics, Elsevier, vol. 2(1), pages 1-52.
    14. Hu, Ya-Han & Tai, Chun-Tien & Liu, Kang Ernest & Cai, Cheng-Fang, 2020. "Identification of highly-cited papers using topic-model-based and bibliometric features: the consideration of keyword popularity," Journal of Informetrics, Elsevier, vol. 14(1).
    15. Luigi Aldieri & Gennaro Guida & Maxim Kotsemir & Concetto Paolo Vinci, 2019. "An investigation of impact of research collaboration on academic performance in Italy," Quality & Quantity: International Journal of Methodology, Springer, vol. 53(4), pages 2003-2040, July.
    16. Jinseok Kim & Jenna Kim & Jason Owen‐Smith, 2021. "Ethnicity‐based name partitioning for author name disambiguation using supervised machine learning," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 72(8), pages 979-994, August.
    17. Hao Wu & Bo Li & Yijian Pei & Jun He, 2014. "Unsupervised author disambiguation using Dempster–Shafer theory," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(3), pages 1955-1972, December.
    18. Sergey Shashnov & Maxim Kotsemir, 2018. "Research landscape of the BRICS countries: current trends in research output, thematic structures of publications, and the relative influence of partners," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(2), pages 1115-1155, November.
    19. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    20. Tolga Yuret, 2018. "Author-weighted impact factor and reference return ratio: can we attain more equality among fields?," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 2097-2111, September.

    More about this item

    Keywords

    University research capacity; University research performance; Publication activity; Bibliometric analysis; Bibliometric indicators; Citation analysis; Research evaluation; International citation databases; Universities; University management;
    All these keywords.

    JEL classification:

    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I20 - Health, Education, and Welfare - - Education - - - General
    • I28 - Health, Education, and Welfare - - Education - - - Government Policy

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:112:y:2017:i:3:d:10.1007_s11192-017-2450-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.