IDEAS home Printed from
   My bibliography  Save this article

Measuring, analysis and visualization of research capacity of university at the level of departments and staff members


  • Maxim Kotsemir

    () (National Research University Higher School of Economics)

  • Sergey Shashnov

    () (National Research University Higher School of Economics)


Abstract This paper is devoted to the challenges of measuring, analyzing and visualizing research capacity of university. We identify the related methodological issues, propose solutions and apply these solutions to a complex analysis of the research potential of three departments of a Russian university. First, we briefly review the current literature on different aspects of an analysis of research capacity of university. The next step is a discussion on the key challenges faced when analyzing the publication activity of a university. Further, we discuss the opportunities offered by and limitations of using the Web of Science and Scopus databases to determine the research capabilities of universities. In the empirical section of the paper, we analyse the research capacity of university departments and individual employees using simple yet illustrative tools of bibliometric analysis. We also make recommendations for university administrative personnel, which can be derived from our analysis.

Suggested Citation

  • Maxim Kotsemir & Sergey Shashnov, 2017. "Measuring, analysis and visualization of research capacity of university at the level of departments and staff members," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(3), pages 1659-1689, September.
  • Handle: RePEc:spr:scient:v:112:y:2017:i:3:d:10.1007_s11192-017-2450-7
    DOI: 10.1007/s11192-017-2450-7

    Download full text from publisher

    File URL:
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    1. Jian Wang & Kaspars Berzins & Diana Hicks & Julia Melkers & Fang Xiao & Diogo Pinheiro, 2012. "A boosted-trees method for name disambiguation," Scientometrics, Springer;Akadémiai Kiadó, vol. 93(2), pages 391-411, November.
    2. Igor Podlubny, 2005. "Comparison of scientific impact expressed by the number of citations in different fields of science," Scientometrics, Springer;Akadémiai Kiadó, vol. 64(1), pages 95-99, July.
    3. Elizabeth S. Vieira & José A. N. F. Gomes, 2009. "A comparison of Scopus and Web of Science for a typical university," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(2), pages 587-600, November.
    4. Andreas Strotmann & Dangzhi Zhao, 2012. "Author name disambiguation: What difference does it make in author-based citation analysis?," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(9), pages 1820-1833, September.
    5. Abramo, Giovanni & D’Angelo, Ciriaco Andrea & Soldatenkova, Anastasiia, 2016. "The ratio of top scientists to the academic staff as an indicator of the competitive strength of universities," Journal of Informetrics, Elsevier, vol. 10(2), pages 596-605.
    6. Moed, H. F. & Burger, W. J. M. & Frankfort, J. G. & Van Raan, A. F. J., 1985. "The use of bibliometric data for the measurement of university research performance," Research Policy, Elsevier, vol. 14(3), pages 131-149, June.
    7. Maxim Kotsemir, 2012. "Dynamics of Russian and World Science through the Prism of International Publications," Foresight and STI Governance (Foresight-Russia till No. 3/2015), National Research University Higher School of Economics, vol. 6(1), pages 38-58.
    8. Amanda H Goodall, 2005. "Should top universities be led by top researchers, and are they?," General Economics and Teaching 0510003, University Library of Munich, Germany.
    9. Loet Leydesdorff & Lutz Bornmann, 2011. "How fractional counting of citations affects the impact factor: Normalization in terms of differences in citation potentials among fields of science," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(2), pages 217-229, February.
    10. Hsuan-I Liu & Bi-Chun Chang & Kuan-Chia Chen, 2012. "Collaboration patterns of Taiwanese scientific publications in various research areas," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(1), pages 145-155, July.
    11. Yong Jiang & Hai-Tao Zheng & Xinmin Wang & Binggan Lu & Kaihua Wu, 2011. "Affiliation disambiguation for constructing semantic digital libraries," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(6), pages 1029-1041, June.
    12. James D. O’Leary & Mark W. Crawford & Eva Jurczyk & Alison Buchan, 2015. "Benchmarking bibliometrics in biomedical research: research performance of the University of Toronto’s Faculty of Medicine, 2008–2012," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(1), pages 311-321, October.
    13. Thomas Gurney & Edwin Horlings & Peter van den Besselaar, 2012. "Author disambiguation using multi-aspect similarity indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(2), pages 435-449, May.
    14. Themis Lazaridis, 2010. "Ranking university departments using the mean h-index," Scientometrics, Springer;Akadémiai Kiadó, vol. 82(2), pages 211-216, February.
    15. Mohammad A. Abolghassemi Fakhree & Abolghasem Jouyban, 2011. "Scientometric analysis of the major Iranian medical universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(1), pages 205-220, April.
    16. Zehra Taşkın & Umut Al, 2014. "Standardization problem of author affiliations in citation indexes," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(1), pages 347-368, January.
    17. Courtault, Jean-Michel & Hayek, Naïla & Rimbaux, Eric & Zhu, Tong, 2010. "Research in economics and management in France: A bibliometric study using the h-index," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 39(2), pages 329-337, April.
    18. Nian Cai Liu & Ying Cheng & Li Liu, 2005. "Academic ranking of world universities using scientometrics - A comment to the “Fatal Attraction”," Scientometrics, Springer;Akadémiai Kiadó, vol. 64(1), pages 101-109, July.
    19. Abramo, Giovanni & Cicero, Tindaro & D’Angelo, Ciriaco Andrea, 2013. "The impact of unproductive and top researchers on overall university research performance," Journal of Informetrics, Elsevier, vol. 7(1), pages 166-175.
    20. Nikolaos A. Kazakis, 2014. "Bibliometric evaluation of the research performance of the Greek civil engineering departments in National and European context," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(1), pages 505-525, October.
    21. Grant Lewison, 2001. "The quantity and quality of female researchers: A bibliometric study of Iceland," Scientometrics, Springer;Akadémiai Kiadó, vol. 52(1), pages 29-43, September.
    22. Tian, Yangge & Wen, Cheng & Hong, Song, 2008. "Global scientific production on GIS research by bibliometric analysis from 1997 to 2006," Journal of Informetrics, Elsevier, vol. 2(1), pages 65-74.
    23. Pascal Cuxac & Jean-Charles Lamirel & Valerie Bonvallot, 2013. "Efficient supervised and semi-supervised approaches for affiliations disambiguation," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(1), pages 47-58, October.
    24. Jung Cheol Shin & William K. Cummings, 2010. "Multilevel analysis of academic publishing across disciplines: research preference, collaboration, and time on research," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(2), pages 581-594, November.
    25. Loet Leydesdorff & Jung C. Shin, 2011. "How to evaluate universities in terms of their relative citation impacts: Fractional counting of citations and the normalization of differences among disciplines," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(6), pages 1146-1155, June.
    26. Franklin Mixon & Kamal Upadhyaya, 2001. "Ranking economics departments in the US South," Applied Economics Letters, Taylor & Francis Journals, vol. 8(2), pages 115-119.
    27. Shuiqing Huang & Bo Yang & Sulan Yan & Ronald Rousseau, 2014. "Institution name disambiguation for research assessment," Scientometrics, Springer;Akadémiai Kiadó, vol. 99(3), pages 823-838, June.
    28. Maria Bordons & M. T. Fernández & Isabel Gómez, 2002. "Advantages and limitations in the use of impact factor measures for the assessment of research performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 53(2), pages 195-206, February.
    29. José M. Soler, 2007. "Separating the articles of authors with the same name," Scientometrics, Springer;Akadémiai Kiadó, vol. 72(2), pages 281-290, August.
    Full references (including those not matched with items on IDEAS)


    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.

    Cited by:

    1. Luigi Aldieri & Gennaro Guida & Maxim Kotsemir & Concetto Paolo Vinci, 2019. "An investigation of impact of research collaboration on academic performance in Italy," Quality & Quantity: International Journal of Methodology, Springer, vol. 53(4), pages 2003-2040, July.
    2. Sergey Shashnov & Maxim Kotsemir, 2018. "Research landscape of the BRICS countries: current trends in research output, thematic structures of publications, and the relative influence of partners," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(2), pages 1115-1155, November.
    3. Köksal Şahin & Gökçe Candan, 2018. "Scientific productivity and cooperation in Turkic world: a bibliometric analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(3), pages 1199-1229, June.
    4. Maxim Kotsemir, 2019. "Unmanned aerial vehicles research in Scopus: an analysis and visualization of publication activity and research collaboration at the country level," Quality & Quantity: International Journal of Methodology, Springer, vol. 53(4), pages 2143-2173, July.
    5. Andrey E. Guskov & Denis V. Kosyakov & Irina V. Selivanova, 2018. "Boosting research productivity in top Russian universities: the circumstances of breakthrough," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(2), pages 1053-1080, November.

    More about this item


    University research capacity; University research performance; Publication activity; Bibliometric analysis; Bibliometric indicators; Citation analysis; Research evaluation; International citation databases; Universities; University management;

    JEL classification:

    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I20 - Health, Education, and Welfare - - Education - - - General
    • I28 - Health, Education, and Welfare - - Education - - - Government Policy


    Access and download statistics


    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:112:y:2017:i:3:d:10.1007_s11192-017-2450-7. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Sonal Shukla) or (Springer Nature Abstracting and Indexing). General contact details of provider: .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.