IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v125y2020i2d10.1007_s11192-020-03672-6.html
   My bibliography  Save this article

Research strengths identified by esteem and bibliometric indicators: a case study at the University of Vienna

Author

Listed:
  • Johannes Sorz

    (University of Vienna)

  • Wolfgang Glänzel

    (KU Leuven
    Library of the Hungarian Academy of Sciences)

  • Ursula Ulrych

    (University of Vienna)

  • Christian Gumpenberger

    (University of Vienna)

  • Juan Gorraiz

    (University of Vienna)

Abstract

The identification of one’s own research strengths is of crucial importance for research administration at universities. In this case study, two different approaches were applied to the University of Vienna. The first relies on funding and rankings information as well as on other esteem indicators. The second is based on a bibliometric analysis of the publication output. We used two alternative clusterings for publications for the bibliometric analysis: Web of Science subject categories and lists of researchers associated with esteem-indicators. Both, esteem-indicators and bibliometric analysis proved to be useful in identifying research strengths, lead to similar results and are meant to be used together to complement each other. We found that the greatest hindrance in the bibliometric approach lies in the inherent limitations of journals-assignment-based classification systems and the considerable time and efforts for more accurate researcher-based publication analyses. Further investigation on this subject, including new and alternative metrics, is needed and will be conducted in the future. However, the preliminary results already demonstrate the benefits of using esteem-factors together with bibliometric analyses for research strengths definition of universities.

Suggested Citation

  • Johannes Sorz & Wolfgang Glänzel & Ursula Ulrych & Christian Gumpenberger & Juan Gorraiz, 2020. "Research strengths identified by esteem and bibliometric indicators: a case study at the University of Vienna," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1095-1116, November.
    • Handle: RePEc:spr:scient:v:125:y:2020:i:2:d:10.1007_s11192-020-03672-6
    DOI: 10.1007/s11192-020-03672-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-020-03672-6
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-020-03672-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Wolfgang Glänzel & Henk F. Moed, 2002. "Journal impact measures in bibliometric research," Scientometrics, Springer;Akadémiai Kiadó, vol. 53(2), pages 171-193, February.
    2. William G. Ouchi, 1979. "A Conceptual Framework for the Design of Organizational Control Mechanisms," Management Science, INFORMS, vol. 25(9), pages 833-848, September.
    3. Ismael Rafols & Alan L. Porter & Loet Leydesdorff, 2010. "Science overlay maps: A new tool for research policy and library management," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 61(9), pages 1871-1887, September.
    4. Juan Gorraiz & Christian Gumpenberger, 2015. "A flexible bibliometric approach for the assessment of professorial appointments," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(3), pages 1699-1719, December.
    5. J. A. García & Rosa Rodriguez-Sánchez & J. Fdez-Valdivia & Nicolas Robinson-García & Daniel Torres-Salinas, 2013. "Benchmarking research performance at the university level with information theoretic measures," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(1), pages 435-452, April.
    6. Donner, Paul, 2018. "Effect of publication month on citation impact," Journal of Informetrics, Elsevier, vol. 12(1), pages 330-343.
    7. Wolfgang Glänzel & Bart Thijs & Pei-Shan Chi, 2016. "The challenges to expand bibliometric studies from periodical literature to monographic literature with a new data source: the book citation index," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 2165-2179, December.
    8. Ellen Hazelkorn, 2007. "The Impact of League Tables and Ranking Systems on Higher Education Decision Making," Higher Education Management and Policy, OECD Publishing, vol. 19(2), pages 1-24.
    9. Fred L. Bookstein & Horst Seidler & Martin Fieder & Georg Winckler, 2010. "Too much noise in the Times Higher Education rankings," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(1), pages 295-299, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Renata Kudaibergenova & Sandugash Uzakbay & Asselya Makanova & Kymbat Ramadinkyzy & Erlan Kistaubayev & Ruslan Dussekeev & Kadyrzhan Smagulov, 2022. "Managing publication change at Al-Farabi Kazakh National University: a case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 453-479, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ying Huang & Wolfgang Glänzel & Lin Zhang, 2021. "Tracing the development of mapping knowledge domains," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 6201-6224, July.
    2. Pei-Shan Chi & Wolfgang Glänzel, 2018. "Comparison of citation and usage indicators in research assessment in scientific disciplines and journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(1), pages 537-554, July.
    3. Yan, Erjia & Ding, Ying & Cronin, Blaise & Leydesdorff, Loet, 2013. "A bird's-eye view of scientific trading: Dependency relations among fields of science," Journal of Informetrics, Elsevier, vol. 7(2), pages 249-264.
    4. Lin Zhang & Wenjing Zhao & Beibei Sun & Ying Huang & Wolfgang Glänzel, 2020. "How scientific research reacts to international public health emergencies: a global analysis of response patterns," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 747-773, July.
    5. Mingkun Wei & Abdolreza Noroozi Chakoli, 2020. "Evaluating the relationship between the academic and social impact of open access books based on citation behaviors and social media attention," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2401-2420, December.
    6. Juan Gorraiz & Ursula Ulrych & Wolfgang Glänzel & Wenceslao Arroyo-Machado & Daniel Torres-Salinas, 2022. "Measuring the excellence contribution at the journal level: an alternative to Garfield’s impact factor," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 7229-7251, December.
    7. Ludo Waltman & Clara Calero-Medina & Joost Kosten & Ed C.M. Noyons & Robert J.W. Tijssen & Nees Jan Eck & Thed N. Leeuwen & Anthony F.J. Raan & Martijn S. Visser & Paul Wouters, 2012. "The Leiden ranking 2011/2012: Data collection, indicators, and interpretation," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(12), pages 2419-2432, December.
    8. Carlos Martin-Rios, 2016. "Innovative management control systems in knowledge work: a middle manager perspective," Journal of Management Control: Zeitschrift für Planung und Unternehmenssteuerung, Springer, vol. 27(2), pages 181-204, May.
    9. Andrea Francesconi & Enrico Guarini, 2017. "Performance-based funding e sistemi di allocazione delle risorse ai dipartimenti: prime evidenze nelle universit? italiane," MANAGEMENT CONTROL, FrancoAngeli Editore, vol. 2017(1), pages 113-134.
    10. Diego Chavarro & Puay Tang & Ismael Rafols, 2014. "Interdisciplinarity and research on local issues: evidence from a developing country," Research Evaluation, Oxford University Press, vol. 23(3), pages 195-209.
    11. Pascale Amans & Sylvie Rascol-Boutard, 2006. "Controlling Complex Organizations on the Basis of an Operational Performance Measure," Post-Print hal-01659071, HAL.
    12. Mei, Maggie Qiuzhu & Wang, Le & Yan, Jie, 2023. "Maintaining product quality consistency when offshoring to emerging markets: The role of subsidiary control," Journal of International Management, Elsevier, vol. 29(1).
    13. Tuba Bircan & Almila Alkim Akdag Salah, 2022. "A Bibliometric Analysis of the Use of Artificial Intelligence Technologies for Social Sciences," Mathematics, MDPI, vol. 10(23), pages 1-17, November.
    14. Seongkyoon Jeong & Jong-Chan Kim & Jae Young Choi, 2015. "Technology convergence: What developmental stage are we in?," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(3), pages 841-871, September.
    15. David Pastoriza & Miguel Ariño & Joan Ricart, 2008. "Ethical Managerial Behaviour as an Antecedent of Organizational Social Capital," Journal of Business Ethics, Springer, vol. 78(3), pages 329-341, March.
    16. Bjørn Stensaker, 2018. "University Alliances: Enhancing Control, Capacity, and Creativity in Dynamic Environments," Voprosy obrazovaniya / Educational Studies Moscow, National Research University Higher School of Economics, issue 1, pages 132-153.
    17. Rafols, Ismael & Leydesdorff, Loet & O’Hare, Alice & Nightingale, Paul & Stirling, Andy, 2012. "How journal rankings can suppress interdisciplinary research: A comparison between Innovation Studies and Business & Management," Research Policy, Elsevier, vol. 41(7), pages 1262-1282.
    18. Jo Royle & Louisa Coles & Dorothy Williams & Paul Evans, 2007. "Publishing in international journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 71(1), pages 59-86, April.
    19. Kong, Ling & Wang, Dongbo, 2020. "Comparison of citations and attention of cover and non-cover papers," Journal of Informetrics, Elsevier, vol. 14(4).
    20. Julien Batac & Olivier de La Villarmois, 2003. "Les Interactions Controle / Apprentissage Organisationnel : Proposition D'Une Grille D'Analyse," Post-Print halshs-00582732, HAL.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:125:y:2020:i:2:d:10.1007_s11192-020-03672-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.