IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v16y2024i18p8180-d1481291.html
   My bibliography  Save this article

The Performance and Qualitative Evaluation of Scientific Work at Research Universities: A Focus on the Types of University and Research

Author

Listed:
  • Dmitry A. Radushinsky

    (Department of Metrology, Instrumentation and Quality Management, Empress Catherine II Saint Petersburg Mining University (Saint Petersburg Mining University), 199106 St. Petersburg, Russia)

  • Egor O. Zamyatin

    (Department of Scientific Research, Empress Catherine II Saint Petersburg Mining University (Saint Petersburg Mining University), 199106 St. Petersburg, Russia)

  • Alexandra I. Radushinskaya

    (Department of Russian Policy, Saint Petersburg State University (SPbGU), 191124 St. Petersburg, Russia)

  • Ivan I. Sytko

    (Department of Metrology, Instrumentation and Quality Management, Empress Catherine II Saint Petersburg Mining University (Saint Petersburg Mining University), 199106 St. Petersburg, Russia)

  • Ekaterina E. Smirnova

    (Department of Metrology, Instrumentation and Quality Management, Empress Catherine II Saint Petersburg Mining University (Saint Petersburg Mining University), 199106 St. Petersburg, Russia)

Abstract

The successful implementation of scientific research is one of the key factors for sustainable development, including the development of tertiary education. A leading or “world-class university”, today, transfers knowledge to innovation, bearing the concept of “academic excellence”, and features of “research” and “entrepreneurial” universities highly match the SDGs. This article presents an analysis for scientific quality-assessing indicators at research universities. It also studies university science models in different countries, the features of university types—engineering (technical or technological) and comprehensive (multidisciplinary)—and the arising problems with their possible solutions for university science on the whole. The authors suggested a composition of indicators for assessing the quality of the fundamental scientific research and engineering project results and the performances of universities’ specialized scientific units. The respondents of the survey weighed the significance of the indicators. The research used methods of analysis, brainstorming, Ishikawa diagram building, and a survey of specialists. The results obtained can be useful for the improvement of quality management systems (QMSs) at research universities. Some implications of this study could be extended to improve QMS and management processes of specialized scientific organizations that belong to the state, business, and non-profit sectors of science.

Suggested Citation

  • Dmitry A. Radushinsky & Egor O. Zamyatin & Alexandra I. Radushinskaya & Ivan I. Sytko & Ekaterina E. Smirnova, 2024. "The Performance and Qualitative Evaluation of Scientific Work at Research Universities: A Focus on the Types of University and Research," Sustainability, MDPI, vol. 16(18), pages 1-26, September.
    • Handle: RePEc:gam:jsusta:v:16:y:2024:i:18:p:8180-:d:1481291
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/16/18/8180/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2071-1050/16/18/8180/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Carillo, Maria Rosaria & Papagni, Erasmo & Sapio, Alessandro, 2013. "Do collaborations enhance the high-quality output of scientific institutions? Evidence from the Italian Research Assessment Exercise," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 47(C), pages 25-36.
    2. Matveeva, Nataliya & Sterligov, Ivan & Yudkevich, Maria, 2021. "The effect of Russian University Excellence Initiative on publications and collaboration patterns," Journal of Informetrics, Elsevier, vol. 15(1).
    3. Philip G. Altbach & Jamil Salmi, 2011. "The Road to Academic Excellence : The Making of World-Class Research Universities [El camino hacia la excelencia académica : la constitución de universidades de investigación de rango mundial]," World Bank Publications - Books, The World Bank Group, number 2357.
    4. Olcay, Gokcen Arkali & Bulu, Melih, 2017. "Is measuring the knowledge creation of universities possible?: A review of university rankings," Technological Forecasting and Social Change, Elsevier, vol. 123(C), pages 153-160.
    5. Lubango, Louis Mitondo & Pouris, Anastassios, 2009. "Is patenting activity impeding the academic performance of South African University researchers?," Technology in Society, Elsevier, vol. 31(3), pages 315-324.
    6. Nataliya Matveeva & Anuška Ferligoj, 2020. "Scientific collaboration in Russian universities before and after the excellence initiative Project 5-100," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(3), pages 2383-2407, September.
    7. Tavares, Rafael Santos & Angulo-Meza, Lidia & Sant'Anna, Annibal Parracho, 2021. "A proposed multistage evaluation approach for Higher Education Institutions based on network Data envelopment analysis: A Brazilian experience," Evaluation and Program Planning, Elsevier, vol. 89(C).
    8. Ponomariov, Branco L. & Boardman, P. Craig, 2010. "Influencing scientists' collaboration and productivity patterns through new institutions: University research centers and scientific and technical human capital," Research Policy, Elsevier, vol. 39(5), pages 613-624, June.
    9. Aven, Terje, 2018. "Perspectives on the nexus between good risk communication and high scientific risk analysis quality," Reliability Engineering and System Safety, Elsevier, vol. 178(C), pages 290-296.
    10. Basso, Antonella & di Tollo, Giacomo, 2022. "Prediction of UK research excellence framework assessment by the departmental h-index," European Journal of Operational Research, Elsevier, vol. 296(3), pages 1036-1049.
    11. Le, Minh Hanh & Afsharian, Mohsen & Ahn, Heinz, 2021. "Inverse Frontier-based Benchmarking for Investigating the Efficiency and Achieving the Targets in the Vietnamese Education System," Omega, Elsevier, vol. 103(C).
    12. Do, Thi Huong & Krott, Max & Böcher, Michael, 2020. "Multiple traps of scientific knowledge transfer: Comparative case studies based on the RIU model from Vietnam, Germany, Indonesia, Japan, and Sweden," Forest Policy and Economics, Elsevier, vol. 114(C).
    13. Roba Elbawab, 2022. "University Rankings and Goals: A Cluster Analysis," Economies, MDPI, vol. 10(9), pages 1-34, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Tatyana Semenova & Juan Yair Martínez Santoyo, 2025. "Determining Priority Areas for the Technological Development of Oil Companies in Mexico," Resources, MDPI, vol. 14(1), pages 1-27, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andrey Lovakov & Jaime A. Teixeira da Silva, 2025. "Scientometric indicators in research evaluation and research misconduct: analysis of the Russian university excellence initiative," Scientometrics, Springer;Akadémiai Kiadó, vol. 130(3), pages 1813-1829, March.
    2. Xiaojie Fan & Hong Liu & Yang Wang & Yawen Wan & Duanhong Zhang, 2022. "Models of Internationalization of Higher Education in Developing Countries—A Perspective of International Research Collaboration in BRICS Countries," Sustainability, MDPI, vol. 14(20), pages 1-24, October.
    3. Mona Farouk Ali, 2024. "Is there a “difference-in-difference”? The impact of scientometric evaluation on the evolution of international publications in Egyptian universities and research centres," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(2), pages 1119-1154, February.
    4. Leonid Gokhberg & Tatiana Kuznetsova & Maxim Kotsemir, 2023. "From the Soviet Union to the Russian Federation: publication activity dynamics along the evolution of national science policies," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(11), pages 6195-6246, November.
    5. Tommaso Agasisti & Guo-liang Yang & Yao-yao Song & Carolyn-Thi Thanh Dung Tran, 2021. "Evaluating the higher education productivity of Chinese and European “elite” universities using a meta-frontier approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 5819-5853, July.
    6. Foroudi, Pantea & Yu, Qionglei & Gupta, Suraksha & Foroudi, Mohammad M., 2019. "Enhancing university brand image and reputation through customer value co-creation behaviour," Technological Forecasting and Social Change, Elsevier, vol. 138(C), pages 218-227.
    7. Asuamah Yeboah, Samuel & Antwi Boasiako, Ama, 2024. "Beyond the Classroom: Quality Assurance in Developing Nations," MPRA Paper 122486, University Library of Munich, Germany, revised 13 Oct 2024.
    8. Camanho, Ana S. & Stumbriene, Dovile & Barbosa, Flávia & Jakaitiene, Audrone, 2023. "The assessment of performance trends and convergence in education and training systems of European countries," European Journal of Operational Research, Elsevier, vol. 305(1), pages 356-372.
    9. Gibson, Elizabeth & Daim, Tugrul U. & Dabic, Marina, 2019. "Evaluating university industry collaborative research centers," Technological Forecasting and Social Change, Elsevier, vol. 146(C), pages 181-202.
    10. Cinzia Daraio & Simone Di Leo & Loet Leydesdorff, 2022. "Using the Leiden Rankings as a Heuristics: Evidence from Italian universities in the European landscape," LEM Papers Series 2022/08, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    11. Mona Farouk Ali, 2025. "Investigating shifts in publication patterns after launching scientometric evaluation at Egyptian universities: an analysis of submitted research for promotion," Scientometrics, Springer;Akadémiai Kiadó, vol. 130(3), pages 1751-1787, March.
    12. Hu, Juan & Liu, Hao & Chen, Yingxia & Qin, Jiali, 2018. "Strategic planning and the stratification of Chinese higher education institutions," International Journal of Educational Development, Elsevier, vol. 63(C), pages 36-43.
    13. Isidore Komla Zotoo & Guifeng Liu & Zhangping Lu & Frank Kofi Essien & Wencheng Su, 2023. "The Impact of Key Stakeholders and the Computer Skills of Librarians on Research Data Management Support Services (Id so-21-1893.r2)," SAGE Open, , vol. 13(3), pages 21582440231, September.
    14. repec:cdl:cshedu:qt50g3t797 is not listed on IDEAS
    15. Negin Salimi & Jafar Rezaei, 2016. "Measuring efficiency of university-industry Ph.D. projects using best worst method," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 1911-1938, December.
    16. Moxin Li & Yang Wang, 2024. "Influence of political tensions on scientific productivity, citation impact, and knowledge combinations," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(4), pages 2337-2370, April.
    17. Jung, Jiwon & Bozeman, Barry & Gaughan, Monica, 2017. "Impact of research collaboration cosmopolitanism on job satisfaction," Research Policy, Elsevier, vol. 46(10), pages 1863-1872.
    18. Li, Feng & Miao, Yajun & Yang, Chenchen, 2015. "How do alumni faculty behave in research collaboration? An analysis of Chang Jiang Scholars in China," Research Policy, Elsevier, vol. 44(2), pages 438-450.
    19. Avenali, Alessandro & Daraio, Cinzia & Di Leo, Simone & Wolszczak-Derlacz, Joanna, 2024. "Heterogeneity of national accounting systems, world-class universities and financial resources: What are the links?," Journal of Informetrics, Elsevier, vol. 18(2).
    20. Motohashi, Kazuyuki & Muramatsu, Shingo, 2012. "Examining the university industry collaboration policy in Japan: Patent analysis," Technology in Society, Elsevier, vol. 34(2), pages 149-162.
    21. Adéla Fajčíková & Hana Urbancová, 2019. "Factors Influencing Students’ Motivation to Seek Higher Education—A Case Study at a State University in the Czech Republic," Sustainability, MDPI, vol. 11(17), pages 1-14, August.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:16:y:2024:i:18:p:8180-:d:1481291. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.