IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v16y2024i18p8180-d1481291.html

The Performance and Qualitative Evaluation of Scientific Work at Research Universities: A Focus on the Types of University and Research

Author

Listed:
  • Dmitry A. Radushinsky

    (Department of Metrology, Instrumentation and Quality Management, Empress Catherine II Saint Petersburg Mining University (Saint Petersburg Mining University), 199106 St. Petersburg, Russia)

  • Egor O. Zamyatin

    (Department of Scientific Research, Empress Catherine II Saint Petersburg Mining University (Saint Petersburg Mining University), 199106 St. Petersburg, Russia)

  • Alexandra I. Radushinskaya

    (Department of Russian Policy, Saint Petersburg State University (SPbGU), 191124 St. Petersburg, Russia)

  • Ivan I. Sytko

    (Department of Metrology, Instrumentation and Quality Management, Empress Catherine II Saint Petersburg Mining University (Saint Petersburg Mining University), 199106 St. Petersburg, Russia)

  • Ekaterina E. Smirnova

    (Department of Metrology, Instrumentation and Quality Management, Empress Catherine II Saint Petersburg Mining University (Saint Petersburg Mining University), 199106 St. Petersburg, Russia)

Abstract

The successful implementation of scientific research is one of the key factors for sustainable development, including the development of tertiary education. A leading or “world-class university”, today, transfers knowledge to innovation, bearing the concept of “academic excellence”, and features of “research” and “entrepreneurial” universities highly match the SDGs. This article presents an analysis for scientific quality-assessing indicators at research universities. It also studies university science models in different countries, the features of university types—engineering (technical or technological) and comprehensive (multidisciplinary)—and the arising problems with their possible solutions for university science on the whole. The authors suggested a composition of indicators for assessing the quality of the fundamental scientific research and engineering project results and the performances of universities’ specialized scientific units. The respondents of the survey weighed the significance of the indicators. The research used methods of analysis, brainstorming, Ishikawa diagram building, and a survey of specialists. The results obtained can be useful for the improvement of quality management systems (QMSs) at research universities. Some implications of this study could be extended to improve QMS and management processes of specialized scientific organizations that belong to the state, business, and non-profit sectors of science.

Suggested Citation

  • Dmitry A. Radushinsky & Egor O. Zamyatin & Alexandra I. Radushinskaya & Ivan I. Sytko & Ekaterina E. Smirnova, 2024. "The Performance and Qualitative Evaluation of Scientific Work at Research Universities: A Focus on the Types of University and Research," Sustainability, MDPI, vol. 16(18), pages 1-26, September.
    • Handle: RePEc:gam:jsusta:v:16:y:2024:i:18:p:8180-:d:1481291
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/16/18/8180/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2071-1050/16/18/8180/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Carillo, Maria Rosaria & Papagni, Erasmo & Sapio, Alessandro, 2013. "Do collaborations enhance the high-quality output of scientific institutions? Evidence from the Italian Research Assessment Exercise," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 47(C), pages 25-36.
    2. Matveeva, Nataliya & Sterligov, Ivan & Yudkevich, Maria, 2021. "The effect of Russian University Excellence Initiative on publications and collaboration patterns," Journal of Informetrics, Elsevier, vol. 15(1).
    3. Philip G. Altbach & Jamil Salmi, 2011. "The Road to Academic Excellence : The Making of World-Class Research Universities [El camino hacia la excelencia académica : la constitución de universidades de investigación de rango mundial]," World Bank Publications - Books, The World Bank Group, number 2357, April.
    4. Chen, Ya & Pan, Yongbin & Liu, Haoxiang & Wu, Huaqing & Deng, Guangwei, 2023. "Efficiency analysis of Chinese universities with shared inputs: An aggregated two-stage network DEA approach," Socio-Economic Planning Sciences, Elsevier, vol. 90(C).
    5. Basso, Antonella & di Tollo, Giacomo, 2022. "Prediction of UK research excellence framework assessment by the departmental h-index," European Journal of Operational Research, Elsevier, vol. 296(3), pages 1036-1049.
    6. Olcay, Gokcen Arkali & Bulu, Melih, 2017. "Is measuring the knowledge creation of universities possible?: A review of university rankings," Technological Forecasting and Social Change, Elsevier, vol. 123(C), pages 153-160.
    7. Le, Minh Hanh & Afsharian, Mohsen & Ahn, Heinz, 2021. "Inverse Frontier-based Benchmarking for Investigating the Efficiency and Achieving the Targets in the Vietnamese Education System," Omega, Elsevier, vol. 103(C).
    8. Lubango, Louis Mitondo & Pouris, Anastassios, 2009. "Is patenting activity impeding the academic performance of South African University researchers?," Technology in Society, Elsevier, vol. 31(3), pages 315-324.
    9. Nataliya Matveeva & Anuška Ferligoj, 2020. "Scientific collaboration in Russian universities before and after the excellence initiative Project 5-100," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(3), pages 2383-2407, September.
    10. Tavares, Rafael Santos & Angulo-Meza, Lidia & Sant'Anna, Annibal Parracho, 2021. "A proposed multistage evaluation approach for Higher Education Institutions based on network Data envelopment analysis: A Brazilian experience," Evaluation and Program Planning, Elsevier, vol. 89(C).
    11. Ponomariov, Branco L. & Boardman, P. Craig, 2010. "Influencing scientists' collaboration and productivity patterns through new institutions: University research centers and scientific and technical human capital," Research Policy, Elsevier, vol. 39(5), pages 613-624, June.
    12. Aven, Terje, 2018. "Perspectives on the nexus between good risk communication and high scientific risk analysis quality," Reliability Engineering and System Safety, Elsevier, vol. 178(C), pages 290-296.
    13. Do, Thi Huong & Krott, Max & Böcher, Michael, 2020. "Multiple traps of scientific knowledge transfer: Comparative case studies based on the RIU model from Vietnam, Germany, Indonesia, Japan, and Sweden," Forest Policy and Economics, Elsevier, vol. 114(C).
    14. Guironnet, Jean-Pascal & Peypoch, Nicolas, 2018. "The geographical efficiency of education and research: The ranking of U.S. universities," Socio-Economic Planning Sciences, Elsevier, vol. 62(C), pages 44-55.
    15. Roba Elbawab, 2022. "University Rankings and Goals: A Cluster Analysis," Economies, MDPI, vol. 10(9), pages 1-34, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Tatyana Semenova & Juan Yair Martínez Santoyo, 2025. "Determining Priority Areas for the Technological Development of Oil Companies in Mexico," Resources, MDPI, vol. 14(1), pages 1-27, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andrey Lovakov & Jaime A. Teixeira da Silva, 2025. "Scientometric indicators in research evaluation and research misconduct: analysis of the Russian university excellence initiative," Scientometrics, Springer;Akadémiai Kiadó, vol. 130(3), pages 1813-1829, March.
    2. Shih-Pin Chen & Chung-Wei Chang, 2021. "Measuring the efficiency of university departments: an empirical study using data envelopment analysis and cluster analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 5263-5284, June.
    3. Xiaojie Fan & Hong Liu & Yang Wang & Yawen Wan & Duanhong Zhang, 2022. "Models of Internationalization of Higher Education in Developing Countries—A Perspective of International Research Collaboration in BRICS Countries," Sustainability, MDPI, vol. 14(20), pages 1-24, October.
    4. Leonid Gokhberg & Tatiana Kuznetsova & Maxim Kotsemir, 2023. "From the Soviet Union to the Russian Federation: publication activity dynamics along the evolution of national science policies," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(11), pages 6195-6246, November.
    5. Jiani Liu & Kim Jungyin & Shim Jaewoo & Lee Heechul & Wasi Ul Hassan Shah, 2024. "Evaluating the efficiency, productivity change, and technology gaps of China’s provincial higher education systems: A comprehensive analytical framework," PLOS ONE, Public Library of Science, vol. 19(1), pages 1-25, January.
    6. Rella, Angela & Rubino, Michele & Raimo, Nicola & Vitolla, Filippo, 2024. "Does the digitalization of municipalities affect the efficiency of universities? An Italian case study using DEA and Malmquist index approaches," Technology in Society, Elsevier, vol. 77(C).
    7. Mona Farouk Ali, 2024. "Is there a “difference-in-difference”? The impact of scientometric evaluation on the evolution of international publications in Egyptian universities and research centres," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(2), pages 1119-1154, February.
    8. Tommaso Agasisti & Guo-liang Yang & Yao-yao Song & Carolyn-Thi Thanh Dung Tran, 2021. "Evaluating the higher education productivity of Chinese and European “elite” universities using a meta-frontier approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 5819-5853, July.
    9. Foroudi, Pantea & Yu, Qionglei & Gupta, Suraksha & Foroudi, Mohammad M., 2019. "Enhancing university brand image and reputation through customer value co-creation behaviour," Technological Forecasting and Social Change, Elsevier, vol. 138(C), pages 218-227.
    10. Asuamah Yeboah, Samuel & Antwi Boasiako, Ama, 2024. "Beyond the Classroom: Quality Assurance in Developing Nations," MPRA Paper 122486, University Library of Munich, Germany, revised 13 Oct 2024.
    11. Aurélie Corne & Olga Goncalves & Nicolas Peypoch, 2020. "Evaluating the performance drivers of French ski resorts: A hierarchical approach," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 41(3), pages 389-405, April.
    12. Wang, Zehui & Xie, Jianhui, 2025. "Water constraint mitigation and agricultural productivity: Evidence from the China’s South-to-North Water Diversion Project," Agricultural Water Management, Elsevier, vol. 314(C).
    13. Camanho, Ana S. & Stumbriene, Dovile & Barbosa, Flávia & Jakaitiene, Audrone, 2023. "The assessment of performance trends and convergence in education and training systems of European countries," European Journal of Operational Research, Elsevier, vol. 305(1), pages 356-372.
    14. Annamaria Demarinis Loiotile & Francesco De Nicolò & Adriana Agrimi & Loredana Bellantuono & Marianna La Rocca & Alfonso Monaco & Ester Pantaleo & Sabina Tangaro & Nicola Amoroso & Roberto Bellotti, 2022. "Best Practices in Knowledge Transfer: Insights from Top Universities," Sustainability, MDPI, vol. 14(22), pages 1-23, November.
    15. Cooley, Savannah & Jenkins, Amber & Schaeffer, Blake & Bormann, Kat J. & Abdallah, Adel & Melton, Forrest & Granger, Stephanie & Graczyk, Indrani, 2022. "Paths to research-driven decision making in the realms of environment and water," Technology in Society, Elsevier, vol. 70(C).
    16. Gibson, Elizabeth & Daim, Tugrul U. & Dabic, Marina, 2019. "Evaluating university industry collaborative research centers," Technological Forecasting and Social Change, Elsevier, vol. 146(C), pages 181-202.
    17. Cinzia Daraio & Simone Di Leo & Loet Leydesdorff, 2022. "Using the Leiden Rankings as a Heuristics: Evidence from Italian universities in the European landscape," LEM Papers Series 2022/08, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    18. Csató, László & Tóth, Csaba, 2020. "University rankings from the revealed preferences of the applicants," European Journal of Operational Research, Elsevier, vol. 286(1), pages 309-320.
    19. Anastasia E. Sudakova & Dahel Mustafa Saleh Dahel, 2023. "Funding the Higher Education System: International Experience and Russian Practice," R-Economy, Ural Federal University, Graduate School of Economics and Management, vol. 9(2), pages 207-225.
    20. Ding, Tao & Zhang, Yun & Zhang, Danlu & Li, Feng, 2023. "Performance evaluation of Chinese research universities: A parallel interactive network DEA approach with shared and fixed sum inputs," Socio-Economic Planning Sciences, Elsevier, vol. 87(PA).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:16:y:2024:i:18:p:8180-:d:1481291. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.