IDEAS home Printed from https://ideas.repec.org/a/spr/qualqt/v52y2018i1d10.1007_s11135-016-0452-9.html
   My bibliography  Save this article

Evaluation of the quality and quantity of research results in higher education

Author

Listed:
  • Amelia Bucur

    (Lucian Blaga University of Sibiu)

  • Claudiu Vasile Kifor

    (Lucian Blaga University of Sibiu)

  • Silvia Cristina Mărginean

    (Lucian Blaga University of Sibiu)

Abstract

The evaluation of the quality and quantity of research results in higher education, both at an institutional and an individual level, has become a must in today’s competitive environment. Universities use sets of indicators validated at national or international level, in order to measure research results and to set goals, but sometimes they need specific systems that are more appropriate in order to reach their strategic objectives. Based on the system of evaluation used by a Romanian medium-sized university, in the first part of the case study from this article, it is mathematically proven that the measurement itself has a great impact on the research results’ dynamics because of the changing behaviour of the academic staff. The model could be applied and customized to any set of indicators used by different universities, and our results prove that a good set of indicators could be a useful tool to increase research performance and to achieve specific goals and strategic objectives in universities. In the second part of the case study, we tried to answer the following question: From a set of indicators used to quantify research activity in higher education, which ones are critical indicators? In order to find an answer to this question, we used the topic of hierarchization of the research indicators in higher-education as a multiple-criteria decision-making problem. The criteria used in the case study are funding from the state budget and from other sources, and national and international visibility of the research results.

Suggested Citation

  • Amelia Bucur & Claudiu Vasile Kifor & Silvia Cristina Mărginean, 2018. "Evaluation of the quality and quantity of research results in higher education," Quality & Quantity: International Journal of Methodology, Springer, vol. 52(1), pages 101-118, January.
    • Handle: RePEc:spr:qualqt:v:52:y:2018:i:1:d:10.1007_s11135-016-0452-9
    DOI: 10.1007/s11135-016-0452-9
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11135-016-0452-9
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11135-016-0452-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kumar, P. & Singh, N. & Tewari, N. K., 1991. "A nonlinear goal programming model for multistage, multiobjective decision problems with application to grouping and loading problem in a flexible manufacturing system," European Journal of Operational Research, Elsevier, vol. 53(2), pages 166-171, July.
    2. Jamil Salmi & Alenoush Saroyan, 2007. "League Tables as Policy Instruments: Uses and Misuses," Higher Education Management and Policy, OECD Publishing, vol. 19(2), pages 1-38.
    3. M. Ab Hamid & Z. Mustafa & N. Suradi & F. Idris & M. Abdullah, 2013. "Value-based performance excellence measurement for higher education institution: instrument validation," Quality & Quantity: International Journal of Methodology, Springer, vol. 47(6), pages 3019-3030, October.
    4. Soutar, Geoffrey N. & Murphy, Jamie, 2009. "Journal quality: A Google Scholar analysis," Australasian marketing journal, Elsevier, vol. 17(3), pages 150-153.
    5. Corrente, Salvatore & Greco, Salvatore & Słowiński, Roman, 2013. "Multiple Criteria Hierarchy Process with ELECTRE and PROMETHEE," Omega, Elsevier, vol. 41(5), pages 820-846.
    6. Ashkan Ebadi & Andrea Schiffauerova, 2016. "How to boost scientific production? A statistical analysis of research funding and other influencing factors," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(3), pages 1093-1116, March.
    7. Dejian Yu, 2015. "A scientometrics review on aggregation operator research," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(1), pages 115-133, October.
    8. George Gordon & Celia Whitchurch, 2007. "Managing Human Resources in Higher Education: The Implications of a Diversifying Workforce," Higher Education Management and Policy, OECD Publishing, vol. 19(2), pages 1-21.
    9. Zanakis, Stelios H. & Solomon, Anthony & Wishart, Nicole & Dublish, Sandipa, 1998. "Multi-attribute decision making: A simulation comparison of select methods," European Journal of Operational Research, Elsevier, vol. 107(3), pages 507-529, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Csomós, György, 2020. "Introducing recalibrated academic performance indicators in the evaluation of individuals’ research performance: A case study from Eastern Europe," Journal of Informetrics, Elsevier, vol. 14(4).
    2. Lucía Muñoz-Pascual & Jesús Galende & Carla Curado, 2019. "Human Resource Management Contributions to Knowledge Sharing for a Sustainability-Oriented Performance: A Mixed Methods Approach," Sustainability, MDPI, vol. 12(1), pages 1-24, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wątróbski, Jarosław & Jankowski, Jarosław & Ziemba, Paweł & Karczmarczyk, Artur & Zioło, Magdalena, 2019. "Generalised framework for multi-criteria method selection," Omega, Elsevier, vol. 86(C), pages 107-124.
    2. Xingwen Chen & Li Zhu & Chao Liu & Chunhua Chen & Jun Liu & Dongxia Huo, 2023. "Workplace Diversity in the Asia-Pacific Region: A Review of Literature and Directions for Future Research," Asia Pacific Journal of Management, Springer, vol. 40(3), pages 1021-1045, September.
    3. Corrente, Salvatore & Figueira, José Rui & Greco, Salvatore, 2014. "The SMAA-PROMETHEE method," European Journal of Operational Research, Elsevier, vol. 239(2), pages 514-522.
    4. Belén Álvarez-Bornstein & Adrián A. Díaz-Faes & María Bordons, 2019. "What characterises funded biomedical research? Evidence from a basic and a clinical domain," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 805-825, May.
    5. Eduardo Fernández & José Rui Figueira & Jorge Navarro, 2023. "A theoretical look at ordinal classification methods based on comparing actions with limiting boundaries between adjacent classes," Annals of Operations Research, Springer, vol. 325(2), pages 819-843, June.
    6. Franceschini, Fiorenzo & Maisano, Domenico, 2015. "Checking the consistency of the solution in ordinal semi-democratic decision-making problems," Omega, Elsevier, vol. 57(PB), pages 188-195.
    7. Krejci, Igor & Voriskova, Andrea, 2010. "Analysis of the Method for the Selection of Regions with Concentrated State Aid," AGRIS on-line Papers in Economics and Informatics, Czech University of Life Sciences Prague, Faculty of Economics and Management, vol. 2(3), pages 1-8, September.
    8. Kokaraki, Nikoleta & Hopfe, Christina J. & Robinson, Elaine & Nikolaidou, Elli, 2019. "Testing the reliability of deterministic multi-criteria decision-making methods using building performance simulation," Renewable and Sustainable Energy Reviews, Elsevier, vol. 112(C), pages 991-1007.
    9. Hamalainen, Raimo P. & Mantysaari, Juha, 2002. "Dynamic multi-objective heating optimization," European Journal of Operational Research, Elsevier, vol. 142(1), pages 1-15, October.
    10. Mulliner, Emma & Smallbone, Kieran & Maliene, Vida, 2013. "An assessment of sustainable housing affordability using a multiple criteria decision making method," Omega, Elsevier, vol. 41(2), pages 270-279.
    11. Manel Baucells & Rakesh K. Sarin, 2003. "Group Decisions with Multiple Criteria," Management Science, INFORMS, vol. 49(8), pages 1105-1118, August.
    12. Hajkowicz, Stefan & Higgins, Andrew, 2008. "A comparison of multiple criteria analysis techniques for water resource management," European Journal of Operational Research, Elsevier, vol. 184(1), pages 255-265, January.
    13. Fernandez Martinez, Roberto & Lostado Lorza, Ruben & Santos Delgado, Ana Alexandra & Piedra, Nelson, 2021. "Use of classification trees and rule-based models to optimize the funding assignment to research projects: A case study of UTPL," Journal of Informetrics, Elsevier, vol. 15(1).
    14. Daraio, Cinzia & Bonaccorsi, Andrea & Simar, Léopold, 2015. "Rankings and university performance: A conditional multidimensional approach," European Journal of Operational Research, Elsevier, vol. 244(3), pages 918-930.
    15. Cătălin Emilian Boja & Claudiu Herţeliu & Marian Dârdală & Bogdan Vasile Ileanu, 2018. "Day of the week submission effect for accepted papers in Physica A, PLOS ONE, Nature and Cell," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(2), pages 887-918, November.
    16. Murat Perit Çakır & Cengiz Acartürk & Oğuzhan Alaşehir & Canan Çilingir, 2015. "A comparative analysis of global and national university ranking systems," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(3), pages 813-848, June.
    17. Raja Rub Nawaz & Dr.Rafique Ahmed & Sajida Reza, 2015. "Prioritization Of Quality Care Criteria To Deliver Quality Service Using Dematel," IBT Journal of Business Studies (JBS), Ilma University, Faculty of Management Science, vol. 11(2), pages 165-181.
    18. Runtong Zhang & Jun Wang & Xiaomin Zhu & Meimei Xia & Ming Yu, 2017. "Some Generalized Pythagorean Fuzzy Bonferroni Mean Aggregation Operators with Their Application to Multiattribute Group Decision-Making," Complexity, Hindawi, vol. 2017, pages 1-16, August.
    19. Dejian Yu & Sun Meng, 2018. "An overview of biomass energy research with bibliometric indicators," Energy & Environment, , vol. 29(4), pages 576-590, June.
    20. Govindan, Kannan & Jepsen, Martin Brandt, 2016. "ELECTRE: A comprehensive literature review on methodologies and applications," European Journal of Operational Research, Elsevier, vol. 250(1), pages 1-29.

    More about this item

    Keywords

    Quality; Quantity; Research; Higher education; Indicator; Multiple-criteria optimization;
    All these keywords.

    JEL classification:

    • C6 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:qualqt:v:52:y:2018:i:1:d:10.1007_s11135-016-0452-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.