IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v91y2022ics0149718921001154.html
   My bibliography  Save this article

A novel hybrid evaluation framework for public organizations based on employees’ performance factors

Author

Listed:
  • Afrasiabi, Ahmadreza
  • Chalmardi, Mazyar Kaboli
  • Balezentis, Tomas

Abstract

Performance evaluation is a comprehensive process for comparing activities compared with predetermined organizational criteria. Based on the results of performance evaluation, organizations can embark on purposeful actions to improve their situation. Obviously, the success of organizations and the economic development of the country depend on the performance of human resources (HR). This paper proposes a novel hybrid evaluation framework for analyzing the performance of public sector organizations. The suggested setting allows for performance evaluation based on a comprehensive approach involving expert knowledge. For this purpose, the research integrates the Balanced Scorecard (BSC) approach and fuzzy multi-criteria decision-making (MCDM) methods. Initially, the employees’ performance factors (criteria) are identified from the literature based on the BSC dimensions. Then, the most relevant of them are finalized through the fuzzy Delphi method (FDM) questionnaires and experts’ opinions. In the second stage, the weights of criteria are determined by adopting the fuzzy best-worst method (FBWM). Moreover, two fuzzy MCDM techniques, namely VIKOR and Grey Relational Analysis (GRA), are used to examine the performance of the eight important public sector organizations of Iran. Finally, a Monte Carlo simulation-based (MCSB) approach and a scenario-based (SCB) approach are applied to compare the effectiveness of fuzzy VIKOR and fuzzy GRA. The results suggest that the critical employees’ performance factors include sharing knowledge with colleagues (0.136), optimal use of facilities (0.123) and participation in solving organizational issues (0.118). Additionally, based on the implemented sensitivity analysis approaches, fuzzy VIKOR generates more reliable results and also has higher robustness than fuzzy GRA.

Suggested Citation

  • Afrasiabi, Ahmadreza & Chalmardi, Mazyar Kaboli & Balezentis, Tomas, 2022. "A novel hybrid evaluation framework for public organizations based on employees’ performance factors," Evaluation and Program Planning, Elsevier, vol. 91(C).
    • Handle: RePEc:eee:epplan:v:91:y:2022:i:c:s0149718921001154
    DOI: 10.1016/j.evalprogplan.2021.102020
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718921001154
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.evalprogplan.2021.102020?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lebas, Michel J., 1995. "Performance measurement and performance management," International Journal of Production Economics, Elsevier, vol. 41(1-3), pages 23-35, October.
    2. Wu, Hung-Yi & Lin, Yi-Kuei & Chang, Chi-Hsiang, 2011. "Performance evaluation of extension education centers in universities based on the balanced scorecard," Evaluation and Program Planning, Elsevier, vol. 34(1), pages 37-50, February.
    3. Kristof De Witte & Laura López-Torres, 2017. "Efficiency in education: a review of literature and a way forward," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 339-363, April.
    4. Bruce Hollingsworth, 2008. "The measurement of efficiency and productivity of health care delivery," Health Economics, John Wiley & Sons, Ltd., vol. 17(10), pages 1107-1128, October.
    5. Kathryn Newcomer & Laila El Baradei & Sandra Garcia, 2013. "EXPECTATIONS AND CAPACITY OF PERFORMANCE MEASUREMENT IN NGOs IN THE DEVELOPMENT CONTEXT," Public Administration & Development, Blackwell Publishing, vol. 33(1), pages 62-79, February.
    6. Asatryan, Zareh & De Witte, Kristof, 2015. "Direct democracy and local government efficiency," European Journal of Political Economy, Elsevier, vol. 39(C), pages 58-66.
    7. Witte, Kristof De & Geys, Benny, 2011. "Evaluating efficient public good provision: Theory and evidence from a generalised conditional efficiency model for public libraries," Journal of Urban Economics, Elsevier, vol. 69(3), pages 319-327, May.
    8. Mohammad-Mehdi Parhizgar & Nahid Saravi-Moghadam, 2017. "Selection and comparison the most suitable strategy in the public and private banks with BSC approach," International Journal of Productivity and Quality Management, Inderscience Enterprises Ltd, vol. 20(1), pages 75-98.
    9. Mavrotas, George & Pechak, Olena & Siskos, Eleftherios & Doukas, Haris & Psarras, John, 2015. "Robustness analysis in Multi-Objective Mathematical Programming using Monte Carlo simulation," European Journal of Operational Research, Elsevier, vol. 240(1), pages 193-201.
    10. De Borger, Bruno & Kerstens, Kristiaan, 1996. "Cost efficiency of Belgian local governments: A comparative analysis of FDH, DEA, and econometric approaches," Regional Science and Urban Economics, Elsevier, vol. 26(2), pages 145-170, April.
    11. Kristof Witte & Wim Moesen, 2010. "Sizing the government," Public Choice, Springer, vol. 145(1), pages 39-55, October.
    12. Bentes, Alexandre Veronese & Carneiro, Jorge & da Silva, Jorge Ferreira & Kimura, Herbert, 2012. "Multidimensional assessment of organizational performance: Integrating BSC and AHP," Journal of Business Research, Elsevier, vol. 65(12), pages 1790-1799.
    13. Opricovic, Serafim & Tzeng, Gwo-Hshiung, 2007. "Extended VIKOR method in comparison with outranking methods," European Journal of Operational Research, Elsevier, vol. 178(2), pages 514-529, April.
    14. Mao-Sheng Liao & Gin-Shuh Liang & Chin-Yuan Chen, 2013. "Fuzzy grey relation method for multiple criteria decision-making problems," Quality & Quantity: International Journal of Methodology, Springer, vol. 47(6), pages 3065-3077, October.
    15. Yair Mundlak, 1961. "Empirical Production Function Free of Management Bias," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 43(1), pages 44-56.
    16. Madjid Tavana & Kaveh Khalili-Damghani & Rahman Rahmatian, 2015. "A hybrid fuzzy MCDM method for measuring the performance of publicly held pharmaceutical companies," Annals of Operations Research, Springer, vol. 226(1), pages 589-621, March.
    17. Lu, Ming-Tsang & Hsu, Chao-Che & Liou, James J.H. & Lo, Huai-Wei, 2018. "A hybrid MCDM and sustainability-balanced scorecard model to establish sustainable performance evaluation for international airports," Journal of Air Transport Management, Elsevier, vol. 71(C), pages 9-19.
    18. Ishizaka, Alessio & Siraj, Sajid, 2018. "Are multi-criteria decision-making tools useful? An experimental comparative study of three methods," European Journal of Operational Research, Elsevier, vol. 264(2), pages 462-471.
    19. Revelli, Federico & Tovmo, Per, 2007. "Revealed yardstick competition: Local government efficiency patterns in Norway," Journal of Urban Economics, Elsevier, vol. 62(1), pages 121-134, July.
    20. Hsu, C.-H. & Wang, Fu-Kwun & Tzeng, Gwo-Hshiung, 2012. "The best vendor selection for conducting the recycled material based on a hybrid MCDM model combining DANP with VIKOR," Resources, Conservation & Recycling, Elsevier, vol. 66(C), pages 95-111.
    21. Huiru Zhao & Sen Guo, 2014. "Selecting Green Supplier of Thermal Power Equipment by Using a Hybrid MCDM Method for Sustainability," Sustainability, MDPI, vol. 6(1), pages 1-19, January.
    22. Anastasios D. Diamantidis & Prodromos Chatzoglou, 2018. "Factors affecting employee performance: an empirical approach," International Journal of Productivity and Performance Management, Emerald Group Publishing Limited, vol. 68(1), pages 171-193, December.
    23. Mehdi Salimi & Mahboubeh Khodaparast, 2019. "Providing a combined model of fuzzy AHP and numerical taxonomy analysis for sport organizational ranking and performance appraisal," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 10(5), pages 1133-1144, October.
    24. Pina, Vicente & Torres, Lourdes, 2001. "Analysis of the efficiency of local government services delivery. An application to urban public transport," Transportation Research Part A: Policy and Practice, Elsevier, vol. 35(10), pages 929-944, December.
    25. Saks, Alan M. & Gruman, Jamie A., 2011. "Manage Employee Engagement to Manage Performance," Industrial and Organizational Psychology, Cambridge University Press, vol. 4(2), pages 204-207, June.
    26. Soltani, Ebrahim & van der Meer, Robert & Gennard, John & Williams, Terry, 2003. "A TQM Approach to HR Performance Evaluation Criteria," European Management Journal, Elsevier, vol. 21(3), pages 323-337, June.
    27. Sujit Singh & Ezutah Udoncy Olugu & Siti Nurmaya Musa & Abu Bakar Mahat, 2018. "Fuzzy-based sustainability evaluation method for manufacturing SMEs using balanced scorecard framework," Journal of Intelligent Manufacturing, Springer, vol. 29(1), pages 1-18, January.
    28. Sampaio, Breno Ramos & Neto, Oswaldo Lima & Sampaio, Yony, 2008. "Efficiency analysis of public transport systems: Lessons for institutional planning," Transportation Research Part A: Policy and Practice, Elsevier, vol. 42(3), pages 445-454, March.
    29. Marra, Mita, 2018. "The ambiguities of performance-based governance reforms in Italy: Reviving the fortunes of evaluation and performance measurement," Evaluation and Program Planning, Elsevier, vol. 69(C), pages 173-182.
    30. Rezaei, Jafar, 2015. "Best-worst multi-criteria decision-making method," Omega, Elsevier, vol. 53(C), pages 49-57.
    31. Sarraf, Fatemeh & Nejad, Shabnam Hashemi, 2020. "Improving performance evaluation based on balanced scorecard with grey relational analysis and data envelopment analysis approaches: Case study in water and wastewater companies," Evaluation and Program Planning, Elsevier, vol. 79(C).
    32. Drago Pupavac & Robert Marsanic & Ljudevit Krpan & Mimo Draskovic, 2019. "Analysis and Evaluation of Employment in the Maritime Transport System of the Republic of Croatia," Montenegrin Journal of Economics, Economic Laboratory for Transition Research (ELIT), vol. 15(2), pages 181-193.
    33. Varmazyar, Mohsen & Dehghanbaghi, Maryam & Afkhami, Mehdi, 2016. "A novel hybrid MCDM model for performance evaluation of research and technology organizations based on BSC approach," Evaluation and Program Planning, Elsevier, vol. 58(C), pages 125-140.
    34. Sajad Akbari & Jafar Heydari & Mohammad Ali Keramati & Abbas Keramati, 2020. "A mixed system of network data envelopment analysis to evaluate the performance of bank branches: an illustration with Iranian banks," International Journal of Business Excellence, Inderscience Enterprises Ltd, vol. 22(2), pages 198-212.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Cachón-Rodríguez, Gabriel & Blanco-González, Alicia & Prado-Román, Camilo & Del-Castillo-Feito, Cristina, 2022. "How sustainable human resources management helps in the evaluation and planning of employee loyalty and retention: Can social capital make a difference?," Evaluation and Program Planning, Elsevier, vol. 95(C).
    2. Irene Daskalopoulou & Athanasia Karakitsiou & Zafeirios Thomakis & Alexandros Parthymos, 2022. "Assessing the cooperation propensity of social entrepreneurs: a multicriteria analysis of human factor effects," Operational Research, Springer, vol. 22(5), pages 5569-5595, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Benito, Bernardino & Guillamón, María-Dolores & Martínez-Córdoba, Pedro-José, 2020. "Determinants of efficiency improvement in the Spanish public lighting sector," Utilities Policy, Elsevier, vol. 64(C).
    2. Milad Kolagar & Seyed Mohammad Hassan Hosseini & Ramin Felegari & Parviz Fattahi, 2020. "Policy-making for renewable energy sources in search of sustainable development: a hybrid DEA-FBWM approach," Environment Systems and Decisions, Springer, vol. 40(4), pages 485-509, December.
    3. Enrique J. Buch‐Gómez & Roberto Cabaleiro‐Casal, 2020. "Turnout, political strength, and cost efficiency in Spanish municipalities of the autonomous region of Galicia: Evidence from an alternative stochastic frontier approach," Papers in Regional Science, Wiley Blackwell, vol. 99(3), pages 533-553, June.
    4. Titl, Vitezslav & De Witte, Kristof & Geys, Benny, 2021. "Political donations, public procurement and government efficiency," World Development, Elsevier, vol. 148(C).
    5. D’Inverno, Giovanna & De Witte, Kristof, 2020. "Service level provision in municipalities: A flexible directional distance composite indicator," European Journal of Operational Research, Elsevier, vol. 286(3), pages 1129-1141.
    6. Titl, Vitezslav & De Witte, Kristof, 2022. "How politics influence public good provision," Socio-Economic Planning Sciences, Elsevier, vol. 81(C).
    7. Dan-Ping Li & Li Xie & Peng-Fei Cheng & Xiang-Hong Zhou & Cheng-Xun Fu, 2021. "Green Supplier Selection Under Cloud Manufacturing Environment: A Hybrid MCDM Model," SAGE Open, , vol. 11(4), pages 21582440211, November.
    8. Kheybari, Siamak & Rezaie, Fariba Mahdi & Farazmand, Hadis, 2020. "Analytic network process: An overview of applications," Applied Mathematics and Computation, Elsevier, vol. 367(C).
    9. Maghsoodi, Abtin Ijadi, 2023. "Cryptocurrency portfolio allocation using a novel hybrid and predictive big data decision support system," Omega, Elsevier, vol. 115(C).
    10. Tommaso Agasisti & Giuseppe Munda, 2017. "Efficiency of investment in compulsory education: An Overview of Methodological Approaches," JRC Research Reports JRC106681, Joint Research Centre.
    11. Abbas Keramati & Fatemeh Shapouri, 2016. "Multidimensional appraisal of customer relationship management: integrating balanced scorecard and multi criteria decision making approaches," Information Systems and e-Business Management, Springer, vol. 14(2), pages 217-251, May.
    12. Jussi Tanskanen & Liisa Mäkelä & Riitta Viitala, 2019. "Linking Managerial Coaching and Leader–Member Exchange on Work Engagement and Performance," Journal of Happiness Studies, Springer, vol. 20(4), pages 1217-1240, April.
    13. Ioannis Sitaridis & Fotis Kitsios, 2020. "Competitiveness analysis and evaluation of entrepreneurial ecosystems: a multi-criteria approach," Annals of Operations Research, Springer, vol. 294(1), pages 377-399, November.
    14. Geys, Benny & Konrad, Kai A., . "Federalism and optimal allocation across levels of governance," Chapters in Economics,, University of Munich, Department of Economics.
    15. Haji Vahabzadeh, Ali & Asiaei, Arash & Zailani, Suhaiza, 2015. "Reprint of “Green decision-making model in reverse logistics using FUZZY-VIKOR method”," Resources, Conservation & Recycling, Elsevier, vol. 104(PB), pages 334-347.
    16. Isabel Narbón-Perpiñá & Maria Teresa Balaguer-Coll & Diego Prior & Emili Tortosa-Ausina, 2021. "Searching for the optimal territorial structure: the case of Spanish provincial councils," Regional Studies, Taylor & Francis Journals, vol. 55(4), pages 645-664, April.
    17. Bartłomiej Kizielewicz & Jarosław Wątróbski & Wojciech Sałabun, 2020. "Identification of Relevant Criteria Set in the MCDA Process—Wind Farm Location Case Study," Energies, MDPI, vol. 13(24), pages 1-40, December.
    18. Seyed Morteza Hatefi & Hamideh Asadi & Gholamreza Shams & Jolanta Tamošaitienė & Zenonas Turskis, 2021. "Model for the Sustainable Material Selection by Applying Integrated Dempster-Shafer Evidence Theory and Additive Ratio Assessment (ARAS) Method," Sustainability, MDPI, vol. 13(18), pages 1-23, September.
    19. Kai Wang & Zhe Wang & Jun Deng & Yuanyuan Feng & Quanfang Li, 2022. "Study on the Evaluation of Emergency Management Capacity of Resilient Communities by the AHP-TOPSIS Method," IJERPH, MDPI, vol. 19(23), pages 1-14, December.
    20. Jose M. Cordero & Cristina Polo & Nickolaos G. Tzeremes, 2020. "Evaluating the efficiency of municipalities in the presence of unobserved heterogeneity," Journal of Productivity Analysis, Springer, vol. 53(3), pages 377-390, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:91:y:2022:i:c:s0149718921001154. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.