IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v11y2019i19p5471-d273037.html
   My bibliography  Save this article

Reform of Chinese Universities in the Context of Sustainable Development: Teacher Evaluation and Improvement Based on Hybrid Multiple Criteria Decision-Making Model

Author

Listed:
  • Sung-Shun Weng

    (Department of Information and Finance Management, National Taipei University of Technology, Taipei 10608, Taiwan)

  • Yang Liu

    (Department of Information and Finance Management, National Taipei University of Technology, Taipei 10608, Taiwan)

  • Yen-Ching Chuang

    (Department of Industrial Engineering and Management, National Taipei University of Technology, 1, Sec. 3, Zhongxiao E. Rd., Taipei 10608, Taiwan)

Abstract

China is pushing universities to implement reforms in order to achieve the sustainable development goals, but with the development level of teachers becoming the key restricting factor. In this sense, teacher evaluation and improvement act as positive factors for China to achieve the 2030 sustainable development goals. Previous studies on teacher evaluation have usually assumed that the relationship between the evaluation criteria is independent, with the weights of each standard derived from this assumption. However, this assumption is often not in line with the actual situation. Decisions based on these studies are likely to waste resources and may negatively impact the efficiency and effectiveness of teachers’ sustainable development. This study developed an integrated model for the evaluation and improvement of teachers based on the official teacher evaluation criteria of China’s International Scholarly Exchange Curriculum (ISEC) programme and a multiple criteria decision-making methodology. First, a decision-making trial and a laboratory-based analytical network process were used to establish an influential network-relation diagram (INRD) and influential weights under ISEC standards. Next, an important performance analysis was used to integrate the weight and performance of each standard to produce a worst-performance criterion set for each university teacher. Finally, the worst performance set used an INRD to derive an improvement strategy with a cause–effect relationship for each teacher. This study chose a Chinese university that has implemented teaching reform for our case study. The results show that our developed model can assist decision-makers to improve their current evaluations of teachers and to provide a cause–effect improvement strategy for education reform committees and higher education institutions.

Suggested Citation

  • Sung-Shun Weng & Yang Liu & Yen-Ching Chuang, 2019. "Reform of Chinese Universities in the Context of Sustainable Development: Teacher Evaluation and Improvement Based on Hybrid Multiple Criteria Decision-Making Model," Sustainability, MDPI, vol. 11(19), pages 1-23, October.
  • Handle: RePEc:gam:jsusta:v:11:y:2019:i:19:p:5471-:d:273037
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/11/19/5471/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2071-1050/11/19/5471/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Abalo, Javier & Varela, Jesus & Manzano, Vicente, 2007. "Importance values for Importance-Performance Analysis: A formula for spreading out values derived from preference rankings," Journal of Business Research, Elsevier, vol. 60(2), pages 115-121, February.
    2. Oral, Muhittin & Oukil, Amar & Malouin, Jean-Louis & Kettani, Ossama, 2014. "The appreciative democratic voice of DEA: A case of faculty academic performance evaluation," Socio-Economic Planning Sciences, Elsevier, vol. 48(1), pages 20-28.
    3. Julia Lane, 2010. "Let's make science metrics more scientific," Nature, Nature, vol. 464(7288), pages 488-489, March.
    4. Johnes, Jill & Yu, Li, 2008. "Measuring the research performance of Chinese higher education institutions using data envelopment analysis," China Economic Review, Elsevier, vol. 19(4), pages 679-696, December.
    5. Ralph L. Keeney & Kelly E. See & Detlof von Winterfeldt, 2006. "Evaluating Academic Programs: With Applications to U.S. Graduate Decision Science Programs," Operations Research, INFORMS, vol. 54(5), pages 813-828, October.
    6. Frauman, Eric & Banks, Sarah, 2011. "Gateway community resident perceptions of tourism development: Incorporating Importance-Performance Analysis into a Limits of Acceptable Change framework," Tourism Management, Elsevier, vol. 32(1), pages 128-140.
    7. Coccia, Mario, 2008. "Measuring scientific performance of public research units for strategic change," Journal of Informetrics, Elsevier, vol. 2(3), pages 183-194.
    8. Ji-Feng Ding & Jung-Fong Kuo & Wen-Hwa Shyu & Chien-Chang Chou, 2019. "Evaluating determinants of attractiveness and their cause-effect relationships for container ports in Taiwan: users’ perspectives," Maritime Policy & Management, Taylor & Francis Journals, vol. 46(4), pages 466-490, May.
    9. Jean-Charles Billaut & Denis Bouyssou & Philippe Vincke, 2010. "Should you believe in the Shanghai ranking?," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(1), pages 237-263, July.
    10. Gudiel Pineda, Pedro Jose & Liou, James J.H. & Hsu, Chao-Che & Chuang, Yen-Ching, 2018. "An integrated MCDM model for improving airline operational and financial performance," Journal of Air Transport Management, Elsevier, vol. 68(C), pages 103-117.
    11. Marlene N M Filipe & Fernando A F Ferreira & Sérgio P Santos, 2015. "A multiple criteria information system for pedagogical evaluation and professional development of teachers," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 66(11), pages 1769-1782, November.
    12. Jean-Charles Billaut & Denis Bouyssou & Philippe Vincke, 2010. "Should you believe in the Shanghai ranking?," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(1), pages 237-263, July.
    13. Ding, Lan & Zeng, Yao, 2015. "Evaluation of Chinese higher education by TOPSIS and IEW — The case of 68 universities belonging to the Ministry of Education in China," China Economic Review, Elsevier, vol. 36(C), pages 341-358.
    14. repec:dau:papers:123456789/2947 is not listed on IDEAS
    15. Rosa María Brito & Columba Rodríguez & José Luis Aparicio, 2018. "Sustainability in Teaching: An Evaluation of University Teachers and Students," Sustainability, MDPI, vol. 10(2), pages 1-16, February.
    16. Lu, Ming-Tsang & Hsu, Chao-Che & Liou, James J.H. & Lo, Huai-Wei, 2018. "A hybrid MCDM and sustainability-balanced scorecard model to establish sustainable performance evaluation for international airports," Journal of Air Transport Management, Elsevier, vol. 71(C), pages 9-19.
    17. Bo-Wei Zhu & Jia-Rui Zhang & Gwo-Hshiung Tzeng & Shan-Lin Huang & Lei Xiong, 2017. "Public Open Space Development for Elderly People by Using the DANP-V Model to Establish Continuous Improvement Strategies towards a Sustainable and Healthy Aging Society," Sustainability, MDPI, vol. 9(3), pages 1-29, March.
    18. Mercedes Varela-Losada & Azucena Arias-Correa & Uxío Pérez-Rodríguez & Pedro Vega-Marcote, 2019. "How Can Teachers Be Encouraged to Commit to Sustainability? Evaluation of a Teacher-Training Experience in Spain," Sustainability, MDPI, vol. 11(16), pages 1-12, August.
    19. Qi-Gan Shao & James J. H. Liou & Sung-Shun Weng & Yen-Ching Chuang, 2018. "Improving the Green Building Evaluation System in China Based on the DANP Method," Sustainability, MDPI, vol. 10(4), pages 1-20, April.
    20. Bana e Costa, Carlos A. & Oliveira, Mónica D., 2012. "A multicriteria decision analysis model for faculty evaluation," Omega, Elsevier, vol. 40(4), pages 424-436.
    21. Sever, Ivan, 2015. "Importance-performance analysis: A valid management tool?," Tourism Management, Elsevier, vol. 48(C), pages 43-53.
    22. I-Ming Feng & Jun-Hong Chen & Bo-Wei Zhu & Lei Xiong, 2018. "Assessment of and Improvement Strategies for the Housing of Healthy Elderly: Improving Quality of Life," Sustainability, MDPI, vol. 10(3), pages 1-32, March.
    23. Olaya Álvarez-García & Luis Ángel García-Escudero & Francisca Salvà-Mut & Aina Calvo-Sastre, 2019. "Variables Influencing Pre-Service Teacher Training in Education for Sustainable Development: A Case Study of Two Spanish Universities," Sustainability, MDPI, vol. 11(16), pages 1-14, August.
    24. Boley, B. Bynum & McGehee, Nancy Gard & Tom Hammett, A.L., 2017. "Importance-performance analysis (IPA) of sustainable tourism initiatives: The resident perspective," Tourism Management, Elsevier, vol. 58(C), pages 66-77.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yifan Liu & Tiantian Bao & Dan Zhao & Huiyun Sang & Benwei Fu, 2022. "Evaluation of Student-Perceived Service Quality in Higher Education for Sustainable Development: A Fuzzy TODIM-ERA Method," Sustainability, MDPI, vol. 14(8), pages 1-21, April.
    2. Sandra Caeiro & Ulisses M. Azeiteiro, 2020. "Sustainability Assessment in Higher Education Institutions," Sustainability, MDPI, vol. 12(8), pages 1-4, April.
    3. Hui-Wen Vivian Tang & Lynne Lee, 2021. "Developing an Organizational Climate Diagnostic Instrument for Junior High Schools in Taiwan," SAGE Open, , vol. 11(1), pages 21582440219, February.
    4. Cristina Checa & Carmen De-Pablos-Heredero & Yenny Guiselli Torres & José Luis Montes-Botella & Cecilio Barba & Antón García, 2020. "Focused Coordination Models towards Sustainability in Higher Education. Case of Quevedo State Technical University (Ecuador)," Sustainability, MDPI, vol. 12(14), pages 1-16, July.
    5. Meng-Chen Zhang & Bo-Wei Zhu & Chao-Meng Huang & Gwo-Hshiung Tzeng, 2021. "Systematic Evaluation Model for Developing Sustainable World-Class Universities: An East Asian Perspective," Mathematics, MDPI, vol. 9(8), pages 1-20, April.
    6. Tien-Li Chen & Chin-Chuan Chen & Yen-Ching Chuang & James J. H. Liou, 2020. "A Hybrid MADM Model for Product Design Evaluation and Improvement," Sustainability, MDPI, vol. 12(17), pages 1-22, August.
    7. Sung-Shun Weng & Yang Liu & Juan Dai & Yen-Ching Chuang, 2020. "A Novel Improvement Strategy of Competency for Education for Sustainable Development (ESD) of University Teachers Based on Data Mining," Sustainability, MDPI, vol. 12(7), pages 1-18, March.
    8. Manuel Sousa & Maria Fatima Almeida & Rodrigo Calili, 2021. "Multiple Criteria Decision Making for the Achievement of the UN Sustainable Development Goals: A Systematic Literature Review and a Research Agenda," Sustainability, MDPI, vol. 13(8), pages 1-37, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bana e Costa, Carlos A. & Oliveira, Mónica D., 2012. "A multicriteria decision analysis model for faculty evaluation," Omega, Elsevier, vol. 40(4), pages 424-436.
    2. Michele Preziosi & Alessia Acampora & Maria Claudia Lucchetti & Roberto Merli, 2022. "Delighting Hotel Guests with Sustainability: Revamping Importance-Performance Analysis in the Light of the Three-Factor Theory of Customer Satisfaction," Sustainability, MDPI, vol. 14(6), pages 1-20, March.
    3. Esmailpour, Javad & Aghabayk, Kayvan & Abrari Vajari, Mohammad & De Gruyter, Chris, 2020. "Importance – Performance Analysis (IPA) of bus service attributes: A case study in a developing country," Transportation Research Part A: Policy and Practice, Elsevier, vol. 142(C), pages 129-150.
    4. Tien-Li Chen & Chin-Chuan Chen & Yen-Ching Chuang & James J. H. Liou, 2020. "A Hybrid MADM Model for Product Design Evaluation and Improvement," Sustainability, MDPI, vol. 12(17), pages 1-22, August.
    5. Brandão, Luana Carneiro & Soares de Mello, João Carlos Correia Baptista, 2019. "A multi-criteria approach to the h-index," European Journal of Operational Research, Elsevier, vol. 276(1), pages 357-363.
    6. Chengcai Tang & Qianqian Zheng & Pin Ng, 2019. "A Study on the Coordinative Green Development of Tourist Experience and Commercialization of Tourism at Cultural Heritage Sites," Sustainability, MDPI, vol. 11(17), pages 1-19, August.
    7. Jih-Kuang Chen, 2021. "A New Approach for Diagonal Line Model of Importance-Performance Analysis: A Case Study of Tourist Satisfaction in China," SAGE Open, , vol. 11(1), pages 21582440219, January.
    8. Alexandr Gedranovich & Mykhaylo Salnykov, 2012. "Productivity analysis of Belarusian higher education system," BEROC Working Paper Series 16, Belarusian Economic Research and Outreach Center (BEROC).
    9. El Gibari, Samira & Gómez, Trinidad & Ruiz, Francisco, 2018. "Evaluating university performance using reference point based composite indicators," Journal of Informetrics, Elsevier, vol. 12(4), pages 1235-1250.
    10. Khatab Alqararah, 2023. "Assessing the robustness of composite indicators: the case of the Global Innovation Index," Journal of Innovation and Entrepreneurship, Springer, vol. 12(1), pages 1-22, December.
    11. Patricia Esteve-Guirao & Mercedes Jaén García & Isabel Banos-González, 2019. "The Interdependences between Sustainability and Their Lifestyle That Pre-Service Teachers Establish When Addressing Socio-Ecological Problems," Sustainability, MDPI, vol. 11(20), pages 1-18, October.
    12. Franceschini, Fiorenzo & Maisano, Domenico, 2011. "Structured evaluation of the scientific output of academic research groups by recent h-based indicators," Journal of Informetrics, Elsevier, vol. 5(1), pages 64-74.
    13. Zofio, Jose Luis & Aparicio, Juan & Barbero, Javier & Zabala-Iturriagagoitia, Jon Mikel, 2023. "The influence of bottlenecks on innovation systems performance: Put the slowest climber first," Technological Forecasting and Social Change, Elsevier, vol. 193(C).
    14. Roger Chapman Burk & Richard M. Nehring, 2023. "An Empirical Comparison of Rank-Based Surrogate Weights in Additive Multiattribute Decision Analysis," Decision Analysis, INFORMS, vol. 20(1), pages 55-72, March.
    15. D. Docampo & D. Egret & L. Cram, 2015. "The effect of university mergers on the Shanghai ranking," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(1), pages 175-191, July.
    16. Linghan Zhang & Junyi Zhang, 2018. "Impacts of Leisure and Tourism on the Elderly’s Quality of Life in Intimacy: A Comparative Study in Japan," Sustainability, MDPI, vol. 10(12), pages 1-17, December.
    17. Yu-Hung Chien & Fang-Yu Chang, 2023. "An importance-performance analysis of teachers’ perception of STEM engineering design education," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-11, December.
    18. Lai, Ivan Ka Wai & Hitchcock, Michael, 2015. "Importance–performance analysis in tourism: A framework for researchers," Tourism Management, Elsevier, vol. 48(C), pages 242-267.
    19. Gul, Muhammet & Yucesan, Melih, 2022. "Performance evaluation of Turkish Universities by an integrated Bayesian BWM-TOPSIS model," Socio-Economic Planning Sciences, Elsevier, vol. 80(C).
    20. Hiran H. Lathabai & Abhirup Nandy & Vivek Kumar Singh, 2021. "x-index: Identifying core competency and thematic research strengths of institutions using an NLP and network based ranking framework," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(12), pages 9557-9583, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:11:y:2019:i:19:p:5471-:d:273037. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.