IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v86y2011i2d10.1007_s11192-010-0268-7.html
   My bibliography  Save this article

An approach to improve the indicator weights of scientific and technological competitiveness evaluation of Chinese universities

Author

Listed:
  • Jingda Ding

    (Wuhan University)

  • Junping Qiu

    (Wuhan University)

Abstract

As indicator weights obtaining is often difficult in all types of evaluation, this paper describes an approach to improve the indicator weights of scientific and technological competitiveness evaluation of Chinese universities. As a public institution funded by Chinese government, the research center for Chinese science evaluation of Wuhan University has completed five annual evaluations for the scientific and technological competitiveness of Chinese universities since 2005, whose abundant and reliable data motivated us to try to improve the weights obtained by the AHP (analytical hierarchy process). Based on these data, we calculated the objective weights of the indicator using the representative mathematical methods of the least square and the variation coefficient. As the weights of AHP can be influenced by the knowledge, experience and preference of experts and the calculated objective weights neglect the subjective judgement information, we integrated the subjective and objective weights by respectively using the additive and multiplicative model to reflect both the subjective considerations of experts and the objective information, and obtained three kinds of integrative weights. Finally, we selected the integrative weights of multiplicative model as the best weights by comparing and analyzing the evaluation results in 2005 and 2009 of each kind of weights. The results show that the evaluation effect of the weights of multiplicative model is indeed the best for all types of Chinese universities among these kinds of weights, and the experts and university principals enquired also basically reached a consensus on the university rankings of the integrative weights of multiplicative model.

Suggested Citation

  • Jingda Ding & Junping Qiu, 2011. "An approach to improve the indicator weights of scientific and technological competitiveness evaluation of Chinese universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 86(2), pages 285-297, February.
    • Handle: RePEc:spr:scient:v:86:y:2011:i:2:d:10.1007_s11192-010-0268-7
    DOI: 10.1007/s11192-010-0268-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-010-0268-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-010-0268-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Mu-Hsuan Huang & Han-Wen Chang & Dar-Zen Chen, 2006. "Research evaluation of research-oriented universities in Taiwan from 1993 to 2003," Scientometrics, Springer;Akadémiai Kiadó, vol. 67(3), pages 419-435, June.
    2. Chiang Kao & Hwei-Lan Pao, 2009. "An evaluation of research performance in management of 168 Taiwan universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 78(2), pages 261-277, February.
    3. Higgins, J. C., 1989. "Performance measurement in universities," European Journal of Operational Research, Elsevier, vol. 38(3), pages 358-368, February.
    4. Diakoulaki, D & Mavrotas, G & Papayannakis, L, 1992. "A multicriteria approach for evaluating the performance of industrial firms," Omega, Elsevier, vol. 20(4), pages 467-474, July.
    5. Yoram Wind & Thomas L. Saaty, 1980. "Marketing Applications of the Analytic Hierarchy Process," Management Science, INFORMS, vol. 26(7), pages 641-658, July.
    6. Ma, Jian & Fan, Zhi-Ping & Huang, Li-Hua, 1999. "A subjective and objective integrated approach to determine attribute weights," European Journal of Operational Research, Elsevier, vol. 112(2), pages 397-404, January.
    7. Ellen Bonnevie-Nebelong, 2006. "Journal citation identity, journal citation image and internationalisation: Methods for journal evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 66(2), pages 411-424, February.
    8. A. Raan, 1999. "Advanced bibliometric methods for the evaluation of universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 45(3), pages 417-423, July.
    9. Linda Butler, 2002. "Identifying "highly-rated" journals - an Australian case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 53(2), pages 207-227, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Leo Freyer, 2014. "Robust rankings," Scientometrics, Springer;Akadémiai Kiadó, vol. 100(2), pages 391-406, August.
    2. Gul, Muhammet & Yucesan, Melih, 2022. "Performance evaluation of Turkish Universities by an integrated Bayesian BWM-TOPSIS model," Socio-Economic Planning Sciences, Elsevier, vol. 80(C).
    3. Benito Bonito, Mónica & Romera Ayllón, María Rosario, 2011. "Improving quality assessment of composite indicators in university rankings: a case study of French and German universities of excellence," DES - Working Papers. Statistics and Econometrics. WS ws112015, Universidad Carlos III de Madrid. Departamento de Estadística.
    4. Yoon, Jungsub & Oh, Yoonhwan & Lee, Jeong-Dong, 2017. "The impact of policy consistency on technological competitiveness: A study on OECD countries," Energy Policy, Elsevier, vol. 108(C), pages 425-434.
    5. M. Benito & R. Romera, 2011. "Improving quality assessment of composite indicators in university rankings: a case study of French and German universities of excellence," Scientometrics, Springer;Akadémiai Kiadó, vol. 89(1), pages 153-176, October.
    6. Antonio Fernández-Cano & Elvira Curiel-Marin & Manuel Torralbo-Rodríguez & Mónica Vallejo-Ruiz, 2018. "Questioning the Shanghai Ranking methodology as a tool for the evaluation of universities: an integrative review," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 2069-2083, September.
    7. Yuandi Wang & Jiashun Huang & Yantai Chen & Xiongfeng Pan & Jin Chen, 2013. "Have Chinese universities embraced their third mission? New insight from a business perspective," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(2), pages 207-222, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chiang Kao & Hwei-Lan Pao, 2009. "An evaluation of research performance in management of 168 Taiwan universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 78(2), pages 261-277, February.
    2. Rađenović Žarko & Veselinović Ivana, 2017. "Integrated AHP-TOPSIS Method for the Assessment of Health Management Information Systems Efficiency," Economic Themes, Sciendo, vol. 55(1), pages 121-142, March.
    3. Ruimin Ma & Chaoqun Ni & Junping Qiu, 2008. "Scientific research competitiveness of world universities in computer science," Scientometrics, Springer;Akadémiai Kiadó, vol. 76(2), pages 245-260, August.
    4. Chiang Kao & Hsiou-Wei Lin & San-Lin Chung & Wei-Chi Tsai & Jyh-Shen Chiou & Yen-Liang Chen & Liang-Hsuan Chen & Shih-Chieh Fang & Hwei-Lan Pao, 2008. "Ranking Taiwanese management journals: A case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 76(1), pages 95-115, July.
    5. Chiang Kao, 2009. "The authorship and internationality of Industrial Engineering journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(1), pages 123-136, October.
    6. Milan Ranđelović & Jelena Stanković & Kristijan Kuk & Gordana Savić & Dragan Ranđelović, 2018. "An Approach to Determining the Importance of Model Criteria in Certifying a City as Business-Friendly," Interfaces, INFORMS, vol. 48(2), pages 156-165, April.
    7. Ewa Roszkowska, 2020. "The extention rank ordering criteria weighting methods in fuzzy enviroment," Operations Research and Decisions, Wroclaw University of Science and Technology, Faculty of Management, vol. 30(2), pages 91-114.
    8. Chiang Kao & Shiang-Tai Liu & Hwei-Lan Pao, 2012. "Assessing improvement in management research in Taiwan," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(1), pages 75-87, July.
    9. Edmundas Kazimieras Zavadskas & Valentinas Podvezko, 2016. "Integrated Determination of Objective Criteria Weights in MCDM," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 15(02), pages 267-283, March.
    10. Feng, Bo & Jiang, Zhong-Zhong & Fan, Zhi-Ping & Fu, Na, 2010. "A method for member selection of cross-functional teams using the individual and collaborative performances," European Journal of Operational Research, Elsevier, vol. 203(3), pages 652-661, June.
    11. Xu, Xiaozhan, 2004. "A note on the subjective and objective integrated approach to determine attribute weights," European Journal of Operational Research, Elsevier, vol. 156(2), pages 530-532, July.
    12. Banai, Reza, 2010. "Evaluation of land use-transportation systems with the Analytic Network Process," The Journal of Transport and Land Use, Center for Transportation Studies, University of Minnesota, vol. 3(1), pages 85-112.
    13. Fatih Yiğit & Şakir Esnaf, 2021. "A new Fuzzy C-Means and AHP-based three-phased approach for multiple criteria ABC inventory classification," Journal of Intelligent Manufacturing, Springer, vol. 32(6), pages 1517-1528, August.
    14. Rachele Corticelli & Margherita Pazzini & Cecilia Mazzoli & Claudio Lantieri & Annarita Ferrante & Valeria Vignali, 2022. "Urban Regeneration and Soft Mobility: The Case Study of the Rimini Canal Port in Italy," Sustainability, MDPI, vol. 14(21), pages 1-27, November.
    15. Lin, Sheng-Hau & Zhao, Xiaofeng & Wu, Jiuxing & Liang, Fachao & Li, Jia-Hsuan & Lai, Ren-Ji & Hsieh, Jing-Chzi & Tzeng, Gwo-Hshiung, 2021. "An evaluation framework for developing green infrastructure by using a new hybrid multiple attribute decision-making model for promoting environmental sustainability," Socio-Economic Planning Sciences, Elsevier, vol. 75(C).
    16. Pishchulov, Grigory & Trautrims, Alexander & Chesney, Thomas & Gold, Stefan & Schwab, Leila, 2019. "The Voting Analytic Hierarchy Process revisited: A revised method with application to sustainable supplier selection," International Journal of Production Economics, Elsevier, vol. 211(C), pages 166-179.
    17. Seung-Jin Han & Won-Jae Lee & So-Hee Kim & Sang-Hoon Yoon & Hyunwoong Pyun, 2022. "Assessing Expected Long-term Benefits for the Olympic Games: Delphi-AHP Approach from Korean Olympic Experts," SAGE Open, , vol. 12(4), pages 21582440221, December.
    18. Denys Yemshanov & Frank H. Koch & Yakov Ben‐Haim & Marla Downing & Frank Sapio & Marty Siltanen, 2013. "A New Multicriteria Risk Mapping Approach Based on a Multiattribute Frontier Concept," Risk Analysis, John Wiley & Sons, vol. 33(9), pages 1694-1709, September.
    19. Seyed Rakhshan & Ali Kamyad & Sohrab Effati, 2015. "Ranking decision-making units by using combination of analytical hierarchical process method and Tchebycheff model in data envelopment analysis," Annals of Operations Research, Springer, vol. 226(1), pages 505-525, March.
    20. V. Srinivasan & G. Shainesh & Anand K. Sharma, 2015. "An approach to prioritize customer-based, cost-effective service enhancements," The Service Industries Journal, Taylor & Francis Journals, vol. 35(14), pages 747-762, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:86:y:2011:i:2:d:10.1007_s11192-010-0268-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.