IDEAS home Printed from https://ideas.repec.org/a/pal/jorsoc/v68y2017i4d10.1057_s41274-016-0168-1.html
   My bibliography  Save this article

Assessing research effectiveness: a comparison of alternative nonparametric models

Author

Listed:
  • Giannis Karagiannis

    () (University of Macedonia)

  • Georgia Paschalidou

    (University of Macedonia)

Abstract

Abstract In this paper, we examine three alternative a posteriori weighting schemes with variable, common and restricted weights in order to assess research productivity by means of two seemingly similar nonparametric models: the Benefit-of-the-doubt and the Kao and Hung (2003) model. Our empirical results, based on different types of faculty members’ publications, show that there is more variability in the estimated effectiveness scores among alternative weighting schemes within each model rather than between models for any particular weighting scheme. In addition, we also found that the effectiveness scores from the BoD model are greater than or equal to those from the K&H model for the variable- and the restricted-weights schemes while there is no clear pattern between the BoD and the K&H effectiveness scores from the common-weights scheme.

Suggested Citation

  • Giannis Karagiannis & Georgia Paschalidou, 2017. "Assessing research effectiveness: a comparison of alternative nonparametric models," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 456-468, April.
  • Handle: RePEc:pal:jorsoc:v:68:y:2017:i:4:d:10.1057_s41274-016-0168-1
    DOI: 10.1057/s41274-016-0168-1
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1057/s41274-016-0168-1
    File Function: Abstract
    Download Restriction: Access to full text is restricted to subscribers.

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Liu, W.B. & Zhang, D.Q. & Meng, W. & Li, X.X. & Xu, F., 2011. "A study of DEA models without explicit inputs," Omega, Elsevier, vol. 39(5), pages 472-480, October.
    2. Wang, Ying-Ming & Chin, Kwai-Sang, 2010. "Some alternative models for DEA cross-efficiency evaluation," International Journal of Production Economics, Elsevier, vol. 128(1), pages 332-338, November.
    3. Lovell, C. A. Knox & Pastor, Jesus T., 1999. "Radial DEA models without inputs or without outputs," European Journal of Operational Research, Elsevier, vol. 118(1), pages 46-51, October.
    4. Hagen, Nils T., 2014. "Counting and comparing publication output with and without equalizing and inflationary bias," Journal of Informetrics, Elsevier, vol. 8(2), pages 310-317.
    5. Ng, Wan Lung, 2007. "A simple classifier for multiple criteria ABC analysis," European Journal of Operational Research, Elsevier, vol. 177(1), pages 344-353, February.
    6. Caporaletti, L. E. & Dulá, J. H. & Womer, N. K., 1999. "Performance evaluation based on multiple attributes with nonparametric frontiers," Omega, Elsevier, vol. 27(6), pages 637-645, December.
    7. repec:pal:jorsoc:v:68:y:2017:i:7:d:10.1057_jors.2015.81 is not listed on IDEAS
    8. Oral, Muhittin & Oukil, Amar & Malouin, Jean-Louis & Kettani, Ossama, 2014. "The appreciative democratic voice of DEA: A case of faculty academic performance evaluation," Socio-Economic Planning Sciences, Elsevier, vol. 48(1), pages 20-28.
    9. Kao, Chiang & Wu, Wann-Yih & Hsieh, Wen-Jen & Wang, Tai-Yue & Lin, Chinho & Chen, Liang-Hsuan, 2008. "Measuring the national competitiveness of Southeast Asian countries," European Journal of Operational Research, Elsevier, vol. 187(2), pages 613-628, June.
    10. Kao, Chiang, 1994. "Evaluation of junior colleges of technology: The Taiwan case," European Journal of Operational Research, Elsevier, vol. 72(1), pages 43-51, January.
    11. repec:spr:scient:v:93:y:2012:i:3:d:10.1007_s11192-012-0714-9 is not listed on IDEAS
    12. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    13. Lins, Marcos P. Estellita & Gomes, Eliane G. & Soares de Mello, Joao Carlos C. B. & Soares de Mello, Adelino Jose R., 2003. "Olympic ranking based on a zero sum gains DEA model," European Journal of Operational Research, Elsevier, vol. 148(2), pages 312-322, July.
    14. repec:spr:scient:v:76:y:2008:i:2:d:10.1007_s11192-007-1942-2 is not listed on IDEAS
    15. Sungmook Lim & Joe Zhu, 2015. "DEA cross-efficiency evaluation under variable returns to scale," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 66(3), pages 476-487, March.
    16. Soares de Mello, João Carlos C.B. & Angulo Meza, Lidia & da Silveira, Juliana Quintanilha & Gomes, Eliane Gonçalves, 2013. "About negative efficiencies in Cross Evaluation BCC input oriented models," European Journal of Operational Research, Elsevier, vol. 229(3), pages 732-737.
    17. Angel Prieto & José ZofIo, 2001. "Evaluating Effectiveness in Public Provision of Infrastructure and Equipment: The Case of Spanish Municipalities," Journal of Productivity Analysis, Springer, vol. 15(1), pages 41-58, January.
    18. Kao, Chiang & Hung, Hsi-Tai, 2007. "Management performance: An empirical study of the manufacturing companies in Taiwan," Omega, Elsevier, vol. 35(2), pages 152-160, April.
    19. Rogge, Nicky & De Witte, Kristof, 2009. "To publish or not to publish? On the aggregation and drivers of research performance," Working Papers 2009/42, Hogeschool-Universiteit Brussel, Faculteit Economie en Management.
    20. repec:spr:scient:v:78:y:2009:i:2:d:10.1007_s11192-007-1906-6 is not listed on IDEAS
    21. Laurens Cherchye & Willem Moesen & Nicky Rogge & Tom Puyenbroeck, 2007. "An Introduction to ‘Benefit of the Doubt’ Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 82(1), pages 111-145, May.
    22. repec:spr:scient:v:92:y:2012:i:1:d:10.1007_s11192-012-0721-x is not listed on IDEAS
    23. Liang, Liang & Wu, Jie & Cook, Wade D. & Zhu, Joe, 2008. "Alternative secondary goals in DEA cross-efficiency evaluation," International Journal of Production Economics, Elsevier, vol. 113(2), pages 1025-1030, June.
    24. Ng, Wan Lung, 2008. "An efficient and simple model for multiple criteria supplier selection problem," European Journal of Operational Research, Elsevier, vol. 186(3), pages 1059-1067, May.
    25. Karagiannis, Giannis & Knox Lovell, C.A., 2016. "Productivity measurement in radial DEA models with a single constant input," European Journal of Operational Research, Elsevier, vol. 251(1), pages 323-328.
    26. repec:spr:scient:v:85:y:2010:i:3:d:10.1007_s11192-010-0286-5 is not listed on IDEAS
    27. repec:spr:scient:v:96:y:2013:i:1:d:10.1007_s11192-013-0971-2 is not listed on IDEAS
    28. Abramo, Giovanni & Cicero, Tindaro & D’Angelo, Ciriaco Andrea, 2011. "A field-standardized application of DEA to national-scale research assessment of universities," Journal of Informetrics, Elsevier, vol. 5(4), pages 618-628.
    29. repec:pal:jorsoc:v:56:y:2005:i:10:d:10.1057_palgrave.jors.2601924 is not listed on IDEAS
    30. Färe, Rolf & Karagiannis, Giannis, 2017. "The denominator rule for share-weighting aggregation," European Journal of Operational Research, Elsevier, vol. 260(3), pages 1175-1180.
    31. Pilar Murias & José Miguel & David Rodríguez, 2008. "A Composite Indicator for University Quality Assesment: The Case of Spanish Higher Education System," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 89(1), pages 129-146, October.
    32. repec:pal:jorsoc:v:55:y:2004:i:8:d:10.1057_palgrave.jors.2601752 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    More about this item

    Keywords

    research effectiveness; DEA; BoD; weighting schemes;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pal:jorsoc:v:68:y:2017:i:4:d:10.1057_s41274-016-0168-1. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Sonal Shukla) or (Rebekah McClure). General contact details of provider: http://www.palgrave-journals.com/ .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.