IDEAS home Printed from https://ideas.repec.org/a/eee/jomega/v40y2012i4p424-436.html
   My bibliography  Save this article

A multicriteria decision analysis model for faculty evaluation

Author

Listed:
  • Bana e Costa, Carlos A.
  • Oliveira, Mónica D.

Abstract

In the context of increasing demands for social and financial accountability of universities, the required implementation of transparent faculty evaluation systems constitutes a challenge and an opportunity for universities strategically aligning the activity of academic staff with the university goals. However, despite growing interest in the performance appraisal of faculty, only a few reported studies propose models that cover the full range of academic activities and the models in use are typically based on ad hoc scoring systems that lack theoretical soundness. This article approaches faculty evaluation from an innovative comprehensive perspective. Based on the concepts and methods of multiple criteria value measurement, it proposes a new faculty evaluation model that addresses the whole range of academic activities and can be applied within and across distinct scientific areas, while respecting their specificities. Constructed through a socio-technical process, the model was designed for and adopted by the Instituto Superior Técnico, the engineering school of the Technical University of Lisbon. The model has a two-level hierarchical additive structure, with top-level evaluation areas specified by second-level evaluation criteria. A bottom non-additive third level accounts for the quantitative and qualitative dimensions of academic activity related to each evaluation criterion. The model allows (a) the comparison of the performance of academic staff with performance targets reflecting the strategic policy concerns of university management; (b) the definition of the multicriteria value profile of each faculty member at the top level of the evaluation areas; (c) the computation of an overall value score for each faculty member, through an optimisation procedure that makes use of a flexible system of weights and (d) the assignment of faculty members to rating categories.

Suggested Citation

  • Bana e Costa, Carlos A. & Oliveira, Mónica D., 2012. "A multicriteria decision analysis model for faculty evaluation," Omega, Elsevier, vol. 40(4), pages 424-436.
  • Handle: RePEc:eee:jomega:v:40:y:2012:i:4:p:424-436
    DOI: 10.1016/j.omega.2011.08.006
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305048311001265
    Download Restriction: Full text for ScienceDirect subscribers only

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Edwards, Ward & Barron, F. Hutton, 1994. "SMARTS and SMARTER: Improved Simple Methods for Multiattribute Utility Measurement," Organizational Behavior and Human Decision Processes, Elsevier, vol. 60(3), pages 306-325, December.
    2. Donohue, Joan M. & Fox, Jeremy B., 2000. "A multi-method evaluation of journals in the decision and management sciences by US academics," Omega, Elsevier, vol. 28(1), pages 17-36, February.
    3. Mustafa, A. & Goh, M., 1996. "Multi-criterion models for higher education administration," Omega, Elsevier, vol. 24(2), pages 167-178, April.
    4. Bana e Costa, Carlos A. & Ensslin, Leonardo & Correa, Emerson C. & Vansnick, Jean-Claude, 1999. "Decision Support Systems in action: Integrated application in a multicriteria decision aid process," European Journal of Operational Research, Elsevier, vol. 113(2), pages 315-335, March.
    5. Politis, Y. & Siskos, Y., 2004. "Multicriteria methodology for the evaluation of a Greek engineering department," European Journal of Operational Research, Elsevier, vol. 156(1), pages 223-240, July.
    6. Etzkowitz, Henry, 2003. "Research groups as 'quasi-firms': the invention of the entrepreneurial university," Research Policy, Elsevier, vol. 32(1), pages 109-121, January.
    7. Meredith, Jack R. & Steward, Michelle D. & Lewis, Bruce R., 2011. "Knowledge dissemination in operations management: Published perceptions versus academic reality," Omega, Elsevier, vol. 39(4), pages 435-446, August.
    8. Julia Lane, 2010. "Let’s make science metrics more scientific," Working Paper Series of the German Council for Social and Economic Data 137, German Council for Social and Economic Data (RatSWD).
    9. Bana e Costa, Carlos A. & Oliveira, Rui Carvalho, 2002. "Assigning priorities for maintenance, repair and refurbishment in managing a municipal housing stock," European Journal of Operational Research, Elsevier, vol. 138(2), pages 380-391, April.
    10. repec:dau:papers:123456789/2947 is not listed on IDEAS
    11. Coccia, Mario, 2008. "Measuring scientific performance of public research units for strategic change," Journal of Informetrics, Elsevier, vol. 2(3), pages 183-194.
    12. Claire Donovan, 2007. "The qualitative future of research evaluation," Science and Public Policy, Oxford University Press, vol. 34(8), pages 585-597, October.
    13. Jean-Charles Billaut & Denis Bouyssou & Philippe Vincke, 2010. "Should you believe in the Shanghai ranking?," Post-Print hal-00388319, HAL.
    14. Pilar Murias & José Miguel & David Rodríguez, 2008. "A Composite Indicator for University Quality Assesment: The Case of Spanish Higher Education System," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 89(1), pages 129-146, October.
    15. Bana e Costa, Carlos A. & Corrêa, Émerson C. & De Corte, Jean-Marie & Vansnick, Jean-Claude, 2002. "Facilitating bid evaluation in public call for tenders: a socio-technical approach," Omega, Elsevier, vol. 30(3), pages 227-242, June.
    16. Lawrence Phillips & Carlos Bana e Costa, 2007. "Transparent prioritisation, budgeting and resource allocation with multi-criteria decision analysis and decision conferencing," Annals of Operations Research, Springer, vol. 154(1), pages 51-68, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ricardo J. G. Mateus & João C. Bana e Costa & Pedro Verga Matos, 0. "Supporting Multicriteria Group Decisions with MACBETH Tools: Selection of Sustainable Brownfield Redevelopment Actions," Group Decision and Negotiation, Springer, vol. 0, pages 1-27.
    2. Andriosopoulos, Dimitrios & Gaganis, Chrysovalantis & Pasiouras, Fotios & Zopounidis, Constantin, 2012. "An application of multicriteria decision aid models in the prediction of open market share repurchases," Omega, Elsevier, vol. 40(6), pages 882-890.
    3. Fasolo, Barbara & Bana e Costa, Carlos A., 2014. "Tailoring value elicitation to decision makers' numeracy and fluency: Expressing value judgments in numbers or words," Omega, Elsevier, vol. 44(C), pages 83-90.
    4. Cardoso, Teresa & Oliveira, Mónica Duarte & Barbosa-Póvoa, Ana & Nickel, Stefan, 2016. "Moving towards an equitable long-term care network: A multi-objective and multi-period planning approach," Omega, Elsevier, vol. 58(C), pages 69-85.
    5. Ricardo J. G. Mateus & João C. Bana e Costa & Pedro Verga Matos, 2017. "Supporting Multicriteria Group Decisions with MACBETH Tools: Selection of Sustainable Brownfield Redevelopment Actions," Group Decision and Negotiation, Springer, vol. 26(3), pages 495-521, May.
    6. Rodrigues, Teresa C. & Montibeller, Gilberto & Oliveira, Mónica D. & Bana e Costa, Carlos A., 2017. "Modelling multicriteria value interactions with Reasoning Maps," European Journal of Operational Research, Elsevier, vol. 258(3), pages 1054-1071.
    7. Alessio Ishizaka & Maynard Gordon, 2017. "MACBETHSort: a multiple criteria decision aid procedure for sorting strategic products," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(1), pages 53-61, January.
    8. repec:eee:socmed:v:188:y:2017:i:c:p:137-156 is not listed on IDEAS
    9. repec:eee:jomega:v:75:y:2018:i:c:p:154-164 is not listed on IDEAS
    10. repec:eee:energy:v:129:y:2017:i:c:p:255-272 is not listed on IDEAS

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jomega:v:40:y:2012:i:4:p:424-436. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Dana Niculescu). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/375/description#description .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.