IDEAS home Printed from
   My bibliography  Save this article

An AHP-based evaluation procedure for Innovative Educational Projects: A face-to-face vs. computer-mediated case study


  • Meløn, Mønica García
  • Aragonés Beltran, Pablo
  • Carmen González Cruz, M.


In this paper a procedure to evaluate proposals for Educational Innovation Projects is proposed. This methodology should help the Institute of Educational Sciences of the Politechnical University of Valencia to choose the best Educational Project, the final aim being to provide the Administration with a stringent evaluation methodology, since the current evaluation methodology was found to be neither sufficiently objective nor systematic. Since in the definition and evaluation of these Educational Projects diverse stakeholders are involved, the process has been approached as a MCDA carried out by a group of experts. Although a whole methodology is proposed, the paper has been focused on the weight assignment of the different criteria chosen by the experts. The experts have been asked to act in two different ways: in face-to-face meetings in which a consensus or compromise had to be reached, and meetings at distance where the experts have given their individual judgements, which have been next combined using the geometric mean with the software EC 2000 [Expert Choice 2000 Team. Pittsburgh: Expert Choice, Inc.; 2001]. This procedure has allowed the authors to analyse the possible scenarios that the IES board team might come up against in the future. The main difference between the two ways of work is the dimension of physical space or the distance between the members of the evaluating team. This distance has a significant effect on the way team members relate to each other.

Suggested Citation

  • Meløn, Mønica García & Aragonés Beltran, Pablo & Carmen González Cruz, M., 2008. "An AHP-based evaluation procedure for Innovative Educational Projects: A face-to-face vs. computer-mediated case study," Omega, Elsevier, vol. 36(5), pages 754-765, October.
  • Handle: RePEc:eee:jomega:v:36:y:2008:i:5:p:754-765

    Download full text from publisher

    File URL:
    Download Restriction: Full text for ScienceDirect subscribers only

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    1. Mustafa, A. & Goh, M., 1996. "Multi-criterion models for higher education administration," Omega, Elsevier, vol. 24(2), pages 167-178, April.
    2. Politis, Y. & Siskos, Y., 2004. "Multicriteria methodology for the evaluation of a Greek engineering department," European Journal of Operational Research, Elsevier, vol. 156(1), pages 223-240, July.
    3. Katrin Borcherding & Thomas Eppel & Detlof von Winterfeldt, 1991. "Comparison of Weighting Judgments in Multiattribute Utility Measurement," Management Science, INFORMS, vol. 37(12), pages 1603-1619, December.
    4. Mareschal, Bertrand, 1988. "Weight stability intervals in multicriteria decision aid," European Journal of Operational Research, Elsevier, vol. 33(1), pages 54-64, January.
    5. Forgionne, Guisseppi A. & Kohli, Rajiv & Jennings, Darniet, 2002. "An AHP analysis of quality in AI and DSS journals," Omega, Elsevier, vol. 30(3), pages 171-183, June.
    6. Davey, Anne & Olson, David & Wallenius, Jyrki, 1994. "The process of multiattribute decision making: A case study of selecting applicants for a Ph.D. program," European Journal of Operational Research, Elsevier, vol. 72(3), pages 469-484, February.
    7. Baltes, Boris B. & Dickson, Marcus W. & Sherman, Michael P. & Bauer, Cara C. & LaGanke, Jacqueline S., 2002. "Computer-Mediated Communication and Group Decision Making: A Meta-Analysis," Organizational Behavior and Human Decision Processes, Elsevier, vol. 87(1), pages 156-179, January.
    8. Gerardine DeSanctis & R. Brent Gallupe, 1987. "A Foundation for the Study of Group Decision Support Systems," Management Science, INFORMS, vol. 33(5), pages 589-609, May.
    9. Caballero, R. & Galache, T. & Gomez, T. & Molina, J. & Torrico, A., 2001. "Efficient assignment of financial resources within a university system. Study of the University of Malaga," European Journal of Operational Research, Elsevier, vol. 133(2), pages 298-309, January.
    Full references (including those not matched with items on IDEAS)


    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.

    Cited by:

    1. Tayfun Büke & Aylin Çiğdem Köne, 2016. "Assessing Air Quality in Turkey: A Proposed, Air Quality Index," Sustainability, MDPI, Open Access Journal, vol. 8(1), pages 1-8, January.
    2. repec:gam:jsusta:v:8:y:2016:i:1:p:73:d:62113 is not listed on IDEAS
    3. repec:spr:fininn:v:2:y:2016:i:1:d:10.1186_s40854-016-0027-8 is not listed on IDEAS
    4. Kao, Chiang & Pao, Hwei-Lan, 2012. "Predicting project approvals: A case of grants from the National Science Council of Taiwan," Omega, Elsevier, vol. 40(1), pages 89-95, January.
    5. Saud Alshehri & Yacine Rezgui & Haijiang Li, 2015. "Disaster community resilience assessment method: a consensus-based Delphi and AHP approach," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 78(1), pages 395-416, August.


    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jomega:v:36:y:2008:i:5:p:754-765. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Dana Niculescu). General contact details of provider: .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.