IDEAS home Printed from
   My bibliography  Save this paper

Measuring the efficiency of universities: a comparison of multilevel modelling and data envelopment analysis


  • J Johnes


Data envelopment analysis (DEA) and multilevel modelling (MLM) are applied to a data set of 54578 graduates from UK universities in 1993 in order to assess the teaching performance of universities. A methodology developed by Thanassoulis & Portela (2002) allows each individual's DEA efficiency score to be decomposed into two components: one attributable to the university at which the student studied, and the other attributable to the individual student. From the former component a measure of each institution's teaching efficiency is derived and compared to the university effects from various multilevel models. The comparisons are made within four broad subjects: pure science; applied science; social science and arts. The results show that the rankings of universities derived from the DEA efficiencies which measure the universities'' own performance (i.e. having excluded the efforts of the individuals) are not strongly correlated with the university rankings derived from the university effects of the multilevel models. The data were also used to perform various university-level DEAs. The university efficiency scores derived from these DEAs are largely unrelated to the scores from the individual-level DEAs, confirming a result from a smaller data set (Johnes 2003). However, the university-level DEAs provide efficiency scores which are generally strongly related to the university effects of the multilevel models.

Suggested Citation

  • J Johnes, 2003. "Measuring the efficiency of universities: a comparison of multilevel modelling and data envelopment analysis," Working Papers 541921, Lancaster University Management School, Economics Department.
  • Handle: RePEc:lan:wpaper:541921

    Download full text from publisher

    File URL:
    Download Restriction: no

    References listed on IDEAS

    1. Ward-Warmedinger, Melanie E. & Sloane, Peter J., 1999. "Job Satisfaction within the Scottish Academic Profession," IZA Discussion Papers 38, Institute for the Study of Labor (IZA).
    2. Levy-Garboua, Louis & Montmarquette, Claude, 2004. "Reported job satisfaction: what does it mean?," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 33(2), pages 135-151, April.
    3. Freeman, Richard B, 1978. "Job Satisfaction as an Economic Variable," American Economic Review, American Economic Association, vol. 68(2), pages 135-141, May.
    4. Daniel S. Hamermesh, 2001. "The Changing Distribution of Job Satisfaction," Journal of Human Resources, University of Wisconsin Press, vol. 36(1), pages 1-30.
    5. Arnaud Chevalier & Reamonn Lydon, 2002. "Estimates of the Effect of Wages on Job Satisfaction," CEP Discussion Papers dp0531, Centre for Economic Performance, LSE.
    6. Alison L. Booth & Marco Francesconi & Jeff Frank, 2002. "Temporary Jobs: Stepping Stones Or Dead Ends?," Economic Journal, Royal Economic Society, vol. 112(480), pages 189-213, June.
    7. Allen, Jim & van der Velden, Rolf, 2001. "Educational Mismatches versus Skill Mismatches: Effects on Wages, Job Satisfaction, and On-the-Job Search," Oxford Economic Papers, Oxford University Press, vol. 53(3), pages 434-452, July.
    8. Andrew Clark & Yannis Georgellis & Peter Sanfey, "undated". "Job Satisfaction, Wage changes and Quits: Evidence from Germany," Economics and Finance Discussion Papers 98-06, Economics and Finance Section, School of Social Sciences, Brunel University.
    9. Groot, Wim & Maassen van den Brink, Henriette, 1999. "Job satisfaction and preference drift1," Economics Letters, Elsevier, vol. 63(3), pages 363-367, June.
    10. Daniel S. Hamermesh, 1999. "Changing Inequality in Markets for Workplace Amenities," The Quarterly Journal of Economics, Oxford University Press, vol. 114(4), pages 1085-1123.
    11. Clark, Andrew E & Oswald, Andrew J, 1994. "Unhappiness and Unemployment," Economic Journal, Royal Economic Society, vol. 104(424), pages 648-659, May.
    12. Bruno S. Frey & Alois Stutzer, 2002. "What Can Economists Learn from Happiness Research?," Journal of Economic Literature, American Economic Association, vol. 40(2), pages 402-435, June.
    13. Shields, Michael A & Price, Stephen Wheatley, 2002. "Racial Harassment, Job Satisfaction and Intentions to Quit: Evidence from the British Nursing Profession," Economica, London School of Economics and Political Science, vol. 69(274), pages 295-226, May.
    14. Clark, Andrew E. & Oswald, Andrew J., 1996. "Satisfaction and comparison income," Journal of Public Economics, Elsevier, vol. 61(3), pages 359-381, September.
    15. van Praag, B. M. S. & Frijters, P. & Ferrer-i-Carbonell, A., 2003. "The anatomy of subjective well-being," Journal of Economic Behavior & Organization, Elsevier, vol. 51(1), pages 29-49, May.
    16. Phelps, Charlotte D., 2001. "A clue to the paradox of happiness," Journal of Economic Behavior & Organization, Elsevier, vol. 45(3), pages 293-300, July.
    17. Meg G Birdseye & John S Hill, 1995. "Individual, Organizational/Work and Environmental Influences on Expatriate Turnover Tendencies: An Empirical Study," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 26(4), pages 787-813, December.
    18. Louis Lévy-Garboua & Claude Montmarquette & Véronique Simonnet, 2001. "Job Satisfaction and Quits: Theory and Evidence from the German Socioeconomic Panel," CIRANO Working Papers 2001s-41, CIRANO.
    19. George A. Akerlof & Andrew K. Rose & Janet L. Yellen, 1988. "Job Switching and Job Satisfaction in the U.S. Labor Market," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 19(2), pages 495-594.
    20. Clark, Andrew E., 1999. "Are wages habit-forming? evidence from micro data," Journal of Economic Behavior & Organization, Elsevier, vol. 39(2), pages 179-200, June.
    21. David G. Blanchflower & Andrew Oswald, 2000. "The Rising Well-Being of the Young," NBER Chapters,in: Youth Employment and Joblessness in Advanced Countries, pages 289-328 National Bureau of Economic Research, Inc.
    22. Easterlin, Richard A, 2001. "Income and Happiness: Towards an Unified Theory," Economic Journal, Royal Economic Society, vol. 111(473), pages 465-484, July.
    23. Clark, Andrew E., 2001. "What really matters in a job? Hedonic measurement using quit data," Labour Economics, Elsevier, vol. 8(2), pages 223-242, May.
    24. Clark, Andrew E., 1997. "Job satisfaction and gender: Why are women so happy at work?," Labour Economics, Elsevier, vol. 4(4), pages 341-372, December.
    25. Sousa-Poza, Alfonso & Sousa-Poza, Andres A., 2000. "Well-being at work: a cross-national analysis of the levels and determinants of job satisfaction," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 29(6), pages 517-538, November.
    26. Philippe Moguerou, 2002. "Job satisfaction among US Ph.D. graduates: the effects of gender and employment sector," Labor and Demography 0204002, EconWPA.
    27. McBride, Michael, 2001. "Relative-income effects on subjective well-being in the cross-section," Journal of Economic Behavior & Organization, Elsevier, vol. 45(3), pages 251-278, July.
    28. Peter Sloane & Melanie Ward, 2001. "Cohort effects and job satisfaction of academics," Applied Economics Letters, Taylor & Francis Journals, vol. 8(12), pages 787-791.
    29. P. J. Sloane & H. Williams, 2000. "Job Satisfaction, Comparison Earnings, and Gender," LABOUR, CEIS, vol. 14(3), pages 473-502, September.
    Full references (including those not matched with items on IDEAS)


    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:lan:wpaper:541921. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Giorgio Motta). General contact details of provider: .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.