IDEAS home Printed from https://ideas.repec.org/a/bla/buecrs/v58y2006i2p75-104.html
   My bibliography  Save this article

Measuring Efficiency: A Comparison of Multilevel Modelling and Data Envelopment Analysis in the Context of Higher Education

Author

Listed:
  • Jill Johnes

Abstract

Data envelopment analysis (DEA) and multilevel modelling (MLM) are applied to a data set of 54,564 graduates from UK universities in 1993 to assess whether the choice of technique affects the measurement of universities' performance. A methodology developed by Thanassoulis and Portela (2002; Education Economics, 10(2), pp. 183-207) allows each individual's DEA efficiency score to be decomposed into two components: one attributable to the university at which the student studied and the other attributable to the individual student. From the former component, a measure of each institution's teaching efficiency is derived and compared to the university effects from various multilevel models. The comparisons are made within four broad subjects: pure science, applied science, social science and arts. The results show that the rankings of universities derived from the DEA efficiencies which measure the universities' own performance (i.e., having excluded the efforts of the individuals) are not strongly correlated with the university rankings derived from the university effects of the multilevel models. The data were also used to perform a university-level DEA. The university efficiency scores derived from these DEAs are largely unrelated to the scores from the individual-level DEAs, confirming a result from a smaller data set (Johnes, 2006a; European Journal of Operational Research, forthcoming). However, the university-level DEAs provide efficiency scores which are generally strongly related to the university effects of the multilevel models. Copyright Blackwell Publishers Ltd and the Board of Trustees of the Bulletin of Economic Research, 2006.

Suggested Citation

  • Jill Johnes, 2006. "Measuring Efficiency: A Comparison of Multilevel Modelling and Data Envelopment Analysis in the Context of Higher Education," Bulletin of Economic Research, Wiley Blackwell, vol. 58(2), pages 75-104, April.
  • Handle: RePEc:bla:buecrs:v:58:y:2006:i:2:p:75-104
    as

    Download full text from publisher

    File URL: http://www.blackwell-synergy.com/servlet/useragent?func=synergy&synergyAction=showTOC&journalCode=boer&volume=58&issue=2&year=2006&part=null
    File Function: link to full text
    Download Restriction: Access to full text is restricted to subscribers.

    As the access to this document is restricted, you may want to search for a different version of it.

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. C F Chen & K T Soo, 2009. "Some university students are more equal than others: Evidence from England," Working Papers 600480, Lancaster University Management School, Economics Department.
    2. Kristof de Witte & Laura López-Torres, 2015. "Efficiency in Education. A Review of Literature and a Way Forward," Working Papers 1501, Departament Empresa, Universitat Autònoma de Barcelona, revised Apr 2015.
    3. Jean-Charles Billaut & Denis Bouyssou & Philippe Vincke, 2009. "Should you believe in the Shanghai ranking? An MCDM view," Working Papers hal-00877050, HAL.
    4. Sami El-Mahgary & Petri Rönnholm & Hannu Hyyppä & Henrik Haggrén & Jenni Koponen, 2014. "Evaluating the performance of university course units using data envelopment analysis," Cogent Economics & Finance, Taylor & Francis Journals, vol. 2(1), pages 1-20, December.
    5. Yaisawarng, Suthathip & Ng, Ying Chu, 2014. "The impact of higher education reform on research performance of Chinese universities," China Economic Review, Elsevier, vol. 31(C), pages 94-105.
    6. repec:eee:soceps:v:62:y:2018:i:c:p:44-55 is not listed on IDEAS
    7. Billaut, Jean-Charles & Bouyssou, Denis & Vincke, Philippe, 2010. "Faut-il croire le classement de Shangaï ?," Revue de la Régulation - Capitalisme, institutions, pouvoirs, Association Recherche et Régulation, vol. 8.
    8. repec:pal:jorsoc:v:61:y:2010:i:8:d:10.1057_jors.2009.50 is not listed on IDEAS
    9. Aleksandra Parteka & Joanna Wolszczak-Derlacz, 2013. "Dynamics of productivity in higher education: cross-european evidence based on bootstrapped Malmquist indices," Journal of Productivity Analysis, Springer, vol. 40(1), pages 67-82, August.
    10. Deutsch, Joseph & Dumas, Audrey & Silber, Jacques, 2013. "Estimating an educational production function for five countries of Latin America on the basis of the PISA data," Economics of Education Review, Elsevier, vol. 36(C), pages 245-262.
    11. Jean-Charles Billaut & Denis Bouyssou & Philippe Vincke, 2010. "Should you believe in the Shanghai ranking?," Post-Print hal-00388319, HAL.
    12. Angel García Correas & Manuel Larran Jorge, 2010. "Análisis de diferentes medidas de la eficiencia investigadora y factores explicativos en las universidades públicas españolas," Investigaciones de Economía de la Educación volume 5,in: María Jesús Mancebón-Torrubia & Domingo P. Ximénez-de-Embún & José María Gómez-Sancho & Gregorio Gim (ed.), Investigaciones de Economía de la Educación 5, edition 1, volume 5, chapter 36, pages 703-732 Asociación de Economía de la Educación.
    13. Kong, Wei-Hsin & Fu, Tsu-Tan, 2012. "Assessing the performance of business colleges in Taiwan using data envelopment analysis and student based value-added performance indicators," Omega, Elsevier, vol. 40(5), pages 541-549.
    14. Tzeremes, Nickolaos & Halkos, George, 2010. "A DEA approach for measuring university departments’ efficiency," MPRA Paper 24029, University Library of Munich, Germany.
    15. George E. Halkos & Nickolaos G. Tzeremes & Stavros A. Kourtzidis, 2012. "Measuring Public Owned University Departments' Efficiency: A Bootstrapped DEA Approach," Journal of Economics and Econometrics, Economics and Econometrics Society, vol. 55(2), pages 1-24.
    16. Halkos, George & Tzeremes, Nickolaos, 2011. "Adjusting for cultural effects on countries’ education policy efficiency:an application of conditional full frontiers measures," MPRA Paper 30098, University Library of Munich, Germany.
    17. Tommaso Agasisti, 2014. "How does schools’ efficiency look like across Europe? An empirical analysis of Germany, Spain, France, Italy and UK using OECD PISA2012 data," Working papers 9, Società Italiana di Economia Pubblica.
    18. repec:spr:scient:v:84:y:2010:i:1:d:10.1007_s11192-009-0115-x is not listed on IDEAS
    19. repec:spr:scient:v:95:y:2013:i:2:d:10.1007_s11192-012-0844-0 is not listed on IDEAS

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:buecrs:v:58:y:2006:i:2:p:75-104. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Wiley-Blackwell Digital Licensing) or (Christopher F. Baum). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0307-3378 .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.