IDEAS home Printed from https://ideas.repec.org/p/pra/mprapa/67119.html
   My bibliography  Save this paper

Explaining (in)efficiency in higher education: a comparison of parametric and non-parametric analyses to rank universities

Author

Listed:
  • Barra, Cristian
  • Lagravinese, Raffaele
  • Zotti, Roberto

Abstract

In recent years more and more numerous are the rankings published in the newspapers or technical reports available, covering many aspects of higher education, but in many cases with very conflicting results between them, due to the fact that universities’ performances depend on the set of variables considered and on the methods of analysis employed. The aim of this study is to rank higher education institutions (HEIs) in Italy, comparing parametric and non-parametric approaches: we firstly apply a so-called double bootstrap Data Envelopment Analysis (DEA) to generate unbiased coefficients (Simar and Wilson, 2007) and then a Stochastic Frontier Analysis (SFA), modelling the production set through an output distance function, applying a within transformation to data as developed by Wang and Ho (2010), to evaluate which determinants have an impact on universities’ efficiencies. The findings reveal that, on average and among the macro-areas of the country, the level of efficiency does not change significantly among estimation methods which, instead, generate different rankings. This may guide universities’ managers and policymakers as rankings have a strong impact on academic decision-making and behaviour, on the structure of the institutions and also on students and graduates recruiters. Variables describing institution, market place and environment have an important role in explaining (in)efficiency.

Suggested Citation

  • Barra, Cristian & Lagravinese, Raffaele & Zotti, Roberto, 2015. "Explaining (in)efficiency in higher education: a comparison of parametric and non-parametric analyses to rank universities," MPRA Paper 67119, University Library of Munich, Germany.
    • Handle: RePEc:pra:mprapa:67119
    as

    Download full text from publisher

    File URL: https://mpra.ub.uni-muenchen.de/67119/1/MPRA_paper_67119.pdf
    File Function: original version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Johnes, Geraint & Johnes, Jill, 1993. "Measuring the Research Performance of UK Economics Departments: An Application of Data Envelopment Analysis," Oxford Economic Papers, Oxford University Press, vol. 45(2), pages 332-347, April.
    2. Johnes, Jill, 1996. "Performance assessment in higher education in Britain," European Journal of Operational Research, Elsevier, vol. 89(1), pages 18-33, February.
    3. Wiji Arulampalam & Robin A. Naylor & Jeremy P. Smith, 2004. "A hazard model of the probability of medical school drop‐out in the UK," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 167(1), pages 157-178, February.
    4. Gianna Boero & Abigail McKnight & Robin Naylor & Jeremy Smith, 2004. "Graduates and Graduate Labour Markets in the UK and Italy," Palgrave Macmillan Books, in: Daniele Checchi & Claudio Lucifora (ed.), Education, Training and Labour Market Outcomes in Europe, chapter 6, pages 129-165, Palgrave Macmillan.
    5. Antreas Athanassopoulos & Estelle Shale, 1997. "Assessing the Comparative Efficiency of Higher Education Institutions in the UK by the Means of Data Envelopment Analysis," Education Economics, Taylor & Francis Journals, vol. 5(2), pages 117-134.
    6. Gianna Boero & Abigail McKnight & Robin Naylor & Jeremy Smith, 2004. "Graduates and Graduate Labour Markets in the UK and Italy," Palgrave Macmillan Books, in: Daniele Checchi & Claudio Lucifora (ed.), Education, Training and Labour Market Outcomes in Europe, chapter 6, pages 129-165, Palgrave Macmillan.
    7. Jill Johnes, 2014. "Efficiency and Mergers in English Higher Education 1996/97 to 2008/9: Parametric and Non-parametric Estimation of the Multi-input Multi-output Distance Function," Manchester School, University of Manchester, vol. 82(4), pages 465-487, July.
    8. Agasisti, Tommaso & Wolszczak-Derlacz, Joana, 2014. "Exploring universities’ efficiency differentials between countries in a multi-year perspective: an application of bootstrap DEA and Malmquist index to Italy and Poland, 2001-2011," Institute for Research on Labor and Employment, Working Paper Series qt14m8g45v, Institute of Industrial Relations, UC Berkeley.
    9. Bruno S. Frey & Katja Rost, 2010. "Do rankings reflect research quality?," Journal of Applied Economics, Universidad del CEMA, vol. 13, pages 1-38, May.
    10. Pablo D'Este & Simona Iammarino, 2010. "The spatial profile of university‐business research partnerships," Papers in Regional Science, Wiley Blackwell, vol. 89(2), pages 335-350, June.
    11. Claudia Curi & Cinzia Daraio & Patrick Llerena, 2012. "University technology transfer: how (in)efficient are French universities?," Cambridge Journal of Economics, Cambridge Political Economy Society, vol. 36(3), pages 629-654.
    12. Worthington, Andrew C. & Lee, Boon L., 2008. "Efficiency, technology and productivity change in Australian universities, 1998-2003," Economics of Education Review, Elsevier, vol. 27(3), pages 285-298, June.
    13. Johnes, Jill & Yu, Li, 2008. "Measuring the research performance of Chinese higher education institutions using data envelopment analysis," China Economic Review, Elsevier, vol. 19(4), pages 679-696, December.
    14. Mowery, David C. & Ziedonis, Arvids A., 2015. "Markets versus spillovers in outflows of university research," Research Policy, Elsevier, vol. 44(1), pages 50-66.
    15. repec:kap:iaecre:v:16:y:2010:i:1:p:24-38 is not listed on IDEAS
    16. Kao, Chiang & Hung, Hsi-Tai, 2008. "Efficiency analysis of university departments: An empirical study," Omega, Elsevier, vol. 36(4), pages 653-664, August.
    17. Coco, Giuseppe & Lagravinese, Raffaele, 2014. "Cronyism and education performance," Economic Modelling, Elsevier, vol. 38(C), pages 443-450.
    18. Keld Laursen & Toke Reichstein & Ammon Salter, 2011. "Exploring the Effect of Geographical Proximity and University Quality on University-Industry Collaboration in the United Kingdom," Regional Studies, Taylor & Francis Journals, vol. 45(4), pages 507-523.
    19. Chapple, Wendy & Lockett, Andy & Siegel, Donald & Wright, Mike, 2005. "Assessing the relative performance of U.K. university technology transfer offices: parametric and non-parametric evidence," Research Policy, Elsevier, vol. 34(3), pages 369-384, April.
    20. repec:kap:iaecre:v:14:y:2008:i:1:p:76-89 is not listed on IDEAS
    21. Wang, Hung-Jen & Ho, Chia-Wen, 2010. "Estimating fixed-effect panel stochastic frontier models by model transformation," Journal of Econometrics, Elsevier, vol. 157(2), pages 286-296, August.
    22. Thursby, Jerry G. & Kemp, Sukanya, 2002. "Growth and productive efficiency of university intellectual property licensing," Research Policy, Elsevier, vol. 31(1), pages 109-124, January.
    23. Hung-jen Wang & Peter Schmidt, 2002. "One-Step and Two-Step Estimation of the Effects of Exogenous Variables on Technical Efficiency Levels," Journal of Productivity Analysis, Springer, vol. 18(2), pages 129-144, September.
    24. Meeusen, Wim & van den Broeck, Julien, 1977. "Efficiency Estimation from Cobb-Douglas Production Functions with Composed Error," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 18(2), pages 435-444, June.
    25. Harvey Goldstein & Catherine Renault, 2004. "Contributions of Universities to Regional Economic Development: A Quasi-experimental Approach," Regional Studies, Taylor & Francis Journals, vol. 38(7), pages 733-746.
    26. Stephen L. DesJardins & Dennis A. Ahlburg & Brian P. McCall, 2002. "A Temporal Investigation of Factors Related to Timely Degree Completion," The Journal of Higher Education, Taylor & Francis Journals, vol. 73(5), pages 555-581, September.
    27. Gary Madden & Scott Savage & Steven Kemp, 1997. "Measuring Public Sector Efficiency: A Study of Economics Departments at Australian Universities," Education Economics, Taylor & Francis Journals, vol. 5(2), pages 153-168.
    28. Tommaso Agasisti & Geraint Johnes, 2010. "Heterogeneity and the evaluation of efficiency: the case of Italian universities," Applied Economics, Taylor & Francis Journals, vol. 42(11), pages 1365-1375.
    29. Haelermans, Carla & Ruggiero, John, 2013. "Estimating technical and allocative efficiency in the public sector: A nonparametric analysis of Dutch schools," European Journal of Operational Research, Elsevier, vol. 227(1), pages 174-181.
    30. Etzkowitz, Henry, 2003. "Research groups as 'quasi-firms': the invention of the entrepreneurial university," Research Policy, Elsevier, vol. 32(1), pages 109-121, January.
    31. Donald Siegel & Mike Wright & Wendy Chapple & Andy Lockett, 2008. "Assessing The Relative Performance Of University Technology Transfer In The Us And Uk: A Stochastic Distance Function Approach," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 17(7-8), pages 717-729.
    32. Battese, George E. & Corra, Greg S., 1977. "Estimation Of A Production Frontier Model: With Application To The Pastoral Zone Of Eastern Australia," Australian Journal of Agricultural Economics, Australian Agricultural and Resource Economics Society, vol. 21(3), pages 1-11, December.
    33. Tiziana Laureti, 2008. "Modelling Exogenous Variables in Human Capital Formation through a Heteroscedastic Stochastic Frontier," International Advances in Economic Research, Springer;International Atlantic Economic Society, vol. 14(1), pages 76-89, February.
    34. Kristof Witte & Lenka Hudrlikova, 2013. "What about excellence in teaching? A benevolent ranking of universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(1), pages 337-364, July.
    35. Antonio Alvarez & Christine Amsler & Luis Orea & Peter Schmidt, 2006. "Interpreting and Testing the Scaling Property in Models where Inefficiency Depends on Firm Characteristics," Journal of Productivity Analysis, Springer, vol. 25(3), pages 201-212, June.
    36. Brennan, Shae & Haelermans, Carla & Ruggiero, John, 2014. "Nonparametric estimation of education productivity incorporating nondiscretionary inputs with an application to Dutch schools," European Journal of Operational Research, Elsevier, vol. 234(3), pages 809-818.
    37. Roger Carrington & Tim Coelli & D. S. Prasada Rao, 2005. "The Performance Of Australian Universities: Conceptual Issues And Preliminary Results," Economic Papers, The Economic Society of Australia, vol. 24(2), pages 145-163, June.
    38. Battese, G E & Coelli, T J, 1995. "A Model for Technical Inefficiency Effects in a Stochastic Frontier Production Function for Panel Data," Empirical Economics, Springer, vol. 20(2), pages 325-332.
    39. Greene, William, 2005. "Reconsidering heterogeneity in panel data estimators of the stochastic frontier model," Journal of Econometrics, Elsevier, vol. 126(2), pages 269-303, June.
    40. Lucia Buzzigoli & Antonio Giusti & Alessandro Viviani, 2010. "The Evaluation of University Departments. A Case Study for Firenze," International Advances in Economic Research, Springer;International Atlantic Economic Society, vol. 16(1), pages 24-38, February.
    41. Kroll, Henning & Schubert, Torben, 2014. "On universities' long-term effects on regional value creation and unemployment: The case of Germany," Working Papers "Firms and Region" R1/2014, Fraunhofer Institute for Systems and Innovation Research (ISI).
    42. Gerhard Kempkes & Carsten Pohl, 2010. "The efficiency of German universities-some evidence from nonparametric and parametric methods," Applied Economics, Taylor & Francis Journals, vol. 42(16), pages 2063-2079.
    43. Hashimoto, Akihiro & Haneda, Shoko, 2008. "Measuring the change in R&D efficiency of the Japanese pharmaceutical industry," Research Policy, Elsevier, vol. 37(10), pages 1829-1836, December.
    44. Andrea Bonaccorsi & Cinzia Daraio & Léopold Simar, 2006. "Advanced indicators of productivity of universitiesAn application of robust nonparametric methods to Italian data," Scientometrics, Springer;Akadémiai Kiadó, vol. 66(2), pages 389-410, February.
    45. Robert G Dyson, 2000. "Strategy, performance and operational research," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 51(1), pages 5-11, January.
    46. Tim Coelli & Sergio Perelman, 2000. "Technical efficiency of European railways: a distance function approach," Applied Economics, Taylor & Francis Journals, vol. 32(15), pages 1967-1976.
    47. Richard Florida & Charlotta Mellander & Kevin Stolarick, 2008. "Inside the black box of regional development: human capital, the creative class and tolerance," Journal of Economic Geography, Oxford University Press, vol. 8(5), pages 615-649, September.
    48. Simar, Leopold & Wilson, Paul W., 2007. "Estimation and inference in two-stage, semi-parametric models of production processes," Journal of Econometrics, Elsevier, vol. 136(1), pages 31-64, January.
    49. Abbott, M. & Doucouliagos, C., 2003. "The efficiency of Australian universities: a data envelopment analysis," Economics of Education Review, Elsevier, vol. 22(1), pages 89-97, February.
    50. Tommaso Agasisti & Geraint Johnes, 2009. "Beyond frontiers: comparing the efficiency of higher education decision-making units across more than one country," Education Economics, Taylor & Francis Journals, vol. 17(1), pages 59-79.
    51. George E. Halkos & Nickolaos G. Tzeremes & Stavros A. Kourtzidis, 2012. "Measuring Public Owned University Departments' Efficiency: A Bootstrapped DEA Approach," Journal of Economics and Econometrics, Economics and Econometrics Society, vol. 55(2), pages 1-24.
    52. Tyagi, Preeti & Yadav, Shiv Prasad & Singh, S.P., 2009. "Relative performance of academic departments using DEA with sensitivity analysis," Evaluation and Program Planning, Elsevier, vol. 32(2), pages 168-177, May.
    53. COELLI, Tim, 2000. "On the econometric estimation of the distance function representation of a production technology," LIDAM Discussion Papers CORE 2000042, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    54. George E. Battese & Greg S. Corra, 1977. "Estimation Of A Production Frontier Model: With Application To The Pastoral Zone Of Eastern Australia," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 21(3), pages 169-179, December.
    55. de Groot, Hans & McMahon, Walter W & Volkwein, J Fredericks, 1991. "The Cost Structure of American Research Universities," The Review of Economics and Statistics, MIT Press, vol. 73(3), pages 424-431, August.
    56. Ellen Hazelkorn, 2007. "The Impact of League Tables and Ranking Systems on Higher Education Decision Making," Higher Education Management and Policy, OECD Publishing, vol. 19(2), pages 1-24.
    57. Tommaso Agasisti & Giuseppe Catalano & Paolo Landoni & Roberto Verganti, 2012. "Evaluating the performance of academic departments: an analysis of research-related output efficiency," Research Evaluation, Oxford University Press, vol. 21(1), pages 2-14, February.
    58. Tommaso Agasisti, 2009. "Market forces and competition in university systems: theoretical reflections and empirical evidence from Italy," International Review of Applied Economics, Taylor & Francis Journals, vol. 23(4), pages 463-483.
    59. Johnes, Jill, 2006. "Measuring teaching efficiency in higher education: An application of data envelopment analysis to economics graduates from UK Universities 1993," European Journal of Operational Research, Elsevier, vol. 174(1), pages 443-456, October.
    60. Jeremy Smith & Robin Naylor, 2001. "Determinants of Degree Performance in UK Universities: A Statistical Analysis of the 1993 Student Cohort," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 63(1), pages 29-60, February.
    61. Kraus, Margit, 2004. "Schätzung von Kostenfunktionen für die bundesdeutsche Hochschulausbildung: Ein konzeptioneller Ansatz im empirischen Test," ZEW Discussion Papers 04-36, ZEW - Leibniz Centre for European Economic Research.
    62. Tommaso Agasisti, 2011. "Performances and spending efficiency in higher education: a European comparison through non-parametric approaches," Education Economics, Taylor & Francis Journals, vol. 19(2), pages 199-224.
    63. Aigner, Dennis & Lovell, C. A. Knox & Schmidt, Peter, 1977. "Formulation and estimation of stochastic frontier production function models," Journal of Econometrics, Elsevier, vol. 6(1), pages 21-37, July.
    64. Kumbhakar,Subal C. & Lovell,C. A. Knox, 2003. "Stochastic Frontier Analysis," Cambridge Books, Cambridge University Press, number 9780521666633.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Tommaso Agasisti & Sabine Gralka, 2019. "The transient and persistent efficiency of Italian and German universities: a stochastic frontier analysis," Applied Economics, Taylor & Francis Journals, vol. 51(46), pages 5012-5030, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Barra, Cristian & Lagravinese, Raffaele & Zotti, Roberto, 2018. "Does econometric methodology matter to rank universities? An analysis of Italian higher education system," Socio-Economic Planning Sciences, Elsevier, vol. 62(C), pages 104-120.
    2. Agasisti, Tommaso & Barra, Cristian & Zotti, Roberto, 2016. "Evaluating the efficiency of Italian public universities (2008–2011) in presence of (unobserved) heterogeneity," Socio-Economic Planning Sciences, Elsevier, vol. 55(C), pages 47-58.
    3. Kristof De Witte & Laura López-Torres, 2017. "Efficiency in education: a review of literature and a way forward," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 339-363, April.
    4. Cristian Barra & Roberto Zotti, 2017. "Investigating the Human Capital Development–growth Nexus," International Regional Science Review, , vol. 40(6), pages 638-678, November.
    5. Tommaso Agasisti & Cristian Barra & Roberto Zotti, 2019. "Research, knowledge transfer, and innovation: The effect of Italian universities’ efficiency on local economic development 2006−2012," Journal of Regional Science, Wiley Blackwell, vol. 59(5), pages 819-849, November.
    6. Mehdi Rhaiem, 2017. "Measurement and determinants of academic research efficiency: a systematic review of the evidence," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 581-615, February.
    7. Cristian Barra & Roberto Zotti, 2016. "Measuring Efficiency in Higher Education: An Empirical Study Using a Bootstrapped Data Envelopment Analysis," International Advances in Economic Research, Springer;International Atlantic Economic Society, vol. 22(1), pages 11-33, February.
    8. Gralka, Sabine, 2018. "Stochastic frontier analysis in higher education: A systematic review," CEPIE Working Papers 05/18, Technische Universität Dresden, Center of Public and International Economics (CEPIE).
    9. Barra, Cristian & Zotti, Roberto, 2014. "Handling negative data using Data Envelopment Analysis: a directional distance approach applied to higher education," MPRA Paper 55570, University Library of Munich, Germany.
    10. Zotti, Roberto & Barra, Cristian, 2014. "Human capital development, knowledge spillovers and local growth: Is there a quality effect of university efficiency?," MPRA Paper 60065, University Library of Munich, Germany.
    11. Vanesa D’Elia & Gustavo Ferro, 2019. "Empirical Efficiency Measurement in Higher Education: An Overview," CEMA Working Papers: Serie Documentos de Trabajo. 708, Universidad del CEMA.
    12. Erik E. Lehmann & Michele Meoli & Stefano Paleari & Sarah A. E. Stockinger, 2018. "Approaching effects of the economic crisis on university efficiency: a comparative study of Germany and Italy," Eurasian Business Review, Springer;Eurasia Business and Economics Society, vol. 8(1), pages 37-54, March.
    13. Renato A. Villano & Carolyn‐Dung T. T. Tran, 2021. "Survey on technical efficiency in higher education: A meta‐fractional regression analysis," Pacific Economic Review, Wiley Blackwell, vol. 26(1), pages 110-135, February.
    14. Manuel Salas-Velasco, 2020. "Measuring and explaining the production efficiency of Spanish universities using a non-parametric approach and a bootstrapped-truncated regression," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(2), pages 825-846, February.
    15. Zotti, Roberto & Barra, Cristian, 2014. "How students' exogenous characteristics affect faculties’ inefficiency. A heteroscedastic stochastic frontier approach," MPRA Paper 54011, University Library of Munich, Germany.
    16. Mehdi Rhaiem & Nabil Amara, 2020. "Determinants of research efficiency in Canadian business schools: evidence from scholar-level data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 53-99, October.
    17. Amara, Nabil & Rhaiem, Mehdi & Halilem, Norrin, 2020. "Assessing the research efficiency of Canadian scholars in the management field: Evidence from the DEA and fsQCA," Journal of Business Research, Elsevier, vol. 115(C), pages 296-306.
    18. Johnes, Jill, 2015. "Operational Research in education," European Journal of Operational Research, Elsevier, vol. 243(3), pages 683-696.
    19. Tzeremes, Nickolaos & Halkos, George, 2010. "A DEA approach for measuring university departments’ efficiency," MPRA Paper 24029, University Library of Munich, Germany.
    20. Yang, Guo-liang & Fukuyama, Hirofumi & Song, Yao-yao, 2018. "Measuring the inefficiency of Chinese research universities based on a two-stage network DEA model," Journal of Informetrics, Elsevier, vol. 12(1), pages 10-30.

    More about this item

    Keywords

    Universities; Efficiency; Data Envelopment Analysis; Stochastic Frontier Analysis;
    All these keywords.

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C67 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Input-Output Models
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:67119. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joachim Winter (email available below). General contact details of provider: https://edirc.repec.org/data/vfmunde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.