IDEAS home Printed from https://ideas.repec.org/p/pra/mprapa/67119.html
   My bibliography  Save this paper

Explaining (in)efficiency in higher education: a comparison of parametric and non-parametric analyses to rank universities

Author

Listed:
  • Barra, Cristian
  • Lagravinese, Raffaele
  • Zotti, Roberto

Abstract

In recent years more and more numerous are the rankings published in the newspapers or technical reports available, covering many aspects of higher education, but in many cases with very conflicting results between them, due to the fact that universities’ performances depend on the set of variables considered and on the methods of analysis employed. The aim of this study is to rank higher education institutions (HEIs) in Italy, comparing parametric and non-parametric approaches: we firstly apply a so-called double bootstrap Data Envelopment Analysis (DEA) to generate unbiased coefficients (Simar and Wilson, 2007) and then a Stochastic Frontier Analysis (SFA), modelling the production set through an output distance function, applying a within transformation to data as developed by Wang and Ho (2010), to evaluate which determinants have an impact on universities’ efficiencies. The findings reveal that, on average and among the macro-areas of the country, the level of efficiency does not change significantly among estimation methods which, instead, generate different rankings. This may guide universities’ managers and policymakers as rankings have a strong impact on academic decision-making and behaviour, on the structure of the institutions and also on students and graduates recruiters. Variables describing institution, market place and environment have an important role in explaining (in)efficiency.

Suggested Citation

  • Barra, Cristian & Lagravinese, Raffaele & Zotti, Roberto, 2015. "Explaining (in)efficiency in higher education: a comparison of parametric and non-parametric analyses to rank universities," MPRA Paper 67119, University Library of Munich, Germany.
  • Handle: RePEc:pra:mprapa:67119
    as

    Download full text from publisher

    File URL: https://mpra.ub.uni-muenchen.de/67119/1/MPRA_paper_67119.pdf
    File Function: original version
    Download Restriction: no

    References listed on IDEAS

    as
    1. Johnes, Jill & Yu, Li, 2008. "Measuring the research performance of Chinese higher education institutions using data envelopment analysis," China Economic Review, Elsevier, vol. 19(4), pages 679-696, December.
    2. Johnes, Geraint & Johnes, Jill, 1993. "Measuring the Research Performance of UK Economics Departments: An Application of Data Envelopment Analysis," Oxford Economic Papers, Oxford University Press, vol. 45(2), pages 332-347, April.
    3. Johnes, Jill, 1996. "Performance assessment in higher education in Britain," European Journal of Operational Research, Elsevier, vol. 89(1), pages 18-33, February.
    4. Wiji Arulampalam & Robin A. Naylor & Jeremy P. Smith, 2004. "A hazard model of the probability of medical school drop-out in the UK," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 167(1), pages 157-178.
    5. Antreas Athanassopoulos & Estelle Shale, 1997. "Assessing the Comparative Efficiency of Higher Education Institutions in the UK by the Means of Data Envelopment Analysis," Education Economics, Taylor & Francis Journals, vol. 5(2), pages 117-134.
    6. Gerhard Kempkes & Carsten Pohl, 2010. "The efficiency of German universities-some evidence from nonparametric and parametric methods," Applied Economics, Taylor & Francis Journals, vol. 42(16), pages 2063-2079.
    7. G. Boero & A. Mcknight & R. Naylor & J. Smith, 2001. "Graduates and graduate labour markets in the UK and Italy," Working Paper CRENoS 200111, Centre for North South Economic Research, University of Cagliari and Sassari, Sardinia.
    8. Jill Johnes, 2014. "Efficiency and Mergers in English Higher Education 1996/97 to 2008/9: Parametric and Non-parametric Estimation of the Multi-input Multi-output Distance Function," Manchester School, University of Manchester, vol. 82(4), pages 465-487, July.
    9. Agasisti, Tommaso & Wolszczak-Derlacz, Joana, 2014. "Exploring universities’ efficiency differentials between countries in a multi-year perspective: an application of bootstrap DEA and Malmquist index to Italy and Poland, 2001-2011," Institute for Research on Labor and Employment, Working Paper Series qt14m8g45v, Institute of Industrial Relations, UC Berkeley.
    10. Hashimoto, Akihiro & Haneda, Shoko, 2008. "Measuring the change in R&D efficiency of the Japanese pharmaceutical industry," Research Policy, Elsevier, vol. 37(10), pages 1829-1836, December.
    11. Bruno S. Frey & Katja Rost, 2010. "Do rankings reflect research quality?," Journal of Applied Economics, Universidad del CEMA, vol. 13, pages 1-38, May.
    12. Pablo D'Este & Simona Iammarino, 2010. "The spatial profile of university-business research partnerships," Papers in Regional Science, Wiley Blackwell, vol. 89(2), pages 335-350, June.
    13. Claudia Curi & Cinzia Daraio & Patrick Llerena, 2012. "University technology transfer: how (in)efficient are French universities?," Cambridge Journal of Economics, Oxford University Press, vol. 36(3), pages 629-654.
    14. Worthington, Andrew C. & Lee, Boon L., 2008. "Efficiency, technology and productivity change in Australian universities, 1998-2003," Economics of Education Review, Elsevier, vol. 27(3), pages 285-298, June.
    15. Mowery, David C. & Ziedonis, Arvids A., 2015. "Markets versus spillovers in outflows of university research," Research Policy, Elsevier, vol. 44(1), pages 50-66.
    16. Tim Coelli & Sergio Perelman, 2000. "Technical efficiency of European railways: a distance function approach," Applied Economics, Taylor & Francis Journals, vol. 32(15), pages 1967-1976.
    17. repec:kap:iaecre:v:16:y:2010:i:1:p:24-38 is not listed on IDEAS
    18. Kao, Chiang & Hung, Hsi-Tai, 2008. "Efficiency analysis of university departments: An empirical study," Omega, Elsevier, vol. 36(4), pages 653-664, August.
    19. Coco, Giuseppe & Lagravinese, Raffaele, 2014. "Cronyism and education performance," Economic Modelling, Elsevier, vol. 38(C), pages 443-450.
    20. Hung-jen Wang & Peter Schmidt, 2002. "One-Step and Two-Step Estimation of the Effects of Exogenous Variables on Technical Efficiency Levels," Journal of Productivity Analysis, Springer, vol. 18(2), pages 129-144, September.
    21. Richard Florida & Charlotta Mellander & Kevin Stolarick, 2008. "Inside the black box of regional development: human capital, the creative class and tolerance," Journal of Economic Geography, Oxford University Press, vol. 8(5), pages 615-649, September.
    22. Keld Laursen & Toke Reichstein & Ammon Salter, 2011. "Exploring the Effect of Geographical Proximity and University Quality on University-Industry Collaboration in the United Kingdom," Regional Studies, Taylor & Francis Journals, vol. 45(4), pages 507-523.
    23. Chapple, Wendy & Lockett, Andy & Siegel, Donald & Wright, Mike, 2005. "Assessing the relative performance of U.K. university technology transfer offices: parametric and non-parametric evidence," Research Policy, Elsevier, vol. 34(3), pages 369-384, April.
    24. Wang, Hung-Jen & Ho, Chia-Wen, 2010. "Estimating fixed-effect panel stochastic frontier models by model transformation," Journal of Econometrics, Elsevier, vol. 157(2), pages 286-296, August.
    25. Thursby, Jerry G. & Kemp, Sukanya, 2002. "Growth and productive efficiency of university intellectual property licensing," Research Policy, Elsevier, vol. 31(1), pages 109-124, January.
    26. Simar, Leopold & Wilson, Paul W., 2007. "Estimation and inference in two-stage, semi-parametric models of production processes," Journal of Econometrics, Elsevier, vol. 136(1), pages 31-64, January.
    27. Abbott, M. & Doucouliagos, C., 2003. "The efficiency of Australian universities: a data envelopment analysis," Economics of Education Review, Elsevier, vol. 22(1), pages 89-97, February.
    28. Meeusen, Wim & van den Broeck, Julien, 1977. "Efficiency Estimation from Cobb-Douglas Production Functions with Composed Error," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 18(2), pages 435-444, June.
    29. Tommaso Agasisti & Geraint Johnes, 2009. "Beyond frontiers: comparing the efficiency of higher education decision-making units across more than one country," Education Economics, Taylor & Francis Journals, vol. 17(1), pages 59-79.
    30. George E. Halkos & Nickolaos G. Tzeremes & Stavros A. Kourtzidis, 2012. "Measuring Public Owned University Departments' Efficiency: A Bootstrapped DEA Approach," Journal of Economics and Econometrics, Economics and Econometrics Society, vol. 55(2), pages 1-24.
    31. Harvey Goldstein & Catherine Renault, 2004. "Contributions of Universities to Regional Economic Development: A Quasi-experimental Approach," Regional Studies, Taylor & Francis Journals, vol. 38(7), pages 733-746.
    32. Gary Madden & Scott Savage & Steven Kemp, 1997. "Measuring Public Sector Efficiency: A Study of Economics Departments at Australian Universities," Education Economics, Taylor & Francis Journals, vol. 5(2), pages 153-168.
    33. Tommaso Agasisti & Geraint Johnes, 2010. "Heterogeneity and the evaluation of efficiency: the case of Italian universities," Applied Economics, Taylor & Francis Journals, vol. 42(11), pages 1365-1375.
    34. COELLI, Tim, 2000. "On the econometric estimation of the distance function representation of a production technology," CORE Discussion Papers 2000042, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    35. Haelermans, Carla & Ruggiero, John, 2013. "Estimating technical and allocative efficiency in the public sector: A nonparametric analysis of Dutch schools," European Journal of Operational Research, Elsevier, vol. 227(1), pages 174-181.
    36. George E. Battese & Greg S. Corra, 1977. "Estimation Of A Production Frontier Model: With Application To The Pastoral Zone Of Eastern Australia," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 21(3), pages 169-179, December.
    37. Etzkowitz, Henry, 2003. "Research groups as 'quasi-firms': the invention of the entrepreneurial university," Research Policy, Elsevier, vol. 32(1), pages 109-121, January.
    38. de Groot, Hans & McMahon, Walter W & Volkwein, J Fredericks, 1991. "The Cost Structure of American Research Universities," The Review of Economics and Statistics, MIT Press, vol. 73(3), pages 424-431, August.
    39. Antonio Alvarez & Christine Amsler & Luis Orea & Peter Schmidt, 2006. "Interpreting and Testing the Scaling Property in Models where Inefficiency Depends on Firm Characteristics," Journal of Productivity Analysis, Springer, vol. 25(3), pages 201-212, June.
    40. Tommaso Agasisti & Giuseppe Catalano & Paolo Landoni & Roberto Verganti, 2012. "Evaluating the performance of academic departments: an analysis of research-related output efficiency," Research Evaluation, Oxford University Press, vol. 21(1), pages 2-14, February.
    41. Tommaso Agasisti, 2009. "Market forces and competition in university systems: theoretical reflections and empirical evidence from Italy," International Review of Applied Economics, Taylor & Francis Journals, vol. 23(4), pages 463-483.
    42. Donald Siegel & Mike Wright & Wendy Chapple & Andy Lockett, 2008. "Assessing The Relative Performance Of University Technology Transfer In The Us And Uk: A Stochastic Distance Function Approach," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 17(7-8), pages 717-729.
    43. Johnes, Jill, 2006. "Measuring teaching efficiency in higher education: An application of data envelopment analysis to economics graduates from UK Universities 1993," European Journal of Operational Research, Elsevier, vol. 174(1), pages 443-456, October.
    44. Battese, George E. & Corra, Greg S., 1977. "Estimation Of A Production Frontier Model: With Application To The Pastoral Zone Of Eastern Australia," Australian Journal of Agricultural Economics, Australian Agricultural and Resource Economics Society, vol. 0(Number 3), pages 1-11, December.
    45. Smith, Jeremy & Naylor, Robin, 2001. " Determinants of Degree Performance in UK Universities: A Statistical Analysis of the 1993 Student Cohort," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 63(1), pages 29-60, February.
    46. Brennan, Shae & Haelermans, Carla & Ruggiero, John, 2014. "Nonparametric estimation of education productivity incorporating nondiscretionary inputs with an application to Dutch schools," European Journal of Operational Research, Elsevier, vol. 234(3), pages 809-818.
    47. Kraus, Margit, 2004. "Schätzung von Kostenfunktionen für die bundesdeutsche Hochschulausbildung: Ein konzeptioneller Ansatz im empirischen Test," ZEW Discussion Papers 04-36, ZEW - Zentrum für Europäische Wirtschaftsforschung / Center for European Economic Research.
    48. Tommaso Agasisti, 2011. "Performances and spending efficiency in higher education: a European comparison through non-parametric approaches," Education Economics, Taylor & Francis Journals, vol. 19(2), pages 199-224.
    49. Roger Carrington & Tim Coelli & D. S. Prasada Rao, 2005. "The Performance Of Australian Universities: Conceptual Issues And Preliminary Results," Economic Papers, The Economic Society of Australia, vol. 24(2), pages 145-163, June.
    50. Battese, G E & Coelli, T J, 1995. "A Model for Technical Inefficiency Effects in a Stochastic Frontier Production Function for Panel Data," Empirical Economics, Springer, vol. 20(2), pages 325-332.
    51. Aigner, Dennis & Lovell, C. A. Knox & Schmidt, Peter, 1977. "Formulation and estimation of stochastic frontier production function models," Journal of Econometrics, Elsevier, vol. 6(1), pages 21-37, July.
    52. Greene, William, 2005. "Reconsidering heterogeneity in panel data estimators of the stochastic frontier model," Journal of Econometrics, Elsevier, vol. 126(2), pages 269-303, June.
    53. Kumbhakar,Subal C. & Lovell,C. A. Knox, 2003. "Stochastic Frontier Analysis," Cambridge Books, Cambridge University Press, number 9780521666633, October.
    54. Lucia Buzzigoli & Antonio Giusti & Alessandro Viviani, 2010. "The Evaluation of University Departments. A Case Study for Firenze," International Advances in Economic Research, Springer;International Atlantic Economic Society, vol. 16(1), pages 24-38, February.
    55. Kroll, Henning & Schubert, Torben, 2014. "On universities' long-term effects on regional value creation and unemployment: The case of Germany," Working Papers "Firms and Region" R1/2014, Fraunhofer Institute for Systems and Innovation Research (ISI).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Agasisti, Tommaso & Gralka, Sabine, 2017. "The transient and persistent efficiency of Italian and German universities: A stochastic frontier analysis," CEPIE Working Papers 14/17, Technische Universität Dresden, Center of Public and International Economics (CEPIE).

    More about this item

    Keywords

    Universities; Efficiency; Data Envelopment Analysis; Stochastic Frontier Analysis;

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C67 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Input-Output Models
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:67119. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Joachim Winter). General contact details of provider: http://edirc.repec.org/data/vfmunde.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.