IDEAS home Printed from https://ideas.repec.org/a/kap/iaecre/v22y2016i1d10.1007_s11294-015-9558-4.html
   My bibliography  Save this article

Measuring Efficiency in Higher Education: An Empirical Study Using a Bootstrapped Data Envelopment Analysis

Author

Listed:
  • Cristian Barra

    (University of Salerno)

  • Roberto Zotti

    (University of Salerno)

Abstract

This paper applies data envelopment analysis (DEA) to assess technical efficiency in a big public university. Particular attention has been paid to two main activities, teaching and research, and on two large groups, the Science and Technology (ST) sector and the Humanity and Social Science (HSS) sector. The findings, based to data from 2005 to 2009, suggest that the ST sector is more efficient in terms of quality of research than the HSS sector, that instead achieves higher efficiency in teaching activities. The efficiency estimates strongly depend on the output specification, given that the use of several quality proxies, such as three research and two student questionnaire-based teaching alternative indices, reduce performance and its differentials for both research and teaching activities. A bootstrap technique is also used to provide confidence intervals for efficiency scores and to obtain bias-corrected estimates. The Malmquist index is calculated to measure changes in productivity.

Suggested Citation

  • Cristian Barra & Roberto Zotti, 2016. "Measuring Efficiency in Higher Education: An Empirical Study Using a Bootstrapped Data Envelopment Analysis," International Advances in Economic Research, Springer;International Atlantic Economic Society, vol. 22(1), pages 11-33, February.
    • Handle: RePEc:kap:iaecre:v:22:y:2016:i:1:d:10.1007_s11294-015-9558-4
    DOI: 10.1007/s11294-015-9558-4
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11294-015-9558-4
    File Function: Abstract
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s11294-015-9558-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Johnes, Geraint & Johnes, Jill, 1993. "Measuring the Research Performance of UK Economics Departments: An Application of Data Envelopment Analysis," Oxford Economic Papers, Oxford University Press, vol. 45(2), pages 332-347, April.
    2. Sveinbjörn Blöndal & Simon Field & Nathalie Girouard, 2002. "Investment in Human Capital Through Post-Compulsory Education and Training: Selected Efficiency and Equity Aspects," OECD Economics Department Working Papers 333, OECD Publishing.
    3. Jill Johnes, 2004. "Efficiency Measurement," Chapters, in: Geraint Johnes & Jill Johnes (ed.), International Handbook on the Economics of Education, chapter 16, Edward Elgar Publishing.
    4. Kocher, Martin G. & Luptacik, Mikulas & Sutter, Matthias, 2006. "Measuring productivity of research in economics: A cross-country study using DEA," Socio-Economic Planning Sciences, Elsevier, vol. 40(4), pages 314-332, December.
    5. Per Andersen & Niels Christian Petersen, 1993. "A Procedure for Ranking Efficient Units in Data Envelopment Analysis," Management Science, INFORMS, vol. 39(10), pages 1261-1264, October.
    6. Ray, Subhash C & Desli, Evangelia, 1997. "Productivity Growth, Technical Progress, and Efficiency Change in Industrialized Countries: Comment," American Economic Review, American Economic Association, vol. 87(5), pages 1033-1039, December.
    7. Jill Johnes, 2008. "Efficiency And Productivity Change In The English Higher Education Sector From 1996/97 To 2004/5," Manchester School, University of Manchester, vol. 76(6), pages 653-674, December.
    8. Worthington, Andrew C. & Lee, Boon L., 2008. "Efficiency, technology and productivity change in Australian universities, 1998-2003," Economics of Education Review, Elsevier, vol. 27(3), pages 285-298, June.
    9. Andrea Bonaccorsi & Cinzia Daraio & Léopold Simar, 2006. "Advanced indicators of productivity of universitiesAn application of robust nonparametric methods to Italian data," Scientometrics, Springer;Akadémiai Kiadó, vol. 66(2), pages 389-410, February.
    10. repec:kap:iaecre:v:16:y:2010:i:1:p:24-38 is not listed on IDEAS
    11. Kao, Chiang & Hung, Hsi-Tai, 2008. "Efficiency analysis of university departments: An empirical study," Omega, Elsevier, vol. 36(4), pages 653-664, August.
    12. Greene, William H., 1980. "On the estimation of a flexible frontier production model," Journal of Econometrics, Elsevier, vol. 13(1), pages 101-115, May.
    13. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    14. repec:kap:iaecre:v:14:y:2008:i:1:p:76-89 is not listed on IDEAS
    15. Abbott, M. & Doucouliagos, C., 2003. "The efficiency of Australian universities: a data envelopment analysis," Economics of Education Review, Elsevier, vol. 22(1), pages 89-97, February.
    16. Simar, Leopold & Wilson, Paul W., 1999. "Estimating and bootstrapping Malmquist indices," European Journal of Operational Research, Elsevier, vol. 115(3), pages 459-471, June.
    17. George E. Halkos & Nickolaos G. Tzeremes & Stavros A. Kourtzidis, 2012. "Measuring Public Owned University Departments' Efficiency: A Bootstrapped DEA Approach," Journal of Economics and Econometrics, Economics and Econometrics Society, vol. 55(2), pages 1-24.
    18. Sarrico, Cláudia S. & Teixeira, Pedro N. & Rosa, Maria J. & Cardoso, Margarida F., 2009. "Subject mix and productivity in Portuguese universities," European Journal of Operational Research, Elsevier, vol. 197(1), pages 287-295, August.
    19. Harris, Geoffrey Thomas, 1988. "Research Output in Australian University Economics Departments, 1974-83," Australian Economic Papers, Wiley Blackwell, vol. 27(50), pages 102-110, June.
    20. Tyagi, Preeti & Yadav, Shiv Prasad & Singh, S.P., 2009. "Relative performance of academic departments using DEA with sensitivity analysis," Evaluation and Program Planning, Elsevier, vol. 32(2), pages 168-177, May.
    21. Jerry G. Thursby, 2000. "What Do We Say about Ourselves and What Does It Mean? Yet Another Look at Economics Department Research," Journal of Economic Literature, American Economic Association, vol. 38(2), pages 383-404, June.
    22. Léopold Simar & Paul W. Wilson, 1998. "Sensitivity Analysis of Efficiency Scores: How to Bootstrap in Nonparametric Frontier Models," Management Science, INFORMS, vol. 44(1), pages 49-61, January.
    23. Gary Madden & Scott Savage & Steven Kemp, 1997. "Measuring Public Sector Efficiency: A Study of Economics Departments at Australian Universities," Education Economics, Taylor & Francis Journals, vol. 5(2), pages 153-168.
    24. Tommaso Agasisti & Geraint Johnes, 2010. "Heterogeneity and the evaluation of efficiency: the case of Italian universities," Applied Economics, Taylor & Francis Journals, vol. 42(11), pages 1365-1375.
    25. Loren Tauer & Harold Fried & William Fry, 2007. "Measuring Efficiencies of Academic Departments within a College," Education Economics, Taylor & Francis Journals, vol. 15(4), pages 473-489.
    26. Johnes, Jill & Johnes, Geraint, 1995. "Research funding and performance in U.K. University Departments of Economics: A frontier analysis," Economics of Education Review, Elsevier, vol. 14(3), pages 301-314, September.
    27. Chizmar, John F & Zak, Thomas A, 1983. "Modeling Multiple Outputs in Educational Production Functions," American Economic Review, American Economic Association, vol. 73(2), pages 17-22, May.
    28. Caves, Douglas W & Christensen, Laurits R & Diewert, W Erwin, 1982. "The Economic Theory of Index Numbers and the Measurement of Input, Output, and Productivity," Econometrica, Econometric Society, vol. 50(6), pages 1393-1414, November.
    29. Chizmar, John F. & Zak, Thomas A., 1984. "Canonical estimation of joint educational production functions," Economics of Education Review, Elsevier, vol. 3(1), pages 37-43, February.
    30. Gary Ferrier & Joseph Hirschberg, 1997. "Bootstrapping Confidence Intervals for Linear Programming Efficiency Scores: With an Illustration Using Italian Banking Data," Journal of Productivity Analysis, Springer, vol. 8(1), pages 19-33, March.
    31. R. D. Banker & A. Charnes & W. W. Cooper, 1984. "Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis," Management Science, INFORMS, vol. 30(9), pages 1078-1092, September.
    32. Geraint Johnes & Jill Johnes (ed.), 2004. "International Handbook on the Economics of Education," Books, Edward Elgar Publishing, number 2847.
    33. Tiziana Laureti, 2008. "Modelling Exogenous Variables in Human Capital Formation through a Heteroscedastic Stochastic Frontier," International Advances in Economic Research, Springer;International Atlantic Economic Society, vol. 14(1), pages 76-89, February.
    34. A. T. Flegg & D. O. Allen & K. Field & T. W. Thurlow, 2004. "Measuring the efficiency of British universities: a multi-period data envelopment analysis," Education Economics, Taylor & Francis Journals, vol. 12(3), pages 231-249.
    35. Cazals, Catherine & Florens, Jean-Pierre & Simar, Leopold, 2002. "Nonparametric frontier estimation: a robust approach," Journal of Econometrics, Elsevier, vol. 106(1), pages 1-25, January.
    36. Tommaso Agasisti, 2011. "Performances and spending efficiency in higher education: a European comparison through non-parametric approaches," Education Economics, Taylor & Francis Journals, vol. 19(2), pages 199-224.
    37. Roger Carrington & Tim Coelli & D. S. Prasada Rao, 2005. "The Performance Of Australian Universities: Conceptual Issues And Preliminary Results," Economic Papers, The Economic Society of Australia, vol. 24(2), pages 145-163, June.
    38. Aigner, Dennis & Lovell, C. A. Knox & Schmidt, Peter, 1977. "Formulation and estimation of stochastic frontier production function models," Journal of Econometrics, Elsevier, vol. 6(1), pages 21-37, July.
    39. Lucia Buzzigoli & Antonio Giusti & Alessandro Viviani, 2010. "The Evaluation of University Departments. A Case Study for Firenze," International Advances in Economic Research, Springer;International Atlantic Economic Society, vol. 16(1), pages 24-38, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Alona Zharova & Janine Tellinger-Rice & Wolfgang Karl Härdle, 2018. "How to Measure a Performance of a Collaborative Research Centre," SFB 649 Discussion Papers SFB649DP2018-001, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
    2. Jesús A. Tapia & Bonifacio Salvador, 2022. "Data envelopment analysis efficiency in the public sector using provider and customer opinion: An application to the Spanish health system," Health Care Management Science, Springer, vol. 25(2), pages 333-346, June.
    3. Jian Yang & Huadong Cheng, 2023. "Coupling Coordination between University Scientific & Technological Innovation and Sustainable Economic Development in China," Sustainability, MDPI, vol. 15(3), pages 1-14, January.
    4. Vanesa D’Elia & Gustavo Ferro, 2019. "Empirical Efficiency Measurement in Higher Education: An Overview," CEMA Working Papers: Serie Documentos de Trabajo. 708, Universidad del CEMA.
    5. Alona Zharova & Janine Tellinger-Rice & Wolfgang Karl Härdle, 2018. "How to measure the performance of a Collaborative Research Center," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(2), pages 1023-1040, November.
    6. Zhang, Chonghui & Jiang, Nanyue & Su, Tiantian & Chen, Ji & Streimikiene, Dalia & Balezentis, Tomas, 2022. "Spreading knowledge and technology: Research efficiency at universities based on the three-stage MCDM-NRSDEA method with bootstrapping," Technology in Society, Elsevier, vol. 68(C).
    7. Cantner, Uwe & Grashof, Nils & Grebel, Thomas & Zhang, Xijie, 2023. "When Excellence is not Excellent: The Impact of the Excellence Initiative on the Relative Productivity of German Universities," MPRA Paper 118139, University Library of Munich, Germany.
    8. Shih-Pin Chen & Chung-Wei Chang, 2021. "Measuring the efficiency of university departments: an empirical study using data envelopment analysis and cluster analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 5263-5284, June.
    9. Delimiro Visbal-Cadavid & Mónica Martínez-Gómez & Francisco Guijarro, 2017. "Assessing the Efficiency of Public Universities through DEA. A Case Study," Sustainability, MDPI, vol. 9(8), pages 1-19, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kristof De Witte & Laura López-Torres, 2017. "Efficiency in education: a review of literature and a way forward," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 339-363, April.
    2. Mehdi Rhaiem, 2017. "Measurement and determinants of academic research efficiency: a systematic review of the evidence," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 581-615, February.
    3. Barra, Cristian & Lagravinese, Raffaele & Zotti, Roberto, 2018. "Does econometric methodology matter to rank universities? An analysis of Italian higher education system," Socio-Economic Planning Sciences, Elsevier, vol. 62(C), pages 104-120.
    4. Barra, Cristian & Lagravinese, Raffaele & Zotti, Roberto, 2015. "Explaining (in)efficiency in higher education: a comparison of parametric and non-parametric analyses to rank universities," MPRA Paper 67119, University Library of Munich, Germany.
    5. Agasisti, Tommaso & Barra, Cristian & Zotti, Roberto, 2016. "Evaluating the efficiency of Italian public universities (2008–2011) in presence of (unobserved) heterogeneity," Socio-Economic Planning Sciences, Elsevier, vol. 55(C), pages 47-58.
    6. Mad Ithnin Salleh & Nurul Fadly Habidin & Abdul Halim Masnan & Nordin Mamat, 2017. "Estimating Technical Efficiency and Bootstrapping Malmquist Indices: Analysis of Malaysian Preschool Sector," International Journal of Academic Research in Business and Social Sciences, Human Resource Management Academic Research Society, International Journal of Academic Research in Business and Social Sciences, vol. 7(3), pages 440-457, March.
    7. Renato A. Villano & Carolyn‐Dung T. T. Tran, 2021. "Survey on technical efficiency in higher education: A meta‐fractional regression analysis," Pacific Economic Review, Wiley Blackwell, vol. 26(1), pages 110-135, February.
    8. Tzeremes, Nickolaos & Halkos, George, 2010. "A DEA approach for measuring university departments’ efficiency," MPRA Paper 24029, University Library of Munich, Germany.
    9. Cristian Barra & Roberto Zotti, 2017. "Investigating the Human Capital Development–growth Nexus," International Regional Science Review, , vol. 40(6), pages 638-678, November.
    10. Barra, Cristian & Zotti, Roberto, 2014. "Handling negative data using Data Envelopment Analysis: a directional distance approach applied to higher education," MPRA Paper 55570, University Library of Munich, Germany.
    11. Calogero Guccio & Marco Ferdinando Martorana & Isidoro Mazza, 2016. "Efficiency assessment and convergence in teaching and research in Italian public universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(3), pages 1063-1094, June.
    12. Amara, Nabil & Rhaiem, Mehdi & Halilem, Norrin, 2020. "Assessing the research efficiency of Canadian scholars in the management field: Evidence from the DEA and fsQCA," Journal of Business Research, Elsevier, vol. 115(C), pages 296-306.
    13. Aparicio, Juan & López-Torres, Laura & Santín, Daniel, 2018. "Economic crisis and public education. A productivity analysis using a Hicks-Moorsteen index," Economic Modelling, Elsevier, vol. 71(C), pages 34-44.
    14. Manuel Salas-Velasco, 2020. "Measuring and explaining the production efficiency of Spanish universities using a non-parametric approach and a bootstrapped-truncated regression," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(2), pages 825-846, February.
    15. Dag Fjeld Edvardsen & Finn R. Førsund & Sverre A. C. Kittelsen, 2017. "Productivity development of Norwegian institutions of higher education 2004–2013," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 399-415, April.
    16. Zotti, Roberto & Barra, Cristian, 2014. "Human capital development, knowledge spillovers and local growth: Is there a quality effect of university efficiency?," MPRA Paper 60065, University Library of Munich, Germany.
    17. Yang, Guo-liang & Fukuyama, Hirofumi & Song, Yao-yao, 2018. "Measuring the inefficiency of Chinese research universities based on a two-stage network DEA model," Journal of Informetrics, Elsevier, vol. 12(1), pages 10-30.
    18. Calogero Guccio & Marco Ferdinando Martorana & Luisa Monaco, 2016. "Evaluating the impact of the Bologna Process on the efficiency convergence of Italian universities: a non-parametric frontier approach," Journal of Productivity Analysis, Springer, vol. 45(3), pages 275-298, June.
    19. Vanesa D’Elia & Gustavo Ferro, 2019. "Empirical Efficiency Measurement in Higher Education: An Overview," CEMA Working Papers: Serie Documentos de Trabajo. 708, Universidad del CEMA.
    20. Jill Johnes & Maria Portela & Emmanuel Thanassoulis, 2017. "Efficiency in education," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 331-338, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:iaecre:v:22:y:2016:i:1:d:10.1007_s11294-015-9558-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.