IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v109y2016i2d10.1007_s11192-016-2102-3.html
   My bibliography  Save this article

The determinants of the research output of universities: specialization, quality and inefficiencies

Author

Listed:
  • José Manuel Pastor

    (Universitat de València)

  • Lorenzo Serrano

    (Ivie)

Abstract

The analysis of productivity in Higher Education Institutions (HEIs) at a European level reveals enormous differences in output per researcher across countries. This study develops a 5-step methodology that explicitly considers the quality of scientific output in EU universities and its specialisations to explain and decompose the differences in output per university researcher in terms of (a) differences in efficiency within each field of science (FOS), (b) differences in FOS specialisation of HEIs in each country, (c) differences in quality, and (d) differences in allocation of resources per researcher. The inefficiency levels estimated show that across the EU as a whole there is a substantial margin for increasing research output without having to spend more resources. There are also major differences between countries in terms of inefficiency. The main sources of heterogeneity in scientific output in the HEIs of the EU are the differences in resources allocated per researcher and, to a lesser extent, the differences in efficiency within each knowledge field. The differences in quality and in specialisation also play a smaller role in determining differences in output.

Suggested Citation

  • José Manuel Pastor & Lorenzo Serrano, 2016. "The determinants of the research output of universities: specialization, quality and inefficiencies," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 1255-1281, November.
    • Handle: RePEc:spr:scient:v:109:y:2016:i:2:d:10.1007_s11192-016-2102-3
    DOI: 10.1007/s11192-016-2102-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-016-2102-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-016-2102-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Johnes, Jill, 1996. "Performance assessment in higher education in Britain," European Journal of Operational Research, Elsevier, vol. 89(1), pages 18-33, February.
    2. Buenstorf, Guido, 2009. "Is commercialization good or bad for science? Individual-level evidence from the Max Planck Society," Research Policy, Elsevier, vol. 38(2), pages 281-292, March.
    3. Nicolas Carayol, 2004. "Academic incentives and research organization for patenting at a large French university," Post-Print hal-00279232, HAL.
    4. Calogero Guccio & Marco Ferdinando Martorana & Luisa Monaco, 2016. "Evaluating the impact of the Bologna Process on the efficiency convergence of Italian universities: a non-parametric frontier approach," Journal of Productivity Analysis, Springer, vol. 45(3), pages 275-298, June.
    5. Kira Fabrizio & Alberto Di Minin, 2004. "Commercializing the laboratory: the relationship between faculty patenting and publishing," Working Papers 200402, Scuola Superiore Sant'Anna of Pisa, Istituto di Management.
    6. Worthington, Andrew C. & Lee, Boon L., 2008. "Efficiency, technology and productivity change in Australian universities, 1998-2003," Economics of Education Review, Elsevier, vol. 27(3), pages 285-298, June.
    7. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    8. Crespi, Gustavo & D'Este, Pablo & Fontana, Roberto & Geuna, Aldo, 2011. "The impact of academic patenting on university research and its transfer," Research Policy, Elsevier, vol. 40(1), pages 55-68, February.
    9. Antje Klitkou & Magnus Gulbrandsen, 2010. "The relationship between academic patenting and scientific publishing in Norway," Scientometrics, Springer;Akadémiai Kiadó, vol. 82(1), pages 93-108, January.
    10. S. Breschi & F. Lissoni & F. Montobbio, 2007. "The Scientific Productivity Of Academic Inventors: New Evidence From Italian Data," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 16(2), pages 101-118.
    11. Malcolm Abbott & Hristos Doucouliagos, 2004. "Research output of Australian universities," Education Economics, Taylor & Francis Journals, vol. 12(3), pages 251-265.
    12. Glass, J C & McKillop, Donal G & Hyndman, N, 1995. "Efficiency in the Provision of University Teaching and Research: An Empirical Analysis of UK Universities," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 10(1), pages 61-72, Jan.-Marc.
    13. Paula Stephan & Shiferaw Gurmu & Albert Sumell & Grant Black, 2007. "Who'S Patenting In The University? Evidence From The Survey Of Doctorate Recipients," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 16(2), pages 71-99.
    14. Nicolas Carayol, 2007. "Academic Incentives, Research Organization And Patenting At A Large French University," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 16(2), pages 119-138.
    15. Johnes, Jill, 2006. "Data envelopment analysis and its application to the measurement of efficiency in higher education," Economics of Education Review, Elsevier, vol. 25(3), pages 273-288, June.
    16. Pierre Azoulay & Waverly Ding & Toby Stuart, 2009. "The Impact Of Academic Patenting On The Rate, Quality And Direction Of (Public) Research Output," Journal of Industrial Economics, Wiley Blackwell, vol. 57(4), pages 637-676, December.
    17. A. T. Flegg & D. O. Allen & K. Field & T. W. Thurlow, 2004. "Measuring the efficiency of British universities: a multi-period data envelopment analysis," Education Economics, Taylor & Francis Journals, vol. 12(3), pages 231-249.
    18. Ajay Agrawal & Rebecca Henderson, 2002. "Putting Patents in Context: Exploring Knowledge Transfer from MIT," Management Science, INFORMS, vol. 48(1), pages 44-60, January.
    19. Johnes, Geraint, 1988. "Determinants of research output in economics departments in British universities," Research Policy, Elsevier, vol. 17(3), pages 171-178, June.
    20. Gerhard Kempkes & Carsten Pohl, 2010. "The efficiency of German universities-some evidence from nonparametric and parametric methods," Applied Economics, Taylor & Francis Journals, vol. 42(16), pages 2063-2079.
    21. Sarrico, C. S. & Dyson, R. G., 2004. "Restricting virtual weights in data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 159(1), pages 17-34, November.
    22. Joaquin Maudos & Jose Pastor & Lorenzo Serrano, 2000. "Efficiency and Productive Specialization: An Application to the Spanish Regions," Regional Studies, Taylor & Francis Journals, vol. 34(9), pages 829-842.
    23. Johnes, Geraint & Johnes, Jill, 2009. "Higher education institutions' costs and efficiency: Taking the decomposition a further step," Economics of Education Review, Elsevier, vol. 28(1), pages 107-113, February.
    24. Abbott, M. & Doucouliagos, C., 2003. "The efficiency of Australian universities: a data envelopment analysis," Economics of Education Review, Elsevier, vol. 22(1), pages 89-97, February.
    25. Sarrico, Cláudia S. & Teixeira, Pedro N. & Rosa, Maria J. & Cardoso, Margarida F., 2009. "Subject mix and productivity in Portuguese universities," European Journal of Operational Research, Elsevier, vol. 197(1), pages 287-295, August.
    26. de Groot, Hans & McMahon, Walter W & Volkwein, J Fredericks, 1991. "The Cost Structure of American Research Universities," The Review of Economics and Statistics, MIT Press, vol. 73(3), pages 424-431, August.
    27. E Thanassoulis & M Kortelainen & G Johnes & J Johnes, 2011. "Costs and efficiency of higher education institutions in England: a DEA analysis," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(7), pages 1282-1297, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Alona Zharova & Janine Tellinger-Rice & Wolfgang Karl Härdle, 2018. "How to Measure a Performance of a Collaborative Research Centre," SFB 649 Discussion Papers SFB649DP2018-001, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
    2. Alona Zharova & Janine Tellinger-Rice & Wolfgang Karl Härdle, 2018. "How to measure the performance of a Collaborative Research Center," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(2), pages 1023-1040, November.
    3. Robertas Damaševičius & Ligita Zailskaitė-Jakštė, 2023. "The Impact of a National Crisis on Research Collaborations: A Scientometric Analysis of Ukrainian Authors 2019–2022," Publications, MDPI, vol. 11(3), pages 1-16, August.
    4. Giuri, Paola & Munari, Federico & Scandura, Alessandra & Toschi, Laura, 2019. "The strategic orientation of universities in knowledge transfer activities," Technological Forecasting and Social Change, Elsevier, vol. 138(C), pages 261-278.
    5. Tanel Hirv, 2022. "The interplay of the size of the research system, ways of collaboration, level, and method of funding in determining bibliometric outputs," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(3), pages 1295-1316, March.
    6. Mehdi Rhaiem & Nabil Amara, 2020. "Determinants of research efficiency in Canadian business schools: evidence from scholar-level data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 53-99, October.
    7. Cristian Barra & Mónica Y. Castro-Peña & Jesús Gabalán Coello, 2024. "Research and knowledge transfer performance in Colombian universities," Quality & Quantity: International Journal of Methodology, Springer, vol. 58(1), pages 77-96, February.
    8. Mohammed S. Alqahtani & Mohamed Abbas & Mohammed Abdul Muqeet & Hussain M. Almohiy, 2022. "Research Productivity in Terms of Output, Impact, and Collaboration for University Researchers in Saudi Arabia: SciVal Analytics and t -Tests Statistical Based Approach," Sustainability, MDPI, vol. 14(23), pages 1-21, December.
    9. Samira Foladi & Maghsud Solimanpur & Mustafa Jahangoshai Rezaee, 2020. "Inverse Dynamic Data Envelopment Analysis for Evaluating Faculties of University with Quasi-Fixed Inputs," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 148(1), pages 323-347, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kristof De Witte & Laura López-Torres, 2017. "Efficiency in education: a review of literature and a way forward," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 339-363, April.
    2. Mehdi Rhaiem, 2017. "Measurement and determinants of academic research efficiency: a systematic review of the evidence," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 581-615, February.
    3. Tzeremes, Nickolaos & Halkos, George, 2010. "A DEA approach for measuring university departments’ efficiency," MPRA Paper 24029, University Library of Munich, Germany.
    4. Shamohammadi, Mehdi & Oh, Dong-hyun, 2019. "Measuring the efficiency changes of private universities of Korea: A two-stage network data envelopment analysis," Technological Forecasting and Social Change, Elsevier, vol. 148(C).
    5. Aparicio, Juan & López-Torres, Laura & Santín, Daniel, 2018. "Economic crisis and public education. A productivity analysis using a Hicks-Moorsteen index," Economic Modelling, Elsevier, vol. 71(C), pages 34-44.
    6. Heike Grimm & Johannes Jaenicke, 2015. "Testing the causal relationship between academic patenting and scientific publishing in Germany: Crowding-out or reinforcement?," The Journal of Technology Transfer, Springer, vol. 40(3), pages 512-535, June.
    7. Yaisawarng, Suthathip & Ng, Ying Chu, 2014. "The impact of higher education reform on research performance of Chinese universities," China Economic Review, Elsevier, vol. 31(C), pages 94-105.
    8. José Manuel Pastor & Lorenzo Serrano & Irene Zaera, 2015. "The research output of European higher education institutions," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(3), pages 1867-1893, March.
    9. Crespi, Gustavo & D'Este, Pablo & Fontana, Roberto & Geuna, Aldo, 2011. "The impact of academic patenting on university research and its transfer," Research Policy, Elsevier, vol. 40(1), pages 55-68, February.
    10. Joanna Wolszczak-Derlacz & Aleksandra Parteka, 2011. "Efficiency of European public higher education institutions: a two-stage multicountry approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 89(3), pages 887-917, December.
    11. Ruiz, José L. & Segura, José V. & Sirvent, Inmaculada, 2015. "Benchmarking and target setting with expert preferences: An application to the evaluation of educational performance of Spanish universities," European Journal of Operational Research, Elsevier, vol. 242(2), pages 594-605.
    12. Lee, Boon L. & Worthington, Andrew C., 2016. "A network DEA quantity and quality-orientated production model: An application to Australian university research services," Omega, Elsevier, vol. 60(C), pages 26-33.
    13. Barra, Cristian & Lagravinese, Raffaele & Zotti, Roberto, 2018. "Does econometric methodology matter to rank universities? An analysis of Italian higher education system," Socio-Economic Planning Sciences, Elsevier, vol. 62(C), pages 104-120.
    14. Agasisti, Tommaso & Barra, Cristian & Zotti, Roberto, 2016. "Evaluating the efficiency of Italian public universities (2008–2011) in presence of (unobserved) heterogeneity," Socio-Economic Planning Sciences, Elsevier, vol. 55(C), pages 47-58.
    15. Calogero Guccio & Marco Ferdinando Martorana & Isidoro Mazza, 2016. "Efficiency assessment and convergence in teaching and research in Italian public universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(3), pages 1063-1094, June.
    16. Mario Calderini & Chiara Franzoni & Andrea Vezzulli, 2007. "The Unequal Benefits of Academic Patenting for Science and Engineering Research," KITeS Working Papers 203, KITeS, Centre for Knowledge, Internationalization and Technology Studies, Universita' Bocconi, Milano, Italy, revised Oct 2007.
    17. Rentocchini, Francesco & D'Este, Pablo & Manjarrés-Henríquez, Liney & Grimaldi, Rosa, 2014. "The relationship between academic consulting and research performance: Evidence from five Spanish universities," International Journal of Industrial Organization, Elsevier, vol. 32(C), pages 70-83.
    18. Daniel Ogachi & Lydia Bares & Zoltan Zeman, 2021. "Innovation and Scientific Research as a Sustainable Development Goal in Spanish Public Universities," Sustainability, MDPI, vol. 13(7), pages 1-12, April.
    19. Paula E. Stephan, 2008. "Science and the University: Challenges for Future Research," CESifo Economic Studies, CESifo Group, vol. 54(2), pages 313-324.
    20. Vanesa D’Elia & Gustavo Ferro, 2019. "Empirical Efficiency Measurement in Higher Education: An Overview," CEMA Working Papers: Serie Documentos de Trabajo. 708, Universidad del CEMA.

    More about this item

    Keywords

    HEI; Specialization; Research output; Efficiency; Quality;
    All these keywords.

    JEL classification:

    • I20 - Health, Education, and Welfare - - Education - - - General
    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • I28 - Health, Education, and Welfare - - Education - - - Government Policy

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:109:y:2016:i:2:d:10.1007_s11192-016-2102-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.