IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v112y2017i3d10.1007_s11192-017-2442-7.html
   My bibliography  Save this article

The determinants of research performance in European universities: a large scale multilevel analysis

Author

Listed:
  • Andrea Bonaccorsi

    (Universita degli Studi di Pisa and IRVAPP-FBK)

  • Luca Secondi

    (Agro-Food and Forest Systems (DIBAF) - University of Tuscia)

Abstract

The paper examines the research performance of European universities in a disaggregated way, using a large array of indicators from Scopus publications, including indicators of volume (number of articles; number of citations) and indicators of quality (percentage of publications in top 10% and top 25% SNIP journals; percentage of citations from top 10% and top 25% journals). These indicators are considered dependent variables in a multi-level estimation framework, in which research performance in a scientific area depends on variables at the level of university and at the level of the external regional environment. The area examined is Medicine, for the 2007–2010 period. The paper exploits for the first time the integration of publication data with the census of European universities (ETER). A large number of hypotheses are tested and discussed.

Suggested Citation

  • Andrea Bonaccorsi & Luca Secondi, 2017. "The determinants of research performance in European universities: a large scale multilevel analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(3), pages 1147-1178, September.
    • Handle: RePEc:spr:scient:v:112:y:2017:i:3:d:10.1007_s11192-017-2442-7
    DOI: 10.1007/s11192-017-2442-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-017-2442-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-017-2442-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Pierre Dubois & Jean-Charles Rochet & Jean-Marc Schlenker, 2014. "Productivity and mobility in academic research: evidence from mathematicians," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(3), pages 1669-1701, March.
    2. Worthington, Andrew C. & Higgs, Helen, 2014. "Economies of scale and scope in Australian urban water utilities," Utilities Policy, Elsevier, vol. 31(C), pages 52-62.
    3. Viner, Neil & Powell, Philip & Green, Rod, 2004. "Institutionalized biases in the award of research grants: a preliminary analysis revisiting the principle of accumulative advantage," Research Policy, Elsevier, vol. 33(3), pages 443-454, April.
    4. Koshal, Rajindar K. & Koshal, Manjulika, 1999. "Economies of scale and scope in higher education: a case of comprehensive universities," Economics of Education Review, Elsevier, vol. 18(2), pages 269-277, April.
    5. Andrea Bonaccorsi & Cinzia Daraio, 2005. "Exploring size and agglomeration effects on public research productivity," Scientometrics, Springer;Akadémiai Kiadó, vol. 63(1), pages 87-120, March.
    6. Bosquet, Clément & Combes, Pierre-Philippe, 2013. "Do large departments make academics more productive? agglomeration and peer effects in research," LSE Research Online Documents on Economics 58306, London School of Economics and Political Science, LSE Library.
    7. Fredrik Niclas Piro & Dag W. Aksnes & Kristoffer Rørstad, 2013. "A macro analysis of productivity differences across fields: Challenges in the measurement of scientific publishing," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(2), pages 307-320, February.
    8. Pierre Azoulay & Joshua S. Graff Zivin & Gustavo Manso, 2011. "Incentives and creativity: evidence from the academic life sciences," RAND Journal of Economics, RAND Corporation, vol. 42(3), pages 527-554, September.
    9. Clément Bosquet & Pierre-Philippe Combes, 2015. "Do large departments make academics more productive? Sorting and agglomeration economies in research," THEMA Working Papers 2015-16, THEMA (THéorie Economique, Modélisation et Applications), Université de Cergy-Pontoise.
    10. Cherchye, L. & Abeele, P. Vanden, 2005. "On research efficiency: A micro-analysis of Dutch university research in Economics and Business Management," Research Policy, Elsevier, vol. 34(4), pages 495-516, May.
    11. George J. Borjas & Kirk B. Doran, 2021. "The Collapse Of The Soviet Union And The Productivity Of American Mathematicians," World Scientific Book Chapters, in: Foundational Essays in Immigration Economics, chapter 11, pages 313-373, World Scientific Publishing Co. Pte. Ltd..
    12. Uwe Schimank & Markus Winnes, 2000. "Beyond Humboldt? The relationship between teaching and research in European university systems," Science and Public Policy, Oxford University Press, vol. 27(6), pages 397-408, December.
    13. Carayol, Nicolas & Matt, Mireille, 2006. "Individual and collective determinants of academic scientists' productivity," Information Economics and Policy, Elsevier, vol. 18(1), pages 55-72, March.
    14. Daraio, Cinzia & Bonaccorsi, Andrea & Simar, Léopold, 2015. "Efficiency and economies of scale and specialization in European universities: A directional distance approach," Journal of Informetrics, Elsevier, vol. 9(3), pages 430-448.
    15. Keiji Hashimoto & Elchanan Cohn, 1997. "Economies of Scale and Scope in Japanese Private Universities," Education Economics, Taylor & Francis Journals, vol. 5(2), pages 107-115.
    16. Stefan Hornbostel & Susan Böhmer & Bernd Klingsporn & Jörg Neufeld & Markus Ins, 2009. "Funding of young scientist and scientific excellence," Scientometrics, Springer;Akadémiai Kiadó, vol. 79(1), pages 171-190, April.
    17. Alexander Oettl, 2012. "Reconceptualizing Stars: Scientist Helpfulness and Peer Performance," Management Science, INFORMS, vol. 58(6), pages 1122-1140, June.
    18. Izadi, Hooshang & Johnes, Geraint & Oskrochi, Reza & Crouchley, Robert, 2002. "Stochastic frontier estimation of a CES cost function: the case of higher education in Britain," Economics of Education Review, Elsevier, vol. 21(1), pages 63-71, February.
    19. Gonzalez-Brambila, Claudia & Veloso, Francisco M., 2007. "The determinants of research output and impact: A study of Mexican researchers," Research Policy, Elsevier, vol. 36(7), pages 1035-1051, September.
    20. Stefan P L de Jong & Pleun van Arensbergen & Floortje Daemen & Barend van der Meulen & Peter van den Besselaar, 2011. "Evaluation of research in context: an approach and two cases," Research Evaluation, Oxford University Press, vol. 20(1), pages 61-72, March.
    21. Carolina Cañibano & Javier Otamendi & Inés Andújar, 2009. "An assessment of selection processes among candidates for public research grants: the case of the Ramón y Cajal Programme in Spain," Research Evaluation, Oxford University Press, vol. 18(2), pages 153-161, June.
    22. Bornmann, Lutz & Mutz, Rüdiger & Daniel, Hans-Dieter, 2008. "Latent Markov modeling applied to grant peer review," Journal of Informetrics, Elsevier, vol. 2(3), pages 217-228.
    23. Per O. Seglen & Dag W. Aksnes, 2000. "Scientific Productivity and Group Size: A Bibliometric Analysis of Norwegian Microbiological Research," Scientometrics, Springer;Akadémiai Kiadó, vol. 49(1), pages 125-143, August.
    24. Thomas Bolli & Jörg Schläpfer, 2015. "Job mobility, peer effects, and research productivity in economics," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(3), pages 629-650, September.
    25. Pedro Teixeira & Vera Rocha & Ricardo Biscaia & Margarida F. Cardoso, 2014. "Public and private higher education in Europe: competition, complementarity or worlds apart?," Chapters, in: Andrea Bonaccorsi (ed.), Knowledge, Diversity and Performance in European Higher Education, chapter 3, pages iii-iii, Edward Elgar Publishing.
    26. Bosquet, Clément & Combes, Pierre-Philippe, 2017. "Sorting and agglomeration economies in French economics departments," Journal of Urban Economics, Elsevier, vol. 101(C), pages 27-44.
    27. George J. Borjas & Kirk B. Doran, 2015. "Which Peers Matter? The Relative Impacts of Collaborators, Colleagues, and Competitors," The Review of Economics and Statistics, MIT Press, vol. 97(5), pages 1104-1117, December.
    28. David N. Laband & Bernard F. Lentz, 2003. "New Estimates of Economies of Scale and Scope in Higher Education," Southern Economic Journal, John Wiley & Sons, vol. 70(1), pages 172-183, July.
    29. Carmen López-Illescas & Félix Moya-Anegón & Henk F. Moed, 2011. "A ranking of universities should account for differences in their disciplinary specialization," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(2), pages 563-574, August.
    30. Johnes, Jill, 2006. "Data envelopment analysis and its application to the measurement of efficiency in higher education," Economics of Education Review, Elsevier, vol. 25(3), pages 273-288, June.
    31. Hoisl, Karin, 2007. "Tracing mobile inventors--The causality between inventor mobility and inventor productivity," Research Policy, Elsevier, vol. 36(5), pages 619-636, June.
    32. Bornmann, Lutz & Leydesdorff, Loet & Van den Besselaar, Peter, 2010. "A meta-evaluation of scientific research proposals: Different ways of comparing rejected to awarded applications," Journal of Informetrics, Elsevier, vol. 4(3), pages 211-220.
    33. Hugo Horta & T Austin Lacy, 2011. "How does size matter for science? Exploring the effects of research unit size on academics' scientific productivity and information exchange behaviors," Science and Public Policy, Oxford University Press, vol. 38(6), pages 449-460, July.
    34. William E. Becker & Peter E. Kennedy, 2006. "The Influence of Teaching on Research in Economics," Southern Economic Journal, John Wiley & Sons, vol. 72(3), pages 747-759, January.
    35. Carole J. Bland & Bruce A. Center & Deborah A. Finstad & Kelly R. Risbey & Justin Staples, 2006. "The Impact of Appointment Type on the Productivity and Commitment of Full-Time Faculty in Research and Doctoral Institutions," The Journal of Higher Education, Taylor & Francis Journals, vol. 77(1), pages 89-123, January.
    36. Moed, Henk F. & de Moya-Anegón, Félix & López-Illescas, Carmen & Visser, Martijn, 2011. "Is concentration of university research associated with better research performance?," Journal of Informetrics, Elsevier, vol. 5(4), pages 649-658.
    37. Jacob, Brian A. & Lefgren, Lars, 2011. "The impact of research grant funding on scientific productivity," Journal of Public Economics, Elsevier, vol. 95(9), pages 1168-1177.
    38. Geraint Johnes & Jill Johnes (ed.), 2004. "International Handbook on the Economics of Education," Books, Edward Elgar Publishing, number 2847.
    39. Pierre Azoulay & Joshua S. Graff Zivin & Jialan Wang, 2010. "Superstar Extinction," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(2), pages 549-589.
    40. Broder, Ivy E, 1993. "Review of NSF Economics Proposals: Gender and Institutional Patterns," American Economic Review, American Economic Association, vol. 83(4), pages 964-970, September.
    41. Lutz Bornmann & Hans-Dieter Daniel, 2005. "Selection of research fellowship recipients by committee peer review. Reliability, fairness and predictive validity of Board of Trustees' decisions," Scientometrics, Springer;Akadémiai Kiadó, vol. 63(2), pages 297-320, April.
    42. Dundar, Halil & Lewis, Darrell R., 1995. "Departmental productivity in American universities: Economies of scale and scope," Economics of Education Review, Elsevier, vol. 14(2), pages 119-144, June.
    43. Buchmueller, Thomas C. & Dominitz, Jeff & Lee Hansen, W., 1999. "Graduate training and the early career productivity of Ph.D. economists," Economics of Education Review, Elsevier, vol. 18(1), pages 65-77, February.
    44. Karin Hoisl, 2009. "Does mobility increase the productivity of inventors?," The Journal of Technology Transfer, Springer, vol. 34(2), pages 212-225, April.
    45. repec:hal:spmain:info:hdl:2441/5f4gqlbaf382ua75f8et967s6a is not listed on IDEAS
    46. Fredrik Niclas Piro & Dag W. Aksnes & Kristoffer Rørstad, 2013. "A macro analysis of productivity differences across fields: Challenges in the measurement of scientific publishing," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 64(2), pages 307-320, February.
    47. James S. Fairweather, 2002. "The Mythologies of Faculty Productivity," The Journal of Higher Education, Taylor & Francis Journals, vol. 73(1), pages 26-48, January.
    48. Lutz Bornmann & Hans-Dieter Daniel, 2006. "Selecting scientific excellence through committee peer review - A citation analysis of publications previously published to approval or rejection of post-doctoral research fellowship applicants," Scientometrics, Springer;Akadémiai Kiadó, vol. 68(3), pages 427-440, September.
    49. Lepori, B. & Seeber, M. & Bonaccorsi, A., 2015. "Competition for talent. Country and organizational-level effects in the internationalization of European higher education institutions," Research Policy, Elsevier, vol. 44(3), pages 789-802.
    50. Bolli, Thomas & Somogyi, Frank, 2011. "Do competitively acquired funds induce universities to increase productivity?," Research Policy, Elsevier, vol. 40(1), pages 136-147, February.
    51. Thed N. van Leeuwen & Henk F. Moed, 2012. "Funding decisions, peer review, and scientific excellence in physical sciences, chemistry, and geosciences," Research Evaluation, Oxford University Press, vol. 21(3), pages 189-198, August.
    52. Cohn, Elchanan & Rhine, Sherrie L W & Santos, Maria C, 1989. "Institutions of Higher Education as Multi-product Firms: Economies of Scale and Scope," The Review of Economics and Statistics, MIT Press, vol. 71(2), pages 284-290, May.
    53. Longlong, Hou & Fengliang, Li & Weifang, Min, 2009. "Multi-product total cost functions for higher education: The case of Chinese research universities," Economics of Education Review, Elsevier, vol. 28(4), pages 505-511, August.
    54. Sarrico, Cláudia S. & Teixeira, Pedro N. & Rosa, Maria J. & Cardoso, Margarida F., 2009. "Subject mix and productivity in Portuguese universities," European Journal of Operational Research, Elsevier, vol. 197(1), pages 287-295, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Püttmann, Vitus & Thomsen, Stephan L. & Trunzer, Johannes, 2020. "Zur Relevanz von Ausstattungsunterschieden für Forschungsleistungsvergleiche: Ein Diskussionsbeitrag für die Wirtschaftswissenschaften in Deutschland," Hannover Economic Papers (HEP) dp-679, Leibniz Universität Hannover, Wirtschaftswissenschaftliche Fakultät, revised Mar 2021.
    2. Gad Yair & Keith Goldstein, 2020. "The Annus Mirabilis paper: years of peak productivity in scientific careers," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(2), pages 887-902, August.
    3. Önder, Ali Sina & Schweitzer, Sascha & Yilmazkuday, Hakan, 2021. "Specialization, field distance, and quality in economists’ collaborations," Journal of Informetrics, Elsevier, vol. 15(4).
    4. Selcuk Besir Demir, 2018. "Pros and cons of the new financial support policy for Turkish researchers," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 2053-2068, September.
    5. Andrea Bonaccorsi & Daniele Biancardi & Mabel Sanchez Barrioluengo & Federico Biagi, 2019. "Study on Higher Education Institutions and Local Development," JRC Research Reports JRC117272, Joint Research Centre.
    6. Ali Sina Önder & Sascha Schweitzer & Hakan Yilmazkuday, 2021. "Field Distance and Quality in Economists’ Collaborations," Working Papers in Economics & Finance 2021-04, University of Portsmouth, Portsmouth Business School, Economics and Finance Subject Group.
    7. Bonaccorsi, Andrea & Belingheri, Paola & Secondi, Luca, 2021. "The research productivity of universities. A multilevel and multidisciplinary analysis on European institutions," Journal of Informetrics, Elsevier, vol. 15(2).
    8. Andrea Bonaccorsi & Nicola Melluso & Francesco Alessandro Massucci, 2022. "Exploring the antecedents of interdisciplinarity at the European Research Council: a topic modeling approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 6961-6991, December.
    9. Renato Bruni & Giuseppe Catalano & Cinzia Daraio & Martina Gregori & Henk F. Moed, 2020. "Studying the heterogeneity of European higher education institutions," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1117-1144, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Daraio, Cinzia & Bonaccorsi, Andrea & Simar, Léopold, 2015. "Efficiency and economies of scale and specialization in European universities: A directional distance approach," Journal of Informetrics, Elsevier, vol. 9(3), pages 430-448.
    2. Andrea Bonaccorsi & Cinzia Daraio & Leopold Simar, 2014. "Efficiency and economies of scale and scope in European universities. A directional distance approach," DIAG Technical Reports 2014-08, Department of Computer, Control and Management Engineering, Universita' degli Studi di Roma "La Sapienza".
    3. Bonaccorsi, Andrea & Belingheri, Paola & Secondi, Luca, 2021. "The research productivity of universities. A multilevel and multidisciplinary analysis on European institutions," Journal of Informetrics, Elsevier, vol. 15(2).
    4. repec:hal:spmain:info:hdl:2441/65v9ag2jfn865abjgaljmq2qi9 is not listed on IDEAS
    5. Thomas Bolli & Jörg Schläpfer, 2015. "Job mobility, peer effects, and research productivity in economics," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(3), pages 629-650, September.
    6. Clément Bosquet & Pierre-Philippe Combes & Emeric Henry & Thierry Mayer, 2022. "Peer Effects in Academic Research: Senders and Receivers," The Economic Journal, Royal Economic Society, vol. 132(648), pages 2644-2673.
    7. repec:spo:wpecon:info:hdl:2441/65v9ag2jfn865abjgaljmq2qi9 is not listed on IDEAS
    8. repec:spo:wpmain:info:hdl:2441/65v9ag2jfn865abjgaljmq2qi9 is not listed on IDEAS
    9. repec:hal:wpspec:info:hdl:2441/65v9ag2jfn865abjgaljmq2qi9 is not listed on IDEAS
    10. Mehdi Rhaiem, 2017. "Measurement and determinants of academic research efficiency: a systematic review of the evidence," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 581-615, February.
    11. Liang-Cheng Zhang & Andrew C. Worthington, 2018. "Explaining Estimated Economies of Scale and Scope in Higher Education: A Meta-Regression Analysis," Research in Higher Education, Springer;Association for Institutional Research, vol. 59(2), pages 156-173, March.
    12. Maaike Verbree & Edwin Horlings & Peter Groenewegen & Inge Weijden & Peter Besselaar, 2015. "Organizational factors influencing scholarly performance: a multivariate study of biomedical research groups," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(1), pages 25-49, January.
    13. Kevin W. Boyack & Caleb Smith & Richard Klavans, 2018. "Toward predicting research proposal success," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(2), pages 449-461, February.
    14. Torben Schubert, 2014. "Are there scale economies in scientific production? On the topic of locally increasing returns to scale," Scientometrics, Springer;Akadémiai Kiadó, vol. 99(2), pages 393-408, May.
    15. Hartwig, Jochen, 2015. "Structural change, aggregate demand and employment dynamics in the OECD, 1970–2010," Structural Change and Economic Dynamics, Elsevier, vol. 34(C), pages 36-45.
    16. Camil Demetrescu & Andrea Ribichini & Marco Schaerf, 2020. "Are Italian research assessment exercises size-biased?," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 533-549, October.
    17. Marvin A. Titus & Adriana Vamosiu & Kevin R. McClure, 2017. "Are Public Master’s Institutions Cost Efficient? A Stochastic Frontier and Spatial Analysis," Research in Higher Education, Springer;Association for Institutional Research, vol. 58(5), pages 469-496, August.
    18. Tasso Brandt & Torben Schubert, 2013. "Is the university model an organizational necessity? Scale and agglomeration effects in science," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(2), pages 541-565, February.
    19. Shamohammadi, Mehdi & Oh, Dong-hyun, 2019. "Measuring the efficiency changes of private universities of Korea: A two-stage network data envelopment analysis," Technological Forecasting and Social Change, Elsevier, vol. 148(C).
    20. Lars Herberholz & Berthold U. Wigger, 2020. "Efficiency of European Universities: A Comparison of Peers," CESifo Working Paper Series 8044, CESifo.
    21. Longlong, Hou & Fengliang, Li & Weifang, Min, 2009. "Multi-product total cost functions for higher education: The case of Chinese research universities," Economics of Education Review, Elsevier, vol. 28(4), pages 505-511, August.
    22. Bolli, Thomas & Olivares, Maria & Bonaccorsi, Andrea & Daraio, Cinzia & Aracil, Adela Garcia & Lepori, Benedetto, 2016. "The differential effects of competitive funding on the production frontier and the efficiency of universities," Economics of Education Review, Elsevier, vol. 52(C), pages 91-104.
    23. Mehdi Rhaiem & Nabil Amara, 2020. "Determinants of research efficiency in Canadian business schools: evidence from scholar-level data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 53-99, October.
    24. Tasso Brandt & Torben Schubert, 2014. "Is the university model an organizational necessity? Scale and agglomeration effects in science," Chapters, in: Andrea Bonaccorsi (ed.), Knowledge, Diversity and Performance in European Higher Education, chapter 8, pages iii-iii, Edward Elgar Publishing.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:112:y:2017:i:3:d:10.1007_s11192-017-2442-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.