IDEAS home Printed from https://ideas.repec.org/a/eee/infome/v6y2012i2p155-168.html
   My bibliography  Save this article

The dispersion of research performance within and between universities as a potential indicator of the competitive intensity in higher education systems

Author

Listed:
  • Abramo, Giovanni
  • Cicero, Tindaro
  • D’Angelo, Ciriaco Andrea

Abstract

Higher education systems in competitive environments generally present top universities, that are able to attract top scientists, top students and public and private financing, with notable socio-economic benefits in their region. The same does not hold true for non-competitive systems. In this study we will measure the dispersion of research performance within and between universities in the Italian university system, typically non-competitive. We will also investigate the level of correlation that occurs between performance in research and its dispersion in universities. The findings may represent a first benchmark for similar studies in other nations. Furthermore, they lead to policy indications, questioning the effectiveness of selective funding of universities based on national research assessment exercises. The field of observation is composed of all Italian universities active in the hard sciences. Research performance will be evaluated using a bibliometric approach, through publications indexed in the Web of Science between 2004 and 2008.

Suggested Citation

  • Abramo, Giovanni & Cicero, Tindaro & D’Angelo, Ciriaco Andrea, 2012. "The dispersion of research performance within and between universities as a potential indicator of the competitive intensity in higher education systems," Journal of Informetrics, Elsevier, vol. 6(2), pages 155-168.
    • Handle: RePEc:eee:infome:v:6:y:2012:i:2:p:155-168
    DOI: 10.1016/j.joi.2011.11.007
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1751157711001064
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.joi.2011.11.007?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Giovanni Abramo & Ciriaco Andrea D'Angelo & Flavia Di Costa, 2008. "Assessment of sectoral aggregation distortion in research productivity measurements," Research Evaluation, Oxford University Press, vol. 17(2), pages 111-121, June.
    2. Giovanni Abramo, 2007. "Il trasferimento tecnologico pubblico-privato: un’analisi integrata del sistema Italia," Rivista di Politica Economica, SIPI Spa, vol. 97(2), pages 45-86, March-Apr.
    3. Jaffe, Adam B, 1989. "Real Effects of Academic Research," American Economic Review, American Economic Association, vol. 79(5), pages 957-970, December.
    4. Rodrigo Costas & Thed N. van Leeuwen & María Bordons, 2010. "A bibliometric classificatory approach for the study and assessment of research performance at the individual level: The effects of age on productivity and impact," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 61(8), pages 1564-1581, August.
    5. Michael Fritsch & Viktor Slavtchev, 2007. "Universities and Innovation in Space," Industry and Innovation, Taylor & Francis Journals, vol. 14(2), pages 201-218.
    6. Joseph Macri & Dipendra Sinha, 2006. "Rankings Methodology for International Comparisons of Institutions and Individuals: an Application to Economics in Australia and New Zealand," Journal of Economic Surveys, Wiley Blackwell, vol. 20(1), pages 111-156, February.
    7. Derek J. Solla de Price, 1971. "Some remarks on elitism in information and the invisible college phenomenon in science," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 22(2), pages 74-75, March.
    8. Daniel Coronado & Manuel Acosta, 2005. "The effects of scientific regional opportunities in science-technology flows: Evidence from scientific literature in firms patent data," The Annals of Regional Science, Springer;Western Regional Science Association, vol. 39(3), pages 495-522, September.
    9. Auranen, Otto & Nieminen, Mika, 2010. "University research funding and publication performance--An international comparison," Research Policy, Elsevier, vol. 39(6), pages 822-834, July.
    10. Rodrigo Costas & Thed N. van Leeuwen & María Bordons, 2010. "A bibliometric classificatory approach for the study and assessment of research performance at the individual level: The effects of age on productivity and impact," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 61(8), pages 1564-1581, August.
    11. Kalaitzidakis, P. & Mamuneas, T.P. & Stengos, T., 2003. "Rankings of Academic Journals and Institutions," Working Papers 2003-8, University of Guelph, Department of Economics and Finance.
    12. Pantelis Kalaitzidakis & Theofanis P. Mamuneas & Thanasis Stengos, 2003. "Rankings of Academic Journals and Institutions in Economics," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1346-1366, December.
    13. George Deltas, 2003. "The Small-Sample Bias of the Gini Coefficient: Results and Implications for Empirical Research," The Review of Economics and Statistics, MIT Press, vol. 85(1), pages 226-234, February.
    14. David A. King, 2004. "The scientific impact of nations," Nature, Nature, vol. 430(6997), pages 311-316, July.
    15. Lundberg, Jonas, 2007. "Lifting the crown—citation z-score," Journal of Informetrics, Elsevier, vol. 1(2), pages 145-154.
    16. Rosenberg, Nathan & Nelson, Richard R., 1994. "American universities and technical advance in industry," Research Policy, Elsevier, vol. 23(3), pages 323-348, May.
    17. Renata R. Gonçalves & Christian Kieling & Rodrigo A. Bressan & Jair J. Mari & Luis A. Rohde, 2009. "The evaluation of scientific productivity in Brazil: An assessment of the mental health field," Scientometrics, Springer;Akadémiai Kiadó, vol. 80(2), pages 529-537, August.
    18. Abramo, Giovanni & D'Angelo, Ciriaco Andrea & Caprasecca, Alessandro, 2009. "Allocative efficiency in public research funding: Can bibliometrics help?," Research Policy, Elsevier, vol. 38(1), pages 206-215, February.
    19. Dosi, Giovanni & Llerena, Patrick & Labini, Mauro Sylos, 2006. "The relationships between science, technologies and their industrial exploitation: An illustration through the myths and realities of the so-called `European Paradox'," Research Policy, Elsevier, vol. 35(10), pages 1450-1464, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Abramo, Giovanni & D’Angelo, Ciriaco Andrea & Grilli, Leonardo, 2015. "Funnel plots for visualizing uncertainty in the research performance of institutions," Journal of Informetrics, Elsevier, vol. 9(4), pages 954-961.
    2. Khalil Assala & Suela Bylykbashi & Gilles Roehrich, 2021. "How To Measure Competitive Intensity?," Post-Print hal-03381232, HAL.
    3. Giovanni Abramo & Ciriaco Andrea D’Angelo & Francesco Rosati, 2016. "The north–south divide in the Italian higher education system," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 2093-2117, December.
    4. Abramo, Giovanni & D’Angelo, Ciriaco Andrea, 2015. "Evaluating university research: Same performance indicator, different rankings," Journal of Informetrics, Elsevier, vol. 9(3), pages 514-525.
    5. Abramo, Giovanni & Cicero, Tindaro & D’Angelo, Ciriaco Andrea, 2013. "The impact of unproductive and top researchers on overall university research performance," Journal of Informetrics, Elsevier, vol. 7(1), pages 166-175.
    6. Koen Jonkers & Thomas Zacharewicz, 2016. "Research Performance Based Funding Systems: a Comparative Assessment," JRC Research Reports JRC101043, Joint Research Centre.
    7. Giovanni Abramo & Ciriaco Andrea D’Angelo & Francesco Rosati, 2014. "Career advancement and scientific performance in universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 891-907, February.
    8. Andrea Bonaccorsi & Luca Secondi & Enza Setteducati & Alessio Ancaiani, 2014. "Participation and commitment in third-party research funding: evidence from Italian Universities," The Journal of Technology Transfer, Springer, vol. 39(2), pages 169-198, April.
    9. Kwieciński Dariusz, 2017. "Measures of Competitive Intensity – Analysis Based on Literature Review," Journal of Management and Business Administration. Central Europe, Sciendo, vol. 25(1), pages 53-77, March.
    10. Koen Jonkers & Thomas Zacharewicz, 2015. "Performance based funding: a comparative assessment of their use and nature in EU Member States – a working paper," JRC Research Reports JRC97684, Joint Research Centre.
    11. Giovanni Abramo & Ciriaco D’Angelo, 2015. "An assessment of the first “scientific habilitation” for university appointments in Italy," Economia Politica: Journal of Analytical and Institutional Economics, Springer;Fondazione Edison, vol. 32(3), pages 329-357, December.
    12. Jessie S. Barrot, 2017. "Research impact and productivity of Southeast Asian countries in language and linguistics," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(1), pages 1-15, January.
    13. Juan Gorraiz & Christian Gumpenberger, 2015. "A flexible bibliometric approach for the assessment of professorial appointments," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(3), pages 1699-1719, December.
    14. Jappelli, Tullio & Nappi, Carmela Anna & Torrini, Roberto, 2017. "Gender effects in research evaluation," Research Policy, Elsevier, vol. 46(5), pages 911-924.
    15. Bonaccorsi, Andrea & Haddawy, Peter & Cicero, Tindaro & Hassan, Saeed-Ul, 2017. "The solitude of stars. An analysis of the distributed excellence model of European universities," Journal of Informetrics, Elsevier, vol. 11(2), pages 435-454.
    16. Sandström, Ulf & Van den Besselaar, Peter, 2018. "Funding, evaluation, and the performance of national research systems," Journal of Informetrics, Elsevier, vol. 12(1), pages 365-384.
    17. Abramo, Giovanni & D’Angelo, Ciriaco Andrea & Rosati, Francesco, 2016. "A methodology to measure the effectiveness of academic recruitment and turnover," Journal of Informetrics, Elsevier, vol. 10(1), pages 31-42.
    18. Abramo, Giovanni & D’Angelo, Ciriaco Andrea & Soldatenkova, Anastasiia, 2016. "The ratio of top scientists to the academic staff as an indicator of the competitive strength of universities," Journal of Informetrics, Elsevier, vol. 10(2), pages 596-605.
    19. Giovanni Abramo & Ciriaco Andrea D’Angelo & Flavia Di Costa, 2014. "Variability of research performance across disciplines within universities in non-competitive higher education systems," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 777-795, February.
    20. Giovanni Abramo & Ciriaco Andrea D’Angelo & Emanuela Reale, 2019. "Peer review versus bibliometrics: Which method better predicts the scholarly impact of publications?," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 537-554, October.
    21. Abramo, Giovanni & D’Angelo, Andrea Ciriaco & Grilli, Leonardo, 2016. "From rankings to funnel plots: The question of accounting for uncertainty when assessing university research performance," Journal of Informetrics, Elsevier, vol. 10(3), pages 854-862.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Giovanni Abramo & Ciriaco Andrea D’Angelo & Marco Solazzi, 2010. "National research assessment exercises: a measure of the distortion of performance rankings when labor input is treated as uniform," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(3), pages 605-619, September.
    2. Abramo, Giovanni & Cicero, Tindaro & D’Angelo, Ciriaco Andrea, 2011. "A field-standardized application of DEA to national-scale research assessment of universities," Journal of Informetrics, Elsevier, vol. 5(4), pages 618-628.
    3. Giovanni Abramo & Ciriaco Andrea D’Angelo & Francesco Rosati, 2014. "Relatives in the same university faculty: nepotism or merit?," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(1), pages 737-749, October.
    4. David L. Anderson & John Tressler, 2013. "The Relevance of the “h-” and “g-” Index to Economics in the Context of A Nation-Wide Research Evaluation Scheme: The New Zealand Case," Economic Papers, The Economic Society of Australia, vol. 32(1), pages 81-94, March.
    5. David L. Anderson & John Tressler, 2009. "The Excellence in Research for Australia Scheme: An Evaluation of the Draft Journal Weights for Economics," Working Papers in Economics 09/07, University of Waikato.
    6. Giovanni Abramo & Ciriaco Andrea D’Angelo, 2011. "National-scale research performance assessment at the individual level," Scientometrics, Springer;Akadémiai Kiadó, vol. 86(2), pages 347-364, February.
    7. John Gibson & David L. Anderson & John Tressler, 2014. "Which Journal Rankings Best Explain Academic Salaries? Evidence From The University Of California," Economic Inquiry, Western Economic Association International, vol. 52(4), pages 1322-1340, October.
    8. David L. Anderson & John Tressler, 2011. "Ranking Economics Departments In Terms Of Residual Productivity: New Zealand Economics Departments, 2000–2006," Australian Economic Papers, Wiley Blackwell, vol. 50(4), pages 157-168, December.
    9. Raquel Carrasco & Javier Ruiz-Castillo, 2019. "Spatial mobility in elite academic institutions in economics: the case of Spain," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 10(2), pages 141-172, June.
    10. Hottenrott, Hanna & Thorwarth, Susanne, 2010. "Industry funding of university research and scientific productivity," ZEW Discussion Papers 10-105, ZEW - Leibniz Centre for European Economic Research.
    11. Giovanni Abramo & Ciriaco Andrea D’Angelo & Flavia Di Costa, 2011. "A national-scale cross-time analysis of university research performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(2), pages 399-413, May.
    12. Murat Çokgezen, 2019. "Research Performance of Turkish Economists and Economics Departments: Another Update and a Review of the 2000s," Emerging Markets Finance and Trade, Taylor & Francis Journals, vol. 55(1), pages 133-149, January.
    13. David L. Anderson & John Tressler, 2008. "Research Output in New Zealand Economics Department 2000-2006," Working Papers in Economics 08/05, University of Waikato.
    14. Giovanni Abramo & Ciriaco Andrea D’Angelo & Flavia Costa, 2011. "Research productivity: Are higher academic ranks more productive than lower ones?," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(3), pages 915-928, September.
    15. Giovanni Abramo & Ciriaco Andrea D’Angelo & Flavia Di Costa, 2011. "National research assessment exercises: a comparison of peer review and bibliometrics rankings," Scientometrics, Springer;Akadémiai Kiadó, vol. 89(3), pages 929-941, December.
    16. Thelwall, Mike & Fairclough, Ruth, 2015. "Geometric journal impact factors correcting for individual highly cited articles," Journal of Informetrics, Elsevier, vol. 9(2), pages 263-272.
    17. Frank Havemann & Birger Larsen, 2015. "Bibliometric indicators of young authors in astrophysics: Can later stars be predicted?," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(2), pages 1413-1434, February.
    18. Joseph Macri & Michael McAleer & Dipendra Sinha, 2010. "On the robustness of alternative rankings methodologies: Australian and New Zealand economics departments, 1988 to 2002," Applied Economics, Taylor & Francis Journals, vol. 42(10), pages 1257-1268.
    19. ÇOKGEZEN , Murat, 2013. "Publication performance of economists and economics departments in Turkey (2006–2011): An Update and Comparison," Regional and Sectoral Economic Studies, Euro-American Association of Economic Development, vol. 13(3), pages 95-106.
    20. David L. Anderson & John Tressler, 2017. "Researcher rank stability across alternative output measurement schemes in the context of a time limited research evaluation: the New Zealand case," Applied Economics, Taylor & Francis Journals, vol. 49(45), pages 4542-4553, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:infome:v:6:y:2012:i:2:p:155-168. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/joi .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.