IDEAS home Printed from https://ideas.repec.org/a/sae/evarev/v33y2009i2p159-188.html

Mapping Excellence in National Research Systems

Author

Listed:
  • Giovanni Abramo

    (Italian Research Council University of Rome Tor Vergata)

  • Ciriaco Andrea D'Angelo

    (University of Rome Tor Vergata)

  • Flavia Di Costa

    (University of Rome Tor Vergata)

Abstract

The study of “scientific excellence†is taking on increasing importance in the development of research policies in many nations. However, scientific excellence is difficult to define because of its multidimensional and highly complex character. This work contributes to the state of the art by exploring an effective, simple, and inexpensive bibliometric methodology that further identifies “excellent†centers of research by beginning with the individual researchers affiliated with such centers. The study concentrates on public research organizations in Italy, analyzing 109 scientific categories of research in the “hard†sciences and 157 centers of excellence operating in 60 of these categories. Findings from this first application of the methodology should be considered exploratory and indicative. With a longer period of observation and the addition of further measurements, this methodology could be extended and adapted to a variety of national and supranational contexts, aiding policy decisions at various levels.

Suggested Citation

  • Giovanni Abramo & Ciriaco Andrea D'Angelo & Flavia Di Costa, 2009. "Mapping Excellence in National Research Systems," Evaluation Review, , vol. 33(2), pages 159-188, April.
    • Handle: RePEc:sae:evarev:v:33:y:2009:i:2:p:159-188
    DOI: 10.1177/0193841X08322871
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0193841X08322871
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0193841X08322871?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Robert J. W. Tijssen & Martijn S. Visser & Thed N. van Leeuwen, 2002. "Benchmarking international scientific excellence: Are highly cited research papers an appropriate frame of reference?," Scientometrics, Springer;Akadémiai Kiadó, vol. 54(3), pages 381-397, July.
    2. James Adams & Zvi Griliches, 1996. "Measuring Science: An Exploration," Harvard Institute of Economic Research Working Papers 1749, Harvard - Institute of Economic Research.
    3. Henk F. Moed, 2002. "The impact-factors debate: the ISI's uses and limits," Nature, Nature, vol. 415(6873), pages 731-732, February.
    4. Thed N. van Leeuwen & Henk F. Moed, 2002. "Development and application of journal impact measures in the Dutch science system," Scientometrics, Springer;Akadémiai Kiadó, vol. 53(2), pages 249-266, February.
    5. Anthony F. J. van Raan, 2005. "Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods," Scientometrics, Springer;Akadémiai Kiadó, vol. 62(1), pages 133-143, January.
    6. Thed N. Van Leeuwen & Martijn S. Visser & Henk F. Moed & Ton J. Nederhof & Anthony F. J. Van Raan, 2003. "The Holy Grail of science policy: Exploring and combining bibliometric tools in search of scientific excellence," Scientometrics, Springer;Akadémiai Kiadó, vol. 57(2), pages 257-280, June.
    7. Giovanni Abramo & Ciriaco Andrea D’Angelo & Fabio Pugini, 2008. "The measurement of Italian universities’ research productivity by a non parametric-bibliometric methodology," Scientometrics, Springer;Akadémiai Kiadó, vol. 76(2), pages 225-244, August.
    8. Robert J W Tijssen, 2003. "Scoreboards of research excellence," Research Evaluation, Oxford University Press, vol. 12(2), pages 91-103, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yi-Ching Liaw & Te-Yi Chan & Chin-Yuan Fan & Cheng-Hsin Chiang, 2014. "Can the technological impact of academic journals be evaluated? The practice of non-patent reference (NPR) analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(1), pages 17-37, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rodríguez-Navarro, Alonso & Brito, Ricardo, 2018. "Technological research in the EU is less efficient than the world average. EU research policy risks Europeans’ future," Journal of Informetrics, Elsevier, vol. 12(3), pages 718-731.
    2. Mehdi Rhaiem & Nabil Amara, 2020. "Determinants of research efficiency in Canadian business schools: evidence from scholar-level data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 53-99, October.
    3. Bar-Ilan, Judit, 2008. "Informetrics at the beginning of the 21st century—A review," Journal of Informetrics, Elsevier, vol. 2(1), pages 1-52.
    4. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    5. Albarrán, Pedro & Ortuño, Ignacio & Ruiz-Castillo, Javier, 2011. "The measurement of low- and high-impact in citation distributions: Technical results," Journal of Informetrics, Elsevier, vol. 5(1), pages 48-63.
    6. Javier Ruiz-Castillo, 2012. "The evaluation of citation distributions," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 3(1), pages 291-310, March.
    7. Oguz K. Baskurt, 2011. "Time series analysis of publication counts of a university: what are the implications?," Scientometrics, Springer;Akadémiai Kiadó, vol. 86(3), pages 645-656, March.
    8. Domingo Docampo & Lawrence Cram, 2019. "Highly cited researchers: a moving target," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(3), pages 1011-1025, March.
    9. Giovanni Abramo & Ciriaco Andrea D’Angelo & Marco Solazzi, 2010. "National research assessment exercises: a measure of the distortion of performance rankings when labor input is treated as uniform," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(3), pages 605-619, September.
    10. Robert J. W. Tijssen & Jos J. Winnink, 2018. "Capturing ‘R&D excellence’: indicators, international statistics, and innovative universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(2), pages 687-699, February.
    11. Ludo Waltman & Michael Schreiber, 2013. "On the calculation of percentile-based bibliometric indicators," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(2), pages 372-379, February.
    12. Giovanni Abramo & Ciriaco Andrea D’Angelo & Marco Solazzi, 2011. "The relationship between scientists’ research performance and the degree of internationalization of their research," Scientometrics, Springer;Akadémiai Kiadó, vol. 86(3), pages 629-643, March.
    13. Bárbara S. Lancho-Barrantes & Vicente P. Guerrero-Bote & Félix Moya-Anegón, 2010. "The iceberg hypothesis revisited," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(2), pages 443-461, November.
    14. Jing Li & Qiushuang Long & Xiaoli Lu & Dengsheng Wu, 2023. "Citation beneficiaries of discipline-specific mega-journals: who and how much," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 10(1), pages 1-10, December.
    15. Abramo, Giovanni & D'Angelo, Ciriaco Andrea & Caprasecca, Alessandro, 2009. "Allocative efficiency in public research funding: Can bibliometrics help?," Research Policy, Elsevier, vol. 38(1), pages 206-215, February.
    16. Abramo, Giovanni & D’Angelo, Ciriaco Andrea, 2014. "Assessing national strengths and weaknesses in research fields," Journal of Informetrics, Elsevier, vol. 8(3), pages 766-775.
    17. Vicente P. Guerrero-Bote & Felipe Zapico-Alonso & María Eugenia Espinosa-Calvo & Rocío Gómez-Crisóstomo & Félix Moya-Anegón, 2007. "Import-export of knowledge between scientific subject categories: The iceberg hypothesis," Scientometrics, Springer;Akadémiai Kiadó, vol. 71(3), pages 423-441, June.
    18. Pedro Albarrán & Ignacio Ortuño & Javier Ruiz-Castillo, 2011. "Average-based versus high- and low-impact indicators for the evaluation of scientific distributions," Research Evaluation, Oxford University Press, vol. 20(4), pages 325-339, October.
    19. Ruimin Ma & Chaoqun Ni & Junping Qiu, 2008. "Scientific research competitiveness of world universities in computer science," Scientometrics, Springer;Akadémiai Kiadó, vol. 76(2), pages 245-260, August.
    20. Giovanni Abramo & Ciriaco Andrea D’Angelo & Flavia Di Costa, 2011. "A national-scale cross-time analysis of university research performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(2), pages 399-413, May.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:evarev:v:33:y:2009:i:2:p:159-188. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.