IDEAS home Printed from https://ideas.repec.org/p/cte/werepe/we095534.html
   My bibliography  Save this paper

A comparison of the scientific performance of the U. S. and the European Union at the turn of the XXI century

Author

Listed:
  • Albarrán, Pedro
  • Crespo, Juan A.
  • Ortuño, Ignacio
  • Ruiz-Castillo, Javier

Abstract

In this paper, scientific performance is identified with the impact journal articles achieve through the citations they receive. The empirical exercise refers to 3.6 million articles published in 1998-2002 in 22 scientific fields, and the more than 47 million citations they receive in 1998-2007. The first finding is that a failure to exclude co-authorship among member countries within the EU (European Union) may lead to a serious upward bias in the assignment of articles to this geographical area. In the second place, standard indicators, such as normalized mean citation ratios, are silent about what takes place in different parts of the citation distribution. Consequently, this paper compares the publication shares of the U.S. and the EU at every percentile of the world citation distribution in each field. In 15 disciplines, as well as in all sciences as a whole, the EU share of total publications is greater than that of the U.S. one. But as soon as the citations received by these publications are taken into account the picture is completely reversed. The mean citation rate in the U.S. is greater than in the EU in every one of the 22 fields. In seven fields, the initial gap between the U.S. and the EU widens up as we advance towards the more cited articles, while in the remaining 15 fields –except for Agricultural Sciences– the U.S. always surpasses the EU when it counts, namely, at the upper tail of citation distributions. For all sciences as a whole, the U.S publication share becomes greater than that of the EU one for the top 50% of the most highly cited articles.

Suggested Citation

  • Albarrán, Pedro & Crespo, Juan A. & Ortuño, Ignacio & Ruiz-Castillo, Javier, 2009. "A comparison of the scientific performance of the U. S. and the European Union at the turn of the XXI century," UC3M Working papers. Economics we095534, Universidad Carlos III de Madrid. Departamento de Economía.
  • Handle: RePEc:cte:werepe:we095534
    as

    Download full text from publisher

    File URL: https://e-archivo.uc3m.es/bitstream/handle/10016/5212/09-55-34.pdf?sequence=1
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Katz, J. Sylvan, 1999. "The self-similar science system1," Research Policy, Elsevier, vol. 28(5), pages 501-517, June.
    2. Giovanni Dosi & Patrick Llerena & Mauro Sylos Labin, 2005. "Science-Technology-Industry Links and the ”European Paradox”: Some Notes on the Dynamics of Scientific and Technological Research in Europe," Working Papers of BETA 2005-11, Bureau d'Economie Théorique et Appliquée, UDS, Strasbourg.
    3. Moed, H. F. & Burger, W. J. M. & Frankfort, J. G. & Van Raan, A. F. J., 1985. "The use of bibliometric data for the measurement of university research performance," Research Policy, Elsevier, vol. 14(3), pages 131-149, June.
    4. Grupp, Hariolf & Mogee, Mary Ellen, 2004. "Indicators for national science and technology policy: how robust are composite indicators?," Research Policy, Elsevier, vol. 33(9), pages 1373-1384, November.
    5. Thed N. Van Leeuwen & Martijn S. Visser & Henk F. Moed & Ton J. Nederhof & Anthony F. J. Van Raan, 2003. "The Holy Grail of science policy: Exploring and combining bibliometric tools in search of scientific excellence," Scientometrics, Springer;Akadémiai Kiadó, vol. 57(2), pages 257-280, June.
    6. Robert D. Shelton & Geoffrey M. Holdridge, 2004. "The US-EU race for leadership of science and technology: Qualitative and quantitative indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 60(3), pages 353-363, August.
    7. Jonathan Adams, 1998. "Benchmarking international research," Nature, Nature, vol. 396(6712), pages 615-618, December.
    8. J Sylvan Katz, 2000. "Scale-independent indicators and research evaluation," Science and Public Policy, Oxford University Press, vol. 27(1), pages 23-36, February.
    9. Michael Batty, 2003. "The Geography of Scientific Citation," Environment and Planning A, , vol. 35(5), pages 761-765, May.
    10. David A. King, 2004. "The scientific impact of nations," Nature, Nature, vol. 430(6997), pages 311-316, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Herranz, Neus & Ruiz-Castillo, Javier, 2012. "Sub-field normalization in the multiplicative case: Average-based citation indicators," Journal of Informetrics, Elsevier, vol. 6(4), pages 543-556.
    2. Neus Herranz & Javier Ruiz-Castillo, 2013. "The end of the “European Paradox”," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(1), pages 453-464, April.
    3. Perianes-Rodriguez, Antonio & Ruiz-Castillo, Javier, 2015. "Multiplicative versus fractional counting methods for co-authored publications. The case of the 500 universities in the Leiden Ranking," Journal of Informetrics, Elsevier, vol. 9(4), pages 974-989.
    4. Pedro Albarrán & Ignacio Ortuño & Javier Ruiz-Castillo, 2011. "Average-based versus high- and low-impact indicators for the evaluation of scientific distributions," Research Evaluation, Oxford University Press, vol. 20(4), pages 325-339, October.
    5. Jürgen Janger & Agnes Kügler & Andreas Reinstaller & Fabian Unterlass, 2017. "Austria 2025 – Looking Out For the Frontier(s): Towards a New Framework For Frontier Measurement in Science, Technology and Innovation," WIFO Studies, WIFO, number 59289, February.
    6. Brigida Blasi & Sandra Romagnosi & Andrea Bonaccorsi, 2018. "Universities as celebrities? How the media select information from a large research assessment exercise," Science and Public Policy, Oxford University Press, vol. 45(4), pages 503-514.
    7. David Bailey & Lisa de Propris & Jürgen Janger, 2015. "Industrial and Innovation Policy as Drivers of Change. WWWforEurope Deliverable No. 9," WIFO Studies, WIFO, number 58412, February.
    8. Benedetto, Lepori & Geuna, Aldo & Veglio, Valerio, 2017. "A Typology of European Universities. Differentiation and resource distribution," Department of Economics and Statistics Cognetti de Martiis. Working Papers 201705, University of Turin.
    9. Pedro Albarrán & Antonio Perianes-Rodríguez & Javier Ruiz-Castillo, 2015. "Differences in citation impact across countries," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(3), pages 512-525, March.
    10. Albarrán, Pedro & Ortuño, Ignacio & Ruiz-Castillo, Javier, 2011. "High- and low-impact citation measures: Empirical applications," Journal of Informetrics, Elsevier, vol. 5(1), pages 122-145.
    11. Javier Ruiz-Castillo, 2012. "The evaluation of citation distributions," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 3(1), pages 291-310, March.
    12. Jürgen Janger, 2015. "Business Science Links For a New Growth Path. WWWforEurope Working Paper No. 107," WIFO Studies, WIFO, number 58413, February.
    13. Benedetto Lepori & Aldo Geuna & Valerio Veglio, 2017. "A Typology of European Research Universities. Differentiation, Layering and Resource Distribution," SPRU Working Paper Series 2017-01, SPRU - Science Policy Research Unit, University of Sussex Business School.
    14. Albarrán, Pedro & Ortuño, Ignacio & Ruiz-Castillo, Javier, 2011. "The measurement of low- and high-impact in citation distributions: Technical results," Journal of Informetrics, Elsevier, vol. 5(1), pages 48-63.
    15. Gergaud, Olivier & Ginsburgh, Victor & Moreno-Ternero, Juan D., 2021. "Wine Ratings: Seeking a Consensus among Tasters via Normalization, Approval, and Aggregation," Journal of Wine Economics, Cambridge University Press, vol. 16(3), pages 321-342, August.
    16. Jürgen Janger & Klaus Nowotny, 2014. "Bestimmungsfaktoren für die Arbeitsplatzwahl von Wissenschaftern und Wissenschafterinnen," WIFO Monatsberichte (monthly reports), WIFO, vol. 87(1), pages 81-89, January.
    17. Hrvoje Matakovic & Mirjana Pejic Bach & Iva Radocaj Novak, 2013. "Scientific Productivity in Transition Countries: Trends and Obstacles," Interdisciplinary Description of Complex Systems - scientific journal, Croatian Interdisciplinary Society Provider Homepage: http://indecs.eu, vol. 11(2), pages 174-189.
    18. N. N., 2014. "WIFO-Monatsberichte, Heft 1/2014," WIFO Monatsberichte (monthly reports), WIFO, vol. 87(1), January.
    19. Andrea Bonaccorsi & Tindaro Cicero & Peter Haddawy & Saeed-UL Hassan, 2017. "Explaining the transatlantic gap in research excellence," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(1), pages 217-241, January.
    20. Lucio Cassia & Alfredo Massis & Michele Meoli & Tommaso Minola, 2014. "Entrepreneurship research centers around the world: research orientation, knowledge transfer and performance," The Journal of Technology Transfer, Springer, vol. 39(3), pages 376-392, June.
    21. Mátyás, László & Balázsi, László & Dömötör, Erika, 2016. "Emberi tényező a gazdaságban. Összegzés a COEURE-projekt tanulmányaiból, I [The human factor in the economy. Summary of the COEURE project studies, I]," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(4), pages 407-430.
    22. Ruiz-Castillo, Javier, 2016. "Research output indicators are not productivity indicators," UC3M Working papers. Economics we1601, Universidad Carlos III de Madrid. Departamento de Economía.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pedro Albarrán & Juan A. Crespo & Ignacio Ortuño & Javier Ruiz-Castillo, 2010. "A comparison of the scientific performance of the U.S. and the European union at the turn of the 21st century," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(1), pages 329-344, October.
    2. Domingo Docampo & Lawrence Cram, 2019. "Highly cited researchers: a moving target," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(3), pages 1011-1025, March.
    3. Javier Ruiz-Castillo, 2012. "The evaluation of citation distributions," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 3(1), pages 291-310, March.
    4. Albarrán, Pedro & Ortuño, Ignacio & Ruiz-Castillo, Javier, 2011. "The measurement of low- and high-impact in citation distributions: Technical results," Journal of Informetrics, Elsevier, vol. 5(1), pages 48-63.
    5. Vicente P. Guerrero-Bote & Felipe Zapico-Alonso & María Eugenia Espinosa-Calvo & Rocío Gómez-Crisóstomo & Félix Moya-Anegón, 2007. "Import-export of knowledge between scientific subject categories: The iceberg hypothesis," Scientometrics, Springer;Akadémiai Kiadó, vol. 71(3), pages 423-441, June.
    6. Albarrán, Pedro & Ortuño, Ignacio & Ruiz-Castillo, Javier, 2011. "High- and low-impact citation measures: Empirical applications," Journal of Informetrics, Elsevier, vol. 5(1), pages 122-145.
    7. Bar-Ilan, Judit, 2008. "Informetrics at the beginning of the 21st century—A review," Journal of Informetrics, Elsevier, vol. 2(1), pages 1-52.
    8. Gao, Xia & Guo, Xiaochuan & Sylvan, Katz J. & Guan, Jiancheng, 2010. "The Chinese innovation system during economic transition: A scale-independent view," Journal of Informetrics, Elsevier, vol. 4(4), pages 618-628.
    9. Frenken, Koen & Hardeman, Sjoerd & Hoekman, Jarno, 2009. "Spatial scientometrics: Towards a cumulative research program," Journal of Informetrics, Elsevier, vol. 3(3), pages 222-232.
    10. Abramo, Giovanni & D’Angelo, Ciriaco Andrea, 2015. "A methodology to compute the territorial productivity of scientists: The case of Italy," Journal of Informetrics, Elsevier, vol. 9(4), pages 675-685.
    11. Wolfgang Glänzel & Koenraad Debackere & Martin Meyer, 2008. "‘Triad’ or ‘tetrad’? On global changes in a dynamic world," Scientometrics, Springer;Akadémiai Kiadó, vol. 74(1), pages 71-88, January.
    12. Giovanni Abramo & Ciriaco Andrea D’Angelo & Fulvio Viel, 2011. "The field-standardized average impact of national research systems compared to world average: the case of Italy," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(2), pages 599-615, August.
    13. Gao, Xia & Guan, Jiancheng, 2009. "A scale-independent analysis of the performance of the Chinese innovation system," Journal of Informetrics, Elsevier, vol. 3(4), pages 321-331.
    14. Javier Ruiz-Castillo, 2013. "The role of statistics in establishing the similarity of citation distributions in a static and a dynamic context," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(1), pages 173-181, July.
    15. Rodríguez-Navarro, Alonso & Brito, Ricardo, 2018. "Technological research in the EU is less efficient than the world average. EU research policy risks Europeans’ future," Journal of Informetrics, Elsevier, vol. 12(3), pages 718-731.
    16. Daraio, Cinzia & Bonaccorsi, Andrea & Simar, Léopold, 2015. "Rankings and university performance: A conditional multidimensional approach," European Journal of Operational Research, Elsevier, vol. 244(3), pages 918-930.
    17. Gregory J Hather & Winston Haynes & Roger Higdon & Natali Kolker & Elizabeth A Stewart & Peter Arzberger & Patrick Chain & Dawn Field & B Robert Franza & Biaoyang Lin & Folker Meyer & Vural Ozdemir & , 2010. "The United States of America and Scientific Research," PLOS ONE, Public Library of Science, vol. 5(8), pages 1-9, August.
    18. Leporia, Benedetto & Geuna, Aldo & Mira, Antonietta, 2018. "Scientific Output of US and European Universities Scales Super-linearly with Resources," Department of Economics and Statistics Cognetti de Martiis LEI & BRICK - Laboratory of Economics of Innovation "Franco Momigliano", Bureau of Research in Innovation, Complexity and Knowledge, Collegio 201806, University of Turin.
    19. Giancarlo Ruocco & Cinzia Daraio, 2013. "An empirical approach to compare the performance of heterogeneous academic fields," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(3), pages 601-625, December.
    20. Basma Albanna & Julia Handl & Richard Heeks, 2021. "Publication outperformance among global South researchers: An analysis of individual-level and publication-level predictors of positive deviance," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(10), pages 8375-8431, October.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cte:werepe:we095534. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Ana Poveda (email available below). General contact details of provider: http://www.eco.uc3m.es/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.