IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v114y2018i2d10.1007_s11192-017-2593-6.html
   My bibliography  Save this article

Assessing the effect of the United States’ “citation advantage” on other countries’ scientific impact as measured in the Web of Science (WoS) database

Author

Listed:
  • Yves Gingras

    (Université du Québec à Montréal)

  • Mahdi Khelfaoui

    (Université du Québec à Montréal)

Abstract

Eugene Garfield, always insisted that citation analysis “can be used wisely or abused” and that it is “up to the scientific community to prevent abuse of the SCI by devoting the necessary attention to its proper and judicious exploitation” (Garfield in Nat 227:669–671, 1970). Dedicated to his memory, this paper aim to assess the significance of a parameter that is seldom taken into account in evaluation studies: the existence of a USA comparative citation (visibility) advantage built in the database and thus affecting countries that collaborate more with the USA than with other countries. We analyze how this USA citation advantage affects the measure of the scientific impact (usually measured through citations received) of major countries. The main conclusion coming out of this study is that, given the strong presence of the USA in the WoS database, the comparative rankings tend, by construction, to give a citation advantage to countries having the closest relation to that country.

Suggested Citation

  • Yves Gingras & Mahdi Khelfaoui, 2018. "Assessing the effect of the United States’ “citation advantage” on other countries’ scientific impact as measured in the Web of Science (WoS) database," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(2), pages 517-532, February.
    • Handle: RePEc:spr:scient:v:114:y:2018:i:2:d:10.1007_s11192-017-2593-6
    DOI: 10.1007/s11192-017-2593-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-017-2593-6
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-017-2593-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Gunnar Öquist & Mats Benner, 2015. "Why Are Some Nations More Successful Than Others in Research Impact? A Comparison Between Denmark and Sweden," Springer Books, in: Isabell M. Welpe & Jutta Wollersheim & Stefanie Ringelhan & Margit Osterloh (ed.), Incentives and Performance, edition 127, pages 241-257, Springer.
    2. Leydesdorff, Loet & Wagner, Caroline S. & Bornmann, Lutz, 2014. "The European Union, China, and the United States in the top-1% and top-10% layers of most-frequently cited publications: Competition and collaborations," Journal of Informetrics, Elsevier, vol. 8(3), pages 606-617.
    3. Raheem Sarwar & Saeed-UI Hassan, 2015. "A bibliometric assessment of scientific productivity and international collaboration of the Islamic World in science and technology (S&T) areas," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(2), pages 1059-1077, November.
    4. George A. Lozano & Vincent Larivière & Yves Gingras, 2012. "The weakening relationship between the impact factor and papers' citations in the digital age," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(11), pages 2140-2145, November.
    5. Vincent Larivière & Yves Gingras, 2010. "The impact factor's Matthew Effect: A natural experiment in bibliometrics," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 61(2), pages 424-427, February.
    6. Loet Leydesdorff & Caroline Wagner, 2009. "Is the United States losing ground in science? A global perspective on the world science system," Scientometrics, Springer;Akadémiai Kiadó, vol. 78(1), pages 23-36, January.
    7. Loet Leydesdorff & Ping Zhou, 2005. "Are the contributions of China and Korea upsetting the world system of science?," Scientometrics, Springer;Akadémiai Kiadó, vol. 63(3), pages 617-630, June.
    8. Philippe Mongeon & Adèle Paul-Hus, 2016. "The journal coverage of Web of Science and Scopus: a comparative analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(1), pages 213-228, January.
    9. Bar-Ilan, Judit, 2008. "Informetrics at the beginning of the 21st century—A review," Journal of Informetrics, Elsevier, vol. 2(1), pages 1-52.
    10. Francisco Collazo-Reyes, 2014. "Growth of the number of indexed journals of Latin America and the Caribbean: the effect on the impact of each country," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(1), pages 197-209, January.
    11. Vicente P. Guerrero Bote & Carlos Olmeda-Gómez & Félix Moya-Anegón, 2013. "Quantifying the benefits of international scientific collaboration," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(2), pages 392-404, February.
    12. Bárbara S. Lancho-Barrantes & Vicente P. Guerrero-Bote & Félix Moya-Anegón, 2013. "Citation increments between collaborating countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(3), pages 817-831, March.
    13. Éric Archambault & Étienne Vignola-Gagné & Grégoire Côté & Vincent Larivière & Yves Gingrasb, 2006. "Benchmarking scientific output in the social sciences and humanities: The limits of existing databases," Scientometrics, Springer;Akadémiai Kiadó, vol. 68(3), pages 329-342, September.
    14. Vincent Larivière & Yves Gingras & Éric Archambault, 2006. "Canadian collaboration networks: A comparative analysis of the natural sciences, social sciences and the humanities," Scientometrics, Springer;Akadémiai Kiadó, vol. 68(3), pages 519-533, September.
    15. Michel Zitt & Elise Bassecoulard & Yoshiko Okubo, 2000. "Shadows of the Past in International Cooperation: Collaboration Profiles of the Top Five Producers of Science," Scientometrics, Springer;Akadémiai Kiadó, vol. 47(3), pages 627-657, March.
    16. Jiann-wien Hsu & Ding-wei Huang, 2011. "Correlation between impact and collaboration," Scientometrics, Springer;Akadémiai Kiadó, vol. 86(2), pages 317-324, February.
    17. Hugo Confraria & Manuel Mira Godinho, 2015. "The impact of African science: a bibliometric analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(2), pages 1241-1268, February.
    18. David A. King, 2004. "The scientific impact of nations," Nature, Nature, vol. 430(6997), pages 311-316, July.
    19. Sumeer Gul & Nahida Tun Nisa & Tariq Ahmad Shah & Sangita Gupta & Asifa Jan & Suhail Ahmad, 2015. "Middle East: research productivity and performance across nations," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(2), pages 1157-1166, November.
    20. Vincent Larivière & Yves Gingras & Cassidy R. Sugimoto & Andrew Tsou, 2015. "Team size matters: Collaboration and scientific impact since 1900," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(7), pages 1323-1332, July.
    21. Thed N. Van Leeuwen & Henk F. Moed & Robert J. W. Tijssen & Martijn S. Visser & Anthony F. J. Van Raan, 2001. "Language biases in the coverage of the Science Citation Index and its consequencesfor international comparisons of national research performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 51(1), pages 335-346, April.
    22. Štěpán Jurajda & Stanislav Kozubek & Daniel Münich & Samuel Škoda, 2017. "Scientific publication performance in post-communist countries: still lagging far behind," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(1), pages 315-328, July.
    23. Donald deB. Beaver, 2004. "Does collaborative research have greater epistemic authority?," Scientometrics, Springer;Akadémiai Kiadó, vol. 60(3), pages 399-408, August.
    24. Zhou, Ping & Leydesdorff, Loet, 2006. "The emergence of China as a leading nation in science," Research Policy, Elsevier, vol. 35(1), pages 83-104, February.
    25. Dag W Aksnes, 2003. "Characteristics of highly cited papers," Research Evaluation, Oxford University Press, vol. 12(3), pages 159-170, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Vivek Kumar Singh & Prashasti Singh & Ashraf Uddin & Parveen Arora & Sujit Bhattacharya, 2022. "Exploring the relationship between journals indexed from a country and its research output: an empirical investigation," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 2933-2966, June.
    2. Bornmann, Lutz & Haunschild, Robin & Mutz, Rüdiger, 2020. "Should citations be field-normalized in evaluative bibliometrics? An empirical analysis based on propensity score matching," Journal of Informetrics, Elsevier, vol. 14(4).
    3. Abramo, Giovanni & D’Angelo, Ciriaco Andrea & Di Costa, Flavia, 2021. "On the relation between the degree of internationalization of cited and citing publications: A field level analysis, including and excluding self-citations," Journal of Informetrics, Elsevier, vol. 15(1).
    4. Ha, Taehyun, 2022. "An explainable artificial-intelligence-based approach to investigating factors that influence the citation of papers," Technological Forecasting and Social Change, Elsevier, vol. 184(C).
    5. Wang, Jue & Zhang, Liwei, 2018. "Proximal advantage in knowledge diffusion: The time dimension," Journal of Informetrics, Elsevier, vol. 12(3), pages 858-867.
    6. Abdelghani Maddi & Yves Gingras, 2021. "Gender Diversity In Research Teams And Citation Impact In Economics And Management," Journal of Economic Surveys, Wiley Blackwell, vol. 35(5), pages 1381-1404, December.
    7. Raf Vanderstraeten & Frédéric Vandermoere, 2021. "Inequalities in the growth of Web of Science," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(10), pages 8635-8651, October.
    8. Fan, Lingxu & Guo, Lei & Wang, Xinhua & Xu, Liancheng & Liu, Fangai, 2022. "Does the author’s collaboration mode lead to papers’ different citation impacts? An empirical analysis based on propensity score matching," Journal of Informetrics, Elsevier, vol. 16(4).
    9. Ibrahim Shehatta & Abdullah M. Al-Rubaish, 2019. "Impact of country self-citations on bibliometric indicators and ranking of most productive countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(2), pages 775-791, August.
    10. Bornmann, Lutz & Tekles, Alexander, 2021. "Convergent validity of several indicators measuring disruptiveness with milestone assignments to physics papers by experts," Journal of Informetrics, Elsevier, vol. 15(3).
    11. Diana Floegel & Kaitlin L. Costello, 2022. "Methods for a feminist technoscience of information practice: Design justice and speculative futurities," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 73(4), pages 625-634, April.
    12. Steven T. Joanis & Vivek H. Patil, 2022. "First-author gender differentials in business journal publishing: top journals versus the rest," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(2), pages 733-761, February.
    13. Svetla Baykoucheva, 2019. "Eugene Garfield’s Ideas and Legacy and Their Impact on the Culture of Research," Publications, MDPI, vol. 7(2), pages 1-12, June.
    14. Wei Quan & Philippe Mongeon & Maxime Sainte-Marie & Rongying Zhao & Vincent Larivière, 2019. "On the development of China’s leadership in international collaborations," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(2), pages 707-721, August.
    15. Bornmann, Lutz & Adams, Jonathan & Leydesdorff, Loet, 2018. "The negative effects of citing with a national orientation in terms of recognition: National and international citations in natural-sciences papers from Germany, the Netherlands, and the UK," Journal of Informetrics, Elsevier, vol. 12(3), pages 931-949.
    16. Balázs Győrffy & Andrea Magda Nagy & Péter Herman & Ádám Török, 2018. "Factors influencing the scientific performance of Momentum grant holders: an evaluation of the first 117 research groups," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(1), pages 409-426, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bar-Ilan, Judit, 2008. "Informetrics at the beginning of the 21st century—A review," Journal of Informetrics, Elsevier, vol. 2(1), pages 1-52.
    2. Mahdi Khelfaoui & Julien Larrègue & Vincent Larivière & Yves Gingras, 2020. "Measuring national self-referencing patterns of major science producers," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(2), pages 979-996, May.
    3. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    4. Zhenyue Zhao & Xuelian Pan & Weina Hua, 2021. "Comparative analysis of the research productivity, publication quality, and collaboration patterns of top ranked library and information science schools in China and the United States," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 931-950, February.
    5. Confraria, Hugo & Mira Godinho, Manuel & Wang, Lili, 2017. "Determinants of citation impact: A comparative analysis of the Global South versus the Global North," Research Policy, Elsevier, vol. 46(1), pages 265-279.
    6. Hamid Bouabid & Adèle Paul-Hus & Vincent Larivière, 2016. "Scientific collaboration and high-technology exchanges among BRICS and G-7 countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(3), pages 873-899, March.
    7. Dongqing Lyu & Kaile Gong & Xuanmin Ruan & Ying Cheng & Jiang Li, 2021. "Does research collaboration influence the “disruption” of articles? Evidence from neurosciences," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 287-303, January.
    8. Caroline S. Wagner & Xiaojing Cai & Satyam Mukherjee, 2020. "China’s scholarship shows atypical referencing patterns," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(3), pages 2457-2468, September.
    9. Pedro Albarrán & Juan A. Crespo & Ignacio Ortuño & Javier Ruiz-Castillo, 2010. "A comparison of the scientific performance of the U.S. and the European union at the turn of the 21st century," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(1), pages 329-344, October.
    10. Miguel-Angel Vera-Baceta & Michael Thelwall & Kayvan Kousha, 2019. "Web of Science and Scopus language coverage," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(3), pages 1803-1813, December.
    11. Zaida Chinchilla-Rodríguez & Cassidy R Sugimoto & Vincent Larivière, 2019. "Follow the leader: On the relationship between leadership and scholarly impact in international collaborations," PLOS ONE, Public Library of Science, vol. 14(6), pages 1-18, June.
    12. Elias Sanz-Casado & Carlos García-Zorita & Ronald Rousseau, 2016. "Using h-cores to study the most-cited articles of the twenty-first century," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(1), pages 243-261, July.
    13. Thomas Heinze & Arlette Jappe & David Pithan, 2019. "From North American hegemony to global competition for scientific leadership? Insights from the Nobel population," PLOS ONE, Public Library of Science, vol. 14(4), pages 1-14, April.
    14. Leydesdorff, Loet & Wagner, Caroline, 2009. "Macro-level indicators of the relations between research funding and research output," Journal of Informetrics, Elsevier, vol. 3(4), pages 353-362.
    15. Camil Demetrescu & Irene Finocchi & Andrea Ribichini & Marco Schaerf, 2022. "On computer science research and its temporal evolution," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(8), pages 4913-4938, August.
    16. Jo Royle & Louisa Coles & Dorothy Williams & Paul Evans, 2007. "Publishing in international journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 71(1), pages 59-86, April.
    17. Rodríguez-Navarro, Alonso & Brito, Ricardo, 2018. "Technological research in the EU is less efficient than the world average. EU research policy risks Europeans’ future," Journal of Informetrics, Elsevier, vol. 12(3), pages 718-731.
    18. Maziar Montazerian & Edgar Dutra Zanotto & Hellmut Eckert, 2019. "A new parameter for (normalized) evaluation of H-index: countries as a case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(3), pages 1065-1078, March.
    19. Gregory J Hather & Winston Haynes & Roger Higdon & Natali Kolker & Elizabeth A Stewart & Peter Arzberger & Patrick Chain & Dawn Field & B Robert Franza & Biaoyang Lin & Folker Meyer & Vural Ozdemir & , 2010. "The United States of America and Scientific Research," PLOS ONE, Public Library of Science, vol. 5(8), pages 1-9, August.
    20. Chan-Yuan Wong, 2019. "A century of scientific publication: towards a theorization of growth behavior and research-orientation," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(1), pages 357-377, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:114:y:2018:i:2:d:10.1007_s11192-017-2593-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.