IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v128y2023i10d10.1007_s11192-023-04801-7.html
   My bibliography  Save this article

Beyond views, productivity, and citations: measuring geopolitical differences of scientific impact in communication research

Author

Listed:
  • János József Tóth

    (National University of Public Service
    Institute of Hungarian Research)

  • Gergő Háló

    (National University of Public Service)

  • Manuel Goyanes

    (Universidad Carlos III de Madrid)

Abstract

Scientometric analyses applying critical sociological frameworks have previously shown that high-prestige research output—with regards to both quantity and impact—is typically clustered in a few core countries and world regions, indicating uneven power relations and systematic biases within global academia. Although citation count is a common formula in these analyses, only a handful of studies investigated altmetrics (impact measures beyond citation-based metrics) in communication science. In this paper, we explore geopolitical biases of impact amongst the most productive scholars in the field of communication from 11 countries and 3 world regions. Drawing on SCOPUS data, we test three formulas that measure scholarly performance (citations per document; views per document; and citations per view) to investigate how geographical location affects the impact of scholars. Our results indicate a strong US-dominance with regard to citation-based impact, emphasizing a further need for de-Westernization within the field. Moreover, the analysis of altmetric formulas revealed that research published by Eastern European and Spanish scholars, although accessed similarly or even more often than American or Western European publications, is less cited than those. Country-level comparisons are also discussed.

Suggested Citation

  • János József Tóth & Gergő Háló & Manuel Goyanes, 2023. "Beyond views, productivity, and citations: measuring geopolitical differences of scientific impact in communication research," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(10), pages 5705-5729, October.
  • Handle: RePEc:spr:scient:v:128:y:2023:i:10:d:10.1007_s11192-023-04801-7
    DOI: 10.1007/s11192-023-04801-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-023-04801-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11192-023-04801-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ling-Chu Lee & Pin-Hua Lin & Yun-Wen Chuang & Yi-Yang Lee, 2011. "Research output and economic productivity: a Granger causality test," Scientometrics, Springer;Akadémiai Kiadó, vol. 89(2), pages 465-478, November.
    2. Leydesdorff, Loet & Wagner, Caroline S. & Bornmann, Lutz, 2014. "The European Union, China, and the United States in the top-1% and top-10% layers of most-frequently cited publications: Competition and collaborations," Journal of Informetrics, Elsevier, vol. 8(3), pages 606-617.
    3. Sonia R. Zanotto & Cristina Haeffner & Jorge A. Guimarães, 2016. "Unbalanced international collaboration affects adversely the usefulness of countries’ scientific output as well as their technological and social impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 1789-1814, December.
    4. Almeida, J.A.S. & Pais, A.A.C.C. & Formosinho, S.J., 2009. "Science indicators and science patterns in Europe," Journal of Informetrics, Elsevier, vol. 3(2), pages 134-142.
    5. Christian Zimmermann, 2013. "Academic Rankings with RePEc," Econometrics, MDPI, vol. 1(3), pages 1-32, December.
    6. Johan Bollen & Herbert Van de Sompel & Aric Hagberg & Ryan Chute, 2009. "A Principal Component Analysis of 39 Scientific Impact Measures," PLOS ONE, Public Library of Science, vol. 4(6), pages 1-11, June.
    7. Richard Van Noorden, 2010. "Cities: Building the best cities for science," Nature, Nature, vol. 467(7318), pages 906-908, October.
    8. Mike Thelwall, 2021. "Measuring Societal Impacts Of Research With Altmetrics? Common Problems And Mistakes," Journal of Economic Surveys, Wiley Blackwell, vol. 35(5), pages 1302-1314, December.
    9. Francis Narin & Mark P. Carpenter, 1975. "National publication and citation comparisons," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 26(2), pages 80-93, March.
    10. Cassidy R. Sugimoto & Sam Work & Vincent Larivière & Stefanie Haustein, 2017. "Scholarly use of social media and altmetrics: A review of the literature," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(9), pages 2037-2062, September.
    11. Bornmann, Lutz & Waltman, Ludo, 2011. "The detection of “hot regions” in the geography of science—A visualization approach by using density maps," Journal of Informetrics, Elsevier, vol. 5(4), pages 547-553.
    12. Marton Demeter & Tamas Toth, 2020. "The world-systemic network of global elite sociology: the western male monoculture at faculties of the top one-hundred sociology departments of the world," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(3), pages 2469-2495, September.
    13. Rosalind S. Hunter & Andrew J. Oswald & Bruce G. Charlton, 2009. "The Elite Brain Drain," Economic Journal, Royal Economic Society, vol. 119(538), pages 231-251, June.
    14. Rafael Repiso & Antonio Castillo-Esparcia & Daniel Torres-Salinas, 2019. "Altmetrics, alternative indicators for Web of Science Communication studies journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 941-958, May.
    15. Harzing, Anne-Wil & Giroud, Axèle, 2014. "The competitive advantage of nations: An application to academia," Journal of Informetrics, Elsevier, vol. 8(1), pages 29-42.
    16. Ulrich Schmoch & Torben Schubert, 2008. "Are international co-publications an indicator for quality of scientific research?," Scientometrics, Springer;Akadémiai Kiadó, vol. 74(3), pages 361-377, March.
    17. Teemu Makkonen & Timo Mitze, 2016. "Scientific collaboration between ‘old’ and ‘new’ member states: Did joining the European Union make a difference?," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(3), pages 1193-1215, March.
    18. Manuel Goyanes & Márton Demeter & Zicheng Cheng & Homero Gil Zúñiga, 2022. "Measuring publication diversity among the most productive scholars: how research trajectories differ in communication, psychology, and political science," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3661-3682, June.
    19. Li, Jiang & Qiao, Lili & Li, Wenyuze & Jin, Yidan, 2014. "Chinese-language articles are not biased in citations: Evidences from Chinese-English bilingual journals in Scopus and Web of Science," Journal of Informetrics, Elsevier, vol. 8(4), pages 912-916.
    20. Éric Archambault & Étienne Vignola-Gagné & Grégoire Côté & Vincent Larivière & Yves Gingrasb, 2006. "Benchmarking scientific output in the social sciences and humanities: The limits of existing databases," Scientometrics, Springer;Akadémiai Kiadó, vol. 68(3), pages 329-342, September.
    21. Robin Cowan & Giulia Rossello, 2018. "Emergent structures in faculty hiring networks, and the effects of mobility on academic performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(1), pages 527-562, October.
    22. Manuel Goyanes & Luis de-Marcos, 2020. "Academic influence and invisible colleges through editorial board interlocking in communication sciences: a social network analysis of leading journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(2), pages 791-811, May.
    23. Mike Thelwall & Kayvan Kousha, 2015. "ResearchGate: Disseminating, communicating, and measuring Scholarship?," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(5), pages 876-889, May.
    24. Leydesdorff, Loet & Wagner, Caroline, 2009. "Macro-level indicators of the relations between research funding and research output," Journal of Informetrics, Elsevier, vol. 3(4), pages 353-362.
    25. Marton Demeter & Agnes Jele & Zsolt Balázs Major, 2022. "The model of maximum productivity for research universities SciVal author ranks, productivity, university rankings, and their implications," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(8), pages 4335-4361, August.
    26. Anthony Breitzman, 2021. "The relationship between web usage and citation statistics for electronics and information technology articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(3), pages 2085-2105, March.
    27. Frenken, Koen & Hardeman, Sjoerd & Hoekman, Jarno, 2009. "Spatial scientometrics: Towards a cumulative research program," Journal of Informetrics, Elsevier, vol. 3(3), pages 222-232.
    28. Ehsan Mohammadi & Mike Thelwall, 2014. "Mendeley readership altmetrics for the social sciences and humanities: Research evaluation and knowledge flows," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 65(8), pages 1627-1638, August.
    29. Ehsan Mohammadi & Mike Thelwall & Stefanie Haustein & Vincent Larivière, 2015. "Who reads research articles? An altmetrics analysis of Mendeley user categories," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(9), pages 1832-1846, September.
    30. Henk F. Moed & Gali Halevi, 2016. "On full text download and citation distributions in scientific-scholarly journals," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(2), pages 412-431, February.
    31. Juan Gorraiz & Christian Gumpenberger & Christian Schlögl, 2014. "Usage versus citation behaviours in four subject areas," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(2), pages 1077-1095, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Csomós, György, 2018. "Reprint of “A spatial scientometric analysis of the publication output of cities worldwide”," Journal of Informetrics, Elsevier, vol. 12(2), pages 547-566.
    2. Martin Grančay & Tomáš Dudáš & Ladislav Mura, 2022. "Revealed comparative advantages in academic publishing of “old” and “new” European Union Member States 1998–2018," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(3), pages 1247-1271, March.
    3. Mojisola Erdt & Htet Htet Aung & Ashley Sara Aw & Charlie Rapple & Yin-Leng Theng, 2017. "Analysing researchers’ outreach efforts and the association with publication metrics: A case study of Kudos," PLOS ONE, Public Library of Science, vol. 12(8), pages 1-25, August.
    4. Fairclough, Ruth & Thelwall, Mike, 2015. "National research impact indicators from Mendeley readers," Journal of Informetrics, Elsevier, vol. 9(4), pages 845-859.
    5. Marton Demeter, 2022. "Development Studies in the World System of Global Knowledge Production: A Critical Empirical Analysis," Progress in Development Studies, , vol. 22(3), pages 239-256, July.
    6. Bornmann, Lutz & Stefaner, Moritz & de Moya Anegón, Felix & Mutz, Rüdiger, 2014. "What is the effect of country-specific characteristics on the research performance of scientific institutions? Using multi-level statistical models to rank and map universities and research-focused in," Journal of Informetrics, Elsevier, vol. 8(3), pages 581-593.
    7. Sergio Copiello, 2020. "Other than detecting impact in advance, alternative metrics could act as early warning signs of retractions: tentative findings of a study into the papers retracted by PLoS ONE," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2449-2469, December.
    8. Ortega, José Luis, 2018. "The life cycle of altmetric impact: A longitudinal study of six metrics from PlumX," Journal of Informetrics, Elsevier, vol. 12(3), pages 579-589.
    9. Martín-Martín, Alberto & Orduna-Malea, Enrique & Delgado López-Cózar, Emilio, 2018. "Author-level metrics in the new academic profile platforms: The online behaviour of the Bibliometrics community," Journal of Informetrics, Elsevier, vol. 12(2), pages 494-509.
    10. Hu, Beibei & Ding, Yang & Dong, Xianlei & Bu, Yi & Ding, Ying, 2021. "On the relationship between download and citation counts: An introduction of Granger-causality inference," Journal of Informetrics, Elsevier, vol. 15(2).
    11. Anthony Breitzman, 2021. "The relationship between web usage and citation statistics for electronics and information technology articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(3), pages 2085-2105, March.
    12. Amalia Mas-Bleda & Mike Thelwall, 2016. "Can alternative indicators overcome language biases in citation counts? A comparison of Spanish and UK research," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 2007-2030, December.
    13. Maryam Moshtagh & Tahereh Jowkar & Maryam Yaghtin & Hajar Sotudeh, 2023. "The moderating effect of altmetrics on the correlations between single and multi-faceted university ranking systems: the case of THE and QS vs. Nature Index and Leiden," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(1), pages 761-781, January.
    14. Thelwall, Mike, 2017. "Three practical field normalised alternative indicator formulae for research evaluation," Journal of Informetrics, Elsevier, vol. 11(1), pages 128-151.
    15. Abramo, Giovanni & D'Angelo, Ciriaco Andrea & Di Costa, Flavia, 2022. "Revealing the scientific comparative advantage of nations: Common and distinctive features," Journal of Informetrics, Elsevier, vol. 16(1).
    16. Mojisola Erdt & Aarthy Nagarajan & Sei-Ching Joanna Sin & Yin-Leng Theng, 2016. "Altmetrics: an analysis of the state-of-the-art in measuring research impact on social media," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 1117-1166, November.
    17. Abramo, Giovanni & D’Angelo, Ciriaco Andrea, 2015. "A methodology to compute the territorial productivity of scientists: The case of Italy," Journal of Informetrics, Elsevier, vol. 9(4), pages 675-685.
    18. Barbara S. Lancho-Barrantes & Hector G. Ceballos-Cancino & Francisco J. Cantu-Ortiz, 2021. "Comparing the efficiency of countries to assimilate and apply research investment," Quality & Quantity: International Journal of Methodology, Springer, vol. 55(4), pages 1347-1369, August.
    19. Yang, Siluo & Zheng, Mengxue & Yu, Yonghao & Wolfram, Dietmar, 2021. "Are Altmetric.com scores effective for research impact evaluation in the social sciences and humanities?," Journal of Informetrics, Elsevier, vol. 15(1).
    20. Hyeonchae Yang & Woo-Sung Jung, 2015. "A strategic management approach for Korean public research institutes based on bibliometric investigation," Quality & Quantity: International Journal of Methodology, Springer, vol. 49(4), pages 1437-1464, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:128:y:2023:i:10:d:10.1007_s11192-023-04801-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.