IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v56y2003i2d10.1023_a1021923329277.html
   My bibliography  Save this article

Correcting glasses help fair comparisons in international science landscape: Country indicators as a function of ISI database delineation

Author

Listed:
  • Michel Zitt

    (Observatoire des Sciences et des Techniques (OST))

  • Suzy Ramanana-Rahary

    (Observatoire des Sciences et des Techniques (OST))

  • Elise Bassecoulard

    (Observatoire des Sciences et des Techniques (OST))

Abstract

The increasing use of bibliometric indicators in science policy calls for a reassessment of their robustness and limits. The perimeter of journal inclusion within ISI databases will determine variations in the classic bibliometric indicators used for international comparison, such as world shares of publications or relative impacts. We show in this article that when this perimeter is adjusted using a natural criterion for inclusion of journals, the journal impact, the variation of the most common country indicators (publication and citation shares; relative impacts) with the perimeter chosen depends on two phenomena. The first one is a bibliometric regularity rooted in the main features of competition in the open space of science, that can be modeled by bibliometric laws, the parameters of which are “coverage-independent” indicators. But this regularity is obscured for many countries by a second phenomenon, the presence of a sub-population of journals that does not reflect the same international openness, the nationally-oriented journals. As a result indicators based on standard SCI or SCISearch perimeters are jeopardized to a certain extent by this sub-population which creates large irregularities. These irregularities often lead to an over-estimation of share and an under-estimation of the impact, for countries with national editorial tradition, while the impact of a few mainstream countries arguably benefits from the presence of this sub-population.

Suggested Citation

  • Michel Zitt & Suzy Ramanana-Rahary & Elise Bassecoulard, 2003. "Correcting glasses help fair comparisons in international science landscape: Country indicators as a function of ISI database delineation," Scientometrics, Springer;Akadémiai Kiadó, vol. 56(2), pages 259-282, February.
    • Handle: RePEc:spr:scient:v:56:y:2003:i:2:d:10.1023_a:1021923329277
    DOI: 10.1023/A:1021923329277
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1023/A:1021923329277
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1023/A:1021923329277?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. A. Bookstein, 1990. "Informetric distributions, part II: Resilience to ambiguity," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 41(5), pages 376-386, July.
    2. Rémi Barr, 2001. "The Agora model of innovation systems: S&T indicators for a democratic knowledge society," Research Evaluation, Oxford University Press, vol. 10(1), pages 13-18, April.
    3. Katz, J. Sylvan, 1999. "The self-similar science system1," Research Policy, Elsevier, vol. 28(5), pages 501-517, June.
    4. Poovanalingam Murugesan & Michael J. Moravcsik, 1978. "Variation of the nature of citation measures with journals and scientific specialties," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 29(3), pages 141-147, May.
    5. M. Bonitz & E. Bruckner & Andrea Scharnhorst, 1999. "The matthew index—Concentration patterns and Matthew core journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 44(3), pages 361-378, March.
    6. M. Zitt & E. Bassecoulard, 1999. "Internationalization of communication a view on the evolution of scientific journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 46(3), pages 669-685, November.
    7. Derek De Solla Price, 1976. "A general theory of bibliometric and other cumulative advantage processes," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 27(5), pages 292-306, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Abdulkader A. Murad & Dimitar T. Tomov, 2012. "Institutionalization and internationalization of research on the applications of the geographical information systems in health planning," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(1), pages 143-158, April.
    2. Gisleine Carmo & Luiz Flávio Felizardo & Valderí Castro Alcântara & Cristiane Aparecida Silva & José Willer Prado, 2023. "The impact of Jürgen Habermas’s scientific production: a scientometric review," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(3), pages 1853-1875, March.
    3. M. Zitt, 2011. "Behind citing-side normalization of citations: some properties of the journal impact factor," Scientometrics, Springer;Akadémiai Kiadó, vol. 89(1), pages 329-344, October.
    4. Ricardo Arencibia-Jorge & Felix Moya-Anegón, 2010. "Challenges in the study of Cuban scientific output," Scientometrics, Springer;Akadémiai Kiadó, vol. 83(3), pages 723-737, June.
    5. Ekaterina Dyachenko, 2013. "Internationalization of academic journals: is there still a gap between social and natural sciences?," HSE Working papers WP BRP 28/HUM/2013, National Research University Higher School of Economics.
    6. Ludo Waltman & Nees Jan Eck, 2013. "Source normalized indicators of citation impact: an overview of different approaches and an empirical comparison," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(3), pages 699-716, September.
    7. Michel Zitt & Suzy Ramanana-Rahary & Elise Bassecoulard & Françoise Laville, 2003. "Potential science-technology spillovers in regions: An insight on geographic co-location of knowledge activities in the EU," Scientometrics, Springer;Akadémiai Kiadó, vol. 57(2), pages 295-320, June.
    8. Zaida Chinchilla-Rodríguez & Ricardo Arencibia-Jorge & Félix Moya-Anegón & Elena Corera-Álvarez, 2015. "Somes patterns of Cuban scientific publication in Scopus: the current situation and challenges," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(3), pages 779-794, June.
    9. Ekaterina L. Dyachenko, 2014. "Internationalization of academic journals: Is there still a gap between social and natural sciences?," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(1), pages 241-255, October.
    10. Michel Zitt, 2012. "The journal impact factor: angel, devil, or scapegoat? A comment on J.K. Vanclay’s article 2011," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 485-503, August.
    11. Hamdi A. Al-Jamimi & Galal M. BinMakhashen & Lutz Bornmann, 2022. "Use of bibliometrics for research evaluation in emerging markets economies: a review and discussion of bibliometric indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(10), pages 5879-5930, October.
    12. Vladimir Pislyakov & Ekaterina Dyachenko, 2010. "Citation expectations: are they realized? Study of the Matthew index for Russian papers published abroad," Scientometrics, Springer;Akadémiai Kiadó, vol. 83(3), pages 739-749, June.
    13. Michel Zitt & Suzy Ramanana-Rahary & Elise Bassecoulard, 2003. "Bridging citation and reference distributions: Part I - The referencing-structure function and its application to co-citation and co-item studies," Scientometrics, Springer;Akadémiai Kiadó, vol. 57(1), pages 93-118, May.
    14. Mladen Andreis & Maja Jokić, 2008. "An impact of Croatian journals measured by citation analysis from SCI-expanded database in time span 1975–2001," Scientometrics, Springer;Akadémiai Kiadó, vol. 75(2), pages 263-288, May.
    15. Domingo Docampo & Lawrence Cram, 2017. "Academic performance and institutional resources: a cross-country analysis of research universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 739-764, February.
    16. Peder Olesen Larsen & Markus Ins, 2010. "The rate of growth in scientific publication and the decline in coverage provided by Science Citation Index," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(3), pages 575-603, September.
    17. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    18. Bonaccorsi, Andrea & Vargas, Juan, 2010. "Proliferation dynamics in new sciences," Research Policy, Elsevier, vol. 39(8), pages 1034-1050, October.
    19. Robert D. Shelton & Patricia Foland & Roman Gorelskyy, 2009. "Do new SCI journals have a different national bias?," Scientometrics, Springer;Akadémiai Kiadó, vol. 79(2), pages 351-363, May.
    20. Ole Ellegaard & Johan A. Wallin, 2015. "The bibliometric analysis of scholarly production: How great is the impact?," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(3), pages 1809-1831, December.
    21. Dario Sambunjak & Ana Ivaniš & Ana Marušić & Matko Marušić, 2008. "Representation of journals from five neighboring European countries in the Journal Citation Reports," Scientometrics, Springer;Akadémiai Kiadó, vol. 76(2), pages 261-271, August.
    22. Suzy Ramanana-Rahary & Michel Zitt & Ronald Rousseau, 2009. "Aggregation properties of relative impact and other classical indicators: Convexity issues and the Yule-Simpson paradox," Scientometrics, Springer;Akadémiai Kiadó, vol. 79(2), pages 311-327, May.
    23. Bar-Ilan, Judit, 2008. "Informetrics at the beginning of the 21st century—A review," Journal of Informetrics, Elsevier, vol. 2(1), pages 1-52.
    24. Waltman, Ludo & van Eck, Nees Jan, 2013. "A systematic empirical comparison of different approaches for normalizing citation impact indicators," Journal of Informetrics, Elsevier, vol. 7(4), pages 833-849.
    25. Maria Cláudia Cabrini Grácio & Ely Francina Tannuri Oliveira & Zaida Chinchilla-Rodríguez & Henk F. Moed, 2020. "Does corresponding authorship influence scientific impact in collaboration: Brazilian institutions as a case of study," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1349-1369, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guillermo Armando Ronda-Pupo, 2017. "The effect of document types and sizes on the scaling relationship between citations and co-authorship patterns in management journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(3), pages 1191-1207, March.
    2. Guillermo Armando Ronda-Pupo, 2020. "The performance of Latin American research on economics & business," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(1), pages 573-590, January.
    3. Tol, Richard S.J., 2013. "The Matthew effect for cohorts of economists," Journal of Informetrics, Elsevier, vol. 7(2), pages 522-527.
    4. Guillermo Armando Ronda-Pupo & Thong Pham, 2018. "The evolutions of the rich get richer and the fit get richer phenomena in scholarly networks: the case of the strategic management journal," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(1), pages 363-383, July.
    5. Guillermo Armando Ronda-Pupo & J. Sylvan Katz, 2018. "The power law relationship between citation impact and multi-authorship patterns in articles in Information Science & Library Science journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(3), pages 919-932, March.
    6. Michel Zitt, 2012. "The journal impact factor: angel, devil, or scapegoat? A comment on J.K. Vanclay’s article 2011," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 485-503, August.
    7. Hajar Sotudeh & Abbas Horri, 2009. "Countries positioning in open access journals system: An investigation of citation distribution patterns," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(1), pages 7-31, October.
    8. Rafael Bailón-Moreno & Encarnación Jurado-Alameda & Rosario Ruiz-Baños & Jean Pierre Courtial & Evaristo Jiménez-Contreras, 2007. "The pulsing structure of science: Ortega y Gasset, Saint Matthew, fractality and transfractality," Scientometrics, Springer;Akadémiai Kiadó, vol. 71(1), pages 3-24, April.
    9. Fenner, Trevor & Levene, Mark & Loizou, George, 2010. "Predicting the long tail of book sales: Unearthing the power-law exponent," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 389(12), pages 2416-2421.
    10. Lemarchand, Guillermo A., 2012. "The long-term dynamics of co-authorship scientific networks: Iberoamerican countries (1973–2010)," Research Policy, Elsevier, vol. 41(2), pages 291-305.
    11. Sarah Shandera & Jes L Matsick & David R Hunter & Louis Leblond, 2021. "RASE: Modeling cumulative disadvantage due to marginalized group status in academia," PLOS ONE, Public Library of Science, vol. 16(12), pages 1-20, December.
    12. Smith, Dallas & Webb, Benjamin, 2019. "Hidden symmetries in real and theoretical networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 514(C), pages 855-867.
    13. Thor, Andreas & Marx, Werner & Leydesdorff, Loet & Bornmann, Lutz, 2016. "Introducing CitedReferencesExplorer (CRExplorer): A program for reference publication year spectroscopy with cited references standardization," Journal of Informetrics, Elsevier, vol. 10(2), pages 503-515.
    14. Henk F. Moed, 2002. "Measuring China"s research performance using the Science Citation Index," Scientometrics, Springer;Akadémiai Kiadó, vol. 53(3), pages 281-296, March.
    15. Perc, Matjaž, 2010. "Zipf’s law and log-normal distributions in measures of scientific output across fields and institutions: 40 years of Slovenia’s research as an example," Journal of Informetrics, Elsevier, vol. 4(3), pages 358-364.
    16. Manfred Bonitz & Andrea Scharnhorst, 2001. "Competition in science and the Matthew core journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 51(1), pages 37-54, April.
    17. Battiston, Pietro & Sacco, Pier Luigi & Stanca, Luca, 2022. "Cover effects on citations uncovered: Evidence from Nature," Journal of Informetrics, Elsevier, vol. 16(2).
    18. Leporia, Benedetto & Geuna, Aldo & Mira, Antonietta, 2018. "Scientific Output of US and European Universities Scales Super-linearly with Resources," Department of Economics and Statistics Cognetti de Martiis LEI & BRICK - Laboratory of Economics of Innovation "Franco Momigliano", Bureau of Research in Innovation, Complexity and Knowledge, Collegio 201806, University of Turin.
    19. V'it Mach'av{c}ek, 2021. "Globalization of Scientific Communication: Evidence from authors in academic journals by country of origin," Papers 2112.02672, arXiv.org.
    20. Loet Leydesdorff, 2015. "Can intellectual processes in the sciences also be simulated? The anticipation and visualization of possible future states," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(3), pages 2197-2214, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:56:y:2003:i:2:d:10.1023_a:1021923329277. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.