IDEAS home Printed from https://ideas.repec.org/a/eee/soceco/v41y2012i5p495-499.html
   My bibliography  Save this article

On some flaws of university rankings: The example of the SCImago report

Author

Listed:
  • de Mesnard, Louis

Abstract

Using France as our main example, we show there is a much scope for improving the SCImago ranking. We detect problems of nomenclature, double affiliation, aggregation and of bias toward large public-funded research organizations. The output per scholar is more important than the output per organization. The examples we cite suggest that only detailed knowledge of the situation can help in addressing the issue and take us beyond any automatic reading of the metadata.

Suggested Citation

  • de Mesnard, Louis, 2012. "On some flaws of university rankings: The example of the SCImago report," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 41(5), pages 495-499.
    • Handle: RePEc:eee:soceco:v:41:y:2012:i:5:p:495-499
    DOI: 10.1016/j.socec.2012.04.011
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1053535712000315
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.socec.2012.04.011?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Loet Leydesdorff & Ping Zhou, 2005. "Are the contributions of China and Korea upsetting the world system of science?," Scientometrics, Springer;Akadémiai Kiadó, vol. 63(3), pages 617-630, June.
    2. Aparna Basu, 2010. "Does a country’s scientific ‘productivity’ depend critically on the number of country journals indexed?," Scientometrics, Springer;Akadémiai Kiadó, vol. 82(3), pages 507-516, March.
    3. Cyrenne, Philippe & Grant, Hugh, 2009. "University decision making and prestige: An empirical study," Economics of Education Review, Elsevier, vol. 28(2), pages 237-248, April.
    4. González-Pereira, Borja & Guerrero-Bote, Vicente P. & Moya-Anegón, Félix, 2010. "A new approach to the metric of journals’ scientific prestige: The SJR indicator," Journal of Informetrics, Elsevier, vol. 4(3), pages 379-391.
    5. Félix Moya-Anegón & Zaida Chinchilla-Rodríguez & Benjamín Vargas-Quesada & Elena Corera-Álvarez & Francisco José Muñoz-Fernández & Antonio González-Molina & Victor Herrero-Solana, 2007. "Coverage analysis of Scopus: A journal metric approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 73(1), pages 53-78, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Edmilson J. T. Manganote & Peter A. Schulz & Carlos Henrique Brito Cruz, 2016. "Effect of high energy physics large collaborations on higher education institutions citations and rankings," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 813-826, November.
    2. Romo-Fernández, Luz M. & López-Pujalte, Cristina & Guerrero Bote, Vicente P. & Moya-Anegón, Félix, 2011. "Analysis of Europe’s scientific production on renewable energies," Renewable Energy, Elsevier, vol. 36(9), pages 2529-2537.
    3. Maja Jokić & Andrea Mervar & Stjepan Mateljan, 2018. "Scientific potential of European fully open access journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(3), pages 1373-1394, March.
    4. Zaida Chinchilla-Rodríguez & Grisel Zacca-González & Benjamín Vargas-Quesada & Félix Moya-Anegón, 2015. "Latin American scientific output in Public Health: combined analysis using bibliometric, socioeconomic and health indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(1), pages 609-628, January.
    5. A. Abrizah & A. N. Zainab & K. Kiran & R. G. Raj, 2013. "LIS journals scientific impact and subject categorization: a comparison between Web of Science and Scopus," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(2), pages 721-740, February.
    6. Zaida Chinchilla-Rodríguez & Ricardo Arencibia-Jorge & Félix Moya-Anegón & Elena Corera-Álvarez, 2015. "Somes patterns of Cuban scientific publication in Scopus: the current situation and challenges," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(3), pages 779-794, June.
    7. Guerrero-Bote, Vicente P. & Moya-Anegón, Félix, 2012. "A further step forward in measuring journals’ scientific prestige: The SJR2 indicator," Journal of Informetrics, Elsevier, vol. 6(4), pages 674-688.
    8. Ekaterina Dyachenko, 2013. "Internationalization of academic journals: is there still a gap between social and natural sciences?," HSE Working papers WP BRP 28/HUM/2013, National Research University Higher School of Economics.
    9. Ricardo Arencibia-Jorge & Felix Moya-Anegón, 2010. "Challenges in the study of Cuban scientific output," Scientometrics, Springer;Akadémiai Kiadó, vol. 83(3), pages 723-737, June.
    10. Said Fathalla & Sahar Vahdati & Christoph Lange & Sören Auer, 2020. "Scholarly event characteristics in four fields of science: a metrics-based analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(2), pages 677-705, May.
    11. Mira Fischer & Patrick Kampkötter, 2017. "Effects of German Universities' Excellence Initiative on Ability Sorting of Students and Perceptions of Educational Quality," Journal of Institutional and Theoretical Economics (JITE), Mohr Siebeck, Tübingen, vol. 173(4), pages 662-687, December.
    12. Tuan V. Nguyen & Ly T. Pham, 2011. "Scientific output and its relationship to knowledge economy: an analysis of ASEAN countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 89(1), pages 107-117, October.
    13. Walters, William H., 2017. "Do subjective journal ratings represent whole journals or typical articles? Unweighted or weighted citation impact?," Journal of Informetrics, Elsevier, vol. 11(3), pages 730-744.
    14. J. A. García & Rosa Rodriguez-Sánchez & J. Fdez-Valdivia & J. Martinez-Baena, 2012. "On first quartile journals which are not of highest impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 90(3), pages 925-943, March.
    15. Teja Koler-Povh & Primož Južnič & Goran Turk, 2014. "Impact of open access on citation of scholarly publications in the field of civil engineering," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 1033-1045, February.
    16. Dejian Yu & Wanru Wang & Shuai Zhang & Wenyu Zhang & Rongyu Liu, 2017. "A multiple-link, mutually reinforced journal-ranking model to measure the prestige of journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(1), pages 521-542, April.
    17. Yves Gingras & Mahdi Khelfaoui, 2018. "Assessing the effect of the United States’ “citation advantage” on other countries’ scientific impact as measured in the Web of Science (WoS) database," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(2), pages 517-532, February.
    18. Jo Royle & Louisa Coles & Dorothy Williams & Paul Evans, 2007. "Publishing in international journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 71(1), pages 59-86, April.
    19. Thor, Andreas & Marx, Werner & Leydesdorff, Loet & Bornmann, Lutz, 2016. "Introducing CitedReferencesExplorer (CRExplorer): A program for reference publication year spectroscopy with cited references standardization," Journal of Informetrics, Elsevier, vol. 10(2), pages 503-515.
    20. Antonio Fernández-Cano & Manuel Torralbo & Mónica Vallejo, 2012. "Time series of scientific growth in Spanish doctoral theses (1848–2009)," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(1), pages 15-36, April.

    More about this item

    Keywords

    SCImago; SJR; University ranking; Aggregation; Affiliation;
    All these keywords.

    JEL classification:

    • A14 - General Economics and Teaching - - General Economics - - - Sociology of Economics

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:soceco:v:41:y:2012:i:5:p:495-499. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/620175 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.