IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v130y2025i3d10.1007_s11192-025-05269-3.html
   My bibliography  Save this article

Scientometric indicators in research evaluation and research misconduct: analysis of the Russian university excellence initiative

Author

Listed:
  • Andrey Lovakov

    (German Centre for Higher Education Research and Science Studies (DZHW))

  • Jaime A. Teixeira da Silva

    (Independent Researcher)

Abstract

This study aimed to examine the impact of the Russian University Excellence Initiative (RUEI), also known as Project 5–100, on research misconduct in Russian higher education. Launched in 2013, the RUEI incentivized universities to increase the number of publications in internationally indexed journals. The analysis compares the prevalence of retracted publications—as a proxy for research misconduct—between universities that participated in the RUEI and a control group of universities that did not. A total of 2621 retracted papers affiliated with at least one Russian institution were identified. Of which 203 papers were indexed in Web of Science (WoS) and/or Scopus databases. The results showed that RUEI universities had a significantly higher number of retracted publications in WoS- and Scopus-indexed journals, suggesting that pressure to meet quantitative scientometric indicators may have encouraged unethical research practices and research misconduct. In addition, different reasons for retraction were found between publications indexed and not indexed in WoS and/or Scopus databases. These findings suggest that the direct and irresponsible use of scientometric indicators as performance measures may have unintended negative consequences that may undermine research integrity.

Suggested Citation

  • Andrey Lovakov & Jaime A. Teixeira da Silva, 2025. "Scientometric indicators in research evaluation and research misconduct: analysis of the Russian university excellence initiative," Scientometrics, Springer;Akadémiai Kiadó, vol. 130(3), pages 1813-1829, March.
    • Handle: RePEc:spr:scient:v:130:y:2025:i:3:d:10.1007_s11192-025-05269-3
    DOI: 10.1007/s11192-025-05269-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-025-05269-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-025-05269-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Anna Abalkina & Alexander Libman, 2020. "The real costs of plagiarism: Russian governors, plagiarized PhD theses, and infrastructure in Russian regions," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2793-2820, December.
    2. Tatiana Marina & Ivan Sterligov, 2021. "Prevalence of potentially predatory publishing in Scopus on the country level," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 5019-5077, June.
    3. Hanna Hottenrott & Michael E. Rose & Cornelia Lawson, 2021. "The rise of multiple institutional affiliations in academia," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 72(8), pages 1039-1058, August.
    4. Matveeva, Nataliya & Sterligov, Ivan & Yudkevich, Maria, 2021. "The effect of Russian University Excellence Initiative on publications and collaboration patterns," Journal of Informetrics, Elsevier, vol. 15(1).
    5. Andrey Lovakov & Anna Panova & Ivan Sterligov & Maria Yudkevich, 2021. "Does government support of a few leading universities have a broader impact on the higher education system? Evaluation of the Russian University Excellence Initiative [The Costs and Benefits of Wor," Research Evaluation, Oxford University Press, vol. 30(3), pages 240-255.
    6. Andrey Lovakov & Anna Panova & Maria Yudkevich, 2022. "Global visibility of nationally published research output: the case of the post-Soviet region," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(5), pages 2643-2659, May.
    7. Tatiana Marina & Ivan Sterligov, 2021. "Correction to: Prevalence of potentially predatory publishing in Scopus on the country level," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 5079-5079, June.
    8. Nataliya Matveeva & Anuška Ferligoj, 2020. "Scientific collaboration in Russian universities before and after the excellence initiative Project 5-100," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(3), pages 2383-2407, September.
    9. Hladchenko, Myroslava & Moed, Henk F., 2021. "The effect of publication traditions and requirements in research assessment and funding policies upon the use of national journals in 28 post-socialist countries," Journal of Informetrics, Elsevier, vol. 15(4).
    10. Jelena Brankovic & Leopold Ringel & Tobias Werron, 2022. "Spreading the gospel: Legitimating university rankings as boundary work," Research Evaluation, Oxford University Press, vol. 31(4), pages 463-474.
    11. Hicks, Diana, 2012. "Performance-based university research funding systems," Research Policy, Elsevier, vol. 41(2), pages 251-261.
    12. Andrey Lovakov & Maia Chankseliani & Anna Panova, 2022. "Universities vs. research institutes? Overcoming the Soviet legacy of higher education and research," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(11), pages 6293-6313, November.
    13. I. G. Dezhina, 2020. "Research Policy in Leading Russian Universities: Eff ects of ‘New Managerialism’," University Management: Practice and Analysis, Federal State Autonomous Educational Institution of Higher Education «Ural Federal University named after the first President of Russia B.N.Yeltsin»; Non-Commercial Partnership “University Management: Practice and, vol. 24(3).
    14. Andrey E. Guskov & Denis V. Kosyakov & Irina V. Selivanova, 2018. "Boosting research productivity in top Russian universities: the circumstances of breakthrough," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(2), pages 1053-1080, November.
    15. Chekhovich, Yury V. & Khazov, Andrey V., 2022. "Analysis of duplicated publications in Russian journals," Journal of Informetrics, Elsevier, vol. 16(1).
    16. Qin Zhang & Juneman Abraham & Hui-Zhen Fu, 2020. "Collaboration and its influence on retraction based on retracted publications during 1978–2017," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 213-232, October.
    17. Maia Chankseliani & Andrey Lovakov & Vladimir Pislyakov, 2021. "A big picture: bibliometric study of academic publications from post-Soviet countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(10), pages 8701-8730, October.
    18. Fabián Freijedo-Farinas & Alberto Ruano-Ravina & Mónica Pérez-Ríos & Joseph Ross & Cristina Candal-Pedreira, 2024. "Biomedical retractions due to misconduct in Europe: characterization and trends in the last 20 years," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(5), pages 2867-2882, May.
    19. Alberto Baccini & Giuseppe De Nicolao & Eugenio Petrovich, 2019. "Citation gaming induced by bibliometric evaluation: A country-level comparative analysis," PLOS ONE, Public Library of Science, vol. 14(9), pages 1-16, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Denis Kosyakov & Andrey Guskov, 2022. "Reasons and consequences of changes in Russian research assessment policies," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(8), pages 4609-4630, August.
    2. Leonid Gokhberg & Tatiana Kuznetsova & Maxim Kotsemir, 2023. "From the Soviet Union to the Russian Federation: publication activity dynamics along the evolution of national science policies," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(11), pages 6195-6246, November.
    3. Katerina Guba, 2024. "Why do sociologists on academic periphery willingly support bibliometric indicators?," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(1), pages 497-518, January.
    4. Ekaterina Dyachenko & Iurii Agafonov & Katerina Guba & Alexander Gelvikh, 2024. "Independent Russian medical science: is there any?," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(9), pages 5577-5597, September.
    5. Andreea Mironescu & Alina Moroșanu & Anca-Diana Bibiri, 2023. "The regional dynamics of multilingual publishing in web of science: A statistical analysis of central and eastern european journals and researchers in linguistics," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(2), pages 1133-1162, February.
    6. Daria Gerashchenko, 2024. "Research topic switch and its relation to appointment as university leader," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(3), pages 1841-1862, March.
    7. Anna Abalkina, 2024. "Challenges posed by hijacked journals in Scopus," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 75(4), pages 395-422, April.
    8. Nataliya Matveeva & Ivan Sterligov & Andrey Lovakov, 2022. "International scientific collaboration of post-Soviet countries: a bibliometric analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(3), pages 1583-1607, March.
    9. Denis Kosyakov & Andrey Guskov, 2024. "Disciplinary and institutional shifts: decomposing deviations in the country-level proportions of conference papers in Scopus," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(3), pages 1697-1717, March.
    10. Wu, Dengsheng & Wang, Shuwen & Xu, Weixuan & Li, Jianping, 2024. "Do conference-journal articles receive more citations? A case study in physics," Journal of Informetrics, Elsevier, vol. 18(4).
    11. Xiaolin Deng & Xiangtao Wang & Yuting Yang & Junqin Li & Yang Gao & Haiyan Huang & Yu Zhang & Jing Du & Puchang Wang, 2025. "Global Research Trends and Hotspots in White Clover ( Trifolium repens L.) Responses to Drought Stress (1990–2024)," Sustainability, MDPI, vol. 17(5), pages 1-24, February.
    12. David Moroz, 2024. "What does terroir mean? A science mapping of a multidimensional concept," Journal of Agricultural Economics, Wiley Blackwell, vol. 75(3), pages 889-913, September.
    13. Moxin Li & Yang Wang, 2024. "Influence of political tensions on scientific productivity, citation impact, and knowledge combinations," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(4), pages 2337-2370, April.
    14. Andrey Lovakov & Maia Chankseliani & Anna Panova, 2022. "Universities vs. research institutes? Overcoming the Soviet legacy of higher education and research," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(11), pages 6293-6313, November.
    15. Renata Kudaibergenova & Sandugash Uzakbay & Asselya Makanova & Kymbat Ramadinkyzy & Erlan Kistaubayev & Ruslan Dussekeev & Kadyrzhan Smagulov, 2022. "Managing publication change at Al-Farabi Kazakh National University: a case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 453-479, January.
    16. Vivek Kumar Singh & Satya Swarup Srichandan & Hiran H. Lathabai, 2022. "ResearchGate and Google Scholar: how much do they differ in publications, citations and different metrics and why?," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(3), pages 1515-1542, March.
    17. Maia Chankseliani, 2023. "Who funds the production of globally visible research in the Global South?," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(1), pages 783-801, January.
    18. Balatskiy, E. & Yurevich, M., 2021. "Russian economic science on the international market of "predatory" publications," Journal of the New Economic Association, New Economic Association, vol. 50(2), pages 190-198.
    19. Mona Farouk Ali, 2024. "Is there a “difference-in-difference”? The impact of scientometric evaluation on the evolution of international publications in Egyptian universities and research centres," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(2), pages 1119-1154, February.
    20. Hanna Hottenrott & Cornelia Lawson, 2022. "What is behind multiple institutional affiliations in academia?," Science and Public Policy, Oxford University Press, vol. 49(3), pages 382-402.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:130:y:2025:i:3:d:10.1007_s11192-025-05269-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.