IDEAS home Printed from https://ideas.repec.org/a/gam/jpubli/v8y2020i3p36-d381907.html
   My bibliography  Save this article

An Overview of the Dynamics of Relative Research Performance in Central-Eastern Europe Using a Ranking-Based Analysis Derived from SCImago Data

Author

Listed:
  • Ioan Ianoş

    (Interdisciplinary Centre of Advanced Research on Territorial Dynamics, University of Bucharest, 050663 Bucharest, Romania)

  • Alexandru-Ionuţ Petrişor

    (Doctoral School of Urban Planning, Ion Mincu University of Architecture and Urbanism, 010014 Bucharest, Romania)

Abstract

In recent times, rankings seem to play an increasingly important role, influencing the lives of individual researchers or academics and their institutions. Individual and institutional rankings used for promotion and research or academic funding seem to illustrate more and more the “publish or perish” mantra, relying sometimes almost exclusively on publications and their citations. Eastern Europe found itself part of this new world after a period of isolation, uneven for the countries within the area. The present study uses SCImago data to perform a regional analysis of individual and aggregated domains, for individual countries and the entire region, based on a novel “adjusted citation index”, in order to measure the performance and identify, using correlations with additional data and information, the mechanisms that can increase the research performance of a country. In a nutshell, the results indicate that the national research policies are responsible for performance. Adaptive research policies simulate a real performance, in comparison with more restrictive ones, which are more likely to stimulate unethical behaviors such as self-citations or citation stacking, especially when used for the assessment of researchers. The importance of the findings lies in the possibility of replicating the methodology, adapting it to different spatial scales.

Suggested Citation

  • Ioan Ianoş & Alexandru-Ionuţ Petrişor, 2020. "An Overview of the Dynamics of Relative Research Performance in Central-Eastern Europe Using a Ranking-Based Analysis Derived from SCImago Data," Publications, MDPI, vol. 8(3), pages 1-25, July.
  • Handle: RePEc:gam:jpubli:v:8:y:2020:i:3:p:36-:d:381907
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2304-6775/8/3/36/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2304-6775/8/3/36/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Slavo Radosevic & Esin Yoruk, 2014. "Are there global shifts in the world science base? Analysing the catching up and falling behind of world regions," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(3), pages 1897-1924, December.
    2. Saeed-Ul Hassan & Iqra Safder & Anam Akram & Faisal Kamiran, 2018. "A novel machine-learning approach to measuring scientific knowledge flows using citation context analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(2), pages 973-996, August.
    3. Peter Vinkler, 2008. "Correlation between the structure of scientific research, scientometric indicators and GDP in EU and non-EU countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 74(2), pages 237-254, February.
    4. Mu‐hsuan Huang & Yu‐wei Chang, 2008. "Characteristics of research output in social sciences and humanities: From a research evaluation perspective," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 59(11), pages 1819-1828, September.
    5. Jacek Pietrucha, 2018. "Country-specific determinants of world university rankings," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(3), pages 1129-1139, March.
    6. Ewen Callaway, 2016. "Beat it, impact factor! Publishing elite turns against controversial metric," Nature, Nature, vol. 535(7611), pages 210-211, July.
    7. Dalibor Fiala, 2013. "Science Evaluation in the Czech Republic: The Case of Universities," Societies, MDPI, vol. 3(3), pages 1-14, June.
    8. Martin Grančay & Jolita Vveinhardt & Ērika Šumilo, 2017. "Publish or perish: how Central and Eastern European economists have dealt with the ever-increasing academic publishing requirements 2000–2015," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(3), pages 1813-1837, June.
    9. Péter Sasvári & András Nemeslaki & László Duma, 2019. "Exploring the influence of scientific journal ranking on publication performance in the Hungarian social sciences: the case of law and economics," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 595-616, May.
    10. Ádám Kun, 2018. "Publish and Who Should Perish: You or Science?," Publications, MDPI, vol. 6(2), pages 1-16, April.
    11. Djuro Kutlača & Dragan Babić & Lazar Živković & Dijana Štrbac, 2015. "Analysis of quantitative and qualitative indicators of SEE countries scientific output," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(1), pages 247-265, January.
    12. McNutt, Marcia & Bradford, Monica & Drazen, Jeffrey, 2018. "Transparency in Authors’ Contributions and Responsibilities to Promote Integrity in Scientific Publication," OSF Preprints asywp, Center for Open Science.
    13. Pierre Régibeau & Katharine E. Rockett, 2016. "Research assessment and recognized excellence: simple bibliometrics for more efficient academic research evaluations," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 31(88), pages 611-652.
    14. Jiri Vanecek, 2008. "Bibliometric analysis of the Czech research publications from 1994 to 2005," Scientometrics, Springer;Akadémiai Kiadó, vol. 77(2), pages 345-360, November.
    15. John McCormack & Carol Propper & Sarah Smith, 2014. "Herding Cats? Management and University Performance," Economic Journal, Royal Economic Society, vol. 124(578), pages 534-564, August.
    16. Maja Jokić, 2020. "Productivity, visibility, authorship, and collaboration in library and information science journals: Central and Eastern European authors," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(2), pages 1189-1219, February.
    17. Antonio Cavacini, 2016. "Recent trends in Middle Eastern scientific production," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(1), pages 423-432, October.
    18. Éric Archambault & Étienne Vignola-Gagné & Grégoire Côté & Vincent Larivière & Yves Gingrasb, 2006. "Benchmarking scientific output in the social sciences and humanities: The limits of existing databases," Scientometrics, Springer;Akadémiai Kiadó, vol. 68(3), pages 329-342, September.
    19. Jingda Ding & Chao Liu & Goodluck Asobenie Kandonga, 2020. "Exploring the limitations of the h-index and h-type indexes in measuring the research performance of authors," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(3), pages 1303-1322, March.
    20. Marcin Kozak & Lutz Bornmann & Loet Leydesdorff, 2015. "How have the Eastern European countries of the former Warsaw Pact developed since 1990? A bibliometric study," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(2), pages 1101-1117, February.
    21. Alis Oancea, 2019. "Research governance and the future(s) of research assessment," Palgrave Communications, Palgrave Macmillan, vol. 5(1), pages 1-12, December.
    22. Daniele Fanelli, 2010. "Do Pressures to Publish Increase Scientists' Bias? An Empirical Support from US States Data," PLOS ONE, Public Library of Science, vol. 5(4), pages 1-7, April.
    23. Francesco Pomponi & Bernardino D’Amico & Tom Rye, 2019. "Who Is (Likely) Peer-Reviewing Your Papers? A Partial Insight into the World’s Top Reviewers," Publications, MDPI, vol. 7(1), pages 1-7, March.
    24. Daniel Teodorescu & Tudorel Andrei, 2014. "An examination of “citation circles” for social sciences journals in Eastern European countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 99(2), pages 209-231, May.
    25. Maja Jokić & Andrea Mervar & Stjepan Mateljan, 2019. "Comparative analysis of book citations in social science journals by Central and Eastern European authors," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(3), pages 1005-1029, September.
    26. Štěpán Jurajda & Stanislav Kozubek & Daniel Münich & Samuel Škoda, 2017. "Scientific publication performance in post-communist countries: still lagging far behind," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(1), pages 315-328, July.
    27. Dag. W. Aksnes & Gunnar Sivertsen & Thed N. van Leeuwen & Kaja K. Wendt, 2017. "Measuring the productivity of national R&D systems: Challenges in cross-national comparisons of R&D input and publication output indicators," Science and Public Policy, Oxford University Press, vol. 44(2), pages 246-258.
    28. Zhigang Hu & Gege Lin & Taian Sun & Xianwen Wang, 2018. "An EU without the UK: mapping the UK’s changing roles in the EU scientific research," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(3), pages 1185-1198, June.
    29. Dejan Pajić, 2015. "Globalization of the social sciences in Eastern Europe: genuine breakthrough or a slippery slope of the research evaluation practice?," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(3), pages 2131-2150, March.
    30. Marcia K. McNutt & Monica Bradford & Jeffrey M. Drazen & Brooks Hanson & Bob Howard & Kathleen Hall Jamieson & Véronique Kiermer & Emilie Marcus & Barbara Kline Pope & Randy Schekman & Sowmya Swaminat, 2018. "Transparency in authors’ contributions and responsibilities to promote integrity in scientific publication," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 115(11), pages 2557-2560, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Marina Martinčević & Darja Maslić Seršić & Davor Jokić, 2023. "Contribution of CEE authors to psychological science: is the growing trend of publishing in non-CEE journals still present 10 years after its inception?," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(6), pages 3703-3721, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andrea Mervar & Maja Jokić, 2022. "Core-periphery nexus in the EU social sciences: bibliometric perspective," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(10), pages 5793-5817, October.
    2. Zoltán Krajcsák, 2021. "Researcher Performance in Scopus Articles ( RPSA ) as a New Scientometric Model of Scientific Output: Tested in Business Area of V4 Countries," Publications, MDPI, vol. 9(4), pages 1-23, October.
    3. Martin Grančay & Jolita Vveinhardt & Ērika Šumilo, 2017. "Publish or perish: how Central and Eastern European economists have dealt with the ever-increasing academic publishing requirements 2000–2015," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(3), pages 1813-1837, June.
    4. Marina Martinčević & Darja Maslić Seršić & Davor Jokić, 2023. "Contribution of CEE authors to psychological science: is the growing trend of publishing in non-CEE journals still present 10 years after its inception?," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(6), pages 3703-3721, June.
    5. Andreea Mironescu & Alina Moroșanu & Anca-Diana Bibiri, 2023. "The regional dynamics of multilingual publishing in web of science: A statistical analysis of central and eastern european journals and researchers in linguistics," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(2), pages 1133-1162, February.
    6. Hladchenko, Myroslava & Moed, Henk F., 2021. "The effect of publication traditions and requirements in research assessment and funding policies upon the use of national journals in 28 post-socialist countries," Journal of Informetrics, Elsevier, vol. 15(4).
    7. Darja Maslić Seršić & Marina Martinčević & Maja Jokić, 2021. "The contribution of CEE authors to psychological science: a comparative analysis of papers published in CEE and non-CEE journals indexed by Scopus in the period 1996—2013," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1453-1469, February.
    8. Giulio Marini, 2021. "Joining the European Union as an advantage in science performativity. A quasi-experimental study," DoQSS Working Papers 21-09, Quantitative Social Science - UCL Social Research Institute, University College London.
    9. Štěpán Jurajda & Stanislav Kozubek & Daniel Münich & Samuel Škoda, 2017. "Scientific publication performance in post-communist countries: still lagging far behind," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(1), pages 315-328, July.
    10. Andrey Lovakov & Anna Panova & Maria Yudkevich, 2022. "Global visibility of nationally published research output: the case of the post-Soviet region," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(5), pages 2643-2659, May.
    11. Marton Demeter & Agnes Jele & Zsolt Balázs Major, 2022. "The model of maximum productivity for research universities SciVal author ranks, productivity, university rankings, and their implications," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(8), pages 4335-4361, August.
    12. Frode Eika Sandnes, 2021. "A bibliometric study of human–computer interaction research activity in the Nordic-Baltic Eight countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 4733-4767, June.
    13. Maja Jokić, 2020. "Productivity, visibility, authorship, and collaboration in library and information science journals: Central and Eastern European authors," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(2), pages 1189-1219, February.
    14. Dejan Pajić, 2015. "Globalization of the social sciences in Eastern Europe: genuine breakthrough or a slippery slope of the research evaluation practice?," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(3), pages 2131-2150, March.
    15. György Csomós & Jenő Zsolt Farkas, 2023. "Understanding the increasing market share of the academic publisher “Multidisciplinary Digital Publishing Institute” in the publication output of Central and Eastern European countries: a case study o," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(1), pages 803-824, January.
    16. Csomós, György, 2020. "Introducing recalibrated academic performance indicators in the evaluation of individuals’ research performance: A case study from Eastern Europe," Journal of Informetrics, Elsevier, vol. 14(4).
    17. Vučković Dijana & Pekovic Sanja & Popović Stevo & Janinovic Jovana, 2023. "Assessing the Appraisal of Research Quality in Social Sciences and Humanities: A Case Study of the University of Montenegro," Business Systems Research, Sciendo, vol. 14(1), pages 131-152, September.
    18. Yves Gingras & Mahdi Khelfaoui, 2018. "Assessing the effect of the United States’ “citation advantage” on other countries’ scientific impact as measured in the Web of Science (WoS) database," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(2), pages 517-532, February.
    19. Ülle Must, 2012. "Alone or together: examples from history research," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(2), pages 527-537, May.
    20. Jielan Ding & Per Ahlgren & Liying Yang & Ting Yue, 2018. "Disciplinary structures in Nature, Science and PNAS: journal and country levels," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 1817-1852, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jpubli:v:8:y:2020:i:3:p:36-:d:381907. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.