IDEAS home Printed from https://ideas.repec.org/a/nea/journl/y2016i30p162-175.html
   My bibliography  Save this article

Ranking of Russian Economic Journals: The Scientific Method or "Numbers Game"

Author

Listed:
  • Rubinstein, A.

    (Institute of Economics of the Russian Academy of Sciences (the RAS), Moscow, Russia
    State Institute of Art, Moscow, Russia)

Abstract

This article is devoted to general problems of ranking on the example of critical analysis of the three ratings of Russian economic journals suggested in recent years, the methodology of construction of which are connected with the Russian Science Citation Index (RSCI) data, results of expert surveys and a combination of these approaches. The fundamental disadvantages of each of them are revealed and it is shown that the vulnerable points of such developments are relatively arbitrary choice of bibliometric indicators and their weak correlation with academic authority of journals, insufficiently substantiated procedure of aggregation of used indicators and/or expert analysis, as well as surveys of experts are not representative. This paper presents a "passive experiment", in terms of which were mapped the results of the ranking of journals, based on the three ratings and three additional criteria. Made the overall conclusion about the low level of development of such researches and the lack of real grounds for the application of these ratings in the practice of science management and motivation of scientists..

Suggested Citation

  • Rubinstein, A., 2016. "Ranking of Russian Economic Journals: The Scientific Method or "Numbers Game"," Journal of the New Economic Association, New Economic Association, vol. 30(2), pages 162-175.
    • Handle: RePEc:nea:journl:y:2016:i:30:p:162-175
    as

    Download full text from publisher

    File URL: http://www.econorus.org/repec/journl/2016-30-162-175r.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Volkova, O., 2016. "Do Visual Culture Revolutions Affect Accounting Practices?," Journal of the New Economic Association, New Economic Association, vol. 29(1), pages 54-82.
    2. Писляков Владимир Владимирович, 2011. "Российские Журналы По Общественным Наукам В Зарубежных Базах Данных (К Статье А. А. Муравьева)," Higher School of Economics Economic Journal Экономический журнал Высшей школы экономики, CyberLeninka;Федеральное государственное автономное образовательное учреждение высшего образования «Национальный исследовательский университет «Высшая школа экономики», vol. 15(2), pages 268-269.
    3. A. Muravyev., 2013. "On Scientific Value of Russian Journals in Economics and Related Fields," VOPROSY ECONOMIKI, N.P. Redaktsiya zhurnala "Voprosy Economiki", vol. 4.
    4. Thomas E. Nisonger, 1999. "JASIS and library and information science journal rankings: A review and analysis of the last half‐century," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 50(11), pages 1004-1019.
    5. Irina Dezhina & Vladimir Dashkeev, 2008. "Who are the leading economists in Russia?," Research Paper Series, Gaidar Institute for Economic Policy, pages 1-21.
    6. N. Kurakova & L. Tsvetkova & O. Eremchenko., 2013. "Scientometric Parameters of Russian Economic Science: General State and the Evaluation of Thesis Boards," VOPROSY ECONOMIKI, N.P. Redaktsiya zhurnala "Voprosy Economiki", vol. 11.
    7. Rubinstein, A., 2011. "The Journal of the New Economic Association and its Readership: A Sociological Study," Journal of the New Economic Association, New Economic Association, issue 12, pages 150-160.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Rubinstein, A. & Burakov, N., 2021. "Economic journals in the optics of scientometrics," Journal of the New Economic Association, New Economic Association, vol. 50(2), pages 205-215.
    2. Aleskerov, F. & Kazachinskaya, A. & Karabekyan, D. & Semina, A. & Yakuba, V., 2021. "Economic journals of Russia, their characteristics and network analysis," Journal of the New Economic Association, New Economic Association, vol. 50(2), pages 170-182.
    3. V. M. Moskovkin & X. Sun, 2019. "Methodology of regional analysis of the Russian economic reseaerch market," Economics of Science, Delo Publishing house, vol. 5(1).
    4. Rubinstein, A., 2019. "Man shall not live by RSCI alone..," Journal of the New Economic Association, New Economic Association, vol. 44(4), pages 245-259.
    5. Rubinstein, Alexander & Slutskin, Lev, 2018. "«Multiway data analysis» and the general problem of journals’ ranking," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 50, pages 90-113.
    6. Moskovkin, V.M. (Московкин, В.М.) & sun, X. (Сунь, С.), 2019. "Methodology of regional analysis of the Russian economic reseaerch market [Методология Регионального Анализа Российского Рынка Экономических Исследований]," Economy of science, Russian Presidential Academy of National Economy and Public Administration, vol. 5, pages 67-78, April.
    7. Minakir, P., 2021. "Research results and bibliometrics: Is a contradiction anatagonistic?," Journal of the New Economic Association, New Economic Association, vol. 50(2), pages 183-190.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Volkova, O., 2016. "Do Visual Culture Revolutions Affect Accounting Practices?," Journal of the New Economic Association, New Economic Association, vol. 29(1), pages 54-82.
    2. Rubinstein, Alexander & Slutskin, Lev, 2018. "«Multiway data analysis» and the general problem of journals’ ranking," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 50, pages 90-113.
    3. A. Muravyev., 2013. "On Scientific Value of Russian Journals in Economics and Related Fields," VOPROSY ECONOMIKI, N.P. Redaktsiya zhurnala "Voprosy Economiki", vol. 4.
    4. Рубинштейн Александр Яковлевич, "undated". "Ранжирование Российских Экономических Журналов: Научный Метод Или «Игра В Цыфирь»? [Ran Ranking of Russian Economic Journals: The Scientific Method or “Numbers Game”?]," Working papers a:pru175:ye:2016:1, Institute of Economics.
    5. Mladen Andreis & Maja Jokić, 2008. "An impact of Croatian journals measured by citation analysis from SCI-expanded database in time span 1975–2001," Scientometrics, Springer;Akadémiai Kiadó, vol. 75(2), pages 263-288, May.
    6. Wen-Yau Cathy Lin, 2012. "Research status and characteristics of library and information science in Taiwan: a bibliometric analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(1), pages 7-21, July.
    7. Chiang Kao & Hsiou-Wei Lin & San-Lin Chung & Wei-Chi Tsai & Jyh-Shen Chiou & Yen-Liang Chen & Liang-Hsuan Chen & Shih-Chieh Fang & Hwei-Lan Pao, 2008. "Ranking Taiwanese management journals: A case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 76(1), pages 95-115, July.
    8. Chien Hsiang Liao & Mu-Yen Chen, 2018. "Exploring knowledge patterns of library and information science journals within the field: a citation analysis from 2009 to 2016," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(3), pages 1991-2008, December.
    9. Рубинштейн Александр Яковлевич & Бураков Н. А. & Славинская О. А., "undated". "Сообщество Экономистов И Экономические Журналы (Социологические Измерения Vs Библиометрии). Научный Доклад [Community of economists and Russian economic journals (sociological measurements VS bibli," Working papers a:pru175:ye:2017:2, Institute of Economics.
    10. Subochev, A., 2016. "How Different Are the Existing Ratings of Russian Economic Journals and How to Unify Them?," Journal of the New Economic Association, New Economic Association, vol. 30(2), pages 181-192.
    11. Shumilov, A. & Balatsky, E., 2016. "RePEc Academic Rankings: Construction Issues and the Role of Russian Participants," Journal of the New Economic Association, New Economic Association, vol. 32(4), pages 111-138.
    12. Chiang Kao, 2009. "The authorship and internationality of Industrial Engineering journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(1), pages 123-136, October.
    13. Muravyev, Alexander, 2012. "К Вопросу О Классификации Российских Журналов По Экономике И Смежным Дисциплинам [On classification of Russian journals in Economics and related fields]," MPRA Paper 43459, University Library of Munich, Germany.
    14. Olena Yarmolyuk & Olha Dmytrenko & Svitlana Viter, 2021. "Trends of the Accounting Development in Ukraine Taking into Account Foreign Experience," Oblik i finansi, Institute of Accounting and Finance, issue 1, pages 44-51, March.
    15. Carlos R. Azzoni, 2010. "Making a Great Difference: The Influence of Professor Werner Baer on the Economic Literature in Brazil, and on Brazil," Palgrave Macmillan Books, in: Hadi Salehi Esfahani & Giovanni Facchini & Geoffrey J. D. Hewings (ed.), Economic Development in Latin America, chapter 19, pages 295-305, Palgrave Macmillan.
    16. Aleskerov, F. & Badgaeva, D. & Pislyakov, V. & Sterligov, I. & Shvydun, S., 2016. "An Importance of Russian and International Economic Journals: a Network Approach," Journal of the New Economic Association, New Economic Association, vol. 30(2), pages 193-205.
    17. Shumilov, Andrei & Balatsky, Evgeny, 2016. "Академические рейтинги RePEc: вопросы построения и роль российских участников [RePEc Academic Rankings: Construction Issues and the Role of Russian Participants]," MPRA Paper 70956, University Library of Munich, Germany.
    18. Daria Maltseva & Vladimir Batagelj, 2020. "iMetrics: the development of the discipline with many names," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 313-359, October.
    19. Rubinstein, A. & Burakov, N., 2021. "Economic journals in the optics of scientometrics," Journal of the New Economic Association, New Economic Association, vol. 50(2), pages 205-215.
    20. V. M. Moskovkin & X. Sun, 2019. "Methodology of regional analysis of the Russian economic reseaerch market," Economics of Science, Delo Publishing house, vol. 5(1).

    More about this item

    Keywords

    journal ranking; bibliometric indicators; citation; expert analysis; aggregation; arranging;
    All these keywords.

    JEL classification:

    • A11 - General Economics and Teaching - - General Economics - - - Role of Economics; Role of Economists
    • A14 - General Economics and Teaching - - General Economics - - - Sociology of Economics
    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nea:journl:y:2016:i:30:p:162-175. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Alexey Tcharykov (email available below). General contact details of provider: https://edirc.repec.org/data/nearuea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.