IDEAS home Printed from https://ideas.repec.org/a/nea/journl/y2016i30p181-192.html
   My bibliography  Save this article

How Different Are the Existing Ratings of Russian Economic Journals and How to Unify Them?

Author

Listed:
  • Subochev, A.

    (DeCAn Lab, National Research University Higher School of Economics, Moscow, Russia)

Abstract

Recently, three ratings of Russian economic journals have been independently proposed by Muravyev (2012), Balatsky (2015) and researchers from the Higher School of Economics (2014). In this paper, quantitative estimates of their (in)consistency are obtained. Additionally, these three orderings are compared to journal rankings based on values of Science Index and 2- and 5-year impact factors published by eLIBRARY.ru. It is demonstrated that all journal orderings weakly, though positively, correlate with each other. A new approach to aggregation of journal rankings is proposed. Aggregation is considered as a multicriteria decision problem, and ordinal ranking methods from social choice theory are employed to solve it. One may apply either a social ranking rule or a multistage procedure of selection and exclusion of the best journals, as determined by a social choice solution concept. In this paper, Pareto principle and majority rule based solution concepts, such as the Copeland rule, the Pareto set, the core, the uncovered set and the minimal externally stable set, are used to produce aggregate rankings of 74 top Russian economic journals. Correlation analysis demonstrates that aggregate rankings reduce the number of contradictions and represent the set of initial three rankings better than any of the latter.

Suggested Citation

  • Subochev, A., 2016. "How Different Are the Existing Ratings of Russian Economic Journals and How to Unify Them?," Journal of the New Economic Association, New Economic Association, vol. 30(2), pages 181-192.
    • Handle: RePEc:nea:journl:y:2016:i:30:p:181-192
    as

    Download full text from publisher

    File URL: http://www.econorus.org/repec/journl/2016-30-181-192r.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Muravyev, A. A., 2012. "On Classification of Russian Journals in Economics," Working Papers 551, Graduate School of Management, St. Petersburg State University.
    2. Subochev, Andrey, 2008. "Dominant, weakly stable, uncovered sets: properties and extensions," MPRA Paper 53421, University Library of Munich, Germany.
    3. Kenneth J. Arrow & Herve Raynaud, 1986. "Social Choice and Multicriterion Decision-Making," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262511754, December.
    4. Fuad Aleskerov & Andrey Subochev, 2013. "Modeling optimal social choice: matrix-vector representation of various solution concepts based on majority rule," Journal of Global Optimization, Springer, vol. 56(2), pages 737-756, June.
    5. Fuad T. Aleskerov & Vladimir V. Pislyakov & Andrey N. Subochev, 2014. "Ranking Journals In Economics, Management And Political Science By Social Choice Theory Methods," HSE Working papers WP BRP 27/STI/2014, National Research University Higher School of Economics.
    6. A. Muravyev., 2013. "On Scientific Value of Russian Journals in Economics and Related Fields," VOPROSY ECONOMIKI, N.P. Redaktsiya zhurnala "Voprosy Economiki", vol. 4.
    7. Muravyev, Alexander A., 2012. "On Classification of Russian Journals in Economics," Working Papers 843, Graduate School of Management, St. Petersburg State University.
    8. Fuad T. Aleskerov & Vladimir V. Pislyakov & Timur V. Vitkup, 2014. "Ranking Journals In Economics, Management And Political Sciences By The Threshold Aggregation Procedure," HSE Working papers WP BRP 73/EC/2014, National Research University Higher School of Economics.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. V. M. Moskovkin & X. Sun, 2019. "Methodology of regional analysis of the Russian economic reseaerch market," Economics of Science, Delo Publishing house, vol. 5(1).
    2. Rubinstein, A., 2019. "Man shall not live by RSCI alone..," Journal of the New Economic Association, New Economic Association, vol. 44(4), pages 245-259.
    3. repec:rnp:ecosci:es1904 is not listed on IDEAS

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Subochev, Andrey & Zakhlebin, Igor, 2014. "Alternative versions of the global competitive industrial performance ranking constructed by methods from social choice theory," MPRA Paper 67462, University Library of Munich, Germany.
    2. Subochev, Andrey & Aleskerov, Fuad & Pislyakov, Vladimir, 2018. "Ranking journals using social choice theory methods: A novel approach in bibliometrics," Journal of Informetrics, Elsevier, vol. 12(2), pages 416-429.
    3. Fuad T. Aleskerov & Vladimir V. Pislyakov & Andrey N. Subochev, 2014. "Ranking Journals In Economics, Management And Political Science By Social Choice Theory Methods," HSE Working papers WP BRP 27/STI/2014, National Research University Higher School of Economics.
    4. O. A. Yeremchenko & F. A. Kurakov, 2016. "The Issue Of Imitation Of Scientific Publication Activity In Russia And Recommendations For Solving It," Economics of Science, Delo Publishing house, vol. 2(1).
    5. Balatsky, Evgeny V. (Балацкий, Евгений) & Ekimova, Natalia A. (Екимова, Наталья), 2017. "Competition of Economic Journals in Russia: Results of the Three Waves of Ranking [Конкуренция Экономических Журналов России: Итоги Трех Волн Рейтингования]," Ekonomicheskaya Politika / Economic Policy, Russian Presidential Academy of National Economy and Public Administration, vol. 6, pages 178-201, December.
    6. Zahid Halim & Shafaq Khan, 2019. "A data science-based framework to categorize academic journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(1), pages 393-423, April.
    7. Noelia Rico & Camino R. Vela & Raúl Pérez-Fernández & Irene Díaz, 2021. "Reducing the Computational Time for the Kemeny Method by Exploiting Condorcet Properties," Mathematics, MDPI, vol. 9(12), pages 1-12, June.
    8. William Gehrlein, 2002. "Condorcet's paradox and the likelihood of its occurrence: different perspectives on balanced preferences ," Theory and Decision, Springer, vol. 52(2), pages 171-199, March.
    9. Tommaso Agasisti & Giuseppe Munda, 2017. "Efficiency of investment in compulsory education: An Overview of Methodological Approaches," JRC Research Reports JRC106681, Joint Research Centre.
    10. Joey Au & Andrew Coleman & Trudy Sullivan, 2015. "A Practical Approach to Well-being Based Policy Development: What Do New Zealanders Want from Their Retirement Income Policies?," Treasury Working Paper Series 15/14, New Zealand Treasury.
    11. Giuseppe Munda, 2003. "Social Multi-Criteria Evaluation (SMCE)," UHE Working papers 2003_04, Universitat Autònoma de Barcelona, Departament d'Economia i Història Econòmica, Unitat d'Història Econòmica.
    12. Рубинштейн Александр Яковлевич, "undated". "Ранжирование Российских Экономических Журналов: Научный Метод Или «Игра В Цыфирь»? [Ran Ranking of Russian Economic Journals: The Scientific Method or “Numbers Game”?]," Working papers a:pru175:ye:2016:1, Institute of Economics.
    13. Dias, Luis C. & Lamboray, Claude, 2010. "Extensions of the prudence principle to exploit a valued outranking relation," European Journal of Operational Research, Elsevier, vol. 201(3), pages 828-837, March.
    14. Leo Katz, 2010. "A Theory of Loopholes," The Journal of Legal Studies, University of Chicago Press, vol. 39(1), pages 1-31, January.
    15. Tangian, Andranik S., 2004. "Constructing the composite indicator "Quality of work" from the third European survey on working conditions," WSI Working Papers 132, The Institute of Economic and Social Research (WSI), Hans Böckler Foundation.
    16. Brandt, Felix, 2011. "Minimal stable sets in tournaments," Journal of Economic Theory, Elsevier, vol. 146(4), pages 1481-1499, July.
    17. Fuad Aleskerov & Andrey Subochev, 2013. "Modeling optimal social choice: matrix-vector representation of various solution concepts based on majority rule," Journal of Global Optimization, Springer, vol. 56(2), pages 737-756, June.
    18. Zachary F. Lansdowne, 1996. "Ordinal ranking methods for multicriterion decision making," Naval Research Logistics (NRL), John Wiley & Sons, vol. 43(5), pages 613-627, August.
    19. Fuad Aleskerov & Andrey Subochev, 2016. "Matrix-vector representation of various solution concepts," Papers 1607.02378, arXiv.org.
    20. Mala, Jozsef, 1999. "On [lambda]-majority voting paradoxes," Mathematical Social Sciences, Elsevier, vol. 37(1), pages 39-44, January.

    More about this item

    Keywords

    journal ranking; economic journals; Russian journals; rank aggregation; multicriteria choice; social choice rules; majority rule; uncovered set; externally stable set; Copeland rule;
    All these keywords.

    JEL classification:

    • C65 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Miscellaneous Mathematical Tools

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nea:journl:y:2016:i:30:p:181-192. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Alexey Tcharykov (email available below). General contact details of provider: https://edirc.repec.org/data/nearuea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.