IDEAS home Printed from https://ideas.repec.org/a/nea/journl/y2016i30p181-192.html
   My bibliography  Save this article

How Different Are the Existing Ratings of Russian Economic Journals and How to Unify Them?

Author

Listed:
  • Subochev, A.

    (DeCAn Lab, National Research University Higher School of Economics, Moscow, Russia)

Abstract

Recently, three ratings of Russian economic journals have been independently proposed by Muravyev (2012), Balatsky (2015) and researchers from the Higher School of Economics (2014). In this paper, quantitative estimates of their (in)consistency are obtained. Additionally, these three orderings are compared to journal rankings based on values of Science Index and 2- and 5-year impact factors published by eLIBRARY.ru. It is demonstrated that all journal orderings weakly, though positively, correlate with each other. A new approach to aggregation of journal rankings is proposed. Aggregation is considered as a multicriteria decision problem, and ordinal ranking methods from social choice theory are employed to solve it. One may apply either a social ranking rule or a multistage procedure of selection and exclusion of the best journals, as determined by a social choice solution concept. In this paper, Pareto principle and majority rule based solution concepts, such as the Copeland rule, the Pareto set, the core, the uncovered set and the minimal externally stable set, are used to produce aggregate rankings of 74 top Russian economic journals. Correlation analysis demonstrates that aggregate rankings reduce the number of contradictions and represent the set of initial three rankings better than any of the latter.

Suggested Citation

  • Subochev, A., 2016. "How Different Are the Existing Ratings of Russian Economic Journals and How to Unify Them?," Journal of the New Economic Association, New Economic Association, vol. 30(2), pages 181-192.
    • Handle: RePEc:nea:journl:y:2016:i:30:p:181-192
    as

    Download full text from publisher

    File URL: http://www.econorus.org/repec/journl/2016-30-181-192r.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Fuad Aleskerov & Andrey Subochev, 2013. "Modeling optimal social choice: matrix-vector representation of various solution concepts based on majority rule," Journal of Global Optimization, Springer, vol. 56(2), pages 737-756, June.
    2. A. Muravyev., 2013. "On Scientific Value of Russian Journals in Economics and Related Fields," VOPROSY ECONOMIKI, N.P. Redaktsiya zhurnala "Voprosy Economiki", vol. 4.
    3. Subochev, Andrey, 2008. "Dominant, weakly stable, uncovered sets: properties and extensions," MPRA Paper 53421, University Library of Munich, Germany.
    4. Fuad T. Aleskerov & Vladimir V. Pislyakov & Andrey N. Subochev, 2014. "Ranking Journals In Economics, Management And Political Science By Social Choice Theory Methods," HSE Working papers WP BRP 27/STI/2014, National Research University Higher School of Economics.
    5. Muravyev, A. A., 2012. "On Classification of Russian Journals in Economics," Working Papers 551, Graduate School of Management, St. Petersburg State University.
    6. Kenneth J. Arrow & Herve Raynaud, 1986. "Social Choice and Multicriterion Decision-Making," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262511754, December.
    7. Muravyev, Alexander A., 2012. "On Classification of Russian Journals in Economics," Working Papers 843, Graduate School of Management, St. Petersburg State University.
    8. Fuad T. Aleskerov & Vladimir V. Pislyakov & Timur V. Vitkup, 2014. "Ranking Journals In Economics, Management And Political Sciences By The Threshold Aggregation Procedure," HSE Working papers WP BRP 73/EC/2014, National Research University Higher School of Economics.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. V. M. Moskovkin & X. Sun, 2019. "Methodology of regional analysis of the Russian economic reseaerch market," Economics of Science, Delo Publishing house, vol. 5(1).
    2. repec:rnp:ecosci:es1904 is not listed on IDEAS
    3. Rubinstein, A., 2019. "Man shall not live by RSCI alone..," Journal of the New Economic Association, New Economic Association, vol. 44(4), pages 245-259.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Subochev, Andrey & Zakhlebin, Igor, 2014. "Alternative versions of the global competitive industrial performance ranking constructed by methods from social choice theory," MPRA Paper 67462, University Library of Munich, Germany.
    2. Subochev, Andrey & Aleskerov, Fuad & Pislyakov, Vladimir, 2018. "Ranking journals using social choice theory methods: A novel approach in bibliometrics," Journal of Informetrics, Elsevier, vol. 12(2), pages 416-429.
    3. Balatsky, Evgeny V. (Балацкий, Евгений) & Ekimova, Natalia A. (Екимова, Наталья), 2017. "Competition of Economic Journals in Russia: Results of the Three Waves of Ranking [Конкуренция Экономических Журналов России: Итоги Трех Волн Рейтингования]," Ekonomicheskaya Politika / Economic Policy, Russian Presidential Academy of National Economy and Public Administration, vol. 6, pages 178-201, December.
    4. Fuad T. Aleskerov & Vladimir V. Pislyakov & Andrey N. Subochev, 2014. "Ranking Journals In Economics, Management And Political Science By Social Choice Theory Methods," HSE Working papers WP BRP 27/STI/2014, National Research University Higher School of Economics.
    5. O. A. Yeremchenko & F. A. Kurakov, 2016. "The Issue Of Imitation Of Scientific Publication Activity In Russia And Recommendations For Solving It," Economics of Science, Delo Publishing house, vol. 2(1).
    6. Zahid Halim & Shafaq Khan, 2019. "A data science-based framework to categorize academic journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(1), pages 393-423, April.
    7. Tommaso Agasisti & Giuseppe Munda & Ralph Hippe, 2019. "Measuring the efficiency of European education systems by combining Data Envelopment Analysis and Multiple-Criteria Evaluation," Journal of Productivity Analysis, Springer, vol. 51(2), pages 105-124, June.
    8. Munda, Giuseppe, 2009. "A conflict analysis approach for illuminating distributional issues in sustainability policy," European Journal of Operational Research, Elsevier, vol. 194(1), pages 307-322, April.
    9. Noelia Rico & Camino R. Vela & Raúl Pérez-Fernández & Irene Díaz, 2021. "Reducing the Computational Time for the Kemeny Method by Exploiting Condorcet Properties," Mathematics, MDPI, vol. 9(12), pages 1-12, June.
    10. Susumu Cato, 2014. "Menu Dependence and Group Decision Making," Group Decision and Negotiation, Springer, vol. 23(3), pages 561-577, May.
    11. Richter, Michael & Rubinstein, Ariel, 2019. ""Convex preferences": a new definition," Theoretical Economics, Econometric Society, vol. 14(4), November.
    12. William Gehrlein, 2002. "Condorcet's paradox and the likelihood of its occurrence: different perspectives on balanced preferences ," Theory and Decision, Springer, vol. 52(2), pages 171-199, March.
    13. Tommaso Agasisti & Giuseppe Munda, 2017. "Efficiency of investment in compulsory education: An Overview of Methodological Approaches," JRC Research Reports JRC106681, Joint Research Centre.
    14. Nguyen Nghia Bien, 2016. "Forest Management Systems in the Uplands of Vietnam: Social, Economic and Environmental Perspectives," EEPSEA Research Report rr2016052, Economy and Environment Program for Southeast Asia (EEPSEA), revised Apr 2016.
    15. Shumilov, Andrei & Balatsky, Evgeny, 2016. "Академические рейтинги RePEc: вопросы построения и роль российских участников [RePEc Academic Rankings: Construction Issues and the Role of Russian Participants]," MPRA Paper 70956, University Library of Munich, Germany.
    16. Rubinstein, Alexander & Slutskin, Lev, 2018. "«Multiway data analysis» and the general problem of journals’ ranking," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 50, pages 90-113.
    17. Joey Au & Andrew Coleman & Trudy Sullivan, 2015. "A Practical Approach to Well-being Based Policy Development: What Do New Zealanders Want from Their Retirement Income Policies?," Treasury Working Paper Series 15/14, New Zealand Treasury.
    18. Gans, Joshua S., 1996. "On the impossibility of rational choice under incomplete information," Journal of Economic Behavior & Organization, Elsevier, vol. 29(2), pages 287-309, March.
    19. Fuad T. Aleskerov & Vladimir V. Pislyakov & Timur V. Vitkup, 2014. "Ranking Journals In Economics, Management And Political Sciences By The Threshold Aggregation Procedure," HSE Working papers WP BRP 73/EC/2014, National Research University Higher School of Economics.
    20. Vanessa Silva & Danielle Morais & Adiel Almeida, 2010. "A Multicriteria Group Decision Model to Support Watershed Committees in Brazil," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 24(14), pages 4075-4091, November.

    More about this item

    Keywords

    journal ranking; economic journals; Russian journals; rank aggregation; multicriteria choice; social choice rules; majority rule; uncovered set; externally stable set; Copeland rule;
    All these keywords.

    JEL classification:

    • C65 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Miscellaneous Mathematical Tools

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nea:journl:y:2016:i:30:p:181-192. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Alexey Tcharykov (email available below). General contact details of provider: https://edirc.repec.org/data/nearuea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.