IDEAS home Printed from https://ideas.repec.org/p/hig/wpaper/27sti2014.html
   My bibliography  Save this paper

Ranking Journals In Economics, Management And Political Science By Social Choice Theory Methods

Author

Listed:
  • Fuad T. Aleskerov

    (National Research University Higher School of Economics (Russia))

  • Vladimir V. Pislyakov

    (National Research University Higher School of Economics (Russia))

  • Andrey N. Subochev

    (National Research University Higher School of Economics (Russia))

Abstract

Data on economic, management and political science journals are used to produce quantitative estimates of (in)consistency of evaluations based on seven popular bibliometric indicators. This paper proposes a new approach to the construction of aggregate journal rankings: aggregation is considered to be a multicriteria decision problem and ordinal ranking methods from social choice theory are employed to solve it. We apply either a direct ranking method based on majority rule (e.g. the Copeland rule, the Markovian method) or a multistage procedure of selection and exclusion of the best journals, as determined by a majority rule-based social choice solution concept (tournament solution), such as the uncovered set and the minimal externally stable set. We use the same method to analyze correlations of rankings and demonstrate that aggregate rankings reduce the number of contradictions and represent the set of single-indicator-based rankings better than any of the seven rankings themselves.

Suggested Citation

  • Fuad T. Aleskerov & Vladimir V. Pislyakov & Andrey N. Subochev, 2014. "Ranking Journals In Economics, Management And Political Science By Social Choice Theory Methods," HSE Working papers WP BRP 27/STI/2014, National Research University Higher School of Economics.
    • Handle: RePEc:hig:wpaper:27sti2014
    as

    Download full text from publisher

    File URL: http://www.hse.ru/data/2014/05/19/1322077930/27STI2014.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Fuad Aleskerov & Andrey Subochev, 2013. "Modeling optimal social choice: matrix-vector representation of various solution concepts based on majority rule," Journal of Global Optimization, Springer, vol. 56(2), pages 737-756, June.
    2. Fuad Aleskerov & Andrey Subochev, 2016. "Matrix-vector representation of various solution concepts," Papers 1607.02378, arXiv.org.
    3. Kenneth J. Arrow & Herve Raynaud, 1986. "Social Choice and Multicriterion Decision-Making," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262511754, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Subochev, Andrey & Zakhlebin, Igor, 2014. "Alternative versions of the global competitive industrial performance ranking constructed by methods from social choice theory," MPRA Paper 67462, University Library of Munich, Germany.
    2. Subochev, A., 2016. "How Different Are the Existing Ratings of Russian Economic Journals and How to Unify Them?," Journal of the New Economic Association, New Economic Association, vol. 30(2), pages 181-192.
    3. Zahid Halim & Shafaq Khan, 2019. "A data science-based framework to categorize academic journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(1), pages 393-423, April.
    4. Balatsky, Evgeny V. (Балацкий, Евгений) & Ekimova, Natalia A. (Екимова, Наталья), 2017. "Competition of Economic Journals in Russia: Results of the Three Waves of Ranking [Конкуренция Экономических Журналов России: Итоги Трех Волн Рейтингования]," Ekonomicheskaya Politika / Economic Policy, Russian Presidential Academy of National Economy and Public Administration, vol. 6, pages 178-201, December.
    5. Subochev, Andrey & Aleskerov, Fuad & Pislyakov, Vladimir, 2018. "Ranking journals using social choice theory methods: A novel approach in bibliometrics," Journal of Informetrics, Elsevier, vol. 12(2), pages 416-429.
    6. Fuad T. Aleskerov & Vladimir V. Pislyakov & Timur V. Vitkup, 2014. "Ranking Journals In Economics, Management And Political Sciences By The Threshold Aggregation Procedure," HSE Working papers WP BRP 73/EC/2014, National Research University Higher School of Economics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Subochev, Andrey & Zakhlebin, Igor, 2014. "Alternative versions of the global competitive industrial performance ranking constructed by methods from social choice theory," MPRA Paper 67462, University Library of Munich, Germany.
    2. Subochev, A., 2016. "How Different Are the Existing Ratings of Russian Economic Journals and How to Unify Them?," Journal of the New Economic Association, New Economic Association, vol. 30(2), pages 181-192.
    3. Fuad Aleskerov & Sergey Shvydun, 2019. "Allocation of Disputable Zones in the Arctic Region," Group Decision and Negotiation, Springer, vol. 28(1), pages 11-42, February.
    4. Subochev, Andrey & Aleskerov, Fuad & Pislyakov, Vladimir, 2018. "Ranking journals using social choice theory methods: A novel approach in bibliometrics," Journal of Informetrics, Elsevier, vol. 12(2), pages 416-429.
    5. Noelia Rico & Camino R. Vela & Raúl Pérez-Fernández & Irene Díaz, 2021. "Reducing the Computational Time for the Kemeny Method by Exploiting Condorcet Properties," Mathematics, MDPI, vol. 9(12), pages 1-12, June.
    6. William Gehrlein, 2002. "Condorcet's paradox and the likelihood of its occurrence: different perspectives on balanced preferences ," Theory and Decision, Springer, vol. 52(2), pages 171-199, March.
    7. Tommaso Agasisti & Giuseppe Munda, 2017. "Efficiency of investment in compulsory education: An Overview of Methodological Approaches," JRC Research Reports JRC106681, Joint Research Centre.
    8. Joey Au & Andrew Coleman & Trudy Sullivan, 2015. "A Practical Approach to Well-being Based Policy Development: What Do New Zealanders Want from Their Retirement Income Policies?," Treasury Working Paper Series 15/14, New Zealand Treasury.
    9. Giuseppe Munda, 2003. "Social Multi-Criteria Evaluation (SMCE)," UHE Working papers 2003_04, Universitat Autònoma de Barcelona, Departament d'Economia i Història Econòmica, Unitat d'Història Econòmica.
    10. Dias, Luis C. & Lamboray, Claude, 2010. "Extensions of the prudence principle to exploit a valued outranking relation," European Journal of Operational Research, Elsevier, vol. 201(3), pages 828-837, March.
    11. Leo Katz, 2010. "A Theory of Loopholes," The Journal of Legal Studies, University of Chicago Press, vol. 39(1), pages 1-31, January.
    12. Tangian, Andranik S., 2004. "Constructing the composite indicator "Quality of work" from the third European survey on working conditions," WSI Working Papers 132, The Institute of Economic and Social Research (WSI), Hans Böckler Foundation.
    13. Brandt, Felix, 2011. "Minimal stable sets in tournaments," Journal of Economic Theory, Elsevier, vol. 146(4), pages 1481-1499, July.
    14. Zachary F. Lansdowne, 1996. "Ordinal ranking methods for multicriterion decision making," Naval Research Logistics (NRL), John Wiley & Sons, vol. 43(5), pages 613-627, August.
    15. Mala, Jozsef, 1999. "On [lambda]-majority voting paradoxes," Mathematical Social Sciences, Elsevier, vol. 37(1), pages 39-44, January.
    16. Bernard Monjardet, 2006. "Condorcet domains and distributive lattices," Post-Print halshs-00119141, HAL.
    17. Lamboray, Claude, 2007. "A comparison between the prudent order and the ranking obtained with Borda's, Copeland's, Slater's and Kemeny's rules," Mathematical Social Sciences, Elsevier, vol. 54(1), pages 1-16, July.
    18. Salvatore Greco & Alessio Ishizaka & Menelaos Tasiou & Gianpiero Torrisi, 2019. "On the Methodological Framework of Composite Indices: A Review of the Issues of Weighting, Aggregation, and Robustness," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(1), pages 61-94, January.
    19. Chowdhury, Khorshed & Mallik, Girijasankar, 2007. "SPair-Wise Output Convergence in East Asia and the Pacific: An Application of Stochastic Unit Root Test," Economics Working Papers wp07-07, School of Economics, University of Wollongong, NSW, Australia.
    20. Giuseppe Munda, 2012. "Intensity of preference and related uncertainty in non-compensatory aggregation rules," Theory and Decision, Springer, vol. 73(4), pages 649-669, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hig:wpaper:27sti2014. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Shamil Abdulaev or Shamil Abdulaev (email available below). General contact details of provider: https://edirc.repec.org/data/hsecoru.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.