IDEAS home Printed from https://ideas.repec.org/p/has/discpr/1018.html
   My bibliography  Save this paper

The World Cup of Economics Journals: A Ranking by a Tournament Method

Author

Listed:
  • Laszlo A. Koczy

    (Institute of Economics - Hungarian Academy of Sciences)

  • Martin Strobel

    (Maastricht University)

Abstract

A ranking of journals is manipulable if a particular journal's position can be improved by making additional citations to other journals. We introduce a simple ranking method that is not manipulable and is invariant to citation intensities, journal scaling and article-splitting. The ranking of economics journals is presented and is compared to rankings by alternative methods in the recent years.

Suggested Citation

  • Laszlo A. Koczy & Martin Strobel, 2010. "The World Cup of Economics Journals: A Ranking by a Tournament Method," CERS-IE WORKING PAPERS 1018, Institute of Economics, Centre for Economic and Regional Studies.
    • Handle: RePEc:has:discpr:1018
    as

    Download full text from publisher

    File URL: http://econ.core.hu/file/download/MTDP/MTDP1018.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Jeno Koltay, 2010. "Multinational Companies and Labour Relations in Hungary: between Home Country - Host Country Effects and Global Tendencies," CERS-IE WORKING PAPERS 1015, Institute of Economics, Centre for Economic and Regional Studies.
    2. Gusztav Nemes, 2010. "Environmental Governance in Hungary - Rural Development Policies and Social Learning during the Implementation of EU Agri-Environmental Policies - A Case Study," CERS-IE WORKING PAPERS 1008, Institute of Economics, Centre for Economic and Regional Studies.
    3. Pranab Bardhan, 2003. "Journal publication in economics: a view from the periphery," Economic Journal, Royal Economic Society, vol. 113(488), pages 332-337, June.
    4. Ignacio Palacios-Huerta & Oscar Volij, 2004. "The Measurement of Intellectual Influence," Econometrica, Econometric Society, vol. 72(3), pages 963-977, May.
    5. Kalaitzidakis, P. & Mamuneas, T.P. & Stengos, T., 2003. "Rankings of Academic Journals and Institutions," Working Papers 2003-8, University of Guelph, Department of Economics and Finance.
    6. Laband, David N & Piette, Michael J, 1994. "The Relative Impacts of Economics Journals: 1970-1990," Journal of Economic Literature, American Economic Association, vol. 32(2), pages 640-666, June.
    7. Liebowitz, S J & Palmer, J P, 1984. "Assessing the Relative Impacts of Economic Journals," Journal of Economic Literature, American Economic Association, vol. 22(1), pages 77-88, March.
    8. Pantelis Kalaitzidakis & Theofanis P. Mamuneas & Thanasis Stengos, 2003. "Rankings of Academic Journals and Institutions in Economics," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1346-1366, December.
    9. László Á. Kóczy & Alexandru Nichifor & Martin Strobel, 2010. "Intellectual Infl uence: Quality versus Quantity," Working Paper Series 1009, Óbuda University, Keleti Faculty of Business and Management.
    10. Basu, Parantap & Gillman, Max & Pearlman, Joseph, 2012. "Inflation, human capital and Tobin's q," Journal of Economic Dynamics and Control, Elsevier, vol. 36(7), pages 1057-1074.
    11. Laszlo Paizs, 2010. "Asymmetric Competition in the Setting of Diesel Excise Taxes in EU Countries," CERS-IE WORKING PAPERS 1012, Institute of Economics, Centre for Economic and Regional Studies.
    12. Békés, Gábor & Harasztosi, Péter, 2013. "Agglomeration premium and trading activity of firms," Regional Science and Urban Economics, Elsevier, vol. 43(1), pages 51-64.
    13. Mihály Laki, 2010. "The Evolution of the Market of the Hungarian Printing Industry after 1989: The End of a Success Story?," Europe-Asia Studies, Taylor & Francis Journals, vol. 62(6), pages 933-957.
    14. Cziraki, P. & de Goeij, P. C. & Renneboog, L.D.R., 2010. "Insider Trading, Option Exercises and Private Benefits of Control (Revision of DP 2010-32)," Discussion Paper 2010-90, Tilburg University, Center for Economic Research.
    15. Stigler, George J & Stigler, Stephen M & Friedland, Claire, 1995. "The Journals of Economics," Journal of Political Economy, University of Chicago Press, vol. 103(2), pages 331-359, April.
    16. Tibor Braun & Wolfgang Glänzel & András Schubert, 2006. "A Hirsch-type index for journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 69(1), pages 169-173, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Blog mentions

    As found by EconAcademics.org, the blog aggregator for Economics research:
    1. The World Cup of Economics Journals
      by László Kóczy in Game theory, research & other stuff on 2010-09-12 02:04:00

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Klaus Wohlrabe, 2016. "Taking the Temperature: A Meta-Ranking of Economics Journals," CESifo Working Paper Series 5726, CESifo.
    2. Lehmann, Robert & Wohlrabe, Klaus, 2017. "Who is the ‘Journal Grand Master’? A new ranking based on the Elo rating system," Journal of Informetrics, Elsevier, vol. 11(3), pages 800-809.
    3. László Kóczy & Alexandru Nichifor, 2013. "The intellectual influence of economic journals: quality versus quantity," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 52(3), pages 863-884, April.
    4. George Emm Halkos & Nickolaos G. Tzeremes, 2011. "Measuring economic journals’ citation efficiency: a data envelopment analysis approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(3), pages 979-1001, September.
    5. Joseph Gerald Hirschberg & Jeanette Ngaire Lye, 2020. "Grading Journals In Economics: The Abcs Of The Abdc," Journal of Economic Surveys, Wiley Blackwell, vol. 34(4), pages 876-921, September.
    6. L'aszl'o Csat'o & Csaba T'oth, 2018. "University rankings from the revealed preferences of the applicants," Papers 1810.04087, arXiv.org, revised Feb 2020.
    7. Csató, László, 2019. "Journal ranking should depend on the level of aggregation," Journal of Informetrics, Elsevier, vol. 13(4).
    8. Ho F. Chan & Franklin G. Mixon & Benno Torgler, 2018. "Relation of early career performance and recognition to the probability of winning the Nobel Prize in economics," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(3), pages 1069-1086, March.
    9. Yu, Xiaohua & Gao, Zhifeng, 2010. "An updated ranking of the economic research institutions in China (2000-2009)," China Economic Review, Elsevier, vol. 21(4), pages 571-581, December.
    10. Ho Fai Chan & Bruno S. Frey & Jana Gallus & Benno Torgler, 2013. "Does the John Bates Clark Medal boost subsequent productivity and citation success?," ECON - Working Papers 111, Department of Economics - University of Zurich.
    11. Robert Hofmeister, 2011. "Measuring the Value of Research: A Generational Accounting Approach," Working Paper Series of the Department of Economics, University of Konstanz 2011-07, Department of Economics, University of Konstanz.
    12. Lutz Bornmann & Alexander Butz & Klaus Wohlrabe, 2018. "What are the top five journals in economics? A new meta-ranking," Applied Economics, Taylor & Francis Journals, vol. 50(6), pages 659-675, February.
    13. Pislyakov, Vladimir, 2022. "On some properties of medians, percentiles, baselines, and thresholds in empirical bibliometric analysis," Journal of Informetrics, Elsevier, vol. 16(4).
    14. Klaus Ritzberger, 2008. "A Ranking of Journals in Economics and Related Fields," German Economic Review, Verein für Socialpolitik, vol. 9, pages 402-430, November.
    15. Csató, László & Tóth, Csaba, 2020. "University rankings from the revealed preferences of the applicants," European Journal of Operational Research, Elsevier, vol. 286(1), pages 309-320.
    16. Chan, Ho Fai & Frey, Bruno S. & Gallus, Jana & Torgler, Benno, 2014. "Academic honors and performance," Labour Economics, Elsevier, vol. 31(C), pages 188-204.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Klaus Ritzberger, 2008. "Eine invariante Bewertung wirtschaftswissenschaftlicher Fachzeitschriften," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 9(3), pages 267-285, August.
    2. Koczy, L. & Nichifor, A. & Strobel, M., 2010. "Intellectual Influence: quality versus quantity," Research Memorandum 029, Maastricht University, Maastricht Research School of Economics of Technology and Organization (METEOR).
    3. Wohlrabe, Klaus, 2016. "Taking the Temperature: A Meta-Ranking of Economics Journals," MPRA Paper 68933, University Library of Munich, Germany.
    4. Pantelis Kalaitzidakis & Theofanis P. Mamuneas & Thanasis Stengos, 2011. "An updated ranking of academic journals in economics," Canadian Journal of Economics, Canadian Economics Association, vol. 44(4), pages 1525-1538, November.
    5. Erich Battistin & Marco Ovidi, 2022. "Rising Stars: Expert Reviews and Reputational Yardsticks in the Research Excellence Framework," Economica, London School of Economics and Political Science, vol. 89(356), pages 830-848, October.
    6. Waltman, Ludo & van Eck, Nees Jan, 2008. "Some comments on the journal weighted impact factor proposed by Habibzadeh and Yadollahie," Journal of Informetrics, Elsevier, vol. 2(4), pages 369-372.
    7. Klaus Ritzberger, 2008. "A Ranking of Journals in Economics and Related Fields," German Economic Review, Verein für Socialpolitik, vol. 9, pages 402-430, November.
    8. Kóczy, L.Á. & Nichifor, A. & Strobel, M., 2009. "Article length bias in journal rankings," Research Memorandum 016, Maastricht University, Maastricht Research School of Economics of Technology and Organization (METEOR).
    9. Chagas , André Luis Squarize, 2017. "Publish or Perish: um ranking de revistas da subárea de Economia Regional e Urbana para os pesquisadores brasileiros," Revista Brasileira de Estudos Regionais e Urbanos, Associação Brasileira de Estudos Regionais e Urbanos (ABER), vol. 11(4), pages 515-536.
    10. Battistin, Erich & Ovidi, Marco, 2017. "Rising Stars," IZA Discussion Papers 11198, Institute of Labor Economics (IZA).
    11. Ham, John C. & Wright, Julian & Ye, Ziqiu, 2023. "Documenting and Explaining the Dramatic Rise of the New Society Journals in Economics," IZA Discussion Papers 16337, Institute of Labor Economics (IZA).
    12. George Emm Halkos & Nickolaos G. Tzeremes, 2011. "Measuring economic journals’ citation efficiency: a data envelopment analysis approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(3), pages 979-1001, September.
    13. Pedro Cosme Vieira & Aurora A. C. Teixeira, 2010. "Are finance, management, and marketing autonomous fields of scientific research? An analysis based on journal citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(3), pages 627-646, December.
    14. László Kóczy & Alexandru Nichifor, 2013. "The intellectual influence of economic journals: quality versus quantity," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 52(3), pages 863-884, April.
    15. Lutz Bornmann & Alexander Butz & Klaus Wohlrabe, 2018. "What are the top five journals in economics? A new meta-ranking," Applied Economics, Taylor & Francis Journals, vol. 50(6), pages 659-675, February.
    16. Howard J. Wall, 2009. "Journal rankings in economics: handle with care," Working Papers 2009-014, Federal Reserve Bank of St. Louis.
    17. Tombazos, Christis G. & Dobra, Matthew, 2014. "Formulating research policy on expert advice," European Economic Review, Elsevier, vol. 72(C), pages 166-181.
    18. Melody Lo & M. C. Sunny Wong & Franklin G. Mixon, 2008. "Ranking Economics Journals, Economics Departments, and Economists Using Teaching‐Focused Research Productivity," Southern Economic Journal, John Wiley & Sons, vol. 74(3), pages 894-906, January.
    19. David L. Anderson & John Tressler, 2013. "The Relevance of the “h-” and “g-” Index to Economics in the Context of A Nation-Wide Research Evaluation Scheme: The New Zealand Case," Economic Papers, The Economic Society of Australia, vol. 32(1), pages 81-94, March.
    20. J. A. García & Rosa Rodriguez-Sánchez & J. Fdez-Valdivia & J. Martinez-Baena, 2012. "On first quartile journals which are not of highest impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 90(3), pages 925-943, March.

    More about this item

    Keywords

    journal ranking; incomplete tournaments; manipulation; invariance; scientometrics;
    All these keywords.

    JEL classification:

    • A1 - General Economics and Teaching - - General Economics
    • C8 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs
    • D72 - Microeconomics - - Analysis of Collective Decision-Making - - - Political Processes: Rent-seeking, Lobbying, Elections, Legislatures, and Voting Behavior
    • Y1 - Miscellaneous Categories - - Data: Tables and Charts

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:has:discpr:1018. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Nora Horvath (email available below). General contact details of provider: https://edirc.repec.org/data/iehashu.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.