IDEAS home Printed from https://ideas.repec.org/p/shf/wpaper/2015011.html
   My bibliography  Save this paper

Ranking economics journals using data from a national research evaluation exercise

Author

Listed:
  • Arne Risa Hole

    (Department of Economics, University of Sheffield)

Abstract

This paper describes an algorithm for creating a ranking of economics journals using data from the 2014 UK Research Excellence Framework (REF) exercise. The ranking generated by the algorithm can be viewed as a measure of the average quality of the papers published in the journal, as judged by the REF Economics and Econometrics sub-panel, based on the outputs submitted to the REF.

Suggested Citation

  • Arne Risa Hole, 2015. "Ranking economics journals using data from a national research evaluation exercise," Working Papers 2015011, The University of Sheffield, Department of Economics.
  • Handle: RePEc:shf:wpaper:2015011
    as

    Download full text from publisher

    File URL: http://www.sheffield.ac.uk/economics/research/serps/articles/2015_011
    File Function: First version, March 2015
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Cristiano Varin & Manuela Cattelan & David Firth, 2016. "Statistical modelling of citation exchange between statistics journals," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 179(1), pages 1-63, January.
    2. Pantelis Kalaitzidakis & Theofanis P. Mamuneas & Thanasis Stengos, 2011. "An updated ranking of academic journals in economics," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 44(4), pages 1525-1538, November.
    3. J. Peter Neary & James A. Mirrlees & Jean Tirole, 2003. "Evaluating Economics Research in Europe: An Introduction," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1239-1249, December.
    4. David Card & Stefano DellaVigna, 2013. "Nine Facts about Top Journals in Economics," Journal of Economic Literature, American Economic Association, vol. 51(1), pages 144-161, March.
    5. John Hudson, 2013. "Ranking Journals," Economic Journal, Royal Economic Society, vol. 0, pages 202-222, August.
    6. Sofronis Clerides & Panos Pashardes & Alexandros Polycarpou, 2011. "Peer Review vs Metric‐based Assessment: Testing for Bias in the RAE Ratings of UK Economics Departments," Economica, London School of Economics and Political Science, vol. 78(311), pages 565-583, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Richard McManus & Karen Mumford & Cristina Sechel, 2017. "The Selection of Economics Lecturers into the 2014 UK Research Excellence Framework Exercise: Outputs and Gender," Discussion Papers 17/16, Department of Economics, University of York.
    2. Yves Fassin, 2021. "Does the Financial Times FT50 journal list select the best management and economics journals?," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 5911-5943, July.
    3. Drivas, Kyriakos & Kremmydas, Dimitris, 2020. "The Matthew effect of a journal's ranking," Research Policy, Elsevier, vol. 49(4).
    4. Ms. Juliana Dutra Araujo & Manasa Patnam & Ms. Adina Popescu & Mr. Fabian Valencia & Weijia Yao, 2020. "Effects of Macroprudential Policy: Evidence from Over 6,000 Estimates," IMF Working Papers 2020/067, International Monetary Fund.
    5. Battistin, Erich & Ovidi, Marco, 2017. "Rising Stars," IZA Discussion Papers 11198, Institute of Labor Economics (IZA).
    6. Linton, O. B. & Xu, E., 2022. "Auditing the Auditors: An evaluation of the REF2021 Output Results," Cambridge Working Papers in Economics 2266, Faculty of Economics, University of Cambridge.
    7. Murat Çokgezen, 2019. "Research Performance of Turkish Economists and Economics Departments: Another Update and a Review of the 2000s," Emerging Markets Finance and Trade, Taylor & Francis Journals, vol. 55(1), pages 133-149, January.
    8. Richard McManus & Karen Mumford & Cristina Sechel, 2022. "Measuring research excellence amongst economics lecturers in the UK," Bulletin of Economic Research, Wiley Blackwell, vol. 74(2), pages 386-404, April.
    9. Syed Hasan & Robert Breunig, 2021. "Article length and citation outcomes," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 7583-7608, September.
    10. Zahid Halim & Shafaq Khan, 2019. "A data science-based framework to categorize academic journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(1), pages 393-423, April.
    11. Erich Battistin & Marco Ovidi, 2022. "Rising Stars: Expert Reviews and Reputational Yardsticks in the Research Excellence Framework," Economica, London School of Economics and Political Science, vol. 89(356), pages 830-848, October.
    12. Banal-Estañol, Albert & Jofre-Bonet, Mireia & Iori, Giulia & Maynou, Laia & Tumminello, Michele & Vassallo, Pietro, 2023. "Performance-based research funding: Evidence from the largest natural experiment worldwide," Research Policy, Elsevier, vol. 52(6).
    13. Linton, O. B. & Xu, E., 2022. "Auditing the Auditors: An evaluation of the REF2021 Output Results," Janeway Institute Working Papers 2228, Faculty of Economics, University of Cambridge.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Stelios Katranidis & Theodore Panagiotidis & Costas Zontanos, 2014. "An Evaluation Of The Greek Universities’ Economics Departments," Bulletin of Economic Research, Wiley Blackwell, vol. 66(2), pages 173-182, April.
    2. Battistin, Erich & Ovidi, Marco, 2017. "Rising Stars," IZA Discussion Papers 11198, Institute of Labor Economics (IZA).
    3. Lutz Bornmann & Alexander Butz & Klaus Wohlrabe, 2018. "What are the top five journals in economics? A new meta-ranking," Applied Economics, Taylor & Francis Journals, vol. 50(6), pages 659-675, February.
    4. Matthias Aistleitner & Jakob Kapeller & Stefan Steinerberger, 2018. "Citation Patterns in Economics and Beyond," Working Papers Series 85, Institute for New Economic Thinking.
    5. Erich Battistin & Marco Ovidi, 2022. "Rising Stars: Expert Reviews and Reputational Yardsticks in the Research Excellence Framework," Economica, London School of Economics and Political Science, vol. 89(356), pages 830-848, October.
    6. Martina Cioni & Giovanni Federico & Michelangelo Vasta, 2021. "The State of the Art of Economic History: The Uneasy Relation with Economics," Working Papers 20210067, New York University Abu Dhabi, Department of Social Science, revised Jun 2021.
    7. Wohlrabe, Klaus, 2016. "Taking the Temperature: A Meta-Ranking of Economics Journals," MPRA Paper 68933, University Library of Munich, Germany.
    8. José Alberto Molina & Alberto Alcolea & Alfredo Ferrer & Alberto Alcolea & David Iñiguez & Alejandro Rivero & Gonzalo Ruiz & Alfonso Tarancón, 2016. "Co-authorship and Academic Productivity in Economics: Interaction Maps from the Complex Networks Approach," Boston College Working Papers in Economics 914, Boston College Department of Economics.
    9. Aistleitner, Matthias & Kapeller, Jakob & Kronberger, Dominik, 2022. "The authors of economics journals revisited: Evidence from a large-scale replication of Hodgson & Rothman (1999)," ifso working paper series 20, University of Duisburg-Essen, Institute for Socioeconomics (ifso).
    10. repec:esx:essedp:757 is not listed on IDEAS
    11. Stelios Katranidis & Theodore Panagiotidis & Costas Zontanos, 2017. "Economists, Research Performance and National Inbreeding: North Versus South," Economic Notes, Banca Monte dei Paschi di Siena SpA, vol. 46(1), pages 145-163, February.
    12. Aistleitner, Matthias & Kapeller, Jakob & Kronberger, Dominik, 2023. "The authors of economics journals revisited: evidence from a large-scale replication of Hodgson and Rothman (1999)," Journal of Institutional Economics, Cambridge University Press, vol. 19(1), pages 86-101, February.
    13. José Alberto Molina & Alfredo Ferrer & David Iñiguez & Alejandro Rivero & Gonzalo Ruiz & Alfonso Tarancón, 2020. "Network analysis to measure academic performance in economics," Empirical Economics, Springer, vol. 58(3), pages 995-1018, March.
    14. Stephan B. Bruns & David I. Stern, 2016. "Research assessment using early citation information," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(2), pages 917-935, August.
    15. Cloos, Janis & Greiff, Matthias & Rusch, Hannes, 2020. "Geographical Concentration and Editorial Favoritism within the Field of Laboratory Experimental Economics (RM/19/029-revised-)," Research Memorandum 014, Maastricht University, Graduate School of Business and Economics (GSBE).
    16. Pedro Garcia Duarte & Yann Giraud, 2014. "Chasing the B: A Bibliographic Account of Economics’ Relation to its Past, 1991-2011," Working Papers, Department of Economics 2014_06, University of São Paulo (FEA-USP).
    17. Lukas Kuld & John O'Hagan, 2017. "Rise of Multi-authored Papers in Economics: Demise of the 'Lone Star' and Why?," Trinity Economics Papers tep0517, Trinity College Dublin, Department of Economics.
    18. Koffi, Marlene, 2021. "Innovative ideas and gender inequality," CLEF Working Paper Series 35, Canadian Labour Economics Forum (CLEF), University of Waterloo.
    19. Martina Cioni & Govanni Federico & Michelangelo Vasta, 2018. "Ninety years of publications in Economic History: evidence from the top five field journals (1927-2017)," Department of Economics University of Siena 791, Department of Economics, University of Siena.
    20. Claudio A. Bonilla & José M. Merigó & Carolina Torres-Abad, 2015. "Economics in Latin America: a bibliometric analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(2), pages 1239-1252, November.
    21. Régibeau, P & Rockett, K, 2014. "A Tale of Two Metrics: Research Assessment vs Recognised Excellence," Economics Discussion Papers 14461, University of Essex, Department of Economics.

    More about this item

    Keywords

    Journal ranking; Research Excellence Framework;

    JEL classification:

    • A1 - General Economics and Teaching - - General Economics

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:shf:wpaper:2015011. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Mike Crabtree (email available below). General contact details of provider: https://edirc.repec.org/data/desheuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.