IDEAS home Printed from https://ideas.repec.org/p/eei/rpaper/eeri_rp_2011_13.html
   My bibliography  Save this paper

Measuring Economic Journals' Citation Efficiency: A Data Envelopment Analysis Approach

Author

Listed:
  • George Emm. Halkos
  • Nickolaos G. Tzeremes

Abstract

This paper by using Data Envelopment Analysis (DEA) and statistical inference evaluates the citation performance of 229 economic journals. The paper categorizes the journals into four main categories (A to D) based on their efficiency levels. The results are then compared to the 27 “core economic journals” as introduced by Dimond (1989). The results reveal that after more than twenty years Diamonds’ list of “core economic journals” is still valid. Finally, for the first time the paper uses data from four well-known databases (SSCI, Scopus, RePEc, Econlit) and two quality ranking reports (Kiel Institute internals ranking and ABS quality ranking report) in a DEA setting and in order to derive the ranking of 229 economic journals. The ten economic journals with the highest citation performance are Journal of Political Economy, Econometrica, Quarterly Journal of Economics, Journal of Financial Economics, Journal of Economic Literature, American Economic Review, Review of Economic Studies, Journal of Econometrics, Journal of Finance, Brookings Papers on Economic Activity.

Suggested Citation

  • George Emm. Halkos & Nickolaos G. Tzeremes, 2011. "Measuring Economic Journals' Citation Efficiency: A Data Envelopment Analysis Approach," EERI Research Paper Series EERI_RP_2011_13, Economics and Econometrics Research Institute (EERI), Brussels.
  • Handle: RePEc:eei:rpaper:eeri_rp_2011_13
    as

    Download full text from publisher

    File URL: http://www.eeri.eu/documents/wp/EERI_RP_2011_13.pdf
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. Leopold Simar & Paul Wilson, 2000. "A general methodology for bootstrapping in non-parametric frontier models," Journal of Applied Statistics, Taylor & Francis Journals, vol. 27(6), pages 779-802.
    2. H. L. Patterson, 1957. "Discussion," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 5(1), pages 20-23, March.
    3. R. D. Banker & A. Charnes & W. W. Cooper, 1984. "Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis," Management Science, INFORMS, vol. 30(9), pages 1078-1092, September.
    4. Burton, M P & Phimister, Euan, 1995. "Core Journals: A Reappraisal of the Diamond List," Economic Journal, Royal Economic Society, vol. 105(429), pages 361-373, March.
    5. Léopold Simar & Paul Wilson, 2000. "Statistical Inference in Nonparametric Frontier Models: The State of the Art," Journal of Productivity Analysis, Springer, vol. 13(1), pages 49-78, January.
    6. Pantelis Kalaitzidakis & Theofanis P. Mamuneas & Thanasis Stengos, 2011. "An updated ranking of academic journals in economics," Canadian Journal of Economics, Canadian Economics Association, vol. 44(4), pages 1525-1538, November.
    7. Kodrzycki Yolanda K. & Yu Pingkang, 2006. "New Approaches to Ranking Economics Journals," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 5(1), pages 1-44, August.
    8. Francesc Pujol, 2008. "Ranking Journals Following a Matching Model Approach: An Application to Public Economics Journals," Journal of Public Economic Theory, Association for Public Economic Theory, vol. 10(1), pages 55-76, February.
    9. Léopold Simar & Paul W. Wilson, 1998. "Sensitivity Analysis of Efficiency Scores: How to Bootstrap in Nonparametric Frontier Models," Management Science, INFORMS, vol. 44(1), pages 49-61, January.
    10. Finn Førsund & Nikias Sarafoglou, 2002. "On the Origins of Data Envelopment Analysis," Journal of Productivity Analysis, Springer, vol. 17(1), pages 23-40, January.
    11. repec:spr:scient:v:82:y:2010:i:2:d:10.1007_s11192-009-0043-9 is not listed on IDEAS
    12. Moed, Henk F., 2010. "Measuring contextual citation impact of scientific journals," Journal of Informetrics, Elsevier, vol. 4(3), pages 265-277.
    13. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    14. Friedrich Schneider & Heinrich W. Ursprung, 2008. "The 2008 GEA Journal-Ranking for the Economics Profession," German Economic Review, Verein für Socialpolitik, vol. 9, pages 532-538, November.
    15. Loet Leydesdorff & Félix de Moya-Anegón & Vicente P. Guerrero-Bote, 2010. "Journal maps on the basis of Scopus data: A comparison with the Journal Citation Reports of the ISI," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 61(2), pages 352-369, February.
    16. Førsund, Finn R. & Kittelsen, Sverre A. & Krivonozhko, Vladimir E., 2007. "Farrell Revisited: Visualising the DEA Production Frontier," Memorandum 15/2007, Oslo University, Department of Economics.
    17. Laband, David N & Piette, Michael J, 1994. "The Relative Impacts of Economics Journals: 1970-1990," Journal of Economic Literature, American Economic Association, vol. 32(2), pages 640-666, June.
    18. George Emm. Halkos & Nickolaos G. Tzeremes, 2007. "International Competitiveness in the ICT Industry: Evaluating the Performance of the Top 50 Companies," Global Economic Review, Taylor & Francis Journals, vol. 36(2), pages 167-182.
    19. Pantelis Kalaitzidakis & Theofanis P. Mamuneas & Thanasis Stengos, 2003. "Rankings of Academic Journals and Institutions in Economics," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1346-1366, December.
    20. Liebowitz, S J & Palmer, J P, 1984. "Assessing the Relative Impacts of Economic Journals," Journal of Economic Literature, American Economic Association, vol. 22(1), pages 77-88, March.
    21. A. W. Wood, 1957. "Discussion," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 5(2), pages 62-64, July.
    22. Ignacio Palacios-Huerta & Oscar Volij, 2004. "The Measurement of Intellectual Influence," Econometrica, Econometric Society, vol. 72(3), pages 963-977, May.
    23. Gaines Liner & Minesh Amin, 2004. "Methods of ranking economics journals," Atlantic Economic Journal, Springer;International Atlantic Economic Society, vol. 32(2), pages 140-149, June.
    24. repec:spr:scient:v:74:y:2008:i:1:d:10.1007_s11192-008-0101-8 is not listed on IDEAS
    25. Simar, Leopold & Wilson, Paul W., 2002. "Non-parametric tests of returns to scale," European Journal of Operational Research, Elsevier, vol. 139(1), pages 115-132, May.
    26. Klaus Ritzberger, 2008. "A Ranking of Journals in Economics and Related Fields," German Economic Review, Verein für Socialpolitik, vol. 9, pages 402-430, November.
    27. Laszlo A. Koczy & Martin Strobel, 2010. "The World Cup of Economics Journals: A Ranking by a Tournament Method," IEHAS Discussion Papers 1018, Institute of Economics, Centre for Economic and Regional Studies, Hungarian Academy of Sciences.
    28. repec:spr:scient:v:83:y:2010:i:1:d:10.1007_s11192-009-0021-2 is not listed on IDEAS
    29. George Halkos & Nickolaos Tzeremes, 2010. "The effect of foreign ownership on SMEs performance: An efficiency analysis perspective," Journal of Productivity Analysis, Springer, vol. 34(2), pages 167-180, October.
    30. Coelli, Tim & Perelman, Sergio, 1999. "A comparison of parametric and non-parametric distance functions: With application to European railways," European Journal of Operational Research, Elsevier, vol. 117(2), pages 326-339, September.
    31. Kalaitzidakis, P. & Mamuneas, T.P. & Stengos, T., 2003. "Rankings of Academic Journals and Institutions," Working Papers 2003-8, University of Guelph, Department of Economics and Finance.
    32. Norris, Michael & Oppenheim, Charles, 2007. "Comparing alternatives to the Web of Science for coverage of the social sciences’ literature," Journal of Informetrics, Elsevier, vol. 1(2), pages 161-169.
    33. repec:spr:scient:v:74:y:2008:i:2:d:10.1007_s11192-008-0217-x is not listed on IDEAS
    34. López-Illescas, Carmen & de Moya-Anegón, Félix & Moed, Henk F., 2008. "Coverage and citation impact of oncological journals in the Web of Science and Scopus," Journal of Informetrics, Elsevier, vol. 2(4), pages 304-316.
    35. repec:spr:scient:v:53:y:2002:i:2:d:10.1023_a:1014848323806 is not listed on IDEAS
    36. repec:spr:scient:v:66:y:2006:i:2:d:10.1007_s11192-006-0028-x is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Halkos, George & Tzeremes, Nickolaos, 2012. "Ranking the ‘Diamond Core’ economic journals: A note," MPRA Paper 36589, University Library of Munich, Germany.
    2. Wohlrabe, Klaus, 2016. "Taking the Temperature: A Meta-Ranking of Economics Journals," MPRA Paper 68933, University Library of Munich, Germany.
    3. Biresh K Sahoo & Ramadhar Singh & Bineet Mishra & Krithiga Sankaran, 2015. "Research Productivity in Management Schools of India: A Directional Benefit-of-Doubt Model Analysis," Working Papers id:7139, eSocialSciences.
    4. David I. Stern, 2013. "Uncertainty Measures for Economics Journal Impact Factors," Journal of Economic Literature, American Economic Association, vol. 51(1), pages 173-189, March.
    5. Tüselmann, Heinz & Sinkovics, Rudolf R. & Pishchulov, Grigory, 2016. "Revisiting the standing of international business journals in the competitive landscape," Journal of World Business, Elsevier, vol. 51(4), pages 487-498.
    6. Seiler, Christian & Wohlrabe, Klaus, 2013. "Archetypal scientists," Journal of Informetrics, Elsevier, vol. 7(2), pages 345-356.
    7. Petridis, Konstantinos & Malesios, Chrisovalantis & Arabatzis, Garyfallos & Thanassoulis, Emmanuel, 2013. "Efficiency analysis of forestry journals: Suggestions for improving journals’ quality," Journal of Informetrics, Elsevier, vol. 7(2), pages 505-521.
    8. repec:eee:jomega:v:70:y:2017:i:c:p:135-147 is not listed on IDEAS
    9. Campanario, Juan Miguel, 2014. "Analysis of the distribution of cited journals according to their positions in the h-core of citing journal listed in Journal Citation Reports," Journal of Informetrics, Elsevier, vol. 8(3), pages 534-545.
    10. Antonio García-Romero & Daniel Santín & Gabriela Sicilia, 2016. "Another brick in the wall: a new ranking of academic journals in Economics using FDH," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(1), pages 91-101, April.
    11. Laura Vana & Ronald Hochreiter & Kurt Hornik, 2016. "Computing a journal meta-ranking using paired comparisons and adaptive lasso estimators," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(1), pages 229-251, January.
    12. Frederic S. Lee & Xuan Pham & Gyun Gu, 2013. "The UK Research Assessment Exercise and the narrowing of UK economics," Cambridge Journal of Economics, Oxford University Press, vol. 37(4), pages 693-717.
    13. Lutz Bornmann & Alexander Butz & Klaus Wohlrabe, 2018. "What are the top five journals in economics? A new meta-ranking," Applied Economics, Taylor & Francis Journals, vol. 50(6), pages 659-675, February.
    14. Sahoo, Biresh K. & Singh, Ramadhar & Mishra, Bineet & Sankaran, Krithiga, 2017. "Research productivity in management schools of India during 1968-2015: A directional benefit-of-doubt model analysis," Omega, Elsevier, vol. 66(PA), pages 118-139.
    15. Tüselmann, Heinz & Sinkovics, Rudolf R. & Pishchulov, Grigory, 2015. "Towards a consolidation of worldwide journal rankings – A classification using random forests and aggregate rating via data envelopment analysis," Omega, Elsevier, vol. 51(C), pages 11-23.

    More about this item

    Keywords

    Ranking journals; Data Envelopment Analysis; Indexing techniques; Nonparametric analysis.;

    JEL classification:

    • C02 - Mathematical and Quantitative Methods - - General - - - Mathematical Economics
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis
    • C67 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Input-Output Models

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eei:rpaper:eeri_rp_2011_13. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Julia van Hove). General contact details of provider: http://edirc.repec.org/data/eeriibe.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.