IDEAS home Printed from https://ideas.repec.org/p/pra/mprapa/29893.html
   My bibliography  Save this paper

Measuring economic journals’ citation efficiency: A data envelopment analysis approach

Author

Listed:
  • Halkos, George
  • Tzeremes, Nickolaos

Abstract

This paper by using Data Envelopment Analysis (DEA) and statistical inference evaluates the citation performance of 229 economic journals. The paper categorizes the journals into four main categories (A to D) based on their efficiency levels. The results are then compared to the 27 “core economic journals” as introduced by Dimond (1989). The results reveal that after more than twenty years Diamonds’ list of “core economic journals” is still valid. Finally, for the first time the paper uses data from four well-known databases (SSCI, Scopus, RePEc, Econlit) and two quality ranking reports (Kiel Institute internals ranking and ABS quality ranking report) in a DEA setting and in order to derive the ranking of 229 economic journals. The ten economic journals with the highest citation performance are Journal of Political Economy, Econometrica, Quarterly Journal of Economics, Journal of Financial Economics, Journal of Economic Literature, American Economic Review, Review of Economic Studies, Journal of Econometrics, Journal of Finance, Brookings Papers on Economic Activity.

Suggested Citation

  • Halkos, George & Tzeremes, Nickolaos, 2011. "Measuring economic journals’ citation efficiency: A data envelopment analysis approach," MPRA Paper 29893, University Library of Munich, Germany.
  • Handle: RePEc:pra:mprapa:29893
    as

    Download full text from publisher

    File URL: https://mpra.ub.uni-muenchen.de/29893/1/MPRA_paper_29893.pdf
    File Function: original version
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. Leopold Simar & Paul Wilson, 2000. "A general methodology for bootstrapping in non-parametric frontier models," Journal of Applied Statistics, Taylor & Francis Journals, vol. 27(6), pages 779-802.
    2. Léopold Simar & Paul Wilson, 2000. "Statistical Inference in Nonparametric Frontier Models: The State of the Art," Journal of Productivity Analysis, Springer, vol. 13(1), pages 49-78, January.
    3. Pantelis Kalaitzidakis & Theofanis P. Mamuneas & Thanasis Stengos, 2011. "An updated ranking of academic journals in economics," Canadian Journal of Economics, Canadian Economics Association, vol. 44(4), pages 1525-1538, November.
    4. Kodrzycki Yolanda K. & Yu Pingkang, 2006. "New Approaches to Ranking Economics Journals," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 5(1), pages 1-44, August.
    5. George Emm. Halkos & Nickolaos G. Tzeremes, 2007. "International Competitiveness in the ICT Industry: Evaluating the Performance of the Top 50 Companies," Global Economic Review, Taylor & Francis Journals, vol. 36(2), pages 167-182.
    6. Ignacio Palacios-Huerta & Oscar Volij, 2004. "The Measurement of Intellectual Influence," Econometrica, Econometric Society, vol. 72(3), pages 963-977, May.
    7. Klaus Ritzberger, 2008. "A Ranking of Journals in Economics and Related Fields," German Economic Review, Verein für Socialpolitik, vol. 9, pages 402-430, November.
    8. Kalaitzidakis, P. & Mamuneas, T.P. & Stengos, T., 2003. "Rankings of Academic Journals and Institutions," Working Papers 2003-8, University of Guelph, Department of Economics and Finance.
    9. Norris, Michael & Oppenheim, Charles, 2007. "Comparing alternatives to the Web of Science for coverage of the social sciences’ literature," Journal of Informetrics, Elsevier, vol. 1(2), pages 161-169.
    10. repec:spr:scient:v:53:y:2002:i:2:d:10.1023_a:1014848323806 is not listed on IDEAS
    11. repec:spr:scient:v:66:y:2006:i:2:d:10.1007_s11192-006-0028-x is not listed on IDEAS
    12. Burton, M P & Phimister, Euan, 1995. "Core Journals: A Reappraisal of the Diamond List," Economic Journal, Royal Economic Society, vol. 105(429), pages 361-373, March.
    13. Finn Førsund & Nikias Sarafoglou, 2002. "On the Origins of Data Envelopment Analysis," Journal of Productivity Analysis, Springer, vol. 17(1), pages 23-40, January.
    14. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    15. Friedrich Schneider & Heinrich W. Ursprung, 2008. "The 2008 GEA Journal-Ranking for the Economics Profession," German Economic Review, Verein für Socialpolitik, vol. 9, pages 532-538, November.
    16. Loet Leydesdorff & Félix de Moya-Anegón & Vicente P. Guerrero-Bote, 2010. "Journal maps on the basis of Scopus data: A comparison with the Journal Citation Reports of the ISI," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 61(2), pages 352-369, February.
    17. Førsund, Finn R. & Kittelsen, Sverre A. & Krivonozhko, Vladimir E., 2007. "Farrell Revisited: Visualising the DEA Production Frontier," Memorandum 15/2007, Oslo University, Department of Economics.
    18. Laband, David N & Piette, Michael J, 1994. "The Relative Impacts of Economics Journals: 1970-1990," Journal of Economic Literature, American Economic Association, vol. 32(2), pages 640-666, June.
    19. Pantelis Kalaitzidakis & Theofanis P. Mamuneas & Thanasis Stengos, 2003. "Rankings of Academic Journals and Institutions in Economics," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1346-1366, December.
    20. Liebowitz, S J & Palmer, J P, 1984. "Assessing the Relative Impacts of Economic Journals," Journal of Economic Literature, American Economic Association, vol. 22(1), pages 77-88, March.
    21. Gaines Liner & Minesh Amin, 2004. "Methods of ranking economics journals," Atlantic Economic Journal, Springer;International Atlantic Economic Society, vol. 32(2), pages 140-149, June.
    22. repec:spr:scient:v:74:y:2008:i:1:d:10.1007_s11192-008-0101-8 is not listed on IDEAS
    23. repec:spr:scient:v:83:y:2010:i:1:d:10.1007_s11192-009-0021-2 is not listed on IDEAS
    24. George Halkos & Nickolaos Tzeremes, 2010. "The effect of foreign ownership on SMEs performance: An efficiency analysis perspective," Journal of Productivity Analysis, Springer, vol. 34(2), pages 167-180, October.
    25. Coelli, Tim & Perelman, Sergio, 1999. "A comparison of parametric and non-parametric distance functions: With application to European railways," European Journal of Operational Research, Elsevier, vol. 117(2), pages 326-339, September.
    26. López-Illescas, Carmen & de Moya-Anegón, Félix & Moed, Henk F., 2008. "Coverage and citation impact of oncological journals in the Web of Science and Scopus," Journal of Informetrics, Elsevier, vol. 2(4), pages 304-316.
    27. Francesc Pujol, 2008. "Ranking Journals Following a Matching Model Approach: An Application to Public Economics Journals," Journal of Public Economic Theory, Association for Public Economic Theory, vol. 10(1), pages 55-76, February.
    28. Léopold Simar & Paul W. Wilson, 1998. "Sensitivity Analysis of Efficiency Scores: How to Bootstrap in Nonparametric Frontier Models," Management Science, INFORMS, vol. 44(1), pages 49-61, January.
    29. repec:spr:scient:v:82:y:2010:i:2:d:10.1007_s11192-009-0043-9 is not listed on IDEAS
    30. Moed, Henk F., 2010. "Measuring contextual citation impact of scientific journals," Journal of Informetrics, Elsevier, vol. 4(3), pages 265-277.
    31. Simar, Leopold & Wilson, Paul W., 2002. "Non-parametric tests of returns to scale," European Journal of Operational Research, Elsevier, vol. 139(1), pages 115-132, May.
    32. Laszlo A. Koczy & Martin Strobel, 2010. "The World Cup of Economics Journals: A Ranking by a Tournament Method," IEHAS Discussion Papers 1018, Institute of Economics, Centre for Economic and Regional Studies, Hungarian Academy of Sciences.
    33. H. L. Patterson, 1957. "Discussion," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 5(1), pages 20-23, March.
    34. R. D. Banker & A. Charnes & W. W. Cooper, 1984. "Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis," Management Science, INFORMS, vol. 30(9), pages 1078-1092, September.
    35. A. W. Wood, 1957. "Discussion," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 5(2), pages 62-64, July.
    36. repec:spr:scient:v:74:y:2008:i:2:d:10.1007_s11192-008-0217-x is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Halkos, George & Tzeremes, Nickolaos, 2012. "Ranking the ‘Diamond Core’ economic journals: A note," MPRA Paper 36589, University Library of Munich, Germany.
    2. Klaus Wohlrabe, 2016. "Taking the Temperature: A Meta-Ranking of Economics Journals," CESifo Working Paper Series 5726, CESifo Group Munich.
    3. Laura Vana & Ronald Hochreiter & Kurt Hornik, 2016. "Computing a journal meta-ranking using paired comparisons and adaptive lasso estimators," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(1), pages 229-251, January.
    4. Biresh K Sahoo & Ramadhar Singh & Bineet Mishra & Krithiga Sankaran, 2015. "Research Productivity in Management Schools of India: A Directional Benefit-of-Doubt Model Analysis," Working Papers id:7139, eSocialSciences.
    5. David I. Stern, 2013. "Uncertainty Measures for Economics Journal Impact Factors," Journal of Economic Literature, American Economic Association, vol. 51(1), pages 173-189, March.
    6. Tüselmann, Heinz & Sinkovics, Rudolf R. & Pishchulov, Grigory, 2016. "Revisiting the standing of international business journals in the competitive landscape," Journal of World Business, Elsevier, vol. 51(4), pages 487-498.
    7. Frederic S. Lee & Xuan Pham & Gyun Gu, 2013. "The UK Research Assessment Exercise and the narrowing of UK economics," Cambridge Journal of Economics, Oxford University Press, vol. 37(4), pages 693-717.
    8. Seiler, Christian & Wohlrabe, Klaus, 2013. "Archetypal scientists," Journal of Informetrics, Elsevier, vol. 7(2), pages 345-356.
    9. Petridis, Konstantinos & Malesios, Chrisovalantis & Arabatzis, Garyfallos & Thanassoulis, Emmanuel, 2013. "Efficiency analysis of forestry journals: Suggestions for improving journals’ quality," Journal of Informetrics, Elsevier, vol. 7(2), pages 505-521.
    10. Lutz Bornmann & Alexander Butz & Klaus Wohlrabe, 2018. "What are the top five journals in economics? A new meta-ranking," Applied Economics, Taylor & Francis Journals, vol. 50(6), pages 659-675, February.
    11. Sahoo, Biresh K. & Singh, Ramadhar & Mishra, Bineet & Sankaran, Krithiga, 2017. "Research productivity in management schools of India during 1968-2015: A directional benefit-of-doubt model analysis," Omega, Elsevier, vol. 66(PA), pages 118-139.
    12. repec:eee:jomega:v:70:y:2017:i:c:p:135-147 is not listed on IDEAS
    13. Campanario, Juan Miguel, 2014. "Analysis of the distribution of cited journals according to their positions in the h-core of citing journal listed in Journal Citation Reports," Journal of Informetrics, Elsevier, vol. 8(3), pages 534-545.
    14. Antonio García-Romero & Daniel Santín & Gabriela Sicilia, 2016. "Another brick in the wall: a new ranking of academic journals in Economics using FDH," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(1), pages 91-101, April.
    15. Tüselmann, Heinz & Sinkovics, Rudolf R. & Pishchulov, Grigory, 2015. "Towards a consolidation of worldwide journal rankings – A classification using random forests and aggregate rating via data envelopment analysis," Omega, Elsevier, vol. 51(C), pages 11-23.

    More about this item

    Keywords

    Ranking journals; Data Envelopment Analysis; Indexing techniques; Nonparametric analysis;

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C02 - Mathematical and Quantitative Methods - - General - - - Mathematical Economics
    • C61 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Optimization Techniques; Programming Models; Dynamic Analysis
    • C67 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Input-Output Models

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:29893. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Joachim Winter). General contact details of provider: http://edirc.repec.org/data/vfmunde.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.