IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v107y2016i1d10.1007_s11192-016-1843-3.html
   My bibliography  Save this article

Another brick in the wall: a new ranking of academic journals in Economics using FDH

Author

Listed:
  • Antonio García-Romero

    (IE University)

  • Daniel Santín

    (Complutense University of Madrid)

  • Gabriela Sicilia

    (Complutense University of Madrid)

Abstract

The academic journals rankings are widely used for academic purposes, especially in the field of Economics. There are many procedures to construct academic journals rankings. Some of them are based on citation analysis while other are based on expert opinion. In this study, we introduced a methodological innovation to aggregate different performance measures to build an alternative ranking of journals in Economics. Our approach is based on a pure output oriented Free Disposal Hull (FDH). We analyzed four indicators—Journal Impact Factor, Discounted Impact Factor, h-index, and Article Influence—for a set of 232 journals in Economics. The results allow us to reach two main conclusions. First, the ranking based on the FDH method seems to be consistent with other well-known reference rankings (i.e.: KMS, Invariant, Ambitious and Area Score). Second, the additional information that provides the FDH model may be used by the Editorial Board to formulate strategies to achieve goals. For instance, to improve a journal score by comparing it with the scores of similar journals.

Suggested Citation

  • Antonio García-Romero & Daniel Santín & Gabriela Sicilia, 2016. "Another brick in the wall: a new ranking of academic journals in Economics using FDH," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(1), pages 91-101, April.
    • Handle: RePEc:spr:scient:v:107:y:2016:i:1:d:10.1007_s11192-016-1843-3
    DOI: 10.1007/s11192-016-1843-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-016-1843-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-016-1843-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Cornillier, Fabien & Charles, Vincent, 2015. "Measuring the attractiveness of academic journals: A direct influence aggregation model," MPRA Paper 66556, University Library of Munich, Germany.
    2. Lovell, C. A. Knox & Pastor, Jesus T., 1999. "Radial DEA models without inputs or without outputs," European Journal of Operational Research, Elsevier, vol. 118(1), pages 46-51, October.
    3. Knox Lovell, C. A., 1995. "Measuring the macroeconomic performance of the Taiwanese economy," International Journal of Production Economics, Elsevier, vol. 39(1-2), pages 165-178, April.
    4. De Borger, Bruno & Kerstens, Kristiaan, 1996. "Cost efficiency of Belgian local governments: A comparative analysis of FDH, DEA, and econometric approaches," Regional Science and Urban Economics, Elsevier, vol. 26(2), pages 145-170, April.
    5. Ignacio Palacios-Huerta & Oscar Volij, 2004. "The Measurement of Intellectual Influence," Econometrica, Econometric Society, vol. 72(3), pages 963-977, May.
    6. Pantelis Kalaitzidakis & Theofanis P. Mamuneas & Thanasis Stengos, 2011. "An updated ranking of academic journals in economics," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 44(4), pages 1525-1538, November.
    7. Christian Zimmermann, 2013. "Academic Rankings with RePEc," Econometrics, MDPI, vol. 1(3), pages 1-32, December.
    8. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    9. George Emm Halkos & Nickolaos G. Tzeremes, 2011. "Measuring economic journals’ citation efficiency: a data envelopment analysis approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(3), pages 979-1001, September.
    10. Dominique Deprins & Léopold Simar & Henry Tulkens, 2006. "Measuring Labor-Efficiency in Post Offices," Springer Books, in: Parkash Chander & Jacques Drèze & C. Knox Lovell & Jack Mintz (ed.), Public goods, environmental externalities and fiscal competition, chapter 0, pages 285-309, Springer.
    11. Currie, Russell R. & Pandher, Gurupdesh S., 2011. "Finance journal rankings and tiers: An Active Scholar Assessment methodology," Journal of Banking & Finance, Elsevier, vol. 35(1), pages 7-20, January.
    12. Stefano Benati & Silvana Stefani, 2011. "The Academic Journal Ranking Problem: A Fuzzy-Clustering Approach," Journal of Classification, Springer;The Classification Society, vol. 28(1), pages 7-20, April.
    13. Cazals, Catherine & Florens, Jean-Pierre & Simar, Leopold, 2002. "Nonparametric frontier estimation: a robust approach," Journal of Econometrics, Elsevier, vol. 106(1), pages 1-25, January.
    14. Gianfranco Ennas & Battista Biggio & Maria Chiara Di Guardo, 2015. "Data-driven journal meta-ranking in business and management," Scientometrics, Springer;Akadémiai Kiadó, vol. 105(3), pages 1911-1929, December.
    15. C Tofallis, 2001. "Combining two approaches to efficiency assessment," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 52(11), pages 1225-1231, November.
    16. Gaby Haddow & Paul Genoni, 2010. "Citation analysis and peer ranking of Australian social science journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(2), pages 471-487, November.
    17. Liebowitz, S J & Palmer, J P, 1984. "Assessing the Relative Impacts of Economic Journals," Journal of Economic Literature, American Economic Association, vol. 22(1), pages 77-88, March.
    18. Knox Lovell, C. A. & Pastor, Jesus T., 1997. "Target setting: An application to a bank branch network," European Journal of Operational Research, Elsevier, vol. 98(2), pages 290-299, April.
    19. Laurens Cherchye & Willem Moesen & Nicky Rogge & Tom Puyenbroeck, 2007. "An Introduction to ‘Benefit of the Doubt’ Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 82(1), pages 111-145, May.
    20. Gupta, Sanjeev & Verhoeven, Marijn, 2001. "The efficiency of government expenditure: experiences from Africa," Journal of Policy Modeling, Elsevier, vol. 23(4), pages 433-467, May.
    21. R. D. Banker & A. Charnes & W. W. Cooper, 1984. "Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis," Management Science, INFORMS, vol. 30(9), pages 1078-1092, September.
    22. Stigler, George J & Stigler, Stephen M & Friedland, Claire, 1995. "The Journals of Economics," Journal of Political Economy, University of Chicago Press, vol. 103(2), pages 331-359, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. De Witte, Kristof & Schiltz, Fritz, 2018. "Measuring and explaining organizational effectiveness of school districts: Evidence from a robust and conditional Benefit-of-the-Doubt approach," European Journal of Operational Research, Elsevier, vol. 267(3), pages 1172-1181.
    2. Chen, Kun & Ren, Xian-tong & Yang, Guo-liang, 2021. "A novel approach for assessing academic journals: Application of integer DEA model for management science and operations research field," Journal of Informetrics, Elsevier, vol. 15(3).
    3. Jennifer Kunz & Mathias Heitz, 2021. "Banks’ risk culture and management control systems: A systematic literature review," Journal of Management Control: Zeitschrift für Planung und Unternehmenssteuerung, Springer, vol. 32(4), pages 439-493, December.
    4. Rosenthal, Edward C. & Weiss, Howard J., 2017. "A data envelopment analysis approach for ranking journals," Omega, Elsevier, vol. 70(C), pages 135-147.
    5. Johan Lyhagen & Per Ahlgren, 2020. "Uncertainty and the ranking of economics journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2545-2560, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wohlrabe, Klaus, 2016. "Taking the Temperature: A Meta-Ranking of Economics Journals," MPRA Paper 68933, University Library of Munich, Germany.
    2. Juan Aparicio & Magdalena Kapelko, 2019. "Enhancing the Measurement of Composite Indicators of Corporate Social Performance," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 144(2), pages 807-826, July.
    3. Lutz Bornmann & Alexander Butz & Klaus Wohlrabe, 2018. "What are the top five journals in economics? A new meta-ranking," Applied Economics, Taylor & Francis Journals, vol. 50(6), pages 659-675, February.
    4. Sahoo, Biresh K. & Singh, Ramadhar & Mishra, Bineet & Sankaran, Krithiga, 2017. "Research productivity in management schools of India during 1968-2015: A directional benefit-of-doubt model analysis," Omega, Elsevier, vol. 66(PA), pages 118-139.
    5. Gnewuch, Matthias & Wohlrabe, Klaus, 2018. "Super-efficiency of education institutions: an application to economics departments," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 26, pages 610-623.
    6. Tüselmann, Heinz & Sinkovics, Rudolf R. & Pishchulov, Grigory, 2016. "Revisiting the standing of international business journals in the competitive landscape," Journal of World Business, Elsevier, vol. 51(4), pages 487-498.
    7. George Emm Halkos & Nickolaos G. Tzeremes, 2011. "Measuring economic journals’ citation efficiency: a data envelopment analysis approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(3), pages 979-1001, September.
    8. Fusco, Elisa & Vidoli, Francesco & Rogge, Nicky, 2020. "Spatial directional robust Benefit of the Doubt approach in presence of undesirable output: An application to Italian waste sector," Omega, Elsevier, vol. 94(C).
    9. Johan Lyhagen & Per Ahlgren, 2020. "Uncertainty and the ranking of economics journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2545-2560, December.
    10. D'Inverno, Giovanna & Carosi, Laura & Ravagli, Letizia, 2018. "Global public spending efficiency in Tuscan municipalities," Socio-Economic Planning Sciences, Elsevier, vol. 61(C), pages 102-113.
    11. Rosenthal, Edward C. & Weiss, Howard J., 2017. "A data envelopment analysis approach for ranking journals," Omega, Elsevier, vol. 70(C), pages 135-147.
    12. Sahoo, Biresh K. & Acharya, Debashis, 2010. "An alternative approach to monetary aggregation in DEA," European Journal of Operational Research, Elsevier, vol. 204(3), pages 672-682, August.
    13. Zanella, Andreia & Camanho, Ana S. & Dias, Teresa G., 2015. "Undesirable outputs and weighting schemes in composite indicators based on data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 245(2), pages 517-530.
    14. Philippe K. Widmer & Peter Zweifel, 2008. "Public Good Provision in a Federalist Country: Tiebout Competition, Fiscal Equalization, and Incentives for Efficiency in Switzerland," SOI - Working Papers 0804, Socioeconomic Institute - University of Zurich, revised Dec 2010.
    15. Lovell, C. A. Knox & Pastor, Jesus T., 1999. "Radial DEA models without inputs or without outputs," European Journal of Operational Research, Elsevier, vol. 118(1), pages 46-51, October.
    16. Andor, Mark A. & Parmeter, Christopher & Sommer, Stephan, 2019. "Combining uncertainty with uncertainty to get certainty? Efficiency analysis for regulation purposes," European Journal of Operational Research, Elsevier, vol. 274(1), pages 240-252.
    17. António Afonso & Miguel St. Aubyn, 2004. "Non-parametric Approaches to Education and Health Expenditure Efficiency in OECD Countries," Working Papers Department of Economics 2004/01, ISEG - Lisbon School of Economics and Management, Department of Economics, Universidade de Lisboa.
    18. Paola Azar & Gabriela Sicilia, 2021. "An assessment of pupil and school performance in public primary education in Uruguay," Documentos de Trabajo (working papers) 21-22, Instituto de Economía - IECON.
    19. De Witte, Kristof & Schiltz, Fritz, 2018. "Measuring and explaining organizational effectiveness of school districts: Evidence from a robust and conditional Benefit-of-the-Doubt approach," European Journal of Operational Research, Elsevier, vol. 267(3), pages 1172-1181.
    20. Wei-Kang Wang & Wen-Min Lu & Yu-Han Wang, 2013. "The relationship between bank performance and intellectual capital in East Asia," Quality & Quantity: International Journal of Methodology, Springer, vol. 47(2), pages 1041-1062, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:107:y:2016:i:1:d:10.1007_s11192-016-1843-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.