IDEAS home Printed from https://ideas.repec.org/p/ucm/doicae/1334.html
   My bibliography  Save this paper

Ranking Leading Econometrics Journals Using Citations Data from ISI and RePEc

Author

Listed:
  • Chia-Lin Chang

    (Department of Applied Economics, Department of Finance, National Chung Hsing University, Taiwan)

  • Michael McAleer

    (Econometric Institute, Erasmus School of Economics, Erasmus University Rotterdam and Tinbergen Institute, The Netherlands, Department of Quantitative Economics, Complutense University of Madrid, and Institute of Economic Research, Kyoto University.)

Abstract

The paper focuses on the robustness of rankings of academic journal quality and research impact of 10 leading econometrics journals taken from the Thomson Reuters ISI Web of Science (ISI) Category of Economics, using citations data from ISI and the highly accessible Research Papers in Economics (RePEc) database that is widely used in economics, finance and related disciplines. The journals are ranked using quantifiable static and dynamic Research Assessment Measures (RAMs), with 15 RAMs from ISI and 5 RAMs from RePEc. The similarities and differences in various RAMs, which are based on alternative weighted and unweighted transformations of citations, are highlighted to show which RAMs are able to provide informational value relative to others. The RAMs include the impact factor, mean citations and non-citations, journal policy, number of high quality papers, and journal influence and article influence. The paper highlight robust rankings based on the harmonic mean of the ranks of 20 RAMs, which in some cases are closely related. It is shown that emphasizing the most widely-used RAM, the 2-year impact factor of a journal, can lead to a distorted evaluation of journal quality, impact and influence relative to the harmonic mean of the ranks.

Suggested Citation

  • Chia-Lin Chang & Michael McAleer, 2013. "Ranking Leading Econometrics Journals Using Citations Data from ISI and RePEc," Documentos de Trabajo del ICAE 2013-34, Universidad Complutense de Madrid, Facultad de Ciencias Económicas y Empresariales, Instituto Complutense de Análisis Económico.
    • Handle: RePEc:ucm:doicae:1334
    Note: The authors are most grateful for very helpful discussions and correspondence with Esfandiar Maasoumi and Christian Zimmermann. For financial support, the first author wishes to thank the National Science Council, Taiwan, and the second author wishes to acknowledge the Australian Research Council and the National Science Council, Taiwan
    as

    Download full text from publisher

    File URL: https://eprints.ucm.es/id/eprint/23260/1/1334.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Christian Zimmermann, 2013. "Academic Rankings with RePEc," Econometrics, MDPI, vol. 1(3), pages 1-32, December.
    2. Chia-Lin Chang & Michael McAleer, 2013. "Ranking journal quality by harmonic mean of ranks: an application to ISI statistics & probability," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 67(1), pages 27-53, February.
    3. Chia-Lin Chang & Michael Mcaleer, 2013. "What Do Experts Know About Forecasting Journal Quality? A Comparison With Isi Research Impact In Finance," Annals of Financial Economics (AFE), World Scientific Publishing Co. Pte. Ltd., vol. 8(01), pages 1-30.
    4. Chia-Lin Chang & Michael McAleer & Les Oxley, 2011. "Great Expectatrics: Great Papers, Great Journals, Great Econometrics," Econometric Reviews, Taylor & Francis Journals, vol. 30(6), pages 583-619.
    5. Chia-Lin Chang & Esfandiar Maasoumi & Michael McAleer, 2016. "Robust Ranking of Journal Quality: An Application to Economics," Econometric Reviews, Taylor & Francis Journals, vol. 35(1), pages 50-97, January.
    6. Chia-Lin Chang & Michael McAleer & Les Oxley, 2011. "What makes a great journal great in the sciences? Which came first, the chicken or the egg?," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(1), pages 17-40, April.
    7. Chang, Chia-Lin & McAleer, Michael & Oxley, Les, 2013. "Coercive journal self citations, impact factor, Journal Influence and Article Influence," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 93(C), pages 190-197.
    8. Chia‐Lin Chang & Michael McAleer & Les Oxley, 2011. "What Makes A Great Journal Great In Economics? The Singer Not The Song," Journal of Economic Surveys, Wiley Blackwell, vol. 25(2), pages 326-361, April.
    9. Chia-Lin Chang & Michael McAleer & Les Oxley, 2011. "How are journal impact, prestige and article influence related? An application to neuroscience," Journal of Applied Statistics, Taylor & Francis Journals, vol. 38(11), pages 2563-2573, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chia-Lin Chang & Michael Mcaleer, 2014. "Just How Good Are The Top Three Journals In Finance? An Assessment Based On Quantity And Quality Citations," Annals of Financial Economics (AFE), World Scientific Publishing Co. Pte. Ltd., vol. 9(01), pages 1-31.
    2. Christian Zimmermann, 2013. "Academic Rankings with RePEc," Econometrics, MDPI, vol. 1(3), pages 1-32, December.
    3. David L. Anderson & John Tressler, 2017. "Researcher rank stability across alternative output measurement schemes in the context of a time limited research evaluation: the New Zealand case," Applied Economics, Taylor & Francis Journals, vol. 49(45), pages 4542-4553, September.
    4. William C. Horrace & Christopher F. Parmeter, 2017. "Accounting for Multiplicity in Inference on Economics Journal Rankings," Southern Economic Journal, John Wiley & Sons, vol. 84(1), pages 337-347, July.
    5. Chang Chia-Lin & McAleer Michael, 2014. "Ranking Economics and Econometrics ISI Journals by Quality Weighted Citations," Review of Economics, De Gruyter, vol. 65(1), pages 35-52, April.
    6. Chia-Lin Chang & Michael McAleer, 2015. "Bibliometric Rankings of Journals Based on the Thomson Reuters Citations Database," Journal of Reviews on Global Economics, Lifescience Global, vol. 4, pages 120-125.
    7. Raphael Auer & Christian Zimmermann, 2020. "A journal ranking based on central bank citations," Vox eBook Chapters, in: Sebastian Galliani & Ugo Panizza (ed.), Publishing and Measuring Success in Economics, edition 1, volume 1, chapter 1, pages 57-63, Centre for Economic Policy Research.
    8. Valérie Mignon & Marc Joëts & Bertrand Candelon, 2023. "What Makes Econometric Ideas Popular: The Role of Connectivity," Working Papers hal-04343996, HAL.
    9. Chia-Lin Chang & Michael McAleer, 2019. "Modeling Latent Carbon Emission Prices for Japan: Theory and Practice," Energies, MDPI, vol. 12(21), pages 1-21, November.
    10. Franklin G. Mixon, Jr. & Kamal P. Upadhyaya, 2021. "Scholarly Impact of Core Econometrics Journals: A Catalog and Citations-Based Ranking," International Econometric Review (IER), Econometric Research Association, vol. 13(4), pages 118-131, December.
    11. Ferda, HALICIOGLU, 2014. "Research Ranking Place of Turkish Economists in the World," MPRA Paper 54058, University Library of Munich, Germany.
    12. David L. Anderson & John Tressler, 2015. "Are Researcher Rankings Stable Across Alternative Output Measurement Schemes in the Context of a Time Limited Research Evaluation? The New Zealand Case," Working Papers in Economics 15/10, University of Waikato.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chia-Lin Chang & Michael Mcaleer, 2014. "Just How Good Are The Top Three Journals In Finance? An Assessment Based On Quantity And Quality Citations," Annals of Financial Economics (AFE), World Scientific Publishing Co. Pte. Ltd., vol. 9(01), pages 1-31.
    2. Chia-Lin Chang & Michael McAleer, 2015. "Bibliometric Rankings of Journals Based on the Thomson Reuters Citations Database," Journal of Reviews on Global Economics, Lifescience Global, vol. 4, pages 120-125.
    3. Chia-Lin Chang & Michael McAleer, "undated". "Quality Weighted Citations Versus Total Citations in the Sciences and Social Sciences, with an Application to Finance and Accounting," Documentos de Trabajo del ICAE 2015-01, Universidad Complutense de Madrid, Facultad de Ciencias Económicas y Empresariales, Instituto Complutense de Análisis Económico, revised Jan 2015.
    4. Chia-Lin Chang & Michael Mcaleer, 2013. "What Do Experts Know About Forecasting Journal Quality? A Comparison With Isi Research Impact In Finance," Annals of Financial Economics (AFE), World Scientific Publishing Co. Pte. Ltd., vol. 8(01), pages 1-30.
    5. Chia-Lin Chang & Michael McAleer, 2019. "Modeling Latent Carbon Emission Prices for Japan: Theory and Practice," Energies, MDPI, vol. 12(21), pages 1-21, November.
    6. Chia-Lin Chang & Michael McAleer & Les Oxley, 2012. "Journal Impact Factor, Eigenfactor, Journal Influence and Article Influence," KIER Working Papers 822, Kyoto University, Institute of Economic Research.
    7. Chang, Chia-Lin & McAleer, Michael & Oxley, Les, 2013. "Coercive journal self citations, impact factor, Journal Influence and Article Influence," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 93(C), pages 190-197.
    8. Chang Chia-Lin & McAleer Michael, 2014. "Ranking Economics and Econometrics ISI Journals by Quality Weighted Citations," Review of Economics, De Gruyter, vol. 65(1), pages 35-52, April.
    9. Chia-Lin Chang & Michael McAleer, 2013. "Ranking journal quality by harmonic mean of ranks: an application to ISI statistics & probability," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 67(1), pages 27-53, February.
    10. Chia-Lin Chang & Esfandiar Maasoumi & Michael McAleer, 2016. "Robust Ranking of Journal Quality: An Application to Economics," Econometric Reviews, Taylor & Francis Journals, vol. 35(1), pages 50-97, January.
    11. Lutz Bornmann & Alexander Butz & Klaus Wohlrabe, 2018. "What are the top five journals in economics? A new meta-ranking," Applied Economics, Taylor & Francis Journals, vol. 50(6), pages 659-675, February.
    12. Chia-Lin Chang & Michael McAleer, 2012. "What do Experts Know About Ranking Journal Quality? A Comparison with ISI Research Impact in Finance," Documentos de Trabajo del ICAE 2012-01, Universidad Complutense de Madrid, Facultad de Ciencias Económicas y Empresariales, Instituto Complutense de Análisis Económico.
    13. Chia-Lin Chang & Michael McAleer, 2014. "How Should Journal Quality be Ranked? An Application to Agricultural, Energy, Environmental and Resource Economics," Journal of Reviews on Global Economics, Lifescience Global, vol. 3, pages 33-47.
    14. Justus Haucap & Johannes Muck, 2015. "What drives the relevance and reputation of economics journals? An update from a survey among economists," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(3), pages 849-877, June.
    15. Chang, C-L. & McAleer, M.J., 2014. "Quality Weighted Citations Versus Total Citations in the Sciences and Social Sciences," Econometric Institute Research Papers 50641, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    16. Michael McAleer & Chia-Lin Chang, 2011. "Citations and Impact of ISI Tourism and Hospitality Journals," KIER Working Papers 781, Kyoto University, Institute of Economic Research.
    17. Joseph Gerald Hirschberg & Jeanette Ngaire Lye, 2020. "Grading Journals In Economics: The Abcs Of The Abdc," Journal of Economic Surveys, Wiley Blackwell, vol. 34(4), pages 876-921, September.
    18. Wohlrabe, Klaus, 2016. "Taking the Temperature: A Meta-Ranking of Economics Journals," MPRA Paper 68933, University Library of Munich, Germany.
    19. David L. Anderson & John Tressler, 2017. "Researcher rank stability across alternative output measurement schemes in the context of a time limited research evaluation: the New Zealand case," Applied Economics, Taylor & Francis Journals, vol. 49(45), pages 4542-4553, September.
    20. McAleer, M.J. & Oláh, J. & Popp, J., 2018. "Pros and Cons of the Impact Factor in a Rapidly Changing Digital World," Econometric Institute Research Papers EI2018-11, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.

    More about this item

    Keywords

    Research assessment measures; Citations; Impact; Influence; Harmonic mean; Robust journal rankings; Econometrics.;
    All these keywords.

    JEL classification:

    • C18 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Methodolical Issues: General
    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • Y10 - Miscellaneous Categories - - Data: Tables and Charts - - - Data: Tables and Charts

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ucm:doicae:1334. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Águeda González Abad (email available below). General contact details of provider: https://edirc.repec.org/data/feucmes.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.