IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v129y2024i5d10.1007_s11192-024-04979-4.html
   My bibliography  Save this article

Education journal rankings: a diversity-based Author Affiliation Index assessment methodology

Author

Listed:
  • Yan-Hong Yang

    (Shanghai University)

  • Ying-Hui Shao

    (Shanghai University of International Business and Economics)

Abstract

Determining the reputation of academic journals is an crucial issue. The Author Affiliation Index (AAI) was proposed as a novel indicator for judging journal quality in many academic disciplines. Nevertheless, the original AAI has several potential limitations, some of which have been discussed and addressed in previous studies. In this paper, we modified the original AAI by incorporating diversity of top-notch institutions, namely the AAID, exploring how institutional diversity is related to journal quality assessment. We further conducted a quality assessment of 263 education journals indexed in the Social Sciences Citation Index (SSCI) by applying the AAID, AAI and weighted AAI. We find that the AAID ranking possesses a low correlation coefficient with the Journal Impact Factor (JIF) and Eigenfactor Score (ES). That is to say, the AAID rating has not reached a good agreement with the most popular ranking indicators JIF and ES for journals in the field of education. Moreover, we analyze the reasons for the highest AAID from the structure of complex networks. Overall, the AAID is an alternative indicator for evaluating the prestige of journals from a new perspective.

Suggested Citation

  • Yan-Hong Yang & Ying-Hui Shao, 2024. "Education journal rankings: a diversity-based Author Affiliation Index assessment methodology," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(5), pages 2677-2700, May.
    • Handle: RePEc:spr:scient:v:129:y:2024:i:5:d:10.1007_s11192-024-04979-4
    DOI: 10.1007/s11192-024-04979-4
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-024-04979-4
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-024-04979-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Mingers, John & Yang, Liying, 2017. "Evaluating journal quality: A review of journal citation indicators and ranking in business and management," European Journal of Operational Research, Elsevier, vol. 257(1), pages 323-337.
    2. Matherly, Michele & Shortridge, Rebecca Toppe, 2009. "A pragmatic model to estimate journal quality in accounting," Journal of Accounting Education, Elsevier, vol. 27(1), pages 14-29.
    3. Michael F. Gorman & John J. Kanet & Dominique Christ, 2011. "Evaluating Transportation Research Journal Quality Using the Author Affiliation Index," Transportation Journal, John Wiley & Sons, vol. 50(4), pages 370-389, October.
    4. Andy Stirling, 2007. "A General Framework for Analysing Diversity in Science, Technology and Society," SPRU Working Paper Series 156, SPRU - Science Policy Research Unit, University of Sussex Business School.
    5. Rüdiger Mutz, 2022. "Diversity and interdisciplinarity: Should variety, balance and disparity be combined as a product or better as a sum? An information-theoretical and statistical estimation approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 7397-7414, December.
    6. Currie, Russell R. & Pandher, Gurupdesh S., 2011. "Finance journal rankings and tiers: An Active Scholar Assessment methodology," Journal of Banking & Finance, Elsevier, vol. 35(1), pages 7-20, January.
    7. Bajo, Emanuele & Barbi, Massimiliano & Hillier, David, 2020. "Where should I publish to get promoted? A finance journal ranking based on business school promotions," Journal of Banking & Finance, Elsevier, vol. 114(C).
    8. Matías Ginieis & Xiaoni Li, 2020. "Ranking of Sustainability Journals Using the Author Affiliation Index and Comparison to Other Journal Metrics," Sustainability, MDPI, vol. 12(3), pages 1-18, February.
    9. Kam C. Chan & Jamie Y. Tong & Frank F. Zhang, 2012. "Accounting Journal Rankings, Authorship Patterns and the Author Affiliation Index," Australian Accounting Review, CPA Australia, vol. 22(4), pages 407-417, December.
    10. Timothy D. Fry & Joan M. Donohue, 2014. "Exploring the Author Affiliation Index," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(3), pages 1647-1667, March.
    11. Blaise Cronin & Lokman I. Meho, 2008. "Applying the author affiliation index to library and information science journals," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 59(11), pages 1861-1865, September.
    12. William J. Moore, 1972. "The Relative Quality Of Economics Journals: A Suggested Rating System," Economic Inquiry, Western Economic Association International, vol. 10(2), pages 156-169, June.
    13. Chen, Carl R. & Huang, Ying, 2007. "Author Affiliation Index, finance journal ranking, and the pattern of authorship," Journal of Corporate Finance, Elsevier, vol. 13(5), pages 1008-1026, December.
    14. Domingo Docampo & Vicente Safón, 2021. "Journal ratings: a paper affiliation methodology," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 8063-8090, September.
    15. Currie, Russell R. & Pandher, Gurupdesh S., 2020. "Finance journal rankings: Active scholar assessment revisited," Journal of Banking & Finance, Elsevier, vol. 111(C).
    16. Imad Moosa, 2011. "The demise of the ARC journal ranking scheme: an ex post analysis of the accounting and finance journals," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 51(3), pages 809-836, September.
    17. Loet Leydesdorff, 2018. "Diversity and interdisciplinarity: how can one distinguish and recombine disparity, variety, and balance?," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 2113-2121, September.
    18. A. J. Nederhof & R. A. Zwaan, 1991. "Quality judgments of journals as indicators of research performance in the humanities and the social and behavioral sciences," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 42(5), pages 332-340, June.
    19. Dengsheng Wu & Xiaoli Lu & Jianping Li & Jing Li, 2020. "Does the institutional diversity of editorial boards increase journal quality? The case economics field," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(2), pages 1579-1597, August.
    20. Guthrie, Cynthia P. & Everett, John O. & Vijayakumar, Jayaraman & Olds, Philip R., 2012. "Evaluating faculty publications in accounting Ph.D. programs: The Author Affiliation Index as an alternative," Journal of Accounting Education, Elsevier, vol. 30(3), pages 290-306.
    21. Kevin Shear McCann, 2000. "The diversity–stability debate," Nature, Nature, vol. 405(6783), pages 228-233, May.
    22. Leydesdorff, Loet & Wagner, Caroline S. & Bornmann, Lutz, 2019. "Interdisciplinarity as diversity in citation patterns among journals: Rao-Stirling diversity, relative variety, and the Gini coefficient," Journal of Informetrics, Elsevier, vol. 13(1), pages 255-269.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Domingo Docampo & Vicente Safón, 2021. "Journal ratings: a paper affiliation methodology," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 8063-8090, September.
    2. Matías Ginieis & Xiaoni Li, 2020. "Ranking of Sustainability Journals Using the Author Affiliation Index and Comparison to Other Journal Metrics," Sustainability, MDPI, vol. 12(3), pages 1-18, February.
    3. Kun Chen & Xu Liu & Abduhalik Wupur & Guo-liang Yang, 2024. "Ranking journals by voting with feet: a new method for journal evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(3), pages 1567-1588, March.
    4. Giulio Giacomo Cantone, 2024. "How to measure interdisciplinary research? A systemic design for the model of measurement," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(8), pages 4937-4982, August.
    5. Timothy D. Fry & Joan M. Donohue, 2014. "Exploring the Author Affiliation Index," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(3), pages 1647-1667, March.
    6. Ziqiang Zeng & Lantian Shi, 2021. "A two-dimensional journal classification method based on output and input factors: perspectives from citation and authorship related indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(5), pages 3929-3964, May.
    7. Grossmann, Axel & Lee, Allissa, 2022. "An analysis of finance journal accessibility: Author inclusivity and journal quality," Journal of Banking & Finance, Elsevier, vol. 138(C).
    8. Shiji Chen & Yanan Guo & Alvin Shijie Ding & Yanhui Song, 2024. "Is interdisciplinarity more likely to produce novel or disruptive research?," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(5), pages 2615-2632, May.
    9. Maryam Nakhoda & Peter Whigham & Sander Zwanenburg, 2023. "Quantifying and addressing uncertainty in the measurement of interdisciplinarity," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(11), pages 6107-6127, November.
    10. Currie, Russell R. & Pandher, Gurupdesh S., 2020. "Finance journal rankings: Active scholar assessment revisited," Journal of Banking & Finance, Elsevier, vol. 111(C).
    11. Dengsheng Wu & Xiaoli Lu & Jianping Li & Jing Li, 2020. "Does the institutional diversity of editorial boards increase journal quality? The case economics field," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(2), pages 1579-1597, August.
    12. Xiaojing Cai & Xiaozan Lyu & Ping Zhou, 2023. "The relationship between interdisciplinarity and citation impact—a novel perspective on citation accumulation," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-12, December.
    13. Chen, Shiji & Qiu, Junping & Arsenault, Clément & Larivière, Vincent, 2021. "Exploring the interdisciplinarity patterns of highly cited papers," Journal of Informetrics, Elsevier, vol. 15(1).
    14. Chan, Kam C. & Chang, Chih-Hsiang & Chang, Yuanchen, 2013. "Ranking of finance journals: Some Google Scholar citation perspectives," Journal of Empirical Finance, Elsevier, vol. 21(C), pages 241-250.
    15. Matthew D. Crook & Brian R. Walkup, 2016. "Rankings And Trends In Finance Publishing: An Iterative Approach," Journal of Financial Research, Southern Finance Association;Southwestern Finance Association, vol. 39(3), pages 291-322, September.
    16. Marco Seeber & Jef Vlegels & Mattia Cattaneo, 2022. "Conditions that do or do not disadvantage interdisciplinary research proposals in project evaluation," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 73(8), pages 1106-1126, August.
    17. Yang, Alex J., 2024. "Unveiling the impact and dual innovation of funded research," Journal of Informetrics, Elsevier, vol. 18(1).
    18. Hou, Jianhua & Li, Hao & Zhang, Yang, 2024. "Influence of interdisciplinarity of scientific papers on the durability of citation diffusion: A perspective from citation discontinuance," Journal of Informetrics, Elsevier, vol. 18(3).
    19. Alex J. Yang & Huimin Xu & Ying Ding & Meijun Liu, 2024. "Unveiling the dynamics of team age structure and its impact on scientific innovation," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(10), pages 6127-6148, October.
    20. Thelwall, Mike & Kousha, Kayvan & Stuart, Emma & Makita, Meiko & Abdoli, Mahshid & Wilson, Paul & Levitt, Jonathan, 2023. "Do bibliometrics introduce gender, institutional or interdisciplinary biases into research evaluations?," Research Policy, Elsevier, vol. 52(8).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:129:y:2024:i:5:d:10.1007_s11192-024-04979-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.