IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v120y2019i3d10.1007_s11192-019-03177-x.html
   My bibliography  Save this article

Editorial team scholarly index (ETSI): an alternative indicator for evaluating academic journal reputation

Author

Listed:
  • Yundong Xie

    (University of Science and Technology of China)

  • Qiang Wu

    (University of Science and Technology of China)

  • Xingchen Li

    (University of Science and Technology of China)

Abstract

Evaluating the scholarly reputation of journals has become one of the key concerns and research focuses in academia. The scholarly performance of a journal’s editorial team helps to enhance the journal’s academic impact. This paper develops an editorial team scholarly index from the new perspective of journal editorship, combining the editors’ scholarly performance and the editors’ titles (e.g., associate, assistant) to provide an alternative indicator for evaluating academic journal reputation. This index is useful to measure and rank journals, especially new journals. The paper classifies journal editorial teams and evaluates academic journals using data for 738 members of editorial teams for 21 well-known journals in the field of library and information science. The study concludes that the new index has a significantly positive relationship with journal reputation and shows that the journals’ rankings according to the new index are neither far away from nor uselessly close to the four baseline indicators traditionally measuring journal reputation. Finally, the research finds that there are significant positive correlations between journal reputation and the new index when three different levels of titles of editors are considered, and a comparative empirical analysis of the title levels is provided.

Suggested Citation

  • Yundong Xie & Qiang Wu & Xingchen Li, 2019. "Editorial team scholarly index (ETSI): an alternative indicator for evaluating academic journal reputation," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(3), pages 1333-1349, September.
    • Handle: RePEc:spr:scient:v:120:y:2019:i:3:d:10.1007_s11192-019-03177-x
    DOI: 10.1007/s11192-019-03177-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-019-03177-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-019-03177-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Mingers, John & Yang, Liying, 2017. "Evaluating journal quality: A review of journal citation indicators and ranking in business and management," European Journal of Operational Research, Elsevier, vol. 257(1), pages 323-337.
    2. Wu, Dengsheng & Li, Jing & Lu, Xiaoli & Li, Jianping, 2018. "Journal editorship index for assessing the scholarly impact of academic institutions: An empirical analysis in the field of economics," Journal of Informetrics, Elsevier, vol. 12(2), pages 448-460.
    3. Bruno S. Frey & Katja Rost, 2010. "Do rankings reflect research quality?," Journal of Applied Economics, Universidad del CEMA, vol. 13, pages 1-38, May.
    4. Baccini, Alberto & Barabesi, Lucio, 2011. "Seats at the table: The network of the editorial boards in information and library science," Journal of Informetrics, Elsevier, vol. 5(3), pages 382-391.
    5. Damien Besancenot & Kim Huynh & Joao Faria, 2012. "Search and research: the influence of editorial boards on journals’ quality," Theory and Decision, Springer, vol. 73(4), pages 687-702, October.
    6. João Ricardo Faria, 2005. "The Game Academics Play: Editors versus Authors," Bulletin of Economic Research, Wiley Blackwell, vol. 57(1), pages 1-12, January.
    7. Lowe, D. Jordan & Van Fleet, David D., 2009. "Scholarly achievement and accounting journal editorial board membership," Journal of Accounting Education, Elsevier, vol. 27(4), pages 197-209.
    8. Eduardo Kunzel Teixeira & Mirian Oliveira, 2018. "Editorial board interlocking in knowledge management and intellectual capital research field," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(3), pages 1853-1869, December.
    9. Esther García-Carpintero & Begoña Granadino & Luis M. Plaza, 2010. "The representation of nationalities on the editorial boards of international journals and the promotion of the scientific output of the same countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(3), pages 799-811, September.
    10. J. E. Hirsch, 2019. "hα: An index to quantify an individual’s scientific leadership," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(2), pages 673-686, February.
    11. Kam C. Chan & Robert C. W. Fok, 2003. "Membership On Editorial Boards And Finance Department Rankings," Journal of Financial Research, Southern Finance Association;Southwestern Finance Association, vol. 26(3), pages 405-420, September.
    12. Tibor Braun & Ildikó Dióspatonyi & Sándor Zsindely & Erika Zádor, 2007. "Gatekeeper index versus impact factor of science journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 71(3), pages 541-543, June.
    13. Sandro Mendonça & João Pereira & Manuel Ennes Ferreira, 2018. "Gatekeeping African studies: what does “editormetrics” indicate about journal governance?," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(3), pages 1513-1534, December.
    14. Jessica Petersen & Fabian Hattke & Rick Vogel, 2017. "Editorial governance and journal impact: a study of management and business journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(3), pages 1593-1614, September.
    15. William H. Walters & Esther Isabelle Wilder, 2016. "Disciplinary, national, and departmental contributions to the literature of library and information science, 2007–2012," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(6), pages 1487-1506, June.
    16. Walters, William H., 2017. "Do subjective journal ratings represent whole journals or typical articles? Unweighted or weighted citation impact?," Journal of Informetrics, Elsevier, vol. 11(3), pages 730-744.
    17. Tibor Braun & Wolfgang Glänzel & András Schubert, 2006. "A Hirsch-type index for journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 69(1), pages 169-173, October.
    18. Liwei Cai & Jiahao Tian & Jiaying Liu & Xiaomei Bai & Ivan Lee & Xiangjie Kong & Feng Xia, 2019. "Scholarly impact assessment: a survey of citation weighting solutions," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(2), pages 453-478, February.
    19. Thomas E. Nisonger, 2002. "The relationship between international editorial board composition and citation measures in political science, business, and genetics journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 54(2), pages 257-268, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mina Moradzadeh & Shahram Sedghi & Sirous Panahi, 2023. "Towards a new paradigm for ‘journal quality’ criteria: a scoping review," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(1), pages 279-321, January.
    2. Yezhu Wang & Yundong Xie & Dong Wang & Lu Guo & Rongting Zhou, 2022. "Do cover papers get better citations and usage counts? An analysis of 42 journals in cell biology," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(7), pages 3793-3813, July.
    3. Xie, Yundong & Wu, Qiang & Zhang, Peng & Li, Xingchen, 2020. "Information Science and Library Science (IS-LS) journal subject categorisation and comparison based on editorship information," Journal of Informetrics, Elsevier, vol. 14(4).
    4. José Alonso Borba & Alessanderson Jacó Carvalho & Denize Demarche Minatti Ferreira & Fábio Minatto, 2021. "Scopes of accounting journals and published papers: what do they signalize?," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 5665-5685, July.
    5. Martín de Diego, Isaac & González-Fernández, César & Fernández-Isabel, Alberto & Fernández, Rubén R. & Cabezas, Javier, 2021. "System for evaluating the reliability and novelty of medical scientific papers," Journal of Informetrics, Elsevier, vol. 15(4).
    6. Salim Sazzed, 2021. "Association between the Rankings of Top Bioinformatics and Medical Informatics Journals and the Scholarly Reputations of Chief Editors," Publications, MDPI, vol. 9(3), pages 1-15, September.
    7. Zhang, Baolong & Wang, Hao & Deng, Sanhong & Su, Xinning, 2020. "Measurement and analysis of Chinese journal discriminative capacity," Journal of Informetrics, Elsevier, vol. 14(1).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Salim Sazzed, 2021. "Association between the Rankings of Top Bioinformatics and Medical Informatics Journals and the Scholarly Reputations of Chief Editors," Publications, MDPI, vol. 9(3), pages 1-15, September.
    2. Guillaume Cabanac, 2012. "Shaping the landscape of research in information systems from the perspective of editorial boards: A scientometric study of 77 leading journals," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(5), pages 977-996, May.
    3. Guillaume Cabanac, 2012. "Shaping the landscape of research in information systems from the perspective of editorial boards: A scientometric study of 77 leading journals," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 63(5), pages 977-996, May.
    4. Dengsheng Wu & Xiaoli Lu & Jianping Li & Jing Li, 2020. "Does the institutional diversity of editorial boards increase journal quality? The case economics field," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(2), pages 1579-1597, August.
    5. Xie, Yundong & Wu, Qiang & Zhang, Peng & Li, Xingchen, 2020. "Information Science and Library Science (IS-LS) journal subject categorisation and comparison based on editorship information," Journal of Informetrics, Elsevier, vol. 14(4).
    6. Ana Teresa Santos & Sandro Mendonça, 2022. "The small world of innovation studies: an “editormetrics” perspective," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 7471-7486, December.
    7. Shuo Xu & Mengjia An & Xin An, 2021. "Do scientific publications by editorial board members have shorter publication delays and then higher influence?," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(8), pages 6697-6713, August.
    8. Manuel Goyanes & Luis de-Marcos, 2020. "Academic influence and invisible colleges through editorial board interlocking in communication sciences: a social network analysis of leading journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(2), pages 791-811, May.
    9. Alberto Baccini & Cristina Re, 2023. "Who are the gatekeepers of economics? Geographic diversity, gender composition, and interlocking editorship of journal boards," Papers 2304.04242, arXiv.org, revised Jan 2024.
    10. Radek Zdeněk & Jana Lososová, 2018. "An analysis of editorial board members’ publication output in agricultural economics and policy journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(1), pages 563-578, October.
    11. Raffaele Miniaci & Michele Pezzoni, 2015. "Is Publication in the Hands of Outstanding Scientists? A Study on the Determinants of Editorial Boards Membership in Economics," GREDEG Working Papers 2015-17, Groupe de REcherche en Droit, Economie, Gestion (GREDEG CNRS), Université Côte d'Azur, France.
    12. Sümeyye Akça & Özlem Şenyurt, 2023. "Geographical representation of editorial boards: a review in the field of library and information sciences," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(2), pages 1409-1427, February.
    13. Zhang, Tianjiao & Shi, Jin & Situ, Lingyun, 2021. "The correlation between author-editorial cooperation and the author’s publications in journals," Journal of Informetrics, Elsevier, vol. 15(1).
    14. Eduardo Kunzel Teixeira & Mirian Oliveira, 2018. "Editorial board interlocking in knowledge management and intellectual capital research field," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(3), pages 1853-1869, December.
    15. Esther García-Carpintero & Begoña Granadino & Luis M. Plaza, 2010. "The representation of nationalities on the editorial boards of international journals and the promotion of the scientific output of the same countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(3), pages 799-811, September.
    16. Faria João R & Mixon Franklin G & Upadhyaya Kamal P, 2018. "Editor Reputation and Journal Quality: The Case of Regional Economic Association Journals," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 18(1), pages 1-20, January.
    17. Louis Mesnard, 2010. "On Hochberg et al.’s “The tragedy of the reviewer commons”," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(3), pages 903-917, September.
    18. Chen, Meiqian & Guo, Zhaoxia & Dong, Yucheng & Chiclana, Francisco & Herrera-Viedma, Enrique, 2021. "Citations optimal growth path: A tool to analyze sensitivity to citations of h-like indexes," Journal of Informetrics, Elsevier, vol. 15(4).
    19. Baccini, Federica & Barabesi, Lucio & Baccini, Alberto & Khelfaoui, Mahdi & Gingras, Yves, 2022. "Similarity network fusion for scholarly journals," Journal of Informetrics, Elsevier, vol. 16(1).
    20. Damien Besancenot & João Ricardo Faria & Franklin G. Mixon, 2017. "Academic Research and the Strategic Interaction of Scholars and Editors: A Two-Stage Game," International Game Theory Review (IGTR), World Scientific Publishing Co. Pte. Ltd., vol. 19(01), pages 1-16, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:120:y:2019:i:3:d:10.1007_s11192-019-03177-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.