IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v118y2019i1d10.1007_s11192-018-2972-7.html
   My bibliography  Save this article

Do faculty journal selections correspond to objective indicators of citation impact? Results for 20 academic departments at Manhattan College

Author

Listed:
  • William H. Walters

    (Manhattan College)

  • Susanne Markgren

    (Manhattan College)

Abstract

We examine the relationships between four citation metrics (impact factor, the numerator of the impact factor, article influence score, and eigenfactor) and the library journal selection decisions made by Manhattan College faculty as part of a large-scale serials review. Our results show that journal selection status (selected or not) is only weakly or moderately related to citation impact. Faculty choosing journals for their universities do consider the citation data provided to them, although they place less emphasis on citation impact than do faculty responding to journal ranking surveys. While previous research suggests that subjective journal ratings are more closely related to size-independent metrics (those that represent the average impact of an article rather than the impact of the journal as a whole) and weighted metrics (those that give more credit for citations in high-impact journals), our current results provide no support for the first assertion and only limited support for the second.

Suggested Citation

  • William H. Walters & Susanne Markgren, 2019. "Do faculty journal selections correspond to objective indicators of citation impact? Results for 20 academic departments at Manhattan College," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(1), pages 321-337, January.
    • Handle: RePEc:spr:scient:v:118:y:2019:i:1:d:10.1007_s11192-018-2972-7
    DOI: 10.1007/s11192-018-2972-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-018-2972-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-018-2972-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jennifer Rowley & Frances Johnson & Laura Sbaffi & Will Frass & Elaine Devine, 2017. "Academics' behaviors and attitudes towards open access publishing in scholarly journals," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(5), pages 1201-1211, May.
    2. Serenko, Alexander & Bontis, Nick, 2011. "What's familiar is excellent: The impact of exposure effect on perceived journal quality," Journal of Informetrics, Elsevier, vol. 5(1), pages 219-223.
    3. Currie, Russell R. & Pandher, Gurupdesh S., 2011. "Finance journal rankings and tiers: An Active Scholar Assessment methodology," Journal of Banking & Finance, Elsevier, vol. 35(1), pages 7-20, January.
    4. Cassidy R. Sugimoto & Sam Work & Vincent Larivière & Stefanie Haustein, 2017. "Scholarly use of social media and altmetrics: A review of the literature," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(9), pages 2037-2062, September.
    5. Alireza Tahai & Michael J. Meyer, 1999. "A revealed preference study of management journals’ direct influences," Strategic Management Journal, Wiley Blackwell, vol. 20(3), pages 279-296, March.
    6. Harley, Diane & Acord, Sophia Krzys & Earl-Novell, Sarah & Lawrence, Shannon & King, C. Judson, 2010. "Assessing the Future Landscape of Scholarly Communication: An Exploration of Faculty Values and Needs in Seven Disciplines - Executive Summary," University of California at Berkeley, Center for Studies in Higher Education qt0kr8s78v, Center for Studies in Higher Education, UC Berkeley.
    7. Elaine Worzala & Charles Tu, 2008. "The Perceived Quality Of Real Estate Journals: Does Your Affiliation Matter," ERES eres2008_296, European Real Estate Society (ERES).
    8. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    9. Ellis, Larry V. & Durden, Garey C., 1991. "Why economists rank their journals the way they do," Journal of Economics and Business, Elsevier, vol. 43(3), pages 265-270, August.
    10. Alexander Serenko & Nick Bontis, 2018. "A critical evaluation of expert survey†based journal rankings: The role of personal research interests," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 69(5), pages 749-752, May.
    11. Walters, William H., 2017. "Do subjective journal ratings represent whole journals or typical articles? Unweighted or weighted citation impact?," Journal of Informetrics, Elsevier, vol. 11(3), pages 730-744.
    12. Philip M. Davis & Suzanne A. Cohen, 2001. "The effect of the Web on undergraduate citation behavior 1996–1999," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 52(4), pages 309-314.
    13. Saarela, Mirka & Kärkkäinen, Tommi & Lahtonen, Tommi & Rossi, Tuomo, 2016. "Expert-based versus citation-based ranking of scholarly and scientific publication channels," Journal of Informetrics, Elsevier, vol. 10(3), pages 693-718.
    14. Harley, Diane & Acord, Sophia Krzys & Earl-Novell, Sarah & Lawrence, Shannon & King, C. Judson, 2010. "Assessing the Future Landscape of Scholarly Communication: An Exploration of Faculty Values and Needs in Seven Disciplines," University of California at Berkeley, Center for Studies in Higher Education qt15x7385g, Center for Studies in Higher Education, UC Berkeley.
    15. Haddawy, Peter & Hassan, Saeed-Ul & Asghar, Awais & Amin, Sarah, 2016. "A comprehensive examination of the relation of three citation-based journal metrics to expert judgment of journal quality," Journal of Informetrics, Elsevier, vol. 10(1), pages 162-173.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zeynep Didem Unutmaz Durmuşoğlu & Alptekin Durmuşoğlu, 2021. "A TOPSIS model for understanding the authors choice of journal selection," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 521-543, January.
    2. Ramón Barrera-Barrera, 2022. "Selecting the appropriate leading journal in Hospitality and Tourism research: a guide based on the topic-journal fit and the JCR impact factor," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(4), pages 1801-1823, April.
    3. Mike Thelwall & Kayvan Kousha & Meiko Makita & Mahshid Abdoli & Emma Stuart & Paul Wilson & Jonathan Levitt, 2023. "In which fields do higher impact journals publish higher quality articles?," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(7), pages 3915-3933, July.
    4. Saarela, Mirka & Kärkkäinen, Tommi, 2020. "Can we automate expert-based journal rankings? Analysis of the Finnish publication indicator," Journal of Informetrics, Elsevier, vol. 14(2).
    5. William H. Walters, 2022. "Can differences in publisher size account for the relatively low prices of the journals available to master’s universities through commercial publishers’ databases? The importance of price discriminat," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(2), pages 1065-1097, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Currie, Russell R. & Pandher, Gurupdesh S., 2020. "Finance journal rankings: Active scholar assessment revisited," Journal of Banking & Finance, Elsevier, vol. 111(C).
    2. Walters, William H., 2017. "Do subjective journal ratings represent whole journals or typical articles? Unweighted or weighted citation impact?," Journal of Informetrics, Elsevier, vol. 11(3), pages 730-744.
    3. Saarela, Mirka & Kärkkäinen, Tommi, 2020. "Can we automate expert-based journal rankings? Analysis of the Finnish publication indicator," Journal of Informetrics, Elsevier, vol. 14(2).
    4. Chieh Liu & Mu-Hsuan Huang, 2022. "Exploring the relationships between altmetric counts and citations of papers in different academic fields based on co-occurrence analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(8), pages 4939-4958, August.
    5. Raminta Pranckutė, 2021. "Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World," Publications, MDPI, vol. 9(1), pages 1-59, March.
    6. Domingo Docampo & Vicente Safón, 2021. "Journal ratings: a paper affiliation methodology," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 8063-8090, September.
    7. Claudiu Vasile Kifor & Ana Maria Benedek & Ioan Sîrbu & Roxana Florența Săvescu, 2023. "Institutional drivers of research productivity: a canonical multivariate analysis of Romanian public universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2233-2258, April.
    8. Bonaccorsi, Andrea & Haddawy, Peter & Cicero, Tindaro & Hassan, Saeed-Ul, 2017. "The solitude of stars. An analysis of the distributed excellence model of European universities," Journal of Informetrics, Elsevier, vol. 11(2), pages 435-454.
    9. Yu Zhang & Min Wang & Morteza Saberi & Elizabeth Chang, 2022. "Analysing academic paper ranking algorithms using test data and benchmarks: an investigation," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(7), pages 4045-4074, July.
    10. Alireza Abbasi & Mahdi Jalili & Abolghasem Sadeghi-Niaraki, 2018. "Influence of network-based structural and power diversity on research performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(1), pages 579-590, October.
    11. Sergio Copiello, 2019. "Research Interest: another undisclosed (and redundant) algorithm by ResearchGate," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(1), pages 351-360, July.
    12. Mike Thelwall & Kayvan Kousha & Meiko Makita & Mahshid Abdoli & Emma Stuart & Paul Wilson & Jonathan Levitt, 2023. "In which fields do higher impact journals publish higher quality articles?," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(7), pages 3915-3933, July.
    13. Alessio J. G. Brown & Klaus F. Zimmermann, 2017. "Three decades of publishing research in population economics," Journal of Population Economics, Springer;European Society for Population Economics, vol. 30(1), pages 11-27, January.
    14. Loliya Agbani Akobo, 2018. "Action learning through radio: exploring conceptual views and lived experiences of women entrepreneurs," Action Learning: Research and Practice, Taylor & Francis Journals, vol. 15(3), pages 235-248, September.
    15. Łukasz Wiechetek & Zbigniew Pastuszak, 2022. "Academic social networks metrics: an effective indicator for university performance?," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(3), pages 1381-1401, March.
    16. Siluo Yang & Xin Xing & Dietmar Wolfram, 2018. "Difference in the impact of open-access papers published by China and the USA," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(2), pages 1017-1037, May.
    17. Hamid R. Jamali & David Nicholas & Eti Herman, 2016. "Scholarly reputation in the digital age and the role of emerging platforms and mechanisms," Research Evaluation, Oxford University Press, vol. 25(1), pages 37-49.
    18. Emanuel Kulczycki & Ewa A. Rozkosz, 2017. "Does an expert-based evaluation allow us to go beyond the Impact Factor? Experiences from building a ranking of national journals in Poland," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(1), pages 417-442, April.
    19. Andrea Bonaccorsi & Tindaro Cicero & Peter Haddawy & Saeed-UL Hassan, 2017. "Explaining the transatlantic gap in research excellence," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(1), pages 217-241, January.
    20. Katarina Krapež, 2022. "Advancing Self-Evaluative and Self-Regulatory Mechanisms of Scholarly Journals: Editors’ Perspectives on What Needs to Be Improved in the Editorial Process," Publications, MDPI, vol. 10(1), pages 1-18, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:118:y:2019:i:1:d:10.1007_s11192-018-2972-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.