IDEAS home Printed from https://ideas.repec.org/a/eee/respol/v49y2020i5s0048733320300378.html
   My bibliography  Save this article

The journal quality perception gap

Author

Listed:
  • Bryce, Cormac
  • Dowling, Michael
  • Lucey, Brian

Abstract

We explore the drivers of researchers’ perceptions around journal quality, and how these perceptions converge or diverge with national journal ranking systems. Prior to the release of the Academic Journal Guide (AJG) 2018 rankings list, we surveyed UK business school researchers, resulting in 19,597 individual journal rankings. We find a notable journal quality perception gap, with 39% of subjective rankings from the business and management community differing from the AJG 2018 rankings. We show that measures of personal connection to the AJG system have strong explanatory power. These factors include the usage of, and sentiment towards, the AJG list, as well as individual research success as measured by AJG rankings. Consistently, we find that high values for these factors narrow the quality perception gap, whereas low values widen it. We also find an increase in the quality perception gap for journals that a respondent has submitted to or reviewed for. Our research, thus, provides new insights into how researchers interact with journal ranking systems. We propose how researchers, business schools, and ranking bodies can incorporate these findings to improve stakeholders’ consensus on research quality assessment.

Suggested Citation

  • Bryce, Cormac & Dowling, Michael & Lucey, Brian, 2020. "The journal quality perception gap," Research Policy, Elsevier, vol. 49(5).
    • Handle: RePEc:eee:respol:v:49:y:2020:i:5:s0048733320300378
    DOI: 10.1016/j.respol.2020.103957
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0048733320300378
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.respol.2020.103957?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Joseph S. Valacich & Mark A. Fuller & Christoph Schneider & Alan R. Dennis, 2006. "Issues and Opinions---Publication Opportunities in Premier Business Outlets: How Level Is the Playing Field?," Information Systems Research, INFORMS, vol. 17(2), pages 107-125, June.
    2. Mingers, John & Yang, Liying, 2017. "Evaluating journal quality: A review of journal citation indicators and ranking in business and management," European Journal of Operational Research, Elsevier, vol. 257(1), pages 323-337.
    3. James J. Heckman & Sidharth Moktan, 2020. "Publishing and promotion in economics - The tyranny of the Top Five," Vox eBook Chapters, in: Sebastian Galliani & Ugo Panizza (ed.), Publishing and Measuring Success in Economics, edition 1, volume 1, chapter 1, pages 23-32, Centre for Economic Policy Research.
    4. Alice Lam, 2007. "Knowledge Networks and Careers: Academic Scientists in Industry–University Links," Journal of Management Studies, Wiley Blackwell, vol. 44(6), pages 993-1016, September.
    5. Kent Daniel & David Hirshleifer & Avanidhar Subrahmanyam, 1998. "Investor Psychology and Security Market Under- and Overreactions," Journal of Finance, American Finance Association, vol. 53(6), pages 1839-1885, December.
    6. Vogel, Rick & Hattke, Fabian & Petersen, Jessica, 2017. "Journal rankings in management and business studies: What rules do we play by?," Research Policy, Elsevier, vol. 46(10), pages 1707-1722.
    7. Cormac Bryce & Thorsten Chmura & Rob Webb & Joel Stiebale & Carly Cheevers, 2019. "Internally Reporting Risk in Financial Services: An Empirical Analysis," Journal of Business Ethics, Springer, vol. 156(2), pages 493-512, May.
    8. Gloria Agyemang & Jane Broadbent, 2015. "Management control systems and research management in universities," Accounting, Auditing & Accountability Journal, Emerald Group Publishing Limited, vol. 28(7), pages 1018-1046, September.
    9. John Hudson & David N. Laband, 2013. "Using and Interpreting Journal Rankings: Introduction," Economic Journal, Royal Economic Society, vol. 0, pages 199-201, August.
    10. Chavarro, Diego & Tang, Puay & Ràfols, Ismael, 2017. "Why researchers publish in non-mainstream journals: Training, knowledge bridging, and gap filling," Research Policy, Elsevier, vol. 46(9), pages 1666-1680.
    11. Violina P. Rindova & Charles J. Fombrun, 1999. "Constructing competitive advantage: the role of firm–constituent interactions," Strategic Management Journal, Wiley Blackwell, vol. 20(8), pages 691-710, August.
    12. Hussain, Simon, 2010. "Accounting journals and the ABS quality ratings," The British Accounting Review, Elsevier, vol. 42(1), pages 1-16.
    13. Samuelson, William & Zeckhauser, Richard, 1988. "Status Quo Bias in Decision Making," Journal of Risk and Uncertainty, Springer, vol. 1(1), pages 7-59, March.
    14. Alan Sangster, 2015. "You Cannot Judge a Book by Its Cover: The Problems with Journal Rankings," Accounting Education, Taylor & Francis Journals, vol. 24(3), pages 175-186, June.
    15. Salter, Ammon & Salandra, Rossella & Walker, James, 2017. "Exploring preferences for impact versus publications among UK business and management academics," Research Policy, Elsevier, vol. 46(10), pages 1769-1782.
    16. Andreas G. F. Hoepner & Jeffrey Unerman, 2012. "Explicit and Implicit Subject Bias in the ABS Journal Quality Guide," Accounting Education, Taylor & Francis Journals, vol. 21(1), pages 3-15, December.
    17. Celsi, Richard L & Olson, Jerry C, 1988. "The Role of Involvement in Attention and Comprehension Processes," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 15(2), pages 210-224, September.
    18. Loewenstein, George, 1996. "Out of Control: Visceral Influences on Behavior," Organizational Behavior and Human Decision Processes, Elsevier, vol. 65(3), pages 272-292, March.
    19. Serenko, Alexander & Dohan, Michael, 2011. "Comparing the expert survey and citation impact journal ranking methods: Example from the field of Artificial Intelligence," Journal of Informetrics, Elsevier, vol. 5(4), pages 629-648.
    20. Bryce, Cormac & Cheevers, Carly & Webb, Rob, 2013. "Operational risk escalation: An empirical analysis of UK call centres," International Review of Financial Analysis, Elsevier, vol. 30(C), pages 298-307.
    21. Brooks, Chris & Fenton, Evelyn M. & Walker, James T., 2014. "Gender and the evaluation of research," Research Policy, Elsevier, vol. 43(6), pages 990-1001.
    22. Steenkamp, Jan-Benedict E. M., 1990. "Conceptual model of the quality perception process," Journal of Business Research, Elsevier, vol. 21(4), pages 309-333, December.
    23. Kostas Axarloglou & Vasilis Theoharakis, 2003. "Diversity in Economics: An Analysis of Journal Quality Perceptions," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1402-1423, December.
    24. Simon Hussain, 2011. "Food for Thought on the ABS Academic Journal Quality Guide," Accounting Education, Taylor & Francis Journals, vol. 20(6), pages 545-559, June.
    25. Vivien Beattie & Alan Goodacre, 2012. "Publication records of accounting and finance faculty promoted to professor: evidence from the UK," Accounting and Business Research, Taylor & Francis Journals, vol. 42(2), pages 197-231, June.
    26. Diana Hicks & Paul Wouters & Ludo Waltman & Sarah de Rijcke & Ismael Rafols, 2015. "Bibliometrics: The Leiden Manifesto for research metrics," Nature, Nature, vol. 520(7548), pages 429-431, April.
    27. Rao, Akshay R & Monroe, Kent B, 1988. "The Moderating Effect of Prior Knowledge on Cue Utilization in Product Evaluations," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 15(2), pages 253-264, September.
    28. Claire-France Picard & Sylvain Durocher & Yves Gendron, 2019. "Desingularization and Dequalification: A Foray Into Ranking Production and Utilization Processes," European Accounting Review, Taylor & Francis Journals, vol. 28(4), pages 737-765, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Domingo Docampo & Vicente Safón, 2021. "Journal ratings: a paper affiliation methodology," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 8063-8090, September.
    2. Tian, Jinfang & Zhang, Mingxuan & Xue, Rui & Cao, Wei & Shan, Yuli, 2022. "The face of achievement: Editors' facial structure and journal performance," International Review of Financial Analysis, Elsevier, vol. 84(C).
    3. Zeynep Didem Unutmaz Durmuşoğlu & Alptekin Durmuşoğlu, 2021. "A TOPSIS model for understanding the authors choice of journal selection," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 521-543, January.
    4. Berninger, Marc & Kiesel, Florian & Schiereck, Dirk & Gaar, Eduard, 2021. "Citations and the readers’ information-extracting costs of finance articles," Journal of Banking & Finance, Elsevier, vol. 131(C).
    5. Piotr Śpiewanowski & Oleksandr Talavera, 2021. "Journal rankings and publication strategy," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 3227-3242, April.
    6. Auschra, Carolin & Bartosch, Julia & Lohmeyer, Nora, 2022. "Differences in female representation in leading management and organization journals: Establishing a benchmark," Research Policy, Elsevier, vol. 51(3).
    7. Brooks, Chris & Schopohl, Lisa & Walker, James T., 2023. "Comparing perceptions of the impact of journal rankings between fields," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 90(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Brooks, Chris & Schopohl, Lisa & Walker, James T., 2023. "Comparing perceptions of the impact of journal rankings between fields," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 90(C).
    2. Drivas, Kyriakos & Kremmydas, Dimitris, 2020. "The Matthew effect of a journal's ranking," Research Policy, Elsevier, vol. 49(4).
    3. Simon Hussain & Lana Liu & Yue Wang & Lingyan Zuo, 2015. "Journal Rankings, Collaborative Research and Publication Strategies: Evidence from China," Accounting Education, Taylor & Francis Journals, vol. 24(3), pages 233-255, June.
    4. Argento, Daniela & van Helden, Jan, 2023. "Are public sector accounting researchers going through an identity shift due to the increasing importance of journal rankings?," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 96(C).
    5. Gebreiter, Florian, 2022. "A profession in peril? University corporatization, performance measurement and the sustainability of accounting academia," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 87(C).
    6. Domingo Docampo & Vicente Safón, 2021. "Journal ratings: a paper affiliation methodology," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 8063-8090, September.
    7. W. Verbeke & I. Vermeir & Z. Pieniak & K. Brunsø, 2005. "Consumers’ quality perception as a basis for fish market segmentation in Belgium," Working Papers of Faculty of Economics and Business Administration, Ghent University, Belgium 05/351, Ghent University, Faculty of Economics and Business Administration.
    8. Hussain, Simon & Liu, Lana Yan Jun & Miller, Anthony D., 2020. "Accounting as a dichotomised discipline: An analysis of the source materials used in the construction of accounting articles," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 66(C).
    9. Osterloh, Margit & Frey, Bruno S., 2020. "How to avoid borrowed plumes in academia," Research Policy, Elsevier, vol. 49(1).
    10. Piotr Śpiewanowski & Oleksandr Talavera, 2021. "Journal rankings and publication strategy," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 3227-3242, April.
    11. Mario Fernandes & Andreas Walter, 2023. "The times they are a-changin’: profiling newly tenured business economics professors in Germany over the past thirty years," Journal of Business Economics, Springer, vol. 93(5), pages 929-971, July.
    12. Stefano DellaVigna, 2009. "Psychology and Economics: Evidence from the Field," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 315-372, June.
    13. Eliseo Reategui & Alause Pires & Michel Carniato & Sergio Roberto Kieling Franco, 2020. "Evaluation of Brazilian research output in education: confronting international and national contexts," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 427-444, October.
    14. Yuan Wu & Taufiq Choudhry, 2018. "Information Uncertainty and Momentum Phenomenon Amidst Market Swings: Evidence From the Chinese Class A Share Market," Asia-Pacific Financial Markets, Springer;Japanese Association of Financial Economics and Engineering, vol. 25(2), pages 111-136, June.
    15. Schmal, W. Benedikt & Haucap, Justus & Knoke, Leon, 2023. "The role of gender and coauthors in academic publication behavior," Research Policy, Elsevier, vol. 52(10).
    16. Gosnell, Greer K., 2018. "Communicating Resourcefully: A Natural Field Experiment on Environmental Framing and Cognitive Dissonance in Going Paperless," Ecological Economics, Elsevier, vol. 154(C), pages 128-144.
    17. Ramiah, Vikash & Xu, Xiaoming & Moosa, Imad A., 2015. "Neoclassical finance, behavioral finance and noise traders: A review and assessment of the literature," International Review of Financial Analysis, Elsevier, vol. 41(C), pages 89-100.
    18. Colleen E. McClure & Justin M. Lawrence & Todd J. Arnold & Lisa K. Scheer, 2023. "The opportunities and costs of highly involved organizational buyers," Journal of the Academy of Marketing Science, Springer, vol. 51(2), pages 480-501, March.
    19. Erich Battistin & Marco Ovidi, 2022. "Rising Stars: Expert Reviews and Reputational Yardsticks in the Research Excellence Framework," Economica, London School of Economics and Political Science, vol. 89(356), pages 830-848, October.
    20. Katharina Dowling & Daniel Guhl & Daniel Klapper & Martin Spann & Lucas Stich & Narine Yegoryan, 2020. "Behavioral biases in marketing," Journal of the Academy of Marketing Science, Springer, vol. 48(3), pages 449-477, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:respol:v:49:y:2020:i:5:s0048733320300378. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/respol .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.