IDEAS home Printed from https://ideas.repec.org/a/eee/crpeac/v90y2023ics1045235421001003.html
   My bibliography  Save this article

Comparing perceptions of the impact of journal rankings between fields

Author

Listed:
  • Brooks, Chris
  • Schopohl, Lisa
  • Walker, James T.

Abstract

While the purpose of academic research is to obtain new knowledge and understanding, there is an increasing concern that many scholars value work based upon where it is published rather than on its intrinsic quality. We argue that the degree to which journal ranking lists affect research has an important field-specific component. Using a large-scale survey of UK business academics and underpinned with a conceptual framework inspired by Bourdieu, we examine the attitudes towards journal ranking lists of individuals working within 22 ‘fields’ operating under the umbrella of business and management in the Academic Journal Guide (AJG). We show that scholars in economics and finance at one end of the spectrum, and in organisational studies at the other, systematically differ from accounting scholars in how they relate to the list. While the empirical evidence suggests that finance and economics are more insular than other fields, members of these two fields are the ones who are significantly less likely to consider that journal lists create a ‘research monoculture’, foster ‘technically well-executed but boring research’, or ‘encourage work that is not of interest to practitioners/policy makers’. On the other hand, scholars in organisational studies show the highest agreement with these concerns about journal ranking lists. Our findings have important implications for the evolution of accounting as a field that spans both a critical, interpretive paradigm with a strong focus on organisational context as well as a positivist, financial and capital markets-based research paradigm. If accounting scholars of these two approaches attach different authority to journal ranking lists and the value of publications in highly ranked journals, these perception differences could lead to tensions within the field and could have distortive effects on resource allocations and the career prospects of accounting scholars working in the respective sub-fields.

Suggested Citation

  • Brooks, Chris & Schopohl, Lisa & Walker, James T., 2023. "Comparing perceptions of the impact of journal rankings between fields," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 90(C).
  • Handle: RePEc:eee:crpeac:v:90:y:2023:i:c:s1045235421001003
    DOI: 10.1016/j.cpa.2021.102381
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1045235421001003
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.cpa.2021.102381?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Fox, Kenneth A., 2018. "The manufacture of the academic accountant," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 57(C), pages 1-20.
    2. Hans Englund & Jonas Gerdin, 2020. "Contesting conformity: how and why academics may oppose the conforming influences of intra-organizational performance evaluations," Accounting, Auditing & Accountability Journal, Emerald Group Publishing Limited, vol. 33(5), pages 913-938, May.
    3. Rowlinson, Michael & Harvey, Charles & Kelly, Aidan & Morris, Huw & Todeva, Emanuela, 2015. "Accounting for research quality: Research audits and the journal rankings debate," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 26(C), pages 2-22.
    4. James J. Heckman & Sidharth Moktan, 2020. "Publishing and promotion in economics - The tyranny of the Top Five," Vox eBook Chapters, in: Sebastian Galliani & Ugo Panizza (ed.), Publishing and Measuring Success in Economics, edition 1, volume 1, chapter 1, pages 23-32, Centre for Economic Policy Research.
    5. Bryce, Cormac & Dowling, Michael & Lucey, Brian, 2020. "The journal quality perception gap," Research Policy, Elsevier, vol. 49(5).
    6. Clarke, Caroline & Knights, David & Jarvis, Carol, 2012. "A Labour of Love? Academics in Business Schools," Scandinavian Journal of Management, Elsevier, vol. 28(1), pages 5-15.
    7. Richardson, Alan J., 2015. "Quantitative research and the critical accounting project," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 32(C), pages 67-77.
    8. repec:hal:spmain:info:hdl:2441/67ft27s7u58ocangahl1jigu6p is not listed on IDEAS
    9. Hussain, Simon & Liu, Lana Yan Jun & Miller, Anthony D., 2020. "Accounting as a dichotomised discipline: An analysis of the source materials used in the construction of accounting articles," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 66(C).
    10. Michelon, Giovanna, 2021. "Accounting research boundaries, multiple centers and academic empathy," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 76(C).
    11. Ellen Hazelkorn, 2009. "Rankings and the battle for world-class excellence: Institutional strategies and policy choices," Higher Education Management and Policy, OECD Publishing, vol. 21(1), pages 1-22.
    12. Marion Fourcade & Etienne Ollion & Yann Algan, 2015. "The Superiority of Economists," Journal of Economic Perspectives, American Economic Association, vol. 29(1), pages 89-114, Winter.
    13. Gendron, Yves & Smith-Lacroix, Jean-Hubert, 2015. "The global financial crisis: Essay on the possibility of substantive change in the discipline of finance," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 30(C), pages 83-101.
    14. Hussain, Simon, 2010. "Accounting journals and the ABS quality ratings," The British Accounting Review, Elsevier, vol. 42(1), pages 1-16.
    15. repec:eme:aaaj00:aaaj-03-2019-3932 is not listed on IDEAS
    16. repec:eme:aaaj00:09513579910259942 is not listed on IDEAS
    17. Henry Sauermann & Wesley M. Cohen, 2010. "What Makes Them Tick? Employee Motives and Firm Innovation," Management Science, INFORMS, vol. 56(12), pages 2134-2153, December.
    18. Henry Sauermann & Paula Stephan, 2013. "Conflicting Logics? A Multidimensional View of Industrial and Academic Science," Organization Science, INFORMS, vol. 24(3), pages 889-909, June.
    19. Endenich, Christoph & Trapp, Rouven, 2018. "Signaling effects of scholarly profiles – The editorial teams of North American accounting association journals," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 51(C), pages 4-23.
    20. Ben-Amar, Walid & Bujaki, Merridee & McConomy, Bruce & McIlkenny, Philip, 2021. "Gendering merit: How the discourse of merit in diversity disclosures supports the gendered status quo on Canadian corporate boards," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 75(C).
    21. Tourish, Dennis & Willmott, Hugh, 2015. "In Defiance of Folly: Journal rankings, mindless measures and the ABS Guide," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 26(C), pages 37-46.
    22. Gendron, Yves & Rodrigue, Michelle, 2021. "On the centrality of peripheral research and the dangers of tight boundary gatekeeping," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 76(C).
    23. Panozzo, Fabrizio, 1997. "The making of the good academic accountant," Accounting, Organizations and Society, Elsevier, vol. 22(5), pages 447-480, July.
    24. M. Fourcade & E. Ollion & Y. Algan., 2015. "The Superiority of Economists," VOPROSY ECONOMIKI, N.P. Redaktsiya zhurnala "Voprosy Economiki", vol. 7.
    25. Brooks, Chris & Schopohl, Lisa, 2018. "Topics and trends in finance research: What is published, who publishes it and what gets cited?," The British Accounting Review, Elsevier, vol. 50(6), pages 615-637.
    26. Salter, Ammon & Salandra, Rossella & Walker, James, 2017. "Exploring preferences for impact versus publications among UK business and management academics," Research Policy, Elsevier, vol. 46(10), pages 1769-1782.
    27. Wesley M. Cohen & Henry Sauermann & Paula Stephan, 2020. "Not in the Job Description: The Commercial Activities of Academic Scientists and Engineers," Management Science, INFORMS, vol. 66(9), pages 4108-4117, September.
    28. Robert Whaples, 2009. "The Policy Views of American Economic Association Members: The Results of a New Survey," Econ Journal Watch, Econ Journal Watch, vol. 6(3), pages 337-348, September.
    29. Hicks, Diana, 2012. "Performance-based university research funding systems," Research Policy, Elsevier, vol. 41(2), pages 251-261.
    30. Richard Laughlin, 1999. "Critical accounting: nature, progress and prognosis," Accounting, Auditing & Accountability Journal, Emerald Group Publishing Limited, vol. 12(1), pages 73-78, March.
    31. Wilkinson, Brett R. & Durden, Chris H., 2015. "Inducing structural change in academic accounting research," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 26(C), pages 23-36.
    32. Humphrey, Christopher & Gendron, Yves, 2015. "What is going on? The sustainability of accounting academia," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 26(C), pages 47-66.
    33. Andreas G. F. Hoepner & Jeffrey Unerman, 2012. "Explicit and Implicit Subject Bias in the ABS Journal Quality Guide," Accounting Education, Taylor & Francis Journals, vol. 21(1), pages 3-15, December.
    34. Paul Wouters & Cassidy R. Sugimoto & Vincent Larivière & Marie E. McVeigh & Bernd Pulverer & Sarah de Rijcke & Ludo Waltman, 2019. "Rethinking impact factors: better ways to judge a journal," Nature, Nature, vol. 569(7758), pages 621-623, May.
    35. Fogarty, Timothy J. & Zimmerman, Aleksandra, 2019. "Few are called, fewer are chosen: Elite reproduction in U.S. academic accounting," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 60(C), pages 1-17.
    36. Hansen, W Lee, 1991. "The Education and Training of Economics Doctorates: Major Findings of the Executive Secretary of the American Economic Association's Commission on Graduate Education in Economics," Journal of Economic Literature, American Economic Association, vol. 29(3), pages 1054-1087, September.
    37. Brooks, Chris & Fenton, Evelyn M. & Walker, James T., 2014. "Gender and the evaluation of research," Research Policy, Elsevier, vol. 43(6), pages 990-1001.
    38. Ryazanova, Olga & McNamara, Peter & Aguinis, Herman, 2017. "Research performance as a quality signal in international labor markets: Visibility of business schools worldwide through a global research performance system," Journal of World Business, Elsevier, vol. 52(6), pages 831-841.
    39. Marion Fourcade & Etienne Ollion & Yann Algan, 2015. "La superioridad de los economistas," Revista de Economía Institucional, Universidad Externado de Colombia - Facultad de Economía, vol. 17(33), pages 13-43, July-Dece.
    40. Harvey, Charles & Yang, Ruomei & Mueller, Frank & Maclean, Mairi, 2020. "Bourdieu, strategy and the field of power," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 73(C).
    41. Gray, Rob & Milne, Markus J., 2015. "It's not what you do, it's the way that you do it? Of method and madness," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 32(C), pages 51-66.
    42. Simon Hussain, 2011. "Food for Thought on the ABS Academic Journal Quality Guide," Accounting Education, Taylor & Francis Journals, vol. 20(6), pages 545-559, June.
    43. Pelger, Christoph & Grottke, Markus, 2015. "What about the future of the academy? – Some remarks on the looming colonisation of doctoral education," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 26(C), pages 117-129.
    44. Williams, Paul F. & Jenkins, J. Gregory & Ingraham, Laura, 2006. "The winnowing away of behavioral accounting research in the US: The process for anointing academic elites," Accounting, Organizations and Society, Elsevier, vol. 31(8), pages 783-818, November.
    45. Mats Alvesson & Jörgen Sandberg, 2013. "Has Management Studies Lost Its Way? Ideas for More Imaginative and Innovative Research," Journal of Management Studies, Wiley Blackwell, vol. 50(1), pages 128-152, January.
    46. Brooks, Chris & Fenton, Evelyn & Schopohl, Lisa & Walker, James, 2019. "Why does research in finance have so little impact?," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 58(C), pages 24-52.
    47. Frank, Bjorn & Schulze, Gunther G., 2000. "Does economics make citizens corrupt?," Journal of Economic Behavior & Organization, Elsevier, vol. 43(1), pages 101-113, September.
    48. Drivas, Kyriakos & Kremmydas, Dimitris, 2020. "The Matthew effect of a journal's ranking," Research Policy, Elsevier, vol. 49(4).
    49. Ellen Hazelkorn, 2007. "The Impact of League Tables and Ranking Systems on Higher Education Decision Making," Higher Education Management and Policy, OECD Publishing, vol. 19(2), pages 1-24.
    50. Clarysse, Bart & Tartari, Valentina & Salter, Ammon, 2011. "The impact of entrepreneurial capacity, experience and organizational support on academic entrepreneurship," Research Policy, Elsevier, vol. 40(8), pages 1084-1093, October.
    51. Diana Hicks & Paul Wouters & Ludo Waltman & Sarah de Rijcke & Ismael Rafols, 2015. "Bibliometrics: The Leiden Manifesto for research metrics," Nature, Nature, vol. 520(7548), pages 429-431, April.
    52. Malsch, Bertrand & Tessier, Sophie, 2015. "Journal ranking effects on junior academics: Identity fragmentation and politicization," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 26(C), pages 84-98.
    53. Lowe, Alan & Locke, Joanne, 2005. "Perceptions of journal quality and research paradigm: results of a web-based survey of British accounting academics," Accounting, Organizations and Society, Elsevier, vol. 30(1), pages 81-98, January.
    54. Rafols, Ismael & Leydesdorff, Loet & O’Hare, Alice & Nightingale, Paul & Stirling, Andy, 2012. "How journal rankings can suppress interdisciplinary research: A comparison between Innovation Studies and Business & Management," Research Policy, Elsevier, vol. 41(7), pages 1262-1282.
    55. Min-Wei Lin & Barry Bozeman, 2006. "Researchers’ Industry Experience and Productivity in University–Industry Research Centers: A “Scientific and Technical Human Capital” Explanation," The Journal of Technology Transfer, Springer, vol. 31(2), pages 269-290, March.
    56. Claire-France Picard & Sylvain Durocher & Yves Gendron, 2019. "Desingularization and Dequalification: A Foray Into Ranking Production and Utilization Processes," European Accounting Review, Taylor & Francis Journals, vol. 28(4), pages 737-765, August.
    57. Lukka, Kari & Kasanen, Eero, 1996. "Is accounting a global or a local discipline? evidence from major research journals," Accounting, Organizations and Society, Elsevier, vol. 21(7-8), pages 755-773.
    58. Bonner, Sarah E. & Hesford, James W. & Van der Stede, Wim A. & Young, S. Mark, 2006. "The most influential journals in academic accounting," Accounting, Organizations and Society, Elsevier, vol. 31(7), pages 663-685, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hussain, Simon & Liu, Lana Yan Jun & Miller, Anthony D., 2020. "Accounting as a dichotomised discipline: An analysis of the source materials used in the construction of accounting articles," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 66(C).
    2. Argento, Daniela & van Helden, Jan, 2023. "Are public sector accounting researchers going through an identity shift due to the increasing importance of journal rankings?," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 96(C).
    3. Gendron, Yves & Rodrigue, Michelle, 2021. "On the centrality of peripheral research and the dangers of tight boundary gatekeeping," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 76(C).
    4. Endenich, Christoph & Trapp, Rouven, 2018. "Signaling effects of scholarly profiles – The editorial teams of North American accounting association journals," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 51(C), pages 4-23.
    5. Brooks, Chris & Fenton, Evelyn & Schopohl, Lisa & Walker, James, 2019. "Why does research in finance have so little impact?," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 58(C), pages 24-52.
    6. Palea, Vera, 2015. "Journal Rankings and the Sustainability of Diversity in Accounting Research," Department of Economics and Statistics Cognetti de Martiis. Working Papers 201546, University of Turin.
    7. Bryce, Cormac & Dowling, Michael & Lucey, Brian, 2020. "The journal quality perception gap," Research Policy, Elsevier, vol. 49(5).
    8. Drivas, Kyriakos & Kremmydas, Dimitris, 2020. "The Matthew effect of a journal's ranking," Research Policy, Elsevier, vol. 49(4).
    9. Palea, Vera, 2017. "Whither accounting research? A European view," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 42(C), pages 59-73.
    10. Christoph Pelger & Markus Grottke, 2017. "Research diversity in accounting doctoral education: survey results from the German-speaking countries," Business Research, Springer;German Academic Association for Business Research, vol. 10(2), pages 307-336, October.
    11. Meyer, Matthias & Waldkirch, Rüdiger W. & Duscher, Irina & Just, Alexander, 2018. "Drivers of citations: An analysis of publications in “top” accounting journals," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 51(C), pages 24-46.
    12. Humphrey, Christopher & Gendron, Yves, 2015. "What is going on? The sustainability of accounting academia," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 26(C), pages 47-66.
    13. Schmal, W. Benedikt & Haucap, Justus & Knoke, Leon, 2023. "The role of gender and coauthors in academic publication behavior," Research Policy, Elsevier, vol. 52(10).
    14. Everett, Jeff, 2008. "Editorial proximity equals publication success: A function of rational self-interest or good-faith economy?," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 19(8), pages 1149-1176.
    15. Bernard Raffournier & Alain Schatt, 2010. "Is European Accounting Research Fairly Reflected in Academic Journals? An Investigation of Possible Non-mainstream and Language Barrier Biases," European Accounting Review, Taylor & Francis Journals, vol. 19(1), pages 161-190.
    16. Simon Hussain & Lana Liu & Yue Wang & Lingyan Zuo, 2015. "Journal Rankings, Collaborative Research and Publication Strategies: Evidence from China," Accounting Education, Taylor & Francis Journals, vol. 24(3), pages 233-255, June.
    17. Carlo D'Ippoliti, 2021. "“Many‐Citedness”: Citations Measure More Than Just Scientific Quality," Journal of Economic Surveys, Wiley Blackwell, vol. 35(5), pages 1271-1301, December.
    18. Gerdin, Jonas & Englund, Hans, 2022. "Vertical, horizontal, and self control in academia: Survey evidence on their diverging effects on perceived researcher autonomy and identity," The British Accounting Review, Elsevier, vol. 54(5).
    19. Salter, Ammon & Salandra, Rossella & Walker, James, 2017. "Exploring preferences for impact versus publications among UK business and management academics," Research Policy, Elsevier, vol. 46(10), pages 1769-1782.
    20. Maria-Victoria Uribe-Bohorquez & Juan-Camilo Rivera-Ordóñez & Isabel-María García-Sánchez, 2023. "Gender disparities in accounting academia: analysis from the lens of publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(7), pages 3827-3865, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:crpeac:v:90:y:2023:i:c:s1045235421001003. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/critical-perspectives-on-accounting/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.