How Journal Rankings can suppress Interdisciplinary Research – A Comparison between Innovation Studies and Business & Management
AbstractThis study provides new quantitative evidence on how journal rankings can disadvantage interdisciplinary research during research evaluations. Using publication data, it compares the degree of interdisciplinarity and the research performance of innovation studies units with business and management schools in the UK. Using various mappings and metrics, this study shows that: (i) innovation studies units are consistently more interdisciplinary than business and management schools; (ii) the top journals in the Association of Business Schools’ rankings span a less diverse set of disciplines than lower ranked journals; (iii) this pattern results in a more favourable performance assessment of the business and management schools, which are more disciplinary-focused. Lastly, it demonstrates how a citation-based analysis challenges the ranking-based assessment. In summary, the investigation illustrates how ostensibly ‘excellence-based’ journal rankings have a systematic bias in favour of mono-disciplinary research. The paper concludes with a discussion of implications of these phenomena, in particular how resulting bias is likely to affect negatively the evaluation and associated financial resourcing of interdisciplinary organisations, and may encourage researchers to be more compliant with disciplinary authority.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by DRUID, Copenhagen Business School, Department of Industrial Economics and Strategy/Aalborg University, Department of Business Studies in its series DRUID Working Papers with number 11-05.
Date of creation: 2011
Date of revision:
Contact details of provider:
Web page: http://www.druid.dk/
Interdisciplinary; Evaluation; Ranking; Innovation; Bibliometrics; REF;
Other versions of this item:
- Rafols, Ismael & Leydesdorff, Loet & O’Hare, Alice & Nightingale, Paul & Stirling, Andy, 2012. "How journal rankings can suppress interdisciplinary research: A comparison between Innovation Studies and Business & Management," Research Policy, Elsevier, vol. 41(7), pages 1262-1282.
- A12 - General Economics and Teaching - - General Economics - - - Relation of Economics to Other Disciplines
- O30 - Economic Development, Technological Change, and Growth - - Technological Change; Research and Development; Intellectual Property Rights - - - General
This paper has been announced in the following NEP Reports:
- NEP-ALL-2011-11-07 (All new papers)
- NEP-PKE-2011-11-07 (Post Keynesian Economics)
- NEP-SOG-2011-11-07 (Sociology of Economics)
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Paul Nightingale & Alister Scott, 2007. "Peer review and the relevance gap: Ten suggestions for policy-makers," Science and Public Policy, Oxford University Press, vol. 34(8), pages 543-553, October.
- Rhoten, Diana & Pfirman, Stephanie, 2007. "Women in interdisciplinary science: Exploring preferences and consequences," Research Policy, Elsevier, vol. 36(1), pages 56-75, February.
- Andrew J. Oswald, 2007.
"An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision-Makers,"
London School of Economics and Political Science, vol. 74(293), pages 21-31, 02.
- Oswald, Andrew J., 2006. "An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision-makers," IZA Discussion Papers 2070, Institute for the Study of Labor (IZA).
- Oswald, Andrew J., 2006. "An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision-makers," The Warwick Economics Research Paper Series (TWERPS) 744, University of Warwick, Department of Economics.
- Heinze, Thomas & Shapira, Philip & Rogers, Juan D. & Senker, Jacqueline M., 2009. "Organizational and institutional influences on creativity in scientific research," Research Policy, Elsevier, vol. 38(4), pages 610-623, May.
- Fagerberg, Jan & Verspagen, Bart, 2009.
"Innovation studies--The emerging structure of a new scientific field,"
Elsevier, vol. 38(2), pages 218-233, March.
- Jan Fagerberg & Bart Verspagen, 2009. "Innovation Studies – the emerging structure of a new scientific field," Working Papers on Innovation Studies 20090104, Centre for Technology, Innovation and Culture, University of Oslo.
- Fagerberg, Jan & Verspagen, Bart, 2009. "Innovation studies—The emerging structure of a new scientific field," Open Access publications from Maastricht University urn:nbn:nl:ui:27-21314, Maastricht University.
- Nicolas Carayol & Thuc Uyen Nguyen Thi, 2005.
"Why do academic scientists engage in interdisciplinary research?,"
Oxford University Press, vol. 14(1), pages 70-79, April.
- Nicolas CARAYOL & Thuc Uyen NGUYEN THI, 2004. "Why do Academic Scientists Engage in Interdisciplinary Research ?," Working Papers of BETA 2004-17, Bureau d'Economie Théorique et Appliquée, UDS, Strasbourg.
- Andy Stirling, 2007. "A General Framework for Analysing Diversity in Science, Technology and Society," SPRU Working Paper Series 156, SPRU - Science and Technology Policy Research, University of Sussex.
- J Sylvan Katz, 2000. "Scale-independent indicators and research evaluation," Science and Public Policy, Oxford University Press, vol. 27(1), pages 23-36, February.
- deS. Price, Derek, 1984. "The science/technology relationship, the craft of experimental science, and policy for the improvement of high technology innovation," Research Policy, Elsevier, vol. 13(1), pages 3-20, February.
- Ismael Rafols & Martin Meyer, 2008. "Diversity and network coherence as indicators of interdisciplinarity: Case studies in bionanoscience," SPRU Working Paper Series 167, SPRU - Science and Technology Policy Research, University of Sussex.
- Philip Lowe & Jeremy Phillipson, 2006. "Reflexive Interdisciplinary Research: The Making of a Research Programme on the Rural Economy and Land Use," Journal of Agricultural Economics, Wiley Blackwell, vol. 57(2), pages 165-184, 07.
- Martin, Ben R. & Irvine, John, 1993.
"Assessing basic research : Some partial indicators of scientific progress in radio astronomy,"
Elsevier, vol. 22(2), pages 106-106, April.
- Martin, Ben R. & Irvine, John, 1983. "Assessing basic research : Some partial indicators of scientific progress in radio astronomy," Research Policy, Elsevier, vol. 12(2), pages 61-90, April.
- Philip Lowe & Jeremy Phillipson, 2009. "Barriers to research collaboration across disciplines: scientific paradigms and institutional practices," Environment and Planning A, Pion Ltd, London, vol. 41(5), pages 1171-1184, May.
- Marcella Corsi & Carlo D'Ippoliti & Federico Lucidi, 2010. "Pluralism at Risk?," American Journal of Economics and Sociology, Wiley Blackwell, vol. 69(5), pages 1495-1529, November.
- Frederic S. Lee, 2007. "The Research Assessment Exercise, the state and the dominance of mainstream economics in British universities," Cambridge Journal of Economics, Oxford University Press, vol. 31(2), pages 309-325, March.
- Scott E. Page, 2007. "Prologue to The Difference: How the Power of Diversity Creates Better Groups, Firms, Schools, and Societies," Introductory Chapters, in: The Difference: How the Power of Diversity Creates Better Groups, Firms, Schools, and Societies Princeton University Press.
- Katz, J. Sylvan & Martin, Ben R., 1997. "What is research collaboration?," Research Policy, Elsevier, vol. 26(1), pages 1-18, March.
- Bhupatiraju, Samyukta & Nomaler, Önder & Triulzi, Giorgio & Verspagen, Bart, 2012. "Knowledge flows – Analyzing the core literature of innovation, entrepreneurship and science and technology studies," Research Policy, Elsevier, vol. 41(7), pages 1205-1218.
- van Rijnsoever, Frank J. & Hessels, Laurens K., 2011. "Factors associated with disciplinary and interdisciplinary research collaboration," Research Policy, Elsevier, vol. 40(3), pages 463-472, April.
- Huutoniemi, Katri & Klein, Julie Thompson & Bruun, Henrik & Hukkinen, Janne, 2010. "Analyzing interdisciplinarity: Typology and indicators," Research Policy, Elsevier, vol. 39(1), pages 79-88, February.
- Jan Youtie & Maurizio Iacopetta & Stuart Graham, 2008. "Assessing the nature of nanotechnology: can we uncover an emerging general purpose technology?," The Journal of Technology Transfer, Springer, vol. 33(3), pages 315-329, June.
- Rinia, E. J. & van Leeuwen, Th. N. & van Vuren, H. G. & van Raan, A. F. J., 2001. "Influence of interdisciplinarity on peer-review and bibliometric evaluations in physics research," Research Policy, Elsevier, vol. 30(3), pages 357-361, March.
- Tommy Clausen & Jan Fagerberg & Magnus Gulbrandsen, 2012.
"Mobilizing for Change: A Study of Research Units in Emerging Scientific Fields,"
Working Papers on Innovation Studies
20120319, Centre for Technology, Innovation and Culture, University of Oslo.
- Clausen, Tommy & Fagerberg, Jan & Gulbrandsen, Magnus, 2012. "Mobilizing for change: A study of research units in emerging scientific fields," Research Policy, Elsevier, vol. 41(7), pages 1249-1261.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Keld Laursen).
If references are entirely missing, you can add them using this form.