IDEAS home Printed from https://ideas.repec.org/a/bpj/germec/v10y2009i3p352-363.html
   My bibliography  Save this article

Misleading Rankings of Research in Business

Author

Listed:
  • Albers Sönke

    (Christian-Albrechts-University at Kiel,Kiel, Germany)

Abstract

The attempts by Schulze and colleagues and Ritzberger to develop a joint ranking of journals for economics and business research are critically evaluated. Their lists suggest that the quality of top business journals is substantially lower than that of many economics journals. If, however, the authors of these lists do not want to claim a general superiority of one discipline (economics) over another one (business), they should give a clear indication that these lists are only applicable for economists. This warning appears to be necessary because Fabel and colleagues derive a ranking of universities and departments with respect to research productivity in business from the business research discriminating list RbR_IMP by Schulze and colleagues. While Diamantopoulos and Wagner already show a lack of face validity of these results, this article explains that the reason for this lies not only in the downgrading and also biased weighting of the business journals across subfields, but even more importantly, in a remarkable incompleteness of the database.

Suggested Citation

  • Albers Sönke, 2009. "Misleading Rankings of Research in Business," German Economic Review, De Gruyter, vol. 10(3), pages 352-363, August.
  • Handle: RePEc:bpj:germec:v:10:y:2009:i:3:p:352-363
    DOI: 10.1111/j.1468-0475.2009.00483.x
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/j.1468-0475.2009.00483.x
    Download Restriction: For access to full text, subscription to the journal or payment for the individual article is required.
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Roberto Serrano, 2004. "The Measurement of Intellectual Influence: the Views of a Sceptic," Economics Bulletin, AccessEcon, vol. 1(3), pages 1-6.
    2. Bruno S. Frey & Katja Rost, 2010. "Do rankings reflect research quality?," Journal of Applied Economics, Universidad del CEMA, vol. 13, pages 1-38, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Müller, Harry, 2012. "Die Zitationshäufigkeit als Qualitätsindikator im Rahmen der Forschungsleistungsmessung," Discussion Papers of the Institute for Organisational Economics 1/2012, University of Münster, Institute for Organisational Economics.
    2. Margit Osterloh & Bruno S. Frey, 2009. "Research Governance in Academia: Are there Alternatives to Academic Rankings?," CREMA Working Paper Series 2009-17, Center for Research in Economics, Management and the Arts (CREMA).
    3. Margit Osterloh & Bruno S. Frey, 2009. "Research governance in academia: are there alternatives to academic rankings?," IEW - Working Papers 423, Institute for Empirical Research in Economics - University of Zurich.
    4. Bruno S. Frey & Margit Osterloh, 2011. "Ranking Games," CREMA Working Paper Series 2011-16, Center for Research in Economics, Management and the Arts (CREMA).
    5. Dilger, Alexander & Müller, Harry, 2011. "Ein Forschungsleistungsranking auf der Grundlage von Google Scholar," Discussion Papers of the Institute for Organisational Economics 12/2011, University of Münster, Institute for Organisational Economics.
    6. Müller, Harry & Dilger, Alexander, 2013. "Der Einfluss des Forschungsschwerpunkts auf den Zitationserfolg: Eine empirische Untersuchung anhand der Gesamtpublikationen deutschsprachiger Hochschullehrer für BWL," Discussion Papers of the Institute for Organisational Economics 1/2013, University of Münster, Institute for Organisational Economics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Albers, Sönke, 2008. "Three Failed Attempts of Joint Rankings of Research in Economics and Business," MPRA Paper 12868, University Library of Munich, Germany, revised 16 Jan 2009.
    2. Albers, Sönke, 2009. "Discriminating Rankings of Research in Business," EconStor Preprints 24827, ZBW - Leibniz Information Centre for Economics.
    3. Klaus Wohlrabe, 2018. "Einige Anmerkungen zum FAZ-Ökonomenranking 2018," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 71(20), pages 29-33, October.
    4. Müller, Harry, 2012. "Die Zitationshäufigkeit als Qualitätsindikator im Rahmen der Forschungsleistungsmessung," Discussion Papers of the Institute for Organisational Economics 1/2012, University of Münster, Institute for Organisational Economics.
    5. Gebhard Kirchgässner, 2011. "Kaderschmieden der Wirtschaft und/oder Universitäten? Der Auftrag der Wirtschaftsuniversitäten und –fakultäten im 21. Jahrhundert," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 12(3), pages 317-337, August.
    6. Justus Haucap & Johannes Muck, 2015. "What drives the relevance and reputation of economics journals? An update from a survey among economists," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(3), pages 849-877, June.
    7. Daraio, Cinzia & Bonaccorsi, Andrea & Geuna, Aldo & Lepori, Benedetto & Bach, Laurent & Bogetoft, Peter & F. Cardoso, Margarida & Castro-Martinez, Elena & Crespi, Gustavo & de Lucio, Ignacio Fernandez, 2011. "The European university landscape: A micro characterization based on evidence from the Aquameth project," Research Policy, Elsevier, vol. 40(1), pages 148-164, February.
    8. Xie, Yundong & Wu, Qiang & Zhang, Peng & Li, Xingchen, 2020. "Information Science and Library Science (IS-LS) journal subject categorisation and comparison based on editorship information," Journal of Informetrics, Elsevier, vol. 14(4).
    9. Wildgaard, Lorna, 2016. "A critical cluster analysis of 44 indicators of author-level performance," Journal of Informetrics, Elsevier, vol. 10(4), pages 1055-1078.
    10. Muhammad Adnan Waseem & Bahaudin G Mujtaba & Huma Shakir, 2013. "Suggested Mechanism for Producing Quality Research at Higher Educational Institutes in Pakistan; System, Structure, Culture and Leadership Issues," International Journal of Learning and Development, Macrothink Institute, vol. 3(1), pages 191-202, December.
    11. Carmen Herrero & Antonio Villar, 2013. "On the Comparison of Group Performance with Categorical Data," PLOS ONE, Public Library of Science, vol. 8(12), pages 1-7, December.
    12. Klaus Wohlrabe, 2020. "Einige Anmerkungen zum FAZ-Ökonomenranking 2020," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 73(11), pages 53-57, November.
    13. Roger Fouquet, 2012. "Economics of Energy and Climate Change: Origins, Developments and Growth," Working Papers 2012-08, BC3.
    14. Dengsheng Wu & Xiaoli Lu & Jianping Li & Jing Li, 0. "Does the institutional diversity of editorial boards increase journal quality? The case economics field," Scientometrics, Springer;Akadémiai Kiadó, vol. 0, pages 1-19.
    15. Perlin, Marcelo S. & Santos, André A.P. & Imasato, Takeyoshi & Borenstein, Denis & Da Silva, Sergio, 2017. "The Brazilian scientific output published in journals: A study based on a large CV database," Journal of Informetrics, Elsevier, vol. 11(1), pages 18-31.
    16. Marlo M Vernon & E Andrew Balas & Shaher Momani, 2018. "Are university rankings useful to improve research? A systematic review," PLOS ONE, Public Library of Science, vol. 13(3), pages 1-15, March.
    17. Monacciani, Fabiana, 2010. "University departments evaluation: a multivariate approach," MPRA Paper 24224, University Library of Munich, Germany.
    18. Haucap, Justus & Thomas, Tobias & Wohlrabe, Klaus, 2017. "Publication performance vs. influence: On the questionable value of quality weighted publication rankings," DICE Discussion Papers 277, University of Düsseldorf, Düsseldorf Institute for Competition Economics (DICE).
    19. Tüselmann, Heinz & Sinkovics, Rudolf R. & Pishchulov, Grigory, 2016. "Revisiting the standing of international business journals in the competitive landscape," Journal of World Business, Elsevier, vol. 51(4), pages 487-498.
    20. Laura Vana & Ronald Hochreiter & Kurt Hornik, 2016. "Computing a journal meta-ranking using paired comparisons and adaptive lasso estimators," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(1), pages 229-251, January.

    More about this item

    Keywords

    Journal ranking; university ranking;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bpj:germec:v:10:y:2009:i:3:p:352-363. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Peter Golla). General contact details of provider: https://www.degruyter.com .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.