IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0336492.html

The influence of publication ranking specifications on publication strategy and academic careers in business administration

Author

Listed:
  • Gerhard Reichmann
  • Christian Schlögl
  • Margit Sommersguter-Reichmann

Abstract

This study examines the impact of methodological variations in publication-based rankings on the evaluation of individual research performance in business administration. Drawing on a unique dataset comprising complete personal publication lists of 233 professors from Austrian public universities (2009–2018), we apply ten distinct ranking variants that differ in their treatment of data sources, co-authorship, publication languages, article lengths, and journal qualities. These variants are categorized into purely quantity-focused and predominantly quality-focused rankings. Our results demonstrate that researcher rankings are susceptible to specification choices. While quantity-focused rankings produce relatively small performance differentials and high variability, quality-focused variants consistently identify a stable group of leading researchers. These scholars publish more frequently in English, in journals indexed by Web of Science (WoS), and in top-tier outlets according to the JOURQUAL ranking. Notably, leading researchers publish over twice as many articles in high-ranking journals as their peers. The findings underscore the significant implications of ranking design for career advancement and research strategy. For early-career researchers, aligning publication efforts with the logic of quality-focused rankings—favoring English-language publications in highly ranked, peer-reviewed journals—is crucial for enhancing academic visibility and competitiveness. Moreover, our study offers a methodological stress test for ranking systems, revealing the extent to which technical design influences outcomes. By leveraging comprehensive and multilingual publication data and systematically comparing multiple ranking methodologies, this study contributes to both the academic evaluation literature and practical guidance for researchers navigating the demands of a metric-driven academic environment.

Suggested Citation

  • Gerhard Reichmann & Christian Schlögl & Margit Sommersguter-Reichmann, 2025. "The influence of publication ranking specifications on publication strategy and academic careers in business administration," PLOS ONE, Public Library of Science, vol. 20(11), pages 1-16, November.
    • Handle: RePEc:plo:pone00:0336492
    DOI: 10.1371/journal.pone.0336492
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0336492
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0336492&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0336492?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Gerhard Reichmann & Margit Sommersguter-Reichmann, 2010. "Efficiency measures and productivity indexes in the context of university library benchmarking," Applied Economics, Taylor & Francis Journals, vol. 42(3), pages 311-323.
    2. Gerhard Reichmann & Christian Schlögl, 2022. "On the possibilities of presenting the research performance of an institute over a long period of time: the case of the Institute of Information Science at the University of Graz in Austria," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3193-3223, June.
    3. Isidro F. Aguillo & Judit Bar-Ilan & Mark Levene & José Luis Ortega, 2010. "Comparing university rankings," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(1), pages 243-256, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. F. Cugnata & G. Perucca & S. Salini, 2017. "Bayesian networks and the assessment of universities' value added," Journal of Applied Statistics, Taylor & Francis Journals, vol. 44(10), pages 1785-1806, July.
    2. Simon, Jose & Simon, Clara & Arias, Alicia, 2011. "Changes in productivity of Spanish university libraries," Omega, Elsevier, vol. 39(5), pages 578-588, October.
    3. Teja Koler-Povh & Primož Južnič & Goran Turk, 2014. "Impact of open access on citation of scholarly publications in the field of civil engineering," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 1033-1045, February.
    4. El Gibari, Samira & Gómez, Trinidad & Ruiz, Francisco, 2018. "Evaluating university performance using reference point based composite indicators," Journal of Informetrics, Elsevier, vol. 12(4), pages 1235-1250.
    5. Hyejin Park & Han Woo Park, 2018. "Two-side face of knowledge building using scientometric analysis," Quality & Quantity: International Journal of Methodology, Springer, vol. 52(6), pages 2815-2836, November.
    6. Mike Thelwall, 2017. "Judit Bar-Ilan: information scientist, computer scientist, scientometrician," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(3), pages 1235-1244, December.
    7. M. Benito & R. Romera, 2011. "Improving quality assessment of composite indicators in university rankings: a case study of French and German universities of excellence," Scientometrics, Springer;Akadémiai Kiadó, vol. 89(1), pages 153-176, October.
    8. Murat Perit Çakır & Cengiz Acartürk & Oğuzhan Alaşehir & Canan Çilingir, 2015. "A comparative analysis of global and national university ranking systems," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(3), pages 813-848, June.
    9. Shahryar Rahnamayan & Sedigheh Mahdavi & Kalyanmoy Deb & Azam Asilian Bidgoli, 2020. "Ranking Multi-Metric Scientific Achievements Using a Concept of Pareto Optimality," Mathematics, MDPI, vol. 8(6), pages 1-46, June.
    10. Frank Rijnsoever & Leon Welle & Sjoerd Bakker, 2014. "Credibility and legitimacy in policy-driven innovation networks: resource dependencies and expectations in Dutch electric vehicle subsidies," The Journal of Technology Transfer, Springer, vol. 39(4), pages 635-661, August.
    11. Hui Xuan Tan & Ephrance Abu Ujum & Kwai Fatt Choong & Kuru Ratnavelu, 2015. "Impact analysis of domestic and international research collaborations: a Malaysian case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(1), pages 885-904, January.
    12. Boring, Anne & Brown, Jennifer, 2024. "Gender and choices in higher education," Economics of Education Review, Elsevier, vol. 99(C).
    13. Marlo M Vernon & E Andrew Balas & Shaher Momani, 2018. "Are university rankings useful to improve research? A systematic review," PLOS ONE, Public Library of Science, vol. 13(3), pages 1-15, March.
    14. André de Waal, 2017. "Evaluating High Performance the Evidence-Based Way: The Case of the Swagelok Transformers," SAGE Open, , vol. 7(4), pages 21582440177, October.
    15. Pinto-Delacadena, Pablo A. & Liern, Vicente & Acosta-Vargas, Patricia & Vinueza-Cabezas, Andrea, 2024. "A multicriteria approach to ranking Latin-American universities based on region-specific criteria," Technological Forecasting and Social Change, Elsevier, vol. 208(C).
    16. Zaida Chinchilla-Rodríguez & Grisel Zacca-González & Benjamín Vargas-Quesada & Félix Moya-Anegón, 2016. "Benchmarking scientific performance by decomposing leadership of Cuban and Latin American institutions in Public Health," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(3), pages 1239-1264, March.
    17. Enar Ruiz-Conde & Aurora Calderón-Martínez, 2014. "University institutional repositories: competitive environment and their role as communication media of scientific knowledge," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 1283-1299, February.
    18. Hernández-Escobedo, Quetzalcoatl & Perea-Moreno, Alberto-Jesús & Manzano-Agugliaro, Francisco, 2018. "Wind energy research in Mexico," Renewable Energy, Elsevier, vol. 123(C), pages 719-729.
    19. Molinos-Senante, María & Delgado-Antequera, Laura & Gómez, Trinidad, 2022. "Measuring the quality of service of water companies: A two-stage goal programming synthetic index proposal," Socio-Economic Planning Sciences, Elsevier, vol. 79(C).
    20. Yuan Wang & Ruimin Ma & Tianhao Tang & Xia Liu & Ping Xie & Jianxin Wang & Jianxiang Liu & Haideng Zhou & Siwei Zhang, 2012. "The comprehensive competitiveness evaluation of American universities in Bridge Engineering," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(3), pages 693-701, June.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0336492. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.