IDEAS home Printed from https://ideas.repec.org/a/eee/respol/v54y2025i1s0048733324001835.html
   My bibliography  Save this article

Endogeny in measuring research excellence. In-house publishing and conflict of interests in Polish science evaluation

Author

Listed:
  • Sadowski, Ireneusz
  • Zamęcki, Łukasz

Abstract

The ministerial exercise of evaluation of scientific institutions gained a pivotal role in the Polish system of science and higher education after the 2018 reform. The evaluation process under the new rules was concluded in 2022, and in the fields of social sciences and humanities (SSH), it was based to a large extent on domestic publications. We have compiled a sample of articles in journals that exerted the highest impact in the four selected SSH disciplines (over 19 thousand articles in 67 journals) to show elements of partiality in how the evaluation was administered. In particular, we show that a degree of control over a journal prompted a substantially higher share of in-house (endogenous) publications, and we point to clear signs of adaptation by editors to the changes in evaluation rules introduced by the Ministry of Science. The results of that particular national case illustrate that domestic indicators of research excellence are relatively prone to bias, as institutions very often have dual and conflicting roles.

Suggested Citation

  • Sadowski, Ireneusz & Zamęcki, Łukasz, 2025. "Endogeny in measuring research excellence. In-house publishing and conflict of interests in Polish science evaluation," Research Policy, Elsevier, vol. 54(1).
    • Handle: RePEc:eee:respol:v:54:y:2025:i:1:s0048733324001835
    DOI: 10.1016/j.respol.2024.105134
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0048733324001835
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.respol.2024.105134?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. James J. Heckman & Sidharth Moktan, 2020. "Publishing and promotion in economics - The tyranny of the Top Five," Vox eBook Chapters, in: Sebastian Galliani & Ugo Panizza (ed.), Publishing and Measuring Success in Economics, edition 1, volume 1, chapter 1, pages 23-32, Centre for Economic Policy Research.
    2. Kaare Aagaard, 2015. "How incentives trickle down: Local use of a national bibliometric indicator system," Science and Public Policy, Oxford University Press, vol. 42(5), pages 725-737.
    3. Hladchenko, Myroslava & Moed, Henk F., 2021. "The effect of publication traditions and requirements in research assessment and funding policies upon the use of national journals in 28 post-socialist countries," Journal of Informetrics, Elsevier, vol. 15(4).
    4. Brogaard, Jonathan & Engelberg, Joseph & Parsons, Christopher A., 2014. "Networks and productivity: Causal evidence from editor rotations," Journal of Financial Economics, Elsevier, vol. 111(1), pages 251-270.
    5. Przemysław Korytkowski & Emanuel Kulczycki, 2019. "Examining how country-level science policy shapes publication patterns: the case of Poland," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(3), pages 1519-1543, June.
    6. Hicks, Diana, 2012. "Performance-based university research funding systems," Research Policy, Elsevier, vol. 41(2), pages 251-261.
    7. Gunnar Sivertsen, 2016. "Patterns of internationalization and criteria for research assessment in the social sciences and humanities," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(2), pages 357-368, May.
    8. Marek Kwiek, 2020. "Internationalists and locals: international research collaboration in a resource-poor system," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 57-105, July.
    9. Katarina Prpić, 2007. "Changes of scientific knowledge production and research productivity in a transitional society," Scientometrics, Springer;Akadémiai Kiadó, vol. 72(3), pages 487-511, September.
    10. Maja Jokić & Andrea Mervar & Stjepan Mateljan, 2019. "Comparative analysis of book citations in social science journals by Central and Eastern European authors," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(3), pages 1005-1029, September.
    11. Emanuel Kulczycki & Raf Guns & Janne Pölönen & Tim C. E. Engels & Ewa A. Rozkosz & Alesia A. Zuccala & Kasper Bruun & Olli Eskola & Andreja Istenič Starčič & Michal Petr & Gunnar Sivertsen, 2020. "Multilingual publishing in the social sciences and humanities: A seven‐country European study," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 71(11), pages 1371-1385, November.
    12. Bethmann, Dirk & Bransch, Felix & Kvasnicka, Michael & Sadrieh, Abdolkarim, 2023. "Home Bias in Top Economics Journals," IZA Discussion Papers 15965, Institute of Labor Economics (IZA).
    13. Demir, Selcuk Besir, 2018. "Predatory journals: Who publishes in them and why?," Journal of Informetrics, Elsevier, vol. 12(4), pages 1296-1311.
    14. Dejan Pajić, 2015. "Globalization of the social sciences in Eastern Europe: genuine breakthrough or a slippery slope of the research evaluation practice?," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(3), pages 2131-2150, March.
    15. Campbell, Donald T., 1979. "Assessing the impact of planned social change," Evaluation and Program Planning, Elsevier, vol. 2(1), pages 67-90, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Giovanni Abramo & Ciriaco Andrea D’Angelo & Myroslava Hladchenko, 2023. "Assessing the effects of publication requirements for professorship on research performance and publishing behaviour of Ukrainian academics," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4589-4609, August.
    2. Andreea Mironescu & Alina Moroșanu & Anca-Diana Bibiri, 2023. "The regional dynamics of multilingual publishing in web of science: A statistical analysis of central and eastern european journals and researchers in linguistics," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(2), pages 1133-1162, February.
    3. Andrea Mervar & Maja Jokić, 2022. "Core-periphery nexus in the EU social sciences: bibliometric perspective," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(10), pages 5793-5817, October.
    4. Gabriel-Alexandru Vîiu & Mihai Păunescu, 2021. "The citation impact of articles from which authors gained monetary rewards based on journal metrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 4941-4974, June.
    5. Linda Sīle & Raf Vanderstraeten, 2019. "Measuring changes in publication patterns in a context of performance-based research funding systems: the case of educational research in the University of Gothenburg (2005–2014)," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(1), pages 71-91, January.
    6. Renata Kudaibergenova & Sandugash Uzakbay & Asselya Makanova & Kymbat Ramadinkyzy & Erlan Kistaubayev & Ruslan Dussekeev & Kadyrzhan Smagulov, 2022. "Managing publication change at Al-Farabi Kazakh National University: a case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 453-479, January.
    7. Yaşar Tonta & Müge Akbulut, 2020. "Does monetary support increase citation impact of scholarly papers?," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1617-1641, November.
    8. Kulczycki, Emanuel & Korzeń, Marcin & Korytkowski, Przemysław, 2017. "Toward an excellence-based research funding system: Evidence from Poland," Journal of Informetrics, Elsevier, vol. 11(1), pages 282-298.
    9. Przemysław Korytkowski & Emanuel Kulczycki, 2019. "Examining how country-level science policy shapes publication patterns: the case of Poland," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(3), pages 1519-1543, June.
    10. Piotr Śpiewanowski & Oleksandr Talavera, 2021. "Journal rankings and publication strategy," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 3227-3242, April.
    11. Marek Kwiek & Wojciech Roszka, 2022. "Academic vs. biological age in research on academic careers: a large-scale study with implications for scientifically developing systems," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3543-3575, June.
    12. Mohamed Boufarss & Mikael Laakso, 2020. "Open Sesame? Open access priorities, incentives, and policies among higher education institutions in the United Arab Emirates," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(2), pages 1553-1577, August.
    13. Giliberto Capano & Benedetto Lepori, 2024. "Designing policies that could work: understanding the interaction between policy design spaces and organizational responses in public sector," Policy Sciences, Springer;Society of Policy Sciences, vol. 57(1), pages 53-82, March.
    14. Lorenzo Ductor & Bauke Visser, 2023. "Concentration of power at the editorial boards of economics journals," Journal of Economic Surveys, Wiley Blackwell, vol. 37(2), pages 189-238, April.
    15. Chaocheng He & Jiang Wu & Qingpeng Zhang, 2021. "Characterizing research leadership on geographically weighted collaboration network," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(5), pages 4005-4037, May.
    16. Lokman Tutuncu, 2024. "Gatekeepers or gatecrashers? The inside connection in editorial board publications of Turkish national journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(2), pages 957-984, February.
    17. John Gibson, 2021. "The micro‐geography of academic research: How distinctive is economics?," Scottish Journal of Political Economy, Scottish Economic Society, vol. 68(4), pages 467-484, September.
    18. Katerina Guba, 2024. "Why do sociologists on academic periphery willingly support bibliometric indicators?," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(1), pages 497-518, January.
    19. Ann Mari May & Mary G. McGarvey & Yana Rodgers & Mark Killingsworth, 2021. "Critiques, Ethics, Prestige and Status: A Survey of Editors in Economics," Eastern Economic Journal, Palgrave Macmillan;Eastern Economic Association, vol. 47(2), pages 295-318, April.
    20. Christoph Siemroth, 2024. "Economics Peer-Review: Problems, Recent Developments, and Reform Proposals," The American Economist, Sage Publications, vol. 69(2), pages 241-258, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:respol:v:54:y:2025:i:1:s0048733324001835. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/respol .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.