IDEAS home Printed from https://ideas.repec.org/a/eee/respol/v54y2025i1s0048733324001835.html

Endogeny in measuring research excellence. In-house publishing and conflict of interests in Polish science evaluation

Author

Listed:
  • Sadowski, Ireneusz
  • Zamęcki, Łukasz

Abstract

The ministerial exercise of evaluation of scientific institutions gained a pivotal role in the Polish system of science and higher education after the 2018 reform. The evaluation process under the new rules was concluded in 2022, and in the fields of social sciences and humanities (SSH), it was based to a large extent on domestic publications. We have compiled a sample of articles in journals that exerted the highest impact in the four selected SSH disciplines (over 19 thousand articles in 67 journals) to show elements of partiality in how the evaluation was administered. In particular, we show that a degree of control over a journal prompted a substantially higher share of in-house (endogenous) publications, and we point to clear signs of adaptation by editors to the changes in evaluation rules introduced by the Ministry of Science. The results of that particular national case illustrate that domestic indicators of research excellence are relatively prone to bias, as institutions very often have dual and conflicting roles.

Suggested Citation

  • Sadowski, Ireneusz & Zamęcki, Łukasz, 2025. "Endogeny in measuring research excellence. In-house publishing and conflict of interests in Polish science evaluation," Research Policy, Elsevier, vol. 54(1).
    • Handle: RePEc:eee:respol:v:54:y:2025:i:1:s0048733324001835
    DOI: 10.1016/j.respol.2024.105134
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0048733324001835
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.respol.2024.105134?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Gunnar Sivertsen, 2016. "Patterns of internationalization and criteria for research assessment in the social sciences and humanities," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(2), pages 357-368, May.
    2. Marek Kwiek, 2020. "Internationalists and locals: international research collaboration in a resource-poor system," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 57-105, July.
    3. Katarina Prpić, 2007. "Changes of scientific knowledge production and research productivity in a transitional society," Scientometrics, Springer;Akadémiai Kiadó, vol. 72(3), pages 487-511, September.
    4. Emanuel Kulczycki & Raf Guns & Janne Pölönen & Tim C. E. Engels & Ewa A. Rozkosz & Alesia A. Zuccala & Kasper Bruun & Olli Eskola & Andreja Istenič Starčič & Michal Petr & Gunnar Sivertsen, 2020. "Multilingual publishing in the social sciences and humanities: A seven‐country European study," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 71(11), pages 1371-1385, November.
    5. Bethmann, Dirk & Bransch, Felix & Kvasnicka, Michael & Sadrieh, Abdolkarim, 2023. "Home Bias in Top Economics Journals," IZA Discussion Papers 15965, IZA Network @ LISER.
    6. Kaare Aagaard, 2015. "How incentives trickle down: Local use of a national bibliometric indicator system," Science and Public Policy, Oxford University Press, vol. 42(5), pages 725-737.
    7. James J. Heckman & Sidharth Moktan, 2020. "Publishing and Promotion in Economics: The Tyranny of the Top Five," Journal of Economic Literature, American Economic Association, vol. 58(2), pages 419-470, June.
    8. Demir, Selcuk Besir, 2018. "Predatory journals: Who publishes in them and why?," Journal of Informetrics, Elsevier, vol. 12(4), pages 1296-1311.
    9. Hladchenko, Myroslava & Moed, Henk F., 2021. "The effect of publication traditions and requirements in research assessment and funding policies upon the use of national journals in 28 post-socialist countries," Journal of Informetrics, Elsevier, vol. 15(4).
    10. Brogaard, Jonathan & Engelberg, Joseph & Parsons, Christopher A., 2014. "Networks and productivity: Causal evidence from editor rotations," Journal of Financial Economics, Elsevier, vol. 111(1), pages 251-270.
    11. Dejan Pajić, 2015. "Globalization of the social sciences in Eastern Europe: genuine breakthrough or a slippery slope of the research evaluation practice?," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(3), pages 2131-2150, March.
    12. Przemysław Korytkowski & Emanuel Kulczycki, 2019. "Examining how country-level science policy shapes publication patterns: the case of Poland," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(3), pages 1519-1543, June.
    13. Hicks, Diana, 2012. "Performance-based university research funding systems," Research Policy, Elsevier, vol. 41(2), pages 251-261.
    14. Maja Jokić & Andrea Mervar & Stjepan Mateljan, 2019. "Comparative analysis of book citations in social science journals by Central and Eastern European authors," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(3), pages 1005-1029, September.
    15. Campbell, Donald T., 1979. "Assessing the impact of planned social change," Evaluation and Program Planning, Elsevier, vol. 2(1), pages 67-90, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Giovanni Abramo & Ciriaco Andrea D’Angelo & Myroslava Hladchenko, 2023. "Assessing the effects of publication requirements for professorship on research performance and publishing behaviour of Ukrainian academics," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4589-4609, August.
    2. Andrea Mervar & Maja Jokić, 2023. "Correction: Core-periphery nexus in the EU social sciences: bibliometric perspective," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(7), pages 4165-4165, July.
    3. Andreea Mironescu & Alina Moroșanu & Anca-Diana Bibiri, 2023. "The regional dynamics of multilingual publishing in web of science: A statistical analysis of central and eastern european journals and researchers in linguistics," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(2), pages 1133-1162, February.
    4. Gabriel-Alexandru Vîiu & Mihai Păunescu, 2021. "The citation impact of articles from which authors gained monetary rewards based on journal metrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 4941-4974, June.
    5. Linda Sīle & Raf Vanderstraeten, 2019. "Measuring changes in publication patterns in a context of performance-based research funding systems: the case of educational research in the University of Gothenburg (2005–2014)," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(1), pages 71-91, January.
    6. Kulczycki, Emanuel & Korzeń, Marcin & Korytkowski, Przemysław, 2017. "Toward an excellence-based research funding system: Evidence from Poland," Journal of Informetrics, Elsevier, vol. 11(1), pages 282-298.
    7. Renata Kudaibergenova & Sandugash Uzakbay & Asselya Makanova & Kymbat Ramadinkyzy & Erlan Kistaubayev & Ruslan Dussekeev & Kadyrzhan Smagulov, 2022. "Managing publication change at Al-Farabi Kazakh National University: a case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 453-479, January.
    8. Yaşar Tonta & Müge Akbulut, 2020. "Does monetary support increase citation impact of scholarly papers?," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1617-1641, November.
    9. Constantinos Alexiou & George Saridakis, 2025. "A Review of the Performance Metrics and Entrepreneurial Practices of Economics and Business Departments in UK Universities: A ‘Gresham’s Law’ Threat?," Journal of Entrepreneurship and Innovation in Emerging Economies, Entrepreneurship Development Institute of India, vol. 11(2), pages 281-308, July.
    10. Przemysław Korytkowski & Emanuel Kulczycki, 2019. "Examining how country-level science policy shapes publication patterns: the case of Poland," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(3), pages 1519-1543, June.
    11. Piotr Śpiewanowski & Oleksandr Talavera, 2021. "Journal rankings and publication strategy," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 3227-3242, April.
    12. Marek Kwiek & Wojciech Roszka, 2022. "Academic vs. biological age in research on academic careers: a large-scale study with implications for scientifically developing systems," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3543-3575, June.
    13. Pat Pataranutaporn & Nattavudh Powdthavee & Chayapatr Achiwaranguprok & Pattie Maes, 2025. "Can AI Solve the Peer Review Crisis? A Large Scale Cross Model Experiment of LLMs' Performance and Biases in Evaluating over 1000 Economics Papers," Papers 2502.00070, arXiv.org, revised Apr 2025.
    14. El Tinay, Hassan & Schor, Juliet B., 2025. "Do economists think about climate change and inequality? Semantic analysis and topic modeling of top five economics journals," Ecological Economics, Elsevier, vol. 232(C).
    15. Darja Maslić Seršić & Marina Martinčević & Maja Jokić, 2021. "The contribution of CEE authors to psychological science: a comparative analysis of papers published in CEE and non-CEE journals indexed by Scopus in the period 1996—2013," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1453-1469, February.
    16. Mohamed Boufarss & Mikael Laakso, 2020. "Open Sesame? Open access priorities, incentives, and policies among higher education institutions in the United Arab Emirates," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(2), pages 1553-1577, August.
    17. Giliberto Capano & Benedetto Lepori, 2024. "Designing policies that could work: understanding the interaction between policy design spaces and organizational responses in public sector," Policy Sciences, Springer;Society of Policy Sciences, vol. 57(1), pages 53-82, March.
    18. Angus, Simon D. & Atalay, Kadir & Newton, Jonathan & Ubilava, David, 2021. "Geographic diversity in economic publishing," Journal of Economic Behavior & Organization, Elsevier, vol. 190(C), pages 255-262.
    19. Li, Meiling & Wang, Yang & Du, Haifeng & Bai, Aruhan, 2024. "Motivating innovation: The impact of prestigious talent funding on junior scientists," Research Policy, Elsevier, vol. 53(9).
    20. Lorenzo Ductor & Bauke Visser, 2023. "Concentration of power at the editorial boards of economics journals," Journal of Economic Surveys, Wiley Blackwell, vol. 37(2), pages 189-238, April.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:respol:v:54:y:2025:i:1:s0048733324001835. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/respol .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.