IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0239336.html
   My bibliography  Save this article

Scholars as government-appointed research evaluators: Do they create congruence between their professional quality standards and political demands?

Author

Listed:
  • Hendrik Woiwode

Abstract

All across the globe politically initiated research evaluations are based on “informed peer review” procedures. Scholars are appointed as evaluators and can apply self-defined quality standards in order to overcome shortcomings of standardized measures. Even though there are no binding criteria in these procedures and the quality standards of the scholars' disciplines vary, studies suggest that scholars, in their role as government-appointed research evaluators, assess research uniformly.By drawing on a small-N investigation, this study compares the quality standards scholars apply as government-appointed research evaluators with quality standards they follow as researchers. The study points to a paradox: Criteria scholars refer to while describing the excellence of their own research and criteria they use as evaluators differ and contradict each other. The results are discussed from different angles.

Suggested Citation

  • Hendrik Woiwode, 2020. "Scholars as government-appointed research evaluators: Do they create congruence between their professional quality standards and political demands?," PLOS ONE, Public Library of Science, vol. 15(10), pages 1-14, October.
    • Handle: RePEc:plo:pone00:0239336
    DOI: 10.1371/journal.pone.0239336
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0239336
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0239336&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0239336?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Giovanni Abramo & Ciriaco Andrea D’Angelo, 2011. "Evaluating research: from informed peer review to bibliometrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(3), pages 499-514, June.
    2. Cooper, David J. & Robson, Keith, 2006. "Accounting, professions and regulation: Locating the sites of professionalization," Accounting, Organizations and Society, Elsevier, vol. 31(4-5), pages 415-444.
    3. Henk J. ter Bogt & Robert W. Scapens, 2012. "Performance Management in Universities: Effects of the Transition to More Quantitative Measurement Systems," European Accounting Review, Taylor & Francis Journals, vol. 21(3), pages 451-497, February.
    4. Daniel Muzio & David M. Brock & Roy Suddaby, 2013. "Professions and Institutional Change: Towards an Institutionalist Sociology of the Professions," Journal of Management Studies, Wiley Blackwell, vol. 50(5), pages 699-721, July.
    5. Woiwode, Hendrik & Froese, Anna, 2021. "Two hearts beating in a research centers’ chest: how scholars in interdisciplinary research settings cope with monodisciplinary deep structures," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 46(11), pages 2230-2244.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Woiwode, Hendrik, 2020. "Scholars as government-appointed research evaluators: Do they create congruence between their professional quality standards and political demands?," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 15(10), pages 1-1.
    2. Canning, Mary & O'Dwyer, Brendan, 2016. "Institutional work and regulatory change in the accounting profession," Accounting, Organizations and Society, Elsevier, vol. 54(C), pages 1-21.
    3. François Brouard & Merridee Bujaki & Sylvain Durocher & Leighann C. Neilson, 2017. "Professional Accountants’ Identity Formation: An Integrative Framework," Journal of Business Ethics, Springer, vol. 142(2), pages 225-238, May.
    4. Darius Fatemi & John Hasseldine & Peggy Hite, 2020. "The Influence of Ethical Codes of Conduct on Professionalism in Tax Practice," Journal of Business Ethics, Springer, vol. 164(1), pages 133-149, June.
    5. Prianto Budi Saptono & Gustofan Mahmud & Intan Pratiwi & Dwi Purwanto & Ismail Khozen & Muhamad Akbar Aditama & Siti Khodijah & Maria Eurelia Wayan & Rina Yuliastuty Asmara & Ferry Jie, 2023. "Development of Climate-Related Disclosure Indicators for Application in Indonesia: A Delphi Method Study," Sustainability, MDPI, vol. 15(14), pages 1-25, July.
    6. Nieves Carrera & Nieves Gómez‐Aguilar & Christopher Humphrey & Emiliano Ruiz‐Barbadillo, 2007. "Mandatory audit firm rotation in Spain: a policy that was never applied," Accounting, Auditing & Accountability Journal, Emerald Group Publishing Limited, vol. 20(5), pages 671-701, September.
    7. A. E. Rodríguez Salazar & M. A. Domínguez-Crespo & A. M. Torres-Huerta & A. I. Licona-Aguilar & A. Nivón-Pellón & V. N. Orta-Guzmán, 2021. "Analysis of the Dynamical Capabilities into the Public Research Institutes to Their Strategic Decision-Making," Sustainability, MDPI, vol. 13(12), pages 1-22, June.
    8. Peter Kariuki & Beatrice Elesani Ombaka & Paul Kiumbe Mburu, 2021. "Sustainability strategies and performance of public universities in Kenya," International Journal of Research in Business and Social Science (2147-4478), Center for the Strategic Studies in Business and Finance, vol. 10(7), pages 40-52, October.
    9. Maroun, Warren & Solomon, Jill, 2014. "Whistle-blowing by external auditors: Seeking legitimacy for the South African Audit Profession?," Accounting forum, Elsevier, vol. 38(2), pages 109-121.
    10. Alexander Kalgin & Olga Kalgina & Anna Lebedeva, 2019. "Publication Metrics as a Tool for Measuring Research Productivity and Their Relation to Motivation," Voprosy obrazovaniya / Educational Studies Moscow, National Research University Higher School of Economics, issue 1, pages 44-86.
    11. Markard, Jochen & Erlinghagen, Sabine, 2017. "Technology users and standardization: Game changing strategies in the field of smart meter technology," Technological Forecasting and Social Change, Elsevier, vol. 118(C), pages 226-235.
    12. Humphrey, Christopher & Loft, Anne & Woods, Margaret, 2009. "The global audit profession and the international financial architecture: Understanding regulatory relationships at a time of financial crisis," Accounting, Organizations and Society, Elsevier, vol. 34(6-7), pages 810-825, August.
    13. Urska Kosi & Antonia Reither, 2014. "Determinants of Corporate Participation in the IFRS 4 (Insurance Contracts) Replacement Process," Accounting in Europe, Taylor & Francis Journals, vol. 11(1), pages 89-112, June.
    14. Olugbenga Oladinrin & Kasun Gomis & Wadu Mesthrige Jayantha & Lovelin Obi & Muhammad Qasim Rana, 2021. "Scientometric Analysis of Global Scientific Literature on Aging in Place," IJERPH, MDPI, vol. 18(23), pages 1-16, November.
    15. Duboisée de Ricquebourg, Alan & Maroun, Warren, 2023. "How do auditor rotations affect key audit matters? Archival evidence from South African audits," The British Accounting Review, Elsevier, vol. 55(2).
    16. Hayoun, Shaul, 2019. "How fair value is both market-based and entity-specific: The irreducibility of value constellations to market prices," Accounting, Organizations and Society, Elsevier, vol. 73(C), pages 68-82.
    17. Nadeem Shafique Butt & Ahmad Azam Malik & Muhammad Qaiser Shahbaz, 2021. "Bibliometric Analysis of Statistics Journals Indexed in Web of Science Under Emerging Source Citation Index," SAGE Open, , vol. 11(1), pages 21582440209, January.
    18. Mike W. Peng, 2019. "Global competition and diffusion of the “A” list," Frontiers of Business Research in China, Springer, vol. 13(1), pages 1-23, December.
    19. Pascal Mantel, 2018. "Territoires professionnels en tension : De la recomposition d’un monopole par l’Ordre des Experts-Comptables français," Post-Print hal-01907942, HAL.
    20. Dakota Murray & Clara Boothby & Huimeng Zhao & Vanessa Minik & Nicolas Bérubé & Vincent Larivière & Cassidy R Sugimoto, 2020. "Exploring the personal and professional factors associated with student evaluations of tenure-track faculty," PLOS ONE, Public Library of Science, vol. 15(6), pages 1-21, June.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0239336. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.