IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0026895.html
   My bibliography  Save this article

Cooperation between Referees and Authors Increases Peer Review Accuracy

Author

Listed:
  • Jeffrey T Leek
  • Margaret A Taub
  • Fernando J Pineda

Abstract

Peer review is fundamentally a cooperative process between scientists in a community who agree to review each other's work in an unbiased fashion. Peer review is the foundation for decisions concerning publication in journals, awarding of grants, and academic promotion. Here we perform a laboratory study of open and closed peer review based on an online game. We show that when reviewer behavior was made public under open review, reviewers were rewarded for refereeing and formed significantly more cooperative interactions (13% increase in cooperation, P = 0.018). We also show that referees and authors who participated in cooperative interactions had an 11% higher reviewing accuracy rate (P = 0.016). Our results suggest that increasing cooperation in the peer review process can lead to a decreased risk of reviewing errors.

Suggested Citation

  • Jeffrey T Leek & Margaret A Taub & Fernando J Pineda, 2011. "Cooperation between Referees and Authors Increases Peer Review Accuracy," PLOS ONE, Public Library of Science, vol. 6(11), pages 1-11, November.
    • Handle: RePEc:plo:pone00:0026895
    DOI: 10.1371/journal.pone.0026895
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0026895
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0026895&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0026895?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Bernd Pulverer, 2011. "Peer reviews: some are already public," Nature, Nature, vol. 474(7351), pages 285-285, June.
    2. Anna Dreber & David G. Rand & Drew Fudenberg & Martin A. Nowak, 2008. "Winners don’t punish," Nature, Nature, vol. 452(7185), pages 348-351, March.
    3. Hidde Ploegh, 2011. "End the wasteful tyranny of reviewer experiments," Nature, Nature, vol. 472(7344), pages 391-391, April.
    4. Christine Wennerås & Agnes Wold, 1997. "Nepotism and sexism in peer-review," Nature, Nature, vol. 387(6631), pages 341-343, May.
    5. Daniel Mietchen, 2011. "Peer reviews: make them public," Nature, Nature, vol. 473(7348), pages 452-452, May.
    6. Bernd Pulverer, 2010. "Transparency showcases strength of peer review," Nature, Nature, vol. 468(7320), pages 29-31, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Necmi K. Avkiran, 2013. "An empirical investigation of the influence of collaboration in Finance on article impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(3), pages 911-925, June.
    2. Qianjin Zong & Yafen Xie & Jiechun Liang, 2020. "Does open peer review improve citation count? Evidence from a propensity score matching analysis of PeerJ," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 607-623, October.
    3. Emilija Stojmenova Duh & Andrej Duh & Uroš Droftina & Tim Kos & Urban Duh & Tanja Simonič Korošak & Dean Korošak, 2019. "Publish-and-Flourish: Using Blockchain Platform to Enable Cooperative Scholarly Communication," Publications, MDPI, vol. 7(2), pages 1-15, May.
    4. Mantas Radzvilas & Francesco De Pretis & William Peden & Daniele Tortoli & Barbara Osimani, 2023. "Incentives for Research Effort: An Evolutionary Model of Publication Markets with Double-Blind and Open Review," Computational Economics, Springer;Society for Computational Economics, vol. 61(4), pages 1433-1476, April.
    5. Follert, Florian & Naumann, Chantal & Thieme, Lutz, 2020. "Between scientific publication and public perception: Some economic remarks on the allocation of time in science," Working Papers of the European Institute for Socioeconomics 34, European Institute for Socioeconomics (EIS), Saarbrücken.
    6. Federico Bianchi & Francisco Grimaldo & Giangiacomo Bravo & Flaminio Squazzoni, 2018. "The peer review game: an agent-based model of scientists facing resource constraints and institutional pressures," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 1401-1420, September.
    7. Gaute Wangen, 2015. "Conflicting Incentives Risk Analysis: A Case Study of the Normative Peer Review Process," Administrative Sciences, MDPI, vol. 5(3), pages 1-23, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alexander Isakov & David Rand, 2012. "The Evolution of Coercive Institutional Punishment," Dynamic Games and Applications, Springer, vol. 2(1), pages 97-109, March.
    2. Bosquet, Clément & Combes, Pierre-Philippe & Garcia-Penalosa, Cecilia, 2013. "Gender and competition: evidence from academic promotions in France," LSE Research Online Documents on Economics 58350, London School of Economics and Political Science, LSE Library.
    3. Benoît, Jean-Pierre & Galbiati, Roberto & Henry, Emeric, 2017. "Investing to cooperate: Theory and experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 144(C), pages 1-17.
    4. Flores, Lucas S. & Han, The Anh, 2024. "Evolution of commitment in the spatial public goods game through institutional incentives," Applied Mathematics and Computation, Elsevier, vol. 473(C).
    5. Wilson, Alistair J. & Wu, Hong, 2017. "At-will relationships: How an option to walk away affects cooperation and efficiency," Games and Economic Behavior, Elsevier, vol. 102(C), pages 487-507.
    6. Pan, Qiuhui & Wang, Lingxiao & Shi, Rongrong & Wang, Huan & He, Mingfeng, 2014. "Spatial modes of cooperation based on bounded rationality," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 415(C), pages 421-427.
    7. van Raan, A. F. J. & van Leeuwen, Th. N., 2002. "Assessment of the scientific basis of interdisciplinary, applied research: Application of bibliometric methods in Nutrition and Food Research," Research Policy, Elsevier, vol. 31(4), pages 611-632, May.
    8. Peter van den Besselaar & Ulf Sandström, 2016. "Gender differences in research performance and its impact on careers: a longitudinal case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(1), pages 143-162, January.
    9. Marta Vohlídalová, 2021. "Early-Career Women Academics: Between Neoliberalism and Gender Conservatism," Sociological Research Online, , vol. 26(1), pages 27-43, March.
    10. repec:cgr:cgsser:03-11 is not listed on IDEAS
    11. Pat O’Connor & Gemma Irvine, 2020. "Multi-Level State Interventions and Gender Equality in Higher Education Institutions: The Irish Case," Administrative Sciences, MDPI, vol. 10(4), pages 1-21, December.
    12. Friederike Mengel & Jan Sauermann & Ulf Zölitz, 2019. "Gender Bias in Teaching Evaluations," Journal of the European Economic Association, European Economic Association, vol. 17(2), pages 535-566.
    13. Fudenberg, Drew & Pathak, Parag A., 2010. "Unobserved punishment supports cooperation," Journal of Public Economics, Elsevier, vol. 94(1-2), pages 78-86, February.
    14. Paula Mählck & Hanna Li Kusterer & Henry Montgomery, 2020. "What professors do in peer review: Interrogating assessment practices in the recruitment of professors in Sweden," Gender, Work and Organization, Wiley Blackwell, vol. 27(6), pages 1361-1377, November.
    15. Michał Krawczyk & Magdalena Smyk, 2015. "Gender, beauty and support networks in academia: evidence from a field experiment," Working Papers 2015-43, Faculty of Economic Sciences, University of Warsaw.
    16. Rebekka Kesberg & Stefan Pfattheicher, 2019. "Democracy matters: a psychological perspective on the beneficial impact of democratic punishment systems in social dilemmas," Palgrave Communications, Palgrave Macmillan, vol. 5(1), pages 1-13, December.
    17. Lorenz Goette & David Huffman & Stephan Meier & Matthias Sutter, 2010. "Group Membership, Competition, and Altruistic versus Antisocial Punishment: Evidence from Randomly Assigned Army Groups," Working Papers 2010-24, Faculty of Economics and Statistics, Universität Innsbruck.
    18. Eugenio Proto & Aldo Rustichini & Andis Sofianos, 2020. "Intelligence, Errors and Strategic Choices in the Repeated Prisoners Dilemma," Working Papers 2020_07, Business School - Economics, University of Glasgow.
    19. Heinrich-Böll-Stiftung (Berlin) (ed.), 2007. "Die Zukunft sozialer Sicherheit," Schriften zu Wirtschaft und Soziales, Heinrich-Böll-Stiftung e.V., Berlin, volume 2, number 2.
    20. Houser, Daniel & Xiao, Erte, 2010. "Inequality-seeking punishment," Economics Letters, Elsevier, vol. 109(1), pages 20-23, October.
    21. Joanna Tyrowicz & Lucas Augusto van der Velde & Magdalena Smyk, 2024. "Gender-neutral hiring of junior scholars," GRAPE Working Papers 94, GRAPE Group for Research in Applied Economics.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0026895. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.