The Miracle of Peer Review and Development inScience: An Agent-Based Model
It is not easy to rationalize how peer review, as the current grassroots of science, can work based on voluntary contributions of reviewers. There is no rationale to write impartial and thorough evaluations. Consequently, there is no risk in submitting lowquality work by authors. As a result, scientists face a social dilemma: if everyone acts according to his or her own self-interest, low scientific quality is produced. Still, in practice, reviewers as well as authors invest high effort in reviews and submissions. We examine how the increased relevance of public good benefits (journal impact factor), the editorial policy of handling incoming reviews, and the acceptance decisions that take into account reputational information can help the evolution of high-quality contributions from authors. High effort from the side of reviewers is problematic even if authors cooperate: reviewers are still best off by producing low-quality reviews, which does not hinder scientific development, just adds random noise and unnecessary costs to it. We show with agent-based simulations that tacit agreements between authors that are based on reciprocity might decrease these costs, but does not result in superior scientific quality. Our study underlines why certain self-emerged current practices, such as the increased importance of journal metrics, the reputation-based selection of reviewers, and the reputation bias in acceptance work efficiently for scientific development. Our results find no answers, however, how the system of peer review with impartial and thorough evaluations could be sustainable jointly with rapid scientifi9c development.
|Date of creation:||Jul 2016|
|Contact details of provider:|| Web page: http://www.capp.unimore.it|
More information through EDIRC
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Raj Chetty & Emmanuel Saez & Laszlo Sandor, 2014.
"What Policies Increase Prosocial Behavior? An Experiment with Referees at the Journal of Public Economics,"
Journal of Economic Perspectives,
American Economic Association, vol. 28(3), pages 169-188, Summer.
- Raj Chetty & Emmanuel Saez & László Sándor, "undated". "What Policies Increase Prosocial Behavior? An Experiment with Referees at the Journal of Public Economics," Working Paper 176786, Harvard University OpenScholar.
- Chetty, Raj & Saez, Emmanuel & SÃ¡ndor, LÃ¡szlÃ³, 2014. "What Policies Increase Prosocial Behavior? An Experiment with Referees at the Journal of Public Economics," Scholarly Articles 22803569, Harvard University Department of Economics.
- Raj Chetty & Emmanuel Saez & László Sándor, 2014. "What Policies Increase Prosocial Behavior? An Experiment with Referees at the Journal of Public Economics," NBER Working Papers 20290, National Bureau of Economic Research, Inc.
When requesting a correction, please mention this item's handle: RePEc:mod:cappmo:0144. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Sara Colombini)
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.