Does incentive provision increase the quality of peer review? An experimental study
AbstractAlthough peer review is crucial for innovation and experimental discoveries in science, it is poorly understood in scientific terms. Discovering its true dynamics and exploring adjustments which improve the commitment of everyone involved could benefit scientific development for all disciplines and consequently increase innovation in the economy and the society. We have reported the results of an innovative experiment developed to model peer review. We demonstrate that offering material rewards to referees tends to decrease the quality and efficiency of the reviewing process. Our findings help to discuss the viability of different options of incentive provision, supporting the idea that journal editors and responsible of research funding agencies should be extremely careful in offering material incentives on reviewing, since these might undermine moral motives which guide referees’ behavior.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoArticle provided by Elsevier in its journal Research Policy.
Volume (Year): 42 (2013)
Issue (Month): 1 ()
Contact details of provider:
Web page: http://www.elsevier.com/locate/respol
Science policy; Peer review; Cooperation; Trust; Reputation;
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Richard R. Nelson, 1959. "The Simple Economics of Basic Scientific Research," Journal of Political Economy, University of Chicago Press, vol. 67, pages 297.
- Ernst Fehr & Klaus M. Schmidt, .
"A Theory of Fairness, Competition and Cooperation,"
IEW - Working Papers
004, Institute for Empirical Research in Economics - University of Zurich.
- Fehr, Ernst & Schmidt, Klaus M., . "A theory of fairness, competition, and cooperation," Chapters in Economics, University of Munich, Department of Economics.
- Ernst Fehr & Klaus M. Schmidt, 1999. "A Theory Of Fairness, Competition, And Cooperation," The Quarterly Journal of Economics, MIT Press, vol. 114(3), pages 817-868, August.
- Fehr, Ernst & Schmidt, Klaus M., 1998. "A Theory of Fairness, Competition and Cooperation," CEPR Discussion Papers 1812, C.E.P.R. Discussion Papers.
- Fehr, Ernst & Schmidt, Klaus M., 1999. "A theory of fairness, competition, and cooperation," Munich Reprints in Economics 20650, University of Munich, Department of Economics.
- Daniel S. Hamermesh, 1994. "Facts and Myths about Refereeing," Journal of Economic Perspectives, American Economic Association, vol. 8(1), pages 153-163, Winter.
- Urs Fischbacher, 2007. "z-Tree: Zurich toolbox for ready-made economic experiments," Experimental Economics, Springer, vol. 10(2), pages 171-178, June.
- Herbert Gintis, 2000. "Strong Reciprocity and Human Sociality," UMASS Amherst Economics Working Papers 2000-02, University of Massachusetts Amherst, Department of Economics.
- Matthew Rabin., 1992.
"Incorporating Fairness into Game Theory and Economics,"
Economics Working Papers
92-199, University of California at Berkeley.
- Rabin, Matthew, 1993. "Incorporating Fairness into Game Theory and Economics," American Economic Review, American Economic Association, vol. 83(5), pages 1281-1302, December.
- M. Rabin, 2001. "Incorporating Fairness into Game Theory and Economics," Levine's Working Paper Archive 511, David K. Levine.
- Haeussler, Carolin, 2011.
"Information-sharing in academia and the industry: A comparative study,"
Elsevier, vol. 40(1), pages 105-122, February.
- Carolin Haeussler, 2010. "Information-Sharing in Academia and the Industry: A Comparative Study," Working Paper Series of the German Council for Social and Economic Data 154, German Council for Social and Economic Data (RatSWD).
- Haeussler, Carolin, 2010. "Information-Sharing in Academia and the Industry: A Comparative Study," MPRA Paper 24415, University Library of Munich, Germany.
- Flaminio Squazzoni & K�roly Tak�cs, 2011. "Social Simulation That 'Peers into Peer Review'," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 14(4), pages 3.
- Engers, Maxim & Gans, Joshua S, 1998. "Why Referees Are Not Paid (Enough)," American Economic Review, American Economic Association, vol. 88(5), pages 1341-49, December.
- Juin-jen Chang & Ching-chong Lai, 2001. "Is It Worthwhile to Pay Referees?," Southern Economic Journal, Southern Economic Association, vol. 68(2), pages 457-463, October.
- Andreas Ortmann & John Fitzgerald & Carl Boeing, 2000. "Trust, Reciprocity, and Social History: A Re-examination," Experimental Economics, Springer, vol. 3(1), pages 81-100, June.
- Paula E. Stephan, 1996. "The Economics of Science," Journal of Economic Literature, American Economic Association, vol. 34(3), pages 1199-1235, September.
- Pollak, Robert A & Wachter, Michael L, 1975. "The Relevance of the Household Production Function and Its Implications for the Allocation of Time," Journal of Political Economy, University of Chicago Press, vol. 83(2), pages 255-77, April.
- Glenn Ellison, 2000.
"The Slowdown of the Economics Publishing Process,"
NBER Working Papers
7804, National Bureau of Economic Research, Inc.
- Azar, Ofer H., 2002.
"Evolution of social norms with heterogeneous preferences: A general model and an application to the academic review process,"
4482, University Library of Munich, Germany.
- Azar, Ofer H., 2008. "Evolution of social norms with heterogeneous preferences: A general model and an application to the academic review process," Journal of Economic Behavior & Organization, Elsevier, vol. 65(3-4), pages 420-435, March.
- Berg Joyce & Dickhaut John & McCabe Kevin, 1995. "Trust, Reciprocity, and Social History," Games and Economic Behavior, Elsevier, vol. 10(1), pages 122-142, July.
- Scott Stern, 2004. "Do Scientists Pay to Be Scientists?," Management Science, INFORMS, vol. 50(6), pages 835-853, June.
- Kenneth Arrow, 1962. "Economic Welfare and the Allocation of Resources for Invention," NBER Chapters, in: The Rate and Direction of Inventive Activity: Economic and Social Factors, pages 609-626 National Bureau of Economic Research, Inc.
- Frey, Bruno S & Jegen, Reto, 2001. " Motivation Crowding Theory," Journal of Economic Surveys, Wiley Blackwell, vol. 15(5), pages 589-611, December.
- Paul A. David, 2004. "Can 'Open Science' be Protected from the Evolving Scheme of IPR Protections?," Journal of Institutional and Theoretical Economics (JITE), Mohr Siebeck, Tübingen, vol. 160(1), pages 9-, March.
- Johnson, Noel D. & Mislin, Alexandra A., 2011. "Trust games: A meta-analysis," Journal of Economic Psychology, Elsevier, vol. 32(5), pages 865-889.
- Partha, Dasgupta & David, Paul A., 1994. "Toward a new economics of science," Research Policy, Elsevier, vol. 23(5), pages 487-521, September.
- Roach, Michael & Sauermann, Henry, 2010. "A taste for science? PhD scientists' academic orientation and self-selection into research careers in industry," Research Policy, Elsevier, vol. 39(3), pages 422-434, April.
- Laband, David N, 1990. "Is There Value-Added from the Review Process in Economics? Preliminary Evidence from Authors," The Quarterly Journal of Economics, MIT Press, vol. 105(2), pages 341-52, May.
- Riccardo Boero & Giangiacomo Bravo & Marco Castellani & Francesco Lagan� & Flaminio Squazzoni, 2009. "Pillars of Trust: An Experimental Study on Reputation and Its Effects," Sociological Research Online, Sociological Research Online, vol. 14(5), pages 5.
- Greiner, Ben, 2004. "An Online Recruitment System for Economic Experiments," MPRA Paper 13513, University Library of Munich, Germany.
- Hendrik P. van Dalen & K�ne Henkens, 2004. "Signals in Science - On the Importance of Signaling in Gaining Attention in Science," Tinbergen Institute Discussion Papers 04-113/1, Tinbergen Institute.
- Hiromasa Takahashi & Junyi Shen & Kazuhito Ogawa, 2014. "An Experimental Examination of Compensation Schemes and Level of Effort in Differentiated Tasks," Discussion Paper Series DP2014-20, Research Institute for Economics & Business Administration, Kobe University.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Zhang, Lei).
If references are entirely missing, you can add them using this form.