Are leading papers of better quality? Evidence from a natural experiment
European countries in which universities rely on public funding increasingly follow the lead of the United Kingdom and run Research Assessment Exercises. Given the subjective nature of such evaluations, some scientists prefer verifiable measures such as citation counts. This, however, also is prone to problems since the number of cites is correlated, among others, with the order of appearance in an issue. In particular, leading papers are more cited. It is, thus, difficult to assess whether they are of better quality, or whether this happens because they appear first in an issue. We make use of a natural experiment that was carried out by a journal in which papers are randomly ordered in some issues, while this order is at the editors' discretion in other issues. Our estimates suggest that approximately two thirds of the additional cites are due to going first, and one third to higher quality. Copyright 2010 Oxford University Press 2009 All rights reserved, Oxford University Press.
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.
Volume (Year): 62 (2010)
Issue (Month): 1 (January)
|Contact details of provider:|| Postal: Oxford University Press, Great Clarendon Street, Oxford OX2 6DP, UK|
Fax: 01865 267 985
Web page: http://oep.oupjournals.org/
|Order Information:||Web: http://www.oup.co.uk/journals|
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Sofronis Clerides & Panos Pashardes & Alexandros Polycarpou, 2011.
"Peer Review vs Metric‐based Assessment: Testing for Bias in the RAE Ratings of UK Economics Departments,"
London School of Economics and Political Science, vol. 78(311), pages 565-583, 07.
- Sofronis Clerides & Panos Pashardes & Alexandros Polycarpou, 2006. "Peer Review vs Metric-Based Assessment: Testing for Bias in the RAE Ratings of UK Economics Departments," University of Cyprus Working Papers in Economics 7-2006, University of Cyprus Department of Economics.
- William J. Moore & Robert J. Newman & Peter J. Sloane & Jeremy D. Steely, "undated". "Productivity Effects of Research Assessment Exercises," Departmental Working Papers 2002-15, Department of Economics, Louisiana State University.
- Ayres, Ian & Vars, Fredrick E, 2000. "Determinants of Citations to Articles in Elite Law Reviews," The Journal of Legal Studies, University of Chicago Press, vol. 29(1), pages 427-450, January.
- Andrew J. Oswald, 2007. "An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision-Makers," Economica, London School of Economics and Political Science, vol. 74(293), pages 21-31, 02.
- Oswald, Andrew J., 2006. "An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision-makers," IZA Discussion Papers 2070, Institute for the Study of Labor (IZA).
- Oswald, Andrew J., 2006. "An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision-makers," The Warwick Economics Research Paper Series (TWERPS) 744, University of Warwick, Department of Economics.
- Cameron,A. Colin & Trivedi,Pravin K., 2005. "Microeconometrics," Cambridge Books, Cambridge University Press, number 9780521848053, January.
- Scott Smart & Joel Waldfogel, 1996. "A Citation-Based Test for Discrimination at Economics and Finance Journals," NBER Working Papers 5460, National Bureau of Economic Research, Inc. Full references (including those not matched with items on IDEAS)