Are leading papers of better quality? Evidence from a natural experiment
European countries in which universities rely on public funding increasingly follow the lead of the United Kingdom and run Research Assessment Exercises. Given the subjective nature of such evaluations, some scientists prefer verifiable measures such as citation counts. This, however, also is prone to problems since the number of cites is correlated, among others, with the order of appearance in an issue. In particular, leading papers are more cited. It is, thus, difficult to assess whether they are of better quality, or whether this happens because they appear first in an issue. We make use of a natural experiment that was carried out by a journal in which papers are randomly ordered in some issues, while this order is at the editors' discretion in other issues. Our estimates suggest that approximately two thirds of the additional cites are due to going first, and one third to higher quality. Copyright 2010 Oxford University Press 2009 All rights reserved, Oxford University Press.
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.
Volume (Year): 62 (2010)
Issue (Month): 1 (January)
|Contact details of provider:|| Postal: |
Fax: 01865 267 985
Web page: http://oep.oupjournals.org/
|Order Information:||Web: http://www.oup.co.uk/journals|
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Andrew J. Oswald, 2007.
"An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision-Makers,"
London School of Economics and Political Science, vol. 74(293), pages 21-31, 02.
- Oswald, Andrew J., 2006. "An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision-makers," IZA Discussion Papers 2070, Institute for the Study of Labor (IZA).
- Oswald, Andrew J., 2006. "An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision-makers," The Warwick Economics Research Paper Series (TWERPS) 744, University of Warwick, Department of Economics.
- GINSBURGH, Victor & van OURS, Jan, 2002.
"Expert opinion and compensation: evidence from a musical competition,"
CORE Discussion Papers
2002033, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
- Victor A. Ginsburgh & Jan C. van Ours, 2003. "Expert Opinion and Compensation: Evidence from a Musical Competition," American Economic Review, American Economic Association, vol. 93(1), pages 289-296, March.
- Victor Ginsburgh & Jan van Ours, 2003. "Expert opinion and compensation: evidence from a musical competition," ULB Institutional Repository 2013/1681, ULB -- Universite Libre de Bruxelles.
- Sofronis Clerides & Panos Pashardes & Alexandros Polycarpou, 2006.
"Peer Review vs Metric-Based Assessment: Testing for Bias in the RAE Ratings of UK Economics Departments,"
University of Cyprus Working Papers in Economics
7-2006, University of Cyprus Department of Economics.
- Sofronis Clerides & Panos Pashardes & Alexandros Polycarpou, 2011. "Peer Review vs Metric‐based Assessment: Testing for Bias in the RAE Ratings of UK Economics Departments," Economica, London School of Economics and Political Science, vol. 78(311), pages 565-583, 07.
- William J. Moore & Robert J. Newman & Peter J. Sloane & Jeremy D. Steely, . "Productivity Effects of Research Assessment Exercises," Departmental Working Papers 2002-15, Department of Economics, Louisiana State University.
- Ayres, Ian & Vars, Fredrick E, 2000. "Determinants of Citations to Articles in Elite Law Reviews," The Journal of Legal Studies, University of Chicago Press, vol. 29(1), pages 427-50, January.
When requesting a correction, please mention this item's handle: RePEc:oup:oxecpp:v:62:y:2010:i:1:p:1-11. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Oxford University Press)or (Christopher F. Baum)
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.