The Objective Measurement of World-Leading Research
How should the productivity of research universities be measured? This task is difficult but important. The recent Research Excellence Framework in the UK, which was based on peer review, suggests that there has been a marked improvement in UK academic research in economics and in many other subjects. But is it possible to design an objective check on, and measure of, a nation's 'world-leading research'? Following a variant of a method developed in Oswald (2010), I examine citations data on 450 genuinely world-leading journal articles over the Research Excellence Framework period 2008-2014. The UK produced 54 of these articles, namely, 12%. This compares to 45 articles, namely 10%, using the same methodology over the Research Assessment Exercise period 2001-2008. I conclude that it is possible to produce an objective measure of world-leading research, and that UK economics did show a small improvement.
|Date of creation:||Feb 2015|
|Contact details of provider:|| Postal: IZA, P.O. Box 7240, D-53072 Bonn, Germany|
Phone: +49 228 3894 223
Fax: +49 228 3894 180
Web page: http://www.iza.org
|Order Information:|| Postal: IZA, Margard Ody, P.O. Box 7240, D-53072 Bonn, Germany|
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- DREZE, Jacques H; & ESTEVAN, Fernanda, "undated".
"Research and higher education in economics: can we deliver the Lisbon objectives,"
CORE Discussion Papers RP
1941, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
- DREZE, Jacques & ESTEVAN, Fernanda, 2006. "Research and higher education in economics: can we deliver the Lisbon objectives ?," CORE Discussion Papers 2006051, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
- Andrew J. Oswald, 2007.
"An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision-Makers,"
London School of Economics and Political Science, vol. 74(293), pages 21-31, February.
- Oswald, Andrew J., 2006. "An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision-makers," IZA Discussion Papers 2070, Institute for the Study of Labor (IZA).
- Oswald, Andrew J., 2006. "An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision-makers," The Warwick Economics Research Paper Series (TWERPS) 744, University of Warwick, Department of Economics.
- Machin, Stephen & Oswald, Andrew, 2000. "UK Economics and the Future Supply of Academic Economists," Economic Journal, Royal Economic Society, vol. 110(464), pages 334-349, June.
- David Roodman, 2009. "A Note on the Theme of Too Many Instruments," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 71(1), pages 135-158, February.
- Daniel Sgroi & Andrew J. Oswald, 2013.
"How Should Peer‐review Panels Behave?,"
Royal Economic Society, vol. 0, pages 255-278, August.
- Sgroi, Daniel & Oswald, Andrew J., 2012. "How Should Peer-Review Panels Behave?," IZA Discussion Papers 7024, Institute for the Study of Labor (IZA).
- Sgroi, Daniel & Oswald, Andrew J., 2012. "How Should Peer-Review Panels Behave?," The Warwick Economics Research Paper Series (TWERPS) 999, University of Warwick, Department of Economics.
- Amanda H Goodall, 2005.
"Should Research Universities be Led by Top Researchers? Part 1: Are they?,"
- Amanda Goodall, 2005. "Should Research Universities be led by top researchers? Part 1: Are they?," CEE Discussion Papers 0051, Centre for the Economics of Education, LSE.
- J. Peter Neary & James A. Mirrlees & Jean Tirole, 2003. "Evaluating Economics Research in Europe: An Introduction," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1239-1249, December.
- repec:spr:scient:v:84:y:2010:i:1:d:10.1007_s11192-009-0087-x is not listed on IDEAS
- Daniel S. Hamermesh & Peter Schmidt, 2003. "The Determinants of Econometric Society Fellows Elections," Econometrica, Econometric Society, vol. 71(1), pages 399-407, January.
- Frey, Bruno S, 2003. "Publishing as Prostitution?--Choosing between One's Own Ideas and Academic Success," Public Choice, Springer, vol. 116(1-2), pages 205-223, July.
- repec:spr:scient:v:63:y:2005:i:3:d:10.1007_s11192-005-0228-9 is not listed on IDEAS
- Nicholas Vasilakos & Gauthier Lanot & Tim Worrall, 2007. "Evaluating the Performance of UK Research in Economics," Keele Economics Research Papers KERP 2007/10, Centre for Economic Research, Keele University.
- Rï¿½gibeau, P & Rockett, K, 2014. "A Tale of Two Metrics: Research Assessment vs Recognised Excellence," Economics Discussion Papers 14461, University of Essex, Department of Economics.
- Andrew J. Oswald, 2010. "A suggested method for the measurement of world-leading research (illustrated with data on economics)," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(1), pages 99-113, July.
- Oswald, Andrew J., 2009. "A Suggested Method for the Measurement of World-Leading Research (Illustrated with Data on Economics)," IZA Discussion Papers 4313, Institute for the Study of Labor (IZA).
- Scott Smart & Joel Waldfogel, 1996. "A Citation-Based Test for Discrimination at Economics and Finance Journals," NBER Working Papers 5460, National Bureau of Economic Research, Inc. Full references (including those not matched with items on IDEAS)
When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp8829. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Mark Fallak)
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.