IDEAS home Printed from https://ideas.repec.org/p/wrk/warwec/887.html
   My bibliography  Save this paper

World-Leading Research and its Measurement

Author

Listed:
  • Oswald, Andrew J.

    (University of Warwick)

Abstract

Journalists and others have asked me whether the favourable RAE 2008 results for UK economics are believable. This is a fair question. It also opens up a broader and more important one: how can we design a bibliometric method to assess the quality (rather than merely quantity) of a nation’s science? To try to address this, I examine objective data on the world’s most influential economics articles. I find that the United Kingdom performed reasonably well over the 2001-2008 period. Of 450 genuinely world-leading journal articles, the UK produced 10% of them -- and was the source of the most-cited article in each of the Journal of Econometrics, the International Economic Review, the Journal of Public Economics, and the Rand Journal of Economics, and of the second most-cited article in the Journal of Health Economics. Interestingly, more than a quarter of these world-leading UK articles came from outside the best-known half-dozen departments. Thus the modern emphasis on ‘top’ departments and the idea that funding should be concentrated in a few places may be mistaken. Pluralism may help to foster iconoclastic ideas.

Suggested Citation

  • Oswald, Andrew J., 2009. "World-Leading Research and its Measurement," The Warwick Economics Research Paper Series (TWERPS) 887, University of Warwick, Department of Economics.
    • Handle: RePEc:wrk:warwec:887
    as

    Download full text from publisher

    File URL: https://warwick.ac.uk/fac/soc/economics/research/workingpapers/2009/twerp_887.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. DREZE, Jacques & ESTEVAN, Fernanda, 2006. "Research and higher education in economics: can we deliver the Lisbon objectives ?," LIDAM Discussion Papers CORE 2006051, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    2. Ana Rute Cardoso & Paulo Guimarães & Klaus F. Zimmermann, 2010. "Comparing the early research performance of PhD graduates in labor economics in Europe and the USA," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(3), pages 621-637, September.
    3. Glenn Ellison, 2011. "Is Peer Review In Decline?," Economic Inquiry, Western Economic Association International, vol. 49(3), pages 635-657, July.
    4. John Hudson, 2007. "Be known by the company you keep: Citations — quality or chance?," Scientometrics, Springer;Akadémiai Kiadó, vol. 71(2), pages 231-238, May.
    5. Brazier, John & Roberts, Jennifer & Deverill, Mark, 2002. "The estimation of a preference-based measure of health from the SF-36," Journal of Health Economics, Elsevier, vol. 21(2), pages 271-292, March.
    6. Andrew J. Oswald, 2007. "An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision‐Makers," Economica, London School of Economics and Political Science, vol. 74(293), pages 21-31, February.
    7. Bruce A. Weinberg, 2009. "An Assessment of British Science over the Twentieth Century," Economic Journal, Royal Economic Society, vol. 119(538), pages 252-269, June.
    8. Frey, Bruno S, 2003. "Publishing as Prostitution?--Choosing between One's Own Ideas and Academic Success," Public Choice, Springer, vol. 116(1-2), pages 205-223, July.
    9. Machin, Stephen & Oswald, Andrew, 2000. "UK Economics and the Future Supply of Academic Economists," Economic Journal, Royal Economic Society, vol. 110(464), pages 334-349, June.
    10. Im, Kyung So & Pesaran, M. Hashem & Shin, Yongcheol, 2003. "Testing for unit roots in heterogeneous panels," Journal of Econometrics, Elsevier, vol. 115(1), pages 53-74, July.
    11. Amanda H Goodall, 2005. "Should Research Universities be Led by Top Researchers? Part 1: Are they?," HEW 0506003, University Library of Munich, Germany.
    12. J. Peter Neary & James A. Mirrlees & Jean Tirole, 2003. "Evaluating Economics Research in Europe: An Introduction," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1239-1249, December.
    13. Daniel S. Hamermesh & Peter Schmidt, 2003. "The Determinants of Econometric Society Fellows Elections," Econometrica, Econometric Society, vol. 71(1), pages 399-407, January.
    14. Stephen Wu, 2007. "Recent publishing trends at the AER, JPE and QJE," Applied Economics Letters, Taylor & Francis Journals, vol. 14(1), pages 59-63.
    15. William H. Starbuck, 2005. "How Much Better Are the Most-Prestigious Journals? The Statistics of Academic Publication," Organization Science, INFORMS, vol. 16(2), pages 180-200, April.
    16. Jonathan Adams, 2005. "Early citation counts correlate with accumulated impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 63(3), pages 567-581, June.
    17. Scott Smart & Joel Waldfogel, 1996. "A Citation-Based Test for Discrimination at Economics and Finance Journals," NBER Working Papers 5460, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bruno Frey, 2009. "Economists in the PITS?," International Review of Economics, Springer;Happiness Economics and Interpersonal Relations (HEIRS), vol. 56(4), pages 335-346, December.
    2. RosalindS. Hunter & Andrew J. Oswald & Bruce G. Charlton, 2009. "The Elite Brain Drain," Economic Journal, Royal Economic Society, vol. 119(538), pages 231-251, June.
    3. Rosalind S Hunter, 2009. "The Elite Brain Drain," Working Papers id:2048, eSocialSciences.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andrew J. Oswald, 2010. "A suggested method for the measurement of world-leading research (illustrated with data on economics)," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(1), pages 99-113, July.
    2. Oswald, Andrew J., 2015. "The Objective Measurement of World-Leading Research," IZA Discussion Papers 8829, Institute of Labor Economics (IZA).
    3. Oswald, Andrew J., 2008. "Can We Test for Bias in Scientific Peer-Review?," IZA Discussion Papers 3665, Institute of Labor Economics (IZA).
    4. Daniel S. Hamermesh, 2018. "Citations in Economics: Measurement, Uses, and Impacts," Journal of Economic Literature, American Economic Association, vol. 56(1), pages 115-156, March.
    5. RosalindS. Hunter & Andrew J. Oswald & Bruce G. Charlton, 2009. "The Elite Brain Drain," Economic Journal, Royal Economic Society, vol. 119(538), pages 231-251, June.
    6. Ali, Showkat & Carden, Giles & Culling, Benjamin & Hunter, Rosalind & Oswald, Andrew J & Owen, Nicola & Ralsmark, Hilda & Snodgrass, Natalie, 2007. "Elite Scientists and the Global Brain Drain," The Warwick Economics Research Paper Series (TWERPS) 825, University of Warwick, Department of Economics.
    7. Rosalind S Hunter, 2009. "The Elite Brain Drain," Working Papers id:2048, eSocialSciences.
    8. Jan Ours & Frederic Vermeulen, 2007. "Ranking Dutch Economists," De Economist, Springer, vol. 155(4), pages 469-487, December.
    9. Leks Borgans & Frank Corvers (Transl. by: E. Pokatovich ), 2010. "The americanization of European higher education and research," Voprosy obrazovaniya / Educational Studies Moscow, National Research University Higher School of Economics, issue 2, pages 5-43.
    10. Rolf Ketzler & Klaus F. Zimmermann, 2013. "A citation-analysis of economic research institutes," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(3), pages 1095-1112, June.
    11. Jens Prüfer & David Zetland, 2010. "An auction market for journal articles," Public Choice, Springer, vol. 145(3), pages 379-403, December.
    12. Marcella Corsi & Carlo D'Ippoliti & Federico Lucidi, 2010. "Pluralism at Risk? Heterodox Economic Approaches and the Evaluation of Economic Research in Italy," American Journal of Economics and Sociology, Wiley Blackwell, vol. 69(5), pages 1495-1529, November.
    13. Berlemann, Michael & Haucap, Justus, 2015. "Which factors drive the decision to opt out of individual research rankings? An empirical study of academic resistance to change," Research Policy, Elsevier, vol. 44(5), pages 1108-1115.
    14. Berlemann, Michael & Haucap, Justus, 2012. "Which factors drive the decision to boycott and opt out of research rankings? A note," DICE Discussion Papers 72, Heinrich Heine University Düsseldorf, Düsseldorf Institute for Competition Economics (DICE).
    15. Osterloh, Margit & Frey, Bruno S., 2020. "How to avoid borrowed plumes in academia," Research Policy, Elsevier, vol. 49(1).
    16. Michael Berlemann & Justus Haucap, 2012. "Which Factors Drive the Decision to Boycott and Opt Out of Research Rankings?," CESifo Working Paper Series 3997, CESifo.
    17. David L. Anderson & John Tressler, 2013. "The Relevance of the “h-” and “g-” Index to Economics in the Context of A Nation-Wide Research Evaluation Scheme: The New Zealand Case," Economic Papers, The Economic Society of Australia, vol. 32(1), pages 81-94, March.
    18. Stanley, T.D. & Doucouliagos, Chris & Jarrell, Stephen B., 2008. "Meta-regression analysis as the socio-economics of economics research," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 37(1), pages 276-292, February.
    19. Justus Haucap & Johannes Muck, 2015. "What drives the relevance and reputation of economics journals? An update from a survey among economists," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(3), pages 849-877, June.
    20. Jinyoung Kim & Kanghyock Koh, 2014. "Incentives for Journal Editors," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 47(1), pages 348-371, February.

    More about this item

    Keywords

    Science ; evaluation ; peer-review ; citations ; research assessment exercise.;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Lists

    This item is featured on the following reading lists, Wikipedia, or ReplicationWiki pages:
    1. Rankings of Economists, Economics Departments and Economics Journals

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wrk:warwec:887. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Margaret Nash (email available below). General contact details of provider: https://edirc.repec.org/data/dewaruk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.