IDEAS home Printed from https://ideas.repec.org/p/ces/ceswps/_3188.html
   My bibliography  Save this paper

How does the Market Use Citation Data? The Hirsch Index in Economics

Author

Listed:
  • Glenn Ellison

Abstract

A large literature following Hirsch (2005) has proposed citation-based indexes that could be used to rank academics. This paper examines how well several such indexes match labor market outcomes using data on the citation records of young tenured economists at 25 U.S. departments. Variants of Hirsch’s index that emphasize smaller numbers of highly-cited papers perform better than Hirsch’s original index and have substantial power to explain which economists are tenured at which departments. Adjustment factors for differences across fields and years of experience are presented.

Suggested Citation

  • Glenn Ellison, 2010. "How does the Market Use Citation Data? The Hirsch Index in Economics," CESifo Working Paper Series 3188, CESifo Group Munich.
  • Handle: RePEc:ces:ceswps:_3188
    as

    Download full text from publisher

    File URL: http://www.cesifo-group.de/DocDL/cesifo1_wp3188.pdf
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. David N. Laband & Robert D. Tollison, 2000. "Intellectual Collaboration," Journal of Political Economy, University of Chicago Press, vol. 108(3), pages 632-661, June.
    2. repec:spr:scient:v:84:y:2010:i:1:d:10.1007_s11192-009-0066-2 is not listed on IDEAS
    3. Hamermesh, Daniel S. & Pfann, Gerard A., 2009. "Markets for Reputation: Evidence on Quality and Quantity in Academe," IZA Discussion Papers 4610, Institute for the Study of Labor (IZA).
    4. Tanya S. Rosenblat & Markus M. Mobius, 2004. "Getting Closer or Drifting Apart?," The Quarterly Journal of Economics, Oxford University Press, vol. 119(3), pages 971-1009.
    5. Glenn Ellison, 2011. "Is Peer Review In Decline?," Economic Inquiry, Western Economic Association International, vol. 49(3), pages 635-657, July.
    6. Ignacio Palacios-Huerta & Oscar Volij, 2004. "The Measurement of Intellectual Influence," Econometrica, Econometric Society, vol. 72(3), pages 963-977, May.
    7. Lutz Bornmann & Gerlind Wallon & Anna Ledin, 2008. "Is the h index related to (standard) bibliometric measures and to the assessments by peers? An investigation of the h index by using molecular life sciences data," Research Evaluation, Oxford University Press, vol. 17(2), pages 149-156, June.
    8. Glenn Ellison, 2002. "Evolving Standards for Academic Publishing: A q-r Theory," Journal of Political Economy, University of Chicago Press, vol. 110(5), pages 994-1034, October.
    9. Qiang Wu, 2010. "The w-index: A measure to assess scientific impact by focusing on widely cited papers," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 61(3), pages 609-614, March.
    10. Liebowitz, S J & Palmer, J P, 1984. "Assessing the Relative Impacts of Economic Journals," Journal of Economic Literature, American Economic Association, vol. 22(1), pages 77-88, March.
    11. Daniel S. Hamermesh & Gerard A. Pfann, 2012. "Reputation And Earnings: The Roles Of Quality And Quantity In Academe," Economic Inquiry, Western Economic Association International, vol. 50(1), pages 1-16, January.
    12. repec:spr:scient:v:75:y:2008:i:2:d:10.1007_s11192-007-1869-7 is not listed on IDEAS
    13. Frances Ruane & Richard S.J. Tol, 2007. "Refined (Successive) H-Indices: An Application To Economics In The Republic Of Ireland," Working Papers FNU-130, Research unit Sustainability and Global Change, Hamburg University, revised Mar 2007.
    14. Richard S.J. Tol, 2007. "Of The H-Index And Its Alternatives: An Application To The 100 Most Prolific Economists," Working Papers FNU-146, Research unit Sustainability and Global Change, Hamburg University, revised Sep 2007.
    15. Schreiber, Michael, 2008. "A modification of the h-index: The hm-index accounts for multi-authored manuscripts," Journal of Informetrics, Elsevier, vol. 2(3), pages 211-216.
    16. Tom Coupé, 2003. "Revealed Performances: Worldwide Rankings of Economists and Economics Departments, 1990-2000," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1309-1345, December.
    17. repec:spr:scient:v:78:y:2009:i:3:d:10.1007_s11192-007-2014-3 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Citations

    Blog mentions

    As found by EconAcademics.org, the blog aggregator for Economics research:
    1. h(5,2) - the Best Citation Metric for Economics?
      by David Stern in Stochastic Trend on 2011-07-07 06:08:00

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Wohlrabe, Klaus & Bornmann, Lutz, 2017. "Normalization of citation impact in economics," MPRA Paper 80384, University Library of Munich, Germany.
    2. Karol Paludkiewicz & Klaus Wohlrabe, 2010. "Qualitätsanalyse von Zeitschriften in den Wirtschaftswissenschaften - über Zitationsdatenbanken und Impaktfaktoren im Online-Zeitalter," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 63(21), pages 18-28, November.
    3. John Gibson & David L. Anderson & John Tressler, 2014. "Which Journal Rankings Best Explain Academic Salaries? Evidence From The University Of California," Economic Inquiry, Western Economic Association International, vol. 52(4), pages 1322-1340, October.
    4. M. Fourcade & E. Ollion & Y. Algan., 2015. "The Superiority of Economists," VOPROSY ECONOMIKI, N.P. Redaktsiya zhurnala "Voprosy Economiki", vol. 7.
    5. Damien Besancenot & Jean-Michel Courtault & Khaled El Dika, 2012. "Piecework versus merit pay: a mean field games approach to academic behavior," Revue d'économie politique, Dalloz, vol. 122(4), pages 547-563.
    6. Schreiber, Michael, 2013. "How to derive an advantage from the arbitrariness of the g-index," Journal of Informetrics, Elsevier, vol. 7(2), pages 555-561.
    7. Schreiber, Michael, 2013. "A case study of the arbitrariness of the h-index and the highly-cited-publications indicator," Journal of Informetrics, Elsevier, vol. 7(2), pages 379-387.
    8. Richard S. J. Tol, 2011. "Credit where credit’s due: accounting for co-authorship in citation counts," Scientometrics, Springer;Akadémiai Kiadó, vol. 89(1), pages 291-299, October.
    9. Victoria Anauati & Sebastian Galiani & Ramiro H. Gálvez, 2016. "Quantifying The Life Cycle Of Scholarly Articles Across Fields Of Economic Research," Economic Inquiry, Western Economic Association International, vol. 54(2), pages 1339-1355, April.
    10. Tyler Cowen & Alex Tabarrok, 2016. "A Skeptical View of the National Science Foundation's Role in Economic Research," Journal of Economic Perspectives, American Economic Association, vol. 30(3), pages 235-248, Summer.
    11. David Card & Stefano DellaVigna, 2017. "What do Editors Maximize? Evidence from Four Leading Economics Journals," NBER Working Papers 23282, National Bureau of Economic Research, Inc.
    12. repec:bla:ecinqu:v:55:y:2017:i:4:p:1945-1965 is not listed on IDEAS
    13. David I. Stern & Richard S.J. Tol, 2018. "How to Count Citations If You Must: Comment," Working Paper Series 0118, Department of Economics, University of Sussex.
    14. Lina M. Cortés & Andrés Mora-Valencia & Javier Perote, 2016. "The productivity of top researchers: a semi-nonparametric approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 891-915, November.
    15. Motty Perry & Philip J. Reny, 2016. "How to Count Citations If You Must," American Economic Review, American Economic Association, vol. 106(9), pages 2722-2741, September.
    16. repec:spr:scient:v:94:y:2013:i:1:d:10.1007_s11192-012-0758-x is not listed on IDEAS
    17. Marion Fourcade & Etienne Ollion & Yann Algan, 2015. "La superioridad de los economistas," Revista de Economía Institucional, Universidad Externado de Colombia - Facultad de Economía, vol. 17(33), pages 13-43, July-Dece.
    18. repec:spr:scient:v:98:y:2014:i:1:d:10.1007_s11192-013-1052-2 is not listed on IDEAS
    19. Daniel S. Hamermesh, 2015. "Citations in Economics: Measurement, Uses and Impacts," NBER Working Papers 21754, National Bureau of Economic Research, Inc.
    20. Palacios-Huerta, Ignacio & Volij, Oscar, 2014. "Axiomatic measures of intellectual influence," International Journal of Industrial Organization, Elsevier, vol. 34(C), pages 85-90.
    21. Sebastian Galiani & Ramiro H. Gálvez, 2017. "The Life Cycle of Scholarly Articles across Fields of Research," NBER Working Papers 23447, National Bureau of Economic Research, Inc.
    22. John Gibson & David L. Anderson & John Tressler, 2017. "Citations Or Journal Quality: Which Is Rewarded More In The Academic Labor Market?," Economic Inquiry, Western Economic Association International, vol. 55(4), pages 1945-1965, October.

    More about this item

    Keywords

    Hirsch index; citation data; economics profession;

    JEL classification:

    • A14 - General Economics and Teaching - - General Economics - - - Sociology of Economics
    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • O30 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ces:ceswps:_3188. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Klaus Wohlrabe). General contact details of provider: http://edirc.repec.org/data/cesifde.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.