IDEAS home Printed from https://ideas.repec.org/a/jns/jbstat/v227y2007i2p187-208n5.html
   My bibliography  Save this article

Who is the ”Platz-Hirsch“ of the German Economics Profession?: A Citation Analysis

Author

Listed:
  • Ursprung Heinrich W.

    (Department of Economics, Box D-138, D-78457 Konstanz, Germany)

  • Zimmer Markus

    (Center for Economic Studies, University of Munich, Schackstrasse 4, D-80539 München, Germany)

Abstract

In this paper, we investigate the informational content of citation-based research evaluations. To illustrate our analysis we refer to the 2005 Handelsblatt ranking of German academic economists. We make extensive use of the recently developed Hirsch-index and relate citation incidence to publication success, career age, and the topicality of the individual researchers’ field of specialization. We arrive at the conclusion that citation-based indicators provide a very incomplete picture of research performance. To obtain acceptable bibliometric research evaluations, citation based indicators need to be complemented with indicators that measure publication success more directly.

Suggested Citation

  • Ursprung Heinrich W. & Zimmer Markus, 2007. "Who is the ”Platz-Hirsch“ of the German Economics Profession?: A Citation Analysis," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 227(2), pages 187-208, April.
    • Handle: RePEc:jns:jbstat:v:227:y:2007:i:2:p:187-208:n:5
    DOI: 10.1515/jbnst-2007-0205
    as

    Download full text from publisher

    File URL: https://doi.org/10.1515/jbnst-2007-0205
    Download Restriction: no
    File URL: https://libkey.io/10.1515/jbnst-2007-0205?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. David N. Laband & Robert D. Tollison, 2000. "Intellectual Collaboration," Journal of Political Economy, University of Chicago Press, vol. 108(3), pages 632-661, June.
    2. Laband, David N, 1986. "Article Popularity," Economic Inquiry, Western Economic Association International, vol. 24(1), pages 173-180, January.
    3. Anthony F.J. van Raan, 2006. "Statistical properties of bibliometric indicators: Research group indicator distributions and correlations," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 57(3), pages 408-430, February.
    4. Medoff, Marshall H., 2003. "Collaboration and the quality of economics research," Labour Economics, Elsevier, vol. 10(5), pages 597-608, October.
    5. Robert B. Archibald & David H. Finifter, 1990. "Multivariate Citations Functions and Journal Rankings," Eastern Economic Journal, Eastern Economic Association, vol. 16(2), pages 151-158, Apr-Jun.
    6. David N. Laband, 1990. "Is There Value-Added from the Review Process in Economics?: Preliminary Evidence from Authors," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 105(2), pages 341-352.
    7. Alireza Tahai & G. Wayne Kelly, 1996. "An Alternative View of Citation Patterns of Quantitative Literature Cited by Business and Economic Researchers," The Journal of Economic Education, Taylor & Francis Journals, vol. 27(3), pages 263-275, July.
    8. Pierre-Philippe Combes & Laurent Linnemer, 2003. "Where are the Economists Who Publish? Publication Concentration and Rankings in Europe Based on Cumulative Publications," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1250-1308, December.
    9. Dan Johnson, 1997. "Getting Noticed in Economics: The Determinants of Academic Citations," The American Economist, Sage Publications, vol. 41(1), pages 43-52, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Marcel Clermont & Alexander Dirksen & Barbara Scheidt & Dirk Tunger, 2017. "Citation metrics as an additional indicator for evaluating research performance? An analysis of their correlations and validity," Business Research, Springer;German Academic Association for Business Research, vol. 10(2), pages 249-279, October.
    2. Launov, Andrey & Graber, Michael & Wälde, Klaus, 2007. "How to get tenured (in Germany, in Economics)," W.E.P. - Würzburg Economic Papers 75, University of Würzburg, Department of Economics.
    3. Klaus Wohlrabe, 2014. "A Criticism of the Frankfurter Allgemeine Zeitung Economist Ranking 2013," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 67(13), pages 63-67, July.
    4. Ioana Alexandra Horodnic & Adriana Zaiţ, 2015. "Motivation and research productivity in a university system undergoing transition," Research Evaluation, Oxford University Press, vol. 24(3), pages 282-292.
    5. Hofmeister Robert & Krapf Matthias, 2011. "How Do Editors Select Papers, and How Good are They at Doing It?," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 11(1), pages 1-23, October.
    6. Sturm Jan-Egbert & Ursprung Heinrich W., 2017. "The Handelsblatt Rankings 2.0: Research Rankings for the Economics Profession in Austria, Germany, and Switzerland," German Economic Review, De Gruyter, vol. 18(4), pages 492-515, December.
    7. Margit Osterloh & Bruno S. Frey, 2009. "Research governance in academia: are there alternatives to academic rankings?," IEW - Working Papers 423, Institute for Empirical Research in Economics - University of Zurich.
    8. Rolf Ketzler & Klaus F. Zimmermann, 2009. "Publications: German economic research institutes on track," Scientometrics, Springer;Akadémiai Kiadó, vol. 80(1), pages 231-252, July.
    9. Klaus Gründler & Niklas Potrafke, 2019. "Ideologically-charged terminology: austerity, fiscal consolidation, and sustainable governance," CESifo Working Paper Series 7613, CESifo.
    10. Di Vaio, Gianfranco & Waldenström, Daniel & Weisdorf, Jacob, 2012. "Citation success: Evidence from economic history journal publications," Explorations in Economic History, Elsevier, vol. 49(1), pages 92-104.
    11. Michael Graber & Andrey Launov & Klaus Wälde, 2008. "Publish or Perish? The Increasing Importance of Publications for Prospective Economics Professors in Austria, Germany and Switzerland," German Economic Review, Verein für Socialpolitik, vol. 9(4), pages 457-472, November.
    12. Rolf Ketzler & Klaus F. Zimmermann, 2013. "A citation-analysis of economic research institutes," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(3), pages 1095-1112, June.
    13. Günther G. Schulze & Susanne Warning & Christian Wiermann, 2008. "What and How Long Does It Take to Get Tenure? The Case of Economics and Business Administration in Austria, Germany and Switzerland," German Economic Review, Verein für Socialpolitik, vol. 9(4), pages 473-505, November.
    14. Michael Graber & Andrey Launov & Klaus Waelde, 2007. "How to get tenured," Working Papers 030, Bavarian Graduate Program in Economics (BGPE).
    15. Klaus Wohlrabe, 2014. "Das FAZ-Ökonomenranking 2013: Eine kritische Betrachtung," ifo Working Paper Series 183, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
    16. Libman, A., 2011. "German Economics: Mechanisms of Transformation," Journal of the New Economic Association, New Economic Association, issue 9, pages 129-149.
    17. Margit Osterloh & Bruno S. Frey, 2010. "Academic rankings and research governance," IEW - Working Papers 482, Institute for Empirical Research in Economics - University of Zurich.
    18. Ioana Alexandra HORODNIC, 2014. "Academic Performance: Measurement Methods Used In Socio - Economic Sciences," THE YEARBOOK OF THE "GH. ZANE" INSTITUTE OF ECONOMIC RESEARCHES, Gheorghe Zane Institute for Economic and Social Research ( from THE ROMANIAN ACADEMY, JASSY BRANCH), vol. 23(1), pages 5-17.
    19. Jean-Michel Courtault & Naïla Hayek, 2008. "On the Robustness of the h-index: a mathematical approach," Economics Bulletin, AccessEcon, vol. 3(78), pages 1-9.
    20. Schulze Günther G. & Warning Susanne, 2009. "Misleading Rankings of Research in Business: A Reply," German Economic Review, De Gruyter, vol. 10(3), pages 368-371, August.
    21. Michael Graber & Andrey Launov & Klaus Wälde, 2008. "Publish or Perish? The Increasing Importance of Publications for Prospective Economics Professors in Austria, Germany and Switzerland," German Economic Review, Verein für Socialpolitik, vol. 9(4), pages 457-472, November.
    22. Günther G. Schulze & Susanne Warning & Christian Wiermann, 2008. "What and How Long Does It Take to Get Tenure? The Case of Economics and Business Administration in Austria, Germany and Switzerland," German Economic Review, Verein für Socialpolitik, vol. 9, pages 473-505, November.
    23. Günther G. Schulze & Susanne Warning, 2009. "Misleading Rankings of Research in Business: A Reply," German Economic Review, Verein für Socialpolitik, vol. 10, pages 368-371, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. repec:jns:jbstat:v:227:y:2007:i:2:p:187-208 is not listed on IDEAS
    2. Eduardo A. Haddad & Jesus P. Mena-Chalco, Otávio J.G. Sidone, 2016. "Produção Científica e Redes de Colaboração dos Docentes Vinculados aos Programas de Pós-graduação em Economia no Brasil," Working Papers, Department of Economics 2016_10, University of São Paulo (FEA-USP).
    3. Damien Besancenot & Kim Van Huynh & Francisco Serranito, 2015. " Thou shalt not work alone ," CEPN Working Papers hal-01175758, HAL.
    4. Bosquet, Clément & Combes, Pierre-Philippe, 2013. "Do large departments make academics more productive? agglomeration and peer effects in research," LSE Research Online Documents on Economics 58306, London School of Economics and Political Science, LSE Library.
    5. Rolf Ketzler & Klaus F. Zimmermann, 2013. "A citation-analysis of economic research institutes," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(3), pages 1095-1112, June.
    6. Clément Bosquet & Pierre-Philippe Combes, 2015. "Do large departments make academics more productive? Sorting and agglomeration economies in research," THEMA Working Papers 2015-16, THEMA (THéorie Economique, Modélisation et Applications), Université de Cergy-Pontoise.
    7. repec:hal:journl:hal-01292851 is not listed on IDEAS
    8. repec:hal:spmain:info:hdl:2441/4jn6cjcel9913942jpruv3pju6 is not listed on IDEAS
    9. Bosquet, Clément & Combes, Pierre-Philippe, 2017. "Sorting and agglomeration economies in French economics departments," Journal of Urban Economics, Elsevier, vol. 101(C), pages 27-44.
    10. Glenn Ellison, 2011. "Is Peer Review In Decline?," Economic Inquiry, Western Economic Association International, vol. 49(3), pages 635-657, July.
    11. repec:hal:spmain:info:hdl:2441/6hol1fq95j9pqofr3i7rv5bssq is not listed on IDEAS
    12. Enrico Miersch, 2020. "Research Evaluation of Financial Research - Evidence from a Survey," Credit and Capital Markets, Credit and Capital Markets, vol. 53(3), pages 383-419.
    13. Besancenot, Damien & Huynh, Kim & Serranito, Francisco, 2017. "Co-authorship and research productivity in economics: Assessing the assortative matching hypothesis," Economic Modelling, Elsevier, vol. 66(C), pages 61-80.
    14. Jang C. Jin & E. Kwan Choi, 2014. "Citations of Most Often Cited Economists: Do Scholarly Books Matter More than Quality Journals?," Pacific Economic Review, Wiley Blackwell, vol. 19(1), pages 8-24, February.
    15. repec:hal:spmain:info:hdl:2441/5f4gqlbaf382ua75f8et967s6a is not listed on IDEAS
    16. Clément Bosquet & Pierre-Philippe Combes, 2015. "Do large departments make academics more productive? Sorting and agglomeration economies in research," THEMA Working Papers 2015-16, THEMA (THéorie Economique, Modélisation et Applications), Université de Cergy-Pontoise.
    17. Medoff, Marshall H., 2003. "Collaboration and the quality of economics research," Labour Economics, Elsevier, vol. 10(5), pages 597-608, October.
    18. Önder, Ali Sina & Schweitzer, Sascha & Yilmazkuday, Hakan, 2021. "Specialization, field distance, and quality in economists’ collaborations," Journal of Informetrics, Elsevier, vol. 15(4).
    19. Di Vaio, Gianfranco & Waldenström, Daniel & Weisdorf, Jacob, 2012. "Citation success: Evidence from economic history journal publications," Explorations in Economic History, Elsevier, vol. 49(1), pages 92-104.
    20. J. Paul Elhorst & Katarina Zigova, 2011. "Evidence of Competition in Research Activity among Economic Department using Spatial Econometric Techniques," Working Paper Series of the Department of Economics, University of Konstanz 2011-04, Department of Economics, University of Konstanz.
    21. Pierre Dubois & Jean-Charles Rochet & Jean-Marc Schlenker, 2014. "Productivity and mobility in academic research: evidence from mathematicians," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(3), pages 1669-1701, March.
    22. Ana Rute Cardoso & Paulo Guimarães & Klaus F. Zimmermann, 2010. "Trends in Economic Research: An International Perspective," Kyklos, Wiley Blackwell, vol. 63(4), pages 479-494, November.
    23. Maria Rosaria Carillo & Erasmo Papagni & Alessandro Sapio, 2012. "Do collaborations enhance the high-quality output of scientific institutions? Evidence from the Italian Research Assessment Exercise (2001-2003)," Discussion Papers 4_2012, CRISEI, University of Naples "Parthenope", Italy.
    24. Glenn Ellison, 2013. "How Does the Market Use Citation Data? The Hirsch Index in Economics," American Economic Journal: Applied Economics, American Economic Association, vol. 5(3), pages 63-90, July.
    25. Conan Mukherjee & Ranojoy Basu & Aftab Alam, 2020. "A measure of authorship by publications," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 41(3), pages 354-361, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jns:jbstat:v:227:y:2007:i:2:p:187-208:n:5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.degruyter.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.