IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp6780.html
   My bibliography  Save this paper

A Citation-Analysis of Economic Research Institutes

Author

Listed:
  • Ketzler, Rolf

    (GDV)

  • Zimmermann, Klaus F.

    (University of Bonn)

Abstract

The citation analysis of the research output of the German economic research institutes presented here is based on publications in peer-reviewed journals listed in the Social Science Citation Index for the 2000–2009 period. The novel feature of the paper is that a count data model quantifies the determinants of citation success and simulates their citation potential. Among the determinants of the number of cites the quality of the publication outlet exhibits a strong positive effect. The same effect has the number of the published pages, but journals with size limits also yield more cites. Field journals get fewer citations in comparison to general journals. Controlling for journal quality, the number of co-authors of a paper has no effect, but it is positive when co-authors are located outside the own institution. We find that the potential citations predicted by our best model lead to different rankings across the institutes than current citations indicating structural change.

Suggested Citation

  • Ketzler, Rolf & Zimmermann, Klaus F., 2012. "A Citation-Analysis of Economic Research Institutes," IZA Discussion Papers 6780, Institute of Labor Economics (IZA).
    • Handle: RePEc:iza:izadps:dp6780
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp6780.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Ana Rute Cardoso & Paulo Guimarães & Klaus F. Zimmermann, 2010. "Comparing the early research performance of PhD graduates in labor economics in Europe and the USA," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(3), pages 621-637, September.
    2. Ira N. Gang & Klaus F. Zimmermann, 2000. "Is Child like Parent? Educational Attainment and Ethnic Origin," Journal of Human Resources, University of Wisconsin Press, vol. 35(3), pages 550-569.
    3. Andrew J. Oswald, 2007. "An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision‐Makers," Economica, London School of Economics and Political Science, vol. 74(293), pages 21-31, February.
    4. Rolf Ketzler & Klaus F. Zimmermann, 2009. "Publications: German economic research institutes on track," Scientometrics, Springer;Akadémiai Kiadó, vol. 80(1), pages 231-252, July.
    5. Friedrich Schneider & Heinrich W. Ursprung, 2008. "The 2008 GEA Journal‐Ranking for the Economics Profession," German Economic Review, Verein für Socialpolitik, vol. 9(4), pages 532-538, November.
    6. Rolf Sternberg & Timo Litzenberger, 2005. "The publication and citation output of German Faculties of Economics and Social Sciences - a comparison of faculties and disciplines based upon SSCI data," Scientometrics, Springer;Akadémiai Kiadó, vol. 65(1), pages 29-53, October.
    7. Friedrich Schneider & Heinrich W. Ursprung, 2008. "The 2008 GEA Journal‐Ranking for the Economics Profession," German Economic Review, Verein für Socialpolitik, vol. 9(4), pages 532-538, November.
    8. Patrick Puhani, 2000. "The Heckman Correction for Sample Selection and Its Critique," Journal of Economic Surveys, Wiley Blackwell, vol. 14(1), pages 53-68, February.
    9. repec:jns:jbstat:v:227:y:2007:i:2:p:187-208 is not listed on IDEAS
    10. Pierre-Philippe Combes & Laurent Linnemer, 2003. "Where are the Economists Who Publish? Publication Concentration and Rankings in Europe Based on Cumulative Publications," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1250-1308, December.
    11. Michael Graber & Andrey Launov & Klaus Wälde, 2008. "Publish or Perish? The Increasing Importance of Publications for Prospective Economics Professors in Austria, Germany and Switzerland," German Economic Review, Verein für Socialpolitik, vol. 9(4), pages 457-472, November.
    12. Tom Coupé, 2003. "Revealed Performances: Worldwide Rankings of Economists and Economics Departments, 1990-2000," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1309-1345, December.
    13. David N. Laband & Robert D. Tollison, 2000. "Intellectual Collaboration," Journal of Political Economy, University of Chicago Press, vol. 108(3), pages 632-661, June.
    14. John Hudson, 2007. "Be known by the company you keep: Citations — quality or chance?," Scientometrics, Springer;Akadémiai Kiadó, vol. 71(2), pages 231-238, May.
    15. Winkelmann, Rainer & Zimmermann, Klaus F, 1995. "Recent Developments in Count Data Modelling: Theory and Application," Journal of Economic Surveys, Wiley Blackwell, vol. 9(1), pages 1-24, March.
    16. Guenter Grohmann & Johannes Stegmann, 2005. "German medical faculties in the 1990s: on-line bibliometric analysis," Research Evaluation, Oxford University Press, vol. 14(2), pages 157-164, August.
    17. Medoff, Marshall H., 2003. "Collaboration and the quality of economics research," Labour Economics, Elsevier, vol. 10(5), pages 597-608, October.
    18. Felix Schläpfer & Friedrich Schneider, 2010. "Messung der akademischen Forschungsleistung in den Wirtschaftswissenschaften: Reputation vs. Zitierhäufigkeiten," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 11(4), pages 325-339, November.
    19. Ursprung Heinrich W. & Zimmer Markus, 2007. "Who is the ”Platz-Hirsch“ of the German Economics Profession?: A Citation Analysis," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 227(2), pages 187-208, April.
    20. Michael Graber & Andrey Launov & Klaus Wälde, 2008. "Publish or Perish? The Increasing Importance of Publications for Prospective Economics Professors in Austria, Germany and Switzerland," German Economic Review, Verein für Socialpolitik, vol. 9(4), pages 457-472, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Marcel Clermont & Alexander Dirksen & Barbara Scheidt & Dirk Tunger, 2017. "Citation metrics as an additional indicator for evaluating research performance? An analysis of their correlations and validity," Business Research, Springer;German Academic Association for Business Research, vol. 10(2), pages 249-279, October.
    2. Marcel Clermont & Johanna Krolak & Dirk Tunger, 2021. "Does the citation period have any effect on the informative value of selected citation indicators in research evaluations?," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1019-1047, February.
    3. Bornmann, Lutz & Haunschild, Robin & Mutz, Rüdiger, 2020. "Should citations be field-normalized in evaluative bibliometrics? An empirical analysis based on propensity score matching," Journal of Informetrics, Elsevier, vol. 14(4).
    4. Döpke, Jörg & Fritsche, Ulrich & Waldhof, Gaby, 2017. "Theories, techniques and the formation of German business cycle forecasts. Evidence from a survey among professional forecasters," Working Papers 2, German Research Foundation's Priority Programme 1859 "Experience and Expectation. Historical Foundations of Economic Behaviour", Humboldt University Berlin.
    5. Döpke Jörg & Fritsche Ulrich & Waldhof Gabi, 2019. "Theories, Techniques and the Formation of German Business Cycle Forecasts : Evidence from a survey of professional forecasters," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 239(2), pages 203-241, April.
    6. Andrei Dubovik & Clemens Fiedler & Alexei Parakhonyak, 2022. "Temporal Patterns in Economics Research," CPB Discussion Paper 440, CPB Netherlands Bureau for Economic Policy Analysis.
    7. Wohlrabe, Klaus & Birkmeier, Daniel, 2014. "Do open access articles in economics have a citation advantage?," MPRA Paper 56842, University Library of Munich, Germany.
    8. Yang, Siluo & Wang, Feifei, 2015. "Visualizing information science: Author direct citation analysis in China and around the world," Journal of Informetrics, Elsevier, vol. 9(1), pages 208-225.
    9. Yuanyuan Liu & Qiang Wu & Shijie Wu & Yong Gao, 2021. "Weighted citation based on ranking-related contribution: a new index for evaluating article impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(10), pages 8653-8672, October.
    10. Bornmann, Lutz & Stefaner, Moritz & de Moya Anegón, Felix & Mutz, Rüdiger, 2014. "What is the effect of country-specific characteristics on the research performance of scientific institutions? Using multi-level statistical models to rank and map universities and research-focused in," Journal of Informetrics, Elsevier, vol. 8(3), pages 581-593.
    11. Piracha, Matloob & Tani, Massimiliano & Zimmermann, Klaus F. & Zhang, Yu, 2022. "Higher education expansion and the rise of China in economics research," China Economic Review, Elsevier, vol. 74(C).
    12. Boris Forthmann & Philipp Doebler, 2021. "Reliability of researcher capacity estimates and count data dispersion: a comparison of Poisson, negative binomial, and Conway-Maxwell-Poisson models," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 3337-3354, April.
    13. Heinz Ahn & Marcel Clermont & Julia Langner, 2022. "The impact of selected input and output factors on measuring research efficiency of university research fields: insights from a purpose-, field-, and method-specific perspective," Journal of Business Economics, Springer, vol. 92(8), pages 1303-1335, October.
    14. Zimmermann, Klaus F., 2014. "Evidenzbasierte wissenschaftliche Politikberatung," IZA Standpunkte 74, Institute of Labor Economics (IZA).
    15. Bornmann, Lutz, 2019. "Does the normalized citation impact of universities profit from certain properties of their published documents – such as the number of authors and the impact factor of the publishing journals? A mult," Journal of Informetrics, Elsevier, vol. 13(1), pages 170-184.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bräuninger, Michael & Haucap, Justus & Muck, Johannes, 2011. "Was lesen und schätzen Ökonomen im Jahr 2011?," DICE Ordnungspolitische Perspektiven 18, Heinrich Heine University Düsseldorf, Düsseldorf Institute for Competition Economics (DICE).
    2. Bräuninger Michael & Haucap Justus & Muck Johannes, 2011. "Was lesen und schätzen deutschsprachige Ökonomen heute?," Perspektiven der Wirtschaftspolitik, De Gruyter, vol. 12(4), pages 339-371, November.
    3. Rolf Sternberg, 2015. "The publication and citation behaviour of economic geographers and geographical economists compared," Review of Regional Research: Jahrbuch für Regionalwissenschaft, Springer;Gesellschaft für Regionalforschung (GfR), vol. 35(1), pages 1-27, February.
    4. Justus Haucap & Tobias Thomas & Klaus Wohlrabe, 2017. "Publication Performance vs. Influence: On the Questionable Value of Quality Weighted Publication Rankings," CESifo Working Paper Series 6818, CESifo.
    5. Günther G. Schulze & Susanne Warning & Christian Wiermann, 2008. "What and How Long Does It Take to Get Tenure? The Case of Economics and Business Administration in Austria, Germany and Switzerland," German Economic Review, Verein für Socialpolitik, vol. 9, pages 473-505, November.
    6. Rolf Sternberg, 2013. "Collision of lions and butterflies or mutual neglect - outside the Anglo-American domain, too? The publication and citation behaviour of economic geographers and geographical economists compared," Working Papers on Innovation and Space 2013-13, Philipps University Marburg, Department of Geography.
    7. Justus Haucap & Johannes Muck, 2015. "What drives the relevance and reputation of economics journals? An update from a survey among economists," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(3), pages 849-877, June.
    8. Rolf Ketzler & Klaus F. Zimmermann, 2009. "Publications: German economic research institutes on track," Scientometrics, Springer;Akadémiai Kiadó, vol. 80(1), pages 231-252, July.
    9. Eduardo A. Haddad & Jesus P. Mena-Chalco, Otávio J.G. Sidone, 2016. "Produção Científica e Redes de Colaboração dos Docentes Vinculados aos Programas de Pós-graduação em Economia no Brasil," Working Papers, Department of Economics 2016_10, University of São Paulo (FEA-USP).
    10. Ursprung Heinrich W. & Zimmer Markus, 2007. "Who is the ”Platz-Hirsch“ of the German Economics Profession?: A Citation Analysis," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 227(2), pages 187-208, April.
    11. Bosquet, Clément & Combes, Pierre-Philippe, 2013. "Do large departments make academics more productive? agglomeration and peer effects in research," LSE Research Online Documents on Economics 58306, London School of Economics and Political Science, LSE Library.
    12. Clément Bosquet & Pierre-Philippe Combes, 2015. "Do large departments make academics more productive? Sorting and agglomeration economies in research," THEMA Working Papers 2015-16, THEMA (THéorie Economique, Modélisation et Applications), Université de Cergy-Pontoise.
    13. repec:hal:journl:hal-01292851 is not listed on IDEAS
    14. repec:hal:spmain:info:hdl:2441/4jn6cjcel9913942jpruv3pju6 is not listed on IDEAS
    15. Anne E Winkler & Sharon G Levin & Paula E Stephan & Wolfgang Gl&aauml;nzel, 2014. "Publishing Trends in Economics across Colleges and Universities, 1991–2007," Eastern Economic Journal, Palgrave Macmillan;Eastern Economic Association, vol. 40(4), pages 560-582, September.
    16. Bosquet, Clément & Combes, Pierre-Philippe, 2017. "Sorting and agglomeration economies in French economics departments," Journal of Urban Economics, Elsevier, vol. 101(C), pages 27-44.
    17. Glenn Ellison, 2013. "How Does the Market Use Citation Data? The Hirsch Index in Economics," American Economic Journal: Applied Economics, American Economic Association, vol. 5(3), pages 63-90, July.
    18. repec:hal:spmain:info:hdl:2441/6hol1fq95j9pqofr3i7rv5bssq is not listed on IDEAS
    19. Oswald, Andrew J., 2009. "World-Leading Research and its Measurement," The Warwick Economics Research Paper Series (TWERPS) 887, University of Warwick, Department of Economics.
    20. Alexander Butz & Klaus Wohlrabe, 2016. "Die Ökonomen-Rankings 2015 von Handelsblatt, FAZ und RePEc: Methodik, Ergebnisse, Kritik und Vergleich," ifo Working Paper Series 212, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
    21. Buehling, Kilian, 2021. "Changing research topic trends as an effect of publication rankings – The case of German economists and the Handelsblatt Ranking," Journal of Informetrics, Elsevier, vol. 15(3).
    22. repec:ner:leuven:urn:hdl:123456789/327130 is not listed on IDEAS
    23. Berlemann, Michael & Haucap, Justus, 2015. "Which factors drive the decision to opt out of individual research rankings? An empirical study of academic resistance to change," Research Policy, Elsevier, vol. 44(5), pages 1108-1115.
    24. Günther G. Schulze & Susanne Warning & Christian Wiermann, 2008. "What and How Long Does It Take to Get Tenure? The Case of Economics and Business Administration in Austria, Germany and Switzerland," German Economic Review, Verein für Socialpolitik, vol. 9(4), pages 473-505, November.

    More about this item

    Keywords

    scientometrics; publication analysis; economic research institutes; rankings; citation analysis;
    All these keywords.

    JEL classification:

    • A11 - General Economics and Teaching - - General Economics - - - Role of Economics; Role of Economists
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • L31 - Industrial Organization - - Nonprofit Organizations and Public Enterprise - - - Nonprofit Institutions; NGOs; Social Entrepreneurship

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp6780. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.