IDEAS home Printed from https://ideas.repec.org/p/cpr/ceprdp/9110.html
   My bibliography  Save this paper

A Citation-Analysis of Economic Research Institutes

Author

Listed:
  • Zimmermann, Klaus F.
  • Ketzler, Rolf

Abstract

The citation analysis of the research output of the German economic research institutes presented here is based on publications in peer-reviewed journals listed in the Social Science Citation Index for the 2000 - 2009 period. The novel feature of the paper is that a count data model quantifies the determinants of citation success and simulates their citation potential. Among the determinants of the number of cites the quality of the publication outlet exhibits a strong positive effect. The same effect has the number of the published pages, but journals with size limits also yield more cites. Field journals get fewer citations in comparison to general journals. Controlling for journal quality, the number of co-authors of a paper has no effect, but it is positive when co-authors are located outside the own institution. We find that the potential citations predicted by our best model lead to different rankings across the institutes than current citations indicating structural change.

Suggested Citation

  • Zimmermann, Klaus F. & Ketzler, Rolf, 2012. "A Citation-Analysis of Economic Research Institutes," CEPR Discussion Papers 9110, C.E.P.R. Discussion Papers.
    • Handle: RePEc:cpr:ceprdp:9110
    as

    Download full text from publisher

    File URL: https://cepr.org/publications/DP9110
    Download Restriction: CEPR Discussion Papers are free to download for our researchers, subscribers and members. If you fall into one of these categories but have trouble downloading our papers, please contact us at subscribers@cepr.org
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. David N. Laband & Robert D. Tollison, 2000. "Intellectual Collaboration," Journal of Political Economy, University of Chicago Press, vol. 108(3), pages 632-661, June.
    2. Ira N. Gang & Klaus F. Zimmermann, 2000. "Is Child like Parent? Educational Attainment and Ethnic Origin," Journal of Human Resources, University of Wisconsin Press, vol. 35(3), pages 550-569.
    3. Ana Rute Cardoso & Paulo Guimarães & Klaus F. Zimmermann, 2010. "Comparing the early research performance of PhD graduates in labor economics in Europe and the USA," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(3), pages 621-637, September.
    4. John Hudson, 2007. "Be known by the company you keep: Citations — quality or chance?," Scientometrics, Springer;Akadémiai Kiadó, vol. 71(2), pages 231-238, May.
    5. Winkelmann, Rainer & Zimmermann, Klaus F, 1995. "Recent Developments in Count Data Modelling: Theory and Application," Journal of Economic Surveys, Wiley Blackwell, vol. 9(1), pages 1-24, March.
    6. Andrew J. Oswald, 2007. "An Examination of the Reliability of Prestigious Scholarly Journals: Evidence and Implications for Decision‐Makers," Economica, London School of Economics and Political Science, vol. 74(293), pages 21-31, February.
    7. Rolf Ketzler & Klaus F. Zimmermann, 2009. "Publications: German economic research institutes on track," Scientometrics, Springer;Akadémiai Kiadó, vol. 80(1), pages 231-252, July.
    8. Guenter Grohmann & Johannes Stegmann, 2005. "German medical faculties in the 1990s: on-line bibliometric analysis," Research Evaluation, Oxford University Press, vol. 14(2), pages 157-164, August.
    9. repec:bla:germec:v:9:y:2008:i::p:532-538 is not listed on IDEAS
    10. Schneider Friedrich & Ursprung Heinrich W., 2008. "The 2008 GEA Journal-Ranking for the Economics Profession," German Economic Review, De Gruyter, vol. 9(4), pages 532-538, December.
    11. Patrick Puhani, 2000. "The Heckman Correction for Sample Selection and Its Critique," Journal of Economic Surveys, Wiley Blackwell, vol. 14(1), pages 53-68, February.
    12. Medoff, Marshall H., 2003. "Collaboration and the quality of economics research," Labour Economics, Elsevier, vol. 10(5), pages 597-608, October.
    13. Rolf Sternberg & Timo Litzenberger, 2005. "The publication and citation output of German Faculties of Economics and Social Sciences - a comparison of faculties and disciplines based upon SSCI data," Scientometrics, Springer;Akadémiai Kiadó, vol. 65(1), pages 29-53, October.
    14. Felix Schläpfer & Friedrich Schneider, 2010. "Messung der akademischen Forschungsleistung in den Wirtschaftswissenschaften: Reputation vs. Zitierhäufigkeiten," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 11(4), pages 325-339, November.
    15. repec:jns:jbstat:v:227:y:2007:i:2:p:187-208 is not listed on IDEAS
    16. Pierre-Philippe Combes & Laurent Linnemer, 2003. "Where are the Economists Who Publish? Publication Concentration and Rankings in Europe Based on Cumulative Publications," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1250-1308, December.
    17. repec:bla:germec:v:9:y:2008:i::p:457-472 is not listed on IDEAS
    18. Ursprung Heinrich W. & Zimmer Markus, 2007. "Who is the ”Platz-Hirsch“ of the German Economics Profession?: A Citation Analysis," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 227(2), pages 187-208, April.
    19. Tom Coupé, 2003. "Revealed Performances: Worldwide Rankings of Economists and Economics Departments, 1990-2000," Journal of the European Economic Association, MIT Press, vol. 1(6), pages 1309-1345, December.
    20. Michael Graber & Andrey Launov & Klaus Wälde, 2008. "Publish or Perish? The Increasing Importance of Publications for Prospective Economics Professors in Austria, Germany and Switzerland," German Economic Review, Verein für Socialpolitik, vol. 9(4), pages 457-472, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Marcel Clermont & Alexander Dirksen & Barbara Scheidt & Dirk Tunger, 2017. "Citation metrics as an additional indicator for evaluating research performance? An analysis of their correlations and validity," Business Research, Springer;German Academic Association for Business Research, vol. 10(2), pages 249-279, October.
    2. Marcel Clermont & Johanna Krolak & Dirk Tunger, 2021. "Does the citation period have any effect on the informative value of selected citation indicators in research evaluations?," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1019-1047, February.
    3. Bornmann, Lutz & Haunschild, Robin & Mutz, Rüdiger, 2020. "Should citations be field-normalized in evaluative bibliometrics? An empirical analysis based on propensity score matching," Journal of Informetrics, Elsevier, vol. 14(4).
    4. Döpke, Jörg & Fritsche, Ulrich & Waldhof, Gaby, 2017. "Theories, techniques and the formation of German business cycle forecasts. Evidence from a survey among professional forecasters," Working Papers 2, German Research Foundation's Priority Programme 1859 "Experience and Expectation. Historical Foundations of Economic Behaviour", Humboldt University Berlin.
    5. Döpke Jörg & Fritsche Ulrich & Waldhof Gabi, 2019. "Theories, Techniques and the Formation of German Business Cycle Forecasts : Evidence from a survey of professional forecasters," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 239(2), pages 203-241, April.
    6. Andrei Dubovik & Clemens Fiedler & Alexei Parakhonyak, 2022. "Temporal Patterns in Economics Research," CPB Discussion Paper 440, CPB Netherlands Bureau for Economic Policy Analysis.
    7. Wohlrabe, Klaus & Birkmeier, Daniel, 2014. "Do open access articles in economics have a citation advantage?," MPRA Paper 56842, University Library of Munich, Germany.
    8. Yang, Siluo & Wang, Feifei, 2015. "Visualizing information science: Author direct citation analysis in China and around the world," Journal of Informetrics, Elsevier, vol. 9(1), pages 208-225.
    9. Yuanyuan Liu & Qiang Wu & Shijie Wu & Yong Gao, 2021. "Weighted citation based on ranking-related contribution: a new index for evaluating article impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(10), pages 8653-8672, October.
    10. Bornmann, Lutz & Stefaner, Moritz & de Moya Anegón, Felix & Mutz, Rüdiger, 2014. "What is the effect of country-specific characteristics on the research performance of scientific institutions? Using multi-level statistical models to rank and map universities and research-focused in," Journal of Informetrics, Elsevier, vol. 8(3), pages 581-593.
    11. Piracha, Matloob & Tani, Massimiliano & Zimmermann, Klaus F. & Zhang, Yu, 2022. "Higher education expansion and the rise of China in economics research," China Economic Review, Elsevier, vol. 74(C).
    12. Boris Forthmann & Philipp Doebler, 2021. "Reliability of researcher capacity estimates and count data dispersion: a comparison of Poisson, negative binomial, and Conway-Maxwell-Poisson models," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 3337-3354, April.
    13. Heinz Ahn & Marcel Clermont & Julia Langner, 2022. "The impact of selected input and output factors on measuring research efficiency of university research fields: insights from a purpose-, field-, and method-specific perspective," Journal of Business Economics, Springer, vol. 92(8), pages 1303-1335, October.
    14. Zimmermann, Klaus F., 2014. "Evidenzbasierte wissenschaftliche Politikberatung," IZA Standpunkte 74, Institute of Labor Economics (IZA).
    15. Bornmann, Lutz, 2019. "Does the normalized citation impact of universities profit from certain properties of their published documents – such as the number of authors and the impact factor of the publishing journals? A mult," Journal of Informetrics, Elsevier, vol. 13(1), pages 170-184.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Michael Bräuninger & Justus Haucap & Johannes Muck, 2011. "Was lesen und schätzen deutschsprachige Ökonomen heute?," Perspektiven der Wirtschaftspolitik, Verein für Socialpolitik, vol. 12(4), pages 339-371, November.
    2. Rolf Sternberg, 2013. "Collision of lions and butterflies or mutual neglect - outside the Anglo-American domain, too? The publication and citation behaviour of economic geographers and geographical economists compared," Working Papers on Innovation and Space 2013-13, Philipps University Marburg, Department of Geography.
    3. Bräuninger, Michael & Haucap, Justus & Muck, Johannes, 2011. "Was lesen und schätzen Ökonomen im Jahr 2011?," DICE Ordnungspolitische Perspektiven 18, Heinrich Heine University Düsseldorf, Düsseldorf Institute for Competition Economics (DICE).
    4. Rolf Sternberg, 2015. "The publication and citation behaviour of economic geographers and geographical economists compared," Review of Regional Research: Jahrbuch für Regionalwissenschaft, Springer;Gesellschaft für Regionalforschung (GfR), vol. 35(1), pages 1-27, February.
    5. Rolf Ketzler & Klaus F. Zimmermann, 2009. "Publications: German economic research institutes on track," Scientometrics, Springer;Akadémiai Kiadó, vol. 80(1), pages 231-252, July.
    6. Eduardo A. Haddad & Jesus P. Mena-Chalco, Otávio J.G. Sidone, 2016. "Produção Científica e Redes de Colaboração dos Docentes Vinculados aos Programas de Pós-graduação em Economia no Brasil," Working Papers, Department of Economics 2016_10, University of São Paulo (FEA-USP).
    7. Schulze Günther G. & Wiermann Christian & Warning Susanne, 2008. "What and How Long Does It Take to Get Tenure? The Case of Economics and Business Administration in Austria, Germany and Switzerland," German Economic Review, De Gruyter, vol. 9(4), pages 473-505, December.
    8. Oswald, Andrew J., 2009. "World-Leading Research and its Measurement," Economic Research Papers 271312, University of Warwick - Department of Economics.
    9. Ursprung Heinrich W. & Zimmer Markus, 2007. "Who is the ”Platz-Hirsch“ of the German Economics Profession?: A Citation Analysis," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 227(2), pages 187-208, April.
    10. Clément Bosquet & Pierre-Philippe Combes, 2013. "Do Large Departments Make Academics More Productive? Agglomeration and Peer Effects in Research," SERC Discussion Papers 0133, Centre for Economic Performance, LSE.
    11. Clément Bosquet & Pierre-Philippe Combes, 2015. "Do large departments make academics more productive? Sorting and agglomeration economies in research," THEMA Working Papers 2015-16, THEMA (THéorie Economique, Modélisation et Applications), Université de Cergy-Pontoise.
    12. Haucap, Justus & Thomas, Tobias & Wohlrabe, Klaus, 2017. "Publication performance vs. influence: On the questionable value of quality weighted publication rankings," DICE Discussion Papers 277, Heinrich Heine University Düsseldorf, Düsseldorf Institute for Competition Economics (DICE).
    13. Andrew J. Oswald, 2010. "A suggested method for the measurement of world-leading research (illustrated with data on economics)," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(1), pages 99-113, July.
    14. repec:spo:wpmain:info:hdl:2441/5f4gqlbaf382ua75f8et967s6a is not listed on IDEAS
    15. repec:hal:journl:hal-01292851 is not listed on IDEAS
    16. repec:hal:spmain:info:hdl:2441/4jn6cjcel9913942jpruv3pju6 is not listed on IDEAS
    17. repec:jns:jbstat:v:227:y:2007:i:2:p:187-208 is not listed on IDEAS
    18. Bosquet, Clément & Combes, Pierre-Philippe, 2017. "Sorting and agglomeration economies in French economics departments," Journal of Urban Economics, Elsevier, vol. 101(C), pages 27-44.
    19. Maria Rosaria Carillo & Erasmo Papagni & Alessandro Sapio, 2012. "Do collaborations enhance the high-quality output of scientific institutions? Evidence from the Italian Research Assessment Exercise (2001-2003)," Discussion Papers 4_2012, CRISEI, University of Naples "Parthenope", Italy.
    20. Glenn Ellison, 2013. "How Does the Market Use Citation Data? The Hirsch Index in Economics," American Economic Journal: Applied Economics, American Economic Association, vol. 5(3), pages 63-90, July.
    21. Seiler, Christian & Wohlrabe, Klaus, 2012. "Ranking economists on the basis of many indicators: An alternative approach using RePEc data," Journal of Informetrics, Elsevier, vol. 6(3), pages 389-402.
    22. repec:hal:spmain:info:hdl:2441/6hol1fq95j9pqofr3i7rv5bssq is not listed on IDEAS
    23. repec:spo:wpmain:info:hdl:2441/4jn6cjcel9913942jpruv3pju6 is not listed on IDEAS
    24. Raquel Carrasco & Javier Ruiz-Castillo, 2014. "The Evolution Of The Scientific Productivity Of Highly Productive Economists," Economic Inquiry, Western Economic Association International, vol. 52(1), pages 1-16, January.
    25. repec:bla:germec:v:9:y:2008:i::p:473-505 is not listed on IDEAS
    26. Buehling, Kilian, 2021. "Changing research topic trends as an effect of publication rankings – The case of German economists and the Handelsblatt Ranking," Journal of Informetrics, Elsevier, vol. 15(3).
    27. Marcel Clermont & Alexander Dirksen & Barbara Scheidt & Dirk Tunger, 2017. "Citation metrics as an additional indicator for evaluating research performance? An analysis of their correlations and validity," Business Research, Springer;German Academic Association for Business Research, vol. 10(2), pages 249-279, October.

    More about this item

    Keywords

    Citation analysis; Rankings; Scientometrics; Publication analysis; Economic research institutes;
    All these keywords.

    JEL classification:

    • A11 - General Economics and Teaching - - General Economics - - - Role of Economics; Role of Economists
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • L31 - Industrial Organization - - Nonprofit Organizations and Public Enterprise - - - Nonprofit Institutions; NGOs; Social Entrepreneurship

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cpr:ceprdp:9110. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://www.cepr.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.