IDEAS home Printed from https://ideas.repec.org/a/eee/respol/v48y2019i2p478-491.html
   My bibliography  Save this article

Self-citations as strategic response to the use of metrics for career decisions

Author

Listed:
  • Seeber, Marco
  • Cattaneo, Mattia
  • Meoli, Michele
  • Malighetti, Paolo

Abstract

There is limited knowledge on the extent to which scientists may strategically respond to metrics by adopting questionable practices, namely practices that challenge the scientific ethos, and the individual and contextual factors that affect their likelihood. This article aims to fill these gaps by studying the opportunistic use of self-citations, i.e. citations of one’s own work to boost metric scores. Based on sociological and economic literature exploring the factors driving scientists’ behaviour, we develop hypotheses on the predictors of strategic increase in self-citations. We test the hypotheses in the Italian Higher Education system, where promotion to professorial positions is regulated by a national habilitation procedure that considers the number of publications and citations received. The sample includes 886 scientists from four of science’s main disciplinary sectors, employs different metrics approaches, and covers an observation period beginning in 2002 and ending in 2014. We find that the introduction of a regulation that links the possibility of career advancement to the number of citations received is related to a strong and significant increase in self-citations among scientists who can benefit the most from increasing citations, namely assistant professors, associate professors and relatively less cited scientists, and in particular among social scientists. Our findings suggest that while metrics are introduced to spur virtuous behaviours, when not properly designed they favour the usage of questionable practices.

Suggested Citation

  • Seeber, Marco & Cattaneo, Mattia & Meoli, Michele & Malighetti, Paolo, 2019. "Self-citations as strategic response to the use of metrics for career decisions," Research Policy, Elsevier, vol. 48(2), pages 478-491.
  • Handle: RePEc:eee:respol:v:48:y:2019:i:2:p:478-491
    DOI: 10.1016/j.respol.2017.12.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S004873331730210X
    Download Restriction: Full text for ScienceDirect subscribers only

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Hendrik P. van Dalen & Arjo Klamer, 2005. "Is Science A Case of Wasteful Competition?," Kyklos, Wiley Blackwell, vol. 58(3), pages 395-414, July.
    2. Francesco Lissoni & Jacques Mairesse & Fabio Montobbio & Michele Pezzoni, 2011. "Scientific productivity and academic promotion: a study on French and Italian physicists," Industrial and Corporate Change, Oxford University Press, vol. 20(1), pages 253-294, February.
    3. Auranen, Otto & Nieminen, Mika, 2010. "University research funding and publication performance--An international comparison," Research Policy, Elsevier, vol. 39(6), pages 822-834, July.
    4. Ruben Durante & Giovanna Labartino & Roberto Perotti, 2011. "Academic Dynasties: Decentralization and Familism in the Italian Academia," NBER Working Papers 17572, National Bureau of Economic Research, Inc.
    5. Kaare Aagaard & Carter Bloch & Jesper W. Schneider, 2015. "Impacts of performance-based research funding systems: The case of the Norwegian Publication Indicator," Research Evaluation, Oxford University Press, vol. 24(2), pages 106-117.
    6. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    7. Pierre Azoulay & Joshua S. Graff Zivin & Gustavo Manso, 2011. "Incentives and creativity: evidence from the academic life sciences," RAND Journal of Economics, RAND Corporation, vol. 42(3), pages 527-554, September.
    8. Levin, Sharon G & Stephan, Paula E, 1991. "Research Productivity over the Life Cycle: Evidence for Academic Scientists," American Economic Review, American Economic Association, vol. 81(1), pages 114-132, March.
    9. repec:bla:jamest:v:40:y:1989:i:5:p:342-349 is not listed on IDEAS
    10. Aksnes, Dag W. & Rip, Arie, 2009. "Researchers' perceptions of citations," Research Policy, Elsevier, vol. 38(6), pages 895-905, July.
    11. Pezzoni, Michele & Sterzi, Valerio & Lissoni, Francesco, 2012. "Career progress in centralized academic systems: Social capital and institutions in France and Italy," Research Policy, Elsevier, vol. 41(4), pages 704-719.
    12. Maliniak, Daniel & Powers, Ryan & Walter, Barbara F., 2013. "The Gender Citation Gap in International Relations," International Organization, Cambridge University Press, vol. 67(04), pages 889-922, October.
    13. repec:bla:jamist:v:57:y:2006:i:2:p:169-185 is not listed on IDEAS
    14. George A. Lozano & Vincent Larivière & Yves Gingras, 2012. "The weakening relationship between the impact factor and papers' citations in the digital age," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(11), pages 2140-2145, November.
    15. Stephan, Paula E., 2010. "The Economics of Science," Handbook of the Economics of Innovation, Elsevier.
    16. Victoria Anauati & Sebastian Galiani & Ramiro H. Gálvez, 2016. "Quantifying The Life Cycle Of Scholarly Articles Across Fields Of Economic Research," Economic Inquiry, Western Economic Association International, vol. 54(2), pages 1339-1355, April.
    17. Sarah de Rijcke & Paul F. Wouters & Alex D. Rushforth & Thomas P. Franssen & Björn Hammarfelt, 2016. "Evaluation practices and effects of indicator use—a literature review," Research Evaluation, Oxford University Press, vol. 25(2), pages 161-169.
    18. Jingfeng Xia & Jennifer L. Harmon & Kevin G. Connolly & Ryan M. Donnelly & Mary R. Anderson & Heather A. Howard, 2015. "Who publishes in “predatory” journals?," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(7), pages 1406-1417, July.
    19. Heinze, Thomas & Shapira, Philip & Rogers, Juan D. & Senker, Jacqueline M., 2009. "Organizational and institutional influences on creativity in scientific research," Research Policy, Elsevier, vol. 38(4), pages 610-623, May.
    20. Imbens, Guido W. & Lemieux, Thomas, 2008. "Regression discontinuity designs: A guide to practice," Journal of Econometrics, Elsevier, vol. 142(2), pages 615-635, February.
    21. repec:spr:scient:v:93:y:2012:i:2:d:10.1007_s11192-012-0683-z is not listed on IDEAS
    22. Andrew Gelman & Guido Imbens, 2014. "Why High-order Polynomials Should not be Used in Regression Discontinuity Designs," NBER Working Papers 20405, National Bureau of Economic Research, Inc.
    23. repec:spr:scient:v:90:y:2012:i:3:d:10.1007_s11192-011-0494-7 is not listed on IDEAS
    24. repec:spr:scient:v:113:y:2017:i:1:d:10.1007_s11192-017-2310-5 is not listed on IDEAS
    25. repec:bla:jamist:v:63:y:2012:i:11:p:2140-2145 is not listed on IDEAS
    26. Costas, Rodrigo & Bordons, María, 2007. "The h-index: Advantages, limitations and its relation with other bibliometric indicators at the micro level," Journal of Informetrics, Elsevier, vol. 1(3), pages 193-203.
    27. repec:spr:scient:v:72:y:2007:i:3:d:10.1007_s11192-007-1777-2 is not listed on IDEAS
    28. repec:bla:jamist:v:58:y:2007:i:8:p:1100-1107 is not listed on IDEAS
    29. Björn Hammarfelt & Sarah de Rijcke, 2015. "Accountability in context: effects of research evaluation systems on publication practices, disciplinary norms, and individual working routines in the faculty of Arts at Uppsala University," Research Evaluation, Oxford University Press, vol. 24(1), pages 63-77.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. repec:eee:respol:v:48:y:2019:i:6:p:1513-1522 is not listed on IDEAS
    2. van Dalen, Harry, 2019. "Values of economists matter in the art and science of economics," Other publications TiSEM eb9877cc-e840-4625-bcee-9, Tilburg University, School of Economics and Management.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:respol:v:48:y:2019:i:2:p:478-491. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Dana Niculescu). General contact details of provider: http://www.elsevier.com/locate/respol .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.