IDEAS home Printed from https://ideas.repec.org/a/eee/respol/v48y2019i2p478-491.html
   My bibliography  Save this article

Self-citations as strategic response to the use of metrics for career decisions

Author

Listed:
  • Seeber, Marco
  • Cattaneo, Mattia
  • Meoli, Michele
  • Malighetti, Paolo

Abstract

There is limited knowledge on the extent to which scientists may strategically respond to metrics by adopting questionable practices, namely practices that challenge the scientific ethos, and the individual and contextual factors that affect their likelihood. This article aims to fill these gaps by studying the opportunistic use of self-citations, i.e. citations of one’s own work to boost metric scores. Based on sociological and economic literature exploring the factors driving scientists’ behaviour, we develop hypotheses on the predictors of strategic increase in self-citations. We test the hypotheses in the Italian Higher Education system, where promotion to professorial positions is regulated by a national habilitation procedure that considers the number of publications and citations received. The sample includes 886 scientists from four of science’s main disciplinary sectors, employs different metrics approaches, and covers an observation period beginning in 2002 and ending in 2014. We find that the introduction of a regulation that links the possibility of career advancement to the number of citations received is related to a strong and significant increase in self-citations among scientists who can benefit the most from increasing citations, namely assistant professors, associate professors and relatively less cited scientists, and in particular among social scientists. Our findings suggest that while metrics are introduced to spur virtuous behaviours, when not properly designed they favour the usage of questionable practices.

Suggested Citation

  • Seeber, Marco & Cattaneo, Mattia & Meoli, Michele & Malighetti, Paolo, 2019. "Self-citations as strategic response to the use of metrics for career decisions," Research Policy, Elsevier, vol. 48(2), pages 478-491.
  • Handle: RePEc:eee:respol:v:48:y:2019:i:2:p:478-491
    DOI: 10.1016/j.respol.2017.12.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S004873331730210X
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.respol.2017.12.004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kaare Aagaard & Carter Bloch & Jesper W. Schneider, 2015. "Impacts of performance-based research funding systems: The case of the Norwegian Publication Indicator," Research Evaluation, Oxford University Press, vol. 24(2), pages 106-117.
    2. Aksnes, Dag W. & Rip, Arie, 2009. "Researchers' perceptions of citations," Research Policy, Elsevier, vol. 38(6), pages 895-905, July.
    3. Dag W. Aksnes, 2006. "Citation rates and perceptions of scientific contribution," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 57(2), pages 169-185, January.
    4. Francesco Lissoni & Jacques Mairesse & Fabio Montobbio & Michele Pezzoni, 2011. "Scientific productivity and academic promotion: a study on French and Italian physicists," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 20(1), pages 253-294, February.
    5. George A. Lozano & Vincent Larivière & Yves Gingras, 2012. "The weakening relationship between the impact factor and papers' citations in the digital age," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(11), pages 2140-2145, November.
    6. Mario Biagioli, 2016. "Watch out for cheats in citation game," Nature, Nature, vol. 535(7611), pages 201-201, July.
    7. Stephan, Paula E., 2010. "The Economics of Science," Handbook of the Economics of Innovation, in: Bronwyn H. Hall & Nathan Rosenberg (ed.), Handbook of the Economics of Innovation, edition 1, volume 1, chapter 0, pages 217-273, Elsevier.
    8. Pezzoni, Michele & Sterzi, Valerio & Lissoni, Francesco, 2012. "Career progress in centralized academic systems: Social capital and institutions in France and Italy," Research Policy, Elsevier, vol. 41(4), pages 704-719.
    9. Imbens, Guido W. & Lemieux, Thomas, 2008. "Regression discontinuity designs: A guide to practice," Journal of Econometrics, Elsevier, vol. 142(2), pages 615-635, February.
    10. Andrew Gelman & Guido Imbens, 2019. "Why High-Order Polynomials Should Not Be Used in Regression Discontinuity Designs," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(3), pages 447-456, July.
    11. S. Monteleone & B. Torrisi, 2012. "Geographical analysis of the academic brain drain in Italy," Scientometrics, Springer;Akadémiai Kiadó, vol. 93(2), pages 413-430, November.
    12. Janine Huisman & Jeroen Smits, 2017. "Duration and quality of the peer review process: the author’s perspective," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 633-650, October.
    13. George A. Lozano & Vincent Larivière & Yves Gingras, 2012. "The weakening relationship between the impact factor and papers' citations in the digital age," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 63(11), pages 2140-2145, November.
    14. Pierre Azoulay & Joshua S. Graff Zivin & Gustavo Manso, 2011. "Incentives and creativity: evidence from the academic life sciences," RAND Journal of Economics, RAND Corporation, vol. 42(3), pages 527-554, September.
    15. James H. Fowler & Dag W. Aksnes, 2007. "Does self-citation pay?," Scientometrics, Springer;Akadémiai Kiadó, vol. 72(3), pages 427-437, September.
    16. Perotti, Roberto & Labartino, Giovanna, 2011. "Academic Dynasties: Decentralization and Familism in the Italian Academia," CEPR Discussion Papers 8645, C.E.P.R. Discussion Papers.
    17. Lutz Bornmann & Hans‐Dieter Daniel, 2007. "Multiple publication on a single research study: Does it pay? The influence of number of research articles on total citation counts in biomedicine," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 58(8), pages 1100-1107, June.
    18. Björn Hammarfelt & Sarah de Rijcke, 2015. "Accountability in context: effects of research evaluation systems on publication practices, disciplinary norms, and individual working routines in the faculty of Arts at Uppsala University," Research Evaluation, Oxford University Press, vol. 24(1), pages 63-77.
    19. Hendrik P. Van Dalen & Arjo Klamer, 2005. "Is Science A Case of Wasteful Competition?," Kyklos, Wiley Blackwell, vol. 58(3), pages 395-414, July.
    20. Auranen, Otto & Nieminen, Mika, 2010. "University research funding and publication performance--An international comparison," Research Policy, Elsevier, vol. 39(6), pages 822-834, July.
    21. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    22. Levin, Sharon G & Stephan, Paula E, 1991. "Research Productivity over the Life Cycle: Evidence for Academic Scientists," American Economic Review, American Economic Association, vol. 81(1), pages 114-132, March.
    23. Michael H. MacRoberts & Barbara R. MacRoberts, 1989. "Problems of citation analysis: A critical review," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 40(5), pages 342-349, September.
    24. Francesco Lissoni & Jacques Mairesse & Fabio Montobbio & Michele Pezzoni, 2011. "Scientific productivity and academic promotion: a study on French and Italian physicists," Industrial and Corporate Change, Oxford University Press, vol. 20(1), pages 253-294, February.
    25. Maliniak, Daniel & Powers, Ryan & Walter, Barbara F., 2013. "The Gender Citation Gap in International Relations," International Organization, Cambridge University Press, vol. 67(4), pages 889-922, October.
    26. Victoria Anauati & Sebastian Galiani & Ramiro H. Gálvez, 2016. "Quantifying The Life Cycle Of Scholarly Articles Across Fields Of Economic Research," Economic Inquiry, Western Economic Association International, vol. 54(2), pages 1339-1355, April.
    27. Sarah de Rijcke & Paul F. Wouters & Alex D. Rushforth & Thomas P. Franssen & Björn Hammarfelt, 2016. "Evaluation practices and effects of indicator use—a literature review," Research Evaluation, Oxford University Press, vol. 25(2), pages 161-169.
    28. Jingfeng Xia & Jennifer L. Harmon & Kevin G. Connolly & Ryan M. Donnelly & Mary R. Anderson & Heather A. Howard, 2015. "Who publishes in “predatory” journals?," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(7), pages 1406-1417, July.
    29. Heinze, Thomas & Shapira, Philip & Rogers, Juan D. & Senker, Jacqueline M., 2009. "Organizational and institutional influences on creativity in scientific research," Research Policy, Elsevier, vol. 38(4), pages 610-623, May.
    30. Daniele Fanelli, 2012. "Negative results are disappearing from most disciplines and countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 90(3), pages 891-904, March.
    31. Costas, Rodrigo & Bordons, María, 2007. "The h-index: Advantages, limitations and its relation with other bibliometric indicators at the micro level," Journal of Informetrics, Elsevier, vol. 1(3), pages 193-203.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. A. Baccini & L. Barabesi & M. Cioni & C. Pisani, 2014. "Crossing the hurdle: the determinants of individual scientific performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(3), pages 2035-2062, December.
    2. Alberto Baccini & Lucio Barabesi & Martina Cioni & Caterina Pisani, 2013. "Crossing the hurdle: the determinants of individual scientific performance," Department of Economics University of Siena 691, Department of Economics, University of Siena.
    3. Corsini, Alberto & Pezzoni, Michele & Visentin, Fabiana, 2021. "What makes a productive Ph.D. student?," MERIT Working Papers 2021-011, United Nations University - Maastricht Economic and Social Research Institute on Innovation and Technology (MERIT).
    4. Jürgen Janger & Anna Strauss & David Campbell, 2013. "Academic Careers: A Cross-country Perspective. WWWforEurope Working Paper No. 37," WIFO Studies, WIFO, number 46923, February.
    5. Corsini, Alberto & Pezzoni, Michele & Visentin, Fabiana, 2022. "What makes a productive Ph.D. student?," Research Policy, Elsevier, vol. 51(10).
    6. Julian Clark & Gabrielle Hirsch & Paul H. Jensen & Elizabeth Webster, 2016. "Research Funding Mechanisms and Biomedical Research Outputs," Economic Papers, The Economic Society of Australia, vol. 35(2), pages 142-154, June.
    7. Pezzoni, Michele & Sterzi, Valerio & Lissoni, Francesco, 2012. "Career progress in centralized academic systems: Social capital and institutions in France and Italy," Research Policy, Elsevier, vol. 41(4), pages 704-719.
    8. Wang, Jian & Lee, You-Na & Walsh, John P., 2018. "Funding model and creativity in science: Competitive versus block funding and status contingency effects," Research Policy, Elsevier, vol. 47(6), pages 1070-1083.
    9. Sergey Kolesnikov & Eriko Fukumoto & Barry Bozeman, 2018. "Researchers’ risk-smoothing publication strategies: Is productivity the enemy of impact?," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 1995-2017, September.
    10. Rotolo, Daniele & Messeni Petruzzelli, Antonio, 2013. "When does centrality matter? Scientific productivity and the moderating role of research specialization and cross-community ties," MPRA Paper 53406, University Library of Munich, Germany.
    11. Köppl–Turyna, Monika & Pitlik, Hans, 2018. "Do equalization payments affect subnational borrowing? Evidence from regression discontinuity," European Journal of Political Economy, Elsevier, vol. 53(C), pages 84-108.
    12. Arteaga, Irma & Heflin, Colleen & Gable, Sara, 2016. "The impact of aging out of WIC on food security in households with children," Children and Youth Services Review, Elsevier, vol. 69(C), pages 82-96.
    13. José Miguel Benavente & Gustavo Crespi & Alessandro Maffioli, 2007. "The Impact of National Research Funds: An Evaluation of the Chilean FONDECYT," OVE Working Papers 0307, Inter-American Development Bank, Office of Evaluation and Oversight (OVE).
    14. Adam C. Sales & Ben B. Hansen, 2020. "Limitless Regression Discontinuity," Journal of Educational and Behavioral Statistics, , vol. 45(2), pages 143-174, April.
    15. Hasan, Rana & Jiang, Yi & Rafols, Radine Michelle, 2021. "Place-based preferential tax policy and industrial development: Evidence from India’s program on industrially backward districts," Journal of Development Economics, Elsevier, vol. 150(C).
    16. Prakash, Nishith & Rockmore, Marc & Uppal, Yogesh, 2019. "Do criminally accused politicians affect economic outcomes? Evidence from India," Journal of Development Economics, Elsevier, vol. 141(C).
    17. Christelis, Dimitris & Georgarakos, Dimitris & Sanz-de-Galdeano, Anna, 2020. "The impact of health insurance on stockholding: A regression discontinuity approach," Journal of Health Economics, Elsevier, vol. 69(C).
    18. Mehdi Rhaiem & Nabil Amara, 2020. "Determinants of research efficiency in Canadian business schools: evidence from scholar-level data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 53-99, October.
    19. Joshua D Gottlieb & Richard R Townsend & Ting Xu, 2022. "Does Career Risk Deter Potential Entrepreneurs?," The Review of Financial Studies, Society for Financial Studies, vol. 35(9), pages 3973-4015.
    20. Christina Korting & Carl Lieberman & Jordan Matsudaira & Zhuan Pei & Yi Shen, 2023. "Visual Inference and Graphical Representation in Regression Discontinuity Designs," The Quarterly Journal of Economics, Oxford University Press, vol. 138(3), pages 1977-2019.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:respol:v:48:y:2019:i:2:p:478-491. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/respol .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.