IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v117y2018i2d10.1007_s11192-018-2913-5.html
   My bibliography  Save this article

The impact of the national assessment exercises on self-citation rate and publication venue: an empirical investigation on the engineering academic sector in Italy

Author

Listed:
  • Federico Scarpa

    (University of Genoa)

  • Vincenzo Bianco

    (University of Genoa)

  • Luca A. Tagliafico

    (University of Genoa)

Abstract

The aim of the present study is to provide an overview of the research activity, in terms of productivity and impact, of the Italian public universities and their academic staff in the engineering sector (EngSec), that is about seven thousand researchers. Beyond the increased bibliometric performance of the considered research area in the last decade, attention will be focused on the possible feedback on publication habits induced by regulations which progressively introduced, in the research world, strong competitiveness elements, such as evaluation exercises, covering both the single researcher career and the funding system. The effects of this feedback are also explored from the point of view of the self-citation phenomenon, which is said to increasingly affect the research world at large. The EngSec is analyzed both as a whole and decomposed in cultural areas to give a more comprehensive view of this important cultural segment of the academia. In 10 years, the productivity of the sector in term of Scopus documents is roughly doubled, with a consistent shift from conference papers to journal articles. The impact also showed a similar trend with self-citations exposing an evident peak in the year 2013.

Suggested Citation

  • Federico Scarpa & Vincenzo Bianco & Luca A. Tagliafico, 2018. "The impact of the national assessment exercises on self-citation rate and publication venue: an empirical investigation on the engineering academic sector in Italy," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(2), pages 997-1022, November.
    • Handle: RePEc:spr:scient:v:117:y:2018:i:2:d:10.1007_s11192-018-2913-5
    DOI: 10.1007/s11192-018-2913-5
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-018-2913-5
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-018-2913-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. P. Pichappan & S. Sarasvady, 2002. "The other side of the coin: The intricacies of author self-citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 54(2), pages 285-290, June.
    2. Moed, H. F. & Burger, W. J. M. & Frankfort, J. G. & Van Raan, A. F. J., 1985. "The use of bibliometric data for the measurement of university research performance," Research Policy, Elsevier, vol. 14(3), pages 131-149, June.
    3. Alessio Ancaiani & Alberto F. Anfossi & Anna Barbara & Sergio Benedetto & Brigida Blasi & Valentina Carletti & Tindaro Cicero & Alberto Ciolfi & Filippo Costa & Giovanna Colizza & Marco Costantini & F, 2015. "Evaluating scientific research in Italy: The 2004–10 research evaluation exercise," Research Evaluation, Oxford University Press, vol. 24(3), pages 242-255.
    4. Rodrigo Costas & Thed N. Leeuwen & María Bordons, 2010. "Self-citations at the meso and individual levels: effects of different calculation methods," Scientometrics, Springer;Akadémiai Kiadó, vol. 82(3), pages 517-537, March.
    5. Giovanni Abramo & Ciriaco Andrea D’Angelo & Fabio Pugini, 2008. "The measurement of Italian universities’ research productivity by a non parametric-bibliometric methodology," Scientometrics, Springer;Akadémiai Kiadó, vol. 76(2), pages 225-244, August.
    6. Giovanni Abramo & Ciriaco Andrea D’Angelo, 2011. "National-scale research performance assessment at the individual level," Scientometrics, Springer;Akadémiai Kiadó, vol. 86(2), pages 347-364, February.
    7. Jian Wang, 2013. "Citation time window choice for research impact evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(3), pages 851-872, March.
    8. Franceschini, Fiorenzo & Maisano, Domenico, 2017. "Critical remarks on the Italian research assessment exercise VQR 2011–2014," Journal of Informetrics, Elsevier, vol. 11(2), pages 337-357.
    9. Stephen M. Lawani, 1982. "On the Heterogeneity and Classification of Author Self‐Citations," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 33(5), pages 281-284, September.
    10. M. Carl Drott, 1995. "Reexamining the role of conference papers in scholarly communication," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 46(4), pages 299-305, May.
    11. Antonis Sidiropoulos & Dimitrios Katsaros & Yannis Manolopoulos, 2007. "Generalized Hirsch h-index for disclosing latent facts in citation networks," Scientometrics, Springer;Akadémiai Kiadó, vol. 72(2), pages 253-280, August.
    12. Alfonso Ibáñez & Pedro Larrañaga & Concha Bielza, 2013. "Cluster methods for assessing research performance: exploring Spanish computer science," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(3), pages 571-600, December.
    13. Marzolla, Moreno, 2016. "Assessing evaluation procedures for individual researchers: The case of the Italian National Scientific Qualification," Journal of Informetrics, Elsevier, vol. 10(2), pages 408-438.
    14. Ying He & Jiancheng Guan, 2008. "Contribution of Chinese publications in computer science: A case study on LNCS," Scientometrics, Springer;Akadémiai Kiadó, vol. 75(3), pages 519-534, June.
    15. Dag W. Aksnes, 2003. "A macro study of self-citation," Scientometrics, Springer;Akadémiai Kiadó, vol. 56(2), pages 235-246, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Cappelletti-Montano, Beniamino & Columbu, Silvia & Montaldo, Stefano & Musio, Monica, 2021. "New perspectives in bibliometric indicators: Moving from citations to citing authors," Journal of Informetrics, Elsevier, vol. 15(3).
    2. Fry, Caroline V. & Lynham, John & Tran, Shannon, 2023. "Ranking researchers: Evidence from Indonesia," Research Policy, Elsevier, vol. 52(5).
    3. Stefano Vercelli & Leonardo Pellicciari & Andrea Croci & Cesare Maria Cornaggia & Francesca Cecchi & Daniele Piscitelli, 2023. "Self-citation behavior within the health allied professions’ scientific sector in Italy: a bibliometric analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(2), pages 1205-1217, February.
    4. Maria Cristiana Martini & Elvira Pelle & Francesco Poggi & Andrea Sciandra, 2022. "The role of citation networks to explain academic promotions: an empirical analysis of the Italian national scientific qualification," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(10), pages 5633-5659, October.
    5. Yangping Zhou, 2021. "Self-citation and citation of top journal publishers and their interpretation in the journal-discipline context," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 6013-6040, July.
    6. Martin Szomszor & David A. Pendlebury & Jonathan Adams, 2020. "How much is too much? The difference between research influence and self-citation excess," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(2), pages 1119-1147, May.
    7. Abramo, Giovanni & D'Angelo, Ciriaco Andrea & Grilli, Leonardo, 2021. "The effects of citation-based research evaluation schemes on self-citation behavior," Journal of Informetrics, Elsevier, vol. 15(4).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Abramo, Giovanni & D'Angelo, Ciriaco Andrea & Grilli, Leonardo, 2021. "The effects of citation-based research evaluation schemes on self-citation behavior," Journal of Informetrics, Elsevier, vol. 15(4).
    2. Vîiu, Gabriel-Alexandru, 2016. "A theoretical evaluation of Hirsch-type bibliometric indicators confronted with extreme self-citation," Journal of Informetrics, Elsevier, vol. 10(2), pages 552-566.
    3. Martin Szomszor & David A. Pendlebury & Jonathan Adams, 2020. "How much is too much? The difference between research influence and self-citation excess," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(2), pages 1119-1147, May.
    4. Alfonso Ibáñez & Pedro Larrañaga & Concha Bielza, 2013. "Cluster methods for assessing research performance: exploring Spanish computer science," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(3), pages 571-600, December.
    5. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    6. Silvio Peroni & Paolo Ciancarini & Aldo Gangemi & Andrea Giovanni Nuzzolese & Francesco Poggi & Valentina Presutti, 2020. "The practice of self-citations: a longitudinal study," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(1), pages 253-282, April.
    7. Mansour Haghighat & Javad Hayatdavoudi, 2021. "How hot are hot papers? The issue of prolificacy and self-citation stacking," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 565-578, January.
    8. Mathieu Leblond, 2012. "Author self-citations in the field of ecology," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(3), pages 943-953, June.
    9. Hui Li & Weishu Liu, 2020. "Same same but different: self-citations identified through Scopus and Web of Science Core Collection," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(3), pages 2723-2732, September.
    10. James Hartley, 2012. "To cite or not to cite: author self-citations and the impact factor," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 313-317, August.
    11. Rafael Aleixandre & Juan Carlos Valderrama & José María Desantes & Antonio J. Torregrosa, 2004. "Identification of information sources and citation patterns in the field of reciprocating internal combustion engines," Scientometrics, Springer;Akadémiai Kiadó, vol. 59(3), pages 321-336, March.
    12. Abramo, Giovanni & D’Angelo, Ciriaco Andrea, 2015. "Ranking research institutions by the number of highly-cited articles per scientist," Journal of Informetrics, Elsevier, vol. 9(4), pages 915-923.
    13. Lutz Bornmann & Werner Marx, 2014. "How to evaluate individual researchers working in the natural and life sciences meaningfully? A proposal of methods based on percentiles of citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(1), pages 487-509, January.
    14. Giovanni Abramo & Ciriaco Andrea D’Angelo, 2011. "Evaluating research: from informed peer review to bibliometrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(3), pages 499-514, June.
    15. Wen-Yau Cathy Lin & Mu-Hsuan Huang, 2012. "The relationship between co-authorship, currency of references and author self-citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 90(2), pages 343-360, February.
    16. Basma Albanna & Julia Handl & Richard Heeks, 2021. "Publication outperformance among global South researchers: An analysis of individual-level and publication-level predictors of positive deviance," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(10), pages 8375-8431, October.
    17. Yu Liu & Wei Zuo & Ying Gao & Yanhong Qiao, 2013. "Comprehensive geometrical interpretation of h-type indices," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(2), pages 605-615, August.
    18. Min, Chao & Sun, Jianjun & Pei, Lei & Ding, Ying, 2016. "Measuring delayed recognition for papers: Uneven weighted summation and total citations," Journal of Informetrics, Elsevier, vol. 10(4), pages 1153-1165.
    19. Bar-Ilan, Judit, 2008. "Informetrics at the beginning of the 21st century—A review," Journal of Informetrics, Elsevier, vol. 2(1), pages 1-52.
    20. Ibrahim Shehatta & Abdullah M. Al-Rubaish, 2019. "Impact of country self-citations on bibliometric indicators and ranking of most productive countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(2), pages 775-791, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:117:y:2018:i:2:d:10.1007_s11192-018-2913-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.