IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v126y2021i4d10.1007_s11192-021-03877-3.html
   My bibliography  Save this article

Article age- and field-normalized tools to evaluate scientific impact and momentum

Author

Listed:
  • Edgar D. Zanotto

    (Federal University of São Carlos – UFSCar)

  • Vinicius Carvalho

    (Federal University of São Carlos – UFSCar)

Abstract

The Field Weighted Citation Index (FWCI) is an article age- and field-normalized metric to evaluate scientific visibility and impact. The Topic Prominence Percentile (TPP) is another parameter that allegedly measures an article’s “momentum.” Both are available at SciVal and are thought-provoking but have been scarcely used by the community, partially because it is very time-consuming to collect these parameters, paper by paper. In this article, we created and tested a computer code that can efficiently harvest the FWCI and TPP of articles of any chosen researcher, research group, or institution from the Scopus database. After collecting the desired data, our algorithm computes the sum, mean and standard deviation, mode, and median. It also calculates an alternative metric, proposed here, i.e., a normalized parameter that divides each FWCI by the number of authors of that article and then produces similar metrics. We first used the new algorithm to collect an article dataset from a selected researcher, used as an example, who has published 226 articles since 2000. The automated data collection task took 35 min versus 4 h manually. To demonstrate the power of this approach, we present the most relevant results. For instance, 20% of this researcher’s papers have achieved very high visibility, an FWCI ≥ 2. Surprisingly, however, his articles of the highest FWCI are not the most cited. His 20 oldest papers have a similar FWCI to the 20 newest, showing that his scientific output reached a steady-state long ago. Moreover, we discovered that the papers of the highest FWCI have a higher share (65%) of international collaborators than the articles of the lowest FWCI (

Suggested Citation

  • Edgar D. Zanotto & Vinicius Carvalho, 2021. "Article age- and field-normalized tools to evaluate scientific impact and momentum," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 2865-2883, April.
  • Handle: RePEc:spr:scient:v:126:y:2021:i:4:d:10.1007_s11192-021-03877-3
    DOI: 10.1007/s11192-021-03877-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-021-03877-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11192-021-03877-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. John P. A. Ioannidis & Richard Klavans & Kevin W. Boyack, 2018. "Thousands of scientists publish a paper every five days," Nature, Nature, vol. 561(7722), pages 167-169, September.
    2. Guangyuan Hu & Lei Wang & Rong Ni & Weishu Liu, 2020. "Which h-index? An exploration within the Web of Science," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(3), pages 1225-1233, June.
    3. John Panaretos & Chrisovaladis Malesios, 2009. "Assessing scientific research performance and impact with single indices," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(3), pages 635-670, December.
    4. Purkayastha, Amrita & Palmaro, Eleonora & Falk-Krzesinski, Holly J. & Baas, Jeroen, 2019. "Comparison of two article-level, field-independent citation metrics: Field-Weighted Citation Impact (FWCI) and Relative Citation Ratio (RCR)," Journal of Informetrics, Elsevier, vol. 13(2), pages 635-642.
    5. Juan E. Iglesias & Carlos Pecharromán, 2007. "Scaling the h-index for different scientific ISI fields," Scientometrics, Springer;Akadémiai Kiadó, vol. 73(3), pages 303-320, December.
    6. Dmitry M. Kochetkov, 2018. "A Correlation Analysis of Normalized Indicators of Citation," Publications, MDPI, vol. 6(3), pages 1-9, September.
    7. Klavans, Richard & Boyack, Kevin W., 2017. "Research portfolio analysis and topic prominence," Journal of Informetrics, Elsevier, vol. 11(4), pages 1158-1174.
    8. Maziar Montazerian & Edgar Dutra Zanotto & Hellmut Eckert, 2020. "Prolificacy and visibility versus reputation in the hard sciences," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(1), pages 207-221, April.
    9. Lorna Wildgaard & Jesper W. Schneider & Birger Larsen, 2014. "A review of the characteristics of 108 author-level bibliometric indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(1), pages 125-158, October.
    10. Schubert, András & Glänzel, Wolfgang, 2007. "A systematic analysis of Hirsch-type indices for journals," Journal of Informetrics, Elsevier, vol. 1(3), pages 179-184.
    11. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    12. João Claro & Carlos A. V. Costa, 2011. "A made-to-measure indicator for cross-disciplinary bibliometric ranking of researchers performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 86(1), pages 113-123, January.
    13. Maziar Montazerian & Edgar Dutra Zanotto & Hellmut Eckert, 2019. "A new parameter for (normalized) evaluation of H-index: countries as a case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(3), pages 1065-1078, March.
    14. Edgar Dutra Zanotto, 2006. "The scientists pyramid," Scientometrics, Springer;Akadémiai Kiadó, vol. 69(1), pages 175-181, October.
    15. Antonis Sidiropoulos & Dimitrios Katsaros & Yannis Manolopoulos, 2007. "Generalized Hirsch h-index for disclosing latent facts in citation networks," Scientometrics, Springer;Akadémiai Kiadó, vol. 72(2), pages 253-280, August.
    16. John P A Ioannidis & Kevin Boyack & Paul F Wouters, 2016. "Citation Metrics: A Primer on How (Not) to Normalize," PLOS Biology, Public Library of Science, vol. 14(9), pages 1-7, September.
    17. Liming Liang, 2006. "h-index sequence and h-index matrix: Constructions and applications," Scientometrics, Springer;Akadémiai Kiadó, vol. 69(1), pages 153-159, October.
    18. Alonso, S. & Cabrerizo, F.J. & Herrera-Viedma, E. & Herrera, F., 2009. "h-Index: A review focused in its variants, computation and standardization for different scientific fields," Journal of Informetrics, Elsevier, vol. 3(4), pages 273-289.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Nikša Alfirević & Lena Malešević Perović & Maja Mihaljević Kosor, 2023. "Productivity and Impact of Sustainable Development Goals (SDGs)-Related Academic Research: A Bibliometric Analysis," Sustainability, MDPI, vol. 15(9), pages 1-17, April.
    2. Carè, R. & Weber, O., 2023. "How much finance is in climate finance? A bibliometric review, critiques, and future research directions," Research in International Business and Finance, Elsevier, vol. 64(C).
    3. Michael Taylor, 2023. "Slow, slow, quick, quick, slow: five altmetric sources observed over a decade show evolving trends, by research age, attention source maturity and open access status," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2175-2200, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Maziar Montazerian & Edgar Dutra Zanotto & Hellmut Eckert, 2020. "Prolificacy and visibility versus reputation in the hard sciences," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(1), pages 207-221, April.
    2. Maziar Montazerian & Edgar Dutra Zanotto & Hellmut Eckert, 2019. "A new parameter for (normalized) evaluation of H-index: countries as a case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(3), pages 1065-1078, March.
    3. Lorna Wildgaard & Jesper W. Schneider & Birger Larsen, 2014. "A review of the characteristics of 108 author-level bibliometric indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(1), pages 125-158, October.
    4. William Cabos & Juan Miguel Campanario, 2018. "Exploring the Hjif-Index, an Analogue to the H-Like Index for Journal Impact Factors," Publications, MDPI, vol. 6(2), pages 1-11, April.
    5. Deming Lin & Tianhui Gong & Wenbin Liu & Martin Meyer, 2020. "An entropy-based measure for the evolution of h index research," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2283-2298, December.
    6. Zhenbin Yan & Qiang Wu & Xingchen Li, 2016. "Do Hirsch-type indices behave the same in assessing single publications? An empirical study of 29 bibliometric indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 1815-1833, December.
    7. Petridis, Konstantinos & Malesios, Chrisovalantis & Arabatzis, Garyfallos & Thanassoulis, Emmanuel, 2013. "Efficiency analysis of forestry journals: Suggestions for improving journals’ quality," Journal of Informetrics, Elsevier, vol. 7(2), pages 505-521.
    8. Anna Tietze & Philip Hofmann, 2019. "The h-index and multi-author hm-index for individual researchers in condensed matter physics," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(1), pages 171-185, April.
    9. Muhammad Raheel & Samreen Ayaz & Muhammad Tanvir Afzal, 2018. "Evaluation of h-index, its variants and extensions based on publication age & citation intensity in civil engineering," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(3), pages 1107-1127, March.
    10. Lucio Bertoli-Barsotti & Tommaso Lando, 2017. "A theoretical model of the relationship between the h-index and other simple citation indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(3), pages 1415-1448, June.
    11. John Panaretos & Chrisovaladis Malesios, 2009. "Assessing scientific research performance and impact with single indices," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(3), pages 635-670, December.
    12. Lorna Wildgaard, 2015. "A comparison of 17 author-level bibliometric indicators for researchers in Astronomy, Environmental Science, Philosophy and Public Health in Web of Science and Google Scholar," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(3), pages 873-906, September.
    13. C. O. S. Sorzano & J. Vargas & G. Caffarena-Fernández & A. Iriarte, 2014. "Comparing scientific performance among equals," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(3), pages 1731-1745, December.
    14. Chun-Ting Zhang, 2009. "The e-Index, Complementing the h-Index for Excess Citations," PLOS ONE, Public Library of Science, vol. 4(5), pages 1-4, May.
    15. Miguel A. García-Pérez, 2009. "A multidimensional extension to Hirsch’s h-index," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(3), pages 779-785, December.
    16. Jaime A. Teixeira da Silva, 2021. "The i100-index, i1000-index and i10,000-index: expansion and fortification of the Google Scholar h-index for finer-scale citation descriptions and researcher classification," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 3667-3672, April.
    17. Mingers, John & Leydesdorff, Loet, 2015. "A review of theory and practice in scientometrics," European Journal of Operational Research, Elsevier, vol. 246(1), pages 1-19.
    18. Wei, Shelia X. & Tong, Tong & Rousseau, Ronald & Wang, Wanru & Ye, Fred Y., 2022. "Relations among the h-, g-, ψ-, and p-index and offset-ability," Journal of Informetrics, Elsevier, vol. 16(4).
    19. Bornmann, Lutz & Haunschild, Robin & Mutz, Rüdiger, 2020. "Should citations be field-normalized in evaluative bibliometrics? An empirical analysis based on propensity score matching," Journal of Informetrics, Elsevier, vol. 14(4).
    20. Bornmann, Lutz & Mutz, Rüdiger & Hug, Sven E. & Daniel, Hans-Dieter, 2011. "A multilevel meta-analysis of studies reporting correlations between the h index and 37 different h index variants," Journal of Informetrics, Elsevier, vol. 5(3), pages 346-359.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:126:y:2021:i:4:d:10.1007_s11192-021-03877-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.