IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v129y2024i6d10.1007_s11192-024-05030-2.html
   My bibliography  Save this article

New fractional classifications of papers based on two generations of references and on the ASJC scopus scheme

Author

Listed:
  • Jesús M. Álvarez-Llorente

    (Universidad de Extremadura)

  • Vicente P. Guerrero-Bote

    (Universidad de Extremadura)

  • Félix Moya-Anegón

    (SCImago Research Group)

Abstract

This paper presents and evaluates a set of methods to classify individual Scopus publications using their references back to the second generation, where each publication can be assigned fractionally into up to five ASJC (All Science Journal Classifications) categories, excluding the Multidisciplinary area and the miscellaneous categories. Based on proposals by Glänzel et al. (Glänzel et al., Scientometrics 44:427–439, 1999a, Glänzel et al., Scientometrics 46:431–441, 1999b, Glänzel, W., Thijs, B., & Huang, Y. (2021). Improving the precision of subject assignment for disparity measurement in studies of interdisciplinary research. In: W. Glänzel, S. Heeffer, PS. Chi, R. Rousseau (eds), Proceedings of the 18th International Conference of the International Society of Scientometrics and Informetrics (ISSI 2021), Leuven University Press, pp. 453–464. https://kuleuven.limo.libis.be/discovery/fulldisplay?docid=lirias3394551&context=SearchWebhook&vid=32KUL_KUL:Lirias&search_scope=lirias_profile&tab=LIRIAS&adaptor=SearchWebhook&lang=en ), some additional parameters are established that allow different results to be obtained depending on how category membership is weighted or how the acceptance thresholds for multiple assignments are established. Various classifications are obtained, and then compared with each other, with the original ASJC Scopus journal classification, and with the AAC (Author’s Assignation Collection) classification of a previous study (Álvarez-Llorente et al., Álvarez-Llorente et al., Profesional de la Información, 2023) in which the papers’ corresponding authors assign them the most appropriate categories. Classifications in which a high threshold is set for allowing assignments to multiple categories, combined with the use of first- and second-generation references and averaging over the number of references, provide the most promising results, improving over other reference-based reclassification proposals in terms of granularity, and over the Scopus classification itself in such aspects as the homogeneity of the publications assigned to a category. They also show greater coincidence with the AAC classification.

Suggested Citation

  • Jesús M. Álvarez-Llorente & Vicente P. Guerrero-Bote & Félix Moya-Anegón, 2024. "New fractional classifications of papers based on two generations of references and on the ASJC scopus scheme," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(6), pages 3493-3515, June.
    • Handle: RePEc:spr:scient:v:129:y:2024:i:6:d:10.1007_s11192-024-05030-2
    DOI: 10.1007/s11192-024-05030-2
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-024-05030-2
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-024-05030-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Wang, Qi & Waltman, Ludo, 2016. "Large-scale analysis of the accuracy of the journal classification systems of Web of Science and Scopus," Journal of Informetrics, Elsevier, vol. 10(2), pages 347-364.
    2. Benjamin M. Althouse & Jevin D. West & Carl T. Bergstrom & Theodore Bergstrom, 2009. "Differences in impact factor across fields and over time," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 60(1), pages 27-34, January.
    3. W. Glänzel & A. Schubert & U. Schoepflin & H. J. Czerwon, 1999. "An item-by-item subject classification of papers published in journals covered by the SSCI database using reference analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 46(3), pages 431-441, November.
    4. Kevin W. Boyack & Henry Small & Richard Klavans, 2013. "Improving the accuracy of co-citation clustering using full text," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(9), pages 1759-1767, September.
    5. Lovro Šubelj & Nees Jan van Eck & Ludo Waltman, 2016. "Clustering Scientific Publications Based on Citation Relations: A Systematic Comparison of Different Methods," PLOS ONE, Public Library of Science, vol. 11(4), pages 1-23, April.
    6. Lin Zhang & Beibei Sun & Fei Shu & Ying Huang, 2022. "Comparing paper level classifications across different methods and systems: an investigation of Nature publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 7633-7651, December.
    7. Frizo Janssens & Wolfgang Glänzel & Bart Moor, 2008. "A hybrid mapping of information science," Scientometrics, Springer;Akadémiai Kiadó, vol. 75(3), pages 607-631, June.
    8. W. Glänzel & A. Schubert & H. -J. Czerwon, 1999. "An item-by-item subject classification of papers published in multidisciplinary and general journals using reference analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 44(3), pages 427-439, March.
    9. Félix Moya-Anegón & Vicente P. Guerrero-Bote & Lutz Bornmann & Henk F. Moed, 2013. "The research guarantors of scientific papers and the output counting: a promising new approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(2), pages 421-434, November.
    10. Althouse, Benjamin M. & West, Jevin D. & Bergstrom, Ted C & Bergstrom, Carl T., 2008. "Differences in Impact Factor Across Fields and Over Time," University of California at Santa Barbara, Economics Working Paper Series qt76h442pg, Department of Economics, UC Santa Barbara.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Anna Małgorzata Kamińska & Łukasz Opaliński & Łukasz Wyciślik, 2024. "The Landscapes of Sustainability in Library and Information Science: Diachronous Citation Perspective," Sustainability, MDPI, vol. 16(21), pages 1-28, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    2. Hric, Darko & Kaski, Kimmo & Kivelä, Mikko, 2018. "Stochastic block model reveals maps of citation patterns and their evolution in time," Journal of Informetrics, Elsevier, vol. 12(3), pages 757-783.
    3. Sjögårde, Peter & Ahlgren, Per, 2018. "Granularity of algorithmically constructed publication-level classifications of research publications: Identification of topics," Journal of Informetrics, Elsevier, vol. 12(1), pages 133-152.
    4. Gabriel-Alexandru Vȋiu & Mihai Păunescu, 2021. "The lack of meaningful boundary differences between journal impact factor quartiles undermines their independent use in research evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1495-1525, February.
    5. Sitaram Devarakonda & Dmitriy Korobskiy & Tandy Warnow & George Chacko, 2020. "Viewing computer science through citation analysis: Salton and Bergmark Redux," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 271-287, October.
    6. Keith Head & Yao Amber Li & Asier Minondo, 2019. "Geography, Ties, and Knowledge Flows: Evidence from Citations in Mathematics," The Review of Economics and Statistics, MIT Press, vol. 101(4), pages 713-727, October.
    7. Ana María Gómez-Aguayo & Joaquín M. Azagra-Caro & Carlos Benito-Amat, 2024. "The steady effect of knowledge co-creation with universities on business scientific impact throughout the economic cycle," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(5), pages 2771-2799, May.
    8. Shahd Al-Janabi & Lee Wei Lim & Luca Aquili, 2021. "Development of a tool to accurately predict UK REF funding allocation," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 8049-8062, September.
    9. Jerome K. Vanclay, 2012. "Impact factor: outdated artefact or stepping-stone to journal certification?," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 211-238, August.
    10. Dorta-González, P. & Dorta-González, M.I., 2013. "Impact maturity times and citation time windows: The 2-year maximum journal impact factor," Journal of Informetrics, Elsevier, vol. 7(3), pages 593-602.
    11. Dorothea Jansen & Regina Görtz & Richard Heidler, 2010. "Knowledge production and the structure of collaboration networks in two scientific fields," Scientometrics, Springer;Akadémiai Kiadó, vol. 83(1), pages 219-241, April.
    12. Huang, Mu-Hsuan & Huang, Wei-Tzu & Chen, Dar-Zen, 2014. "Technological impact factor: An indicator to measure the impact of academic publications on practical innovation," Journal of Informetrics, Elsevier, vol. 8(1), pages 241-251.
    13. Walters, William H., 2014. "Do Article Influence scores overestimate the citation impact of social science journals in subfields that are related to higher-impact natural science disciplines?," Journal of Informetrics, Elsevier, vol. 8(2), pages 421-430.
    14. Michel Zitt, 2015. "Meso-level retrieval: IR-bibliometrics interplay and hybrid citation-words methods in scientific fields delineation," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(3), pages 2223-2245, March.
    15. Yahui Liu & Liying Yang & Jiandong Zhang & Zhesi Shen, 2025. "Addressing the challenges in journal evaluation during the “covidization” of scientific research era : insights from the CAS journal ranking," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 12(1), pages 1-11, December.
    16. Tolga Yuret, 2023. "The citation performance of the references in the standard graduate-level microeconomics textbook: Mas-Collel et al. (1995)," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(3), pages 1473-1484, March.
    17. Tobias Kiesslich & Silke B Weineck & Dorothea Koelblinger, 2016. "Reasons for Journal Impact Factor Changes: Influence of Changing Source Items," PLOS ONE, Public Library of Science, vol. 11(4), pages 1-12, April.
    18. Xiaojun Hu & Ronald Rousseau & Jin Chen, 2012. "Structural indicators in citation networks," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(2), pages 451-460, May.
    19. Waltman, Ludo & van Eck, Nees Jan, 2009. "Some comments on Egghe's derivation of the impact factor distribution," Journal of Informetrics, Elsevier, vol. 3(4), pages 363-366.
    20. Müller, Harry, 2013. "Zur Ethik von Rankings im Hochschulwesen: Eine Betrachtung aus ökonomischer Perspektive," CIW Discussion Papers 1/2013, University of Münster, Center for Interdisciplinary Economics (CIW).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:129:y:2024:i:6:d:10.1007_s11192-024-05030-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.