IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v116y2018i1d10.1007_s11192-018-2733-7.html
   My bibliography  Save this article

Identifying single influential publications in a research field: new analysis opportunities of the CRExplorer

Author

Listed:
  • Andreas Thor

    (University of Applied Sciences for Telecommunications Leipzig)

  • Lutz Bornmann

    (Division for Science and Innovation Studies)

  • Werner Marx

    (Information Service)

  • Rüdiger Mutz

    (Professorship for Social Psychology and Research on Higher Education)

Abstract

Reference Publication Year Spectroscopy (RPYS) has been developed for identifying the cited references (CRs) with the greatest influence in a given paper set (mostly sets of papers on certain topics or fields). The program CRExplorer (see www.crexplorer.net ) was specifically developed by Thor et al. (J Informetr 10:503–515, 2016a; Scientometrics 109:2049–2051, 2016b) for applying RPYS to publication sets downloaded from Scopus or Web of Science. In this study, we present some advanced methods which have been newly developed for CRExplorer. These methods are able to identify and characterize the CRs which have been influential across a longer period (many citing years). The new methods are demonstrated in this study using all the papers published in Scientometrics between 1978 and 2016. The indicators N_TOP50, N_TOP25, and N_TOP10 can be used to identify those CRs which belong to the 50, 25, or 10% most frequently cited publications (CRs) over many citing publication years. In the Scientometrics dataset, for example, Lotka’s (J Wash Acad Sci 12:317–323, 1926) paper on the distribution of scientific productivity belongs to the top 10% publications (CRs) in 36 citing years. Furthermore, the new version of CRExplorer analyzes the impact sequence of CRs across citing years. CRs can have below average (−), average (0), or above average (+) impact in citing years (whereby average is meant in the sense of expected values). The sequence (e.g. 00++−−−0−−00) is used by the program to identify papers with typical impact distributions. For example, CRs can have early, but not late impact (“hot papers”, e.g. +++−−−) or vice versa (“sleeping beauties”, e.g. −−−0000−−−++).

Suggested Citation

  • Andreas Thor & Lutz Bornmann & Werner Marx & Rüdiger Mutz, 2018. "Identifying single influential publications in a research field: new analysis opportunities of the CRExplorer," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(1), pages 591-608, July.
    • Handle: RePEc:spr:scient:v:116:y:2018:i:1:d:10.1007_s11192-018-2733-7
    DOI: 10.1007/s11192-018-2733-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-018-2733-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-018-2733-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. S. Redner, 1998. "How popular is your paper? An empirical study of the citation distribution," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 4(2), pages 131-134, July.
    2. Mehdi Rhaiem & Lutz Bornmann, 2018. "Reference Publication Year Spectroscopy (RPYS) with publications in the area of academic efficiency studies: what are the historical roots of this research topic?," Applied Economics, Taylor & Francis Journals, vol. 50(13), pages 1442-1453, March.
    3. Lutz Bornmann & Adam Y. Ye & Fred Y. Ye, 2017. "Sequence analysis of annually normalized citation counts: an empirical analysis based on the characteristic scores and scales (CSS) method," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(3), pages 1665-1680, December.
    4. Werner Marx & Lutz Bornmann, 2014. "Tracing the origin of a scientific legend by reference publication year spectroscopy (RPYS): the legend of the Darwin finches," Scientometrics, Springer;Akadémiai Kiadó, vol. 99(3), pages 839-844, June.
    5. Amin Mazloumian & Young-Ho Eom & Dirk Helbing & Sergi Lozano & Santo Fortunato, 2011. "How Citation Boosts Promote Scientific Paradigm Shifts and Nobel Prizes," PLOS ONE, Public Library of Science, vol. 6(5), pages 1-6, May.
    6. Garfield, Eugene, 2009. "From the science of science to Scientometrics visualizing the history of science with HistCite software," Journal of Informetrics, Elsevier, vol. 3(3), pages 173-179.
    7. Lutz Bornmann & Rüdiger Mutz, 2015. "Growth rates of modern science: A bibliometric analysis based on the number of publications and cited references," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(11), pages 2215-2222, November.
    8. Marlies Olensky & Marion Schmidt & Nees Jan Eck, 2016. "Evaluation of the citation matching algorithms of CWTS and iFQ in comparison to the Web of science," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(10), pages 2550-2564, October.
    9. Katz, J. Sylvan & Martin, Ben R., 1997. "What is research collaboration?," Research Policy, Elsevier, vol. 26(1), pages 1-18, March.
    10. Olle Persson & Wolfgang Glänzel & Rickard Danell, 2004. "Inflationary bibliometric values: The role of scientific collaboration and the need for relative indicators in evaluative studies," Scientometrics, Springer;Akadémiai Kiadó, vol. 60(3), pages 421-432, August.
    11. Di Vaio, Gianfranco & Waldenström, Daniel & Weisdorf, Jacob, 2012. "Citation success: Evidence from economic history journal publications," Explorations in Economic History, Elsevier, vol. 49(1), pages 92-104.
    12. Werner Marx & Lutz Bornmann, 2016. "Change of perspective: bibliometrics from the point of view of cited references—a literature overview on approaches to the evaluation of cited references in bibliometrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 1397-1415, November.
    13. McLevey, John & McIlroy-Young, Reid, 2017. "Introducing metaknowledge: Software for computational research in information science, network analysis, and science of science," Journal of Informetrics, Elsevier, vol. 11(1), pages 176-197.
    14. Thor, Andreas & Marx, Werner & Leydesdorff, Loet & Bornmann, Lutz, 2016. "Introducing CitedReferencesExplorer (CRExplorer): A program for reference publication year spectroscopy with cited references standardization," Journal of Informetrics, Elsevier, vol. 10(2), pages 503-515.
    15. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    16. van Eck, Nees Jan & Waltman, Ludo, 2014. "CitNetExplorer: A new software tool for analyzing and visualizing citation networks," Journal of Informetrics, Elsevier, vol. 8(4), pages 802-823.
    17. Werner Marx & Lutz Bornmann & Andreas Barth & Loet Leydesdorff, 2014. "Detecting the historical roots of research fields by reference publication year spectroscopy (RPYS)," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 65(4), pages 751-764, April.
    18. Henry Small, 1973. "Co‐citation in the scientific literature: A new measure of the relationship between two documents," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 24(4), pages 265-269, July.
    19. Wolfgang Glänzel & András Schubert, 2001. "Double effort = Double impact? A critical view at international co-authorship in chemistry," Scientometrics, Springer;Akadémiai Kiadó, vol. 50(2), pages 199-214, February.
    20. Eugene Garfield & A. I. Pudovkin & V. S. Istomin, 2003. "Why do we need algorithmic historiography?," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 54(5), pages 400-412, March.
    21. Jordan A. Comins & Thomas W. Hussey, 2015. "Detecting seminal research contributions to the development and use of the global positioning system by reference publication year spectroscopy," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(2), pages 575-580, August.
    22. Bornmann, Lutz & Marx, Werner, 2013. "The proposal of a broadening of perspective in evaluative bibliometrics by complementing the times cited with a cited reference analysis," Journal of Informetrics, Elsevier, vol. 7(1), pages 84-88.
    23. Peter Weingart, 2005. "Impact of bibliometrics upon the science system: Inadvertent consequences?," Scientometrics, Springer;Akadémiai Kiadó, vol. 62(1), pages 117-131, January.
    24. Wolfgang Glänzel & András Schubert, 2003. "A new classification scheme of science fields and subfields designed for scientometric evaluation purposes," Scientometrics, Springer;Akadémiai Kiadó, vol. 56(3), pages 357-367, March.
    25. Barabási, A.L & Jeong, H & Néda, Z & Ravasz, E & Schubert, A & Vicsek, T, 2002. "Evolution of the social network of scientific collaborations," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 311(3), pages 590-614.
    26. Comins, Jordan A. & Hussey, Thomas W., 2015. "Compressing multiple scales of impact detection by Reference Publication Year Spectroscopy," Journal of Informetrics, Elsevier, vol. 9(3), pages 449-454.
    27. Katherine W. McCain, 2015. "Mining full-text journal articles to assess obliteration by incorporation: Herbert A. Simon's concepts of bounded rationality and satisficing in economics, management, and psychology," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(11), pages 2187-2201, November.
    28. Bornmann, Lutz & Haunschild, Robin, 2016. "Citation score normalized by cited references (CSNCR): The introduction of a new citation impact indicator," Journal of Informetrics, Elsevier, vol. 10(3), pages 875-887.
    29. Katherine W. McCain, 2011. "Eponymy and Obliteration by Incorporation: The case of the “Nash Equilibrium”," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(7), pages 1412-1424, July.
    30. Bakthavachalam Elango & Lutz Bornmann & Govindaraju Kannan, 2016. "Detecting the historical roots of tribology research: a bibliometric analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(1), pages 305-313, April.
    31. Philippe Gorry & Pascal Ragouet, 2016. "“Sleeping beauty” and her restless sleep: Charles Dotter and the birth of interventional radiology," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(2), pages 773-784, May.
    32. Lutz Bornmann & Hans-Dieter Daniel, 2005. "Does the h-index for ranking of scientists really work?," Scientometrics, Springer;Akadémiai Kiadó, vol. 65(3), pages 391-392, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Helena Blažun Vošner & Peter Kokol & Danica Železnik & Jernej Završnik, 2022. "From Roots to Contemporary Nursing in Ex-Yugoslavian Countries: A Synthetic Review," SAGE Open, , vol. 12(2), pages 21582440221, May.
    2. Robin Haunschild & Lutz Bornmann, 2022. "Reference publication year spectroscopy (RPYS) in practice: a software tutorial," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 7253-7271, December.
    3. Liang, Guoqiang & Hou, Haiyan & Ding, Ying & Hu, Zhigang, 2020. "Knowledge recency to the birth of Nobel Prize-winning articles: Gender, career stage, and country," Journal of Informetrics, Elsevier, vol. 14(3).
    4. Guoliang Lyu & Ganwei Shi, 2019. "On an approach to boosting a journal’s citation potential," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(3), pages 1387-1409, September.
    5. Peter Kokol & Helena Blažun Vošner & Jernej Završnik & Grega Žlahtič, 2022. "Sleeping beauties in health informatics research," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(8), pages 5073-5081, August.
    6. Lutz Bornmann & Loet Leydesdorff, 2020. "Historical roots of Judit Bar-Ilan’s research: a cited-references analysis using CRExplorer," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(3), pages 1193-1200, June.
    7. Robin Haunschild & Werner Marx, 2022. "On Health Effects of Resveratrol in Wine," IJERPH, MDPI, vol. 19(5), pages 1-13, March.
    8. Wang, Peiling & Su, Jing, 2021. "Post-publication expert recommendations in faculty opinions (F1000Prime): Recommended articles and citations," Journal of Informetrics, Elsevier, vol. 15(3).
    9. Xin Li & Qiang Yao & Xuli Tang & Qian Li & Mengjia Wu, 2020. "How to investigate the historical roots and evolution of research fields in China? A case study on iMetrics using RootCite," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1253-1274, November.
    10. Chembessi Chedrak & Gohoungodji Paulin & Juste Rajaonson, 2023. "“A fine wine, better with age”: Circular economy historical roots and influential publications: A bibliometric analysis using Reference Publication Year Spectroscopy (RPYS)," Journal of Industrial Ecology, Yale University, vol. 27(6), pages 1593-1612, December.
    11. Mostafa, Mohamed M., 2022. "Five decades of catastrophe theory research: Geographical atlas, knowledge structure and historical roots," Chaos, Solitons & Fractals, Elsevier, vol. 159(C).
    12. Robin Haunschild & Werner Marx, 2020. "Discovering seminal works with marker papers," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2955-2969, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Werner Marx & Lutz Bornmann, 2016. "Change of perspective: bibliometrics from the point of view of cited references—a literature overview on approaches to the evaluation of cited references in bibliometrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 1397-1415, November.
    2. McLevey, John & McIlroy-Young, Reid, 2017. "Introducing metaknowledge: Software for computational research in information science, network analysis, and science of science," Journal of Informetrics, Elsevier, vol. 11(1), pages 176-197.
    3. Jianhua Hou, 2017. "Exploration into the evolution and historical roots of citation analysis by referenced publication year spectroscopy," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(3), pages 1437-1452, March.
    4. Matthieu Ballandonne & Igor Cersosimo, 2021. "A note on reference publication year spectroscopy with incomplete information," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 4927-4939, June.
    5. Xin Li & Qiang Yao & Xuli Tang & Qian Li & Mengjia Wu, 2020. "How to investigate the historical roots and evolution of research fields in China? A case study on iMetrics using RootCite," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1253-1274, November.
    6. Bar-Ilan, Judit, 2008. "Informetrics at the beginning of the 21st century—A review," Journal of Informetrics, Elsevier, vol. 2(1), pages 1-52.
    7. Werner Marx & Robin Haunschild & Andreas Thor & Lutz Bornmann, 2017. "Which early works are cited most frequently in climate change research literature? A bibliometric approach based on Reference Publication Year Spectroscopy," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(1), pages 335-353, January.
    8. Comins, Jordan A. & Carmack, Stephanie A. & Leydesdorff, Loet, 2018. "Patent citation spectroscopy (PCS): Online retrieval of landmark patents based on an algorithmic approach," Journal of Informetrics, Elsevier, vol. 12(4), pages 1223-1231.
    9. Thor, Andreas & Marx, Werner & Leydesdorff, Loet & Bornmann, Lutz, 2016. "Introducing CitedReferencesExplorer (CRExplorer): A program for reference publication year spectroscopy with cited references standardization," Journal of Informetrics, Elsevier, vol. 10(2), pages 503-515.
    10. Lutz Bornmann & Robin Haunschild & Loet Leydesdorff, 2018. "Reference publication year spectroscopy (RPYS) of Eugene Garfield’s publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(2), pages 439-448, February.
    11. Sameer Kumar & Jariah Mohd. Jan, 2013. "Mapping research collaborations in the business and management field in Malaysia, 1980–2010," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(3), pages 491-517, December.
    12. Werner Marx & Robin Haunschild & Bernie French & Lutz Bornmann, 2017. "Slow reception and under-citedness in climate change research: A case study of Charles David Keeling, discoverer of the risk of global warming," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(2), pages 1079-1092, August.
    13. K. Brad Wray & Lutz Bornmann, 2015. "Philosophy of science viewed through the lense of “Referenced Publication Years Spectroscopy” (RPYS)," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(3), pages 1987-1996, March.
    14. Tosi, Mauro Dalle Lucca & dos Reis, Julio Cesar, 2021. "SciKGraph: A knowledge graph approach to structure a scientific field," Journal of Informetrics, Elsevier, vol. 15(1).
    15. Chen, Kaihua & Zhang, Yi & Fu, Xiaolan, 2019. "International research collaboration: An emerging domain of innovation studies?," Research Policy, Elsevier, vol. 48(1), pages 149-168.
    16. Leydesdorff, Loet & Bornmann, Lutz & Marx, Werner & Milojević, Staša, 2014. "Referenced Publication Years Spectroscopy applied to iMetrics: Scientometrics, Journal of Informetrics, and a relevant subset of JASIST," Journal of Informetrics, Elsevier, vol. 8(1), pages 162-174.
    17. Liang, Guoqiang & Hou, Haiyan & Ding, Ying & Hu, Zhigang, 2020. "Knowledge recency to the birth of Nobel Prize-winning articles: Gender, career stage, and country," Journal of Informetrics, Elsevier, vol. 14(3).
    18. Massimo Franceschet & Giovanni Colavizza, 2020. "Quantifying the higher-order influence of scientific publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 951-963, November.
    19. Jordan A. Comins & Loet Leydesdorff, 2017. "Citation algorithms for identifying research milestones driving biomedical innovation," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(3), pages 1495-1504, March.
    20. Cesar H. Limaymanta & Rosalía Quiroz-de-García & Jesús A. Rivas-Villena & Andrea Rojas-Arroyo & Orlando Gregorio-Chaviano, 2022. "Relationship between collaboration and normalized scientific impact in South American public universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(11), pages 6391-6411, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:116:y:2018:i:1:d:10.1007_s11192-018-2733-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.