IDEAS home Printed from https://ideas.repec.org/a/eee/infome/v17y2023i1s1751157723000032.html
   My bibliography  Save this article

Revisiting the uniformity and inconsistency of slow-cited papers in science

Author

Listed:
  • Miura, Takahiro
  • Asatani, Kimitaka
  • Sakata, Ichiro

Abstract

Quantitative analyses on delayed recognition indicated by slow-cited papers, including delayed papers and durable papers, have long been discussed to reveal why outstanding discoveries remain unnoticed. However, these analyses include contradictory arguments, such as which combinations of knowledge, over-specialization, or transdisciplinary factors have led to undervaluation. We claim that this is because the indicators of delayed recognition are methodologically similar but capture conceptually different phenomena. Subsequently, this paper examined the overlap of 11 slow-cited measures to identify the uniformity and inconsistency of delayed recognition. Consequently, each measure practically obtained different papers as delayed recognition objectively classified into four groups by citation feature clustering, albeit based on similar concepts. Despite the ambiguity, we found that all delayed recognition measures extract papers that are more likely to be single-author projects that make disruptive contributions to more diverse fields without extremely novel nor conventional knowledge combinations that have been gradually awakened, compared to the null models. This result is robust when applying other hyperparameters, research topic-controlled null models, year-controlled null models, and other fields. This strongly indicates that delayed recognition leads to the reconstruction of a new direction of science and contributes to pioneering a revolutionary research topic. The source code for extracting slow-cited papers is available online.11https://github.com/TM82/pyhibernator

Suggested Citation

  • Miura, Takahiro & Asatani, Kimitaka & Sakata, Ichiro, 2023. "Revisiting the uniformity and inconsistency of slow-cited papers in science," Journal of Informetrics, Elsevier, vol. 17(1).
    • Handle: RePEc:eee:infome:v:17:y:2023:i:1:s1751157723000032
    DOI: 10.1016/j.joi.2023.101378
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1751157723000032
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.joi.2023.101378?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Erik Brynjolfsson & Daniel Rock & Chad Syverson, 2021. "The Productivity J-Curve: How Intangibles Complement General Purpose Technologies," American Economic Journal: Macroeconomics, American Economic Association, vol. 13(1), pages 333-372, January.
    2. Aurora A. C. Teixeira & Pedro Cosme Vieira & Ana Patrícia Abreu, 2017. "Sleeping Beauties and their princes in innovation studies," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 541-580, February.
    3. Jiang Li & Fred Y. Ye, 2016. "Distinguishing sleeping beauties in science," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(2), pages 821-828, August.
    4. Lachance, Christian & Larivière, Vincent, 2014. "On the citation lifecycle of papers with delayed recognition," Journal of Informetrics, Elsevier, vol. 8(4), pages 863-872.
    5. Norio Ohba & Kumiko Nakao, 2012. "Sleeping beauties in ophthalmology," Scientometrics, Springer;Akadémiai Kiadó, vol. 93(2), pages 253-264, November.
    6. Ben Van Calster, 2012. "It takes time: A remarkable example of delayed recognition," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 63(11), pages 2341-2344, November.
    7. Lin, Yiling & Evans, James A. & Wu, Lingfei, 2022. "New directions in science emerge from disconnection and discord," Journal of Informetrics, Elsevier, vol. 16(1).
    8. Andy Stirling, 2007. "A General Framework for Analysing Diversity in Science, Technology and Society," SPRU Working Paper Series 156, SPRU - Science Policy Research Unit, University of Sussex Business School.
    9. Tibor Braun & Wolfgang Glänzel & András Schubert, 2010. "On Sleeping Beauties, Princes and other tales of citation distributions …," Research Evaluation, Oxford University Press, vol. 19(3), pages 195-202, September.
    10. Jeff Alstott & Ed Bullmore & Dietmar Plenz, 2014. "powerlaw: A Python Package for Analysis of Heavy-Tailed Distributions," PLOS ONE, Public Library of Science, vol. 9(1), pages 1-11, January.
    11. Ratnadeep Dey & Anurag Roy & Tanmoy Chakraborty & Saptarshi Ghosh, 2017. "Sleeping beauties in Computer Science: characterization and early identification," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(3), pages 1645-1663, December.
    12. Jiang Li & Fred Y. Ye, 2012. "The phenomenon of all-elements-sleeping-beauties in scientific literature," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(3), pages 795-799, September.
    13. Jian Wang & Bart Thijs & Wolfgang Glänzel, 2015. "Interdisciplinarity and Impact: Distinct Effects of Variety, Balance, and Disparity," PLOS ONE, Public Library of Science, vol. 10(5), pages 1-18, May.
    14. Jianjun Sun & Chao Min & Jiang Li, 2016. "A vector for measuring obsolescence of scientific articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(2), pages 745-757, May.
    15. Jian Wang, 2013. "Citation time window choice for research impact evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(3), pages 851-872, March.
    16. Lingfei Wu & Dashun Wang & James A. Evans, 2019. "Large teams develop and small teams disrupt science and technology," Nature, Nature, vol. 566(7744), pages 378-382, February.
    17. Onodera, Natsuo, 2016. "Properties of an index of citation durability of an article," Journal of Informetrics, Elsevier, vol. 10(4), pages 981-1004.
    18. Ben Calster, 2012. "It takes time: A remarkable example of delayed recognition," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(11), pages 2341-2344, November.
    19. Rodrigo Costas & Thed N. Leeuwen & Anthony F. J. Raan, 2011. "The “Mendel syndrome” in science: durability of scientific literature and its effects on bibliometric analysis of individual scientists," Scientometrics, Springer;Akadémiai Kiadó, vol. 89(1), pages 177-205, October.
    20. Shino Iwami & Junichiro Mori & Ichiro Sakata & Yuya Kajikawa, 2014. "Detection method of emerging leading papers using time transition," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(2), pages 1515-1533, November.
    21. Shiji Chen & Yanhui Song & Fei Shu & Vincent Larivière, 2022. "Interdisciplinarity and impact: the effects of the citation time window," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(5), pages 2621-2642, May.
    22. Weihua Li & Tomaso Aste & Fabio Caccioli & Giacomo Livan, 2019. "Early coauthorship with top scientists predicts success in academic careers," Nature Communications, Nature, vol. 10(1), pages 1-9, December.
    23. Wolfgang Glänzel & Balázs Schlemmer & Bart Thijs, 2003. "Better late than never? On the chance to become highly cited only beyond the standard bibliometric time horizon," Scientometrics, Springer;Akadémiai Kiadó, vol. 58(3), pages 571-586, November.
    24. Kimitaka Asatani & Junichiro Mori & Masanao Ochi & Ichiro Sakata, 2018. "Detecting trends in academic research from a citation network using network representation learning," PLOS ONE, Public Library of Science, vol. 13(5), pages 1-13, May.
    25. Parolo, Pietro Della Briotta & Pan, Raj Kumar & Ghosh, Rumi & Huberman, Bernardo A. & Kaski, Kimmo & Fortunato, Santo, 2015. "Attention decay in science," Journal of Informetrics, Elsevier, vol. 9(4), pages 734-745.
    26. Jian Du & Yishan Wu, 2018. "A parameter-free index for identifying under-cited sleeping beauties in science," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(2), pages 959-971, August.
    27. Jiang Li & Dongbo Shi, 2016. "Sleeping beauties in genius work: When were they awakened?," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(2), pages 432-440, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jianhua Hou & Xiucai Yang, 2019. "Patent sleeping beauties: evolutionary trajectories and identification methods," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(1), pages 187-215, July.
    2. Hui Fang, 2018. "Analysing the variation tendencies of the numbers of yearly citations for sleeping beauties in science by using derivative analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(2), pages 1051-1070, May.
    3. Hou, Jianhua & Yang, Xiucai, 2020. "Social media-based sleeping beauties: Defining, identifying and features," Journal of Informetrics, Elsevier, vol. 14(2).
    4. Hui Fang, 2019. "A transition stage co-citation criterion for identifying the awakeners of sleeping beauty publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 307-322, October.
    5. Helena H. Zhang & Fred Y. Ye, 2020. "Identifying ‘associated-sleeping-beauties’ in ‘swan-groups’ based on small qualified datasets of physics and economics," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(3), pages 1525-1537, March.
    6. Yang, Jinqing & Bu, Yi & Lu, Wei & Huang, Yong & Hu, Jiming & Huang, Shengzhi & Zhang, Li, 2022. "Identifying keyword sleeping beauties: A perspective on the knowledge diffusion process," Journal of Informetrics, Elsevier, vol. 16(1).
    7. ZhangJian Zong & XuanZhen Liu & Hui Fang, 2018. "Sleeping beauties with no prince based on the co-citation criterion," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(3), pages 1841-1852, December.
    8. Onodera, Natsuo, 2016. "Properties of an index of citation durability of an article," Journal of Informetrics, Elsevier, vol. 10(4), pages 981-1004.
    9. Adil El Aichouchi & Philippe Gorry, 2018. "Delayed recognition of Judah Folkman’s hypothesis on tumor angiogenesis: when a Prince awakens a Sleeping Beauty by self-citation," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(1), pages 385-399, July.
    10. Aurora A. C. Teixeira & Pedro Cosme Vieira & Ana Patrícia Abreu, 2017. "Sleeping Beauties and their princes in innovation studies," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 541-580, February.
    11. Lutz Bornmann & Adam Y. Ye & Fred Y. Ye, 2018. "Identifying “hot papers” and papers with “delayed recognition” in large-scale datasets by using dynamically normalized citation impact scores," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(2), pages 655-674, August.
    12. Jianhua Hou & Hao Li & Yang Zhang, 2023. "Altmetrics-based sleeping beauties: necessity or just a supplement?," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(10), pages 5477-5506, October.
    13. Jianhua Hou & Xiucai Yang & Haoyang Song & Haiyue Yao, 2023. "Will patent family be dormant? Research on the identification and characteristics of sleeping beauty’s patent family," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(10), pages 5361-5387, October.
    14. You Song & Fangling Situ & Hongjun Zhu & Jinzhi Lei, 2018. "To be the Prince to wake up Sleeping Beauty: the rediscovery of the delayed recognition studies," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(1), pages 9-24, October.
    15. Chi, Yuxue & Tang, Xianyi & Liu, Yijun, 2022. "Exploring the “awakening effect” in knowledge diffusion: a case study of publications in the library and information science domain," Journal of Informetrics, Elsevier, vol. 16(4).
    16. Min, Chao & Sun, Jianjun & Pei, Lei & Ding, Ying, 2016. "Measuring delayed recognition for papers: Uneven weighted summation and total citations," Journal of Informetrics, Elsevier, vol. 10(4), pages 1153-1165.
    17. Yuh-Shan Ho & James Hartley, 2017. "Sleeping beauties in psychology," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(1), pages 301-305, January.
    18. Anthony F. J. van Raan, 2021. "Sleeping beauties gain impact in overdrive mode," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(5), pages 4311-4332, May.
    19. Ratnadeep Dey & Anurag Roy & Tanmoy Chakraborty & Saptarshi Ghosh, 2017. "Sleeping beauties in Computer Science: characterization and early identification," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(3), pages 1645-1663, December.
    20. Xiaojing Cai & Xiaozan Lyu & Ping Zhou, 2023. "The relationship between interdisciplinarity and citation impact—a novel perspective on citation accumulation," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-12, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:infome:v:17:y:2023:i:1:s1751157723000032. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/joi .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.