IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v124y2020i1d10.1007_s11192-020-03431-7.html
   My bibliography  Save this article

Studying review articles in scientometrics and beyond: a research agenda

Author

Listed:
  • Clemens Blümel

    (German Centre for Higher Education Research and Science Studies)

  • Alexander Schniedermann

    (German Centre for Higher Education Research and Science Studies)

Abstract

Review articles are an often neglected genre in scholarly communication. Though there was intense discussion about review articles in scientometrics in the 1970s and 1980s, we find less studies devoted to this genre within the last 20 years. Yet, recent discussions in other fields, such as linguistics, sociology or medicine imply that review articles are part of important debates about problems of research in academia, such as research quality or transparency. Against that background, the purpose of this paper is to review recent developments for the study of review articles in scientometrics and beyond, to discuss theoretical, conceptual and empirical accounts of how review articles can be defined, and to identify major methodological and conceptual challenges for studying review articles. Based on reviewing work and inputs received from of a workshop conducted at a Conference of the International Society of Informetrics in September 2019, we propose a research agenda for the study of review articles. We have identified six realms of study in this area: (1) the study of methodological caveats resulting from the usage of scholarly databases, (2) the study of field specific patterns of reception and usage of review articles, (3) the study of argumentative and textual structures of review articles, (4) the exploration of organizations and infrastructures for review articles, (5) the study of epistemic roles of review articles, and (6) the analysis of authorship patterns in review articles.

Suggested Citation

  • Clemens Blümel & Alexander Schniedermann, 2020. "Studying review articles in scientometrics and beyond: a research agenda," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 711-728, July.
    • Handle: RePEc:spr:scient:v:124:y:2020:i:1:d:10.1007_s11192-020-03431-7
    DOI: 10.1007/s11192-020-03431-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-020-03431-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-020-03431-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Christian Lachance & Steve Poirier & Vincent Larivière, 2014. "The kiss of death? The effect of being cited in a review on subsequent citations," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 65(7), pages 1501-1505, July.
    2. Benjamin M. Althouse & Jevin D. West & Carl T. Bergstrom & Theodore Bergstrom, 2009. "Differences in impact factor across fields and over time," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 60(1), pages 27-34, January.
    3. H. F. Moed & Th. N. Van Leeuwen, 1995. "Improving the accuracy of institute for scientific information's journal impact factors," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 46(6), pages 461-467, July.
    4. Linda Butler, 2003. "Modifying publication practices in response to funding formulas," Research Evaluation, Oxford University Press, vol. 12(1), pages 39-46, April.
    5. Robert Colebunders & Chris Kenyon & Ronald Rousseau, 2014. "Increase in numbers and proportions of review articles in Tropical Medicine, Infectious Diseases, and oncology," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 65(1), pages 201-205, January.
    6. David Moher & Alessandro Liberati & Jennifer Tetzlaff & Douglas G Altman & The PRISMA Group, 2009. "Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement," PLOS Medicine, Public Library of Science, vol. 6(7), pages 1-6, July.
    7. Lutz Bornmann & Robin Haunschild & Werner Marx, 2016. "Policy documents as sources for measuring societal impact: how often is climate change research mentioned in policy-related documents?," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 1477-1495, December.
    8. Adil El Aichouchi & Philippe Gorry, 2018. "Delayed recognition of Judah Folkman’s hypothesis on tumor angiogenesis: when a Prince awakens a Sleeping Beauty by self-citation," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(1), pages 385-399, July.
    9. Miranda, Ruben & Garcia-Carpintero, Esther, 2018. "Overcitation and overrepresentation of review papers in the most cited papers," Journal of Informetrics, Elsevier, vol. 12(4), pages 1015-1030.
    10. Bornmann, Lutz & Marx, Werner, 2015. "Methods for the generation of normalized citation impact scores in bibliometrics: Which method best reflects the judgements of experts?," Journal of Informetrics, Elsevier, vol. 9(2), pages 408-418.
    11. Gorraiz, Juan & Melero-Fuentes, David & Gumpenberger, Christian & Valderrama-Zurián, Juan-Carlos, 2016. "Availability of digital object identifiers (DOIs) in Web of Science and Scopus," Journal of Informetrics, Elsevier, vol. 10(1), pages 98-109.
    12. Paul Donner, 2017. "Document type assignment accuracy in the journal citation index data of Web of Science," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 219-236, October.
    13. Lei Lei & Yunmei Sun, 2020. "Should highly cited items be excluded in impact factor calculation? The effect of review articles on journal impact factor," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(3), pages 1697-1706, March.
    14. Linda Butler & Martijn S. Visser, 2006. "Extending citation analysis to non-source items," Scientometrics, Springer;Akadémiai Kiadó, vol. 66(2), pages 327-343, February.
    15. John P A Ioannidis & Kevin Boyack & Paul F Wouters, 2016. "Citation Metrics: A Primer on How (Not) to Normalize," PLOS Biology, Public Library of Science, vol. 14(9), pages 1-7, September.
    16. Anne-Wil Harzing, 2013. "Document categories in the ISI Web of Knowledge: Misunderstanding the Social Sciences?," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(1), pages 23-34, January.
    17. Matthew J Page & Larissa Shamseer & Douglas G Altman & Jennifer Tetzlaff & Margaret Sampson & Andrea C Tricco & Ferrán Catalá-López & Lun Li & Emma K Reid & Rafael Sarkis-Onofre & David Moher, 2016. "Epidemiology and Reporting Characteristics of Systematic Reviews of Biomedical Research: A Cross-Sectional Study," PLOS Medicine, Public Library of Science, vol. 13(5), pages 1-30, May.
    18. Anne Sigogneau, 2000. "An Analysis of Document Types Published in Journals Related to Physics: Proceeding Papers Recorded in the Science Citation Index Database," Scientometrics, Springer;Akadémiai Kiadó, vol. 47(3), pages 589-604, March.
    19. Félix Moya-Anegón & Zaida Chinchilla-Rodríguez & Benjamín Vargas-Quesada & Elena Corera-Álvarez & Francisco José Muñoz-Fernández & Antonio González-Molina & Victor Herrero-Solana, 2007. "Coverage analysis of Scopus: A journal metric approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 73(1), pages 53-78, October.
    20. John S. Liu & Chung-Huei Kuan, 2016. "A new approach for main path analysis: Decay in knowledge diffusion," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(2), pages 465-476, February.
    21. Mei Hsiu-Ching Ho & John S. Liu & Kerr C.-T. Chang, 2017. "To include or not: the role of review papers in citation-based analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(1), pages 65-76, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Nikita Jain & Deepali Virmani & Ajith Abraham, 2021. "Tsunami in the last 15 years: a bibliometric analysis with a detailed overview and future directions," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 106(1), pages 139-172, March.
    2. Petr Praus, 2023. "Empirical relationship between the number of review and research articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2201-2209, April.
    3. Louvel, Séverine & Soulier, Alexandra, 2022. "Biological embedding vs. embodiment of social experiences: How these two concepts form distinct thought styles around the social production of health inequalities," Social Science & Medicine, Elsevier, vol. 314(C).
    4. Alexander Schniedermann, 2021. "A comparison of systematic reviews and guideline-based systematic reviews in medical studies," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(12), pages 9829-9846, December.
    5. Xiaojie Fan & Hong Liu & Yang Wang & Yawen Wan & Duanhong Zhang, 2022. "Models of Internationalization of Higher Education in Developing Countries—A Perspective of International Research Collaboration in BRICS Countries," Sustainability, MDPI, vol. 14(20), pages 1-24, October.
    6. Carlo Galli & Stefano Guizzardi, 2021. "The Effect of Article Characteristics on Citation Number in a Diachronic Dataset of the Biomedical Literature on Chronic Inflammation: An Analysis by Ensemble Machines," Publications, MDPI, vol. 9(2), pages 1-11, April.
    7. Bethânia Ávila Rodrigues & Mariana Machado Fidelis Nascimento & Juliana Vitória Messias Bittencourt, 2021. "Mapping of the behavior of scientific publications since the decade of 1990 until the present day in the field of food and nutrition security," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(3), pages 2459-2483, March.
    8. Clemens Blümel & Stephan Gauch, 2021. "Introduction to special issue: quantitative studies of science in Germany," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(12), pages 9641-9647, December.
    9. Agatha Ravi Vidiasratri & Lisdrianto Hanindriyo & Caroline Manuela Hartanto, 2024. "Charting the Future of Oral Health: A Bibliometric Exploration of Quality-of-Life Research in Dentistry," IJERPH, MDPI, vol. 21(3), pages 1-15, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alexander Schniedermann, 2021. "A comparison of systematic reviews and guideline-based systematic reviews in medical studies," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(12), pages 9829-9846, December.
    2. Miranda, Ruben & Garcia-Carpintero, Esther, 2018. "Overcitation and overrepresentation of review papers in the most cited papers," Journal of Informetrics, Elsevier, vol. 12(4), pages 1015-1030.
    3. Dunaiski, Marcel & Geldenhuys, Jaco & Visser, Willem, 2019. "On the interplay between normalisation, bias, and performance of paper impact metrics," Journal of Informetrics, Elsevier, vol. 13(1), pages 270-290.
    4. Mei Hsiu-Ching Ho & John S. Liu & Kerr C.-T. Chang, 2017. "To include or not: the role of review papers in citation-based analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(1), pages 65-76, January.
    5. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    6. Raminta Pranckutė, 2021. "Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World," Publications, MDPI, vol. 9(1), pages 1-59, March.
    7. Elizabeth S. Vieira, 2023. "The influence of research collaboration on citation impact: the countries in the European Innovation Scoreboard," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(6), pages 3555-3579, June.
    8. Neal R. Haddaway & Matthew J. Page & Chris C. Pritchard & Luke A. McGuinness, 2022. "PRISMA2020: An R package and Shiny app for producing PRISMA 2020‐compliant flow diagrams, with interactivity for optimised digital transparency and Open Synthesis," Campbell Systematic Reviews, John Wiley & Sons, vol. 18(2), June.
    9. Thed Leeuwen & Rodrigo Costas & Clara Calero-Medina & Martijn Visser, 2013. "The role of editorial material in bibliometric research performance assessments," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(2), pages 817-828, May.
    10. Olesia Iefremova & Kamil Wais & Marcin Kozak, 2018. "Biographical articles in scientific literature: analysis of articles indexed in Web of Science," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(3), pages 1695-1719, December.
    11. Abdelghani Maddi & Lesya Baudoin, 2022. "The quality of the web of science data: a longitudinal study on the completeness of authors-addresses links," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(11), pages 6279-6292, November.
    12. Sánchez-Gil, Susana & Gorraiz, Juan & Melero-Fuentes, David, 2018. "Reference density trends in the major disciplines," Journal of Informetrics, Elsevier, vol. 12(1), pages 42-58.
    13. Houqiang Yu & Xueting Cao & Tingting Xiao & Zhenyi Yang, 2020. "How accurate are policy document mentions? A first look at the role of altmetrics database," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1517-1540, November.
    14. Nargiz Travis & Marie Knoll & Christopher J. Cadham & Steven Cook & Kenneth E. Warner & Nancy L. Fleischer & Clifford E. Douglas & Luz María Sánchez-Romero & Ritesh Mistry & Rafael Meza & Jana L. Hirs, 2022. "Health Effects of Electronic Cigarettes: An Umbrella Review and Methodological Considerations," IJERPH, MDPI, vol. 19(15), pages 1-23, July.
    15. Petersen, Alexander M. & Pan, Raj K. & Pammolli, Fabio & Fortunato, Santo, 2019. "Methods to account for citation inflation in research evaluation," Research Policy, Elsevier, vol. 48(7), pages 1855-1865.
    16. Bornmann, Lutz & Haunschild, Robin & Mutz, Rüdiger, 2020. "Should citations be field-normalized in evaluative bibliometrics? An empirical analysis based on propensity score matching," Journal of Informetrics, Elsevier, vol. 14(4).
    17. Barrios, Maite & Guilera, Georgina & Gómez-Benito, Juana, 2013. "Impact and structural features of meta-analytical studies, standard articles and reviews in psychology: Similarities and differences," Journal of Informetrics, Elsevier, vol. 7(2), pages 478-486.
    18. Esther Maassen & Marcel A L M van Assen & Michèle B Nuijten & Anton Olsson-Collentine & Jelte M Wicherts, 2020. "Reproducibility of individual effect sizes in meta-analyses in psychology," PLOS ONE, Public Library of Science, vol. 15(5), pages 1-18, May.
    19. Carolin Michels & Jun-Ying Fu, 2014. "Systematic analysis of coverage and usage of conference proceedings in web of science," Scientometrics, Springer;Akadémiai Kiadó, vol. 100(2), pages 307-327, August.
    20. Matthew J Page & Joanne E McKenzie & Patrick M Bossuyt & Isabelle Boutron & Tammy C Hoffmann & Cynthia D Mulrow & Larissa Shamseer & Jennifer M Tetzlaff & Elie A Akl & Sue E Brennan & Roger Chou & Jul, 2021. "The PRISMA 2020 statement: An updated guideline for reporting systematic reviews," PLOS Medicine, Public Library of Science, vol. 18(3), pages 1-15, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:124:y:2020:i:1:d:10.1007_s11192-020-03431-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.