IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0096407.html
   My bibliography  Save this article

Blinded by PRISMA: Are Systematic Reviewers Focusing on PRISMA and Ignoring Other Guidelines?

Author

Listed:
  • Padhraig S Fleming
  • Despina Koletsi
  • Nikolaos Pandis

Abstract

Background: PRISMA guidelines have been developed to improve the reporting of systematic reviews (SRs). Other reporting guidelines and techniques to assess methodological quality of SRs have been developed. We aimed to assess the frequency of the use of reporting and other guidelines in SRs to assess whether PRISMA is being used inappropriately as a substitute for other relevant guidelines. Methods: Web of Knowledge was searched to identify articles citing the PRISMA guidelines over a 12-month period. The use of reporting guidelines (including PRISMA and MOOSE) and tools for assessing methodological quality (including QUADAS) was assessed. Factors associated with appropriate use of guidelines including review type, field of publication and involvement of a methodologist were investigated. Results: Over the 12-month period, 701 SRs were identified. MOOSE guidelines were cited in just 17% of epidemiologic reviews; QUADAS or QUADAS-2 was referred to in just 40% of diagnostic SRs. In the multivariable analysis, medical field of publication and methodologist involvement (OR = 1.97, 95% CI: 1.37, 2.83) were significant predictors of appropriate use of guidelines. Inclusion of a meta-analysis resulted in 73% higher odds of appropriate usage of systematic review guidelines (OR = 1.73, 95% CI: 1.22, 2.35). Conclusions: Usage of SR reporting guidelines and tools for assessment of methodological quality other than PRISMA may be under-utilized with negative implications both for the reporting and methodological quality of systematic reviews.

Suggested Citation

  • Padhraig S Fleming & Despina Koletsi & Nikolaos Pandis, 2014. "Blinded by PRISMA: Are Systematic Reviewers Focusing on PRISMA and Ignoring Other Guidelines?," PLOS ONE, Public Library of Science, vol. 9(5), pages 1-7, May.
    • Handle: RePEc:plo:pone00:0096407
    DOI: 10.1371/journal.pone.0096407
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0096407
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0096407&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0096407?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Nikola Panic & Emanuele Leoncini & Giulio de Belvis & Walter Ricciardi & Stefania Boccia, 2013. "Evaluation of the Endorsement of the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) Statement on the Quality of Published Systematic Review and Meta-Analyses," PLOS ONE, Public Library of Science, vol. 8(12), pages 1-7, December.
    2. Kun-ming Tao & Xiao-qian Li & Qing-hui Zhou & David Moher & Chang-quan Ling & Wei-feng Yu, 2011. "From QUOROM to PRISMA: A Survey of High-Impact Medical Journals' Instructions to Authors and a Review of Systematic Reviews in Anesthesia Literature," PLOS ONE, Public Library of Science, vol. 6(11), pages 1-5, November.
    3. David Moher & Alessandro Liberati & Jennifer Tetzlaff & Douglas G Altman & The PRISMA Group, 2009. "Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement," PLOS Medicine, Public Library of Science, vol. 6(7), pages 1-6, July.
    4. Kenneth F Schulz & Douglas G Altman & David Moher & for the CONSORT Group, 2010. "CONSORT 2010 Statement: Updated Guidelines for Reporting Parallel Group Randomised Trials," PLOS Medicine, Public Library of Science, vol. 7(3), pages 1-7, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Seo, Chunghyeon & Kim, Bitna & Kruis, Nathan E., 2021. "Variation across police response models for handling encounters with people with mental illnesses: A systematic review and meta-analysis," Journal of Criminal Justice, Elsevier, vol. 72(C).
    2. Hisham Abusaada & Abeer Elshater, 2022. "Notes on Developing Research Review in Urban Planning and Urban Design Based on PRISMA Statement," Social Sciences, MDPI, vol. 11(9), pages 1-8, August.
    3. Marialuisa Saviano & Sergio Barile & Francesco Caputo & Mattia Lettieri & Stefania Zanda, 2019. "From Rare to Neglected Diseases: A Sustainable and Inclusive Healthcare Perspective for Reframing the Orphan Drugs Issue," Sustainability, MDPI, vol. 11(5), pages 1-21, March.
    4. Jonathan B Koffel & Melissa L Rethlefsen, 2016. "Reproducibility of Search Strategies Is Poor in Systematic Reviews Published in High-Impact Pediatrics, Cardiology and Surgery Journals: A Cross-Sectional Study," PLOS ONE, Public Library of Science, vol. 11(9), pages 1-16, September.
    5. Abeer Elshater & Hisham Abusaada, 2022. "Developing Process for Selecting Research Techniques in Urban Planning and Urban Design with a PRISMA-Compliant Review," Social Sciences, MDPI, vol. 11(10), pages 1-17, October.
    6. Despina Koletsi & Anna Iliadi & Giorgos N. Tzanetakis & Manolis Vavuranakis & Theodore Eliades, 2021. "Cardiovascular Disease and Chronic Endodontic Infection. Is There an Association? A Systematic Review and Meta-Analysis," IJERPH, MDPI, vol. 18(17), pages 1-18, August.
    7. Emilio Abad-Segura & Mariana-Daniela González-Zamar & Antonio Luque-de la Rosa & María Belén Morales Cevallos, 2020. "Sustainability of Educational Technologies: An Approach to Augmented Reality Research," Sustainability, MDPI, vol. 12(10), pages 1-28, May.
    8. Kim, Bitna, 2022. "Publication bias: A “bird's-eye view” of meta-analytic practice in criminology and criminal justice," Journal of Criminal Justice, Elsevier, vol. 78(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jeroen P M Peters & Lotty Hooft & Wilko Grolman & Inge Stegeman, 2015. "Reporting Quality of Systematic Reviews and Meta-Analyses of Otorhinolaryngologic Articles Based on the PRISMA Statement," PLOS ONE, Public Library of Science, vol. 10(8), pages 1-11, August.
    2. João Carlos Belloti & Aldo Okamura & Jordana Scheeren & Flávio Faloppa & Vinícius Ynoe de Moraes, 2019. "A systematic review of the quality of distal radius systematic reviews: Methodology and reporting assessment," PLOS ONE, Public Library of Science, vol. 14(1), pages 1-12, January.
    3. Daisuke Kato & Yuki Kataoka & Erfen Gustiawan Suwangto & Makoto Kaneko & Hideki Wakabayashi & Daisuke Son & Ichiro Kawachi, 2020. "Reporting Guidelines for Community-Based Participatory Research Did Not Improve the Reporting Quality of Published Studies: A Systematic Review of Studies on Smoking Cessation," IJERPH, MDPI, vol. 17(11), pages 1-9, May.
    4. Giuseppe La Torre & Remigio Bova & Rosario Andrea Cocchiara & Cristina Sestili & Anna Tagliaferri & Simona Maggiacomo & Camilla Foschi & William Zomparelli & Maria Vittoria Manai & David Shaholli & Va, 2023. "What Are the Determinants of the Quality of Systematic Reviews in the International Journals of Occupational Medicine? A Methodological Study Review of Published Literature," IJERPH, MDPI, vol. 20(2), pages 1-12, January.
    5. Shalin Lee Wan Fei & Khatijah L Abdullah, 2015. "Effect of turning vs. supine position under phototherapy on neonates with hyperbilirubinemia: a systematic review," Journal of Clinical Nursing, John Wiley & Sons, vol. 24(5-6), pages 672-682, March.
    6. Savita Bakhshi & Alison E. While, 2013. "Health Professionals’ Alcohol-Related Professional Practices and the Relationship between Their Personal Alcohol Attitudes and Behavior and Professional Practices: A Systematic Review," IJERPH, MDPI, vol. 11(1), pages 1-31, December.
    7. Mulhall, Peter & Taggart, Laurence & Coates, Vivien & McAloon, Toni & Hassiotis, Angela, 2018. "A systematic review of the methodological and practical challenges of undertaking randomised-controlled trials with cognitive disability populations," Social Science & Medicine, Elsevier, vol. 200(C), pages 114-128.
    8. Faith Donald & Kelley Kilpatrick & Kim Reid & Nancy Carter & Ruth Martin-Misener & Denise Bryant-Lukosius & Patricia Harbman & Sharon Kaasalainen & Deborah A. Marshall & Renee Charbonneau-Smith & Erin, 2014. "A Systematic Review of the Cost-Effectiveness of Nurse Practitioners and Clinical Nurse Specialists: What Is the Quality of the Evidence?," Nursing Research and Practice, Hindawi, vol. 2014, pages 1-28, September.
    9. Kartika Saraswati & Brittany J Maguire & Alistair R D McLean & Sauman Singh-Phulgenda & Roland C Ngu & Paul N Newton & Nicholas P J Day & Philippe J Guérin, 2021. "Systematic review of the scrub typhus treatment landscape: Assessing the feasibility of an individual participant-level data (IPD) platform," PLOS Neglected Tropical Diseases, Public Library of Science, vol. 15(10), pages 1-22, October.
    10. Ana Virgolino & Osvaldo Santos & Joana Costa & Mónica Fialho & Ivo Iavicoli & Tiina Santonen & Hanna Tolonen & Evangelia Samoli & Klea Katsouyanni & Georgios Baltatzis & Flavia Ruggieri & Annalisa Abb, 2021. "Challenges to Evidence Synthesis and Identification of Data Gaps in Human Biomonitoring," IJERPH, MDPI, vol. 18(6), pages 1-11, March.
    11. Matthew J Page & Joanne E McKenzie & Patrick M Bossuyt & Isabelle Boutron & Tammy C Hoffmann & Cynthia D Mulrow & Larissa Shamseer & Jennifer M Tetzlaff & Elie A Akl & Sue E Brennan & Roger Chou & Jul, 2021. "The PRISMA 2020 statement: An updated guideline for reporting systematic reviews," PLOS Medicine, Public Library of Science, vol. 18(3), pages 1-15, March.
    12. Anaïs Besson & Alice Tarpin & Valentin Flaudias & Georges Brousse & Catherine Laporte & Amanda Benson & Valentin Navel & Jean-Baptiste Bouillon-Minois & Frédéric Dutheil, 2021. "Smoking Prevalence among Physicians: A Systematic Review and Meta-Analysis," IJERPH, MDPI, vol. 18(24), pages 1-58, December.
    13. Amponsah, Owusu & Blija, Daniel Kwame & Ayambire, Raphael Anammasiya & Takyi, Stephen Appiah & Mensah, Henry & Braimah, Imoro, 2022. "Global urban sprawl containment strategies and their implications for rapidly urbanising cities in Ghana," Land Use Policy, Elsevier, vol. 114(C).
    14. Gianfranco Sanson & Ercole Vellone & Mari Kangasniemi & Rosaria Alvaro & Fabio D'Agostino, 2017. "Impact of nursing diagnoses on patient and organisational outcomes: a systematic literature review," Journal of Clinical Nursing, John Wiley & Sons, vol. 26(23-24), pages 3764-3783, December.
    15. Pei-Ying Kobres & Jean-Paul Chretien & Michael A Johansson & Jeffrey J Morgan & Pai-Yei Whung & Harshini Mukundan & Sara Y Del Valle & Brett M Forshey & Talia M Quandelacy & Matthew Biggerstaff & Ceci, 2019. "A systematic review and evaluation of Zika virus forecasting and prediction research during a public health emergency of international concern," PLOS Neglected Tropical Diseases, Public Library of Science, vol. 13(10), pages 1-21, October.
    16. Jonathan B Koffel, 2015. "Use of Recommended Search Strategies in Systematic Reviews and the Impact of Librarian Involvement: A Cross-Sectional Survey of Recent Authors," PLOS ONE, Public Library of Science, vol. 10(5), pages 1-13, May.
    17. Kun-ming Tao & Xiao-qian Li & Qing-hui Zhou & David Moher & Chang-quan Ling & Wei-feng Yu, 2011. "From QUOROM to PRISMA: A Survey of High-Impact Medical Journals' Instructions to Authors and a Review of Systematic Reviews in Anesthesia Literature," PLOS ONE, Public Library of Science, vol. 6(11), pages 1-5, November.
    18. Mary Ellen Kerans & Anne Murray & Sergi Sabatè, 2016. "Content and Phrasing in Titles of Original Research and Review Articles in 2015: Range of Practice in Four Clinical Journals," Publications, MDPI, vol. 4(2), pages 1-22, April.
    19. Isabel Rodríguez-Gallego & Fatima Leon-Larios & Isabel Corrales-Gutierrez & Juan Diego González-Sanz, 2021. "Impact and Effectiveness of Group Strategies for Supporting Breastfeeding after Birth: A Systematic Review," IJERPH, MDPI, vol. 18(5), pages 1-19, March.
    20. Enrique Orduña-Malea & Adolfo Alonso-Arroyo & José-Antonio Ontalba-Ruipérez & Ferrán Catalá-López, 2023. "Evaluating the online impact of reporting guidelines for randomised trial reports and protocols: a cross-sectional web-based data analysis of CONSORT and SPIRIT initiatives," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(1), pages 407-440, January.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0096407. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.