IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0092508.html
   My bibliography  Save this article

The Quality of Reporting Methods and Results in Network Meta-Analyses: An Overview of Reviews and Suggestions for Improvement

Author

Listed:
  • Brian Hutton
  • Georgia Salanti
  • Anna Chaimani
  • Deborah M Caldwell
  • Chris Schmid
  • Kristian Thorlund
  • Edward Mills
  • Ferrán Catalá-López
  • Lucy Turner
  • Douglas G Altman
  • David Moher

Abstract

Introduction: Some have suggested the quality of reporting of network meta-analyses (a technique used to synthesize information to compare multiple interventions) is sub-optimal. We sought to review information addressing this claim. Objective: To conduct an overview of existing evaluations of quality of reporting in network meta-analyses and indirect treatment comparisons, and to compile a list of topics which may require detailed reporting guidance to enhance future reporting quality. Methods: An electronic search of Medline and the Cochrane Registry of methodologic studies (January 2004–August 2013) was performed by an information specialist. Studies describing findings from quality of reporting assessments were sought. Screening of abstracts and full texts was performed by two team members. Descriptors related to all aspects of reporting a network meta-analysis were summarized. Results: We included eight reports exploring the quality of reporting of network meta-analyses. From past reviews, authors found several aspects of network meta-analyses were inadequately reported, including primary information about literature searching, study selection, and risk of bias evaluations; statement of the underlying assumptions for network meta-analysis, as well as efforts to verify their validity; details of statistical models used for analyses (including information for both Bayesian and Frequentist approaches); completeness of reporting of findings; and approaches for summarizing probability measures as additional important considerations. Conclusions: While few studies were identified, several deficiencies in the current reporting of network meta-analyses were observed. These findings reinforce the need to develop reporting guidance for network meta-analyses. Findings from this review will be used to guide next steps in the development of reporting guidance for network meta-analysis in the format of an extension of the PRISMA (Preferred Reporting Items for Systematic reviews and Meta-Analysis) Statement.

Suggested Citation

  • Brian Hutton & Georgia Salanti & Anna Chaimani & Deborah M Caldwell & Chris Schmid & Kristian Thorlund & Edward Mills & Ferrán Catalá-López & Lucy Turner & Douglas G Altman & David Moher, 2014. "The Quality of Reporting Methods and Results in Network Meta-Analyses: An Overview of Reviews and Suggestions for Improvement," PLOS ONE, Public Library of Science, vol. 9(3), pages 1-9, March.
    • Handle: RePEc:plo:pone00:0092508
    DOI: 10.1371/journal.pone.0092508
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0092508
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0092508&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0092508?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. David Moher & Alessandro Liberati & Jennifer Tetzlaff & Douglas G Altman & The PRISMA Group, 2009. "Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement," PLOS Medicine, Public Library of Science, vol. 6(7), pages 1-6, July.
    2. Alessandro Liberati & Douglas G Altman & Jennifer Tetzlaff & Cynthia Mulrow & Peter C Gøtzsche & John P A Ioannidis & Mike Clarke & P J Devereaux & Jos Kleijnen & David Moher, 2009. "The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration," PLOS Medicine, Public Library of Science, vol. 6(7), pages 1-28, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Fernanda S Tonin & Laiza M Steimbach & Antonio M Mendes & Helena H Borba & Roberto Pontarolo & Fernando Fernandez-Llimos, 2018. "Mapping the characteristics of network meta-analyses on drug therapy: A systematic review," PLOS ONE, Public Library of Science, vol. 13(4), pages 1-16, April.
    2. Jonathan B Koffel & Melissa L Rethlefsen, 2016. "Reproducibility of Search Strategies Is Poor in Systematic Reviews Published in High-Impact Pediatrics, Cardiology and Surgery Journals: A Cross-Sectional Study," PLOS ONE, Public Library of Science, vol. 11(9), pages 1-16, September.
    3. Ferrán Catalá-López & Brian Hutton & Amparo Núñez-Beltrán & Matthew J Page & Manuel Ridao & Diego Macías Saint-Gerons & Miguel A Catalá & Rafael Tabarés-Seisdedos & David Moher, 2017. "The pharmacological and non-pharmacological treatment of attention deficit hyperactivity disorder in children and adolescents: A systematic review with network meta-analyses of randomised trials," PLOS ONE, Public Library of Science, vol. 12(7), pages 1-31, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alessandro Concari & Gerjo Kok & Pim Martens, 2020. "A Systematic Literature Review of Concepts and Factors Related to Pro-Environmental Consumer Behaviour in Relation to Waste Management Through an Interdisciplinary Approach," Sustainability, MDPI, vol. 12(11), pages 1-50, May.
    2. Giuseppe La Torre & Remigio Bova & Rosario Andrea Cocchiara & Cristina Sestili & Anna Tagliaferri & Simona Maggiacomo & Camilla Foschi & William Zomparelli & Maria Vittoria Manai & David Shaholli & Va, 2023. "What Are the Determinants of the Quality of Systematic Reviews in the International Journals of Occupational Medicine? A Methodological Study Review of Published Literature," IJERPH, MDPI, vol. 20(2), pages 1-12, January.
    3. Frank Peinemann & Ulrich Grouven & Nicolaus Kröger & Carmen Bartel & Max H Pittler & Stefan Lange, 2011. "First-Line Matched Related Donor Hematopoietic Stem Cell Transplantation Compared to Immunosuppressive Therapy in Acquired Severe Aplastic Anemia," PLOS ONE, Public Library of Science, vol. 6(4), pages 1-16, April.
    4. Jonathan Kingsley & Aisling Bailey & Nooshin Torabi & Pauline Zardo & Suzanne Mavoa & Tonia Gray & Danielle Tracey & Philip Pettitt & Nicholas Zajac & Emily Foenander, 2019. "A Systematic Review Protocol Investigating Community Gardening Impact Measures," IJERPH, MDPI, vol. 16(18), pages 1-12, September.
    5. Ferrán Catalá-López & Adolfo Alonso-Arroyo & Matthew J Page & Brian Hutton & Rafael Tabarés-Seisdedos & Rafael Aleixandre-Benavent, 2018. "Mapping of global scientific research in comorbidity and multimorbidity: A cross-sectional analysis," PLOS ONE, Public Library of Science, vol. 13(1), pages 1-24, January.
    6. Tobias Elze, 2010. "Misspecifications of Stimulus Presentation Durations in Experimental Psychology: A Systematic Review of the Psychophysics Literature," PLOS ONE, Public Library of Science, vol. 5(9), pages 1-7, September.
    7. S. Rajsic & H. Gothe & H. H. Borba & G. Sroczynski & J. Vujicic & T. Toell & Uwe Siebert, 2019. "Economic burden of stroke: a systematic review on post-stroke care," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 20(1), pages 107-134, February.
    8. Sibonokuhle Ndlovu, 2023. "Preparedness and Response to COVID-19 Disruptions and Learning Challenges for Students with Disabilities in South Africa: A Systematic Review," Sustainability, MDPI, vol. 15(2), pages 1-17, January.
    9. Abbas Mardani & Dalia Streimikiene & Edmundas Kazimieras Zavadskas & Fausto Cavallaro & Mehrbakhsh Nilashi & Ahmad Jusoh & Habib Zare, 2017. "Application of Structural Equation Modeling (SEM) to Solve Environmental Sustainability Problems: A Comprehensive Review and Meta-Analysis," Sustainability, MDPI, vol. 9(10), pages 1-65, October.
    10. Luísa Bandeira Lopes & João Albernaz Neves & João Botelho & Vanessa Machado & José João Mendes, 2021. "Regenerative Endodontic Procedures: An Umbrella Review," IJERPH, MDPI, vol. 18(2), pages 1-17, January.
    11. Gaspar, Rui & Yan, Zheng & Domingos, Samuel, 2019. "Extreme natural and man-made events and human adaptive responses mediated by information and communication technologies' use: A systematic literature review," Technological Forecasting and Social Change, Elsevier, vol. 145(C), pages 125-135.
    12. Nicholas A. Kirk & Nicholas A. Cradock-Henry, 2022. "Land Management Change as Adaptation to Climate and Other Stressors: A Systematic Review of Decision Contexts Using Values-Rules-Knowledge," Land, MDPI, vol. 11(6), pages 1-23, May.
    13. Timothy Noblet & John Marriott & Emma Graham-Clarke & Debra Shirley & Alison Rushton, 2018. "Clinical and cost-effectiveness of non-medical prescribing: A systematic review of randomised controlled trials," PLOS ONE, Public Library of Science, vol. 13(3), pages 1-15, March.
    14. Abbas Mardani & Mehrbakhsh Nilashi & Jurgita Antucheviciene & Madjid Tavana & Romualdas Bausys & Othman Ibrahim, 2017. "Recent Fuzzy Generalisations of Rough Sets Theory: A Systematic Review and Methodological Critique of the Literature," Complexity, Hindawi, vol. 2017, pages 1-33, October.
    15. Wen-Hsiu Yeh & Ya-Ju Ju & Yu-Ting Liu & Ting-Yi Wang, 2022. "Systematic Review and Meta-Analysis on the Effects of Neurofeedback Training of Theta Activity on Working Memory and Episodic Memory in Healthy Population," IJERPH, MDPI, vol. 19(17), pages 1-14, September.
    16. Gourzoulidis, George & Kourlaba, Georgia & Stafylas, Panagiotis & Giamouzis, Gregory & Parissis, John & Maniadakis, Nikolaos, 2017. "Association between copayment, medication adherence and outcomes in the management of patients with diabetes and heart failure," Health Policy, Elsevier, vol. 121(4), pages 363-377.
    17. Cristina Chifor & Iulia D. Arion & Vlad I. Isarie & Felix H. Arion, 2022. "A Systematic Literature Review on European Food Quality Schemes in Romania," Sustainability, MDPI, vol. 14(23), pages 1-16, December.
    18. Snyder, Hannah, 2019. "Literature review as a research methodology: An overview and guidelines," Journal of Business Research, Elsevier, vol. 104(C), pages 333-339.
    19. Pineros-Leano, María & Parchment, Tyrone M. & Calvo, Rocío, 2023. "Family interventions to improve mental, emotional, and behavioral health outcomes among Latinx youth: A systematic review," Children and Youth Services Review, Elsevier, vol. 145(C).
    20. Teresa Loda & Rebecca Erschens & Hannah Loenneker & Katharina E Keifenheim & Christoph Nikendei & Florian Junne & Stephan Zipfel & Anne Herrmann-Werner, 2019. "Cognitive and social congruence in peer-assisted learning – A scoping review," PLOS ONE, Public Library of Science, vol. 14(9), pages 1-15, September.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0092508. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.