IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0269009.html
   My bibliography  Save this article

Methodological approaches for assessing certainty of the evidence in umbrella reviews: A scoping review

Author

Listed:
  • Saranrat Sadoyu
  • Kaniz Afroz Tanni
  • Nontaporn Punrum
  • Sobhon Paengtrai
  • Warittakorn Kategaew
  • Nattiwat Promchit
  • Nai Ming Lai
  • Ammarin Thakkinstian
  • Surachat Ngorsuraches
  • Mukdarut Bangpan
  • Sajesh Veettil
  • Nathorn Chaiyakunapruk

Abstract

Introduction: The number of umbrella reviews (URs) that compiled systematic reviews and meta-analysis (SR-MAs) has increased dramatically over recent years. No formal guidance for assessing the certainty of evidence in URs of meta-analyses exists nowadays. URs of non-interventional studies help establish evidence linking exposure to certain health outcomes in a population. This study aims to identify and describe the methodological approaches for assessing the certainty of the evidence in published URs of non-interventions. Methods: We searched from 3 databases including PubMed, Embase, and The Cochrane Library from May 2010 to September 2021. We included URs that included SR-MAs of studies with non-interventions. Two independent reviewers screened and extracted data. We compared URs characteristics stratified by publication year, journal ranking, journal impact factor using Chi-square test. Results: Ninety-nine URs have been included. Most were SR-MAs of observational studies evaluating association of non-modifiable risk factors with some outcomes. Only half (56.6%) of the included URs assessed the certainty of the evidence. The most frequently used criteria is credibility assessment (80.4%), followed by GRADE approach (14.3%). URs published in journals with higher journal impact factor assessed certainty of evidence than URs published in lower impact group (77.1 versus 37.2% respectively, p

Suggested Citation

  • Saranrat Sadoyu & Kaniz Afroz Tanni & Nontaporn Punrum & Sobhon Paengtrai & Warittakorn Kategaew & Nattiwat Promchit & Nai Ming Lai & Ammarin Thakkinstian & Surachat Ngorsuraches & Mukdarut Bangpan & , 2022. "Methodological approaches for assessing certainty of the evidence in umbrella reviews: A scoping review," PLOS ONE, Public Library of Science, vol. 17(6), pages 1-19, June.
    • Handle: RePEc:plo:pone00:0269009
    DOI: 10.1371/journal.pone.0269009
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0269009
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0269009&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0269009?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Konstantinos Giannakou & Evangelos Evangelou & Panayiotis Yiallouros & Costas A Christophi & Nicos Middleton & Evgenia Papatheodorou & Stefania I Papatheodorou, 2019. "Risk factors for gestational diabetes: An umbrella review of meta-analyses of observational studies," PLOS ONE, Public Library of Science, vol. 14(4), pages 1-19, April.
    2. Md Mahbub Hossain & Abida Sultana & Samia Tasnim & Qiping Fan & Ping Ma & E Lisako J McKyer & Neetu Purohit, 2020. "Prevalence of mental disorders among people who are homeless: An umbrella review," International Journal of Social Psychiatry, , vol. 66(6), pages 528-541, September.
    3. Jonathan Fan & Sonja Senthanar & Robert A. Macpherson & Kimberly Sharpe & Cheryl E. Peters & Mieke Koehoorn & Christopher B. McLeod, 2021. "An Umbrella Review of the Work and Health Impacts of Working in an Epidemic/Pandemic Environment," IJERPH, MDPI, vol. 18(13), pages 1-20, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bernard Austin Kigunda Muriithi, 2024. "Activity Performance Priorities for Adults Experiencing Homelessness: Insights from Management and Staff at a Transitional Housing Facility," IJERPH, MDPI, vol. 22(1), pages 1-14, December.
    2. Mariela Loreto Lara-Cabrera & Moisés Betancort & C. Amparo Muñoz-Rubilar & Natalia Rodríguez Novo & Carlos De las Cuevas, 2021. "The Mediating Role of Resilience in the Relationship between Perceived Stress and Mental Health," IJERPH, MDPI, vol. 18(18), pages 1-10, September.
    3. Tobias Schiffler & Ali Kapan & Alina Gansterer & Thomas Pass & Lisa Lehner & Alejandro Gil-Salmeron & Daragh T. McDermott & Igor Grabovac, 2023. "Characteristics and Effectiveness of Co-Designed Mental Health Interventions in Primary Care for People Experiencing Homelessness: A Systematic Review," IJERPH, MDPI, vol. 20(1), pages 1-14, January.
    4. Carrie Anne Marshall & Abrial Cooke & Julia Holmes & Jordana Bengall & Suliman Aryobi & Brooke Phillips & Rosemary Lysaght & Rebecca Gewurtz, 2024. "“It’s like your days are empty and yet there’s life all around”: A mixed methods, multi-site study exploring boredom during and following homelessness," PLOS ONE, Public Library of Science, vol. 19(5), pages 1-25, May.
    5. Susan J. Gordon & Nicky Baker & Tania S. Marin & Margie Steffens, 2024. "Health Status of People Who Are and Are Not Experiencing Homelessness: Opportunities for Improvement," IJERPH, MDPI, vol. 21(10), pages 1-12, October.
    6. Naina J Ahuja & Allison Nguyen & Sandra J Winter & Mark Freeman & Robert Shi & Patricia Rodriguez Espinosa & Catherine A Heaney, 2020. "Well-Being without a Roof: Examining Well-Being among Unhoused Individuals Using Mixed Methods and Propensity Score Matching," IJERPH, MDPI, vol. 17(19), pages 1-13, October.
    7. Anna Nyberg & Kristiina Rajaleid & Ingrid Demmelmaier, 2022. "The Work Environment during Coronavirus Epidemics and Pandemics: A Systematic Review of Studies Using Quantitative, Qualitative, and Mixed-Methods Designs," IJERPH, MDPI, vol. 19(11), pages 1-48, June.
    8. Kiran M. Sarma & Sarah L. Carthy & Katie M. Cox, 2022. "PROTOCOL: Mental disorder, psychological problems and terrorist behaviour: A systematic review," Campbell Systematic Reviews, John Wiley & Sons, vol. 18(2), June.
    9. Susan J. Gordon & Nicky Baker & Tania S. Marin & Margie Steffens, 2025. "Health Deficits Among People Experiencing Homelessness in an Australian Capital City: An Observational Study," IJERPH, MDPI, vol. 22(2), pages 1-16, January.
    10. Kiran M. Sarma & Sarah L. Carthy & Katie M. Cox, 2022. "Mental disorder, psychological problems and terrorist behaviour: A systematic review and meta‐analysis," Campbell Systematic Reviews, John Wiley & Sons, vol. 18(3), September.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0269009. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.