IDEAS home Printed from https://ideas.repec.org/a/wly/camsys/v18y2022i2ne1230.html
   My bibliography  Save this article

PRISMA2020: An R package and Shiny app for producing PRISMA 2020‐compliant flow diagrams, with interactivity for optimised digital transparency and Open Synthesis

Author

Listed:
  • Neal R. Haddaway
  • Matthew J. Page
  • Chris C. Pritchard
  • Luke A. McGuinness

Abstract

Background Reporting standards, such as PRISMA aim to ensure that the methods and results of systematic reviews are described in sufficient detail to allow full transparency. Flow diagrams in evidence syntheses allow the reader to rapidly understand the core procedures used in a review and examine the attrition of irrelevant records throughout the review process. Recent research suggests that use of flow diagrams in systematic reviews is poor and of low quality and called for standardised templates to facilitate better reporting in flow diagrams. The increasing options for interactivity provided by the Internet gives us an opportunity to support easy‐to‐use evidence synthesis tools, and here we report on the development of a tool for the production of PRISMA 2020‐compliant systematic review flow diagrams. Methods and Findings We developed a free‐to‐use, Open Source R package and web‐based Shiny app to allow users to design PRISMA flow diagrams for their own systematic reviews. Our tool allows users to produce standardised visualisations that transparently document the methods and results of a systematic review process in a variety of formats. In addition, we provide the opportunity to produce interactive, web‐based flow diagrams (exported as HTML files), that allow readers to click on boxes of the diagram and navigate to further details on methods, results or data files. We provide an interactive example here; https://prisma-flowdiagram.github.io/. Conclusions We have developed a user‐friendly tool for producing PRISMA 2020‐compliant flow diagrams for users with coding experience and, importantly, for users without prior experience in coding by making use of Shiny (https://estech.shinyapps.io/prisma_flowdiagram/). This free‐to‐use tool will make it easier to produce clear and PRISMA 2020‐compliant systematic review flow diagrams. Significantly, users can also produce interactive flow diagrams for the first time, allowing readers of their reviews to smoothly and swiftly explore and navigate to further details of the methods and results of a review. We believe this tool will increase use of PRISMA flow diagrams, improve the compliance and quality of flow diagrams, and facilitate strong science communication of the methods and results of systematic reviews by making use of interactivity. We encourage the systematic review community to make use of the tool, and provide feedback to streamline and improve their usability and efficiency.

Suggested Citation

  • Neal R. Haddaway & Matthew J. Page & Chris C. Pritchard & Luke A. McGuinness, 2022. "PRISMA2020: An R package and Shiny app for producing PRISMA 2020‐compliant flow diagrams, with interactivity for optimised digital transparency and Open Synthesis," Campbell Systematic Reviews, John Wiley & Sons, vol. 18(2), June.
  • Handle: RePEc:wly:camsys:v:18:y:2022:i:2:n:e1230
    DOI: 10.1002/cl2.1230
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/cl2.1230
    Download Restriction: no

    File URL: https://libkey.io/10.1002/cl2.1230?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Matthew J Page & Larissa Shamseer & Douglas G Altman & Jennifer Tetzlaff & Margaret Sampson & Andrea C Tricco & Ferrán Catalá-López & Lun Li & Emma K Reid & Rafael Sarkis-Onofre & David Moher, 2016. "Epidemiology and Reporting Characteristics of Systematic Reviews of Biomedical Research: A Cross-Sectional Study," PLOS Medicine, Public Library of Science, vol. 13(5), pages 1-30, May.
    2. Hai Vu-Ngoc & Sameh Samir Elawady & Ghaleb Muhammad Mehyar & Amr Hesham Abdelhamid & Omar Mohamed Mattar & Oday Halhouli & Nguyen Lam Vuong & Citra Dewi Mohd Ali & Ummu Helma Hassan & Nguyen Dang Kien, 2018. "Quality of flow diagram in systematic review and/or meta-analysis," PLOS ONE, Public Library of Science, vol. 13(6), pages 1-16, June.
    3. David Moher & Jennifer Tetzlaff & Andrea C Tricco & Margaret Sampson & Douglas G Altman, 2007. "Epidemiology and Reporting Characteristics of Systematic Reviews," PLOS Medicine, Public Library of Science, vol. 4(3), pages 1-9, March.
    4. David Moher & Alessandro Liberati & Jennifer Tetzlaff & Douglas G Altman & The PRISMA Group, 2009. "Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement," PLOS Medicine, Public Library of Science, vol. 6(7), pages 1-6, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Matías Barceló & Cristian A. Vargas & Stefan Gelcich, 2023. "Land–Sea Interactions and Ecosystem Services: Research Gaps and Future Challenges," Sustainability, MDPI, vol. 15(10), pages 1-16, May.
    2. Joaquín Martínez-Falcó & Javier Martínez-Falcó & Bartolomé Marco-Lajara & Eduardo Sánchez-García & Gustav Visser, 2023. "Aligning the Sustainable Development Goals in the Wine Industry: A Bibliometric Analysis," Sustainability, MDPI, vol. 15(10), pages 1-15, May.
    3. Bernardine Chigozie Chidozie & Ana Luísa Ramos & José Vasconcelos Ferreira & Luís Pinto Ferreira, 2023. "Residual Agroforestry Biomass Supply Chain Simulation Insights and Directions: A Systematic Literature Review," Sustainability, MDPI, vol. 15(13), pages 1-16, June.
    4. Stabak Roy & Saptarshi Mitra, 2023. "Enhancing Bilateral Relations and Regional Cooperation: Analysing the Feasibility and Implications of India–Myanmar Railway Connectivity," South Asian Survey, , vol. 30(1), pages 72-98, March.
    5. Mohd Afjal, 2023. "Bridging the financial divide: a bibliometric analysis on the role of digital financial services within FinTech in enhancing financial inclusion and economic development," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-27, December.
    6. Ivetheyamel Morales & Jordi Segalás & Torsten Masseck, 2023. "Urban Living Labs: A Higher Education Approach to Teaching and Learning about Sustainable Development," Sustainability, MDPI, vol. 15(20), pages 1-20, October.
    7. Ifeoma Chukwunonso Onyemelukwe & José Antonio Vasconcelos Ferreira & Ana Luísa Ramos, 2023. "Human Energy Management in Industry: A Systematic Review of Organizational Strategies to Reinforce Workforce Energy," Sustainability, MDPI, vol. 15(17), pages 1-23, September.
    8. Roberto Fragomeli & Azzurra Annunziata & Gennaro Punzo, 2024. "Promoting the Transition towards Agriculture 4.0: A Systematic Literature Review on Drivers and Barriers," Sustainability, MDPI, vol. 16(6), pages 1-29, March.
    9. Timo Neunaber & Sven Meister, 2023. "Digital Maturity and Its Measurement of General Practitioners: A Scoping Review," IJERPH, MDPI, vol. 20(5), pages 1-18, February.
    10. Chayada Kanokphanvanich & Wanchai Rattanawong & Varin Vongmanee, 2023. "A New Model for a Sustainable Healthcare Supply Chain Prioritizes Patient Safety: Using the Fuzzy Delphi Method to Identify Healthcare Workers’ Perspectives," Sustainability, MDPI, vol. 15(9), pages 1-23, April.
    11. Denisa Andreea Bacalu & Cecilia Lazea & Simona Mirel & Ovidiu-Petru Stan & Lucia Maria Lotrean, 2024. "Breastfeeding in the First Year of Life: The Situation in Romania in the European Context," Sustainability, MDPI, vol. 16(2), pages 1-25, January.
    12. Iwona Gorzeń-Mitka & Monika Wieczorek-Kosmala, 2023. "Mapping the Energy Sector from a Risk Management Research Perspective: A Bibliometric and Scientific Approach," Energies, MDPI, vol. 16(4), pages 1-32, February.
    13. Michael Emru Tadesse & Susanne Elsen, 2023. "The Social Solidarity Economy and the Hull-House Tradition of Social Work: Keys for Unlocking the Potential of Social Work for Sustainable Social Development," Social Sciences, MDPI, vol. 12(3), pages 1-24, March.
    14. Okkie Putriani & Sigit Priyanto & Imam Muthohar & Mukhammad Rizka Fahmi Amrozi, 2022. "Millimetre Wave and Sub-6 5G Readiness of Mobile Network Big Data for Public Transport Planning," Sustainability, MDPI, vol. 15(1), pages 1-19, December.
    15. Albérico Travassos Rosário & Paula Lopes & Filipe Sales Rosário, 2024. "Sustainability and the Circular Economy Business Development," Sustainability, MDPI, vol. 16(14), pages 1-24, July.
    16. Nansy Kouroupi & Theodore Metaxas, 2023. "Can the Metaverse and Its Associated Digital Tools and Technologies Provide an Opportunity for Destinations to Address the Vulnerability of Overtourism?," Tourism and Hospitality, MDPI, vol. 4(2), pages 1-19, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Matthew J Page & Joanne E McKenzie & Patrick M Bossuyt & Isabelle Boutron & Tammy C Hoffmann & Cynthia D Mulrow & Larissa Shamseer & Jennifer M Tetzlaff & Elie A Akl & Sue E Brennan & Roger Chou & Jul, 2021. "The PRISMA 2020 statement: An updated guideline for reporting systematic reviews," PLOS Medicine, Public Library of Science, vol. 18(3), pages 1-15, March.
    2. Xiaoqin Wang & Vivian Welch & Meixuan Li & Liang Yao & Julia Littell & Huijuan Li & Nan Yang & Jianjian Wang & Larissa Shamseer & Yaolong Chen & Kehu Yang & Jeremy M. Grimshaw, 2021. "The methodological and reporting characteristics of Campbell reviews: A systematic review," Campbell Systematic Reviews, John Wiley & Sons, vol. 17(1), March.
    3. Giuseppe La Torre & Remigio Bova & Rosario Andrea Cocchiara & Cristina Sestili & Anna Tagliaferri & Simona Maggiacomo & Camilla Foschi & William Zomparelli & Maria Vittoria Manai & David Shaholli & Va, 2023. "What Are the Determinants of the Quality of Systematic Reviews in the International Journals of Occupational Medicine? A Methodological Study Review of Published Literature," IJERPH, MDPI, vol. 20(2), pages 1-12, January.
    4. Nikolaos Pandis & Padhraig S Fleming & Helen Worthington & Kerry Dwan & Georgia Salanti, 2015. "Discrepancies in Outcome Reporting Exist Between Protocols and Published Oral Health Cochrane Systematic Reviews," PLOS ONE, Public Library of Science, vol. 10(9), pages 1-10, September.
    5. João Carlos Belloti & Aldo Okamura & Jordana Scheeren & Flávio Faloppa & Vinícius Ynoe de Moraes, 2019. "A systematic review of the quality of distal radius systematic reviews: Methodology and reporting assessment," PLOS ONE, Public Library of Science, vol. 14(1), pages 1-12, January.
    6. Diego A Forero & Sandra Lopez-Leon & Yeimy González-Giraldo & Pantelis G Bagos, 2019. "Ten simple rules for carrying out and writing meta-analyses," PLOS Computational Biology, Public Library of Science, vol. 15(5), pages 1-7, May.
    7. Nargiz Travis & Marie Knoll & Christopher J. Cadham & Steven Cook & Kenneth E. Warner & Nancy L. Fleischer & Clifford E. Douglas & Luz María Sánchez-Romero & Ritesh Mistry & Rafael Meza & Jana L. Hirs, 2022. "Health Effects of Electronic Cigarettes: An Umbrella Review and Methodological Considerations," IJERPH, MDPI, vol. 19(15), pages 1-23, July.
    8. Yali Liu & Rui Zhang & Jiao Huang & Xu Zhao & Danlu Liu & Wanting Sun & Yuefen Mai & Peng Zhang & Yajun Wang & Hua Cao & Ke hu Yang, 2014. "Reporting Quality of Systematic Reviews/Meta-Analyses of Acupuncture," PLOS ONE, Public Library of Science, vol. 9(11), pages 1-7, November.
    9. Esther Maassen & Marcel A L M van Assen & Michèle B Nuijten & Anton Olsson-Collentine & Jelte M Wicherts, 2020. "Reproducibility of individual effect sizes in meta-analyses in psychology," PLOS ONE, Public Library of Science, vol. 15(5), pages 1-18, May.
    10. Lucy Turner & James Galipeau & Chantelle Garritty & Eric Manheimer & L Susan Wieland & Fatemeh Yazdi & David Moher, 2013. "An Evaluation of Epidemiological and Reporting Characteristics of Complementary and Alternative Medicine (CAM) Systematic Reviews (SRs)," PLOS ONE, Public Library of Science, vol. 8(1), pages 1-11, January.
    11. Tina Ljungberg & Emma Bondza & Connie Lethin, 2020. "Evidence of the Importance of Dietary Habits Regarding Depressive Symptoms and Depression," IJERPH, MDPI, vol. 17(5), pages 1-18, March.
    12. Laura Sheble, 2017. "Macro‐level diffusion of a methodological knowledge innovation: Research synthesis methods, 1972–2011," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(12), pages 2693-2708, December.
    13. Clemens Blümel & Alexander Schniedermann, 2020. "Studying review articles in scientometrics and beyond: a research agenda," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 711-728, July.
    14. Jeroen P M Peters & Lotty Hooft & Wilko Grolman & Inge Stegeman, 2015. "Reporting Quality of Systematic Reviews and Meta-Analyses of Otorhinolaryngologic Articles Based on the PRISMA Statement," PLOS ONE, Public Library of Science, vol. 10(8), pages 1-11, August.
    15. Alexander Schniedermann, 2021. "A comparison of systematic reviews and guideline-based systematic reviews in medical studies," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(12), pages 9829-9846, December.
    16. Abeer Elshater & Hisham Abusaada, 2022. "Developing Process for Selecting Research Techniques in Urban Planning and Urban Design with a PRISMA-Compliant Review," Social Sciences, MDPI, vol. 11(10), pages 1-17, October.
    17. Vincenzo Sforza & Riccardo Cimini & Alessandro Mechelli & Taryn Vian, 2021. "A Review of the Literature on Corruption in Healthcare Organizations," International Journal of Business and Management, Canadian Center of Science and Education, vol. 15(4), pages 1-98, July.
    18. Christina-Ioanna Papadopoulou & Efstratios Loizou & Fotios Chatzitheodoridis, 2022. "Priorities in Bioeconomy Strategies: A Systematic Literature Review," Energies, MDPI, vol. 15(19), pages 1-15, October.
    19. Sarfraz Aslam & Atif Saleem & Teresa J. Kennedy & Tribhuwan Kumar & Khalida Parveen & Huma Akram & BaoHui Zhang, 2022. "Identifying the Research and Trends in STEM Education in Pakistan: A Systematic Literature Review," SAGE Open, , vol. 12(3), pages 21582440221, August.
    20. Ivor Popovich & Bethany Windsor & Vanessa Jordan & Marian Showell & Bev Shea & Cynthia M Farquhar, 2012. "Methodological Quality of Systematic Reviews in Subfertility: A Comparison of Two Different Approaches," PLOS ONE, Public Library of Science, vol. 7(12), pages 1-9, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:camsys:v:18:y:2022:i:2:n:e1230. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1111/(ISSN)1891-1803 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.