IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v79y2020ics0149718919302605.html

A scoping review of knowledge syntheses in the field of evaluation across four decades of practice

Author

Listed:
  • Lawarée, Justin
  • Jacob, Steve
  • Ouimet, Mathieu

Abstract

This scoping review of 62 knowledge syntheses published in evaluation-focused journals between 1979 and May 2018 provides a portrait of synthesis practices and their evolution in the mainstream of the field of evaluation. Concerns surrounding the production of knowledge syntheses to answer policy questions are not new in the field of evaluation. However, during this last decade, knowledge synthesis methods have expanded as a means to go beyond the limits and constraints of singular evaluations. This scoping review reveals and discusses two key issues with regards to the expansion of knowledge synthesis practices within the field of evaluation: the diversity—and muddling— of methodological practices and synthesis designs, and the frequent omission of quality appraisals.

Suggested Citation

  • Lawarée, Justin & Jacob, Steve & Ouimet, Mathieu, 2020. "A scoping review of knowledge syntheses in the field of evaluation across four decades of practice," Evaluation and Program Planning, Elsevier, vol. 79(C).
    • Handle: RePEc:eee:epplan:v:79:y:2020:i:c:s0149718919302605
    DOI: 10.1016/j.evalprogplan.2019.101761
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718919302605
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.evalprogplan.2019.101761?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Bram Klievink & Bart-Jan Romijn & Scott Cunningham & Hans Bruijn, 2017. "Big data in the public sector: Uncertainties and readiness," Information Systems Frontiers, Springer, vol. 19(2), pages 267-283, April.
    2. Daigneault, Pierre-Marc, 2014. "Taking stock of four decades of quantitative research on stakeholder participation and evaluation use: A systematic map," Evaluation and Program Planning, Elsevier, vol. 45(C), pages 171-181.
    3. Diane Paulsell & Jaime Thomas & Shannon Monahan & Neil S. Seftor, "undated". "A Trusted Source of Information: How Systematic Reviews Can Support User Decisions About Adopting Evidence-Based Programs," Mathematica Policy Research Reports d637ad38ce7649ae84a7ddf06, Mathematica Policy Research.
    4. David Moher & Alessandro Liberati & Jennifer Tetzlaff & Douglas G Altman & The PRISMA Group, 2009. "Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement," PLOS Medicine, Public Library of Science, vol. 6(7), pages 1-6, July.
    5. Tilbury, Clare & Ramsay, Sylvia, 2018. "A systematic scoping review of parental satisfaction with child protection services," Evaluation and Program Planning, Elsevier, vol. 66(C), pages 141-146.
    6. Lorthios-Guilledroit, Agathe & Richard, Lucie & Filiatrault, Johanne, 2018. "Factors associated with the implementation of community-based peer-led health promotion programs: A scoping review," Evaluation and Program Planning, Elsevier, vol. 68(C), pages 19-33.
    7. Norton, Sophie & Milat, Andrew & Edwards, Barry & Giffin, Michael, 2016. "Narrative review of strategies by organizations for building evaluation capacity," Evaluation and Program Planning, Elsevier, vol. 58(C), pages 1-19.
    8. Stolp, Sean & Bottorff, Joan L. & Seaton, Cherisse L. & Jones-Bricker, Margaret & Oliffe, John L. & Johnson, Steven T. & Errey, Sally & Medhurst, Kerensa & Lamont, Sonia, 2017. "Measurement and evaluation practices of factors that contribute to effective health promotion collaboration functioning: A scoping review," Evaluation and Program Planning, Elsevier, vol. 61(C), pages 38-44.
    9. M. Heyvaert & B. Maes & P. Onghena, 2013. "Mixed methods research synthesis: definition, framework, and potential," Quality & Quantity: International Journal of Methodology, Springer, vol. 47(2), pages 659-676, February.
    10. Bram Klievink & Bart-Jan Romijn & Scott Cunningham & Hans Bruijn, 0. "Big data in the public sector: Uncertainties and readiness," Information Systems Frontiers, Springer, vol. 0, pages 1-17.
    11. Alessandro Liberati & Douglas G Altman & Jennifer Tetzlaff & Cynthia Mulrow & Peter C Gøtzsche & John P A Ioannidis & Mike Clarke & P J Devereaux & Jos Kleijnen & David Moher, 2009. "The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration," PLOS Medicine, Public Library of Science, vol. 6(7), pages 1-28, July.
    12. Kate Williams & Jonathan Grant, 2018. "A comparative review of how the policy and procedures to assess research impact evolved in Australia and the UK," Research Evaluation, Oxford University Press, vol. 27(2), pages 93-105.
    13. Brian M. Belcher & Katherine E. Rasmussen & Matthew R. Kemshaw & Deborah A. Zornes, 2016. "Defining and assessing research quality in a transdisciplinary context," Research Evaluation, Oxford University Press, vol. 25(1), pages 1-17.
    14. Sarah Giest, 2017. "Big data for policymaking: fad or fasttrack?," Policy Sciences, Springer;Society of Policy Sciences, vol. 50(3), pages 367-382, September.
    15. Sivarajah, Uthayasankar & Kamal, Muhammad Mustafa & Irani, Zahir & Weerakkody, Vishanth, 2017. "Critical analysis of Big Data challenges and analytical methods," Journal of Business Research, Elsevier, vol. 70(C), pages 263-286.
    16. Donnelly, James P., 2017. "A systematic review of concept mapping dissertations," Evaluation and Program Planning, Elsevier, vol. 60(C), pages 186-193.
    17. Szijarto, Barbara & Milley, Peter & Svensson, Kate & Cousins, J. Bradley, 2018. "On the evaluation of social innovations and social enterprises: Recognizing and integrating two solitudes in the empirical knowledge base," Evaluation and Program Planning, Elsevier, vol. 66(C), pages 20-32.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Md Altab Hossin & Jie Du & Lei Mu & Isaac Owusu Asante, 2023. "Big Data-Driven Public Policy Decisions: Transformation Toward Smart Governance," SAGE Open, , vol. 13(4), pages 21582440231, December.
    2. Roel Heijlen & Joep Crompvoets & Geert Bouckaert & Maxim Chantillon, 2018. "Evolving Government Information Processes for Service Delivery: Identifying Types & Impact," Administrative Sciences, MDPI, vol. 8(2), pages 1-14, May.
    3. Keshav Singh Rawat & Sandeep Kumar Sood, 2021. "Emerging trends and global scope of big data analytics: a scientometric analysis," Quality & Quantity: International Journal of Methodology, Springer, vol. 55(4), pages 1371-1396, August.
    4. Sarah Giest & Annemarie Samuels, 2020. "‘For good measure’: data gaps in a big data world," Policy Sciences, Springer;Society of Policy Sciences, vol. 53(3), pages 559-569, September.
    5. Elizabeth T Cafiero-Fonseca & Andrew Stawasz & Sydney T Johnson & Reiko Sato & David E Bloom, 2017. "The full benefits of adult pneumococcal vaccination: A systematic review," PLOS ONE, Public Library of Science, vol. 12(10), pages 1-23, October.
    6. Cocco, Edoardo & Hashimoto, Yuji Z. & Chopin, Julien, 2025. "Child sexual abuse in the catholic church: A scoping review of characteristics, prevalence, and explanatory factors," Journal of Criminal Justice, Elsevier, vol. 101(C).
    7. Su Keng Tan & Wai Keung Leung & Alexander Tin Hong Tang & Roger A Zwahlen, 2017. "Effects of mandibular setback with or without maxillary advancement osteotomies on pharyngeal airways: An overview of systematic reviews," PLOS ONE, Public Library of Science, vol. 12(10), pages 1-20, October.
    8. Alessandro Concari & Gerjo Kok & Pim Martens, 2020. "A Systematic Literature Review of Concepts and Factors Related to Pro-Environmental Consumer Behaviour in Relation to Waste Management Through an Interdisciplinary Approach," Sustainability, MDPI, vol. 12(11), pages 1-50, May.
    9. Jacob Elnaggar & Fern Tsien & Lucio Miele & Chindo Hicks & Clayton Yates & Melisa Davis, 2019. "An Integrative Genomics Approach for Associating Genetic Susceptibility with the Tumor Immune Microenvironment in Triple Negative Breast Cancer," Biomedical Journal of Scientific & Technical Research, Biomedical Research Network+, LLC, vol. 15(1), pages 1-12, February.
    10. Arjun K Reddy & Jared T Scott & Grayson R Norris & Chip Moore & Jake X Checketts & Griffin K Hughes & Travis Small & Mark M Calder & Brent L Norris, 2023. "Cemented vs Uncemented hemiarthroplasties for femoral neck fractures: An overlapping systematic review and evidence appraisal," PLOS ONE, Public Library of Science, vol. 18(2), pages 1-18, February.
    11. repec:plo:pone00:0083907 is not listed on IDEAS
    12. K. Thoonen & L. van Osch & H. de Vries & S. Jongen & F. Schneider, 2020. "Are Environmental Interventions Targeting Skin Cancer Prevention among Children and Adolescents Effective? A Systematic Review," IJERPH, MDPI, vol. 17(2), pages 1-29, January.
    13. Anke Joubert & Matthias Murawski & Markus Bick, 2023. "Measuring the Big Data Readiness of Developing Countries – Index Development and its Application to Africa," Information Systems Frontiers, Springer, vol. 25(1), pages 327-350, February.
    14. Hyun Kim & Navneet Kaur Baidwan & David Kriebel & Manuel Cifuentes & Sherry Baron, 2018. "Asthma among World Trade Center First Responders: A Qualitative Synthesis and Bias Assessment," IJERPH, MDPI, vol. 15(6), pages 1-14, May.
    15. Kun-ming Tao & Xiao-qian Li & Qing-hui Zhou & David Moher & Chang-quan Ling & Wei-feng Yu, 2011. "From QUOROM to PRISMA: A Survey of High-Impact Medical Journals' Instructions to Authors and a Review of Systematic Reviews in Anesthesia Literature," PLOS ONE, Public Library of Science, vol. 6(11), pages 1-5, November.
    16. Anqi Zhang & Jinsong Wang & Xiaojuan Wan & Ziyi Zhang & Shuhan Zhao & Zihe Guo & Chufan Wang, 2022. "A Meta-Analysis of the Effectiveness of Telemedicine in Glycemic Management among Patients with Type 2 Diabetes in Primary Care," IJERPH, MDPI, vol. 19(7), pages 1-25, March.
    17. Melissa J Benton & Andrea M Hutchins & J Jay Dawes, 2020. "Effect of menstrual cycle on resting metabolism: A systematic review and meta-analysis," PLOS ONE, Public Library of Science, vol. 15(7), pages 1-21, July.
    18. Christian Dierks & Tabea Hagedorn & Alessio Campitelli & Winfried Bulach & Vanessa Zeller, 2021. "Are LCA Studies on Bulk Mineral Waste Management Suitable for Decision Support? A Critical Review," Sustainability, MDPI, vol. 13(9), pages 1-27, April.
    19. Miozza, Mario & Lombardo, Salvatore M. & Galvagno, Marco & Magni, Luca, 2026. "Bridging the digital divide in the pharmaceutical industry: A future research agenda," Social Science & Medicine, Elsevier, vol. 389(C).
    20. Catharine Falch & Gilberto Alves, 2021. "Pharmacists’ Role in Older Adults’ Medication Regimen Complexity: A Systematic Review," IJERPH, MDPI, vol. 18(16), pages 1-17, August.
    21. Giuseppe La Torre & Remigio Bova & Rosario Andrea Cocchiara & Cristina Sestili & Anna Tagliaferri & Simona Maggiacomo & Camilla Foschi & William Zomparelli & Maria Vittoria Manai & David Shaholli & Va, 2023. "What Are the Determinants of the Quality of Systematic Reviews in the International Journals of Occupational Medicine? A Methodological Study Review of Published Literature," IJERPH, MDPI, vol. 20(2), pages 1-12, January.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:79:y:2020:i:c:s0149718919302605. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.