IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v79y2020ics0149718919302605.html
   My bibliography  Save this article

A scoping review of knowledge syntheses in the field of evaluation across four decades of practice

Author

Listed:
  • Lawarée, Justin
  • Jacob, Steve
  • Ouimet, Mathieu

Abstract

This scoping review of 62 knowledge syntheses published in evaluation-focused journals between 1979 and May 2018 provides a portrait of synthesis practices and their evolution in the mainstream of the field of evaluation. Concerns surrounding the production of knowledge syntheses to answer policy questions are not new in the field of evaluation. However, during this last decade, knowledge synthesis methods have expanded as a means to go beyond the limits and constraints of singular evaluations. This scoping review reveals and discusses two key issues with regards to the expansion of knowledge synthesis practices within the field of evaluation: the diversity—and muddling— of methodological practices and synthesis designs, and the frequent omission of quality appraisals.

Suggested Citation

  • Lawarée, Justin & Jacob, Steve & Ouimet, Mathieu, 2020. "A scoping review of knowledge syntheses in the field of evaluation across four decades of practice," Evaluation and Program Planning, Elsevier, vol. 79(C).
    • Handle: RePEc:eee:epplan:v:79:y:2020:i:c:s0149718919302605
    DOI: 10.1016/j.evalprogplan.2019.101761
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718919302605
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.evalprogplan.2019.101761?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Tilbury, Clare & Ramsay, Sylvia, 2018. "A systematic scoping review of parental satisfaction with child protection services," Evaluation and Program Planning, Elsevier, vol. 66(C), pages 141-146.
    2. Lorthios-Guilledroit, Agathe & Richard, Lucie & Filiatrault, Johanne, 2018. "Factors associated with the implementation of community-based peer-led health promotion programs: A scoping review," Evaluation and Program Planning, Elsevier, vol. 68(C), pages 19-33.
    3. Kate Williams & Jonathan Grant, 2018. "A comparative review of how the policy and procedures to assess research impact evolved in Australia and the UK," Research Evaluation, Oxford University Press, vol. 27(2), pages 93-105.
    4. Sivarajah, Uthayasankar & Kamal, Muhammad Mustafa & Irani, Zahir & Weerakkody, Vishanth, 2017. "Critical analysis of Big Data challenges and analytical methods," Journal of Business Research, Elsevier, vol. 70(C), pages 263-286.
    5. Donnelly, James P., 2017. "A systematic review of concept mapping dissertations," Evaluation and Program Planning, Elsevier, vol. 60(C), pages 186-193.
    6. Szijarto, Barbara & Milley, Peter & Svensson, Kate & Cousins, J. Bradley, 2018. "On the evaluation of social innovations and social enterprises: Recognizing and integrating two solitudes in the empirical knowledge base," Evaluation and Program Planning, Elsevier, vol. 66(C), pages 20-32.
    7. Bram Klievink & Bart-Jan Romijn & Scott Cunningham & Hans Bruijn, 2017. "Big data in the public sector: Uncertainties and readiness," Information Systems Frontiers, Springer, vol. 19(2), pages 267-283, April.
    8. Daigneault, Pierre-Marc, 2014. "Taking stock of four decades of quantitative research on stakeholder participation and evaluation use: A systematic map," Evaluation and Program Planning, Elsevier, vol. 45(C), pages 171-181.
    9. Diane Paulsell & Jaime Thomas & Shannon Monahan & Neil S. Seftor, "undated". "A Trusted Source of Information: How Systematic Reviews Can Support User Decisions About Adopting Evidence-Based Programs," Mathematica Policy Research Reports d637ad38ce7649ae84a7ddf06, Mathematica Policy Research.
    10. Brian M. Belcher & Katherine E. Rasmussen & Matthew R. Kemshaw & Deborah A. Zornes, 2016. "Defining and assessing research quality in a transdisciplinary context," Research Evaluation, Oxford University Press, vol. 25(1), pages 1-17.
    11. Sarah Giest, 2017. "Big data for policymaking: fad or fasttrack?," Policy Sciences, Springer;Society of Policy Sciences, vol. 50(3), pages 367-382, September.
    12. Norton, Sophie & Milat, Andrew & Edwards, Barry & Giffin, Michael, 2016. "Narrative review of strategies by organizations for building evaluation capacity," Evaluation and Program Planning, Elsevier, vol. 58(C), pages 1-19.
    13. David Moher & Alessandro Liberati & Jennifer Tetzlaff & Douglas G Altman & The PRISMA Group, 2009. "Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement," PLOS Medicine, Public Library of Science, vol. 6(7), pages 1-6, July.
    14. Stolp, Sean & Bottorff, Joan L. & Seaton, Cherisse L. & Jones-Bricker, Margaret & Oliffe, John L. & Johnson, Steven T. & Errey, Sally & Medhurst, Kerensa & Lamont, Sonia, 2017. "Measurement and evaluation practices of factors that contribute to effective health promotion collaboration functioning: A scoping review," Evaluation and Program Planning, Elsevier, vol. 61(C), pages 38-44.
    15. M. Heyvaert & B. Maes & P. Onghena, 2013. "Mixed methods research synthesis: definition, framework, and potential," Quality & Quantity: International Journal of Methodology, Springer, vol. 47(2), pages 659-676, February.
    16. Bram Klievink & Bart-Jan Romijn & Scott Cunningham & Hans Bruijn, 0. "Big data in the public sector: Uncertainties and readiness," Information Systems Frontiers, Springer, vol. 0, pages 1-17.
    17. Alessandro Liberati & Douglas G Altman & Jennifer Tetzlaff & Cynthia Mulrow & Peter C Gøtzsche & John P A Ioannidis & Mike Clarke & P J Devereaux & Jos Kleijnen & David Moher, 2009. "The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration," PLOS Medicine, Public Library of Science, vol. 6(7), pages 1-28, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Md Altab Hossin & Jie Du & Lei Mu & Isaac Owusu Asante, 2023. "Big Data-Driven Public Policy Decisions: Transformation Toward Smart Governance," SAGE Open, , vol. 13(4), pages 21582440231, December.
    2. Roel Heijlen & Joep Crompvoets & Geert Bouckaert & Maxim Chantillon, 2018. "Evolving Government Information Processes for Service Delivery: Identifying Types & Impact," Administrative Sciences, MDPI, vol. 8(2), pages 1-14, May.
    3. Keshav Singh Rawat & Sandeep Kumar Sood, 2021. "Emerging trends and global scope of big data analytics: a scientometric analysis," Quality & Quantity: International Journal of Methodology, Springer, vol. 55(4), pages 1371-1396, August.
    4. Sarah Giest & Annemarie Samuels, 2020. "‘For good measure’: data gaps in a big data world," Policy Sciences, Springer;Society of Policy Sciences, vol. 53(3), pages 559-569, September.
    5. Elizabeth T Cafiero-Fonseca & Andrew Stawasz & Sydney T Johnson & Reiko Sato & David E Bloom, 2017. "The full benefits of adult pneumococcal vaccination: A systematic review," PLOS ONE, Public Library of Science, vol. 12(10), pages 1-23, October.
    6. Su Keng Tan & Wai Keung Leung & Alexander Tin Hong Tang & Roger A Zwahlen, 2017. "Effects of mandibular setback with or without maxillary advancement osteotomies on pharyngeal airways: An overview of systematic reviews," PLOS ONE, Public Library of Science, vol. 12(10), pages 1-20, October.
    7. Alessandro Concari & Gerjo Kok & Pim Martens, 2020. "A Systematic Literature Review of Concepts and Factors Related to Pro-Environmental Consumer Behaviour in Relation to Waste Management Through an Interdisciplinary Approach," Sustainability, MDPI, vol. 12(11), pages 1-50, May.
    8. Jacob Elnaggar & Fern Tsien & Lucio Miele & Chindo Hicks & Clayton Yates & Melisa Davis, 2019. "An Integrative Genomics Approach for Associating Genetic Susceptibility with the Tumor Immune Microenvironment in Triple Negative Breast Cancer," Biomedical Journal of Scientific & Technical Research, Biomedical Research Network+, LLC, vol. 15(1), pages 1-12, February.
    9. Anke Joubert & Matthias Murawski & Markus Bick, 2023. "Measuring the Big Data Readiness of Developing Countries – Index Development and its Application to Africa," Information Systems Frontiers, Springer, vol. 25(1), pages 327-350, February.
    10. Hyun Kim & Navneet Kaur Baidwan & David Kriebel & Manuel Cifuentes & Sherry Baron, 2018. "Asthma among World Trade Center First Responders: A Qualitative Synthesis and Bias Assessment," IJERPH, MDPI, vol. 15(6), pages 1-14, May.
    11. Giuseppe La Torre & Remigio Bova & Rosario Andrea Cocchiara & Cristina Sestili & Anna Tagliaferri & Simona Maggiacomo & Camilla Foschi & William Zomparelli & Maria Vittoria Manai & David Shaholli & Va, 2023. "What Are the Determinants of the Quality of Systematic Reviews in the International Journals of Occupational Medicine? A Methodological Study Review of Published Literature," IJERPH, MDPI, vol. 20(2), pages 1-12, January.
    12. Frank Peinemann & Ulrich Grouven & Nicolaus Kröger & Carmen Bartel & Max H Pittler & Stefan Lange, 2011. "First-Line Matched Related Donor Hematopoietic Stem Cell Transplantation Compared to Immunosuppressive Therapy in Acquired Severe Aplastic Anemia," PLOS ONE, Public Library of Science, vol. 6(4), pages 1-16, April.
    13. Magdalena Rusch & Josef‐Peter Schöggl & Rupert J. Baumgartner, 2023. "Application of digital technologies for sustainable product management in a circular economy: A review," Business Strategy and the Environment, Wiley Blackwell, vol. 32(3), pages 1159-1174, March.
    14. Jonathan Kingsley & Aisling Bailey & Nooshin Torabi & Pauline Zardo & Suzanne Mavoa & Tonia Gray & Danielle Tracey & Philip Pettitt & Nicholas Zajac & Emily Foenander, 2019. "A Systematic Review Protocol Investigating Community Gardening Impact Measures," IJERPH, MDPI, vol. 16(18), pages 1-12, September.
    15. Wei-Wei Chen & Feng Wang & Rui-Hua Xu, 2013. "Platinum-Based Versus Non-Platinum-Based Chemotherapy as First Line Treatment of Inoperable, Advanced Gastric Adenocarcinoma: A Meta-Analysis," PLOS ONE, Public Library of Science, vol. 8(7), pages 1-8, July.
    16. Giovanni Vinti & Valerie Bauza & Thomas Clasen & Kate Medlicott & Terry Tudor & Christian Zurbrügg & Mentore Vaccari, 2021. "Municipal Solid Waste Management and Adverse Health Outcomes: A Systematic Review," IJERPH, MDPI, vol. 18(8), pages 1-26, April.
    17. Peter M. Bednar & Christine Welch, 0. "Socio-Technical Perspectives on Smart Working: Creating Meaningful and Sustainable Systems," Information Systems Frontiers, Springer, vol. 0, pages 1-18.
    18. Hanna Górska-Warsewicz, 2022. "Consumer or Patient Determinants of Hospital Brand Equity—A Systematic Literature Review," IJERPH, MDPI, vol. 19(15), pages 1-36, July.
    19. André Ramalho & João Serrano & Rui Paulo & Pedro Duarte-Mendes & António Rosado & João Petrica, 2021. "Emerging Qualitative Research Trends (2010–2021) on Sedentary Behaviour among Older Adults: A Systematic Literature Review Protocol," IJERPH, MDPI, vol. 18(21), pages 1-8, November.
    20. S. Rajsic & H. Gothe & H. H. Borba & G. Sroczynski & J. Vujicic & T. Toell & Uwe Siebert, 2019. "Economic burden of stroke: a systematic review on post-stroke care," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 20(1), pages 107-134, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:79:y:2020:i:c:s0149718919302605. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.