IDEAS home Printed from https://ideas.repec.org/a/eee/cysrev/v137y2022ics0190740922001050.html

“What works” registries of interventions to improve child and youth psychosocial outcomes: A critical appraisal

Author

Listed:
  • Axford, Nick
  • Morpeth, Louise
  • Bjornstad, Gretchen
  • Hobbs, Tim
  • Berry, Vashti

Abstract

The last decade or more has seen a proliferation of online registries of evidence-based interventions designed to improve child and youth psychosocial outcomes. The purpose of these resources is typically to help decision-makers make sense of the evidence and thereby inform their decision-making about investment in interventions. Most registries are underpinned by standards of evidence, which are used to guide the rating of programs by a panel of experts. While supporters extol the influence of these initiatives in terms of making commissioners more discriminating about what they invest in, detractors contend that they stifle innovation and embody an unduly narrow view of evidence and intervention. Drawing on the literature, original analysis and first-hand experience of developing, applying and using standards of evidence and associated registries, this article reflects critically on their strengths and limitations, considering issues such as focus, functionality, content, consistency and impact. It also makes proposals for developing and extending the approach, focusing on its intrinsic conceptualization of intervention development, evaluation practice and pathways to impact.

Suggested Citation

  • Axford, Nick & Morpeth, Louise & Bjornstad, Gretchen & Hobbs, Tim & Berry, Vashti, 2022. "“What works” registries of interventions to improve child and youth psychosocial outcomes: A critical appraisal," Children and Youth Services Review, Elsevier, vol. 137(C).
    • Handle: RePEc:eee:cysrev:v:137:y:2022:i:c:s0190740922001050
    DOI: 10.1016/j.childyouth.2022.106469
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0190740922001050
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.childyouth.2022.106469?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Cameron Brick & Alexandra L. J. Freeman & Steven Wooding & William J. Skylark & Theresa M. Marteau & David J. Spiegelhalter, 2018. "Winners and losers: communicating the potential impacts of policies," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 4(1), pages 1-13, December.
    2. Zack, Melissa K. & Karre, Jennifer K. & Olson, Jonathan & Perkins, Daniel F., 2019. "Similarities and differences in program registers: A case study," Evaluation and Program Planning, Elsevier, vol. 76(C), pages 1-1.
    3. Kathryn Oliver & Annette Boaz, 2019. "Transforming evidence for policy and practice: creating space for new conversations," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 5(1), pages 1-10, December.
    4. Per Nilsen, 2020. "Overview of theories, models and frameworks in implementation science," Chapters, in: Per Nilsen & Sarah A. Birken (ed.), Handbook on Implementation Science, chapter 1, pages 8-31, Edward Elgar Publishing.
    5. Mairead Furlong & Sinead McGilloway & Tracey Bywater & Judy Hutchings & Susan M. Smith & Michael Donnelly, 2012. "Behavioural and cognitive‐behavioural group‐based parenting programmes for early‐onset conduct problems in children aged 3 to 12 years," Campbell Systematic Reviews, John Wiley & Sons, vol. 8(1), pages 1-239.
    6. Mihalic, Sharon F. & Elliott, Delbert S., 2015. "Evidence-based programs registry: Blueprints for Healthy Youth Development," Evaluation and Program Planning, Elsevier, vol. 48(C), pages 124-131.
    7. Means, Stephanie N. & Magura, Stephen & Burkhardt, Jason T. & Schröter, Daniela C. & Coryn, Chris L.S., 2015. "Comparing rating paradigms for evidence-based program registers in behavioral health: Evidentiary criteria and implications for assessing programs," Evaluation and Program Planning, Elsevier, vol. 48(C), pages 100-116.
    8. Virginia Knox & Carolyn J. Hill & Gordon Berlin, 2018. "Can Evidence-Based Policy Ameliorate the Nation’s Social Problems?," The ANNALS of the American Academy of Political and Social Science, , vol. 678(1), pages 166-179, July.
    9. Burkhardt, Jason T. & Schröter, Daniela C. & Magura, Stephen & Means, Stephanie N. & Coryn, Chris L.S., 2015. "An overview of evidence-based program registers (EBPRs) for behavioral health," Evaluation and Program Planning, Elsevier, vol. 48(C), pages 92-99.
    10. Maranda, Michael J. & Magura, Stephen & Gugerty, Ryan & Lee, Miranda J. & Landsverk, John A. & Rolls-Reutz, Jennifer & Green, Brandn, 2021. "State behavioral health agency website references to evidence-based program registers," Evaluation and Program Planning, Elsevier, vol. 85(C).
    11. Kreuter, M.W. & Bernhardt, J.M., 2009. "Reframing the dissemination challenge: A marketing and distribution perspective," American Journal of Public Health, American Public Health Association, vol. 99(12), pages 2123-2127.
    12. Pamela R. Buckley & Abigail A. Fagan & Fred C. Pampel & Karl G. Hill, 2020. "Making Evidence-Based Interventions Relevant for Users: A Comparison of Requirements for Dissemination Readiness Across Program Registries," Evaluation Review, , vol. 44(1), pages 51-83, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Julia H. Littell, 2024. "The Logic of Generalization From Systematic Reviews and Meta-Analyses of Impact Evaluations," Evaluation Review, , vol. 48(3), pages 427-460, June.
    2. Samra Maqbool & Hafiz Muhammad Ihsan Zafeer & Pingfei Zeng & Sufyan Maqbool & Zineb Draissi & Saima Javed, 2024. "Inventive leadership styles and their impact for achieving sustainable development goals in education at secondary schools: a case study from Multan, Pakistan," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 11(1), pages 1-11, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Magura, Stephen & Lee-Easton, Miranda J. & Abu-Obaid, Ruqayyah N. & Landsverk, John & DeCamp, Whitney & Rolls-Reutz, Jennifer & Moore, Kristin & Firpo-Triplett, Regina & Buckley, Pamela R. & Stout, El, 2023. "The influence of evidence-based program registry websites for dissemination of evidence-based interventions in behavioral healthcare," Evaluation and Program Planning, Elsevier, vol. 97(C).
    2. Zack, Melissa K. & Karre, Jennifer K. & Olson, Jonathan & Perkins, Daniel F., 2019. "Similarities and differences in program registers: A case study," Evaluation and Program Planning, Elsevier, vol. 76(C), pages 1-1.
    3. Maranda, Michael J. & Magura, Stephen & Gugerty, Ryan & Lee, Miranda J. & Landsverk, John A. & Rolls-Reutz, Jennifer & Green, Brandn, 2021. "State behavioral health agency website references to evidence-based program registers," Evaluation and Program Planning, Elsevier, vol. 85(C).
    4. Iudici, Antonio & Gagliardo Corsi, Agnese, 2017. "Evaluation in the field of social services for minors: Measuring the efficacy of interventions in the Italian service for health protection and promotion," Evaluation and Program Planning, Elsevier, vol. 61(C), pages 160-168.
    5. Michael J. Maranda & Miranda J. Lee-Easton & Stephen Magura, 2022. "Variations in Definitions of Evidence-Based Interventions for Behavioral Health in Eight Selected U.S. States," Evaluation Review, , vol. 46(4), pages 363-390, August.
    6. T’Pring R. Westbrook & Sarah A. Avellar & Neil Seftor, 2017. "Reviewing the Reviews: Examining Similarities and Differences Between Federally Funded Evidence Reviews," Evaluation Review, , vol. 41(3), pages 183-211, June.
    7. Lemire, Sebastian & Freeman, Brian & Porowski, Allan, 2026. "Co-developing practice guides: A researcher-practitioner model for evidence-based practice," Evaluation and Program Planning, Elsevier, vol. 114(C).
    8. Carr, E. Summerson & Obertino-Norwood, Hannah, 2022. "Legitimizing evidence: The trans-institutional life of evidence-based practice," Social Science & Medicine, Elsevier, vol. 310(C).
    9. Henneberger, Angela K. & Mushonga, Dawnsha R., 2021. "Peer selection as a mechanism for preventing adolescent substance use: Current approaches and future directions," Children and Youth Services Review, Elsevier, vol. 120(C).
    10. Pamela R. Buckley & Abigail A. Fagan & Fred C. Pampel & Karl G. Hill, 2020. "Making Evidence-Based Interventions Relevant for Users: A Comparison of Requirements for Dissemination Readiness Across Program Registries," Evaluation Review, , vol. 44(1), pages 51-83, February.
    11. Jonathan Breckon, 2022. "Communicating and using systematic reviews—Learning from other disciplines," Campbell Systematic Reviews, John Wiley & Sons, vol. 18(4), December.
    12. Thilo Bodenstein & Achim Kemmerling, 2026. "Taking Stock of Qualitative Methods of Evaluation: A Study of Practices and Quality Criteria," Evaluation Review, , vol. 50(1), pages 89-115, February.
    13. Reynolds, J.P. & Archer, S. & Pilling, M. & Kenny, M. & Hollands, G.J. & Marteau, T.M., 2019. "Public acceptability of nudging and taxing to reduce consumption of alcohol, tobacco, and food: A population-based survey experiment," Social Science & Medicine, Elsevier, vol. 236(C), pages 1-1.
    14. Reynolds, J.P. & Pilling, M. & Marteau, T.M., 2018. "Communicating quantitative evidence of policy effectiveness and support for the policy: Three experimental studies," Social Science & Medicine, Elsevier, vol. 218(C), pages 1-12.
    15. Eric C. Brown & Pablo Montero-Zamora & Francisco Cardozo-Macías & María Fernanda Reyes-Rodríguez & John S. Briney & Juliana Mejía-Trujillo & Augusto Pérez-Gómez, 2021. "A Comparison of Cut Points for Measuring Risk Factors for Adolescent Substance Use and Antisocial Behaviors in the U.S. and Colombia," IJERPH, MDPI, vol. 18(2), pages 1-14, January.
    16. Hannah B. Love & Alyssa Stephens & Bailey K. Fosdick & Elizabeth Tofany & Ellen R. Fisher, 2022. "The impact of gender diversity on scientific research teams: a need to broaden and accelerate future research," Humanities and Social Sciences Communications, Palgrave Macmillan, vol. 9(1), pages 1-12, December.
    17. Allison Ann Payne, 2024. "The Search for Social Justice in School-Based Crime and Delinquency Prevention," The ANNALS of the American Academy of Political and Social Science, , vol. 714(1), pages 97-113, July.
    18. Bonomi Bezzo, Franco, 2021. "Universal Independence Income. A EUROMOD Utopian Simulation in the UK," EUROMOD Working Papers EM3/21, EUROMOD at the Institute for Social and Economic Research.
    19. Thomas E. Strayer & Laura E. Balis & NithyaPriya S. Ramalingam & Samantha M. Harden, 2022. "Dissemination in Extension: Health Specialists’ Information Sources and Channels for Health Promotion Programming," IJERPH, MDPI, vol. 19(24), pages 1-13, December.
    20. Furlong, Mairead & McLoughlin, Fergal & McGilloway, Sinead, 2021. "The incredible years parenting program for foster carers and biological parents of children in foster care: A mixed methods study," Children and Youth Services Review, Elsevier, vol. 126(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:cysrev:v:137:y:2022:i:c:s0190740922001050. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/childyouth .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.