IDEAS home Printed from https://ideas.repec.org/a/eee/cysrev/v81y2017icp29-39.html
   My bibliography  Save this article

The decline effect in evaluations of the impact of the Strengthening Families Program for Youth 10-14 (SFP 10-14) on adolescent substance use

Author

Listed:
  • Gorman, Dennis M.

Abstract

The decline effect refers to the situation whereby an initially positive set of research findings concerning a phenomenon fail to be replicated in subsequent studies. One explanation for the occurrence of the decline effect is that the initial positive results reported in publications from a single research team are the product of the use of flexible data analysis practices and selective reporting. The present paper reviews evaluations of the Strengthening Families Program for Youth 10-14 (SFP 10-14) conducted by the research group who developed the program and five independent replication studies. The focus is on the effects reported for adolescent substance use. It is argued that the isolated statistically significant results reported in the original studies were produced through the use of flexible data analysis practices such as changing outcome variables across publications and post hoc alterations in study design. In light of this, it is unsurprising that the five independent evaluations have failed to replicate these results. A strength of three of the independent evaluations is that they were registered in a clinical trials registry and had published their study protocols. Both of these procedures limit the opportunity to conduct flexible data analysis. It is recommended that future evaluations of the SFP 10-14 should employ these procedures as well as utilizing the registered reports publication process, making their data and methods openly available to other researchers, and including a skeptic in their research team.

Suggested Citation

  • Gorman, Dennis M., 2017. "The decline effect in evaluations of the impact of the Strengthening Families Program for Youth 10-14 (SFP 10-14) on adolescent substance use," Children and Youth Services Review, Elsevier, vol. 81(C), pages 29-39.
    • Handle: RePEc:eee:cysrev:v:81:y:2017:i:c:p:29-39
    DOI: 10.1016/j.childyouth.2017.07.009
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0190740917302761
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.childyouth.2017.07.009?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Spoth, R. & Guyll, M. & Shin, C., 2009. "Universal intervention as a protective shield against exposure to substance use: Long-term outcomes and public health significance," American Journal of Public Health, American Public Health Association, vol. 99(11), pages 2026-2033.
    2. Spoth, R. & Trudeau, L. & Shin, C. & Ralston, E. & Redmond, C. & Greenberg, M. & Feinberg, M., 2013. "Longitudinal effects of universal preventive intervention on prescription drug misuse: Three randomized controlled trials with late adolescents and young adults," American Journal of Public Health, American Public Health Association, vol. 103(4), pages 665-672.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Julia H. Littell & Therese D. Pigott & Karianne H. Nilsen & Stacy J. Green & Olga L. K. Montgomery, 2021. "Multisystemic Therapy® for social, emotional, and behavioural problems in youth age 10 to 17: An updated systematic review and meta‐analysis," Campbell Systematic Reviews, John Wiley & Sons, vol. 17(4), December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Huang, Chien-Chung & Chen, Yafan & Greene, Loren & Cheung, Shannon & Wei, Yuhan, 2019. "Resilience and emotional and behavioral problems of adolescents in China: Effects of a short-term and intensive mindfulness and life skills training," Children and Youth Services Review, Elsevier, vol. 100(C), pages 291-297.
    2. Katherine Dowling & Margaret M. Barry, 2020. "Evaluating the Implementation Quality of a Social and Emotional Learning Program: A Mixed Methods Approach," IJERPH, MDPI, vol. 17(9), pages 1-17, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:cysrev:v:81:y:2017:i:c:p:29-39. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/childyouth .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.