IDEAS home Printed from https://ideas.repec.org/a/eee/cysrev/v33y2011i11p2273-2281.html
   My bibliography  Save this article

The context of program implementation and evaluation: A pilot study of interorganizational differences to improve child welfare reform efforts

Author

Listed:
  • Crea, Thomas M.
  • Crampton, David S.

Abstract

This article contributes to the growing literature on evaluation and implementation science by examining the interaction between staff perceptions of organizational strength with perceptions and indicators of program fidelity. As part of a pilot project related to the evaluation of the Family to Family initiative, a survey was distributed to employees within two urban child welfare agencies with a total of 410 respondents across both sites, for a combined response rate of 72.2%. Survey results were analyzed both in terms or respondents' perception of their agency as well as in relation to measures of program performance and workload. Multivariate models show that organizational indicators are the most significant and positive predictors of perceived program implementation. Specifically, staff who positively perceived the availability of information within their agency also believed that the programs were well implemented in their agency. These findings suggest that as the value of program changes are articulated within an organization, the implementation of the initiative is perceived to improve.

Suggested Citation

  • Crea, Thomas M. & Crampton, David S., 2011. "The context of program implementation and evaluation: A pilot study of interorganizational differences to improve child welfare reform efforts," Children and Youth Services Review, Elsevier, vol. 33(11), pages 2273-2281.
    • Handle: RePEc:eee:cysrev:v:33:y:2011:i:11:p:2273-2281
    DOI: 10.1016/j.childyouth.2011.07.012
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0190740911002726
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.childyouth.2011.07.012?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Rauktis, Mary E. & McCarthy, Sharon & Krackhardt, David & Cahalane, Helen, 2010. "Innovation in child welfare: The adoption and implementation of Family Group Decision Making in Pennsylvania," Children and Youth Services Review, Elsevier, vol. 32(5), pages 732-739, May.
    2. Rego, Miguel Ángel Santos & Otero, Agustín Godás & Moledo, M del Mar Lorenzo, 2009. "Evaluation of the implementation of a socio-educational program with immigrant families: A case study," Evaluation and Program Planning, Elsevier, vol. 32(1), pages 21-30, February.
    3. Crea, Thomas M. & Crampton, David S. & Abramson-Madden, Anne & Usher, Charles L., 2008. "Variability in the implementation of Team Decisionmaking (TDM): Scope and compliance with the Family to Family practice model," Children and Youth Services Review, Elsevier, vol. 30(11), pages 1221-1232, November.
    4. Kalafat, John & Illback, Robert J. & Sanders, Daniel Jr., 2007. "The relationship between implementation fidelity and educational outcomes in a school-based family support program: Development of a model for evaluating multidimensional full-service programs," Evaluation and Program Planning, Elsevier, vol. 30(2), pages 136-148, May.
    5. Glasgow, R.E. & Lichtenstein, E. & Marcus, A.C., 2003. "Why Don't We See More Translation of Health Promotion Research to Practice? Rethinking the Efficacy-to-Effectiveness Transition," American Journal of Public Health, American Public Health Association, vol. 93(8), pages 1261-1267.
    6. Millett, Lina & Lanier, Paul & Drake, Brett, 2011. "Are economic trends associated with child maltreatment? Preliminary results from the recent recession using state level data," Children and Youth Services Review, Elsevier, vol. 33(7), pages 1280-1287, July.
    7. Tuchman, Ellen & Sarasohn, M. Kim, 2011. "Implementation of an evidence-based modified therapeutic community: Staff and resident perspectives," Evaluation and Program Planning, Elsevier, vol. 34(2), pages 105-112, May.
    8. Webster, Daniel & Needell, Barbara & Wildfire, Judith, 2002. "Data are Your Friends: Child Welfare Agency Self-Evaluation in Los Angeles County with the Family to Family Initiative," Children and Youth Services Review, Elsevier, vol. 24(6-7), pages 471-484.
    9. Crea, Thomas M. & Usher, Charles L. & Wildfire, Judith B., 2009. "Implementation fidelity of Team Decisionmaking," Children and Youth Services Review, Elsevier, vol. 31(1), pages 119-124, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chambers, Ruth M. & Crutchfield, Rashida M. & Goddu Harper, Stephanie G. & Fatemi, Maryam & Rodriguez, Angel Y., 2018. "Family reunification in child welfare practice: A pilot study of parent and staff experiences," Children and Youth Services Review, Elsevier, vol. 91(C), pages 221-231.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Snyder, Elizabeth H. & Lawrence, C. Nicole & Dodge, Kenneth A., 2012. "The impact of system of care support in adherence to wraparound principles in Child and Family Teams in child welfare in North Carolina," Children and Youth Services Review, Elsevier, vol. 34(4), pages 639-647.
    2. Bearman, Sarah Kate & Garland, Ann F. & Schoenwald, Sonja K., 2014. "From practice to evidence in child welfare: Model specification and fidelity measurement of Team Decisionmaking," Children and Youth Services Review, Elsevier, vol. 39(C), pages 153-159.
    3. Crea, Thomas M. & Barth, Richard P. & Chintapalli, Laura K. & Buchanan, Rachel L., 2009. "The implementation and expansion of SAFE: Frontline responses and the transfer of technology to practice," Children and Youth Services Review, Elsevier, vol. 31(8), pages 903-910, August.
    4. Chambers, Ruth M. & Crutchfield, Rashida M. & Goddu Harper, Stephanie G. & Fatemi, Maryam & Rodriguez, Angel Y., 2018. "Family reunification in child welfare practice: A pilot study of parent and staff experiences," Children and Youth Services Review, Elsevier, vol. 91(C), pages 221-231.
    5. Stephanie Lange & Claire-Marie Altrock & Emily Gossmann & Jörg M. Fegert & Andreas Jud, 2022. "COVID-19—What Price Do Children Pay? An Analysis of Economic and Social Policy Factors," IJERPH, MDPI, vol. 19(13), pages 1-15, June.
    6. Gonot-Schoupinsky, Freda N. & Garip, Gulcan, 2019. "A flexible framework for planning and evaluating early-stage health interventions: FRAME-IT," Evaluation and Program Planning, Elsevier, vol. 77(C).
    7. Emmanuel Njeuhmeli & Melissa Schnure & Andrea Vazzano & Elizabeth Gold & Peter Stegman & Katharine Kripke & Michel Tchuenche & Lori Bollinger & Steven Forsythe & Catherine Hankins, 2019. "Using mathematical modeling to inform health policy: A case study from voluntary medical male circumcision scale-up in eastern and southern Africa and proposed framework for success," PLOS ONE, Public Library of Science, vol. 14(3), pages 1-15, March.
    8. Finch, Caroline F & Day, Lesley & Donaldson, Alex & Segal, Leonie & Harrison, James E, 2009. "Determining policy-relevant formats for the presentation of falls research evidence," Health Policy, Elsevier, vol. 93(2-3), pages 207-213, December.
    9. Saria Hassan & Alexis Cooke & Haneefa Saleem & Dorothy Mushi & Jessie Mbwambo & Barrot H. Lambdin, 2019. "Evaluating the Integrated Methadone and Anti-Retroviral Therapy Strategy in Tanzania Using the RE-AIM Framework," IJERPH, MDPI, vol. 16(5), pages 1-15, February.
    10. Cherry, Robert & Wang, Chun, 2016. "The link between male employment and child maltreatment in the U.S., 2000–2012," Children and Youth Services Review, Elsevier, vol. 66(C), pages 117-122.
    11. Estabrooks, Carole A. & Norton, Peter & Birdsell, Judy M. & Newton, Mandi S. & Adewale, Adeniyi J. & Thornley, Richard, 2008. "Knowledge translation and research careers: Mode I and Mode II activity among health researchers," Research Policy, Elsevier, vol. 37(6-7), pages 1066-1078, July.
    12. Natalie Bradford & Shirley Chambers & Adrienne Hudson & Jacqui Jauncey‐Cooke & Robyn Penny & Carol Windsor & Patsy Yates, 2019. "Evaluation frameworks in health services: An integrative review of use, attributes and elements," Journal of Clinical Nursing, John Wiley & Sons, vol. 28(13-14), pages 2486-2498, July.
    13. Chen, Huey T., 2010. "The bottom-up approach to integrative validity: A new perspective for program evaluation," Evaluation and Program Planning, Elsevier, vol. 33(3), pages 205-214, August.
    14. Rieckmann, Traci R. & Kovas, Anne E. & Cassidy, Elaine F. & McCarty, Dennis, 2011. "Employing policy and purchasing levers to increase the use of evidence-based practices in community-based substance abuse treatment settings: Reports from single state authorities," Evaluation and Program Planning, Elsevier, vol. 34(4), pages 366-374, November.
    15. Roberts-Gray, Cynthia & Gingiss, Phyllis M. & Boerm, Melynda, 2007. "Evaluating school capacity to implement new programs," Evaluation and Program Planning, Elsevier, vol. 30(3), pages 247-257, August.
    16. Holly Blake & Betsy Lai & Emil Coman & Jonathan Houdmont & Amanda Griffiths, 2019. "Move-It: A Cluster-Randomised Digital Worksite Exercise Intervention in China: Outcome and Process Evaluation," IJERPH, MDPI, vol. 16(18), pages 1-23, September.
    17. Mohd Shahidan Shaari & Paul Anthony Mariadas & Benjamin Nangle & Abdul Rahim Ridzuan, 2021. "The Relationship between Economic Growth and Child Abuse in Malaysia," Economics Bulletin, AccessEcon, vol. 41(3), pages 1932-1946.
    18. Tabia Henry Akintobi & Payam Sheikhattari & Emma Shaffer & Christina L. Evans & Kathryn L. Braun & Angela U. Sy & Bibiana Mancera & Adriana Campa & Stephania T. Miller & Daniel Sarpong & Rhonda Hollid, 2021. "Community Engagement Practices at Research Centers in U.S. Minority Institutions: Priority Populations and Innovative Approaches to Advancing Health Disparities Research," IJERPH, MDPI, vol. 18(12), pages 1-14, June.
    19. Kaye, Sarah & Osteen, Philip J., 2011. "Developing and validating measures for child welfare agencies to self-monitor fidelity to a child safety intervention," Children and Youth Services Review, Elsevier, vol. 33(11), pages 2146-2151.
    20. Bradley MacDonald & Xanne Janssen & Alison Kirk & Mhairi Patience & Ann-Marie Gibson, 2018. "An Integrative, Systematic Review Exploring the Research, Effectiveness, Adoption, Implementation, and Maintenance of Interventions to Reduce Sedentary Behaviour in Office Workers," IJERPH, MDPI, vol. 15(12), pages 1-29, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:cysrev:v:33:y:2011:i:11:p:2273-2281. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/childyouth .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.