IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v86y2021ics0149718921000112.html

Development and validation of a measure of organizational capacity for implementing youth development programs

Author

Listed:
  • Dymnicki, Allison
  • Neiman, Samantha
  • Joshi, Aasha
  • Johnson, Tasha
  • Hodgman, Sarah

Abstract

Accumulating evidence indicates that incorporating youth development (YD) principles, strategies, and supports into an organization promotes positive adult and youth outcomes. However, few validated measures assess this type of capacity. The YMCA commissioned a study to validate its Capacity Assessment for Youth Development Programming (Y-CAP), which examines the organizational infrastructure required to implement YD programs and processes in seven areas. Survey development was an iterative process informed by existing frameworks, instruments, and pilot testing of items. The Y-CAP was reviewed and revised three times prior to this study, with a final round of revisions made at the start of the validation phase as a result of thorough content, survey methodology, and psychometrics reviews. The revised Y-CAP was completed by 123 YMCA implementation teams. Rasch analyses were used to determine the extent to which validity evidence supports the use and interpretation of the Y-CAP scores. Convergent validity was assessed by comparing Y-CAP scales to the Algorhythm staff survey for youth-serving organizations, and focus groups informed the consequential validity of the Y-CAP. The results provide strong evidence for the reliability and validity of the Y-CAP, which can be used to guide continuous quality improvement initiatives that support capacity and functioning in youth-serving organizations and programs.

Suggested Citation

  • Dymnicki, Allison & Neiman, Samantha & Joshi, Aasha & Johnson, Tasha & Hodgman, Sarah, 2021. "Development and validation of a measure of organizational capacity for implementing youth development programs," Evaluation and Program Planning, Elsevier, vol. 86(C).
    • Handle: RePEc:eee:epplan:v:86:y:2021:i:c:s0149718921000112
    DOI: 10.1016/j.evalprogplan.2021.101916
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718921000112
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.evalprogplan.2021.101916?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. David Andrich, 1978. "A rating formulation for ordered response categories," Psychometrika, Springer;The Psychometric Society, vol. 43(4), pages 561-573, December.
    2. DeBoer, Larry & McNamara, Kevin T. & Cranfield, John & Graham, Thea, 2000. "Legislator Influence and Public School Finance," The Review of Regional Studies, Southern Regional Science Association, vol. 30(2), pages 117-135, Fall.
    3. Bush, Paula Louise & García Bengoechea, Enrique, 2016. "Building on a YMCA’s health and physical activity promotion capacities: A case study of a researcher-organization partnership to optimize adolescent programming_," Evaluation and Program Planning, Elsevier, vol. 57(C), pages 30-38.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kelly Bradley & Jessica Cunningham & Richard Gilman, 2014. "Measuring Adolescent Life Satisfaction: A Psychometric Investigation of the Multidimensional Students’ Life Satisfaction Scale (MSLSS)," Journal of Happiness Studies, Springer, vol. 15(6), pages 1333-1345, December.
    2. Eun-Young Park & Soojung Chae, 2020. "Rasch Analysis of the Korean Parenting Stress Index Short Form (K-PSI-SF) in Mothers of Children with Cerebral Palsy," IJERPH, MDPI, vol. 17(19), pages 1-11, September.
    3. P. A. Ferrari & S. Salini, 2008. "Measuring Service Quality: The Opinion of Europeans about Utilities," Working Papers 2008.36, Fondazione Eni Enrico Mattei.
    4. Chang, Hsin-Li & Yang, Cheng-Hua, 2008. "Explore airlines’ brand niches through measuring passengers’ repurchase motivation—an application of Rasch measurement," Journal of Air Transport Management, Elsevier, vol. 14(3), pages 105-112.
    5. Ji Seung Yang & Xiaying Zheng, 2018. "Item Response Data Analysis Using Stata Item Response Theory Package," Journal of Educational and Behavioral Statistics, , vol. 43(1), pages 116-129, February.
    6. Sullivan, Joe H. & Warkentin, Merrill & Wallace, Linda, 2021. "So many ways for assessing outliers: What really works and does it matter?," Journal of Business Research, Elsevier, vol. 132(C), pages 530-543.
    7. Jing Cao & S. Lynne Stokes & Song Zhang, 2010. "A Bayesian Approach to Ranking and Rater Evaluation," Journal of Educational and Behavioral Statistics, , vol. 35(2), pages 194-214, April.
    8. Syed Abou Iltaf Hussain & Debasish Baruah & Bapi Dutta & Uttam Kumar Mandal & Sankar Prasad Mondal & Thuleswar Nath, 2019. "Evaluating the impact of service quality on the dynamics of customer satisfaction in the telecommunication industry of Jorhat, Assam," Telecommunication Systems: Modelling, Analysis, Design and Management, Springer, vol. 71(1), pages 31-53, May.
    9. Luiz Diego Vidal Santos & Francisco Sandro Rodrigues Holanda & Catuxe Varjão Santana Oliveira & Alceu Pedrotti & Pedro Vinícius Bertulino Menezes & Ana Paula Schervinski Villwock, 2023. "Purchase intention of Amazon sustainable brands: a hybrid approach of structural equation modeling and Rasch model," SN Business & Economics, Springer, vol. 3(12), pages 1-29, December.
    10. Ivana Bassi & Matteo Carzedda & Enrico Gori & Luca Iseppi, 2022. "Rasch analysis of consumer attitudes towards the mountain product label," Agricultural and Food Economics, Springer;Italian Society of Agricultural Economics (SIDEA), vol. 10(1), pages 1-25, December.
    11. Jules Ellis & Brian Junker, 1997. "Tail-measurability in monotone latent variable models," Psychometrika, Springer;The Psychometric Society, vol. 62(4), pages 495-523, December.
    12. Christina Matz-Costa & Jacquelyn James & Larry Ludlow & Melissa Brown & Elyssa Besen & Clair Johnson, 2014. "The Meaning and Measurement of Productive Engagement in Later Life," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 118(3), pages 1293-1314, September.
    13. Antonio Caronni & Marina Ramella & Pietro Arcuri & Claudia Salatino & Lucia Pigini & Maurizio Saruggia & Chiara Folini & Stefano Scarano & Rosa Maria Converti, 2023. "The Rasch Analysis Shows Poor Construct Validity and Low Reliability of the Quebec User Evaluation of Satisfaction with Assistive Technology 2.0 (QUEST 2.0) Questionnaire," IJERPH, MDPI, vol. 20(2), pages 1-19, January.
    14. Wen-Chia Chang, 2023. "Validation of the teaching equity enactment scenario scale in Singapore: a mixed-methods convergent study," Quality & Quantity: International Journal of Methodology, Springer, vol. 57(6), pages 5257-5282, December.
    15. Wanke, Peter Fernandes & Chiappetta Jabbour, Charbel José & Moreira Antunes, Jorge Junio & Lopes de Sousa Jabbour, Ana Beatriz & Roubaud, David & Sobreiro, Vinicius Amorim & Santibanez Gonzalez‬, Erne, 2021. "An original information entropy-based quantitative evaluation model for low-carbon operations in an emerging market," International Journal of Production Economics, Elsevier, vol. 234(C).
    16. Singh, Jagdip, 2004. "Tackling measurement problems with Item Response Theory: Principles, characteristics, and assessment, with an illustrative example," Journal of Business Research, Elsevier, vol. 57(2), pages 184-208, February.
    17. Hua-Hua Chang, 1996. "The asymptotic posterior normality of the latent trait for polytomous IRT models," Psychometrika, Springer;The Psychometric Society, vol. 61(3), pages 445-463, September.
    18. Curt Hagquist & Lisa Hellström, 2014. "The Psychometric Properties of the Early Development Instrument: A Rasch Analysis Based on Swedish Pilot Data," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 117(1), pages 301-317, May.
    19. Curt Hagquist & Raili Välimaa & Nina Simonsen & Sakari Suominen, 2017. "Differential Item Functioning in Trend Analyses of Adolescent Mental Health – Illustrative Examples Using HBSC-Data from Finland," Child Indicators Research, Springer;The International Society of Child Indicators (ISCI), vol. 10(3), pages 673-691, September.
    20. Wang, Luming & Finn, Adam, 2014. "A psychometric theory that measures up to marketing reality: An adapted Many Faceted IRT model," Australasian marketing journal, Elsevier, vol. 22(2), pages 93-102.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:86:y:2021:i:c:s0149718921000112. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.