IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v55y2016icp27-34.html

Formative evaluation: Developing measures for online family mental health recovery education

Author

Listed:
  • Rue, Lisa A.
  • Estrada, Samantha
  • Floren, Michael
  • MacKinnon, Krista

Abstract

Families facing mental health challenges have very limited access to ongoing support. A formative evaluation of Families Healing Together (FHT), a new online family mental health recovery program was conducted using five waves (N=108) of data. Exploratory factor analysis of the measures identified as important to the program theory found strong reliability evidence (α=.77–.86) for 6 constructs. A poor response rate (25%) did not allow for valid pre and postoutcome evaluation, however we did have enough information to assess the psychometric properties of the new measures. The new evaluation tool accounted for 34% of the variance in Capacity to Support Family Member, and nearly 50% of the variance in Hopefulness toward Recovery. New programs without existing measures require formative evaluation strategies that accurately describe program activities in order to develop outcome measures sensitive to novel aspects of program components. Most outcome measures are developed for individuals with mental health challenges not family members. These new measures may be beneficial to effectively evaluate programs that promote family recovery and wellness.

Suggested Citation

  • Rue, Lisa A. & Estrada, Samantha & Floren, Michael & MacKinnon, Krista, 2016. "Formative evaluation: Developing measures for online family mental health recovery education," Evaluation and Program Planning, Elsevier, vol. 55(C), pages 27-34.
    • Handle: RePEc:eee:epplan:v:55:y:2016:i:c:p:27-34
    DOI: 10.1016/j.evalprogplan.2015.11.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718915001263
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.evalprogplan.2015.11.004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Gray, Nicola J. & Klein, Jonathan D. & Noyce, Peter R. & Sesselberg, Tracy S. & Cantrill, Judith A., 2005. "Health information-seeking behaviour in adolescence: the place of the internet," Social Science & Medicine, Elsevier, vol. 60(7), pages 1467-1478, April.
    2. Klaas Sijtsma, 2009. "On the Use, the Misuse, and the Very Limited Usefulness of Cronbach’s Alpha," Psychometrika, Springer;The Psychometric Society, vol. 74(1), pages 107-120, March.
    3. Louis Guttman, 1954. "Some necessary conditions for common-factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 19(2), pages 149-161, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. GUO-FITOUSSI, Liang, 2013. "A Comparison of the Finite Sample Properties of Selection Rules of Factor Numbers in Large Datasets," MPRA Paper 50005, University Library of Munich, Germany.
    2. Barbosa, Anrafel de Souza & Crispim, Maria Cristina & da Silva, Luiz Bueno & da Silva, Jonhatan Magno Norte & Barbosa, Aglaucibelly Maciel & Correia, Lucas Miguel Alencar de Morais & Morioka, Sandra N, 2025. "Empirical analysis of workers' perceptions of ESG impacts on corporate sustainability performance: A methodological innovation combining the PLS-SEM, PROMETHEE-ROC and FIMIX-PLS methods," Technological Forecasting and Social Change, Elsevier, vol. 215(C).
    3. Linda Haddad & Omar El-Shahawy & Roula Ghadban & Tracey E. Barnett & Emily Johnson, 2015. "Waterpipe Smoking and Regulation in the United States: A Comprehensive Review of the Literature," IJERPH, MDPI, vol. 12(6), pages 1-21, May.
    4. Louis Guttman, 1955. "A generalized simplex for factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 20(3), pages 173-192, September.
    5. Pamela Lenton, 2014. "Personality Characteristics, Educational Attainment and Wages: An Economic Analysis Using the British Cohort Study," Working Papers 2014011, The University of Sheffield, Department of Economics.
    6. Grant L. Harley & R. Stockton Maxwell & Bryan A. Black & Matthew F. Bekker, 2020. "A multi-century, tree-ring-derived perspective of the North Cascades (USA) 2014–2016 snow drought," Climatic Change, Springer, vol. 162(1), pages 127-143, September.
    7. Mounia N Hocine & Karim Aït Bouziad & Patrick Légeron & William Dab & Gilbert Saporta, 2016. "How to Identify and Prioritize Psychosocial Factors Impacting Stress Level," PLOS ONE, Public Library of Science, vol. 11(6), pages 1-11, June.
    8. Andrea Zammitti & Isabella Valbusa & Sara Santilli & Maria Cristina Ginevra & Salvatore Soresi & Laura Nota, 2023. "Development and Validation of the Decent Work for Inclusive and Sustainable Future Construction Scale in Italy," Sustainability, MDPI, vol. 15(15), pages 1-19, July.
    9. Sara Soares & Armine Abrahamyan & Mariana Amorim & Ana Cristina Santos & Sílvia Fraga, 2022. "Prevalence of Adverse Childhood Experiences in the First Decade of Life: A Study in the Portuguese Cohort, Generation XXI," IJERPH, MDPI, vol. 19(14), pages 1-16, July.
    10. Margherita Casini & Simone Bastianoni & Francesca Gagliardi & Massimo Gigliotti & Angelo Riccaboni & Gianni Betti, 2019. "Sustainable Development Goals Indicators: A Methodological Proposal for a Multidimensional Fuzzy Index in the Mediterranean Area," Sustainability, MDPI, vol. 11(4), pages 1-25, February.
    11. Anahita Nodehi & Mousa Golalizadeh & Mehdi Maadooliat & Claudio Agostinelli, 2025. "Torus Probabilistic Principal Component Analysis," Journal of Classification, Springer;The Classification Society, vol. 42(2), pages 435-456, July.
    12. Gross, Deborah & Bettencourt, Amie F. & Holmes Finch, W. & Plesko, Corinne & Paulson, Rachael & Singleton, Demetria L., 2022. "Developing an equitable measure of parent engagement in early childhood education for urban schools," Children and Youth Services Review, Elsevier, vol. 141(C).
    13. Nico Migenda & Ralf Möller & Wolfram Schenck, 2021. "Adaptive dimensionality reduction for neural network-based online principal component analysis," PLOS ONE, Public Library of Science, vol. 16(3), pages 1-32, March.
    14. Chester Harris, 1967. "On factors and factor scores," Psychometrika, Springer;The Psychometric Society, vol. 32(4), pages 363-379, December.
    15. Anos-Casero, Paloma & Udomsaph, Charles, 2009. "What drives firm productivity growth ?," Policy Research Working Paper Series 4841, The World Bank.
    16. Conzo, Pierluigi & Aassve, Arnstein & Fuochi, Giulia & Mencarini, Letizia, 2017. "The cultural foundations of happiness," Journal of Economic Psychology, Elsevier, vol. 62(C), pages 268-283.
    17. Gerhard Derflinger, 1984. "A loss function for alpha factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 49(3), pages 325-330, September.
    18. Taiki Yoshida & Yohei Otaka & Shin Kitamura & Kazuki Ushizawa & Masashi Kumagai & Yuto Kurihara & Jun Yaeda & Rieko Osu, 2022. "Development and validation of new evaluation scale for measuring stroke patients’ motivation for rehabilitation in rehabilitation wards," PLOS ONE, Public Library of Science, vol. 17(3), pages 1-17, March.
    19. Kate Elizabeth Gannon, Mike Hulme, 2017. "Geoengineering at the ‘edge of the world’: exploring perceptions of ocean fertilization through the Haida Salmon Restoration Corporation," GRI Working Papers 280, Grantham Research Institute on Climate Change and the Environment.
    20. Louis Guttman, 1958. "To what extent can communalities reduce rank?," Psychometrika, Springer;The Psychometric Society, vol. 23(4), pages 297-308, December.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:55:y:2016:i:c:p:27-34. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.