IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v33y2010i3p205-214.html
   My bibliography  Save this article

The bottom-up approach to integrative validity: A new perspective for program evaluation

Author

Listed:
  • Chen, Huey T.

Abstract

The Campbellian validity model and the traditional top-down approach to validity have had a profound influence on research and evaluation. That model includes the concepts of internal and external validity and within that model, the preeminence of internal validity as demonstrated in the top-down approach. Evaluators and researchers have, however, increasingly recognized that in an evaluation, the over-emphasis on internal validity reduces that evaluation's usefulness and contributes to the gulf between academic and practical communities regarding interventions. This article examines the limitations of the Campbellian validity model and the top-down approach and provides a comprehensive, alternative model, known as the integrative validity model for program evaluation. The integrative validity model includes the concept of viable validity, which is predicated on a bottom-up approach to validity. This approach better reflects stakeholders' evaluation views and concerns, makes external validity workable, and becomes therefore a preferable alternative for evaluation of health promotion/social betterment programs. The integrative validity model and the bottom-up approach enable evaluators to meet scientific and practical requirements, facilitate in advancing external validity, and gain a new perspective on methods. The new perspective also furnishes a balanced view of credible evidence, and offers an alternative perspective for funding.

Suggested Citation

  • Chen, Huey T., 2010. "The bottom-up approach to integrative validity: A new perspective for program evaluation," Evaluation and Program Planning, Elsevier, vol. 33(3), pages 205-214, August.
  • Handle: RePEc:eee:epplan:v:33:y:2010:i:3:p:205-214
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149-7189(09)00101-3
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Hallfors, D. & Cho, H. & Sanchez, V. & Khatapoush, S. & Hyung, M.K. & Bauer, D., 2006. "Efficacy vs effectiveness trial results of an indicated "model" substance abuse program: Implications for public health," American Journal of Public Health, American Public Health Association, vol. 96(12), pages 2254-2259.
    2. Ben D. MacArthur & Richard O. C. Oreffo, 2005. "Bridging the gap," Nature, Nature, vol. 433(7021), pages 19-19, January.
    3. Van Der Hoek, J.A.R. & Van Haastrecht, H.J.A. & Coutinho, R.A., 1989. "Risk reduction among intravenous drug users in Amsterdam under the influence of AIDS," American Journal of Public Health, American Public Health Association, vol. 79(10), pages 1355-1357.
    4. Steckler, A. & McLeroy, K.R., 2008. "The importance of external validity," American Journal of Public Health, American Public Health Association, vol. 98(1), pages 9-10.
    5. Hagan, H. & Des Jarlais, D.C. & Friedman, S.R. & Purchase, D. & Alter, M.J., 1995. "Reduced risk of hepatitis B and hepatitis C among injection drug users in the Tacoma syringe exchange program," American Journal of Public Health, American Public Health Association, vol. 85(11), pages 1531-1537.
    6. Glasgow, R.E. & Lichtenstein, E. & Marcus, A.C., 2003. "Why Don't We See More Translation of Health Promotion Research to Practice? Rethinking the Efficacy-to-Effectiveness Transition," American Journal of Public Health, American Public Health Association, vol. 93(8), pages 1261-1267.
    7. Jay Cross & Cynthia Saunders & Debra Bartelli, 1998. "The Effectiveness of Educational and Needle Exchange Programs: A Meta-analysis of HIV Prevention Strategies for Injecting Drug Users," Quality & Quantity: International Journal of Methodology, Springer, vol. 32(2), pages 165-180, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Cerezo, M. Angeles & Dasi, Carmen & Ruiz, Juan Carlos, 2013. "Supporting parenting of infants: Evaluating outcomes for parents and children in a community-based program," Evaluation and Program Planning, Elsevier, vol. 37(C), pages 12-20.
    2. Pearl Anne Ante-Testard & Francois Rerolle & Anna T. Nguyen & Sania Ashraf & Sarker Masud Parvez & Abu Mohammed Naser & Tarik Benmarhnia & Mahbubur Rahman & Stephen P. Luby & Jade Benjamin-Chung & Ben, 2024. "WASH interventions and child diarrhea at the interface of climate and socioeconomic position in Bangladesh," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
    3. Chen, Huey T., 2016. "Interfacing theories of program with theories of evaluation for advancing evaluation practice: Reductionism, systems thinking, and pragmatic synthesis," Evaluation and Program Planning, Elsevier, vol. 59(C), pages 109-118.
    4. Jacob Alex Klerman, 2017. "Editor in Chief’s Comment: External Validity in Systematic Reviews," Evaluation Review, , vol. 41(5), pages 391-402, October.
    5. Archibald, Thomas, 2015. "“They Just Know”: The epistemological politics of “evidence-based” non-formal education," Evaluation and Program Planning, Elsevier, vol. 48(C), pages 137-148.
    6. Urban, Jennifer Brown & Hargraves, Monica & Trochim, William M., 2014. "Evolutionary Evaluation: Implications for evaluators, researchers, practitioners, funders and the evidence-based program mandate," Evaluation and Program Planning, Elsevier, vol. 45(C), pages 127-139.
    7. Laura C. Leviton & Mathew D. Trujillo, 2017. "Interaction of Theory and Practice to Assess External Validity," Evaluation Review, , vol. 41(5), pages 436-471, October.
    8. Chen, Huey T. & Yip, Fuyuen & Lavonas, Eric J. & Iqbal, Shahed & Turner, Nannette & Cobb, Bobby & Garbe, Paul, 2014. "Using the exhibited generalization approach to evaluate a carbon monoxide alarm ordinance," Evaluation and Program Planning, Elsevier, vol. 47(C), pages 35-44.
    9. Downes, Jenni & Gullickson, Amy M., 2022. "What does it mean for an evaluation to be ‘valid’? A critical synthesis of evaluation literature," Evaluation and Program Planning, Elsevier, vol. 91(C).
    10. Riches, Brian R. & Benavides, Celina M. & Dubon, Valeska X., 2020. "Development of a fostering purpose intervention," Evaluation and Program Planning, Elsevier, vol. 83(C).
    11. Sarah A. Avellar & Jaime Thomas & Rebecca Kleinman & Emily Sama-Miller & Sara E. Woodruff & Rebecca Coughlin & T’Pring R. Westbrook, 2017. "External Validity: The Next Step for Systematic Reviews?," Evaluation Review, , vol. 41(4), pages 283-325, August.
    12. Schalock, Robert L. & Verdugo, Miguel Angel & Gomez, Laura E., 2011. "Evidence-based practices in the field of intellectual and developmental disabilities: An international consensus approach," Evaluation and Program Planning, Elsevier, vol. 34(3), pages 273-282, August.
    13. Gao, Xingyuan & Shen, Jianping & Wu, Huang & Krenn, Huilan Y., 2019. "Evaluating program effects: Conceptualizing and demonstrating a typology," Evaluation and Program Planning, Elsevier, vol. 72(C), pages 88-96.
    14. Inrig, Stephen J. & Higashi, Robin T. & Tiro, Jasmin A. & Argenbright, Keith E. & Lee, Simon J. Craddock, 2017. "Assessing local capacity to expand rural breast cancer screening and patient navigation: An iterative mixed-method tool," Evaluation and Program Planning, Elsevier, vol. 61(C), pages 113-124.
    15. Horton, Douglas & Rotondo, Emma & Paz Ybarnegaray, Rodrigo & Hareau, Guy & Devaux, André & Thiele, Graham, 2013. "Lapses, infidelities, and creative adaptations: Lessons from evaluation of a participatory market development approach in the Andes," Evaluation and Program Planning, Elsevier, vol. 39(C), pages 28-41.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chen, Huey T. & Yip, Fuyuen & Lavonas, Eric J. & Iqbal, Shahed & Turner, Nannette & Cobb, Bobby & Garbe, Paul, 2014. "Using the exhibited generalization approach to evaluate a carbon monoxide alarm ordinance," Evaluation and Program Planning, Elsevier, vol. 47(C), pages 35-44.
    2. Vanessa Taylor & Sarah Ashelford & Patricia Fell & Penelope J Goacher, 2015. "Biosciences in nurse education: is the curriculum fit for practice? Lecturers' views and recommendations from across the UK," Journal of Clinical Nursing, John Wiley & Sons, vol. 24(19-20), pages 2797-2806, October.
    3. Booth, Heather, 2006. "Demographic forecasting: 1980 to 2005 in review," International Journal of Forecasting, Elsevier, vol. 22(3), pages 547-581.
    4. Ercan Tomakin, 2014. "Teaching English Tenses (grammar) in the Turkish Texts; A Case of Simple Present Tense: Is?l Maketi Iter," International Journal of Learning and Development, Macrothink Institute, vol. 4(1), pages 115-131, March.
    5. Peter Viggo Jakobsen, 2009. "Small States, Big Influence: The Overlooked Nordic Influence on the Civilian ESDP," Journal of Common Market Studies, Wiley Blackwell, vol. 47(1), pages 81-102, January.
    6. Radha Jagannathan & Michael J. Camasso & Bagavan Das & Jale Tosun & Sadagopan Iyengar, 2017. "Family, society and the individual: determinants of entrepreneurial attitudes among youth in Chennai, South India," Journal of Global Entrepreneurship Research, Springer;UNESCO Chair in Entrepreneurship, vol. 7(1), pages 1-22, December.
    7. Gonot-Schoupinsky, Freda N. & Garip, Gulcan, 2019. "A flexible framework for planning and evaluating early-stage health interventions: FRAME-IT," Evaluation and Program Planning, Elsevier, vol. 77(C).
    8. Tautenhahn, Susanne & Heilmeier, Hermann & Jung, Martin & Kahl, Anja & Kattge, Jens & Moffat, Antje & Wirth, Christian, 2012. "Beyond distance-invariant survival in inverse recruitment modeling: A case study in Siberian Pinus sylvestris forests," Ecological Modelling, Elsevier, vol. 233(C), pages 90-103.
    9. Emmanuel Njeuhmeli & Melissa Schnure & Andrea Vazzano & Elizabeth Gold & Peter Stegman & Katharine Kripke & Michel Tchuenche & Lori Bollinger & Steven Forsythe & Catherine Hankins, 2019. "Using mathematical modeling to inform health policy: A case study from voluntary medical male circumcision scale-up in eastern and southern Africa and proposed framework for success," PLOS ONE, Public Library of Science, vol. 14(3), pages 1-15, March.
    10. Finch, Caroline F & Day, Lesley & Donaldson, Alex & Segal, Leonie & Harrison, James E, 2009. "Determining policy-relevant formats for the presentation of falls research evidence," Health Policy, Elsevier, vol. 93(2-3), pages 207-213, December.
    11. Vincenzo Galasso, 2020. "Market Reactions to Quest for Decentralization and Independence: Evidence from Catalonia," CESifo Working Paper Series 8254, CESifo.
    12. Thijs Fassaert & Matty A.S. De Wit & Wilco C. Tuinebreijer & Jeroen W. Knipscheer & Arnoud P. Verhoeff & Aartjan T.F. Beekman & Jack Dekker, 2011. "Acculturation and Psychological Distress Among Non-Western Muslim Migrants - a Population-Based Survey," International Journal of Social Psychiatry, , vol. 57(2), pages 132-143, March.
    13. Jakub Bijak & Jason D. Hilton & Eric Silverman & Viet Dung Cao, 2013. "Reforging the Wedding Ring," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 29(27), pages 729-766.
    14. Philippe De Donder & Michel Le Breton & Eugenio Peluso, 2012. "Majority Voting in Multidimensional Policy Spaces: Kramer–Shepsle versus Stackelberg," Journal of Public Economic Theory, Association for Public Economic Theory, vol. 14(6), pages 879-909, December.
    15. Grace Kite, 2014. "Linked in? Software and Information Technology Services in India’s Economic Development," Journal of South Asian Development, , vol. 9(2), pages 99-119, August.
    16. Spyros Arvanitis & Ursina Kubli & Martin Woerter, 2006. "University-Industry Knowledge Interaction in Switzerland: What University Scientists Think about Co-operation with Private Enterprises," KOF Working papers 06-132, KOF Swiss Economic Institute, ETH Zurich.
    17. Don C. Des Jarlais & Samuel R. Friedman, 1992. "AIDS and Legal Access to Sterile Drug Injection Equipment," The ANNALS of the American Academy of Political and Social Science, , vol. 521(1), pages 42-65, May.
    18. Saria Hassan & Alexis Cooke & Haneefa Saleem & Dorothy Mushi & Jessie Mbwambo & Barrot H. Lambdin, 2019. "Evaluating the Integrated Methadone and Anti-Retroviral Therapy Strategy in Tanzania Using the RE-AIM Framework," IJERPH, MDPI, vol. 16(5), pages 1-15, February.
    19. Falco, Paolo & Zaccagni, Sarah, 2020. "Promoting social distancing in a pandemic: Beyond the good intentions," OSF Preprints a2nys, Center for Open Science.
    20. León, Esperanza & Steele, Miriam & Palacios, Jesús & Román, Maite & Moreno, Carmen, 2018. "Parenting adoptive children: Reflective functioning and parent-child interactions. A comparative, relational and predictive study," Children and Youth Services Review, Elsevier, vol. 95(C), pages 352-360.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:33:y:2010:i:3:p:205-214. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.