IDEAS home Printed from https://ideas.repec.org/a/sae/evarev/v12y1988i2p186-195.html

Ensuring Validity Using Coworker Samples

Author

Listed:
  • Michael Calloway

    (Noel Dunivant & Associates)

  • Michael J. Belyea

    (Durham Veterans Administration Medical Center and Duke University)

Abstract

In program evaluation, limitations often preclude the utilization of sophisticated methodologies that assure the integrity of research findings. When rigorous method ologies are not applicable, theoretical or situationally driven evaluations have been developed. In such cases, the situation itself can serve as a useful research guide. In a study of a managerial training program, two subsamples of coworkers—supervisors and subordinates—were used to validate the participants' assessments of program impact. Both samples supported in direction and magnitude the participants' assessments. In addition, the subsamples separately revealed a similar ability to judge specific as well as overall impact. The methodology strengthened the validity of the findings.

Suggested Citation

  • Michael Calloway & Michael J. Belyea, 1988. "Ensuring Validity Using Coworker Samples," Evaluation Review, , vol. 12(2), pages 186-195, April.
    • Handle: RePEc:sae:evarev:v:12:y:1988:i:2:p:186-195
    DOI: 10.1177/0193841X8801200205
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0193841X8801200205
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0193841X8801200205?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Willer, B. & Miller, G., 1976. "On the validity of goal attainment scaling as an outcome measure in mental health," American Journal of Public Health, American Public Health Association, vol. 66(12), pages 1197-1198.
    2. Chen, Huey-Tsyh & Rossi, Peter H., 1987. "The theory-driven approach to validity," Evaluation and Program Planning, Elsevier, vol. 10(1), pages 95-103, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Torvatn, Hans, 1999. "Using program theory models in evaluation of industrial modernization programs: three case studies," Evaluation and Program Planning, Elsevier, vol. 22(1), pages 73-82.
    2. Benson, Paul R. & Fisher, Gene A. & Diana, Augusto & Simon, Lorna & Gamache, Gail & Tessler, Richard C. & McDermeit, Melissa, 1996. "A state network of family support services: The massachusetts family support demonstration project," Evaluation and Program Planning, Elsevier, vol. 19(1), pages 27-39, February.
    3. Kent, Douglas R. & Donaldson, Stewart I. & Wyrick, Phelan A. & Smith, Peggy J., 2000. "Evaluating criminal justice programs designed to reduce crime by targeting repeat gang offenders," Evaluation and Program Planning, Elsevier, vol. 23(1), pages 115-124, February.
    4. Harman, Elena & Azzam, Tarek, 2018. "Towards program theory validation: Crowdsourcing the qualitative analysis of participant experiences," Evaluation and Program Planning, Elsevier, vol. 66(C), pages 183-194.
    5. Saxe, Leonard & Reber, Emily & Hallfors, Denise & Kadushin, Charles & Jones, Delmos & Rindskopf, David & Beveridge, Andrew, 1997. "Think globally, act locally: Assessing the impact of community-based substance abuse prevention," Evaluation and Program Planning, Elsevier, vol. 20(3), pages 357-366, August.
    6. Johanna D. Birckmayer & Carol Hirschon Weiss, 2000. "Theory-Based Evaluation in Practice," Evaluation Review, , vol. 24(4), pages 407-431, August.
    7. Margarian, Anne, 2010. "Restrictions of empirical policy analyses: the example of the evaluation of rural development policies," 118th Seminar, August 25-27, 2010, Ljubljana, Slovenia 95320, European Association of Agricultural Economists.
    8. Henning, Christian H.C.A. & Michalek, Jerzy, 2008. "Theoretische Grundlagen und die Rolle parametrischer bzw. nicht-parametrischer Modellansätze in der Politikevaluation Replik zu Anne Margarian, Johann Heinrich von Thünen-Institut, Braunschweig," German Journal of Agricultural Economics, Humboldt-Universitaet zu Berlin, Department for Agricultural Economics, vol. 57(07), pages 1-4.
    9. Downes, Jenni & Gullickson, Amy M., 2022. "What does it mean for an evaluation to be ‘valid’? A critical synthesis of evaluation literature," Evaluation and Program Planning, Elsevier, vol. 91(C).
    10. Céline Mercier & Myra Piat & Normand Peladeau & Christian Dagenais, 2000. "An Application of Theory-Driven Evaluation to a Drop-In Youth Center," Evaluation Review, , vol. 24(1), pages 73-91, February.
    11. Taut, Sandy & Santelices, Verónica & Araya, Carolina & Manzi, Jorge, 2010. "Theory underlying a national teacher evaluation program," Evaluation and Program Planning, Elsevier, vol. 33(4), pages 477-486, November.
    12. Solomon Cytrynbaum & Yigal Ginath & Joel Birdwell & Lauren Brandt, 1979. "Goal Attainment Scaling," Evaluation Review, , vol. 3(1), pages 5-40, February.
    13. Brousselle, Astrid & Champagne, François, 2011. "Program theory evaluation: Logic analysis," Evaluation and Program Planning, Elsevier, vol. 34(1), pages 69-78, February.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:evarev:v:12:y:1988:i:2:p:186-195. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.