IDEAS home Printed from https://ideas.repec.org/a/sae/anname/v587y2003i1p49-68.html
   My bibliography  Save this article

Methodological Quality Standards for Evaluation Research

Author

Listed:
  • David P. Farrington

    (Cambridge University; Campbell Collaboration Crime and Justice Group; Academy of Experimental Criminology)

Abstract

Evaluation studies vary in methodological quality. It is essential to develop methodological quality standards for evaluation research that can be understood and easily used by scholars, practitioners, policy makers, the mass media, and systematic reviewers. This article proposes that such standards should be based on statistical conclusion validity, internal validity, construct validity, external validity, and descriptive validity. Methodological quality scales are reviewed, and it is argued that efforts should be made to improve them. Pawson and Tilley's challenge to the Campbell evaluation tradition is also assessed. It is concluded that this challenge does not have any implications for methodological quality standards, because the Campbell tradition already emphasizes the need to study moderators and mediators in evaluation research.

Suggested Citation

  • David P. Farrington, 2003. "Methodological Quality Standards for Evaluation Research," The ANNALS of the American Academy of Political and Social Science, , vol. 587(1), pages 49-68, May.
    • Handle: RePEc:sae:anname:v:587:y:2003:i:1:p:49-68
    DOI: 10.1177/0002716202250789
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0002716202250789
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0002716202250789?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. David P. Farrington & Anthony Petrosino, 2001. "The Campbell Collaboration Crime and Justice Group," The ANNALS of the American Academy of Political and Social Science, , vol. 578(1), pages 35-49, November.
    2. David Weisburd & Cynthia M. Lum & Anthony Petrosino, 2001. "Does Research Design Affect Study Outcomes in Criminal Justice?," The ANNALS of the American Academy of Political and Social Science, , vol. 578(1), pages 50-70, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. David P. Farrington, 2003. "British Randomized Experiments on Crime and Justice," The ANNALS of the American Academy of Political and Social Science, , vol. 589(1), pages 150-167, September.
    2. David Weisburd & Cynthia M. Lum & Sue-Ming Yang, 2003. "When can we Conclude that Treatments or Programs “Don’t Work†?," The ANNALS of the American Academy of Political and Social Science, , vol. 587(1), pages 31-48, May.
    3. Cynthia McDougall & Mark A. Cohen & Raymond Swaray & Amanda Perry, 2003. "The Costs and Benefits of Sentencing: A Systematic Review," The ANNALS of the American Academy of Political and Social Science, , vol. 587(1), pages 160-177, May.
    4. Ciula, Raffaele, 2022. "The effects of Bolsa Familia on human development: systematic review approach," MPRA Paper 116768, University Library of Munich, Germany.
    5. Anthony Petrosino, 2003. "Standards for Evidence and Evidence for Standards: The Case of School-Based Drug Prevention," The ANNALS of the American Academy of Political and Social Science, , vol. 587(1), pages 180-207, May.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mark W. Lipsey, 2003. "Those Confounded Moderators in Meta-Analysis: Good, Bad, and Ugly," The ANNALS of the American Academy of Political and Social Science, , vol. 587(1), pages 69-81, May.
    2. David P. Farrington, 2003. "British Randomized Experiments on Crime and Justice," The ANNALS of the American Academy of Political and Social Science, , vol. 589(1), pages 150-167, September.
    3. David Weisburd & Cynthia M. Lum & Sue-Ming Yang, 2003. "When can we Conclude that Treatments or Programs “Don’t Work†?," The ANNALS of the American Academy of Political and Social Science, , vol. 587(1), pages 31-48, May.
    4. Kevin Petersen & Robert C. Davis & David Weisburd & Bruce Taylor, 2022. "Effects of second responder programs on repeat incidents of family abuse: An updated systematic review and meta‐analysis," Campbell Systematic Reviews, John Wiley & Sons, vol. 18(1), March.
    5. Brandon C. Welsh & David P. Farrington, 2003. "Effects of Closed-Circuit Television on Crime," The ANNALS of the American Academy of Political and Social Science, , vol. 587(1), pages 110-135, May.
    6. Iain Chalmers, 2003. "Trying to do more Good than Harm in Policy and Practice: The Role of Rigorous, Transparent, Up-to-Date Evaluations," The ANNALS of the American Academy of Political and Social Science, , vol. 589(1), pages 22-40, September.
    7. Dominic Pearson & David Torgerson & Cynthia McDougall & Roger Bowles, 2010. "Parable of Two Agencies, One of Which Randomizes," The ANNALS of the American Academy of Political and Social Science, , vol. 628(1), pages 11-29, March.
    8. David Weisburd & Anthony Petrosino & Cynthia M. Lum, 2003. "Preface," The ANNALS of the American Academy of Political and Social Science, , vol. 587(1), pages 6-14, May.
    9. Lawrence W. Sherman & Heather Strang, 2004. "Experimental Ethnography: The Marriage of Qualitative and Quantitative Research," The ANNALS of the American Academy of Political and Social Science, , vol. 595(1), pages 204-222, September.
    10. Joan McCord, 2003. "Cures That Harm: Unanticipated Outcomes of Crime Prevention Programs," The ANNALS of the American Academy of Political and Social Science, , vol. 587(1), pages 16-30, May.
    11. Friedrich Lösel & Andreas Beelmann, 2003. "Effects of Child Skills Training in Preventing Antisocial Behavior: A Systematic Review of Randomized Evaluations," The ANNALS of the American Academy of Political and Social Science, , vol. 587(1), pages 84-109, May.
    12. Kevin Petersen & David Weisburd & Sydney Fay & Elizabeth Eggins & Lorraine Mazerolle, 2023. "Police stops to reduce crime: A systematic review and meta‐analysis," Campbell Systematic Reviews, John Wiley & Sons, vol. 19(1), March.
    13. Lawrence W. Sherman, 2003. "Experimental Evidence and Governmental Administration," The ANNALS of the American Academy of Political and Social Science, , vol. 589(1), pages 226-233, September.
    14. David Weisburd & John E. Eck, 2004. "What Can Police Do to Reduce Crime, Disorder, and Fear?," The ANNALS of the American Academy of Political and Social Science, , vol. 593(1), pages 42-65, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:anname:v:587:y:2003:i:1:p:49-68. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.