IDEAS home Printed from https://ideas.repec.org/p/mpr/mprres/f4f8b24cbf874a3989d87cf89983cc9c.html

Improving the Rigor of Quasi-Experimental Impact Evaluations: Lessons for Teen Pregnancy Prevention Researchers

Author

Listed:
  • Brian Goesling
  • Joanne Lee

Abstract

This research brief highlights three ways to improve the rigor of quasi-experimental impact evaluations of social and public health interventions, focusing specifically on evaluations of teen pregnancy prevention programs.

Suggested Citation

  • Brian Goesling & Joanne Lee, 2015. "Improving the Rigor of Quasi-Experimental Impact Evaluations: Lessons for Teen Pregnancy Prevention Researchers," Mathematica Policy Research Reports f4f8b24cbf874a3989d87cf89, Mathematica Policy Research.
    • Handle: RePEc:mpr:mprres:f4f8b24cbf874a3989d87cf89983cc9c
    as

    Download full text from publisher

    File URL: https://www.mathematica.org/-/media/publications/pdfs/family_support/tpp_qed_rb.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Kenneth Fortson & Natalya Verbitsky-Savitz & Emma Kopa & Philip Gleason, 2012. "Using an Experimental Evaluation of Charter Schools to Test Whether Nonexperimental Comparison Group Methods Can Replicate Experimental Impact Estimates," Mathematica Policy Research Reports 27f871b5b7b94f3a80278a593, Mathematica Policy Research.
    2. Shadish, William R. & Clark, M. H. & Steiner, Peter M., 2008. "Can Nonrandomized Experiments Yield Accurate Answers? A Randomized Experiment Comparing Random and Nonrandom Assignments," Journal of the American Statistical Association, American Statistical Association, vol. 103(484), pages 1334-1344.
    3. repec:mpr:mprres:7443 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Vivian C. Wong & Peter M. Steiner, 2018. "Designs of Empirical Evaluations of Nonexperimental Methods in Field Settings," Evaluation Review, , vol. 42(2), pages 176-213, April.
    2. Katherine Baicker & Theodore Svoronos, 2019. "Testing the Validity of the Single Interrupted Time Series Design," CID Working Papers 364, Center for International Development at Harvard University.
    3. Katherine Baicker & Theodore Svoronos, 2019. "Testing the Validity of the Single Interrupted Time Series Design," NBER Working Papers 26080, National Bureau of Economic Research, Inc.
    4. Ben Weidmann & Luke Miratrix, 2021. "Lurking Inferential Monsters? Quantifying Selection Bias In Evaluations Of School Programs," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 40(3), pages 964-986, June.
    5. Vivian C. Wong & Peter M. Steiner & Kylie L. Anglin, 2018. "What Can Be Learned From Empirical Evaluations of Nonexperimental Methods?," Evaluation Review, , vol. 42(2), pages 147-175, April.
    6. repec:mpr:mprres:7927 is not listed on IDEAS
    7. Deborah Peikes & Grace Anglin & Erin Fries Taylor & Stacy Dale & Ann O'Malley & Arkadipta Ghosh & Kaylyn Swankoski & Lara Converse & Rosalind Keith & Mariel Finucane & Jesse Crosson & Anne Mutti & Tho, "undated". "Evaluation of the Comprehensive Primary Care Initiative: Third Annual Report," Mathematica Policy Research Reports 70714de1cb3d4620a5957f68d, Mathematica Policy Research.
    8. Colin Cannonier, 2009. "State Abstinence Education Programs and Teen Fertility in the U.S," Departmental Working Papers 2009-14, Department of Economics, Louisiana State University.
    9. Kari Lock Morgan & Donald B. Rubin, 2015. "Rerandomization to Balance Tiers of Covariates," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(512), pages 1412-1421, December.
    10. Nicholas Voorhees & Justin C. Ortagus & Erica Marti, 2023. "Give It a Swirl? An Examination of the Influence of 4-Year Students Taking Entry-Level Math Courses at the Local Community College," Research in Higher Education, Springer;Association for Institutional Research, vol. 64(1), pages 147-173, February.
    11. Kenneth Fortson & Natalya Verbitsky-Savitz & Emma Kopa & Philip Gleason, 2012. "Using an Experimental Evaluation of Charter Schools to Test Whether Nonexperimental Comparison Group Methods Can Replicate Experimental Impact Estimates," Mathematica Policy Research Reports 27f871b5b7b94f3a80278a593, Mathematica Policy Research.
    12. Rezaei, Ehsan Eyshi & Gaiser, Thomas, "undated". "Change in crop management strategies could double the maize yield in Africa," Discussion Papers 260154, University of Bonn, Center for Development Research (ZEF).
    13. Jean Stockard, 2013. "Merging the accountability and scientific research requirements of the No Child Left Behind Act: using cohort control groups," Quality & Quantity: International Journal of Methodology, Springer, vol. 47(4), pages 2225-2257, June.
    14. Lin, Zhexiao & Han, Fang, 2025. "On regression-adjusted imputation estimators of average treatment effects," Journal of Econometrics, Elsevier, vol. 251(C).
    15. Ferraro, Paul J. & Miranda, Juan José, 2014. "The performance of non-experimental designs in the evaluation of environmental programs: A design-replication study using a large-scale randomized experiment as a benchmark," Journal of Economic Behavior & Organization, Elsevier, vol. 107(PA), pages 344-365.
    16. Anna Haskins, 2013. "Mass Imprisonment and the Intergenerational Transmission of Disadvantage: Paternal Incarceration and Children’s Cognitive Skill Development," Working Papers wp13-15-ff, Princeton University, School of Public and International Affairs, Center for Research on Child Wellbeing..
    17. Joscha Legewie, 2018. "Living on the Edge: Neighborhood Boundaries and the Spatial Dynamics of Violent Crime," Demography, Springer;Population Association of America (PAA), vol. 55(5), pages 1957-1977, October.
    18. Kenneth Fortson & Philip Gleason & Emma Kopa & Natalya Verbitsky-Savitz, "undated". "Horseshoes, Hand Grenades, and Treatment Effects? Reassessing Bias in Nonexperimental Estimators," Mathematica Policy Research Reports 1c24988cd5454dd3be51fbc2c, Mathematica Policy Research.
    19. Michael Broda & Eric Ekholm & Barbara Schneider & Amy C. Hutton, 2018. "Teachers’ Social Networks, College-Going Practices, and the Diffusion of a School-Based Reform Initiative," SAGE Open, , vol. 8(4), pages 21582440188, December.
    20. Wunsch, Conny & Strobl, Renate, 2018. "Identification of Causal Mechanisms Based on Between-Subject Double Randomization Designs," IZA Discussion Papers 11626, IZA Network @ LISER.
    21. Yasemin Kisbu-Sakarya & Thomas D. Cook & Yang Tang & M. H. Clark, 2018. "Comparative Regression Discontinuity: A Stress Test With Small Samples," Evaluation Review, , vol. 42(1), pages 111-143, February.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:mpr:mprres:f4f8b24cbf874a3989d87cf89983cc9c. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joanne Pfleiderer or Cindy George The email address of this maintainer does not seem to be valid anymore. Please ask Cindy George to update the entry or send us the correct address (email available below). General contact details of provider: https://edirc.repec.org/data/mathius.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.