IDEAS home Printed from https://ideas.repec.org/p/mpr/mprres/b58a999ab27a4cabafac5aa080f17612.html

Recognizing and Conducting Opportunistic Experiments in Education: A Guide for Policymakers and Researchers

Author

Listed:
  • Alexandra Resch
  • Jillian Berk
  • Lauren Akers

Abstract

Opportunistic experiments are a type of randomized controlled trial to study the effects of a planned intervention or policy change with minimal added disruption and cost.

Suggested Citation

  • Alexandra Resch & Jillian Berk & Lauren Akers, "undated". "Recognizing and Conducting Opportunistic Experiments in Education: A Guide for Policymakers and Researchers," Mathematica Policy Research Reports b58a999ab27a4cabafac5aa08, Mathematica Policy Research.
  • Handle: RePEc:mpr:mprres:b58a999ab27a4cabafac5aa080f17612
    as

    Download full text from publisher

    File URL: https://www.mathematica.org/-/media/publications/pdfs/education/recognizing_conducting_opportunistic_experiments.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. repec:mpr:mprres:7680 is not listed on IDEAS
    2. Eric P. Bettinger & Bridget Terry Long & Philip Oreopoulos & Lisa Sanbonmatsu, 2009. "The Role of Simplification and Information in College Decisions: Results from the H&R Block FAFSA Experiment," NBER Working Papers 15361, National Bureau of Economic Research, Inc.
    3. repec:mpr:mprres:5863 is not listed on IDEAS
    4. Tuttle, Christina Clark & Gleason, Philip & Clark, Melissa, 2012. "Using lotteries to evaluate schools of choice: Evidence from a national study of charter schools," Economics of Education Review, Elsevier, vol. 31(2), pages 237-253.
    5. repec:mpr:mprres:7681 is not listed on IDEAS
    6. Peter Z. Schochet, "undated". "Statistical Power for Random Assignment Evaluations of Education Programs," Mathematica Policy Research Reports 6749d31ad72d4acf988f7dce5, Mathematica Policy Research.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jacqueline Kauff & Elizabeth Clary & Julia Lyskawa, "undated". "An Evaluation of SOAR: The Implementation and Outcomes of an Effort to Increase Access to SSI and SSDI," Mathematica Policy Research Reports c3d9cd951dbf484994fac60a4, Mathematica Policy Research.
    2. Christoph Emanuel Mueller, 2015. "Evaluating the Effectiveness of Website Content Features Using Retrospective Pretest Methodology," Evaluation Review, , vol. 39(3), pages 283-307, June.
    3. Alicia Meckstroth & Alexandra Resch & Jonathan McCay & Michelle Derr & Jillian Berk & Lauren Akers, "undated". "Advancing Evidence-Based Decision Making: A Toolkit on Recognizing and Conducting Opportunistic Experiments in the Family Self-Sufficiency and Stability Policy Area," Mathematica Policy Research Reports 1b4e98bbc73c4b6a80f6ba1c7, Mathematica Policy Research.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. repec:mpr:mprres:8126 is not listed on IDEAS
    2. Loyalka, Prashant & Song, Yingquan & Wei, Jianguo & Zhong, Weiping & Rozelle, Scott, 2013. "Information, college decisions and financial aid: Evidence from a cluster-randomized controlled trial in China," Economics of Education Review, Elsevier, vol. 36(C), pages 26-40.
    3. Kevin Booker & Brian Gill & Tim Sass & Ron Zimmer, "undated". "Charter High Schools' Effects on Long-Term Attainment and Earnings (Working Paper)," Mathematica Policy Research Reports cfe561a4b1924b7eafb64f918, Mathematica Policy Research.
    4. Scott Carrell & Bruce Sacerdote, 2017. "Why Do College-Going Interventions Work?," American Economic Journal: Applied Economics, American Economic Association, vol. 9(3), pages 124-151, July.
    5. repec:mpr:mprres:8005 is not listed on IDEAS
    6. World Bank, 2017. "Pre-Primary Education in Mongolia," World Bank Publications - Reports 26402, The World Bank Group.
    7. Sorensen, Lucy C. & Holt, Stephen B., 2021. "Sorting it Out: The Effects of Charter Expansion on Teacher and Student Composition at Traditional Public Schools," Economics of Education Review, Elsevier, vol. 82(C).
    8. repec:mpr:mprres:7927 is not listed on IDEAS
    9. Susan M. Dynarski & Steven W. Hemelt & Joshua M. Hyman, 2013. "The Missing Manual: Using National Student Clearinghouse Data to Track Postsecondary Outcomes," NBER Working Papers 19552, National Bureau of Economic Research, Inc.
    10. Giovanni Abbiati & Carlo Barone, 2017. "Is university education worth the investment? The expectations of upper secondary school seniors and the role of family background," Rationality and Society, , vol. 29(2), pages 113-159, May.
    11. Eric Bettinger & Oded Gurantz & Laura Kawano & Bruce Sacerdote, 2016. "The Long Run Impacts of Merit Aid: Evidence from California’s Cal Grant," NBER Working Papers 22347, National Bureau of Economic Research, Inc.
    12. repec:mpr:mprres:6286 is not listed on IDEAS
    13. Elizabeth Tipton & Robert B. Olsen, "undated". "Enhancing the Generalizability of Impact Studies in Education," Mathematica Policy Research Reports 35d5625333dc480aba9765b3b, Mathematica Policy Research.
    14. Robin Jacob & Marie-Andree Somers & Pei Zhu & Howard Bloom, 2016. "The Validity of the Comparative Interrupted Time Series Design for Evaluating the Effect of School-Level Interventions," Evaluation Review, , vol. 40(3), pages 167-198, June.
    15. Cox, James C. & Kreisman, Daniel & Dynarski, Susan, 2020. "Designed to fail: Effects of the default option and information complexity on student loan repayment," Journal of Public Economics, Elsevier, vol. 192(C).
    16. Christopher Rhoads, 2017. "Coherent Power Analysis in Multilevel Studies Using Parameters From Surveys," Journal of Educational and Behavioral Statistics, , vol. 42(2), pages 166-194, April.
    17. Rebecca A. Maynard, 2006. "Presidential address: Evidence-based decision making: What will it take for the decision makers to care?," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 25(2), pages 249-265.
    18. Beshears, John & Choi, James J. & Laibson, David & Madrian, Brigitte C., 2013. "Simplification and saving," Journal of Economic Behavior & Organization, Elsevier, vol. 95(C), pages 130-145.
    19. Kenneth Fortson & Natalya Verbitsky-Savitz & Emma Kopa & Philip Gleason, 2012. "Using an Experimental Evaluation of Charter Schools to Test Whether Nonexperimental Comparison Group Methods Can Replicate Experimental Impact Estimates," Mathematica Policy Research Reports 27f871b5b7b94f3a80278a593, Mathematica Policy Research.
    20. David Deming & Susan Dynarski, 2009. "Into College, Out of Poverty? Policies to Increase the Postsecondary Attainment of the Poor," NBER Working Papers 15387, National Bureau of Economic Research, Inc.
    21. Deborah Peikes & Stacy Dale & Eric Lundquist & Janice Genevro & David Meyers, 2011. "Building the Evidence Base for the Medical Home: What Sample and Sample Size Do Studies Need?," Mathematica Policy Research Reports 5814eb8219b24982af7f7536c, Mathematica Policy Research.
    22. David Deming & Susan Dynarski, 2010. "College Aid," NBER Chapters, in: Targeting Investments in Children: Fighting Poverty When Resources Are Limited, pages 283-302, National Bureau of Economic Research, Inc.
    23. Andrew P. Jaciw & Li Lin & Boya Ma, 2016. "An Empirical Study of Design Parameters for Assessing Differential Impacts for Students in Group Randomized Trials," Evaluation Review, , vol. 40(5), pages 410-443, October.
    24. repec:osf:socarx:y6wh4_v1 is not listed on IDEAS
    25. repec:mpr:mprres:6094 is not listed on IDEAS
    26. John Deke, 2016. "Design and Analysis Considerations for Cluster Randomized Controlled Trials That Have a Small Number of Clusters," Evaluation Review, , vol. 40(5), pages 444-486, October.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:mpr:mprres:b58a999ab27a4cabafac5aa080f17612. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joanne Pfleiderer or Cindy George The email address of this maintainer does not seem to be valid anymore. Please ask Cindy George to update the entry or send us the correct address (email available below). General contact details of provider: https://edirc.repec.org/data/mathius.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.