IDEAS home Printed from
   My bibliography  Save this paper

Replicating Experimental Impact Estimates with Nonexperimental Methods in the Context of Control Crossover


  • Brian Gill
  • Joshua Furgeson
  • Hanley S. Chiang
  • Bing-Ru Teh
  • Joshua Haimson
  • Natalya Verbitsky-Savitz


Ideally, nonexperimental methods that aim to replicate the results of rigorous randomized experiments focus on the intent to treat (ITT) experimental impact estimate, the most causally rigorous measure. This working paper develops a new replication approach that facilitates testing nonexperimental methods against rigorous experimental ITT impact estimates when the experiment includes substantial control crossover.

Suggested Citation

  • Brian Gill & Joshua Furgeson & Hanley S. Chiang & Bing-Ru Teh & Joshua Haimson & Natalya Verbitsky-Savitz, 2013. "Replicating Experimental Impact Estimates with Nonexperimental Methods in the Context of Control Crossover," Mathematica Policy Research Reports 2798055510274fa9b4fdfa54b, Mathematica Policy Research.
  • Handle: RePEc:mpr:mprres:2798055510274fa9b4fdfa54b5a263d0

    Download full text from publisher

    File URL:
    Download Restriction: no

    References listed on IDEAS

    1. repec:mpr:mprres:5572 is not listed on IDEAS
    2. Philip Gleason & Melissa Clark & Christina Clark Tuttle & Emily Dwoyer, "undated". "The Evaluation of Charter School Impacts," Mathematica Policy Research Reports 3066da11915a4b04a77b38848, Mathematica Policy Research.
    3. David McKenzie & John Gibson & Steven Stillman, 2010. "How Important Is Selection? Experimental vs. Non-Experimental Measures of the Income Gains from Migration," Journal of the European Economic Association, MIT Press, vol. 8(4), pages 913-945, June.
    4. repec:mpr:mprres:6676 is not listed on IDEAS
    5. Kenneth Fortson & Natalya Verbitsky-Savitz & Emma Kopa & Philip Gleason, 2012. "Using an Experimental Evaluation of Charter Schools to Test Whether Nonexperimental Comparison Group Methods Can Replicate Experimental Impact Estimates," Mathematica Policy Research Reports 27f871b5b7b94f3a80278a593, Mathematica Policy Research.
    6. repec:mpr:mprres:7293 is not listed on IDEAS
    7. Atila Abdulkadiroğlu & Joshua D. Angrist & Susan M. Dynarski & Thomas J. Kane & Parag A. Pathak, 2011. "Accountability and Flexibility in Public Schools: Evidence from Boston's Charters And Pilots," The Quarterly Journal of Economics, Oxford University Press, vol. 126(2), pages 699-748.
    8. repec:mpr:mprres:6720 is not listed on IDEAS
    9. Kenneth A. Couch & Robert Bifulco, 2012. "Can Nonexperimental Estimates Replicate Estimates Based on Random Assignment in Evaluations of School Choice? A Within‐Study Comparison," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 31(3), pages 729-751, June.
    10. Philip Gleason & Melissa Clark & Christina Clark Tuttle & Emily Dwoyer, 2010. "The Evaluation of Charter School Impacts (Presentation)," Mathematica Policy Research Reports 770e250b2ef343a3b1ec8c932, Mathematica Policy Research.
    11. repec:mpr:mprres:7443 is not listed on IDEAS
    12. Caroline M. Hoxby & Sonali Murarka, 2009. "Charter Schools in New York City: Who Enrolls and How They Affect Their Students' Achievement," NBER Working Papers 14852, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)


    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.

    Cited by:

    1. Joshua Furgeson & Moira McCullough & Clare Wolfendale & Brian Gill, "undated". "The Equity Project Charter School: Impacts on Student Achievement (Final Report)," Mathematica Policy Research Reports 9ed165ddb03646a496128da4d, Mathematica Policy Research.

    More about this item


    Replicating; Experimental Impact Estimates; Education; Nonexperimental Methods; Control Crossover ; Working Paper 21;

    JEL classification:

    • I - Health, Education, and Welfare

    NEP fields

    This paper has been announced in the following NEP Reports:


    Access and download statistics


    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:mpr:mprres:2798055510274fa9b4fdfa54b5a263d0. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Joanne Pfleiderer) or (Cindy George). General contact details of provider: .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.