IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v47y2022i6p639-665.html
   My bibliography  Save this article

Pooling Interactions Into Error Terms in Multisite Experiments

Author

Listed:
  • Wendy Chan

    (University of Pennsylvania)

  • Larry Vernon Hedges

    (Northwestern University)

Abstract

Multisite field experiments using the (generalized) randomized block design that assign treatments to individuals within sites are common in education and the social sciences. Under this design, there are two possible estimands of interest and they differ based on whether sites or blocks have fixed or random effects. When the average treatment effect is assumed to be identical across sites, it is common to omit site by treatment interactions and “pool†them into the error term in classical experimental design. However, prior work has not addressed the consequences of pooling when site by treatment interactions are not zero. This study assesses the impact of pooling on inference in the presence of nonzero site by treatment interactions. We derive the small sample distributions of the test statistics for treatment effects under pooling and illustrate the impacts on rejection rates when interactions are not zero. We use the results to offer recommendations to researchers conducting studies based on the multisite design.

Suggested Citation

  • Wendy Chan & Larry Vernon Hedges, 2022. "Pooling Interactions Into Error Terms in Multisite Experiments," Journal of Educational and Behavioral Statistics, , vol. 47(6), pages 639-665, December.
    • Handle: RePEc:sae:jedbes:v:47:y:2022:i:6:p:639-665
    DOI: 10.3102/10769986221104800
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/10769986221104800
    Download Restriction: no
    File URL: https://libkey.io/10.3102/10769986221104800?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:47:y:2022:i:6:p:639-665. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.