IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v50y2025i3p420-448.html
   My bibliography  Save this article

Approaches to Statistical Efficiency When Comparing the Embedded Adaptive Interventions in a SMART

Author

Listed:
  • Timothy Lycurgus

    (University of Michigan)

  • Amy Kilbourne

    (University of Michigan Medical School)

  • Daniel Almirall

    (University of Michigan)

Abstract

Sequential, multiple assignment randomized trials (SMARTs), which assist in the optimization of adaptive interventions, are growing in popularity in education and behavioral sciences. This is unsurprising, as adaptive interventions reflect the sequential, tailored nature of learning in a classroom or school. Nonetheless, as is true elsewhere in education research, observed effect sizes in education-based SMARTs are frequently small. As a consequence, statistical efficiency is of paramount importance in their analysis. The contributions of this manuscript are twofold. First, we provide an overview of adaptive interventions and SMART designs for researchers in education science. Second, we propose four techniques that have the potential to improve statistical efficiency in the analysis of SMARTs. We demonstrate the benefits of these techniques in SMART settings both through the analysis of a SMART designed to optimize an adaptive intervention for increasing cognitive behavioral therapy delivery in school settings and through a comprehensive simulation study. Each of the proposed techniques is easily implementable, either with over-the-counter statistical software or through R code provided in Supplemental Material.

Suggested Citation

  • Timothy Lycurgus & Amy Kilbourne & Daniel Almirall, 2025. "Approaches to Statistical Efficiency When Comparing the Embedded Adaptive Interventions in a SMART," Journal of Educational and Behavioral Statistics, , vol. 50(3), pages 420-448, June.
    • Handle: RePEc:sae:jedbes:v:50:y:2025:i:3:p:420-448
    DOI: 10.3102/10769986241251419
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/10769986241251419
    Download Restriction: no
    File URL: https://libkey.io/10.3102/10769986241251419?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    More about this item

    Keywords

    Statistical Efficiency; Study Design;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:50:y:2025:i:3:p:420-448. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.