IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v47y2022i4p459-484.html

Regression Discontinuity Designs With an Ordinal Running Variable: Evaluating the Effects of Extended Time Accommodations for English-Language Learners

Author

Listed:
  • Youmi Suk

    (School of Data Science, University of Virginia, Charlottesville, VA, USA)

  • Peter M. Steiner

    (Department of Human Development and Quantitative Methodology, University of Maryland–College Park, MD, USA)

  • Jee-Seon Kim

    (Department of Educational Psychology, University of Wisconsin–Madison, WI, USA)

  • Hyunseung Kang

    (Department of Statistics, University of Wisconsin–Madison, WI, USA)

Abstract

Regression discontinuity (RD) designs are commonly used for program evaluation with continuous treatment assignment variables. But in practice, treatment assignment is frequently based on ordinal variables. In this study, we propose an RD design with an ordinal running variable to assess the effects of extended time accommodations (ETA) for English-language learners (ELLs). ETA eligibility is determined by ordinal ELL English-proficiency categories of National Assessment of Educational Progress data. We discuss the identification and estimation of the average treatment effect (ATE), intent-to-treat effect, and the local ATE at the cutoff. We also propose a series of sensitivity analyses to probe the effect estimates’ robustness to the choices of scaling functions and cutoff scores and remaining confounding.

Suggested Citation

  • Youmi Suk & Peter M. Steiner & Jee-Seon Kim & Hyunseung Kang, 2022. "Regression Discontinuity Designs With an Ordinal Running Variable: Evaluating the Effects of Extended Time Accommodations for English-Language Learners," Journal of Educational and Behavioral Statistics, , vol. 47(4), pages 459-484, August.
  • Handle: RePEc:sae:jedbes:v:47:y:2022:i:4:p:459-484
    DOI: 10.3102/10769986221090275
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/10769986221090275
    Download Restriction: no

    File URL: https://libkey.io/10.3102/10769986221090275?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Andreas Oranje & Andrew Kolstad, 2019. "Research on Psychometric Modeling, Analysis, and Reporting of the National Assessment of Educational Progress," Journal of Educational and Behavioral Statistics, , vol. 44(6), pages 648-670, December.
    2. Adam C. Sales & Ben B. Hansen, 2020. "Limitless Regression Discontinuity," Journal of Educational and Behavioral Statistics, , vol. 45(2), pages 143-174, April.
    3. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    4. Bates, Douglas & Mächler, Martin & Bolker, Ben & Walker, Steve, 2015. "Fitting Linear Mixed-Effects Models Using lme4," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 67(i01).
    5. R. Bradley & S. Katti & Irma Coons, 1962. "Optimal scaling for ordered categories," Psychometrika, Springer;The Psychometric Society, vol. 27(4), pages 355-374, December.
    6. Michal Kolesár & Christoph Rothe, 2018. "Inference in Regression Discontinuity Designs with a Discrete Running Variable," American Economic Review, American Economic Association, vol. 108(8), pages 2277-2304, August.
    7. Hong, Guanglei & Raudenbush, Stephen W., 2006. "Evaluating Kindergarten Retention Policy: A Case Study of Causal Inference for Multilevel Observational Data," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 901-910, September.
    8. Lee, David S. & Card, David, 2008. "Regression discontinuity inference with specification error," Journal of Econometrics, Elsevier, vol. 142(2), pages 655-674, February.
    9. Imbens, Guido W. & Lemieux, Thomas, 2008. "Regression discontinuity designs: A guide to practice," Journal of Econometrics, Elsevier, vol. 142(2), pages 615-635, February.
    10. Hahn, Jinyong & Todd, Petra & Van der Klaauw, Wilbert, 2001. "Identification and Estimation of Treatment Effects with a Regression-Discontinuity Design," Econometrica, Econometric Society, vol. 69(1), pages 201-209, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Youmi Suk & Yongnam Kim, 2025. "Fuzzy Regression Discontinuity Designs With Multiple Control Groups Under One-Sided Noncompliance: Evaluating Extended Time Accommodations," Journal of Educational and Behavioral Statistics, , vol. 50(6), pages 962-984, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Blaise Melly & Rafael Lalive, 2020. "Estimation, Inference, and Interpretation in the Regression Discontinuity Design," Diskussionsschriften dp2016, Universitaet Bern, Departement Volkswirtschaft.
    2. Yang He & Otávio Bartalotti, 2020. "Wild bootstrap for fuzzy regression discontinuity designs: obtaining robust bias-corrected confidence intervals," The Econometrics Journal, Royal Economic Society, vol. 23(2), pages 211-231.
    3. Strazzeri, Maurizio, 2021. "Assessing the Role of Asylum Policies in Refugees' Labor Market Integration: The Case of Protection Statuses in the German Asylum System," VfS Annual Conference 2021 (Virtual Conference): Climate Economics 242395, Verein für Socialpolitik / German Economic Association.
    4. Gaggero, Alessio & Gil, Joan & Jiménez-Rubio, Dolores & Zucchelli, Eugenio, 2022. "Does health information affect lifestyle behaviours? The impact of a diabetes diagnosis," Social Science & Medicine, Elsevier, vol. 314(C).
    5. Dean Eckles & Nikolaos Ignatiadis & Stefan Wager & Han Wu, 2020. "Noise-Induced Randomization in Regression Discontinuity Designs," Papers 2004.09458, arXiv.org, revised Mar 2025.
    6. Matias D. Cattaneo & Rocío Titiunik, 2022. "Regression Discontinuity Designs," Annual Review of Economics, Annual Reviews, vol. 14(1), pages 821-851, August.
    7. Onda, Masayuki & Seyler, Edward, 2020. "English learners reclassification and academic achievement: Evidence from Minnesota," Economics of Education Review, Elsevier, vol. 79(C).
    8. Guido Imbens & Stefan Wager, 2019. "Optimized Regression Discontinuity Designs," The Review of Economics and Statistics, MIT Press, vol. 101(2), pages 264-278, May.
    9. Gaggero, A. & Gil, J. & Jiménez-Rubio, D. & Zucchelli, E., 2021. "Health information and lifestyle behaviours: the impact of a diabetes diagnosis," Health, Econometrics and Data Group (HEDG) Working Papers 21/02, HEDG, c/o Department of Economics, University of York.
    10. John P. Papay & Richard J. Murnane & John B. Willett, 2011. "How Performance Information Affects Human-Capital Investment Decisions: The Impact of Test-Score Labels on Educational Outcomes," NBER Working Papers 17120, National Bureau of Economic Research, Inc.
    11. Jean‐Louis Arcand & Eric Djimeu Wouabe, 2010. "Teacher training and HIV/AIDS prevention in West Africa: regression discontinuity design evidence from the Cameroon," Health Economics, John Wiley & Sons, Ltd., vol. 19(S1), pages 36-54, September.
    12. Cummins, Neil, 2025. "The causal effects of education on age at marriage and marital fertility," LSE Research Online Documents on Economics 126514, London School of Economics and Political Science, LSE Library.
    13. Lina Cardona-Sosa & Carlos Medina & Jairo Nuñez Méndez, 2017. "Impacto de las Transferencias Condicionadas sobre el Mercado de Crédito El caso de Familias en Acción en Colombia," Borradores de Economia 995, Banco de la Republica de Colombia.
    14. Joaquín Artés & Ignacio Jurado, 2018. "Government fragmentation and fiscal deficits: a regression discontinuity approach," Public Choice, Springer, vol. 175(3), pages 367-391, June.
    15. David Wilkinson & Rebecca Riley, 2011. "The UK Minimum Wage at Age 22: A Regression Discontinuity Approach," National Institute of Economic and Social Research (NIESR) Discussion Papers 378, National Institute of Economic and Social Research.
    16. Berlinski, Samuel & Ramos, Alejandra, 2020. "Peer effects in the decision to apply for a professional excellence award," Labour Economics, Elsevier, vol. 67(C).
    17. Mauricio Villamizar‐Villegas & Freddy A. Pinzon‐Puerto & Maria Alejandra Ruiz‐Sanchez, 2022. "A comprehensive history of regression discontinuity designs: An empirical survey of the last 60 years," Journal of Economic Surveys, Wiley Blackwell, vol. 36(4), pages 1130-1178, September.
    18. Bradley R. Curs & Casandra E. Harper & Charles Frey & Brandon Wolak, 2023. "The Effect of College Football Bowl Game Participation on Student-Athlete Academic Outcomes and Team Athletic Success," Research in Higher Education, Springer;Association for Institutional Research, vol. 64(4), pages 497-519, June.
    19. Hızıroğlu Aygün, Aysun & Kırdar, Murat Güray & Koyuncu, Murat & Stoeffler, Quentin, 2024. "Keeping refugee children in school and out of work: Evidence from the world's largest humanitarian cash transfer program," Journal of Development Economics, Elsevier, vol. 168(C).
    20. Einiö, Elias & Overman, Henry G., 2020. "The effects of supporting local business: Evidence from the UK," Regional Science and Urban Economics, Elsevier, vol. 83(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:47:y:2022:i:4:p:459-484. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.