IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2507.00795.html
   My bibliography  Save this paper

Randomization Inference with Sample Attrition

Author

Listed:
  • Xinran Li
  • Peizan Sheng
  • Zeyang Yu

Abstract

Although appealing, randomization inference for treatment effects can suffer from severe size distortion due to sample attrition. We propose new, computationally efficient methods for randomization inference that remain valid under a range of potentially informative missingness mechanisms. We begin by constructing valid p-values for testing sharp null hypotheses, using the worst-case p-value from the Fisher randomization test over all possible imputations of missing outcomes. Leveraging distribution-free test statistics, this worst-case p-value admits a closed-form solution, connecting naturally to bounds in the partial identification literature. Our test statistics incorporate both potential outcomes and missingness indicators, allowing us to exploit structural assumptions-such as monotone missingness-for increased power. We further extend our framework to test non-sharp null hypotheses concerning quantiles of individual treatment effects. The methods are illustrated through simulations and an empirical application.

Suggested Citation

  • Xinran Li & Peizan Sheng & Zeyang Yu, 2025. "Randomization Inference with Sample Attrition," Papers 2507.00795, arXiv.org.
  • Handle: RePEc:arx:papers:2507.00795
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2507.00795
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. David S. Lee, 2009. "Training, Wages, and Sample Selection: Estimating Sharp Bounds on Treatment Effects," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(3), pages 1071-1102.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Juan Pablo Atal & José Ignacio Cuesta & Felipe González & Cristóbal Otero, 2024. "The Economics of the Public Option: Evidence from Local Pharmaceutical Markets," American Economic Review, American Economic Association, vol. 114(3), pages 615-644, March.
    2. Johannes Abeler & Armin Falk & Fabian Kosse, 2025. "Malleability of Preferences for Honesty," The Economic Journal, Royal Economic Society, vol. 135(667), pages 982-998.
    3. Turner, Alex J. & Fichera, Eleonora & Sutton, Matt, 2021. "The effects of in-utero exposure to influenza on mental health and mortality risk throughout the life-course," Economics & Human Biology, Elsevier, vol. 43(C).
    4. Jason M. Lindo & Nicholas J. Sanders & Philip Oreopoulos, 2010. "Ability, Gender, and Performance Standards: Evidence from Academic Probation," American Economic Journal: Applied Economics, American Economic Association, vol. 2(2), pages 95-117, April.
    5. Teresa Molina Millán & Karen Macours, 2017. "Attrition in randomized control trials: Using tracking information to correct bias," FEUNL Working Paper Series novaf:wp1702, Universidade Nova de Lisboa, Faculdade de Economia.
    6. Bonesrønning, Hans & Finseraas, Henning & Hardoy, Ines & Iversen, Jon Marius Vaag & Nyhus, Ole Henning & Opheim, Vibeke & Salvanes, Kari Vea & Sandsør, Astrid Marie Jorde & Schøne, Pål, 2022. "Small-group instruction to improve student performance in mathematics in early grades: Results from a randomized field experiment," Journal of Public Economics, Elsevier, vol. 216(C).
    7. Upasak Das & Rupayan Pal & Udayan Rathore & Bibhas Saha, 2023. "Rein in pandemic by pricing vaccine: Does social trust matter?," Indira Gandhi Institute of Development Research, Mumbai Working Papers 2023-008, Indira Gandhi Institute of Development Research, Mumbai, India.
    8. María laura Alzúa & Guillermo Cruces & Carolina Lopez, 2016. "Long-Run Effects Of Youth Training Programs: Experimental Evidence From Argentina," Economic Inquiry, Western Economic Association International, vol. 54(4), pages 1839-1859, October.
    9. Kjetil Bjorvatn & Alexander W. Cappelen & Linda Helgesson Sekei & Erik Ø. Sørensen & Bertil Tungodden, 2020. "Teaching Through Television: Experimental Evidence on Entrepreneurship Education in Tanzania," Management Science, INFORMS, vol. 66(6), pages 2308-2325, June.
    10. Bhalotra, Sonia & Clarke, Damian & Mühlrad, Hanna & Palme, Mårten, 2021. "Health and Labor Market Impacts of Twin Birth : Evidence from a Swedish IVF Policy Mandate," The Warwick Economics Research Paper Series (TWERPS) 1391, University of Warwick, Department of Economics.
    11. León, Gianmarco, 2017. "Turnout, political preferences and information: Experimental evidence from Peru," Journal of Development Economics, Elsevier, vol. 127(C), pages 56-71.
    12. Fabian Kosse & Thomas Deckers & Pia Pinger & Hannah Schildberg-Hörisch & Armin Falk, 2020. "The Formation of Prosociality: Causal Evidence on the Role of Social Environment," Journal of Political Economy, University of Chicago Press, vol. 128(2), pages 434-467.
    13. Holla,Alaka & Bendini,Maria Magdalena & Dinarte Diaz,Lelys Ileana & Trako,Iva, 2021. "Is Investment in Preprimary Education Too Low ? Lessons from (Quasi) ExperimentalEvidence across Countries," Policy Research Working Paper Series 9723, The World Bank.
    14. Roland Fryer & Steven Levitt & John List & Anya Samek, 2020. "Introducing CogX: A New Preschool Education Program Combining Parent and Child Interventions," Framed Field Experiments 00718, The Field Experiments Website.
    15. Antonia Grohmann & Lukas Menkhoff & Helke Seitz, 2022. "The Effect of Personalized Feedback on Small Enterprises’ Finances in Uganda," Economic Development and Cultural Change, University of Chicago Press, vol. 70(3), pages 1197-1227.
    16. Sudhanshu Handa & David Seidenfeld & Benjamin Davis & Gelson Tembo & Zambia Cash Transfer Evaluation Team, 2016. "The Social and Productive Impacts of Zambia's Child Grant," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 35(2), pages 357-387, April.
    17. Lössbroek, Jelle & Radl, Jonas, 2019. "Teaching older workers new tricks: workplace practices and gender training differences in nine European countries," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 39(10), pages 2170-2193.
    18. Wang, Xintong & Flores, Carlos A. & Flores-Lagunes, Alfonso, 2025. "The effects of Vietnam-era military service on the long-term health of veterans: A bounds analysis," Journal of Health Economics, Elsevier, vol. 101(C).
    19. Jiannan Lu & Peng Ding & Tirthankar Dasgupta, 2018. "Treatment Effects on Ordinal Outcomes: Causal Estimands and Sharp Bounds," Journal of Educational and Behavioral Statistics, , vol. 43(5), pages 540-567, October.
    20. Bauchet, Jonathan & Chakravarty, Sugato & Hunter, Brian, 2018. "Separating the wheat from the chaff: Signaling in microfinance loans," World Development, Elsevier, vol. 106(C), pages 40-50.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2507.00795. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.