IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2607.04257.html

Randomization Tests in Randomized Saturation Designs

Author

Listed:
  • Jizhou Liu
  • Azeem M. Shaikh
  • Liang Zhong

Abstract

Randomized saturation designs are widely used to study spillover effects in clustered populations. In these designs, clusters are first assigned to treatment saturation levels, and units are then randomized within clusters according to the assigned saturation. This paper develops randomization tests for such experiments under several null hypotheses that arise naturally in spillover analysis. For a fixed pair of saturation levels, we first study two individual-level hypotheses: a partially sharp null of no spillover effect for every untreated unit and a bounded null that restricts individual spillover effects by a prespecified constant. Both hypotheses can be tested using a common conditional randomization framework, with finite-sample validity obtained by combining the same focal-unit relabeling distribution with null-specific statistics. We then study weak average-spillover nulls and show that, although these nulls do not yield finite-sample exact conditional tests, studentized relabeling statistics deliver asymptotically valid randomization-based inference. Finally, for multiple ordered saturation levels, we develop a finite-sample valid unconditional pairwise-imputation test for global monotonicity of spillover effects. Simulations and an application to the Zomba Cash Transfer experiment illustrate the finite-sample behavior and practical implementation of the methods.

Suggested Citation

  • Jizhou Liu & Azeem M. Shaikh & Liang Zhong, 2026. "Randomization Tests in Randomized Saturation Designs," Papers 2607.04257, arXiv.org.
  • Handle: RePEc:arx:papers:2607.04257
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2607.04257
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Guillermo Cruces & Dario Tortarolo & Gonzalo Vazquez-Bare, 2023. "Design of partial population experiments with an application to spillovers in tax compliance," IFS Working Papers W23/17, Institute for Fiscal Studies.
    2. Laura Forastiere & Edoardo M. Airoldi & Fabrizia Mealli, 2021. "Identification and Estimation of Treatment and Interference Effects in Observational Studies on Networks," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(534), pages 901-918, April.
    3. Guillaume Basse & Peng Ding & Avi Feller & Panos Toulis, 2024. "Randomization Tests for Peer Effects in Group Formation Experiments," Econometrica, Econometric Society, vol. 92(2), pages 567-590, March.
    4. Liu, Jizhou, 2026. "Inference for two-stage experiments under covariate-adaptive randomization," Journal of Econometrics, Elsevier, vol. 253(C).
    5. G W Basse & A Feller & P Toulis, 2019. "Randomization tests of causal effects under interference," Biometrika, Biometrika Trust, vol. 106(2), pages 487-494.
    6. Susan Athey & Dean Eckles & Guido W. Imbens, 2018. "Exact p-Values for Network Interference," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(521), pages 230-240, January.
    7. Kosuke Imai & Zhichao Jiang & Anup Malani, 2021. "Causal Inference With Interference and Noncompliance in Two-Stage Randomized Experiments," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(534), pages 632-644, April.
    8. Hudgens, Michael G. & Halloran, M. Elizabeth, 2008. "Toward Causal Inference With Interference," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 832-842, June.
    9. Imbens,Guido W. & Rubin,Donald B., 2015. "Causal Inference for Statistics, Social, and Biomedical Sciences," Cambridge Books, Cambridge University Press, number 9780521885881.
    10. Jizhou Liu & Liang Zhong, 2026. "Randomization Tests in Switchback Experiments," Papers 2602.23257, arXiv.org.
    11. Guillaume Basse & Avi Feller, 2018. "Analyzing Two-Stage Experiments in the Presence of Interference," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(521), pages 41-55, January.
    12. Cyrus J. DiCiccio & Joseph P. Romano, 2017. "Robust Permutation Tests For Correlation And Regression Coefficients," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(519), pages 1211-1220, July.
    13. Zhao, Anqi & Ding, Peng, 2021. "Covariate-adjusted Fisher randomization tests for the average treatment effect," Journal of Econometrics, Elsevier, vol. 225(2), pages 278-294.
    14. Jizhou Liu, 2023. "Inference for Two-stage Experiments under Covariate-Adaptive Randomization," Papers 2301.09016, arXiv.org, revised Jan 2026.
    15. Sarah Baird & J. Aislinn Bohren & Craig McIntosh & Berk Özler, 2018. "Optimal Design of Experiments in the Presence of Interference," The Review of Economics and Statistics, MIT Press, vol. 100(5), pages 844-860, December.
    16. Jizhou Liu & Azeem M. Shaikh & Panos Toulis, 2025. "Randomization Inference in Two-Sided Market Experiments," Papers 2504.06215, arXiv.org, revised Mar 2026.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liu, Jizhou, 2026. "Inference for two-stage experiments under covariate-adaptive randomization," Journal of Econometrics, Elsevier, vol. 253(C).
    2. Yuehao Bai & Azeem M. Shaikh & Max Tabord-Meehan, 2024. "A Primer on the Analysis of Randomized Experiments and a Survey of some Recent Advances," Papers 2405.03910, arXiv.org, revised Apr 2025.
    3. Jizhou Liu & Liang Zhong, 2026. "Randomization Tests in Switchback Experiments," Papers 2602.23257, arXiv.org.
    4. Jizhou Liu & Azeem M. Shaikh & Panos Toulis, 2025. "Randomization Inference in Two-Sided Market Experiments," Papers 2504.06215, arXiv.org, revised Mar 2026.
    5. Tadao Hoshino & Takahide Yanagi, 2024. "Causal Inference with Noncompliance and Unknown Interference," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 119(548), pages 2869-2880, October.
    6. Han, Kevin & Basse, Guillaume & Bojinov, Iavor, 2024. "Population interference in panel experiments," Journal of Econometrics, Elsevier, vol. 238(1).
    7. Ariel Boyarsky & Hongseok Namkoong & Jean Pouget-Abadie, 2023. "Modeling Interference Using Experiment Roll-out," Papers 2305.10728, arXiv.org, revised Aug 2023.
    8. Gao, Mengsi & Ding, Peng, 2025. "Causal inference in network experiments: Regression-based analysis and design-based properties," Journal of Econometrics, Elsevier, vol. 252(PA).
    9. Nicolas Debarsy & Julie Le Gallo, 2025. "Identification of Spatial Spillovers: Do's and Don'ts," Journal of Economic Surveys, Wiley Blackwell, vol. 39(5), pages 2152-2173, December.
    10. repec:hal:journl:hal-04549691 is not listed on IDEAS
    11. Jizhou Liu, 2023. "Inference for Two-stage Experiments under Covariate-Adaptive Randomization," Papers 2301.09016, arXiv.org, revised Jan 2026.
    12. David M. Ritzwoller & Joseph P. Romano & Azeem M. Shaikh, 2024. "Randomization Inference: Theory and Applications," Papers 2406.09521, arXiv.org, revised Feb 2025.
    13. Julius Owusu, 2023. "Randomization Inference of Heterogeneous Treatment Effects under Network Interference," Papers 2308.00202, arXiv.org, revised Jun 2025.
    14. Guillermo Cruces & Dario Tortarolo & Gonzalo Vazquez-Bare, 2023. "Design of partial population experiments with an application to spillovers in tax compliance," IFS Working Papers W23/17, Institute for Fiscal Studies.
    15. Zhaonan Qu & Ruoxuan Xiong & Jizhou Liu & Guido Imbens, 2021. "Semiparametric Estimation of Treatment Effects in Observational Studies with Heterogeneous Partial Interference," Papers 2107.12420, arXiv.org, revised Jun 2024.
    16. Vazquez-Bare, Gonzalo, 2023. "Identification and estimation of spillover effects in randomized experiments," Journal of Econometrics, Elsevier, vol. 237(1).
    17. Michael P. Leung, 2022. "Causal Inference Under Approximate Neighborhood Interference," Econometrica, Econometric Society, vol. 90(1), pages 267-293, January.
    18. Vasiliki Koutra & Steven G. Gilmour & Ben M. Parker & Andrew Mead, 2023. "Design of Agricultural Field Experiments Accounting for both Complex Blocking Structures and Network Effects," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 28(3), pages 526-548, September.
    19. Stefan Wager & Kuang Xu, 2021. "Experimenting in Equilibrium," Management Science, INFORMS, vol. 67(11), pages 6694-6715, November.
    20. Davide Viviano & Jess Rudder, 2020. "Policy design in experiments with unknown interference," Papers 2011.08174, arXiv.org, revised Jun 2026.
    21. Evan Munro & Xu Kuang & Stefan Wager, 2021. "Treatment Effects in Market Equilibrium," Papers 2109.11647, arXiv.org, revised Feb 2025.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2607.04257. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.