IDEAS home Printed from https://ideas.repec.org/a/bla/biomet/v79y2023i3p2127-2142.html
   My bibliography  Save this article

Pair‐switching rerandomization

Author

Listed:
  • Ke Zhu
  • Hanzhong Liu

Abstract

Rerandomization discards assignments with covariates unbalanced in the treatment and control groups to improve estimation and inference efficiency. However, the acceptance‐rejection sampling method used in rerandomization is computationally inefficient. As a result, it is time‐consuming for rerandomization to draw numerous independent assignments, which are necessary for performing Fisher randomization tests and constructing randomization‐based confidence intervals. To address this problem, we propose a pair‐switching rerandomization (PSRR) method to draw balanced assignments efficiently. We obtain the unbiasedness and variance reduction of the difference‐in‐means estimator and show that the Fisher randomization tests are valid under PSRR. Moreover, we propose an exact approach to invert Fisher randomization tests to confidence intervals, which is faster than the existing methods. In addition, our method is applicable to both nonsequentially and sequentially randomized experiments. We conduct comprehensive simulation studies to compare the finite‐sample performance of the proposed method with that of classical rerandomization. Simulation results indicate that PSRR leads to comparable power of Fisher randomization tests and is 3–23 times faster than classical rerandomization. Finally, we apply the PSRR method to analyze two clinical trial datasets, both of which demonstrate the advantages of our method.

Suggested Citation

  • Ke Zhu & Hanzhong Liu, 2023. "Pair‐switching rerandomization," Biometrics, The International Biometric Society, vol. 79(3), pages 2127-2142, September.
  • Handle: RePEc:bla:biomet:v:79:y:2023:i:3:p:2127-2142
    DOI: 10.1111/biom.13712
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/biom.13712
    Download Restriction: no

    File URL: https://libkey.io/10.1111/biom.13712?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Miriam Bruhn & David McKenzie, 2009. "In Pursuit of Balance: Randomization in Practice in Development Field Experiments," American Economic Journal: Applied Economics, American Economic Association, vol. 1(4), pages 200-232, October.
    2. Constantine E. Frangakis & Donald B. Rubin, 2002. "Principal Stratification in Causal Inference," Biometrics, The International Biometric Society, vol. 58(1), pages 21-29, March.
    3. Zhenzhen Xu & John D. Kalbfleisch, 2010. "Propensity Score Matching in Randomized Clinical Trials," Biometrics, The International Biometric Society, vol. 66(3), pages 813-823, September.
    4. Adam Kapelner & Abba M. Krieger & Michael Sklar & Uri Shalit & David Azriel, 2021. "Harmonizing Optimized Designs With Classic Randomization in Experiments," The American Statistician, Taylor & Francis Journals, vol. 75(2), pages 195-206, May.
    5. Kari Lock Morgan & Donald B. Rubin, 2015. "Rerandomization to Balance Tiers of Covariates," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(512), pages 1412-1421, December.
    6. Peter L. Cohen & Colin B. Fogarty, 2022. "Gaussian prepivoting for finite population causal inference," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(2), pages 295-320, April.
    7. Xinran Li & Peng Ding, 2020. "Rerandomization and regression adjustment," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 82(1), pages 241-268, February.
    8. Young, Alwyn, 2019. "Channeling Fisher: randomization tests and the statistical insignificance of seemingly significant experimental results," LSE Research Online Documents on Economics 101401, London School of Economics and Political Science, LSE Library.
    9. Per Johansson & Donald B. Rubin & Mårten Schultzberg, 2021. "On optimal rerandomization designs," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 83(2), pages 395-403, April.
    10. Keele, Luke, 2015. "The Statistics of Causal Inference: A View from Political Methodology," Political Analysis, Cambridge University Press, vol. 23(3), pages 313-335, July.
    11. Zhao, Anqi & Ding, Peng, 2021. "Covariate-adjusted Fisher randomization tests for the average treatment effect," Journal of Econometrics, Elsevier, vol. 225(2), pages 278-294.
    12. Jason Wu & Peng Ding, 2021. "Randomization Tests for Weak Null Hypotheses in Randomized Experiments," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1898-1913, October.
    13. Alwyn Young, 2019. "Channeling Fisher: Randomization Tests and the Statistical Insignificance of Seemingly Significant Experimental Results," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(2), pages 557-598.
    14. Xiaokang Luo & Tirthankar Dasgupta & Minge Xie & Regina Y. Liu, 2021. "Leveraging the Fisher randomization test using confidence distributions: Inference, combination and fusion learning," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 83(4), pages 777-797, September.
    15. Dimitris Bertsimas & Nikita Korolko & Alexander M. Weinstein, 2019. "Covariate-Adaptive Optimization in Online Clinical Trials," Operations Research, INFORMS, vol. 67(4), pages 1150-1161, July.
    16. Abhijit V. Banerjee & Sylvain Chassang & Sergio Montero & Erik Snowberg, 2020. "A Theory of Experimenters: Robustness, Randomization, and Balance," American Economic Review, American Economic Association, vol. 110(4), pages 1206-1230, April.
    17. Rubin, Donald B., 2008. "Comment: The Design and Analysis of Gold Standard Randomized Experiments," Journal of the American Statistical Association, American Statistical Association, vol. 103(484), pages 1350-1353.
    18. Imbens,Guido W. & Rubin,Donald B., 2015. "Causal Inference for Statistics, Social, and Biomedical Sciences," Cambridge Books, Cambridge University Press, number 9780521885881.
    19. Tong Wang & Wei Ma, 2021. "The impact of misclassification on covariate‐adaptive randomized clinical trials," Biometrics, The International Biometric Society, vol. 77(2), pages 451-464, June.
    20. Quan Zhou & Philip A Ernst & Kari Lock Morgan & Donald B Rubin & Anru Zhang, 2018. "Sequential rerandomization," Biometrika, Biometrika Trust, vol. 105(3), pages 745-752.
    21. Lihua Lei & Peng Ding, 2021. "Regression adjustment in completely randomized experiments with a diverging number of covariates [Covariance adjustments for the analysis of randomized field experiments]," Biometrika, Biometrika Trust, vol. 108(4), pages 815-828.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ganesh Karapakula, 2023. "Stable Probability Weighting: Large-Sample and Finite-Sample Estimation and Inference Methods for Heterogeneous Causal Effects of Multivalued Treatments Under Limited Overlap," Papers 2301.05703, arXiv.org, revised Jan 2023.
    2. Zhao, Anqi & Ding, Peng, 2021. "Covariate-adjusted Fisher randomization tests for the average treatment effect," Journal of Econometrics, Elsevier, vol. 225(2), pages 278-294.
    3. Yang, Haoyu & Qin, Yichen & Wang, Fan & Li, Yang & Hu, Feifang, 2023. "Balancing covariates in multi-arm trials via adaptive randomization," Computational Statistics & Data Analysis, Elsevier, vol. 179(C).
    4. James J. Heckman & Ganesh Karapakula, 2019. "The Perry Preschoolers at Late Midlife: A Study in Design-Specific Inference," Working Papers 2019-034, Human Capital and Economic Opportunity Working Group.
    5. James J Heckman & Ganesh Karapakula, 2021. "Using a satisficing model of experimenter decision-making to guide finite-sample inference for compromised experiments," The Econometrics Journal, Royal Economic Society, vol. 24(2), pages 1-39.
    6. Hengtao Zhang & Guosheng Yin, 2021. "Response‐adaptive rerandomization," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 70(5), pages 1281-1298, November.
    7. Johnsen, Åshild A. & Kvaløy, Ola, 2021. "Conspiracy against the public - An experiment on collusion11“People of the same trade seldom meet together, even for merriment and diversion, but the conversation ends in a conspiracy against the publ," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 94(C).
    8. Pedro Carneiro & Sokbae Lee & Daniel Wilhelm, 2020. "Optimal data collection for randomized control trials [Microcredit impacts: Evidence from a randomized microcredit program placement experiment by Compartamos Banco]," The Econometrics Journal, Royal Economic Society, vol. 23(1), pages 1-31.
    9. Adam Kapelner & Abba Krieger, 2023. "A matching procedure for sequential experiments that iteratively learns which covariates improve power," Biometrics, The International Biometric Society, vol. 79(1), pages 216-229, March.
    10. Jiang, Liang & Phillips, Peter C.B. & Tao, Yubo & Zhang, Yichong, 2023. "Regression-adjusted estimation of quantile treatment effects under covariate-adaptive randomizations," Journal of Econometrics, Elsevier, vol. 234(2), pages 758-776.
    11. MacKinnon, James G. & Nielsen, Morten Ørregaard & Webb, Matthew D., 2023. "Cluster-robust inference: A guide to empirical practice," Journal of Econometrics, Elsevier, vol. 232(2), pages 272-299.
    12. Pedro Carneiro & Sokbae (Simon) Lee & Daniel Wilhelm, 2016. "Optimal data collection for randomized control trials," CeMMAP working papers 15/16, Institute for Fiscal Studies.
    13. Anell, Anders & Dietrichson, Jens & Ellegård, Lina Maria & Kjellsson, Gustav, 2021. "Information, switching costs, and consumer choice: Evidence from two randomised field experiments in Swedish primary health care," Journal of Public Economics, Elsevier, vol. 196(C).
    14. LaFave, Daniel & Beyene, Abebe Damte & Bluffstone, Randall & Dissanayake, Sahan T.M. & Gebreegziabher, Zenebe & Mekonnen, Alemu & Toman, Michael, 2021. "Impacts of improved biomass cookstoves on child and adult health: Experimental evidence from rural Ethiopia," World Development, Elsevier, vol. 140(C).
    15. Jan Berkes & Frauke Peter & C. Katharina Spiess & Felix Weinhardt, 2022. "Information Provision and Postgraduate Studies," Economica, London School of Economics and Political Science, vol. 89(355), pages 627-646, July.
    16. Haoge Chang, 2023. "Design-based Estimation Theory for Complex Experiments," Papers 2311.06891, arXiv.org.
    17. Yitayew, Asresu & Abdulai, Awudu & Yigezu, Yigezu A. & Deneke, Tilaye T. & Kassie, Girma T., 2021. "Impact of agricultural extension services on the adoption of improved wheat variety in Ethiopia: A cluster randomized controlled trial," World Development, Elsevier, vol. 146(C).
    18. Liang Jiang & Oliver B. Linton & Haihan Tang & Yichong Zhang, 2022. "Improving Estimation Efficiency via Regression-Adjustment in Covariate-Adaptive Randomizations with Imperfect Compliance," Papers 2201.13004, arXiv.org, revised Jun 2023.
    19. Jun Li, 2022. "Value‐Based Payments in Health Care: Evidence from a Nationwide Randomized Experiment in the Home Health Sector," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 41(4), pages 1090-1117, September.
    20. Claudia Custodio & Diogo Mendes & Daniel Metzger, 2021. "The impact of financial education of executives on financial practices of medium and large enterprises," NOVAFRICA Working Paper Series wp2105, Universidade Nova de Lisboa, Nova School of Business and Economics, NOVAFRICA.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:biomet:v:79:y:2023:i:3:p:2127-2142. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0006-341X .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.