IDEAS home Printed from https://ideas.repec.org/a/eee/econom/v251y2025ics0304407625001034.html

Asymptotic theory of the best-choice rerandomization using the Mahalanobis distance

Author

Listed:
  • Wang, Yuhao
  • Li, Xinran

Abstract

Rerandomization, a design that utilizes pretreatment covariates and improves their balance between different treatment groups, has received attention recently in both theory and practice. From a survey by Bruhn and McKenzie (2009), there are at least two types of rerandomization that are used in practice: the first rerandomizes the treatment assignment until covariate imbalance is below a prespecified threshold; the second randomizes the treatment assignment multiple times and chooses the one with the best covariate balance. In this paper we will consider the second type of rerandomization, namely the best-choice rerandomization, whose theory and inference are still lacking in the literature. In particular, we will focus on the best-choice rerandomization that uses the Mahalanobis distance to measure covariate imbalance, which is one of the most commonly used imbalance measure for multivariate covariates and is invariant to affine transformations of covariates. We will study the large-sample repeatedly sampling properties of the best-choice rerandomization, allowing both the number of covariates and the number of tried complete randomizations to increase with the sample size. We show that the asymptotic distribution of the difference-in-means estimator is more concentrated around the true average treatment effect under rerandomization than under the complete randomization, and propose large-sample accurate confidence intervals for rerandomization that are shorter than that for the completely randomized experiment. We further demonstrate that, with moderate number of covariates and with the number of tried randomizations increasing polynomially with the sample size, the best-choice rerandomization can achieve the ideally optimal precision that one can expect even with perfectly balanced covariates. The developed theory and methods for rerandomization are also illustrated using real field experiments.

Suggested Citation

  • Wang, Yuhao & Li, Xinran, 2025. "Asymptotic theory of the best-choice rerandomization using the Mahalanobis distance," Journal of Econometrics, Elsevier, vol. 251(C).
  • Handle: RePEc:eee:econom:v:251:y:2025:i:c:s0304407625001034
    DOI: 10.1016/j.jeconom.2025.106049
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304407625001034
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jeconom.2025.106049?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. repec:osf:socarx:8xn9m_v1 is not listed on IDEAS
    2. Xin Lu & Tianle Liu & Hanzhong Liu & Peng Ding, 2023. "Design-based theory for cluster rerandomization," Biometrika, Biometrika Trust, vol. 110(2), pages 467-483.
    3. Boyd, Chris M. & Díez-Amigo, Sandro, 2023. "Effectiveness of free financial education provided by for-profit financial institutions: Experimental evidence from rural Peru," Economics of Education Review, Elsevier, vol. 97(C).
    4. Yuehao Bai, 2022. "Optimality of Matched-Pair Designs in Randomized Controlled Trials," Papers 2206.07845, arXiv.org.
    5. Morris, Carl, 1979. "A finite selection model for experimental design of the health insurance study," Journal of Econometrics, Elsevier, vol. 11(1), pages 43-61, September.
    6. Zhao, Anqi & Ding, Peng, 2024. "No star is good news: A unified look at rerandomization based on p-values from covariate balance tests," Journal of Econometrics, Elsevier, vol. 241(1).
    7. Christopher Harshaw & Fredrik Sävje & Daniel A. Spielman & Peng Zhang, 2024. "Balancing Covariates in Randomized Experiments with the Gram–Schmidt Walk Design," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 119(548), pages 2934-2946, October.
    8. Alberto Abadie & Susan Athey & Guido W. Imbens & Jeffrey M. Wooldridge, 2020. "Sampling‐Based versus Design‐Based Uncertainty in Regression Analysis," Econometrica, Econometric Society, vol. 88(1), pages 265-296, January.
    9. Jesse Hemerik & Jelle J. Goeman, 2021. "Another Look at the Lady Tasting Tea and Differences Between Permutation Tests and Randomisation Tests," International Statistical Review, International Statistical Institute, vol. 89(2), pages 367-381, August.
    10. Peter L. Cohen & Colin B. Fogarty, 2022. "Gaussian prepivoting for finite population causal inference," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(2), pages 295-320, April.
    11. Suresh de Mel & David McKenzie & Christopher Woodruff, 2019. "Labor Drops: Experimental Evidence on the Return to Additional Labor in Microenterprises," American Economic Journal: Applied Economics, American Economic Association, vol. 11(1), pages 202-235, January.
    12. Xinran Li & Peng Ding, 2020. "Rerandomization and regression adjustment," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 82(1), pages 241-268, February.
    13. Max Cytrynbaum, 2023. "Covariate Adjustment in Stratified Experiments," Papers 2302.03687, arXiv.org, revised Jul 2024.
    14. Yuehao Bai, 2022. "Optimality of Matched-Pair Designs in Randomized Controlled Trials," American Economic Review, American Economic Association, vol. 112(12), pages 3911-3940, December.
    15. Zhao, Anqi & Ding, Peng, 2021. "Covariate-adjusted Fisher randomization tests for the average treatment effect," Journal of Econometrics, Elsevier, vol. 225(2), pages 278-294.
    16. Michael Grimm & Anicet Munyehirwe & Jörg Peters & Maximiliane Sievert, 2017. "A First Step up the Energy Ladder? Low Cost Solar Kits and Household’s Welfare in Rural Rwanda," The World Bank Economic Review, World Bank, vol. 31(3), pages 631-649.
    17. Philip Oreopoulos & Daniel Lang & Joshua Angrist, 2009. "Incentives and Services for College Achievement: Evidence from a Randomized Trial," American Economic Journal: Applied Economics, American Economic Association, vol. 1(1), pages 136-163, January.
    18. Colin B Fogarty, 2018. "Regression-assisted inference for the average treatment effect in paired experiments," Biometrika, Biometrika Trust, vol. 105(4), pages 994-1000.
    19. Xinran Li & Peng Ding, 2017. "General Forms of Finite Population Central Limit Theorems with Applications to Causal Inference," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(520), pages 1759-1769, October.
    20. Deaton, Angus & Cartwright, Nancy, 2018. "Understanding and misunderstanding randomized controlled trials," Social Science & Medicine, Elsevier, vol. 210(C), pages 2-21.
    21. Abhijit V. Banerjee & Sylvain Chassang & Sergio Montero & Erik Snowberg, 2020. "A Theory of Experimenters: Robustness, Randomization, and Balance," American Economic Review, American Economic Association, vol. 110(4), pages 1206-1230, April.
    22. Lasse Brune & Eric Chyn & Jason Kerwin, 2021. "Pay Me Later: Savings Constraints and the Demand for Deferred Payments," American Economic Review, American Economic Association, vol. 111(7), pages 2179-2212, July.
    23. Jean N. Lee & Jonathan Morduch & Saravana Ravindran & Abu Shonchoy & Hassan Zaman, 2021. "Poverty and Migration in the Digital Age: Experimental Evidence on Mobile Banking in Bangladesh," American Economic Journal: Applied Economics, American Economic Association, vol. 13(1), pages 38-71, January.
    24. Yuehao Bai & Joseph P. Romano & Azeem M. Shaikh, 2022. "Inference in Experiments With Matched Pairs," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 117(540), pages 1726-1737, October.
    25. Nadarajah, Saralees, 2008. "Explicit expressions for moments of order statistics," Statistics & Probability Letters, Elsevier, vol. 78(2), pages 196-205, February.
    26. Rosenbaum, Paul R., 2010. "Design Sensitivity and Efficiency in Observational Studies," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 692-702.
    27. Sven Resnjanskij & Jens Ruhose & Simon Wiederhold & Ludger Woessmann & Katharina Wedel, 2024. "Can Mentoring Alleviate Family Disadvantage in Adolescence? A Field Experiment to Improve Labor Market Prospects," Journal of Political Economy, University of Chicago Press, vol. 132(3), pages 1013-1062.
    28. Matt Lowe, 2021. "Types of Contact: A Field Experiment on Collaborative and Adversarial Caste Integration," American Economic Review, American Economic Association, vol. 111(6), pages 1807-1844, June.
    29. Xinhe Wang & Tingyu Wang & Hanzhong Liu, 2023. "Rerandomization in Stratified Randomized Experiments," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 118(542), pages 1295-1304, April.
    30. Cronin, Christopher J. & Lieber, Ethan M.J., 2024. "The demand for skills training among Medicaid home-based caregivers," Journal of Health Economics, Elsevier, vol. 95(C).
    31. Zihao Yang & Tianyi Qu & Xinran Li, 2023. "Rejective Sampling, Rerandomization, and Regression Adjustment in Survey Experiments," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 118(542), pages 1207-1221, April.
    32. Bai, Yuehao & Jiang, Liang & Romano, Joseph P. & Shaikh, Azeem M. & Zhang, Yichong, 2024. "Covariate adjustment in experiments with matched pairs," Journal of Econometrics, Elsevier, vol. 241(1).
    33. Kasy, Maximilian, 2016. "Why Experimenters Might Not Always Want to Randomize, and What They Could Do Instead," Political Analysis, Cambridge University Press, vol. 24(3), pages 324-338, July.
    34. Miriam Bruhn & David McKenzie, 2009. "In Pursuit of Balance: Randomization in Practice in Development Field Experiments," American Economic Journal: Applied Economics, American Economic Association, vol. 1(4), pages 200-232, October.
    35. Zhaoyang Liu & Tingxuan Han & Donald B. Rubin & Ke Deng, 2025. "A Bayesian Criterion for Rerandomization," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 120(552), pages 2809-2821, October.
    36. Alexander Shapiro & Jos Berge, 2002. "Statistical inference of minimum rank factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 67(1), pages 79-94, March.
    37. Max Cytrynbaum, 2024. "Covariate adjustment in stratified experiments," Quantitative Economics, Econometric Society, vol. 15(4), pages 971-998, November.
    38. Lee, Jean N. & Morduch, Jonathan & Ravindran, Saravana & Shonchoy, Abu S., 2022. "Narrowing the gender gap in mobile banking," Journal of Economic Behavior & Organization, Elsevier, vol. 193(C), pages 276-293.
    39. Lori Beaman & Dean Karlan & Bram Thuysbaert & Christopher Udry, 2023. "Selection Into Credit Markets: Evidence From Agriculture in Mali," Econometrica, Econometric Society, vol. 91(5), pages 1595-1627, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yuehao Bai & Azeem M. Shaikh & Max Tabord-Meehan, 2024. "A Primer on the Analysis of Randomized Experiments and a Survey of some Recent Advances," Papers 2405.03910, arXiv.org, revised Apr 2025.
    2. Yuehao Bai & Xun Huang & Joseph P. Romano & Azeem M. Shaikh & Max Tabord-Meehan, 2025. "A New Design-Based Variance Estimator for Finely Stratified Experiments," Papers 2503.10851, arXiv.org, revised May 2025.
    3. Jinglong Zhao, 2024. "Experimental Design For Causal Inference Through An Optimization Lens," Papers 2408.09607, arXiv.org, revised Aug 2024.
    4. Zhao, Anqi & Ding, Peng, 2024. "No star is good news: A unified look at rerandomization based on p-values from covariate balance tests," Journal of Econometrics, Elsevier, vol. 241(1).
    5. Liu, Jizhou, 2026. "Inference for two-stage experiments under covariate-adaptive randomization," Journal of Econometrics, Elsevier, vol. 253(C).
    6. Zhao, Anqi & Ding, Peng, 2021. "Covariate-adjusted Fisher randomization tests for the average treatment effect," Journal of Econometrics, Elsevier, vol. 225(2), pages 278-294.
    7. Jiang, Liang & Li, Liyao & Miao, Ke & Zhang, Yichong, 2025. "Adjustments with many regressors under covariate-adaptive randomizations," Journal of Econometrics, Elsevier, vol. 249(PB).
    8. Bai, Yuehao & Jiang, Liang & Romano, Joseph P. & Shaikh, Azeem M. & Zhang, Yichong, 2024. "Covariate adjustment in experiments with matched pairs," Journal of Econometrics, Elsevier, vol. 241(1).
    9. Jiang, Liang & Phillips, Peter C.B. & Tao, Yubo & Zhang, Yichong, 2023. "Regression-adjusted estimation of quantile treatment effects under covariate-adaptive randomizations," Journal of Econometrics, Elsevier, vol. 234(2), pages 758-776.
    10. Zikai Li, 2025. "Bridging Stratification and Regression Adjustment: Batch-Adaptive Stratification with Post-Design Adjustment in Randomized Experiments," Papers 2510.22908, arXiv.org.
    11. Ke Zhu & Hanzhong Liu, 2023. "Pair‐switching rerandomization," Biometrics, The International Biometric Society, vol. 79(3), pages 2127-2142, September.
    12. Yuehao Bai & Hongchang Guo & Azeem M. Shaikh & Max Tabord-Meehan, 2025. "Inference in Experiments with Matched Pairs and Imperfect Compliance," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 43(3), pages 627-642, July.
    13. Yuehao Bai & Meng Hsuan Hsieh & Jizhou Liu & Max Tabord‐Meehan, 2024. "Revisiting the analysis of matched‐pair and stratified experiments in the presence of attrition," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 39(2), pages 256-268, March.
    14. Max Cytrynbaum & Fredrik Savje, 2026. "Coupling Designs for Randomized Experiments with Complex Treatments," Papers 2604.09858, arXiv.org, revised Jul 2026.
    15. Bai, Yuehao & Liu, Jizhou & Shaikh, Azeem M. & Tabord-Meehan, Max, 2024. "Inference in cluster randomized trials with matched pairs," Journal of Econometrics, Elsevier, vol. 245(1).
    16. Brandon Hauser & Mauricio Olivares, 2025. "A primer on power and sample size calculations for randomisation inference with experimental data," Fiscal Studies, John Wiley & Sons, vol. 46(3), pages 349-371, September.
    17. Yuehao Bai & Jizhou Liu & Max Tabord-Meehan, 2022. "Inference for Matched Tuples and Fully Blocked Factorial Designs," Papers 2206.04157, arXiv.org, revised Nov 2023.
    18. Max Cytrynbaum, 2024. "Finely Stratified Rerandomization Designs," Papers 2407.03279, arXiv.org, revised Jan 2025.
    19. Yuehao Bai, 2022. "Optimality of Matched-Pair Designs in Randomized Controlled Trials," Papers 2206.07845, arXiv.org.
    20. Yuehao Bai & Jizhou Liu & Azeem M. Shaikh & Max Tabord-Meehan, 2023. "On the Efficiency of Highly Stratified Experiments," Papers 2307.15181, arXiv.org, revised Mar 2026.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:econom:v:251:y:2025:i:c:s0304407625001034. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jeconom .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.