IDEAS home Printed from https://ideas.repec.org/a/eee/econom/v249y2025ipas0304407624001544.html
   My bibliography  Save this article

Testing heterogeneous treatment effect with quantile regression under covariate-adaptive randomization

Author

Listed:
  • Liu, Yang
  • Xia, Lucy
  • Hu, Feifang

Abstract

In economic studies and clinical trials, it is prevalent to observe heterogeneous treatment effects that vary depending on the relative locations of units in the distribution of responses. In this study, we propose using quantile regression to estimate and conduct inference for conditional quantile treatment effects (cQTEs) in covariate-adaptive randomized experiments. First, we present sufficient conditions for consistently estimating the cQTEs, concerning the bias due to omitting important covariates in the inference stage. Second, we derive the weak convergence of the quantile regression process and develop a covariate-adaptive randomized bootstrap (CAR-BS) for standard error estimation. Our theoretical results indicate that the Wald test adjusted by CAR-BS is valid in terms of the Type I error, for a large class of covariate-adaptive randomization procedures at different quantiles, regardless of the choice of covariates used in inference. We perform extensive numerical and empirical studies to demonstrate advantages of the new method in various settings.

Suggested Citation

  • Liu, Yang & Xia, Lucy & Hu, Feifang, 2025. "Testing heterogeneous treatment effect with quantile regression under covariate-adaptive randomization," Journal of Econometrics, Elsevier, vol. 249(PA).
  • Handle: RePEc:eee:econom:v:249:y:2025:i:pa:s0304407624001544
    DOI: 10.1016/j.jeconom.2024.105808
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304407624001544
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jeconom.2024.105808?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Pascaline Dupas & Dean Karlan & Jonathan Robinson & Diego Ubfal, 2018. "Banking the Unbanked? Evidence from Three Countries," American Economic Journal: Applied Economics, American Economic Association, vol. 10(2), pages 257-297, April.
    2. Bingkai Wang & Ryoko Susukida & Ramin Mojtabai & Masoumeh Amin-Esmaeili & Michael Rosenblum, 2023. "Model-Robust Inference for Clinical Trials that Improve Precision by Stratified Randomization and Covariate Adjustment," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 118(542), pages 1152-1163, April.
    3. Federico A. Bugni & Ivan A. Canay & Azeem M. Shaikh, 2018. "Inference Under Covariate-Adaptive Randomization," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(524), pages 1784-1796, October.
    4. Jiang, Liang & Phillips, Peter C.B. & Tao, Yubo & Zhang, Yichong, 2023. "Regression-adjusted estimation of quantile treatment effects under covariate-adaptive randomizations," Journal of Econometrics, Elsevier, vol. 234(2), pages 758-776.
    5. Wei Ma & Feifang Hu & Lixin Zhang, 2015. "Testing Hypotheses of Covariate-Adaptive Randomized Clinical Trials," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(510), pages 669-680, June.
    6. Yang L. & Tsiatis A. A., 2001. "Efficiency Study of Estimators for a Treatment Effect in a Pretest-Posttest Trial," The American Statistician, American Statistical Association, vol. 55, pages 314-321, November.
    7. Pamela Jakiela & Owen Ozier, 2016. "Does Africa Need a Rotten Kin Theorem? Experimental Evidence from Village Economies," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 83(1), pages 231-268.
    8. Federico A. Bugni & Ivan A. Canay & Azeem M. Shaikh, 2019. "Inference under covariate‐adaptive randomization with multiple treatments," Quantitative Economics, Econometric Society, vol. 10(4), pages 1747-1785, November.
    9. Brian P. Greaney & Joseph P. Kaboski & Eva Van Leemput, 2016. "Can Self-Help Groups Really Be "Self-Help"?," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 83(4), pages 1614-1644.
    10. Stefan Wager & Susan Athey, 2018. "Estimation and Inference of Heterogeneous Treatment Effects using Random Forests," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(523), pages 1228-1242, July.
    11. Konrad B Burchardi & Selim Gulesci & Benedetta Lerva & Munshi Sulaiman, 2019. "Moral Hazard: Experimental Evidence from Tenancy Contracts," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(1), pages 281-347.
    12. Koenker,Roger, 2005. "Quantile Regression," Cambridge Books, Cambridge University Press, number 9780521845731, May.
    13. Youngjoo Cho & Debashis Ghosh, 2021. "Quantile-Based Subgroup Identification for Randomized Clinical Trials," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 13(1), pages 90-128, April.
    14. Yang Liu & Feifang Hu, 2022. "Balancing Unobserved Covariates With Covariate-Adaptive Randomized Experiments," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 117(538), pages 875-886, April.
    15. Pascaline Dupas & Jonathan Robinson, 2013. "Why Don't the Poor Save More? Evidence from Health Savings Experiments," American Economic Review, American Economic Association, vol. 103(4), pages 1138-1171, June.
    16. Alberto Chong & Isabelle Cohen & Erica Field & Eduardo Nakasone & Maximo Torero, 2016. "Iron Deficiency and Schooling Attainment in Peru," American Economic Journal: Applied Economics, American Economic Association, vol. 8(4), pages 222-255, October.
    17. Jun Shao, 2021. "Rejoinder on ‘Inference after covariate-adaptive randomization: aspects of methodology and theory’," Statistical Theory and Related Fields, Taylor & Francis Journals, vol. 5(3), pages 196-199, July.
    18. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    19. Stephen J. Anderson & David McKenzie, 2022. "Improving Business Practices and the Boundary of the Entrepreneur: A Randomized Experiment Comparing Training, Consulting, Insourcing, and Outsourcing," Journal of Political Economy, University of Chicago Press, vol. 130(1), pages 157-209.
    20. Yujia Gu & Hanzhong Liu & Wei Ma, 2023. "Regression‐based multiple treatment effect estimation under covariate‐adaptive randomization," Biometrics, The International Biometric Society, vol. 79(4), pages 2869-2880, December.
    21. Ting Ye & Jun Shao, 2020. "Robust tests for treatment effect in survival analysis under covariate‐adaptive randomization," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 82(5), pages 1301-1323, December.
    22. Jun Shao & Xinxin Yu & Bob Zhong, 2010. "A theory for testing hypotheses under covariate-adaptive randomization," Biometrika, Biometrika Trust, vol. 97(2), pages 347-360.
    23. Jun Shao & Xinxin Yu, 2013. "Validity of Tests under Covariate-Adaptive Biased Coin Randomization and Generalized Linear Models," Biometrics, The International Biometric Society, vol. 69(4), pages 960-969, December.
    24. A. Baldi Antognini & M. Zagoraiou, 2011. "The covariate-adaptive biased coin design for balancing clinical trials in the presence of prognostic factors," Biometrika, Biometrika Trust, vol. 98(3), pages 519-535.
    25. Joshua Angrist & Victor Chernozhukov & Iván Fernández-Val, 2006. "Quantile Regression under Misspecification, with an Application to the U.S. Wage Structure," Econometrica, Econometric Society, vol. 74(2), pages 539-563, March.
    26. Yuan Sun & Xuming He, 2021. "Model-based bootstrap for detection of regional quantile treatment effects," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 33(2), pages 299-320, April.
    27. Jun Shao, 2021. "Inference after covariate-adaptive randomisation: aspects of methodology and theory," Statistical Theory and Related Fields, Taylor & Francis Journals, vol. 5(3), pages 172-186, July.
    28. Ting Ye & Jun Shao & Yanyao Yi & Qingyuan Zhao, 2023. "Toward Better Practice of Covariate Adjustment in Analyzing Randomized Clinical Trials," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 118(544), pages 2370-2382, October.
    29. Suresh de Mel & Craig McIntosh & Ketki Sheth & Christopher Woodruff, 2022. "Can Mobile-Linked Bank Accounts Bolster Savings? Evidence from a Randomized Controlled Trial in Sri Lanka," The Review of Economics and Statistics, MIT Press, vol. 104(2), pages 306-320, May.
    30. Hanzhong Liu & Fuyi Tu & Wei Ma, 2023. "Lasso-adjusted treatment effect estimation under covariate-adaptive randomization," Biometrika, Biometrika Trust, vol. 110(2), pages 431-447.
    31. Wei Ma & Ping Li & Li-Xin Zhang & Feifang Hu, 2024. "A New and Unified Family of Covariate Adaptive Randomization Procedures and Their Properties," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 119(545), pages 151-162, January.
    32. Wei Ma & Yichen Qin & Yang Li & Feifang Hu, 2020. "Statistical Inference for Covariate-Adaptive Randomization Procedures," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(531), pages 1488-1497, July.
    33. Yichong Zhang & Xin Zheng, 2020. "Quantile treatment effects and bootstrap inference under covariate‐adaptive randomization," Quantitative Economics, Econometric Society, vol. 11(3), pages 957-982, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jiang, Liang & Phillips, Peter C.B. & Tao, Yubo & Zhang, Yichong, 2023. "Regression-adjusted estimation of quantile treatment effects under covariate-adaptive randomizations," Journal of Econometrics, Elsevier, vol. 234(2), pages 758-776.
    2. Liang Jiang & Oliver B. Linton & Haihan Tang & Yichong Zhang, 2022. "Improving Estimation Efficiency via Regression-Adjustment in Covariate-Adaptive Randomizations with Imperfect Compliance," Papers 2201.13004, arXiv.org, revised Jun 2023.
    3. Jiang, Liang & Li, Liyao & Miao, Ke & Zhang, Yichong, 2025. "Adjustments with many regressors under covariate-adaptive randomizations," Journal of Econometrics, Elsevier, vol. 249(PB).
    4. Yujia Gu & Hanzhong Liu & Wei Ma, 2023. "Regression‐based multiple treatment effect estimation under covariate‐adaptive randomization," Biometrics, The International Biometric Society, vol. 79(4), pages 2869-2880, December.
    5. Jun Wang & Yahe Yu, 2024. "Improved estimation of average treatment effects under covariate‐adaptive randomization methods," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 78(2), pages 310-333, May.
    6. Zixuan Zhao & Yanglei Song & Wenyu Jiang & Dongsheng Tu, 2024. "Consistent covariances estimation for stratum imbalances under minimization method for covariate‐adaptive randomization," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 51(2), pages 861-890, June.
    7. Yichong Zhang & Xin Zheng, 2020. "Quantile treatment effects and bootstrap inference under covariate‐adaptive randomization," Quantitative Economics, Econometric Society, vol. 11(3), pages 957-982, July.
    8. Yuehao Bai & Azeem M. Shaikh & Max Tabord-Meehan, 2024. "A Primer on the Analysis of Randomized Experiments and a Survey of some Recent Advances," Papers 2405.03910, arXiv.org, revised Apr 2025.
    9. Undral Byambadalai & Tomu Hirata & Tatsushi Oka & Shota Yasui, 2025. "On Efficient Estimation of Distributional Treatment Effects under Covariate-Adaptive Randomization," Papers 2506.05945, arXiv.org.
    10. Diego Javier Ubfal, 2023. "What Works in Supporting Women-led Businesses?," World Bank Publications - Reports 38564, The World Bank Group.
    11. Tong Wang & Wei Ma, 2021. "The impact of misclassification on covariate‐adaptive randomized clinical trials," Biometrics, The International Biometric Society, vol. 77(2), pages 451-464, June.
    12. Zhao, Anqi & Ding, Peng, 2024. "No star is good news: A unified look at rerandomization based on p-values from covariate balance tests," Journal of Econometrics, Elsevier, vol. 241(1).
    13. Ting Ye & Jun Shao, 2020. "Robust tests for treatment effect in survival analysis under covariate‐adaptive randomization," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 82(5), pages 1301-1323, December.
    14. Chesher, Andrew, 2017. "Understanding the effect of measurement error on quantile regressions," Journal of Econometrics, Elsevier, vol. 200(2), pages 223-237.
    15. Fong, Wai Mun, 2013. "Footprints in the market: Hedge funds and the carry trade," Journal of International Money and Finance, Elsevier, vol. 33(C), pages 41-59.
    16. Undral Byambadalai & Tatsushi Oka & Shota Yasui, 2024. "Estimating Distributional Treatment Effects in Randomized Experiments: Machine Learning for Variance Reduction," Papers 2407.16037, arXiv.org.
    17. Chen, Xirong & Li, Degui & Li, Qi & Li, Zheng, 2019. "Nonparametric estimation of conditional quantile functions in the presence of irrelevant covariates," Journal of Econometrics, Elsevier, vol. 212(2), pages 433-450.
    18. Wiji Arulampalam & Alison Booth & Mark Bryan, 2010. "Are there asymmetries in the effects of training on the conditional male wage distribution?," Journal of Population Economics, Springer;European Society for Population Economics, vol. 23(1), pages 251-272, January.
    19. Graham, Bryan S. & Hahn, Jinyong & Poirier, Alexandre & Powell, James L., 2018. "A quantile correlated random coefficients panel data model," Journal of Econometrics, Elsevier, vol. 206(2), pages 305-335.
    20. Batista, Catia & Vicente, Pedro C., 2020. "Improving access to savings through mobile money: Experimental evidence from African smallholder farmers," World Development, Elsevier, vol. 129(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:econom:v:249:y:2025:i:pa:s0304407624001544. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jeconom .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.