IDEAS home Printed from https://ideas.repec.org/a/eee/deveng/v1y2016icp12-25.html

The pursuit of balance in sequential randomized trials

Author

Listed:
  • Guiteras, Raymond P.
  • Levine, David I.
  • Polley, Thomas H.

Abstract

In many randomized trials, subjects enter the sample sequentially. Because the covariates for all units are not known in advance, standard methods of stratification do not apply. We describe and assess the method of DA-optimal sequential allocation (Atkinson, 1982) for balancing stratification covariates across treatment arms. We provide simulation evidence that the method can provide substantial improvements in precision over commonly employed alternatives. We also describe our experience implementing the method in a field trial of a clean water and handwashing intervention in Dhaka, Bangladesh, the first time the method has been used. We provide advice and software for future researchers.

Suggested Citation

  • Guiteras, Raymond P. & Levine, David I. & Polley, Thomas H., 2016. "The pursuit of balance in sequential randomized trials," Development Engineering, Elsevier, vol. 1(C), pages 12-25.
    • Handle: RePEc:eee:deveng:v:1:y:2016:i:c:p:12-25
    DOI: 10.1016/j.deveng.2015.11.001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S2352728515300580
    Download Restriction: no
    File URL: https://libkey.io/10.1016/j.deveng.2015.11.001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Silvio S. Zocchi & Anthony C. Atkinson, 1999. "Optimum Experimental Designs for Multinomial Logistic Models," Biometrics, The International Biometric Society, vol. 55(2), pages 437-444, June.
    2. Lori Beaman & Jeremy Magruder, 2012. "Who Gets the Job Referral? Evidence from a Social Networks Experiment," American Economic Review, American Economic Association, vol. 102(7), pages 3574-3593, December.
    3. Federico A. Bugni & Ivan A. Canay & Azeem M. Shaikh, 2018. "Inference Under Covariate-Adaptive Randomization," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(524), pages 1784-1796, October.
    4. James Berry & Greg Fischer & Raymond Guiteras, 2020. "Eliciting and Utilizing Willingness to Pay: Evidence from Field Trials in Northern Ghana," Journal of Political Economy, University of Chicago Press, vol. 128(4), pages 1436-1473.
    5. Anthony C. Atkinson, 2002. "The comparison of designs for sequential clinical trials with covariate information," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 165(2), pages 349-373, June.
    6. Dimitris Bertsimas & Mac Johnson & Nathan Kallus, 2015. "The Power of Optimization Over Randomization in Designing Experiments Involving Small Samples," Operations Research, INFORMS, vol. 63(4), pages 868-876, August.
    7. Jun Shao & Xinxin Yu & Bob Zhong, 2010. "A theory for testing hypotheses under covariate-adaptive randomization," Biometrika, Biometrika Trust, vol. 97(2), pages 347-360.
    8. Jun Shao & Xinxin Yu, 2013. "Validity of Tests under Covariate-Adaptive Biased Coin Randomization and Generalized Linear Models," Biometrics, The International Biometric Society, vol. 69(4), pages 960-969, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Massimiliano Russo & Steffen Ventz & Victoria Wang & Lorenzo Trippa, 2023. "Inference in response‐adaptive clinical trials when the enrolled population varies over time," Biometrics, The International Biometric Society, vol. 79(1), pages 381-393, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tong Wang & Wei Ma, 2021. "The impact of misclassification on covariate‐adaptive randomized clinical trials," Biometrics, The International Biometric Society, vol. 77(2), pages 451-464, June.
    2. Liang Jiang & Oliver B. Linton & Haihan Tang & Yichong Zhang, 2022. "Improving Estimation Efficiency via Regression-Adjustment in Covariate-Adaptive Randomizations with Imperfect Compliance," Papers 2201.13004, arXiv.org, revised Jun 2023.
    3. Jiang, Liang & Phillips, Peter C.B. & Tao, Yubo & Zhang, Yichong, 2023. "Regression-adjusted estimation of quantile treatment effects under covariate-adaptive randomizations," Journal of Econometrics, Elsevier, vol. 234(2), pages 758-776.
    4. Raymond P. Guiteras & B. Kelsey Jack, 2014. "Incentives, Selection and Productivity in Labor Markets: Evidence from Rural Malawi," NBER Working Papers 19825, National Bureau of Economic Research, Inc.
    5. Vittorio Bassi & Aisha Nansamba, 2022. "Screening and Signalling Non-Cognitive Skills: Experimental Evidence from Uganda," The Economic Journal, Royal Economic Society, vol. 132(642), pages 471-511.
    6. Yichong Zhang & Xin Zheng, 2020. "Quantile treatment effects and bootstrap inference under covariate‐adaptive randomization," Quantitative Economics, Econometric Society, vol. 11(3), pages 957-982, July.
    7. Liu, Yang & Xia, Lucy & Hu, Feifang, 2025. "Testing heterogeneous treatment effect with quantile regression under covariate-adaptive randomization," Journal of Econometrics, Elsevier, vol. 249(PA).
    8. Ting Ye & Jun Shao, 2020. "Robust tests for treatment effect in survival analysis under covariate‐adaptive randomization," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 82(5), pages 1301-1323, December.
    9. Daniel Agness & Travis Baseler & Sylvain Chassang & Pascaline Dupas & Erik Snowberg, 2022. "Valuing the Time of the Self-Employed," Working Papers 2022-2, Princeton University. Economics Department..
    10. Bensch, Gunther & Grimm, Michael, 2024. "Behavioural constraints in energy technology uptake: Evidence from real-purchase offers in rural Rwanda and Senegal," Ruhr Economic Papers 1081, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    11. Hoffmann, Bridget, 2018. "Do non-monetary prices target the poor? Evidence from a field experiment in India," Journal of Development Economics, Elsevier, vol. 133(C), pages 15-32.
    12. Samuel D. Bell & Nadia A. Streletskaya, 2019. "The Random Quantity Mechanism: Laboratory and Field Tests of a Novel Cost-Revealing Procurement Mechanism," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 73(3), pages 899-921, July.
    13. Ricker-Gilbert, Jacob & Moussa, Bokar & Abdoulaye, Tahirou, 2021. "Using Branding to Signal Quality in Informal Markets. Evidence from an Experimental Auction in the Sahel," 2021 Conference, August 17-31, 2021, Virtual 315284, International Association of Agricultural Economists.
    14. Naphtal Habiyaremye & Nadhem Mtimet & Emily A. Ouma & Gideon A. Obare, 2023. "Consumers' willingness to pay for safe and quality milk: Evidence from experimental auctions in Rwanda," Agribusiness, John Wiley & Sons, Ltd., vol. 39(4), pages 1049-1074, October.
    15. Koichiro Ito & Shuang Zhang, 2020. "Willingness to Pay for Clean Air: Evidence from Air Purifier Markets in China," Journal of Political Economy, University of Chicago Press, vol. 128(5), pages 1627-1672.
    16. Fischer, Greg & Karlan, Dean & McConnell, Margaret & Raffler, Pia, 2019. "Short-term subsidies and seller type: A health products experiment in Uganda," Journal of Development Economics, Elsevier, vol. 137(C), pages 110-124.
    17. Hira Channa & Jacob Ricker‐Gilbert & Hugo De Groote & Jonathan Bauchet, 2021. "Willingness to pay for a new farm technology given risk preferences: Evidence from an experimental auction in Kenya," Agricultural Economics, International Association of Agricultural Economists, vol. 52(5), pages 733-748, September.
    18. Shapiro, Jeremy, 2019. "The impact of recipient choice on aid effectiveness," World Development, Elsevier, vol. 116(C), pages 137-149.
    19. Aker, Jenny C. & Dillon, Brian & Welch, C. Jamilah, 2023. "Demand, supply and long-term adoption: Evidence from a storage technology in West Africa," Journal of Development Economics, Elsevier, vol. 165(C).
    20. Angelucci, Manuela & Bennett, Daniel M, 2022. "Depression, Pharmacotherapy, and the Demand for a Novel Health Product," IZA Discussion Papers 15832, Institute of Labor Economics (IZA).

    More about this item

    Keywords

    ;
    ;
    ;

    JEL classification:

    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • O12 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Microeconomic Analyses of Economic Development

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:deveng:v:1:y:2016:i:c:p:12-25. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/development-engineering .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.