IDEAS home Printed from https://ideas.repec.org/a/bpj/causin/v12y2024i1p18n1.html

Optimal allocation of sample size for randomization-based inference from 2K factorial designs

Author

Listed:
  • Ravichandran Arun

    (Department of Statistics, Rutgers University, Piscataway, NJ, USA)

  • Pashley Nicole E.

    (Department of Statistics, Rutgers University, Piscataway, NJ, USA)

  • Libgober Brian

    (Department of Political Science and Law, Northwestern University, Chicago, IL, USA)

  • Dasgupta Tirthankar

    (Department of Statistics, Rutgers University, Piscataway, NJ, USA)

Abstract

Optimizing the allocation of units into treatment groups can help researchers improve the precision of causal estimators and decrease costs when running factorial experiments. However, existing optimal allocation results typically assume a super-population model and that the outcome data come from a known family of distributions. Instead, we focus on randomization-based causal inference for the finite-population setting, which does not require model specifications for the data or sampling assumptions. We propose exact theoretical solutions for optimal allocation in 2 K {2}^{K} factorial experiments under complete randomization with A-, D-, and E-optimality criteria. We then extend this work to factorial designs with block randomization. We also derive results for optimal allocations when using cost-based constraints. To connect our theory to practice, we provide convenient integer-constrained programming solutions using a greedy optimization approach to find integer optimal allocation solutions for both complete and block randomizations. The proposed methods are demonstrated using two real-life factorial experiments conducted by social scientists.

Suggested Citation

  • Ravichandran Arun & Pashley Nicole E. & Libgober Brian & Dasgupta Tirthankar, 2024. "Optimal allocation of sample size for randomization-based inference from 2K factorial designs," Journal of Causal Inference, De Gruyter, vol. 12(1), pages 1-18, January.
  • Handle: RePEc:bpj:causin:v:12:y:2024:i:1:p:18:n:1
    DOI: 10.1515/jci-2023-0046
    as

    Download full text from publisher

    File URL: https://doi.org/10.1515/jci-2023-0046
    Download Restriction: no

    File URL: https://libkey.io/10.1515/jci-2023-0046?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jinyong Hahn & Keisuke Hirano & Dean Karlan, 2011. "Adaptive Experimental Design Using the Propensity Score," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(1), pages 96-108, January.
    2. Alberto Abadie & Susan Athey & Guido W. Imbens & Jeffrey M. Wooldridge, 2020. "Sampling‐Based versus Design‐Based Uncertainty in Regression Analysis," Econometrica, Econometric Society, vol. 88(1), pages 265-296, January.
    3. Wong, Weng Kee, 1994. "Comparing robust properties of A, D, E and G-optimal designs," Computational Statistics & Data Analysis, Elsevier, vol. 18(4), pages 441-448, November.
    4. Philip Oreopoulos & Daniel Lang & Joshua Angrist, 2009. "Incentives and Services for College Achievement: Evidence from a Randomized Trial," American Economic Journal: Applied Economics, American Economic Association, vol. 1(1), pages 136-163, January.
    5. Friedrich, Ulf & Münnich, Ralf & de Vries, Sven & Wagner, Matthias, 2015. "Fast integer-valued algorithms for optimal allocations under constraints in stratified sampling," Computational Statistics & Data Analysis, Elsevier, vol. 92(C), pages 1-12.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Yuhao & Li, Xinran, 2025. "Asymptotic theory of the best-choice rerandomization using the Mahalanobis distance," Journal of Econometrics, Elsevier, vol. 251(C).
    2. Jinglong Zhao, 2024. "Experimental Design For Causal Inference Through An Optimization Lens," Papers 2408.09607, arXiv.org, revised Aug 2024.
    3. Francesca Meli, 2026. "The Role of Genetic Predisposition for Chronotype in Academic Performance," Bristol Economics Discussion Papers 26/825, School of Economics, University of Bristol, UK.
    4. Meli, Francesca, 2026. "The Role of Genetic Predisposition for Chronotype in Academic Performance," EconStor Preprints 337666, ZBW - Leibniz Information Centre for Economics.
    5. Pugatch, Todd & Wilson, Nicholas, 2018. "Nudging study habits: A field experiment on peer tutoring in higher education," Economics of Education Review, Elsevier, vol. 62(C), pages 151-161.
    6. Jason M. Lindo & Nicholas J. Sanders & Philip Oreopoulos, 2010. "Ability, Gender, and Performance Standards: Evidence from Academic Probation," American Economic Journal: Applied Economics, American Economic Association, vol. 2(2), pages 95-117, April.
    7. Yue Fang & Geert Ridder, 2025. "The Exact Variance of the Average Treatment Effect Estimator in Cluster Randomized Controlled Trials," Papers 2511.05801, arXiv.org, revised Dec 2025.
    8. Victor Gay, 2023. "Culture: An Empirical Investigation of Beliefs, Work, and Fertility. A Verification and Reproduction of Fernández and Fogli (2009)," Post-Print hal-04194417, HAL.
    9. Zara Contractor & Germ'an Reyes, 2025. "Generative AI in Higher Education: Evidence from an Elite College," Papers 2508.00717, arXiv.org, revised Apr 2026.
    10. Oswald, Yvonne & Backes-Gellner, Uschi, 2014. "Learning for a bonus: How financial incentives interact with preferences," Journal of Public Economics, Elsevier, vol. 118(C), pages 52-61.
    11. Pedro Carneiro & Sokbae Lee & Daniel Wilhelm, 2020. "Optimal data collection for randomized control trials," The Econometrics Journal, Royal Economic Society, vol. 23(1), pages 1-31.
    12. De Paola, Maria & Scoppa, Vincenzo, 2015. "Procrastination, academic success and the effectiveness of a remedial program," Journal of Economic Behavior & Organization, Elsevier, vol. 115(C), pages 217-236.
    13. Bodory, Hugo & Huber, Martin, 2018. "The causalweight package for causal inference in R," FSES Working Papers 493, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    14. Aufenanger, Tobias, 2017. "Machine learning to improve experimental design," FAU Discussion Papers in Economics 16/2017, Friedrich-Alexander University Erlangen-Nuremberg, Institute for Economics, revised 2017.
    15. Lisa Barrow & Cecilia Elena Rouse, 2018. "Financial Incentives and Educational Investment: The Impact of Performance-based Scholarships on Student Time Use," Education Finance and Policy, MIT Press, vol. 13(4), pages 419-448, Fall.
    16. Praveen Ranjan Srivastava & Prajwal Eachempati & Ajay Kumar & Ashish Kumar Jha & Lalitha Dhamotharan, 2023. "Best strategy to win a match: an analytical approach using hybrid machine learning-clustering-association rule framework," Annals of Operations Research, Springer, vol. 325(1), pages 319-361, June.
    17. Bruno Ferman, 2026. "On the Use of Design-Based Simulations," Papers 2603.11381, arXiv.org.
    18. Ellis, Jimmy R. & Gershenson, Seth, 2016. "LATE for the Meeting: Gender, Peer Advising, and College Success," IZA Discussion Papers 9956, IZA Network @ LISER.
    19. Lisa Barrow & Cecilia Elena Rouse & Amanda McFarland, 2020. "Who Has the Time? Community College Students’ Time-Use Response to Financial Incentives," Atlantic Economic Journal, Springer;International Atlantic Economic Society, vol. 48(1), pages 35-52, March.
    20. William W. Wang & Ali Jadbabaie, 2025. "Weak Identification in Peer Effects Estimation," Papers 2508.04897, arXiv.org.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bpj:causin:v:12:y:2024:i:1:p:18:n:1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.degruyterbrill.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.