IDEAS home Printed from https://ideas.repec.org/a/bpj/causin/v12y2024i1p18n1.html

Optimal allocation of sample size for randomization-based inference from 2K factorial designs

Author

Listed:
  • Ravichandran Arun

    (Department of Statistics, Rutgers University, Piscataway, NJ, USA)

  • Pashley Nicole E.

    (Department of Statistics, Rutgers University, Piscataway, NJ, USA)

  • Libgober Brian

    (Department of Political Science and Law, Northwestern University, Chicago, IL, USA)

  • Dasgupta Tirthankar

    (Department of Statistics, Rutgers University, Piscataway, NJ, USA)

Abstract

Optimizing the allocation of units into treatment groups can help researchers improve the precision of causal estimators and decrease costs when running factorial experiments. However, existing optimal allocation results typically assume a super-population model and that the outcome data come from a known family of distributions. Instead, we focus on randomization-based causal inference for the finite-population setting, which does not require model specifications for the data or sampling assumptions. We propose exact theoretical solutions for optimal allocation in 2 K {2}^{K} factorial experiments under complete randomization with A-, D-, and E-optimality criteria. We then extend this work to factorial designs with block randomization. We also derive results for optimal allocations when using cost-based constraints. To connect our theory to practice, we provide convenient integer-constrained programming solutions using a greedy optimization approach to find integer optimal allocation solutions for both complete and block randomizations. The proposed methods are demonstrated using two real-life factorial experiments conducted by social scientists.

Suggested Citation

  • Ravichandran Arun & Pashley Nicole E. & Libgober Brian & Dasgupta Tirthankar, 2024. "Optimal allocation of sample size for randomization-based inference from 2K factorial designs," Journal of Causal Inference, De Gruyter, vol. 12(1), pages 1-18, January.
  • Handle: RePEc:bpj:causin:v:12:y:2024:i:1:p:18:n:1
    DOI: 10.1515/jci-2023-0046
    as

    Download full text from publisher

    File URL: https://doi.org/10.1515/jci-2023-0046
    Download Restriction: no

    File URL: https://libkey.io/10.1515/jci-2023-0046?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jinyong Hahn & Keisuke Hirano & Dean Karlan, 2011. "Adaptive Experimental Design Using the Propensity Score," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(1), pages 96-108, January.
    2. Alberto Abadie & Susan Athey & Guido W. Imbens & Jeffrey M. Wooldridge, 2020. "Sampling‐Based versus Design‐Based Uncertainty in Regression Analysis," Econometrica, Econometric Society, vol. 88(1), pages 265-296, January.
    3. Wong, Weng Kee, 1994. "Comparing robust properties of A, D, E and G-optimal designs," Computational Statistics & Data Analysis, Elsevier, vol. 18(4), pages 441-448, November.
    4. Friedrich, Ulf & Münnich, Ralf & de Vries, Sven & Wagner, Matthias, 2015. "Fast integer-valued algorithms for optimal allocations under constraints in stratified sampling," Computational Statistics & Data Analysis, Elsevier, vol. 92(C), pages 1-12.
    5. Philip Oreopoulos & Daniel Lang & Joshua Angrist, 2009. "Incentives and Services for College Achievement: Evidence from a Randomized Trial," American Economic Journal: Applied Economics, American Economic Association, vol. 1(1), pages 136-163, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Meli, Francesca, 2026. "The Role of Genetic Predisposition for Chronotype in Academic Performance," EconStor Preprints 337666, ZBW - Leibniz Information Centre for Economics.
    2. Wang, Yuhao & Li, Xinran, 2025. "Asymptotic theory of the best-choice rerandomization using the Mahalanobis distance," Journal of Econometrics, Elsevier, vol. 251(C).
    3. Jinglong Zhao, 2024. "Experimental Design For Causal Inference Through An Optimization Lens," Papers 2408.09607, arXiv.org, revised Aug 2024.
    4. Francesca Meli, 2026. "The Role of Genetic Predisposition for Chronotype in Academic Performance," Bristol Economics Discussion Papers 26/825, School of Economics, University of Bristol, UK.
    5. Pugatch, Todd & Wilson, Nicholas, 2018. "Nudging study habits: A field experiment on peer tutoring in higher education," Economics of Education Review, Elsevier, vol. 62(C), pages 151-161.
    6. Darren Grant & William Green, 2013. "Grades as incentives," Empirical Economics, Springer, vol. 44(3), pages 1563-1592, June.
    7. Hardt, David & Nagler, Markus & Rincke, Johannes, 2023. "Tutoring in (online) higher education: Experimental evidence," Economics of Education Review, Elsevier, vol. 92(C).
    8. Conti, Gabriella & Poupakis, Stavros & Ekamper, Peter & Bijwaard, Govert E. & Lumey, L.H., 2024. "Severe prenatal shocks and adolescent health: Evidence from the Dutch Hunger Winter," Economics & Human Biology, Elsevier, vol. 53(C).
    9. Jason M. Lindo & Nicholas J. Sanders & Philip Oreopoulos, 2010. "Ability, Gender, and Performance Standards: Evidence from Academic Probation," American Economic Journal: Applied Economics, American Economic Association, vol. 2(2), pages 95-117, April.
    10. Francesco Vidoli, 2026. "The Geography of Impact: Endogenous Spatial Clustering for Difference-in-Differences Estimation," Working Papers 2601, University of Urbino Carlo Bo, Department of Economics, Society & Politics - Scientific Committee - L. Stefanini & G. Travaglini, revised 2026.
    11. Peter Leopold S. Bergman & Elizabeth Kopko & Julio Rodriguez, 2021. "Using Predictive Analytics to Track Students: Evidence from a Seven-College Experiment," CESifo Working Paper Series 9157, CESifo.
    12. Yue Fang & Geert Ridder, 2025. "The Exact Variance of the Average Treatment Effect Estimator in Cluster Randomized Controlled Trials," Papers 2511.05801, arXiv.org, revised Dec 2025.
    13. Victor Gay, 2023. "Culture: An Empirical Investigation of Beliefs, Work, and Fertility. A Verification and Reproduction of Fernández and Fogli (2009)," Post-Print hal-04194417, HAL.
    14. Zara Contractor & Germ'an Reyes, 2025. "Generative AI in Higher Education: Evidence from an Elite College," Papers 2508.00717, arXiv.org, revised Apr 2026.
    15. Oswald, Yvonne & Backes-Gellner, Uschi, 2014. "Learning for a bonus: How financial incentives interact with preferences," Journal of Public Economics, Elsevier, vol. 118(C), pages 52-61.
    16. Pedro Carneiro & Sokbae Lee & Daniel Wilhelm, 2020. "Optimal data collection for randomized control trials," The Econometrics Journal, Royal Economic Society, vol. 23(1), pages 1-31.
    17. De Paola, Maria & Scoppa, Vincenzo, 2015. "Procrastination, academic success and the effectiveness of a remedial program," Journal of Economic Behavior & Organization, Elsevier, vol. 115(C), pages 217-236.
    18. Bodory, Hugo & Huber, Martin, 2018. "The causalweight package for causal inference in R," FSES Working Papers 493, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    19. Penney, Jeffrey & Lehrer, Steven F. & Bernal, Gloria L. & Reyes, Luis Carlos, 2023. "Do opportunities for low-income students at top colleges promote academic success? Evidence from Colombia's Ser Pilo Paga program," CLEF Working Paper Series 64, Canadian Labour Economics Forum (CLEF), University of Waterloo.
    20. Aufenanger, Tobias, 2017. "Machine learning to improve experimental design," FAU Discussion Papers in Economics 16/2017, Friedrich-Alexander University Erlangen-Nuremberg, Institute for Economics, revised 2017.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bpj:causin:v:12:y:2024:i:1:p:18:n:1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.degruyterbrill.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.