IDEAS home Printed from https://ideas.repec.org/a/bla/biomet/v78y2022i1p388-398.html
   My bibliography  Save this article

Power and sample size for observational studies of point exposure effects

Author

Listed:
  • Bonnie E. Shook‐Sa
  • Michael G. Hudgens

Abstract

Inverse probability of treatment weights (IPTWs) are commonly used to control for confounding when estimating causal effects of point exposures from observational data. When planning a study that will be analyzed with IPTWs, determining the required sample size for a given level of statistical power is challenging because of the effect of weighting on the variance of the estimated causal means. This paper considers the utility of the design effect to quantify the effect of weighting on the precision of causal estimates. The design effect is defined as the ratio of the variance of the causal mean estimator divided by the variance of a naïve estimator if, counter to fact, no confounding had been present and weights were not needed. A simple, closed‐form approximation of the design effect is derived that is outcome invariant and can be estimated during the study design phase. Once the design effect is approximated for each treatment group, sample size calculations are conducted as for a randomized trial, but with variances inflated by the design effects to account for weighting. Simulations demonstrate the accuracy of the design effect approximation, and practical considerations are discussed.

Suggested Citation

  • Bonnie E. Shook‐Sa & Michael G. Hudgens, 2022. "Power and sample size for observational studies of point exposure effects," Biometrics, The International Biometric Society, vol. 78(1), pages 388-398, March.
  • Handle: RePEc:bla:biomet:v:78:y:2022:i:1:p:388-398
    DOI: 10.1111/biom.13405
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/biom.13405
    Download Restriction: no

    File URL: https://libkey.io/10.1111/biom.13405?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Brian K Lee & Justin Lessler & Elizabeth A Stuart, 2011. "Weight Trimming and Propensity Score Weighting," PLOS ONE, Public Library of Science, vol. 6(3), pages 1-6, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Callaway, Brantly & Li, Tong, 2023. "Policy evaluation during a pandemic," Journal of Econometrics, Elsevier, vol. 236(1).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Glover, Steven & Jones, Sam, 2019. "Can commercial farming promote rural dynamism in sub-Saharan Africa? Evidence from Mozambique," World Development, Elsevier, vol. 114(C), pages 110-121.
    2. Nazmul Islam & Natalie E. Sheils & Megan S. Jarvis & Kenneth Cohen, 2022. "Comparative effectiveness over time of the mRNA-1273 (Moderna) vaccine and the BNT162b2 (Pfizer-BioNTech) vaccine," Nature Communications, Nature, vol. 13(1), pages 1-7, December.
    3. Wendy Chan, 2018. "Applications of Small Area Estimation to Generalization With Subclassification by Propensity Scores," Journal of Educational and Behavioral Statistics, , vol. 43(2), pages 182-224, April.
    4. Xu Qin & Jonah Deutsch & Guanglei Hong, 2021. "Unpacking Complex Mediation Mechanisms And Their Heterogeneity Between Sites In A Job Corps Evaluation," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 40(1), pages 158-190, January.
    5. Luca Zanin & Rosalba Radice & Giampiero Marra, 2013. "Estimating the Effect of Perceived Risk of Crime on Social Trust in the Presence of Endogeneity Bias," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 114(2), pages 523-547, November.
    6. Xinguang Fan & Maria Vignau Loria, 2020. "Intimate partner violence and contraceptive use in developing countries: How does the relationship depend on context?," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 42(10), pages 293-342.
    7. Aloyce R. Kaliba & Anne G. Gongwe & Kizito Mazvimavi & Ashagre Yigletu, 2021. "Impact of Adopting Improved Seeds on Access to Broader Food Groups Among Small-Scale Sorghum Producers in Tanzania," SAGE Open, , vol. 11(1), pages 21582440209, January.
    8. Stanley C Wei & Lauren Messina & Julia Hood & Alison Hughes & Thomas Jaenicke & Kendra Johnson & Leandro Mena & Susan Scheer & Chi-Chi Udeagu & Amy Wohl & McKaylee Robertson & Joseph Prejean & Mi Chen, 2019. "Methods to include persons living with HIV not receiving HIV care in the Medical Monitoring Project," PLOS ONE, Public Library of Science, vol. 14(8), pages 1-19, August.
    9. Cousineau, Martin & Verter, Vedat & Murphy, Susan A. & Pineau, Joelle, 2023. "Estimating causal effects with optimization-based methods: A review and empirical comparison," European Journal of Operational Research, Elsevier, vol. 304(2), pages 367-380.
    10. Szabolcs Szekér & Ágnes Vathy-Fogarassy, 2020. "Weighted nearest neighbours-based control group selection method for observational studies," PLOS ONE, Public Library of Science, vol. 15(7), pages 1-20, July.
    11. Jiangang Liao & Charles Rohde, 2022. "Variance reduction in the inverse probability weighted estimators for the average treatment effect using the propensity score," Biometrics, The International Biometric Society, vol. 78(2), pages 660-667, June.
    12. Mingyang Shan & Douglas Faries & Andy Dang & Xiang Zhang & Zhanglin Cui & Kristin M. Sheffield, 2022. "A Simulation-Based Evaluation of Statistical Methods for Hybrid Real-World Control Arms in Clinical Trials," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 14(2), pages 259-284, July.
    13. Tenglong Li & Jordan Lawson, 2021. "A generalized bootstrap procedure of the standard error and confidence interval estimation for inverse probability of treatment weighting," Papers 2109.00171, arXiv.org.
    14. Haviland, Amelia M. & Eisenberg, Matthew D. & Mehrotra, Ateev & Huckfeldt, Peter J. & Sood, Neeraj, 2016. "Do “Consumer-Directed” health plans bend the cost curve over time?," Journal of Health Economics, Elsevier, vol. 46(C), pages 33-51.
    15. Hwanhee Hong & Kara E. Rudolph & Elizabeth A. Stuart, 2017. "Bayesian Approach for Addressing Differential Covariate Measurement Error in Propensity Score Methods," Psychometrika, Springer;The Psychometric Society, vol. 82(4), pages 1078-1096, December.
    16. Byeong Yeob Choi & Chen-Pin Wang & Joel Michalek & Jonathan Gelfond, 2019. "Power comparison for propensity score methods," Computational Statistics, Springer, vol. 34(2), pages 743-761, June.
    17. Byeong Yeob Choi, 2021. "Instrumental variable estimation of truncated local average treatment effects," PLOS ONE, Public Library of Science, vol. 16(4), pages 1-12, April.
    18. Emmanuel Nshakira-Rukundo & Essa Chanie Mussa & Nathan Nshakira & Nicolas Gerber & Joachim von Braun, 2021. "Impact of community-based health insurance on utilisation of preventive health services in rural Uganda: a propensity score matching approach," International Journal of Health Economics and Management, Springer, vol. 21(2), pages 203-227, June.
    19. Bai, Yang & Wang, Ryan Yang & Jayakar, Krishna, 2022. "What $2.5 billion can buy: The effect of the Broadband Initiatives Program on farm productivity," Telecommunications Policy, Elsevier, vol. 46(7).
    20. Lingxiao Wang & Barry I. Graubard & Hormuzd A. Katki & and Yan Li, 2020. "Improving external validity of epidemiologic cohort analyses: a kernel weighting approach," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(3), pages 1293-1311, June.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:biomet:v:78:y:2022:i:1:p:388-398. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0006-341X .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.