IDEAS home Printed from https://ideas.repec.org/a/bpj/ijbist/v7y2011i1n31.html
   My bibliography  Save this article

The Relative Performance of Targeted Maximum Likelihood Estimators

Author

Listed:
  • Porter Kristin E.

    (University of California, Berkeley)

  • Gruber Susan

    (University of California, Berkeley)

  • van der Laan Mark J.

    (University of California, Berkeley)

  • Sekhon Jasjeet S.

    (University of California, Berkeley)

Abstract

There is an active debate in the literature on censored data about the relative performance of model based maximum likelihood estimators, IPCW-estimators, and a variety of double robust semiparametric efficient estimators. Kang and Schafer (2007) demonstrate the fragility of double robust and IPCW-estimators in a simulation study with positivity violations. They focus on a simple missing data problem with covariates where one desires to estimate the mean of an outcome that is subject to missingness. Responses by Robins, et al. (2007), Tsiatis and Davidian (2007), Tan (2007) and Ridgeway and McCaffrey (2007) further explore the challenges faced by double robust estimators and offer suggestions for improving their stability. In this article, we join the debate by presenting targeted maximum likelihood estimators (TMLEs). We demonstrate that TMLEs that guarantee that the parametric submodel employed by the TMLE procedure respects the global bounds on the continuous outcomes, are especially suitable for dealing with positivity violations because in addition to being double robust and semiparametric efficient, they are substitution estimators. We demonstrate the practical performance of TMLEs relative to other estimators in the simulations designed by Kang and Schafer (2007) and in modified simulations with even greater estimation challenges.

Suggested Citation

  • Porter Kristin E. & Gruber Susan & van der Laan Mark J. & Sekhon Jasjeet S., 2011. "The Relative Performance of Targeted Maximum Likelihood Estimators," The International Journal of Biostatistics, De Gruyter, vol. 7(1), pages 1-34, August.
    • Handle: RePEc:bpj:ijbist:v:7:y:2011:i:1:n:31
    DOI: 10.2202/1557-4679.1308
    as

    Download full text from publisher

    File URL: https://doi.org/10.2202/1557-4679.1308
    Download Restriction: For access to full text, subscription to the journal or payment for the individual article is required.
    File URL: https://libkey.io/10.2202/1557-4679.1308?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. James Robins & Andrea Rotnitzky & Stijn Vansteelandt, 2007. "Discussions," Biometrics, The International Biometric Society, vol. 63(3), pages 650-653, September.
    2. Weihua Cao & Anastasios A. Tsiatis & Marie Davidian, 2009. "Improving efficiency and robustness of the doubly robust estimator for a population mean with incomplete data," Biometrika, Biometrika Trust, vol. 96(3), pages 723-734.
    3. Zhiqiang Tan, 2010. "Bounded, efficient and doubly robust estimation with inverse weighting," Biometrika, Biometrika Trust, vol. 97(3), pages 661-682.
    4. Gruber Susan & van der Laan Mark J., 2010. "A Targeted Maximum Likelihood Estimator of a Causal Effect on a Bounded Continuous Outcome," The International Journal of Biostatistics, De Gruyter, vol. 6(1), pages 1-18, August.
    5. Mark van der Laan & Sandrine Dudoit & Aad van der Vaart, 2004. "The Cross-Validated Adaptive Epsilon-Net Estimator," U.C. Berkeley Division of Biostatistics Working Paper Series 1141, Berkeley Electronic Press.
    6. Rubin Daniel B & van der Laan Mark J., 2008. "Empirical Efficiency Maximization: Improved Locally Efficient Covariate Adjustment in Randomized Experiments and Survival Analysis," The International Journal of Biostatistics, De Gruyter, vol. 4(1), pages 1-40, May.
    7. Rosenblum Michael & van der Laan Mark J., 2010. "Targeted Maximum Likelihood Estimation of the Parameter of a Marginal Structural Model," The International Journal of Biostatistics, De Gruyter, vol. 6(2), pages 1-30, April.
    8. Andrea Rotnitzky & Lingling Li & Xiaochun Li, 2010. "A note on overadjustment in inverse probability weighted estimation," Biometrika, Biometrika Trust, vol. 97(4), pages 997-1001.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Noémi Kreif & Richard Grieve & Iván Díaz & David Harrison, 2015. "Evaluation of the Effect of a Continuous Treatment: A Machine Learning Approach with an Application to Treatment for Traumatic Brain Injury," Health Economics, John Wiley & Sons, Ltd., vol. 24(9), pages 1213-1228, September.
    2. Radice Rosalba & Ramsahai Roland & Grieve Richard & Kreif Noemi & Sadique Zia & Sekhon Jasjeet S., 2012. "Evaluating treatment effectiveness in patient subgroups: a comparison of propensity score methods with an automated matching approach," The International Journal of Biostatistics, De Gruyter, vol. 8(1), pages 1-45, August.
    3. Stitelman Ori M. & De Gruttola Victor & van der Laan Mark J., 2012. "A General Implementation of TMLE for Longitudinal Data Applied to Causal Inference in Survival Analysis," The International Journal of Biostatistics, De Gruyter, vol. 8(1), pages 1-39, September.
    4. van der Laan Mark J., 2014. "Targeted Estimation of Nuisance Parameters to Obtain Valid Statistical Inference," The International Journal of Biostatistics, De Gruyter, vol. 10(1), pages 1-29, May.
    5. Chaffee Paul H. & van der Laan Mark J., 2012. "Targeted Maximum Likelihood Estimation for Dynamic Treatment Regimes in Sequentially Randomized Controlled Trials," The International Journal of Biostatistics, De Gruyter, vol. 8(1), pages 1-32, June.
    6. Schnitzer Mireille E. & Lok Judith J. & Gruber Susan, 2016. "Variable Selection for Confounder Control, Flexible Modeling and Collaborative Targeted Minimum Loss-Based Estimation in Causal Inference," The International Journal of Biostatistics, De Gruyter, vol. 12(1), pages 97-115, May.
    7. Díaz Iván & Rosenblum Michael, 2015. "Targeted Maximum Likelihood Estimation using Exponential Families," The International Journal of Biostatistics, De Gruyter, vol. 11(2), pages 233-251, November.
    8. Gilbert Peter B. & Blette Bryan S. & Hudgens Michael G. & Shepherd Bryan E., 2020. "Post-randomization Biomarker Effect Modification Analysis in an HIV Vaccine Clinical Trial," Journal of Causal Inference, De Gruyter, vol. 8(1), pages 54-69, January.
    9. Ronald Herrera & Ursula Berger & Ondine S. Von Ehrenstein & Iván Díaz & Stella Huber & Daniel Moraga Muñoz & Katja Radon, 2017. "Estimating the Causal Impact of Proximity to Gold and Copper Mines on Respiratory Diseases in Chilean Children: An Application of Targeted Maximum Likelihood Estimation," IJERPH, MDPI, vol. 15(1), pages 1-15, December.
    10. Stitelman Ori M & Wester C. William & De Gruttola Victor & van der Laan Mark J., 2011. "Targeted Maximum Likelihood Estimation of Effect Modification Parameters in Survival Analysis," The International Journal of Biostatistics, De Gruyter, vol. 7(1), pages 1-34, March.
    11. van der Laan Mark J. & Gruber Susan, 2012. "Targeted Minimum Loss Based Estimation of Causal Effects of Multiple Time Point Interventions," The International Journal of Biostatistics, De Gruyter, vol. 8(1), pages 1-41, May.
    12. Kreif, N. & Grieve, R. & Díaz, I. & Harrison, D., 2014. "Health econometric evaluation of the effects of a continuous treatment: a machine learning approach," Health, Econometrics and Data Group (HEDG) Working Papers 14/19, HEDG, c/o Department of Economics, University of York.
    13. Gilbert Peter B. & Blette Bryan S. & Hudgens Michael G. & Shepherd Bryan E., 2020. "Post-randomization Biomarker Effect Modification Analysis in an HIV Vaccine Clinical Trial," Journal of Causal Inference, De Gruyter, vol. 8(1), pages 54-69, January.
    14. van der Laan Mark, 2017. "A Generally Efficient Targeted Minimum Loss Based Estimator based on the Highly Adaptive Lasso," The International Journal of Biostatistics, De Gruyter, vol. 13(2), pages 1-35, November.
    15. Lars van der Laan & Wenbo Zhang & Peter B. Gilbert, 2023. "Nonparametric estimation of the causal effect of a stochastic threshold‐based intervention," Biometrics, The International Biometric Society, vol. 79(2), pages 1014-1028, June.
    16. Youmi Suk, 2024. "A Within-Group Approach to Ensemble Machine Learning Methods for Causal Inference in Multilevel Studies," Journal of Educational and Behavioral Statistics, , vol. 49(1), pages 61-91, February.
    17. Susan Gruber & Mark J. van der Laan, 2013. "An Application of Targeted Maximum Likelihood Estimation to the Meta-Analysis of Safety Data," Biometrics, The International Biometric Society, vol. 69(1), pages 254-262, March.
    18. Brooks Jordan & van der Laan Mark J. & Go Alan S., 2012. "Targeted Maximum Likelihood Estimation for Prediction Calibration," The International Journal of Biostatistics, De Gruyter, vol. 8(1), pages 1-35, October.
    19. Díaz Iván & Carone Marco & van der Laan Mark J., 2016. "Second-Order Inference for the Mean of a Variable Missing at Random," The International Journal of Biostatistics, De Gruyter, vol. 12(1), pages 333-349, May.
    20. Nima S. Hejazi & Mark J. van der Laan & Holly E. Janes & Peter B. Gilbert & David C. Benkeser, 2021. "Efficient nonparametric inference on the effects of stochastic interventions under two‐phase sampling, with applications to vaccine efficacy trials," Biometrics, The International Biometric Society, vol. 77(4), pages 1241-1253, December.
    21. Sherri Rose & Julie Shi & Thomas G. McGuire & Sharon-Lise T. Normand, 2017. "Matching and Imputation Methods for Risk Adjustment in the Health Insurance Marketplaces," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 9(2), pages 525-542, December.
    22. Sherri Rose & Sharon‐Lise Normand, 2019. "Double robust estimation for multiple unordered treatments and clustered observations: Evaluating drug‐eluting coronary artery stents," Biometrics, The International Biometric Society, vol. 75(1), pages 289-296, March.
    23. Díaz Iván & van der Laan Mark J., 2013. "Assessing the Causal Effect of Policies: An Example Using Stochastic Interventions," The International Journal of Biostatistics, De Gruyter, vol. 9(2), pages 161-174, November.
    24. Mariela Sued & Marina Valdora & Víctor Yohai, 2020. "Robust doubly protected estimators for quantiles with missing data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 29(3), pages 819-843, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rose Sherri & van der Laan Mark J., 2011. "A Targeted Maximum Likelihood Estimator for Two-Stage Designs," The International Journal of Biostatistics, De Gruyter, vol. 7(1), pages 1-21, March.
    2. Karel Vermeulen & Stijn Vansteelandt, 2015. "Bias-Reduced Doubly Robust Estimation," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(511), pages 1024-1036, September.
    3. Peisong Han, 2016. "Combining Inverse Probability Weighting and Multiple Imputation to Improve Robustness of Estimation," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 43(1), pages 246-260, March.
    4. Jie Zhou & Zhiwei Zhang & Zhaohai Li & Jun Zhang, 2015. "Coarsened Propensity Scores and Hybrid Estimators for Missing Data and Causal Inference," International Statistical Review, International Statistical Institute, vol. 83(3), pages 449-471, December.
    5. Guo, Xu & Fang, Yun & Zhu, Xuehu & Xu, Wangli & Zhu, Lixing, 2018. "Semiparametric double robust and efficient estimation for mean functionals with response missing at random," Computational Statistics & Data Analysis, Elsevier, vol. 128(C), pages 325-339.
    6. Zhiwei Zhang & Zhen Chen & James F. Troendle & Jun Zhang, 2012. "Causal Inference on Quantiles with an Obstetric Application," Biometrics, The International Biometric Society, vol. 68(3), pages 697-706, September.
    7. Jianxuan Liu & Yanyuan Ma & Lan Wang, 2018. "An alternative robust estimator of average treatment effect in causal inference," Biometrics, The International Biometric Society, vol. 74(3), pages 910-923, September.
    8. Ao Yuan & Anqi Yin & Ming T. Tan, 2021. "Enhanced Doubly Robust Procedure for Causal Inference," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 13(3), pages 454-478, December.
    9. Gruber Susan & van der Laan Mark J., 2010. "An Application of Collaborative Targeted Maximum Likelihood Estimation in Causal Inference and Genomics," The International Journal of Biostatistics, De Gruyter, vol. 6(1), pages 1-31, May.
    10. Iván Díaz & Elizabeth Colantuoni & Daniel F. Hanley & Michael Rosenblum, 2019. "Improved precision in the analysis of randomized trials with survival outcomes, without assuming proportional hazards," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 25(3), pages 439-468, July.
    11. Xiaogang Duan & Guosheng Yin, 2017. "Ensemble Approaches to Estimating the Population Mean with Missing Response," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 44(4), pages 899-917, December.
    12. Weibin Mo & Yufeng Liu, 2022. "Efficient learning of optimal individualized treatment rules for heteroscedastic or misspecified treatment‐free effect models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(2), pages 440-472, April.
    13. Susan Gruber & Mark J. van der Laan, 2013. "An Application of Targeted Maximum Likelihood Estimation to the Meta-Analysis of Safety Data," Biometrics, The International Biometric Society, vol. 69(1), pages 254-262, March.
    14. Haight, Thaddeus J. & Wang, Yue & van der Laan, Mark J. & Tager, Ira B., 2010. "A cross-validation deletion-substitution-addition model selection algorithm: Application to marginal structural models," Computational Statistics & Data Analysis, Elsevier, vol. 54(12), pages 3080-3094, December.
    15. Słoczyński, Tymon & Wooldridge, Jeffrey M., 2018. "A General Double Robustness Result For Estimating Average Treatment Effects," Econometric Theory, Cambridge University Press, vol. 34(1), pages 112-133, February.
    16. van der Laan Mark J., 2014. "Targeted Estimation of Nuisance Parameters to Obtain Valid Statistical Inference," The International Journal of Biostatistics, De Gruyter, vol. 10(1), pages 1-29, May.
    17. Michael Zimmert, 2018. "The Finite Sample Performance of Treatment Effects Estimators based on the Lasso," Papers 1805.05067, arXiv.org.
    18. Kwun Chuen Gary Chan & Sheung Chi Phillip Yam & Zheng Zhang, 2016. "Globally efficient non-parametric inference of average treatment effects by empirical balancing calibration weighting," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 78(3), pages 673-700, June.
    19. Gruber Susan & van der Laan Mark J., 2012. "Targeted Minimum Loss Based Estimator that Outperforms a given Estimator," The International Journal of Biostatistics, De Gruyter, vol. 8(1), pages 1-22, May.
    20. Waverly Wei & Maya Petersen & Mark J van der Laan & Zeyu Zheng & Chong Wu & Jingshen Wang, 2023. "Efficient targeted learning of heterogeneous treatment effects for multiple subgroups," Biometrics, The International Biometric Society, vol. 79(3), pages 1934-1946, September.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bpj:ijbist:v:7:y:2011:i:1:n:31. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.degruyter.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.