IDEAS home Printed from https://ideas.repec.org/a/bpj/ijbist/v6y2010i2n8.html
   My bibliography  Save this article

Dynamic Regime Marginal Structural Mean Models for Estimation of Optimal Dynamic Treatment Regimes, Part I: Main Content

Author

Listed:
  • Orellana Liliana

    (Instituto de Cálculo, Universidad de Buenos Aires)

  • Rotnitzky Andrea

    (Universidad Torcuato Di Tella and Harvard School of Public Health)

  • Robins James M.

    (Harvard School of Public Health)

Abstract

Dynamic treatment regimes are set rules for sequential decision making based on patient covariate history. Observational studies are well suited for the investigation of the effects of dynamic treatment regimes because of the variability in treatment decisions found in them. This variability exists because different physicians make different decisions in the face of similar patient histories. In this article we describe an approach to estimate the optimal dynamic treatment regime among a set of enforceable regimes. This set is comprised by regimes defined by simple rules based on a subset of past information. The regimes in the set are indexed by a Euclidean vector. The optimal regime is the one that maximizes the expected counterfactual utility over all regimes in the set. We discuss assumptions under which it is possible to identify the optimal regime from observational longitudinal data. Murphy et al. (2001) developed efficient augmented inverse probability weighted estimators of the expected utility of one fixed regime. Our methods are based on an extension of the marginal structural mean model of Robins (1998, 1999) which incorporate the estimation ideas of Murphy et al. (2001). Our models, which we call dynamic regime marginal structural mean models, are specially suitable for estimating the optimal treatment regime in a moderately small class of enforceable regimes of interest. We consider both parametric and semiparametric dynamic regime marginal structural models. We discuss locally efficient, double-robust estimation of the model parameters and of the index of the optimal treatment regime in the set. In a companion paper in this issue of the journal we provide proofs of the main results.

Suggested Citation

  • Orellana Liliana & Rotnitzky Andrea & Robins James M., 2010. "Dynamic Regime Marginal Structural Mean Models for Estimation of Optimal Dynamic Treatment Regimes, Part I: Main Content," The International Journal of Biostatistics, De Gruyter, vol. 6(2), pages 1-49, March.
  • Handle: RePEc:bpj:ijbist:v:6:y:2010:i:2:n:8
    DOI: 10.2202/1557-4679.1200
    as

    Download full text from publisher

    File URL: https://doi.org/10.2202/1557-4679.1200
    Download Restriction: For access to full text, subscription to the journal or payment for the individual article is required.

    File URL: https://libkey.io/10.2202/1557-4679.1200?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. S. A. Murphy, 2003. "Optimal dynamic treatment regimes," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 65(2), pages 331-355, May.
    2. Murphy S.A. & van der Laan M.J. & Robins J.M., 2001. "Marginal Mean Models for Dynamic Regimes," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1410-1423, December.
    3. Orellana Liliana & Rotnitzky Andrea & Robins James M., 2010. "Dynamic Regime Marginal Structural Mean Models for Estimation of Optimal Dynamic Treatment Regimes, Part II: Proofs of Results," The International Journal of Biostatistics, De Gruyter, vol. 6(2), pages 1-19, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Q. Clairon & R. Henderson & N. J. Young & E. D. Wilson & C. J. Taylor, 2021. "Adaptive treatment and robust control," Biometrics, The International Biometric Society, vol. 77(1), pages 223-236, March.
    2. Rich Benjamin & Moodie Erica E. M. & A. Stephens David, 2016. "Influence Re-weighted G-Estimation," The International Journal of Biostatistics, De Gruyter, vol. 12(1), pages 157-177, May.
    3. Lucia Babino & Andrea Rotnitzky & James Robins, 2019. "Multiple robust estimation of marginal structural mean models for unconstrained outcomes," Biometrics, The International Biometric Society, vol. 75(1), pages 90-99, March.
    4. Eric B. Laber & Anastasios A. Tsiatis & Marie Davidian & Shannon T. Holloway, 2014. "Discussion of “Combining biomarkers to optimize patient treatment recommendation”," Biometrics, The International Biometric Society, vol. 70(3), pages 707-710, September.
    5. Jelena Bradic & Weijie Ji & Yuqian Zhang, 2021. "High-dimensional Inference for Dynamic Treatment Effects," Papers 2110.04924, arXiv.org, revised May 2023.
    6. Chaffee Paul H. & van der Laan Mark J., 2012. "Targeted Maximum Likelihood Estimation for Dynamic Treatment Regimes in Sequentially Randomized Controlled Trials," The International Journal of Biostatistics, De Gruyter, vol. 8(1), pages 1-32, June.
    7. Jeffrey A. Boatman & David M. Vock, 2018. "Estimating the causal effect of treatment regimes for organ transplantation," Biometrics, The International Biometric Society, vol. 74(4), pages 1407-1416, December.
    8. Ying Huang & Youyi Fong, 2014. "Identifying optimal biomarker combinations for treatment selection via a robust kernel method," Biometrics, The International Biometric Society, vol. 70(4), pages 891-901, December.
    9. Shu Yang & Anastasios A. Tsiatis & Michael Blazing, 2018. "Modeling survival distribution as a function of time to treatment discontinuation: A dynamic treatment regime approach," Biometrics, The International Biometric Society, vol. 74(3), pages 900-909, September.
    10. Eric B. Laber & Daniel J. Lizotte & Bradley Ferguson, 2014. "Set-valued dynamic treatment regimes for competing outcomes," Biometrics, The International Biometric Society, vol. 70(1), pages 53-61, March.
    11. Baqun Zhang & Anastasios A. Tsiatis & Eric B. Laber & Marie Davidian, 2012. "A Robust Method for Estimating Optimal Treatment Regimes," Biometrics, The International Biometric Society, vol. 68(4), pages 1010-1018, December.
    12. Cain Lauren E. & Robins James M. & Lanoy Emilie & Logan Roger & Costagliola Dominique & Hernán Miguel A., 2010. "When to Start Treatment? A Systematic Approach to the Comparison of Dynamic Regimes Using Observational Data," The International Journal of Biostatistics, De Gruyter, vol. 6(2), pages 1-26, April.
    13. Yasuhiro Hagiwara & Tomohiro Shinozaki & Hirofumi Mukai & Yutaka Matsuyama, 2021. "Sensitivity analysis for subsequent treatments in confirmatory oncology clinical trials: A two‐stage stochastic dynamic treatment regime approach," Biometrics, The International Biometric Society, vol. 77(2), pages 702-714, June.
    14. Yunan Wu & Lan Wang, 2021. "Resampling‐based confidence intervals for model‐free robust inference on optimal treatment regimes," Biometrics, The International Biometric Society, vol. 77(2), pages 465-476, June.
    15. Victor Chernozhukov & Whitney Newey & Rahul Singh & Vasilis Syrgkanis, 2022. "Automatic Debiased Machine Learning for Dynamic Treatment Effects and General Nested Functionals," Papers 2203.13887, arXiv.org, revised Jun 2023.
    16. Yuqian Zhang & Weijie Ji & Jelena Bradic, 2021. "Dynamic treatment effects: high-dimensional inference under model misspecification," Papers 2111.06818, arXiv.org, revised Jun 2023.
    17. Xiaofei Bai & Anastasios A. Tsiatis & Wenbin Lu & Rui Song, 2017. "Optimal treatment regimes for survival endpoints using a locally-efficient doubly-robust estimator from a classification perspective," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 23(4), pages 585-604, October.
    18. Zhen Li & Jie Chen & Eric Laber & Fang Liu & Richard Baumgartner, 2023. "Optimal Treatment Regimes: A Review and Empirical Comparison," International Statistical Review, International Statistical Institute, vol. 91(3), pages 427-463, December.
    19. Ruoqing Zhu & Ying-Qi Zhao & Guanhua Chen & Shuangge Ma & Hongyu Zhao, 2017. "Greedy outcome weighted tree learning of optimal personalized treatment rules," Biometrics, The International Biometric Society, vol. 73(2), pages 391-400, June.
    20. Emily L. Butler & Eric B. Laber & Sonia M. Davis & Michael R. Kosorok, 2018. "Incorporating Patient Preferences into Estimation of Optimal Individualized Treatment Rules," Biometrics, The International Biometric Society, vol. 74(1), pages 18-26, March.
    21. Mélanie Prague & Daniel Commenges & Jon Michael Gran & Bruno Ledergerber & Jim Young & Hansjakob Furrer & Rodolphe Thiébaut, 2017. "Dynamic models for estimating the effect of HAART on CD4 in observational studies: Application to the Aquitaine Cohort and the Swiss HIV Cohort Study," Biometrics, The International Biometric Society, vol. 73(1), pages 294-304, March.
    22. Isaac Meza & Rahul Singh, 2021. "Nested Nonparametric Instrumental Variable Regression: Long Term, Mediated, and Time Varying Treatment Effects," Papers 2112.14249, arXiv.org, revised Mar 2024.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yuqian Zhang & Weijie Ji & Jelena Bradic, 2021. "Dynamic treatment effects: high-dimensional inference under model misspecification," Papers 2111.06818, arXiv.org, revised Jun 2023.
    2. Jelena Bradic & Weijie Ji & Yuqian Zhang, 2021. "High-dimensional Inference for Dynamic Treatment Effects," Papers 2110.04924, arXiv.org, revised May 2023.
    3. Yiwang Zhou & Peter X.K. Song & Haoda Fu, 2021. "Net benefit index: Assessing the influence of a biomarker for individualized treatment rules," Biometrics, The International Biometric Society, vol. 77(4), pages 1254-1264, December.
    4. Ruoqing Zhu & Ying-Qi Zhao & Guanhua Chen & Shuangge Ma & Hongyu Zhao, 2017. "Greedy outcome weighted tree learning of optimal personalized treatment rules," Biometrics, The International Biometric Society, vol. 73(2), pages 391-400, June.
    5. Xiaofei Bai & Anastasios A. Tsiatis & Wenbin Lu & Rui Song, 2017. "Optimal treatment regimes for survival endpoints using a locally-efficient doubly-robust estimator from a classification perspective," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 23(4), pages 585-604, October.
    6. Xinyu Tang & Abdus S. Wahed, 2011. "Comparison of treatment regimes with adjustment for auxiliary variables," Journal of Applied Statistics, Taylor & Francis Journals, vol. 38(12), pages 2925-2938, March.
    7. Hongming Pu & Bo Zhang, 2021. "Estimating optimal treatment rules with an instrumental variable: A partial identification learning approach," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 83(2), pages 318-345, April.
    8. Yasuhiro Hagiwara & Tomohiro Shinozaki & Hirofumi Mukai & Yutaka Matsuyama, 2021. "Sensitivity analysis for subsequent treatments in confirmatory oncology clinical trials: A two‐stage stochastic dynamic treatment regime approach," Biometrics, The International Biometric Society, vol. 77(2), pages 702-714, June.
    9. Han, Sukjin, 2021. "Identification in nonparametric models for dynamic treatment effects," Journal of Econometrics, Elsevier, vol. 225(2), pages 132-147.
    10. Ashesh Rambachan & Neil Shephard, 2019. "Econometric analysis of potential outcomes time series: instruments, shocks, linearity and the causal response function," Papers 1903.01637, arXiv.org, revised Feb 2020.
    11. Zhen Li & Jie Chen & Eric Laber & Fang Liu & Richard Baumgartner, 2023. "Optimal Treatment Regimes: A Review and Empirical Comparison," International Statistical Review, International Statistical Institute, vol. 91(3), pages 427-463, December.
    12. Baqun Zhang & Anastasios A. Tsiatis & Eric B. Laber & Marie Davidian, 2012. "A Robust Method for Estimating Optimal Treatment Regimes," Biometrics, The International Biometric Society, vol. 68(4), pages 1010-1018, December.
    13. Q. Clairon & R. Henderson & N. J. Young & E. D. Wilson & C. J. Taylor, 2021. "Adaptive treatment and robust control," Biometrics, The International Biometric Society, vol. 77(1), pages 223-236, March.
    14. Anders Bredahl Kock & Martin Thyrsgaard, 2017. "Optimal sequential treatment allocation," Papers 1705.09952, arXiv.org, revised Aug 2018.
    15. Callaway, Brantly & Sant’Anna, Pedro H.C., 2021. "Difference-in-Differences with multiple time periods," Journal of Econometrics, Elsevier, vol. 225(2), pages 200-230.
    16. Yunan Wu & Lan Wang, 2021. "Resampling‐based confidence intervals for model‐free robust inference on optimal treatment regimes," Biometrics, The International Biometric Society, vol. 77(2), pages 465-476, June.
    17. Eric B. Laber & Daniel J. Lizotte & Bradley Ferguson, 2014. "Set-valued dynamic treatment regimes for competing outcomes," Biometrics, The International Biometric Society, vol. 70(1), pages 53-61, March.
    18. Luedtke Alexander R. & van der Laan Mark J., 2016. "Super-Learning of an Optimal Dynamic Treatment Rule," The International Journal of Biostatistics, De Gruyter, vol. 12(1), pages 305-332, May.
    19. Shuxiao Chen & Bo Zhang, 2021. "Estimating and Improving Dynamic Treatment Regimes With a Time-Varying Instrumental Variable," Papers 2104.07822, arXiv.org.
    20. Lucia Babino & Andrea Rotnitzky & James Robins, 2019. "Multiple robust estimation of marginal structural mean models for unconstrained outcomes," Biometrics, The International Biometric Society, vol. 75(1), pages 90-99, March.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bpj:ijbist:v:6:y:2010:i:2:n:8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.degruyter.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.