IDEAS home Printed from https://ideas.repec.org/a/bpj/causin/v3y2015i2p157-175n2.html
   My bibliography  Save this article

Surrogate Endpoint Evaluation: Principal Stratification Criteria and the Prentice Definition

Author

Listed:
  • Gilbert Peter B.

    (Vaccine Infectious Disease Division, Fred Hutchinson Cancer Research Center, Seattle, WA 98109, USA Department of Biostatistics, University of Washington, Seattle, WA 98105, USA)

  • Gabriel Erin E.

    (Biostatistics Branch, National Institute of Allergy and Infectious Diseases, Bethesda, MD 20817, USA)

  • Huang Ying

    (Vaccine Infectious Disease Division, Fred Hutchinson Cancer Research Center, Seattle, WA 98109, USA Department of Biostatistics, University of Washington, Seattle, WA 98105, USA)

  • Chan Ivan S.F.

    (Merck & Co., Whitehouse Station, NJ 08889, USA)

Abstract

A common problem of interest within a randomized clinical trial is the evaluation of an inexpensive response endpoint as a valid surrogate endpoint for a clinical endpoint, where a chief purpose of a valid surrogate is to provide a way to make correct inferences on clinical treatment effects in future studies without needing to collect the clinical endpoint data. Within the principal stratification framework for addressing this problem based on data from a single randomized clinical efficacy trial, a variety of definitions and criteria for a good surrogate endpoint have been proposed, all based on or closely related to the “principal effects” or “causal effect predictiveness (CEP)” surface. We discuss CEP-based criteria for a useful surrogate endpoint, including (1) the meaning and relative importance of proposed criteria including average causal necessity (ACN), average causal sufficiency (ACS), and large clinical effect modification; (2) the relationship between these criteria and the Prentice definition of a valid surrogate endpoint; and (3) the relationship between these criteria and the consistency criterion (i.e. assurance against the “surrogate paradox”). This includes the result that ACN plus a strong version of ACS generally do not imply the Prentice definition nor the consistency criterion, but they do have these implications in special cases. Moreover, the converse does not hold except in a special case with a binary candidate surrogate. The results highlight that assumptions about the treatment effect on the clinical endpoint before the candidate surrogate is measured are influential for the ability to draw conclusions about the Prentice definition or consistency. In addition, we emphasize that in some scenarios that occur commonly in practice, the principal strata subpopulations for inference are identifiable from the observable data, in which cases the principal stratification framework has relatively high utility for the purpose of effect modification analysis and is closely connected to the treatment marker selection problem. The results are illustrated with application to a vaccine efficacy trial, where ACN and ACS for an antibody marker are found to be consistent with the data and hence support the Prentice definition and consistency.

Suggested Citation

  • Gilbert Peter B. & Gabriel Erin E. & Huang Ying & Chan Ivan S.F., 2015. "Surrogate Endpoint Evaluation: Principal Stratification Criteria and the Prentice Definition," Journal of Causal Inference, De Gruyter, vol. 3(2), pages 157-175, September.
  • Handle: RePEc:bpj:causin:v:3:y:2015:i:2:p:157-175:n:2
    DOI: 10.1515/jci-2014-0007
    as

    Download full text from publisher

    File URL: https://doi.org/10.1515/jci-2014-0007
    Download Restriction: no

    File URL: https://libkey.io/10.1515/jci-2014-0007?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Gilbert Peter B. & Hudgens Michael G. & Wolfson Julian, 2011. "Commentary on "Principal Stratification -- a Goal or a Tool?" by Judea Pearl," The International Journal of Biostatistics, De Gruyter, vol. 7(1), pages 1-15, September.
    2. Constantine E. Frangakis & Donald B. Rubin, 2002. "Principal Stratification in Causal Inference," Biometrics, The International Biometric Society, vol. 58(1), pages 21-29, March.
    3. Hua Chen & Zhi Geng & Jinzhu Jia, 2007. "Criteria for surrogate end points," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(5), pages 919-932, November.
    4. Peter B. Gilbert & Michael G. Hudgens, 2008. "Evaluating Candidate Principal Surrogate Endpoints," Biometrics, The International Biometric Society, vol. 64(4), pages 1146-1154, December.
    5. Dustin M. Long & Michael G. Hudgens, 2013. "Sharpening Bounds on Principal Effects with Covariates," Biometrics, The International Biometric Society, vol. 69(4), pages 812-819, December.
    6. Marshall M. Joffe & Tom Greene, 2009. "Related Causal Frameworks for Surrogate Outcomes," Biometrics, The International Biometric Society, vol. 65(2), pages 530-538, June.
    7. Jeremy M. G. Taylor & Yue Wang & Rodolphe Thiébaut, 2005. "Counterfactual Links to the Proportion of Treatment Effect Explained by a Surrogate Marker," Biometrics, The International Biometric Society, vol. 61(4), pages 1102-1111, December.
    8. Tyler J. VanderWeele, 2013. "Surrogate Measures and Consistent Surrogates," Biometrics, The International Biometric Society, vol. 69(3), pages 561-565, September.
    9. Dean Follmann, 2006. "Augmented Designs to Assess Immune Response in Vaccine Trials," Biometrics, The International Biometric Society, vol. 62(4), pages 1161-1169, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhichao Jiang & Peng Ding & Zhi Geng, 2016. "Principal causal effect identification and surrogate end point evaluation by multiple trials," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 78(4), pages 829-848, September.
    2. Ying Huang & Shibasish Dasgupta, 2019. "Likelihood-Based Methods for Assessing Principal Surrogate Endpoints in Vaccine Trials," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 11(3), pages 504-523, December.
    3. Tyler J. VanderWeele, 2013. "Surrogate Measures and Consistent Surrogates," Biometrics, The International Biometric Society, vol. 69(3), pages 561-565, September.
    4. Gilbert Peter B. & Blette Bryan S. & Hudgens Michael G. & Shepherd Bryan E., 2020. "Post-randomization Biomarker Effect Modification Analysis in an HIV Vaccine Clinical Trial," Journal of Causal Inference, De Gruyter, vol. 8(1), pages 54-69, January.
    5. Layla Parast & Tianxi Cai & Lu Tian, 2023. "Testing for heterogeneity in the utility of a surrogate marker," Biometrics, The International Biometric Society, vol. 79(2), pages 799-810, June.
    6. Fatema Shafie Khorassani & Jeremy M. G. Taylor & Niko Kaciroti & Michael R. Elliott, 2023. "Incorporating Covariates into Measures of Surrogate Paradox Risk," Stats, MDPI, vol. 6(1), pages 1-23, February.
    7. Emily K. Roberts & Michael R. Elliott & Jeremy M. G. Taylor, 2023. "Solutions for surrogacy validation with longitudinal outcomes for a gene therapy," Biometrics, The International Biometric Society, vol. 79(3), pages 1840-1852, September.
    8. Corwin M. Zigler & Thomas R. Belin, 2012. "A Bayesian Approach to Improved Estimation of Causal Effect Predictiveness for a Principal Surrogate Endpoint," Biometrics, The International Biometric Society, vol. 68(3), pages 922-932, September.
    9. Ying Huang & Peter B. Gilbert & Julian Wolfson, 2013. "Design and Estimation for Evaluating Principal Surrogate Markers in Vaccine Trials," Biometrics, The International Biometric Society, vol. 69(2), pages 301-309, June.
    10. Denis Agniel & Layla Parast, 2021. "Evaluation of longitudinal surrogate markers," Biometrics, The International Biometric Society, vol. 77(2), pages 477-489, June.
    11. Gilbert Peter B. & Hudgens Michael G. & Wolfson Julian, 2011. "Commentary on "Principal Stratification -- a Goal or a Tool?" by Judea Pearl," The International Journal of Biostatistics, De Gruyter, vol. 7(1), pages 1-15, September.
    12. Guido Imbens & Nathan Kallus & Xiaojie Mao & Yuhao Wang, 2022. "Long-term Causal Inference Under Persistent Confounding via Data Combination," Papers 2202.07234, arXiv.org, revised Aug 2024.
    13. Julian Wolfson & Peter Gilbert, 2010. "Statistical Identifiability and the Surrogate Endpoint Problem, with Application to Vaccine Trials," Biometrics, The International Biometric Society, vol. 66(4), pages 1153-1161, December.
    14. Gilbert Peter B. & Blette Bryan S. & Shepherd Bryan E. & Hudgens Michael G., 2020. "Post-randomization Biomarker Effect Modification Analysis in an HIV Vaccine Clinical Trial," Journal of Causal Inference, De Gruyter, vol. 8(1), pages 54-69, January.
    15. Ying Huang, 2018. "Evaluating principal surrogate markers in vaccine trials in the presence of multiphase sampling," Biometrics, The International Biometric Society, vol. 74(1), pages 27-39, March.
    16. Rui Zhuang & Ying Qing Chen, 2020. "Measuring Surrogacy in Clinical Research," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 12(3), pages 295-323, December.
    17. Marshall M. Joffe, 2013. "Discussion on “Surrogate Measures and Consistent Surrogates”," Biometrics, The International Biometric Society, vol. 69(3), pages 569-573, September.
    18. Ying Huang & Peter B. Gilbert, 2011. "Comparing Biomarkers as Principal Surrogate Endpoints," Biometrics, The International Biometric Society, vol. 67(4), pages 1442-1451, December.
    19. Ghosh, Debashis, 2012. "A causal framework for surrogate endpoints with semi-competing risks data," Statistics & Probability Letters, Elsevier, vol. 82(11), pages 1898-1902.
    20. VanderWeele Tyler J, 2011. "Principal Stratification -- Uses and Limitations," The International Journal of Biostatistics, De Gruyter, vol. 7(1), pages 1-14, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bpj:causin:v:3:y:2015:i:2:p:157-175:n:2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.degruyter.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.