IDEAS home Printed from https://ideas.repec.org/a/spr/alstar/v104y2020i4d10.1007_s10182-020-00371-8.html
   My bibliography  Save this article

Biomarker assessment in ROC curve analysis using the length of the curve as an index of diagnostic accuracy: the binormal model framework

Author

Listed:
  • Alba M. Franco-Pereira

    (Complutense University of Madrid)

  • Christos T. Nakas

    (University of Thessaly
    University of Bern)

  • M. Carmen Pardo

    (Complutense University of Madrid)

Abstract

In receiver operating characteristic (ROC) curve analysis, the area under the curve (AUC) is undoubtedly the most widely used index of diagnostic accuracy for the assessment of the utility of a biomarker or for the comparison of competing biomarkers. Along with the AUC, the maximum of the Youden index, J, is often used both as an index of diagnostic accuracy and as a tool useful for the estimation of an optimal cutoff point that can be used for diagnostic purposes based on the biomarker under consideration. In this work, we study the utility of the length of the binormal model-based ROC curve (LoC) as an index of diagnostic accuracy for biomarker evaluation. Estimation procedures for LoC, described in this article, are based either on normality assumptions or on the same assumptions after a Box–Cox transformation to normality. Two simulation studies are considered. In the first, the estimation procedures for LoC are compared in terms of bias and root mean squared error, while in the second one, the performance of LoC is compared with approaches based on AUC and J, both for the case of the assessment of a single biomarker and for the comparison of two biomarkers, in a parametric framework. We provide an interpretation for the proposed index and illustrate with an application on biomarkers from a colorectal cancer study.

Suggested Citation

  • Alba M. Franco-Pereira & Christos T. Nakas & M. Carmen Pardo, 2020. "Biomarker assessment in ROC curve analysis using the length of the curve as an index of diagnostic accuracy: the binormal model framework," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 104(4), pages 625-647, December.
    • Handle: RePEc:spr:alstar:v:104:y:2020:i:4:d:10.1007_s10182-020-00371-8
    DOI: 10.1007/s10182-020-00371-8
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10182-020-00371-8
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10182-020-00371-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Guogen Shan, 2015. "Improved Confidence Intervals for the Youden Index," PLOS ONE, Public Library of Science, vol. 10(7), pages 1-19, July.
    2. Wojtek J. Krzanowski & David J. Hand, 2011. "Testing the difference between two Kolmogorov--Smirnov values in the context of receiver operating characteristic curves," Journal of Applied Statistics, Taylor & Francis Journals, vol. 38(3), pages 437-450, October.
    3. Kelly Zou & W. J. Hall, 2000. "Two transformation models for estimating an ROC curve derived from continuous data," Journal of Applied Statistics, Taylor & Francis Journals, vol. 27(5), pages 621-631.
    4. Martin W. McIntosh & Margaret Sullivan Pepe, 2002. "Combining Several Screening Tests: Optimality of the Risk Score," Biometrics, The International Biometric Society, vol. 58(3), pages 657-664, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Daniel J. Luckett & Eric B. Laber & Samer S. El‐Kamary & Cheng Fan & Ravi Jhaveri & Charles M. Perou & Fatma M. Shebl & Michael R. Kosorok, 2021. "Receiver operating characteristic curves and confidence bands for support vector machines," Biometrics, The International Biometric Society, vol. 77(4), pages 1422-1430, December.
    2. Y. Huang & M. S. Pepe, 2009. "A Parametric ROC Model-Based Approach for Evaluating the Predictiveness of Continuous Markers in Case–Control Studies," Biometrics, The International Biometric Society, vol. 65(4), pages 1133-1144, December.
    3. Houshmand Masoumi, 2021. "Residential Location Choice in Istanbul, Tehran, and Cairo: The Importance of Commuting to Work," Sustainability, MDPI, vol. 13(10), pages 1-18, May.
    4. Ming-Yueh Huang & Chin-Tsang Chiang, 2017. "Estimation and Inference Procedures for Semiparametric Distribution Models with Varying Linear-Index," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 44(2), pages 396-424, June.
    5. Chin-Tsang Chiang & Shr-Yan Huang, 2009. "Estimation for the Optimal Combination of Markers without Modeling the Censoring Distribution," Biometrics, The International Biometric Society, vol. 65(1), pages 152-158, March.
    6. Jin, Hua & Lu, Ying, 2009. "Permutation test for non-inferiority of the linear to the optimal combination of multiple tests," Statistics & Probability Letters, Elsevier, vol. 79(5), pages 664-669, March.
    7. Margaret Sullivan Pepe & Tianxi Cai & Gary Longton, 2006. "Combining Predictors for Classification Using the Area under the Receiver Operating Characteristic Curve," Biometrics, The International Biometric Society, vol. 62(1), pages 221-229, March.
    8. Debashis Ghosh, 2004. "Semiparametric methods for the binormal model with multiple biomarkers," The University of Michigan Department of Biostatistics Working Paper Series 1046, Berkeley Electronic Press.
    9. Holly Janes & Margaret S. Pepe, 2008. "Matching in Studies of Classification Accuracy: Implications for Analysis, Efficiency, and Assessment of Incremental Value," Biometrics, The International Biometric Society, vol. 64(1), pages 1-9, March.
    10. Wang, Dan & Tian, Lili, 2017. "Parametric methods for confidence interval estimation of overlap coefficients," Computational Statistics & Data Analysis, Elsevier, vol. 106(C), pages 12-26.
    11. Dat Huynh & Oliver Laeyendecker & Ron Brookmeyer, 2014. "A serial risk score approach to disease classification that accounts for accuracy and cost," Biometrics, The International Biometric Society, vol. 70(4), pages 1042-1051, December.
    12. Carol Y. Lin & Lance A. Waller & Robert H. Lyles, 2012. "The likelihood approach for the comparison of medical diagnostic system with multiple binary tests," Journal of Applied Statistics, Taylor & Francis Journals, vol. 39(7), pages 1437-1454, December.
    13. Kajal Lahiri & Liu Yang, 2023. "Predicting binary outcomes based on the pair-copula construction," Empirical Economics, Springer, vol. 64(6), pages 3089-3119, June.
    14. Chen, Xiwei & Vexler, Albert & Markatou, Marianthi, 2015. "Empirical likelihood ratio confidence interval estimation of best linear combinations of biomarkers," Computational Statistics & Data Analysis, Elsevier, vol. 82(C), pages 186-198.
    15. Sonia Pérez-Fernández & Pablo Martínez-Camblor & Peter Filzmoser & Norberto Corral, 2021. "Visualizing the decision rules behind the ROC curves: understanding the classification process," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 105(1), pages 135-161, March.
    16. Osamu Komori, 2011. "A boosting method for maximization of the area under the ROC curve," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 63(5), pages 961-979, October.
    17. Debashis Ghosh & Moulinath Banerjee & Pinaki Biswas, 2004. "Binary isotonic regression procedures, with application to cancer biomarkers," The University of Michigan Department of Biostatistics Working Paper Series 1037, Berkeley Electronic Press.
    18. Alibek Orynbassar & Yershat Sapazhanov & Shirali Kadyrov & Irina Lyublinskaya, 2022. "Application of ROC Curve Analysis for Predicting Students’ Passing Grade in a Course Based on Prerequisite Grades," Mathematics, MDPI, vol. 10(12), pages 1-11, June.
    19. Zhongkai Liu & Howard D. Bondell, 2019. "Binormal Precision–Recall Curves for Optimal Classification of Imbalanced Data," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 11(1), pages 141-161, April.
    20. Holly Janes & Gary Longton & Margaret S. Pepe, 2009. "Accommodating covariates in receiver operating characteristic analysis," Stata Journal, StataCorp LP, vol. 9(1), pages 17-39, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:alstar:v:104:y:2020:i:4:d:10.1007_s10182-020-00371-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.