IDEAS home Printed from https://ideas.repec.org/a/gam/jstats/v8y2025i4p101-d1773929.html

Robustness of the Trinormal ROC Surface Model: Formal Assessment via Goodness-of-Fit Testing

Author

Listed:
  • Christos Nakas

    (Laboratory of Biometry, School of Agriculture, University of Thessaly, 384 46 Volos, Greece
    Department of Clinical Chemistry, Inselspital University Hospital Bern, University of Bern, 3012 Bern, Switzerland)

Abstract

Receiver operating characteristic (ROC) surfaces provide a natural extension of ROC curves to three-class diagnostic problems. A key summary index is the volume under the surface (VUS), representing the probability that a randomly chosen observation from each of the three ordered groups is correctly classified. A parametric estimation of VUS typically assumes trinormality of the class distributions. However, a formal method for the verification of this composite assumption has not appeared in the literature. Our approach generalizes the two-class AUC-based GOF test of Zou et al. to the three-class setting by exploiting the parallel structure between empirical and trinormal VUS estimators. We propose a global goodness-of-fit (GOF) test for trinormal ROC models based on the difference between empirical and trinormal parametric estimates of the VUS. To improve stability, a probit transformation is applied and a bootstrap procedure is used to estimate the variance of the difference. The resulting test provides a formal diagnostic for assessing the adequacy of trinormal ROC modeling. Simulation studies illustrate the robustness of the assumption via the empirical size and power of the test under various distributional settings, including skewed and multimodal alternatives. The method’s application to COVID-19 antibody level data demonstrates the practical utility of it. Our findings suggest that the proposed GOF test is simple to implement, computationally feasible for moderate sample sizes, and a useful complement to existing ROC surface methodology.

Suggested Citation

  • Christos Nakas, 2025. "Robustness of the Trinormal ROC Surface Model: Formal Assessment via Goodness-of-Fit Testing," Stats, MDPI, vol. 8(4), pages 1-15, October.
  • Handle: RePEc:gam:jstats:v:8:y:2025:i:4:p:101-:d:1773929
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2571-905X/8/4/101/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2571-905X/8/4/101/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Paul S. Heckerling, 2001. "Parametric Three-Way Receiver Operating Characteristic Surface Analysis Using Mathematica," Medical Decision Making, , vol. 21(5), pages 409-417, October.
    2. James A. Hanley, 1988. "The Robustness of the "Binormal" Assumptions Used in Fitting ROC Curves," Medical Decision Making, , vol. 8(3), pages 197-203, August.
    3. Kang, Le & Tian, Lili, 2013. "Estimation of the volume under the ROC surface with three ordinal diagnostic categories," Computational Statistics & Data Analysis, Elsevier, vol. 62(C), pages 39-51.
    4. Stephan Dreiseitl & Lucila Ohno-Machado & Michael Binder, 2000. "Comparing Three-class Diagnostic Tests by Three-way ROC Analysis," Medical Decision Making, , vol. 20(3), pages 323-331, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wan, Shuwen & Zhang, Biao, 2015. "Using proportional odds models for semiparametric ROC surface estimation," Statistics & Probability Letters, Elsevier, vol. 105(C), pages 74-79.
    2. Huazhen Lin & Ling Zhou & Chunhong Li & Yi Li, 2014. "Semiparametric transformation models for semicompeting survival data," Biometrics, The International Biometric Society, vol. 70(3), pages 599-607, September.
    3. Coolen-Maturi, Tahani & Elkhafifi, Faiza F. & Coolen, Frank P.A., 2014. "Three-group ROC analysis: A nonparametric predictive approach," Computational Statistics & Data Analysis, Elsevier, vol. 78(C), pages 69-81.
    4. Waegeman, Willem & De Baets, Bernard & Boullart, Luc, 2008. "On the scalability of ordered multi-class ROC analysis," Computational Statistics & Data Analysis, Elsevier, vol. 52(7), pages 3371-3388, March.
    5. Eugene Demidenko, 2012. "Confidence intervals and bands for the binormal ROC curve revisited," Journal of Applied Statistics, Taylor & Francis Journals, vol. 39(1), pages 67-79, March.
    6. Òscar Jordà & Alan M. Taylor, 2011. "Performance Evaluation of Zero Net-Investment Strategies," NBER Working Papers 17150, National Bureau of Economic Research, Inc.
    7. repec:plo:pone00:0221433 is not listed on IDEAS
    8. McCarthy, Patrick, 2024. "Predicting trips to health care facilities: A binary logit and receiver operating characteristics (ROC) approach," Research in Transportation Economics, Elsevier, vol. 103(C).
    9. Zhu, Rui & Ghosal, Subhashis, 2019. "Bayesian Semiparametric ROC surface estimation under verification bias," Computational Statistics & Data Analysis, Elsevier, vol. 133(C), pages 40-52.
    10. Kajal Lahiri & Liu Yang, 2018. "Confidence Bands for ROC Curves With Serially Dependent Data," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 36(1), pages 115-130, January.
    11. Khanh To Duc & Monica Chiogna & Gianfranco Adimari, 2019. "Estimation of the volume under the ROC surface in presence of nonignorable verification bias," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 28(4), pages 695-722, December.
    12. Song Zhang & Yang Qu & Yu Cheng & Oscar L. Lopez & Abdus S. Wahed, 2022. "Prognostic accuracy for predicting ordinal competing risk outcomes using ROC surfaces," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 28(1), pages 1-22, January.
    13. Sean F. Reardon & Andrew D. Ho, 2015. "Practical Issues in Estimating Achievement Gaps From Coarsened Data," Journal of Educational and Behavioral Statistics, , vol. 40(2), pages 158-189, April.
    14. Manuel Franco & Juana-María Vivo, 2021. "Evaluating the Performances of Biomarkers over a Restricted Domain of High Sensitivity," Mathematics, MDPI, vol. 9(21), pages 1-20, November.
    15. Debashis Ghosh, 2004. "Semiparametic models and estimation procedures for binormal ROC curves with multiple biomarkers," The University of Michigan Department of Biostatistics Working Paper Series 1038, Berkeley Electronic Press.
    16. Anna N. Angelos Tosteson & Colin B. Begg, 1988. "A General Regression Methodology for ROC Curve Estimation," Medical Decision Making, , vol. 8(3), pages 204-215, August.
    17. Guogen Shan & Hua Zhang & Tao Jiang & Hanna Peterson & Daniel Young & Changxing Ma, 2016. "Exact p-Values for Simon’s Two-Stage Designs in Clinical Trials," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 8(2), pages 351-357, October.
    18. Zhao, Xun & Tang, Lu & Zhang, Weijia & Zhou, Ling, 2025. "Subgroup learning for multiple mixed-type outcomes with block-structured covariates," Computational Statistics & Data Analysis, Elsevier, vol. 204(C).
    19. Laurens Beran, 2014. "Hypothesis tests to determine if all true positives have been identified on a receiver operating characteristic curve," Journal of Applied Statistics, Taylor & Francis Journals, vol. 41(6), pages 1332-1341, June.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jstats:v:8:y:2025:i:4:p:101-:d:1773929. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.