IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v157y2021ics0167947320302371.html
   My bibliography  Save this article

A non-parametric test for comparing conditional ROC curves

Author

Listed:
  • Fanjul-Hevia, Arís
  • González-Manteiga, Wenceslao
  • Pardo-Fernández, Juan Carlos

Abstract

Comparing the accuracy and the behaviour of different diagnostic procedures is one of the main objectives of the Receiver Operating Characteristic (ROC) curve analysis. Along with the diagnostic variables it is usual to observe other covariates, but that extra information has been hardly ever considered for the comparison of this kind of curves. A new non-parametric test is proposed for the comparison of conditional ROC curves. This test is based on a statistic whose theoretical properties are examined, and a bootstrap mechanism is used to calibrate the test. Simulations are run to analyse the practical performance of the test in terms of level approximation and power. An application to real data is also presented to illustrate the procedure.

Suggested Citation

  • Fanjul-Hevia, Arís & González-Manteiga, Wenceslao & Pardo-Fernández, Juan Carlos, 2021. "A non-parametric test for comparing conditional ROC curves," Computational Statistics & Data Analysis, Elsevier, vol. 157(C).
    • Handle: RePEc:eee:csdana:v:157:y:2021:i:c:s0167947320302371
    DOI: 10.1016/j.csda.2020.107146
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947320302371
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2020.107146?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Einmahl, John H.J. & Van Keilegom, Ingrid, 2008. "Specification tests in nonparametric regression," Journal of Econometrics, Elsevier, vol. 143(1), pages 88-102, March.
    2. E. S. Venkatraman, 2000. "A Permutation Test to Compare Receiver Operating Characteristic Curves," Biometrics, The International Biometric Society, vol. 56(4), pages 1134-1138, December.
    3. Lopez-de-Ullibarri, Ignacio & Cao, Ricardo & Cadarso-Suarez, Carmen & Lado, Maria J., 2008. "Nonparametric estimation of conditional ROC curves: Application to discrimination tasks in computerized detection of early breast cancer," Computational Statistics & Data Analysis, Elsevier, vol. 52(5), pages 2623-2631, January.
    4. Pablo Mart�nez-Camblor & Carlos Carleos & Norberto Corral, 2011. "Powerful nonparametric statistics to compare k independent ROC curves," Journal of Applied Statistics, Taylor & Francis Journals, vol. 38(7), pages 1317-1332, May.
    5. Escanciano, J. Carlos, 2006. "A Consistent Diagnostic Test For Regression Models Using Projections," Econometric Theory, Cambridge University Press, vol. 22(6), pages 1030-1051, December.
    6. Vanda Inácio de Carvalho & Miguel de Carvalho & Adam J. Branscum, 2017. "Nonparametric Bayesian covariate‐adjusted estimation of the Youden index," Biometrics, The International Biometric Society, vol. 73(4), pages 1279-1288, December.
    7. Wenceslao González‐Manteiga & Juan Carlos Pardo‐Fernández & Ingrid Van Keilegom, 2011. "ROC Curves in Non‐Parametric Location‐Scale Regression Models," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 38(1), pages 169-184, March.
    8. Arís Fanjul-Hevia & Wenceslao González-Manteiga, 2018. "A comparative study of methods for testing the equality of two or more ROC curves," Computational Statistics, Springer, vol. 33(1), pages 357-377, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Arís Fanjul-Hevia & Wenceslao González-Manteiga, 2018. "A comparative study of methods for testing the equality of two or more ROC curves," Computational Statistics, Springer, vol. 33(1), pages 357-377, March.
    2. Pardo-Fernandez, Juan Carlos & Rodriguez-alvarez, Maria Xose & Van Keilegom, Ingrid, 2013. "A review on ROC curves in the presence of covariates," LIDAM Discussion Papers ISBA 2013050, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    3. To, Duc-Khanh & Adimari, Gianfranco & Chiogna, Monica, 2022. "Estimation of the volume under a ROC surface in presence of covariates," Computational Statistics & Data Analysis, Elsevier, vol. 174(C).
    4. Pablo Mart�nez-Camblor & Carlos Carleos & Norberto Corral, 2011. "Powerful nonparametric statistics to compare k independent ROC curves," Journal of Applied Statistics, Taylor & Francis Journals, vol. 38(7), pages 1317-1332, May.
    5. Pedro H. C. Sant'Anna & Xiaojun Song & Qi Xu, 2022. "Covariate distribution balance via propensity scores," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(6), pages 1093-1120, September.
    6. Jin, Hua & Lu, Ying, 2009. "Permutation test for non-inferiority of the linear to the optimal combination of multiple tests," Statistics & Probability Letters, Elsevier, vol. 79(5), pages 664-669, March.
    7. Wang, Xuexin, 2015. "A Note on Consistent Conditional Moment Tests," MPRA Paper 69005, University Library of Munich, Germany.
    8. Escanciano, Juan Carlos & Jacho-Chávez, David T., 2010. "Approximating the critical values of Cramér-von Mises tests in general parametric conditional specifications," Computational Statistics & Data Analysis, Elsevier, vol. 54(3), pages 625-636, March.
    9. Coolen-Maturi, Tahani & Elkhafifi, Faiza F. & Coolen, Frank P.A., 2014. "Three-group ROC analysis: A nonparametric predictive approach," Computational Statistics & Data Analysis, Elsevier, vol. 78(C), pages 69-81.
    10. Miguel A. Delgado & Juan Carlos Escanciano, 2013. "Conditional Stochastic Dominance Testing," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 31(1), pages 16-28, January.
    11. Juan Carlos Escanciano & Kyungchul Song, 2007. "Asymptotically Optimal Tests for Single-Index Restrictions with a Focus on Average Partial Effects," PIER Working Paper Archive 07-005, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    12. Andrea Vaona, 2008. "The sensitivity of nonparametric misspecification tests to disturbance autocorrelation," Quaderni della facoltà di Scienze economiche dell'Università di Lugano 0803, USI Università della Svizzera italiana.
    13. Sankar, Subhra & Bergsma, Wicher & Dassios, Angelos, 2017. "Testing independence of covariates and errors in nonparametric regression," LSE Research Online Documents on Economics 83780, London School of Economics and Political Science, LSE Library.
    14. Feve, Frederique & Florens, Jean-Pierre & Van Keilegom, Ingrid, 2012. "Estimation of conditional ranks and tests of exogeneity in nonparametric nonseparable models," LIDAM Discussion Papers ISBA 2012036, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    15. Escanciano, Juan Carlos & Song, Kyungchul, 2010. "Testing single-index restrictions with a focus on average derivatives," Journal of Econometrics, Elsevier, vol. 156(2), pages 377-391, June.
    16. Teran Hidalgo, Sebastian J. & Wu, Michael C. & Engel, Stephanie M. & Kosorok, Michael R., 2018. "Goodness-of-fit test for nonparametric regression models: Smoothing spline ANOVA models as example," Computational Statistics & Data Analysis, Elsevier, vol. 122(C), pages 135-155.
    17. Wasel Shadat, 2011. "On the Nonparametric Tests of Univariate GARCH Regression Models," Economics Discussion Paper Series 1115, Economics, The University of Manchester.
    18. Conde-Amboage, Mercedes & Sánchez-Sellero, César & González-Manteiga, Wenceslao, 2015. "A lack-of-fit test for quantile regression models with high-dimensional covariates," Computational Statistics & Data Analysis, Elsevier, vol. 88(C), pages 128-138.
    19. Pascal Lavergne & Valentin Patilea, 2011. "One for All and All for One: Regression Checks With Many Regressors," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(1), pages 41-52, January.
    20. Hongtu Zhu & Joseph G. Ibrahim & Ming-Hui Chen, 2015. "Diagnostic measures for the Cox regression model with missing covariates," Biometrika, Biometrika Trust, vol. 102(4), pages 907-923.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:157:y:2021:i:c:s0167947320302371. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.