Kernel estimators of the ROC curve are better than empirical
AbstractThe receiver operating characteristic (ROC) is a curve used to summarise the performance of a binary decision rule. It can be expressed in terms of the underlying distributions functions of the diagnostic measurement that underlies the rule. Lloyd (1998) has proposed estimating the ROC curve from kernel smoothing of these distribution functions and has presented asymptotic formulas for the bias and standard deviation of the resulting curve estimator. This paper compares the asymptotic accuracy of the kernel-based estimator with the fully empirical estimator. It is shown that the empirical estimator is deficient compared to the kernel estimator and that this deficiency is unbounded as sample size increases. A simulation study using both unimodal and bimodal distributions indicates that the gains in accuracy are significant for realistic sample sizes. Kernel-based ROC estimators can now be recommended.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.
Bibliographic InfoArticle provided by Elsevier in its journal Statistics & Probability Letters.
Volume (Year): 44 (1999)
Issue (Month): 3 (September)
Contact details of provider:
Web page: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Donald Dorfman & Edward Alf, 1968. "Maximum likelihood estimation of parameters of signal detection theory—A direct solution," Psychometrika, Springer, vol. 33(1), pages 117-124, March.
- Gong, Yun & Peng, Liang & Qi, Yongcheng, 2010. "Smoothed jackknife empirical likelihood method for ROC curve," Journal of Multivariate Analysis, Elsevier, vol. 101(6), pages 1520-1531, July.
- Hall, Peter G. & Hyndman, Rob J., 2003. "Improved methods for bandwidth selection when estimating ROC curves," Statistics & Probability Letters, Elsevier, vol. 64(2), pages 181-189, August.
- Lloyd, Chris J., 2002. "Estimation of a convex ROC curve," Statistics & Probability Letters, Elsevier, vol. 59(1), pages 99-111, August.
- Yousef, Waleed A. & Kundu, Subrata & Wagner, Robert F., 2009. "Nonparametric estimation of the threshold at an operating point on the ROC curve," Computational Statistics & Data Analysis, Elsevier, vol. 53(12), pages 4370-4383, October.
- Peter Hall & Rob J. Hyndman, 2002. "An Improved Method for Bandwidth Selection when Estimating ROC Curves," Monash Econometrics and Business Statistics Working Papers 11/02, Monash University, Department of Econometrics and Business Statistics.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Wendy Shamier).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.