Performance of classification models from a user perspective
AbstractThis paper proposes a complete framework to assess the overall performance of classification models from a user perspective in terms of accuracy, comprehensibility, and justifiability. A review is provided of accuracy and comprehensibility measures, and a novel metric is introduced that allows one to measure the justifiability of classification models. Furthermore, taxonomy of domain constraints is introduced, and an overview of the existing approaches to impose constraints and include domain knowledge in data mining techniques is presented. Finally, justifiability metric is applied to a credit scoring and customer churn prediction case.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by Katholieke Universiteit Leuven in its series Open Access publications from Katholieke Universiteit Leuven with number urn:hdl:123456789/274791.
Date of creation: Nov 2011
Date of revision:
Publication status: Published in Decision Support Systems (2011-11) v.51, p.782-793
Contact details of provider:
Web page: http://www.kuleuven.be
You can help add them by filling out this form.
CitEc Project, subscribe to its RSS feed for this item.
- Verbeke, Wouter & Dejaeger, Karel & Martens, David & Hur, Joon & Baesens, Bart, 2012. "New insights into churn prediction in the telecommunication sector: A profit driven data mining approach," European Journal of Operational Research, Elsevier, vol. 218(1), pages 211-229.
- Carlos Serrano-Cinca & Begoña Gutiérrez-Nieto, 2011. "Partial Least Square Discriminant Analysis (PLS-DA) for bankruptcy prediction," Working Papers CEB 11-024, ULB -- Universite Libre de Bruxelles.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Carl Demeyere).
If references are entirely missing, you can add them using this form.