IDEAS home Printed from https://ideas.repec.org/a/spr/annopr/v174y2010i1p147-16810.1007-s10479-008-0424-0.html
   My bibliography  Save this article

Analysis of the consistency of a mixed integer programming-based multi-category constrained discriminant model

Author

Listed:
  • J. Brooks
  • Eva Lee

Abstract

Classification is concerned with the development of rules for the allocation of observations to groups, and is a fundamental problem in machine learning. Much of previous work on classification models investigates two-group discrimination. Multi-category classification is less-often considered due to the tendency of generalizations of two-group models to produce misclassification rates that are higher than desirable. Indeed, producing “good” two-group classification rules is a challenging task for some applications, and producing good multi-category rules is generally more difficult. Additionally, even when the “optimal” classification rule is known, inter-group misclassification rates may be higher than tolerable for a given classification model. We investigate properties of a mixed-integer programming based multi-category classification model that allows for the pre-specification of limits on inter-group misclassification rates. The mechanism by which the limits are satisfied is the use of a reserved judgment region, an artificial category into which observations are placed whose attributes do not sufficiently indicate membership to any particular group. The method is shown to be a consistent estimator of a classification rule with misclassification limits, and performance on simulated and real-world data is demonstrated. Copyright Springer Science+Business Media, LLC 2010

Suggested Citation

  • J. Brooks & Eva Lee, 2010. "Analysis of the consistency of a mixed integer programming-based multi-category constrained discriminant model," Annals of Operations Research, Springer, vol. 174(1), pages 147-168, February.
  • Handle: RePEc:spr:annopr:v:174:y:2010:i:1:p:147-168:10.1007/s10479-008-0424-0
    DOI: 10.1007/s10479-008-0424-0
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s10479-008-0424-0
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1007/s10479-008-0424-0?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Richard Gallagher & Eva Lee & David Patterson, 1997. "Constrained discriminant analysis via 0/1 mixed integer programming," Annals of Operations Research, Springer, vol. 74(0), pages 65-88, November.
    2. Eva K. Lee & Richard J. Gallagher & David A. Patterson, 2003. "A Linear Programming Approach to Discriminant Analysis with a Reserved-Judgment Region," INFORMS Journal on Computing, INFORMS, vol. 15(1), pages 23-41, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. J. Paul Brooks, 2011. "Support Vector Machines with the Ramp Loss and the Hard Margin Loss," Operations Research, INFORMS, vol. 59(2), pages 467-479, April.
    2. S. Basso & A. Ceselli & A. Tettamanzi, 2020. "Random sampling and machine learning to understand good decompositions," Annals of Operations Research, Springer, vol. 284(2), pages 501-526, January.
    3. Eva K. Lee & Ferdinand Pietz & Bernard Benecke & Jacquelyn Mason & Greg Burel, 2013. "Advancing Public Health and Medical Preparedness with Operations Research," Interfaces, INFORMS, vol. 43(1), pages 79-98, February.
    4. J. Paul Brooks & Eva K. Lee, 2014. "Solving a Multigroup Mixed-Integer Programming-Based Constrained Discrimination Model," INFORMS Journal on Computing, INFORMS, vol. 26(3), pages 567-585, August.
    5. Eva K. Lee & Hany Y. Atallah & Michael D. Wright & Eleanor T. Post & Calvin Thomas & Daniel T. Wu & Leon L. Haley, 2015. "Transforming Hospital Emergency Department Workflow and Patient Care," Interfaces, INFORMS, vol. 45(1), pages 58-82, February.
    6. Eva K. Lee & Helder I. Nakaya & Fan Yuan & Troy D. Querec & Greg Burel & Ferdinand H. Pietz & Bernard A. Benecke & Bali Pulendran, 2016. "Machine Learning for Predicting Vaccine Immunogenicity," Interfaces, INFORMS, vol. 46(5), pages 368-390, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. J. Paul Brooks & Eva K. Lee, 2014. "Solving a Multigroup Mixed-Integer Programming-Based Constrained Discrimination Model," INFORMS Journal on Computing, INFORMS, vol. 26(3), pages 567-585, August.
    2. Eva K. Lee & Helder I. Nakaya & Fan Yuan & Troy D. Querec & Greg Burel & Ferdinand H. Pietz & Bernard A. Benecke & Bali Pulendran, 2016. "Machine Learning for Predicting Vaccine Immunogenicity," Interfaces, INFORMS, vol. 46(5), pages 368-390, October.
    3. Fabio Vitor & Todd Easton, 2018. "The double pivot simplex method," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 87(1), pages 109-137, February.
    4. Eva K. Lee & Richard J. Gallagher & David A. Patterson, 2003. "A Linear Programming Approach to Discriminant Analysis with a Reserved-Judgment Region," INFORMS Journal on Computing, INFORMS, vol. 15(1), pages 23-41, February.
    5. Parag Pendharkar & Marvin Troutt, 2014. "Interactive classification using data envelopment analysis," Annals of Operations Research, Springer, vol. 214(1), pages 125-141, March.
    6. J. Paul Brooks, 2011. "Support Vector Machines with the Ramp Loss and the Hard Margin Loss," Operations Research, INFORMS, vol. 59(2), pages 467-479, April.
    7. Eva K. Lee & Hany Y. Atallah & Michael D. Wright & Eleanor T. Post & Calvin Thomas & Daniel T. Wu & Leon L. Haley, 2015. "Transforming Hospital Emergency Department Workflow and Patient Care," Interfaces, INFORMS, vol. 45(1), pages 58-82, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:annopr:v:174:y:2010:i:1:p:147-168:10.1007/s10479-008-0424-0. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.