IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v42y2017i3p264-281.html
   My bibliography  Save this article

A Guide for Setting the Cut-Scores to Minimize Weighted Classification Errors in Test Batteries

Author

Listed:
  • Irina Grabovsky
  • Howard Wainer

    (National Board of Medical Examiners)

Abstract

In this article, we extend the methodology of the Cut-Score Operating Function that we introduced previously and apply it to a testing scenario with multiple independent components and different testing policies. We derive analytically the overall classification error rate for a test battery under the policy when several retakes are allowed for individual components and also for when one is required to retake the whole battery. We derive the overall classification error rate using a flexible cost function defined by weights assigned to false negative and false positive errors. The result, shown graphically, is that competing demands of minimizing both false positive and false negative errors yield a unique optimal value for the cut-score. This cut-score can be estimated numerically for any number of components and any number of retakes. Among the results we obtain is that the more lenient the retake policy the higher one must set the cut-score to minimize the error rate.

Suggested Citation

  • Irina Grabovsky & Howard Wainer, 2017. "A Guide for Setting the Cut-Scores to Minimize Weighted Classification Errors in Test Batteries," Journal of Educational and Behavioral Statistics, , vol. 42(3), pages 264-281, June.
    • Handle: RePEc:sae:jedbes:v:42:y:2017:i:3:p:264-281
    DOI: 10.3102/1076998617701134
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/1076998617701134
    Download Restriction: no
    File URL: https://libkey.io/10.3102/1076998617701134?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Frederic Lord, 1962. "Cutting scores and errors of measurement," Psychometrika, Springer;The Psychometric Society, vol. 27(1), pages 19-30, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Huynh Huynh, 1982. "A bayesian procedure for mastery decisions based on multivariate normal test data," Psychometrika, Springer;The Psychometric Society, vol. 47(3), pages 309-319, September.
    2. Forbes, William & Hudson, Robert & Skerratt, Len & Soufian, Mona, 2015. "Which heuristics can aid financial-decision-making?," International Review of Financial Analysis, Elsevier, vol. 42(C), pages 199-210.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:42:y:2017:i:3:p:264-281. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.