IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0277625.html
   My bibliography  Save this article

COVID-19 masks increase the influence of face recognition algorithm decisions on human decisions in unfamiliar face matching

Author

Listed:
  • Daniela Barragan
  • John J Howard
  • Laura R Rabbitt
  • Yevgeniy B Sirotin

Abstract

Face masks, recently adopted to reduce the spread of COVID-19, have had the unintended consequence of increasing the difficulty of face recognition. In security applications, face recognition algorithms are used to identify individuals and present results for human review. This combination of human and algorithm capabilities, known as human-algorithm teaming, is intended to improve total system performance. However, prior work has shown that human judgments of face pair similarity-confidence can be biased by an algorithm’s decision even in the case of an error by that algorithm. This can reduce team effectiveness, particularly for difficult face pairs. We conducted two studies to examine whether face masks, now routinely present in security applications, impact the degree to which this cognitive bias is experienced by humans. We first compared the influence of algorithm’s decisions on human similarity-confidence ratings in the presence and absence of face masks and found that face masks more than doubled the influence of algorithm decisions on human similarity-confidence ratings. We then investigated if this increase in cognitive bias was dependent on perceived algorithm accuracy by also presenting algorithm accuracy rates in the presence of face masks. We found that making humans aware of the potential for algorithm errors mitigated the increase in cognitive bias due to face masks. Our findings suggest that humans reviewing face recognition algorithm decisions should be made aware of the potential for algorithm errors to improve human-algorithm team performance.

Suggested Citation

  • Daniela Barragan & John J Howard & Laura R Rabbitt & Yevgeniy B Sirotin, 2022. "COVID-19 masks increase the influence of face recognition algorithm decisions on human decisions in unfamiliar face matching," PLOS ONE, Public Library of Science, vol. 17(11), pages 1-17, November.
  • Handle: RePEc:plo:pone00:0277625
    DOI: 10.1371/journal.pone.0277625
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0277625
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0277625&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0277625?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. David White & Richard I Kemp & Rob Jenkins & Michael Matheson & A Mike Burton, 2014. "Passport Officers’ Errors in Face Matching," PLOS ONE, Public Library of Science, vol. 9(8), pages 1-6, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marlena L Itz & Stefan R Schweinberger & Jürgen M Kaufmann, 2016. "Effects of Caricaturing in Shape or Color on Familiarity Decisions for Familiar and Unfamiliar Faces," PLOS ONE, Public Library of Science, vol. 11(2), pages 1-19, February.
    2. Alice Towler & Richard I Kemp & A Mike Burton & James D Dunn & Tanya Wayne & Reuben Moreton & David White, 2019. "Do professional facial image comparison training courses work?," PLOS ONE, Public Library of Science, vol. 14(2), pages 1-17, February.
    3. Dana Michalski & Rebecca Heyer & Carolyn Semmler, 2019. "The performance of practitioners conducting facial comparisons on images of children across age," PLOS ONE, Public Library of Science, vol. 14(11), pages 1-17, November.
    4. Gariup, Monica & Piskorski, Jakub, 2019. "The challenge of detecting false documents at the border: Exploring the performance of humans, machines and their interaction," International Journal of Critical Infrastructure Protection, Elsevier, vol. 24(C), pages 100-110.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0277625. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.