IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0326706.html
   My bibliography  Save this article

Masked face matching benefits from isolated facial features

Author

Listed:
  • Mengying Zhang
  • Melanie Sauerland
  • Anna Sagana

Abstract

Verifying the identity of an unfamiliar person is a difficult task, especially when targets wear masks that cover most of their faces. This presents a major challenge for law enforcement in border control, security, and criminal investigations. Therefore, we aim to explore ways to improve face-matching performance when a face is heavily masked. In two experiments, we investigated whether face-matching performance can benefit from the presentation of isolated facial features, namely the eyes (Experiment 1) and the mouth (Experiment 2), when a target face is masked. Participants viewed pairs of faces and determined whether they belonged to the same person or different people. In congruent pairs, participants matched a full-face image to another full-face image or a masked image to an isolated facial feature. In incongruent pairs, participants matched a full-face image to an image of the eyes or the mouth only or to a masked image. Matching accuracy was significantly better in congruent than incongruent pairs. Interestingly, the benefit of showing an isolated facial feature was even present when that single feature was the mouth. Overall, the findings showed that focusing on isolated facial features, such as the eyes or mouth, can be a valuable strategy for enhancing identity matching with masked perpetrators.

Suggested Citation

  • Mengying Zhang & Melanie Sauerland & Anna Sagana, 2025. "Masked face matching benefits from isolated facial features," PLOS ONE, Public Library of Science, vol. 20(7), pages 1-19, July.
  • Handle: RePEc:plo:pone00:0326706
    DOI: 10.1371/journal.pone.0326706
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0326706
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0326706&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0326706?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. David White & Richard I Kemp & Rob Jenkins & Michael Matheson & A Mike Burton, 2014. "Passport Officers’ Errors in Face Matching," PLOS ONE, Public Library of Science, vol. 9(8), pages 1-6, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marlena L Itz & Stefan R Schweinberger & Jürgen M Kaufmann, 2016. "Effects of Caricaturing in Shape or Color on Familiarity Decisions for Familiar and Unfamiliar Faces," PLOS ONE, Public Library of Science, vol. 11(2), pages 1-19, February.
    2. Alice Towler & Richard I Kemp & A Mike Burton & James D Dunn & Tanya Wayne & Reuben Moreton & David White, 2019. "Do professional facial image comparison training courses work?," PLOS ONE, Public Library of Science, vol. 14(2), pages 1-17, February.
    3. Daniela Barragan & John J Howard & Laura R Rabbitt & Yevgeniy B Sirotin, 2022. "COVID-19 masks increase the influence of face recognition algorithm decisions on human decisions in unfamiliar face matching," PLOS ONE, Public Library of Science, vol. 17(11), pages 1-17, November.
    4. Dana Michalski & Rebecca Heyer & Carolyn Semmler, 2019. "The performance of practitioners conducting facial comparisons on images of children across age," PLOS ONE, Public Library of Science, vol. 14(11), pages 1-17, November.
    5. Gariup, Monica & Piskorski, Jakub, 2019. "The challenge of detecting false documents at the border: Exploring the performance of humans, machines and their interaction," International Journal of Critical Infrastructure Protection, Elsevier, vol. 24(C), pages 100-110.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0326706. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.