Volume 6, Number 6, Abstract 11, Page 11a doi:10.1167/6.6.11 http://journalofvision.org/6/6/11/ ISSN 1534-7362
Face recognition algorithms surpass humans matching faces in images that vary in illumination
Alice J. O'Toole
The University of Texas at Dallas
[e-mail]
P. Jonathon Phillips
National Institue of Standards and Technology
Fang Jiang
The University of Texas at Dallas
Janet Ayyad
The University of Texas at Dallas
Nils Pénard
The University of Texas at Dallas
Hervé Abdi
The University of Texas at Dallas
Abstract

We compared the accuracy of seven state-of-the-art face recognition algorithms with human performance on the same task. Humans and algorithms determined whether two face images, taken under different illumination conditions, were pictures of the same person or of different people. The algorithms tested were participants in the Face Recognition Grand Challenge (FRGC) test organized by the National Institutes of Standards and Technology. In that competition, algorithms matched identities in 128 million pairs of face images. For the human experiments, we sampled 120 "easy" and 120 "difficult" face pairs from the FRGC dataset, using similarity scores derived from a control algorithm based on a principal components analysis of the aligned and scaled face images. In three experiments, which varied only in exposure time (Exp. 1 – unlimited; Exp2. - 2s, Exp. 3 – 500ms), humans rated face pairs according to the likelihood that the two people were the same. ROC curves from the humans and the algorithms were compared. Three algorithms outperformed humans at matching face pairs prescreened to be "difficult" (cf., Liu, in press; Xie et al., 2005) and all but one algorithm surpassed humans on the "easy" face pairs. Although illumination variation continues to challenge face recognition algorithms, several current algorithms compete favorably with humans— even if they appear to perform poorly in absolute terms.
Work supported by TSWG funding.

History
Received March 23, 2006; published June 1, 2006
Citation
O'Toole, A. J., Phillips, P. J., Jiang, F., Ayyad, J., Pénard, N., & Abdi, H. (2006). Face recognition algorithms surpass humans matching faces in images that vary in illumination [Abstract]. Journal of Vision, 6(6):11, 11a, http://journalofvision.org/6/6/11/, doi:10.1167/6.6.11.
Keywords
None
On-Line Presentation
None
for related articles by these authors

for papers that cite this paper
Get citation
Get help with this






jov