2D
image-based face recognition
techniques are sensitive to changes in illumination, pose, facial
expressions and make up. We present multi-modal hybrid face
recognition which exploits the texture and 3D shape of the face for
accurate person identification. The pose of a textured 3D face is
automatically corrected using an iterative algorithm based on
a
single automatically detected point and the Hotelling transform. Face
recognition is performed in three stages. In the first two
stages,
unlikely candidates are rejected leaving fewer for the next stage.
The Spherical Face Representation (SFR) is used in conjunction with the
SIFT to form the first rejection classifier. The second
classifier
detects keypoints on the 3D face and extracts invariant local features
at the keypoints. The local features are projected to the PCA
subspace and matched to find similarity between two faces using a
graph-based approach. Similar faces have more matches and result in a
similar graph (see figure below). Most of the time, faces are
recognized in the firs two stages
and only challenging ones need to be verified by the third
stage. The third stage makes the final decision
using region-based
matching of the expression insensitive regions of the face.
 |
|
I call
it "Laxodonta Face
Recognition" because an elephant never forgets, including
a human face. The strengths of Laxodonta
Face Recognition are :
1. Automatic pose correction.
2. Robustness to facial expressions
3. Works with sunglasses on and off
4. Fast recognition
5. High accuracy
6. Can also recognize partly visible faces |
Related
Publications
Ajmal S. Mian, M. Bennamoun
and R. Owens, "Keypoint Detection and Local Feature Matching for
Textured 3D Face Recognition", International Journal of
Computer Vision (IJCV),
2008. [pdf]
Copyright ©
Springer
Verlag.
Ajmal
S. Mian, M. Bennamoun
and R. Owens, "An Efficient Multimodal 2D-3D Hybrid Approach to
Automatic Face Recognition", IEEE
Transactions in Pattern Analysis and Machine Intelligence (IEEE TPAMI),
vol. 29(11), pp. 1927--1943, 2007. [pdf]
Copyright ©
IEEE.
Ajmal S. Mian, M. Bennamoun and R. Owens, "Automatic 3D
Face Detection, Normalization and Recognition", Third International
Symposium on 3D Data Processing, Visualization and Transmission
(3DPVT), 2006. [
pdf]
Copyright ©
IEEE.
Ajmal S. Mian, M. Bennamoun and R. Owens,
"Keypoint Identification and Feature-based 3D Face
Recognition", International Conference on Biometrics (
ICB),
Lecture Notes on Computer Science, vol. 4642, pp. 163--171, 2007. [
pdf]
Copyright ©
Springer Verlag.
Ajmal
S. Mian, M. Bennamoun and R. Owens,
"Face
Recognition using 2D and 3D Multimodal Local
Features", International Symposium on Visual Computing (ISVC),
2006. [
pdf]
Copyright ©
Springer Verlag.
Ajmal
S. Mian, M. Bennamoun and R. Owens, "2D and 3D Multimodal Hybrid
Face Recognition", European Conference on Computer Vision (ECCV), part
3, pp. 344--355, 2006. [
pdf]
Copyright ©
Springer Verlag.
.