HOME PUBLICATIONS SMART SURVEILLANCE 3D FACE RECOTNIGION 3D OBJECT RECOGNITION 3D MODELING INTERNET KEY EXCHANGE PICTURES

3D Multi-modal Hybrid Face Recognition
(US and Australian Patent Pending)



Abstract
2D image-based face recognition techniques are sensitive to changes in illumination, pose, facial expressions and make up. We present multi-modal hybrid face recognition which exploits the texture and 3D shape of the face for accurate person identification. The pose of a textured 3D face is automatically corrected using an iterative algorithm based on a single automatically detected point and the Hotelling transform. Face recognition is performed in three stages. In the first two stages, unlikely candidates are rejected leaving fewer for the next stage. The Spherical Face Representation (SFR) is used in conjunction with the SIFT to form the first rejection classifier. The second classifier detects keypoints on the 3D face and extracts invariant local features at the keypoints. The local features are projected to the PCA subspace and matched to find similarity between two faces using a graph-based approach. Similar faces have more matches and result in a similar graph (see figure below). Most of the time, faces are recognized in the firs two stages and only challenging ones need to be verified by the third stage. The third stage makes the final decision using region-based matching of the expression insensitive regions of the face.
    
I call it "Laxodonta Face Recognition" because an elephant never forgets, including a human face. The strengths of Laxodonta Face Recognition are :

1. Automatic pose correction.
2. Robustness to facial expressions
3. Works with sunglasses on and off
4. Fast recognition
5. High accuracy
6. Can also recognize partly visible faces
Related Publications

Ajmal S. Mian, M. Bennamoun and R. Owens, "Keypoint Detection and Local Feature Matching for Textured 3D Face Recognition", International Journal of Computer Vision (IJCV), 2008.
[pdf] Copyright © Springer Verlag.

Ajmal S. Mian, M. Bennamoun and R. Owens, "An Efficient Multimodal 2D-3D Hybrid Approach to Automatic Face Recognition", IEEE Transactions in Pattern Analysis and Machine Intelligence (IEEE TPAMI), vol. 29(11), pp. 1927--1943, 2007. [pdfCopyright © IEEE.

Ajmal S. Mian, M. Bennamoun and R. Owens, "Automatic 3D Face Detection, Normalization and Recognition", Third International Symposium on 3D Data Processing, Visualization and Transmission (3DPVT), 2006. [pdf] Copyright © IEEE.

Ajmal S. Mian, M. Bennamoun and R. Owens, "Keypoint Identification and Feature-based 3D Face Recognition", International Conference on Biometrics (ICB), Lecture Notes on Computer Science, vol. 4642, pp. 163--171, 2007. [pdf] Copyright © Springer Verlag.

Ajmal S. Mian, M. Bennamoun and R. Owens, "Face Recognition using 2D and 3D Multimodal Local Features", International Symposium on Visual Computing (ISVC), 2006. [pdf] Copyright © Springer Verlag.

Ajmal S. Mian, M. Bennamoun and R. Owens, "2D and 3D Multimodal Hybrid Face Recognition", European Conference on Computer Vision (ECCV), part 3, pp. 344--355, 2006. [pdf] Copyright © Springer Verlag.

.