Expression-robust 3D face recognition via weighted sparse representation of multi-scale and multi-component local normal patterns

Handle URI:
http://hdl.handle.net/10754/563560
Title:
Expression-robust 3D face recognition via weighted sparse representation of multi-scale and multi-component local normal patterns
Authors:
Li, Huibin; Huang, Di; Morvan, Jean-Marie; Chen, Liming; Wang, Yunhong
Abstract:
In the theory of differential geometry, surface normal, as a first order surface differential quantity, determines the orientation of a surface at each point and contains informative local surface shape information. To fully exploit this kind of information for 3D face recognition (FR), this paper proposes a novel highly discriminative facial shape descriptor, namely multi-scale and multi-component local normal patterns (MSMC-LNP). Given a normalized facial range image, three components of normal vectors are first estimated, leading to three normal component images. Then, each normal component image is encoded locally to local normal patterns (LNP) on different scales. To utilize spatial information of facial shape, each normal component image is divided into several patches, and their LNP histograms are computed and concatenated according to the facial configuration. Finally, each original facial surface is represented by a set of LNP histograms including both global and local cues. Moreover, to make the proposed solution robust to the variations of facial expressions, we propose to learn the weight of each local patch on a given encoding scale and normal component image. Based on the learned weights and the weighted LNP histograms, we formulate a weighted sparse representation-based classifier (W-SRC). In contrast to the overwhelming majority of 3D FR approaches which were only benchmarked on the FRGC v2.0 database, we carried out extensive experiments on the FRGC v2.0, Bosphorus, BU-3DFE and 3D-TEC databases, thus including 3D face data captured in different scenarios through various sensors and depicting in particular different challenges with respect to facial expressions. The experimental results show that the proposed approach consistently achieves competitive rank-one recognition rates on these databases despite their heterogeneous nature, and thereby demonstrates its effectiveness and its generalizability. © 2014 Elsevier B.V.
KAUST Department:
Visual Computing Center (VCC); Computer, Electrical and Mathematical Sciences and Engineering (CEMSE) Division
Publisher:
Elsevier BV
Journal:
Neurocomputing
Issue Date:
Jun-2014
DOI:
10.1016/j.neucom.2013.11.018
Type:
Article
ISSN:
09252312
Sponsors:
This work was supported in part by the French research agency, Agence Nationale de Recherche (ANR), under Grant ANR 2010 INTB 0301 01; the National Natural Science Foundation of China (NSFC) under Grant 61061130560 and Grant 61202237; the Specialized Research Fund for the Doctoral Program of Higher Education (No. 20121102120016); the research program of State Key Laboratory of Software Development Environment (SKLSDE-2013ZX-31); the joint project by the LIA 2MCSI lab between the group of Ecoles Centrales and Beihang University; and the Fundamental Research Funds for the Central Universities.
Appears in Collections:
Articles; Visual Computing Center (VCC); Computer, Electrical and Mathematical Sciences and Engineering (CEMSE) Division

Full metadata record

DC FieldValue Language
dc.contributor.authorLi, Huibinen
dc.contributor.authorHuang, Dien
dc.contributor.authorMorvan, Jean-Marieen
dc.contributor.authorChen, Limingen
dc.contributor.authorWang, Yunhongen
dc.date.accessioned2015-08-03T11:54:30Zen
dc.date.available2015-08-03T11:54:30Zen
dc.date.issued2014-06en
dc.identifier.issn09252312en
dc.identifier.doi10.1016/j.neucom.2013.11.018en
dc.identifier.urihttp://hdl.handle.net/10754/563560en
dc.description.abstractIn the theory of differential geometry, surface normal, as a first order surface differential quantity, determines the orientation of a surface at each point and contains informative local surface shape information. To fully exploit this kind of information for 3D face recognition (FR), this paper proposes a novel highly discriminative facial shape descriptor, namely multi-scale and multi-component local normal patterns (MSMC-LNP). Given a normalized facial range image, three components of normal vectors are first estimated, leading to three normal component images. Then, each normal component image is encoded locally to local normal patterns (LNP) on different scales. To utilize spatial information of facial shape, each normal component image is divided into several patches, and their LNP histograms are computed and concatenated according to the facial configuration. Finally, each original facial surface is represented by a set of LNP histograms including both global and local cues. Moreover, to make the proposed solution robust to the variations of facial expressions, we propose to learn the weight of each local patch on a given encoding scale and normal component image. Based on the learned weights and the weighted LNP histograms, we formulate a weighted sparse representation-based classifier (W-SRC). In contrast to the overwhelming majority of 3D FR approaches which were only benchmarked on the FRGC v2.0 database, we carried out extensive experiments on the FRGC v2.0, Bosphorus, BU-3DFE and 3D-TEC databases, thus including 3D face data captured in different scenarios through various sensors and depicting in particular different challenges with respect to facial expressions. The experimental results show that the proposed approach consistently achieves competitive rank-one recognition rates on these databases despite their heterogeneous nature, and thereby demonstrates its effectiveness and its generalizability. © 2014 Elsevier B.V.en
dc.description.sponsorshipThis work was supported in part by the French research agency, Agence Nationale de Recherche (ANR), under Grant ANR 2010 INTB 0301 01; the National Natural Science Foundation of China (NSFC) under Grant 61061130560 and Grant 61202237; the Specialized Research Fund for the Doctoral Program of Higher Education (No. 20121102120016); the research program of State Key Laboratory of Software Development Environment (SKLSDE-2013ZX-31); the joint project by the LIA 2MCSI lab between the group of Ecoles Centrales and Beihang University; and the Fundamental Research Funds for the Central Universities.en
dc.publisherElsevier BVen
dc.subject3D face recognitionen
dc.subjectFacial surface normalen
dc.subjectIdentical twinsen
dc.subjectLocal normal patternsen
dc.subjectWeighted sparse representationen
dc.titleExpression-robust 3D face recognition via weighted sparse representation of multi-scale and multi-component local normal patternsen
dc.typeArticleen
dc.contributor.departmentVisual Computing Center (VCC)en
dc.contributor.departmentComputer, Electrical and Mathematical Sciences and Engineering (CEMSE) Divisionen
dc.identifier.journalNeurocomputingen
dc.contributor.institutionUniversité de Lyon, CNRS, Franceen
dc.contributor.institutionEcole Centrale Lyon, LIRIS UMR5205, F-69134 Lyon, Franceen
dc.contributor.institutionState Key Laboratory of Software Development Environment, School of Computer Science and Engineering, Beihang University, Beijing 100191, Chinaen
dc.contributor.institutionUniversité Lyon 1, Institut Camille Jordan, 43 blvd du 11 Novembre 1918, F-69622 Villeurbanne-Cedex, Franceen
kaust.authorMorvan, Jean-Marieen
All Items in KAUST are protected by copyright, with all rights reserved, unless otherwise indicated.