Model-based face tracking for view-independent facial expression recognition


Journal Article

Facial expression recognition is necessary for designing any realistic human-machine interfaces. Previous published facial expression recognition systems achieve good recognition rates, but most of them perform well only when the user faces the camera and does not change his 3D head pose. We propose a new method for robust, view-independent recognition of facial expressions that does not make this assumption. The system uses a novel 3D model-based tracker to extract simultaneously and robustly the pose and shape of the face at every frame of a monocular video sequence. There are two main contributions. First, we demonstrate that the 3D information extracted through 3D tracking enables robust facial expression recognition in spite of large rotational and translational head movements (up to 90 degrees in head rotation). Second, we show that the Support Vector Machine is a suitable engine for robust classification. Recognition rates as high as 91 percent are achieved at classifying 5 distinct dynamic facial motions (neutral, opening/closing mouth, smile, raising eyebrow). © 2002 IEEE.

Full Text

Duke Authors

Cited Authors

  • Gokturk, SB; Bouguet, JY; Tomasi, C; Girod, B

Published Date

  • January 1, 2002

Published In

  • Proceedings 5th Ieee International Conference on Automatic Face Gesture Recognition, Fgr 2002

Start / End Page

  • 287 - 293

Digital Object Identifier (DOI)

  • 10.1109/AFGR.2002.1004168

Citation Source

  • Scopus