Lips and Face Real Time Tracking and Facial Expression Recognition

Nuria Oliver, and Alex Pentland
Vision and Modeling Group, MIT Media Lab
Cambridge, MA 02139-1130


This paper describes a real-time system for finding and tracking a human face and mouth, and recognizing mouth shapes that correlate with internal states such as happiness or sadness. It has been tested on hundreds of users and demonstrated extremely reliable and accurate performance.

Main Related Publication

LAFTER: A Real-time Face and Lips Tracker with Facial Expression Recognition

Nuria Oliver, Francois Berard and Alex Pentland. Pattern Recognition Journal, 33:1369-1382, 2000. Winner of the Special Mention Award from the Pattern Recognition Society as an outstanding publication. Nov. 2000.

Last revised 27nov96

Nuria Oliver / MIT Media Lab