Modeling of facial expression and emotion for human communication system

The goal of this research is to realize a face-to-face communication environment with machine by giving a facial expression to computer system. In this paper, modeling methods of facial expression including 3D face model, expression model and emotion model are presented. Facial expression is parameterized with Facial Action Coding System (FACS) which is translated to the grid's motion of face model which is constructed from the 3D range sensor data. An emotion condition is described compactly by the point in a 3D space generated by a 5-layered neural network and its evaluation result shows the high performance of this model.