Human face structure estimation from multiple images using the 2D affine space

In this paper we present an algorithm to estimate the human face structure. The input to the algorithm is not limited to an image sequence of a human head under rigid motion. It can be snapshots of the human face taken by the same or di erent cameras, over di erent periods of time. Since the depth variation of the human face is not very large, we use the a ne camera projec- tion model. Under this assumption, it can be shown that the set of 2D images produced by a 3D point feature of a rigid object can be optimally represented by two lines in the a ne space. Using this property, we reformulate the (human) face structure reconstruction problem in terms of the much familiar multiple baseline stereo matching problem [8]. Apart from the face modeling aspect, we also show how we use the results for reprojecting hu- man faces in identi cation tasks.