Arama Sonuçları

Listeleniyor 1 - 3 / 3
  • Yayın
    Extraction and selection of muscle based features for facial expression recognition
    (IEEE Computer Soc, 2014-12-04) Benli, Kristin Surpuhi; Eskil, Mustafa Taner
    In this study we propose a new set of muscle activity based features for facial expression recognition. We extract muscular activities by observing the displacements of facial feature points in an expression video. The facial feature points are initialized on muscular regions of influence in the first frame of the video. These points are tracked through optical flow in sequential frames. Displacements of feature points on the image plane are used to estimate the 3D orientation of a head model and relative displacements of its vertices. We model the human skin as a linear system of equations. The estimated deformation of the wireframe model produces an over-determined system of equations that can be solved under the constraint of the facial anatomy to obtain muscle activation levels. We apply sequential forward feature selection to choose the most descriptive set of muscles for recognition of basic facial expressions.
  • Yayın
    Facial expression recognition based on anatomy
    (Academic Press Inc Elsevier Science, 2014-02) Eskil, Mustafa Taner; Benli, Kristin Surpuhi
    In this study, we propose a novel approach to facial expression recognition that capitalizes on the anatomical structure of the human face. We model human face with a high-polygon wireframe model that embeds all major muscles. Influence regions of facial muscles are estimated through a semi-automatic customization process. These regions are projected to the image plane to determine feature points. Relative displacement of each feature point between two image frames is treated as an evidence of muscular activity. Feature point displacements are projected back to the 3D space to estimate the new coordinates of the wireframe vertices. Muscular activities that would produce the estimated deformation are solved through a least squares algorithm. We demonstrate the representative power of muscle force based features on three classifiers; NB, SVM and Adaboost Ability to extract muscle forces that compose a facial expression will enable detection of subtle expressions, replicating an expression on animated characters and exploration of psychologically unknown mechanisms of facial expressions.
  • Yayın
    Semi-automatic adaptation of high-polygon wireframe face models through inverse perspective projection
    (Springer-Verlag, 2012) Benli, Kristin Surpuhi; Ağdoğan, Didem; Özgüz, Mete; Eskil, Mustafa Taner
    Precise registration of a generic 3D face model with a subject's face is a critical stage for model based analysis of facial expressions. In this study we propose a semi-automatic model fitting algorithm to fit a high-polygon wireframe model to a single image of a face. We manually mark important landmark points both on the wireframe model and the face image. We carry out an initial alignment by translating and scaling the wireframe model. We then translate the landmark vertices in the 3D wireframe model so that they coincide with inverse perspective projections of image landmark points. The vertices that are not manually labeled as landmark are translated with a weighted sum of vectorial displacement of k neighboring landmark vertices, inversely weighted by their 3D distances to the vertex under consideration. Our experiments indicate that we can fit a high-polygon model to the subject's face with modest computational complexity.