Arama Sonuçları

Listeleniyor 1 - 5 / 5
  • Yayın
    Extraction and selection of muscle based features for facial expression recognition
    (IEEE Computer Soc, 2014-12-04) Benli, Kristin Surpuhi; Eskil, Mustafa Taner
    In this study we propose a new set of muscle activity based features for facial expression recognition. We extract muscular activities by observing the displacements of facial feature points in an expression video. The facial feature points are initialized on muscular regions of influence in the first frame of the video. These points are tracked through optical flow in sequential frames. Displacements of feature points on the image plane are used to estimate the 3D orientation of a head model and relative displacements of its vertices. We model the human skin as a linear system of equations. The estimated deformation of the wireframe model produces an over-determined system of equations that can be solved under the constraint of the facial anatomy to obtain muscle activation levels. We apply sequential forward feature selection to choose the most descriptive set of muscles for recognition of basic facial expressions.
  • Yayın
    Facial expression recognition based on anatomy
    (Academic Press Inc Elsevier Science, 2014-02) Eskil, Mustafa Taner; Benli, Kristin Surpuhi
    In this study, we propose a novel approach to facial expression recognition that capitalizes on the anatomical structure of the human face. We model human face with a high-polygon wireframe model that embeds all major muscles. Influence regions of facial muscles are estimated through a semi-automatic customization process. These regions are projected to the image plane to determine feature points. Relative displacement of each feature point between two image frames is treated as an evidence of muscular activity. Feature point displacements are projected back to the 3D space to estimate the new coordinates of the wireframe vertices. Muscular activities that would produce the estimated deformation are solved through a least squares algorithm. We demonstrate the representative power of muscle force based features on three classifiers; NB, SVM and Adaboost Ability to extract muscle forces that compose a facial expression will enable detection of subtle expressions, replicating an expression on animated characters and exploration of psychologically unknown mechanisms of facial expressions.
  • Yayın
    Convolutional neural network (CNN) algorithm based facial emotion recognition (FER) system for FER-2013 dataset
    (IEEE, 2022-11-18) Ezerceli, Özay; Eskil, Mustafa Taner
    Facial expression recognition (FER) is the key to understanding human emotions and feelings. It is an active area of research since human thoughts can be collected, processed, and used in customer satisfaction, politics, and medical domains. Automated FER systems had been developed and have been used to recognize humans’ emotions but it has been a quite challenging problem in machine learning due to the high intra-class variation. The first models were using known methods such as Support Vector Machines (SVM), Bayes classifier, Fuzzy Techniques, Feature Selection, Artificial Neural Networks (ANN) in their models but still, some limitations affect the accuracy critically such as subjectivity, occlusion, pose, low resolution, scale, illumination variation, etc. The ability of CNN boosts FER accuracy. Deep learning algorithms have emerged as the greatest way to produce the best results in FER in recent years. Various datasets were used to train, test, and validate the models. FER2013, CK+, JAFFE and FERG are some of the most popular datasets. To improve the accuracy of FER models, one dataset or a mix of datasets has been employed. Every dataset includes limitations and issues that have an impact on the model that is trained for it. As a solution to this problem, our state-of-the-art model based on deep learning architectures, particularly convolutional neural network architectures (CNN) with supportive techniques has been implemented. The proposed model achieved 93.7% accuracy with the combination of FER2013 and CK+ datasets for FER2013.
  • Yayın
    Semi-automatic adaptation of high-polygon wireframe face models through inverse perspective projection
    (Springer-Verlag, 2012) Benli, Kristin Surpuhi; Ağdoğan, Didem; Özgüz, Mete; Eskil, Mustafa Taner
    Precise registration of a generic 3D face model with a subject's face is a critical stage for model based analysis of facial expressions. In this study we propose a semi-automatic model fitting algorithm to fit a high-polygon wireframe model to a single image of a face. We manually mark important landmark points both on the wireframe model and the face image. We carry out an initial alignment by translating and scaling the wireframe model. We then translate the landmark vertices in the 3D wireframe model so that they coincide with inverse perspective projections of image landmark points. The vertices that are not manually labeled as landmark are translated with a weighted sum of vectorial displacement of k neighboring landmark vertices, inversely weighted by their 3D distances to the vertex under consideration. Our experiments indicate that we can fit a high-polygon model to the subject's face with modest computational complexity.
  • Yayın
    Assessing dyslexia with machine learning: a pilot study utilizing Google ML Kit
    (IEEE, 2023-12-19) Eroğlu, Günet; Harb, Mhd Raja Abou
    In this study, we explore the application of Google ML Kit, a machine learning development kit, for dyslexia detection in the Turkish language. We collected face-tracking data from two groups: 49 dyslexic children and 22 typically developing children. Using Google ML Kit and other machine learning algorithms based on eye-tracking data, we compared their performance in dyslexia detection. Our findings reveal that Google ML Kit achieved the highest accuracy among the tested methods. This study underscores the potential of machine learning-based dyslexia detection and its practicality in academic and clinical settings.