A Method for Measuring Emotion of Facial Expression Images by Using CCA and Gazing Property

DOI Web Site 1 Citations 23 References

Bibliographic Information

Other Title
  • 正準相関分析と注視特性による顔表情画像からの感情の測定法
  • セイ ジュンソウカン ブンセキ ト チュウシ トクセイ ニ ヨル カオ ヒョウジョウ ガゾウ カラ ノ カンジョウ ノ ソクテイホウ

Search this article

Abstract

This paper proposes a method for measuring and estimating emotion level of a facial expression image by using canonical correlation analysis (CCA) and Kernel CCA (KCCA). According to well known circumplex model of emotion by J.A.Russel, we adopt a scheme of representing emotion by two coordinate axes of valence and arousal. Our CCA and KCCA analyze two groups of variables: 1) gray scale images of facial expressions, and 2) their subjectively evaluated values of emotion in the two coordinate axes. In order to reduce error or uncertainty of estimation for emotion level, several weighting functions for reading facial expression are assembled from human gazing property of eye tracking data. Due to insufficient number of training image samples, CCA method often gets into difficulty of singular covariance matrices. A solution for the difficulty is proposed in this paper by introducing intermediate variables via principal component analysis (PCA). Property of nonlinear KCCA method with Gaussian kernel is compared to that of CCA method. The method is applied to databases of still images and movie images of facial expressions. The experimental results show that the proposed method is effective in the sense that it can estimate the level of emotion from facial expression images with comparable estimation uncertainty to human observers.

Journal

Citations (1)*help

See more

References(23)*help

See more

Related Projects

See more

Keywords

Details 詳細情報について

Report a problem

Back to top