マルチモーダル情報に基づくグループ会話におけるコミュニケーション能力の推定

  • 岡田 将吾
    東京工業大学情報理工学院情報工学系
  • 松儀 良広
    東京工業大学大学院総合理工学研究科知能システム科学専攻
  • 中野 有紀子
    成蹊大学理工学部情報科学科
  • 林 佑樹
    大阪府立大学現代システム科学域知識情報システム学類
  • 黄 宏軒
    立命館大学情報理工学部情報コミュニケーション学科
  • 高瀬 裕
    成蹊大学理工学部情報科学科
  • 新田 克己
    東京工業大学情報理工学院情報工学系

書誌事項

タイトル別名
  • Estimating Communication Skills based on Multimodal Information in Group Discussions

抄録

<p>This paper focuses on developing a model for estimating communication skills of each participant in a group from multimodal (verbal and nonverbal) features. For this purpose, we use a multimodal group meeting corpus including audio signal data and head motion sensor data of participants observed in 30 group meeting sessions. The corpus also includes the communication skills of each participant, which is assessed by 21 external observers with the experience of human resource management. We extracted various kinds of features such as spoken utterances, acoustic features, speaking turns and the amount of head motion to estimate the communication skills. First, we created a regression model to infer the level of communication skills from these features using support vector regression to evaluate the estimation accuracy of the communication skills. Second, we created a binary (high or low) classification model using support vector machine. Experiment results show that the multimodal model achieved 0.62 in R2 as the regression accuracy of overall skill, and also achieved 0.93 as the classification accuracy. This paper reports effective features in predicting the level of communication skill and shows that these features are also useful in characterizing the difference between the participants who have high level communication skills and those who do not.</p>

収録刊行物

被引用文献 (5)*注記

もっと見る

参考文献 (14)*注記

もっと見る

関連プロジェクト

もっと見る

詳細情報 詳細情報について

問題の指摘

ページトップへ