ポスター会話における聴衆のマルチモーダルな振る舞いに基づく興味・理解度の推定  [in Japanese] Estimation of Interest and Comprehension Level of Audience through Multi-modal Behaviors in Poster Conversations  [in Japanese]

Search this Article

Author(s)

Abstract

ポスターセッションにおける聴衆の興味・理解度を自動推定することを試みる。講演形式の発表に比べて、ポスター発表では、聴衆の視線や相槌などの振る舞いが顕著に見られる。これらの振る舞いは、興味・理解度と関係があると考えられる。また興味・理解度は、聴衆の質問や相槌などの発話行為からも推測できると考えられる。本研究ではまず、興味・理解度と発話行為の関係を分析する。次に、発話行為と聴衆の振る舞いとの関係を調べる。これに基いて、話題セグメント毎にマルチモーダルな振る舞いから、質問の生起とその種類の予測を行う。実験の結果、相槌と視線の特徴量が予測に有効であることと、それらを組み合わせることの相乗効果が確認された。

We address the estimation of the interest and comprehension level of an audience in poster sessions. Compared to lecture presentations, the audience's behaviors such as gazing and backchannels are more observable in poster presentations. These multi-modal behaviors are presumably related with their interest and comprehension level. We also assume that the interest and comprehension level can be judged by particular speech acts of the audience such as questions and reactive tokens. First, we make a preliminary analysis on their correlation. Next, we investigate the relationship between the audience's behaviors and the question type. Then, we conduct prediction of questions and their type based on the multi-modal behaviors during the relevant topic segment. Experimental results show that verbal backchannels and eye-gaze patterns are good predictors to this task, and also the combination of the multi-modal features is effective.

Journal

  • IPSJ SIG Notes

    IPSJ SIG Notes 2013-SLP-97(12), 1-5, 2013-07-18

    Information Processing Society of Japan (IPSJ)

Codes

  • NII Article ID (NAID)
    110009587133
  • NII NACSIS-CAT ID (NCID)
    AN10442647
  • Text Lang
    JPN
  • Data Source
    NII-ELS 
Page Top