Proposal of a Multimodal Interaction Description Language for Various Interactive Agents

Search this Article

Author(s)

Abstract

In this paper, we propose a new multimodal interaction description language, MIML (Multimodal Interaction Markup Language), which defines dialogue patterns between human and various types of interactive agents. The feature of this language is three-layered description of agent-based interactive systems. The high-level description is a task definition that can easily construct typical agent-based interactive task control information. The middle-level description is an interaction description that defines agent's behavior and user's input at the granularity of dialogue segment. The low-level description is a platform dependent description that can override the pre-defined function in the interaction description. The connection between task-level and interaction-level is realized by generation of interaction description templates from the task level description. The connection between interaction-level and platform-level is realized by a binding mechanism of XML. As a result of the comparison with other languages, MIML has advantages in high-level interaction description, modality extensibility and compatibility with standardized technologies.

Journal

  • IEICE Trans. Inf. & Syst, D

    IEICE Trans. Inf. & Syst, D 88(11), 2469-2476, 2005-11-01

    The Institute of Electronics, Information and Communication Engineers

References:  8

Cited by:  3

Codes

  • NII Article ID (NAID)
    110003501990
  • NII NACSIS-CAT ID (NCID)
    AA10826272
  • Text Lang
    ENG
  • Article Type
    Journal Article
  • ISSN
    09168532
  • Data Source
    CJP  CJPref  NII-ELS 
Page Top