Modeling of autonomous problem solving process by dynamic construction of task models in multiple tasks environment

• Ohigashi, Yu

• Omori, Takashi

Abstract

Traditional reinforcement learning (RL) supposes a complex but single task to be solved. When a RL agent faces a task similar to a learned one, the agent must relearn the task from the beginning because it doesn’t reuse the past learned results. This is the problem of quick action learning, which is the foundation of decision making in the real world. In this paper, we suppose agents that can solve a set of tasks similar to each other in a multiple tasks environment, where we encounter various problems one after another, and propose a technique of action learning that can quickly solve similar tasks by reusing previously learned knowledge. In our method, a model-based RL uses a task model constructed by combining primitive local predictors for predicting task and environmental dynamics. To evaluate the proposed method, we performed a computer simulation using a simple ping-pong game with variations.

Journal

• Neural Networks

  Neural Networks 19 (8), 1169-1180, 2006-10

Keywords

• Model-based reinforcement learning
• Multiple tasks
• Task model
• Reuse of knowledge

Details

• CRID: 1050282813958097792
• NII Article ID: 10018337743
• NII Book ID: AA10680676
• HANDLE: 2115/16898
• ISSN: 08936080
• Text Lang: en
• Article Type: journal article
• Data Source:
  • IRDB
  • CiNii Articles
  • KAKEN