Sparsely Encoded Associative Memory Model with Forgetting Process

• KIMOTO Tomoyuki

  Oita National College of Technology

• OKADA Masato

  Brain Science Institute, RIKEN

Abstract

In this paper, an associative memory model with a forgetting process proposed by Mezard et al. is investigated as a means of storing sparsely encoded patterns by the SCSNA proposed by Shiino and Fukai. Similar to the case of storing non-sparse (non-biased) patterns as analyzed by Mezard et al., this sparsely encoded associative memory model is also free from a catastrophic deterioration of the memory caused by memory pattern overloading. We theoretically obtain a relationship between the storage capacity and the forgetting rate, and find that there is an optimal forgetting rate leading to the maximum storage capacity. We call this the optimal storage capacity rate. As the memory pattern firing rate decreases, the optimal storage capacity increases and the optimal forgetting rate decreases. Furthermore, we shown that the capacity rate (i.e. the ratio of the storage capacity for the conventional correlation learning rule to the optimal storage capacity) is almost constant with respect to the memory pattern firing rate.

Journal

• IEICE Trans. Inf. & Syst., D

  IEICE Trans. Inf. & Syst., D 85 (12), 1938-1945, 2002-12-01

  The Institute of Electronics, Information and Communication Engineers

Keywords

• associative memory model
• sparse coding
• forgetting process
• SCSNA
• short-term memory

Details

• CRID: 1570854177487807232
• NII Article ID: 110003213611
• NII Book ID: AA10826272
• ISSN: 09168532
• Text Lang: en
• Data Source:
  • CiNii Articles
  • KAKEN