Local Synaptic Learning Rules Suffice to Maximize Mutual Information in a Linear Network

DOI Web Site 被引用文献22件
  • Ralph Linsker
    IBM Research Division, T. J. Watson Research Center, P. O. Box 218, Yorktown Heights, NY 10598 USA

抄録

<jats:p> A network that develops to maximize the mutual information between its output and the signal portion of its input (which is admixed with noise) is useful for extracting salient input features, and may provide a model for aspects of biological neural network function. I describe a local synaptic Learning rule that performs stochastic gradient ascent in this information-theoretic quantity, for the case in which the input-output mapping is linear and the input signal and noise are multivariate gaussian. Feedforward connection strengths are modified by a Hebbian rule during a "learning" phase in which examples of input signal plus noise are presented to the network, and by an anti-Hebbian rule during an "unlearning" phase in which examples of noise alone are presented. Each recurrent lateral connection has two values of connection strength, one for each phase; these values are updated by an anti-Hebbian rule. </jats:p>

収録刊行物

被引用文献 (22)*注記

もっと見る

キーワード

詳細情報 詳細情報について

問題の指摘

ページトップへ