Fast Back Propagation Learning Using Optimization of Learning Rate for Pulsed Neural Networks
-
- Yamamoto Kenji
- Chiba University
-
- Koakutsu Seiichi
- Chiba University
-
- Okamoto Takashi
- Chiba University
-
- Hirata Hironori
- Chiba University
Bibliographic Information
- Other Title
-
- パルスニューラルネットワークのための学習率最適化を用いた誤差逆伝播学習法
- パルス ニューラル ネットワーク ノ タメノ ガクシュウリツ サイテキカ オ モチイタ ゴサ ギャクデンパ ガクシュウホウ
Search this article
Abstract
Neural Networks (NN) are widely applied to information processing because of its nonlinear processing capability. Digital hardware implementation of NN seems to be effective in construction of NN systems in which real-time operation and much further wide applications are possible. However, the digital hardware implementation of analogue NN is very difficult because we have to fulfill the restrictions about circuit resource, such as circuit scale, arrangement, and wiring. A technique that uses pulsed neuron model instead of analogue neuron model as a method of solving this problem has been proposed, and its effectiveness has been confirmed. To construct Pulsed Neural Networks (PNN), Back Propagation (BP) learning has been proposed. However, BP learning takes much time to construct PNN compared with the learning of analogue NN. Therefore some method to speed up BP learning of PNN is necessary. In this paper, we propose a fast BP learning using optimization of learning rate for PNN. In the proposed method, the learning rate is optimized so as to speed up the learning at every learning epoch. To evaluate the proposed method, we apply it to some pattern recognition problems, such as XOR, 3-bits parity, and digit recognition. Results of computational experiments indicate the validity of the proposed method.
Journal
-
- IEEJ Transactions on Electronics, Information and Systems
-
IEEJ Transactions on Electronics, Information and Systems 128 (7), 1137-1142, 2008
The Institute of Electrical Engineers of Japan
- Tweet
Details 詳細情報について
-
- CRID
- 1390282679581747200
-
- NII Article ID
- 10021133154
-
- NII Book ID
- AN10065950
-
- ISSN
- 13488155
- 03854221
-
- NDL BIB ID
- 9564387
-
- Text Lang
- ja
-
- Data Source
-
- JaLC
- NDL
- Crossref
- CiNii Articles
- KAKEN
-
- Abstract License Flag
- Disallowed