Statistical mechanics of lossy compression using multilayer perceptrons
Search this article
Abstract
application/pdf
Statistical mechanics is applied to lossy compression using multilayer perceptrons for unbiased Boolean messages. We utilize a treelike committee machine committee tree and treelike parity machine parity tree whose transfer functions are monotonic. For compression using a committee tree, a lower bound of achievable distortion becomes small as the number of hidden units K increases. However, it cannot reach the Shannon bound even where K→ . For a compression using a parity tree with K 2 hidden units, the rate distortion function, which is known as the theoretical limit for compression, is derived where the code length becomes infinity.
Journal
-
- Physical Review E - Statistical, Nonlinear, and Soft Matter Physics
-
Physical Review E - Statistical, Nonlinear, and Soft Matter Physics 74 (2), 026108-1-026108-11, 2006-08
American Physical Society
- Tweet
Details 詳細情報について
-
- CRID
- 1050859536460280448
-
- NII Article ID
- 120005402715
-
- NII Book ID
- AA11558033
-
- ISSN
- 15393755
-
- Text Lang
- en
-
- Article Type
- journal article
-
- Data Source
-
- IRDB
- CiNii Articles