Effect of Slow Switching of Ensemble Teachers in On-line Learning

• Miyoshi Seiji

  Department of Electrical and Electronic Engineering, Faculty of Engineering Science, Kansai University

• Okada Masato

  Division of Transdisciplinary Sciences, Graduate School of Frontier Sciences, The University of Tokyo RIKEN Brain Science Institute

Abstract

We have analyzed the generalization performance of a student which slowly switches ensemble teachers. By calculating the generalization error analytically using statistical mechanics in the framework of on-line learning, we show that the dynamical behaviors of generalization error have a periodicity that is synchronized with the switching period and that the behaviors differ with the number of ensemble teachers. Furthermore, we show that the smaller the switching period is, the larger the difference in behavior is.

Journal

• Journal of the Physical Society of Japan

  Journal of the Physical Society of Japan 78 (5), 053001-053001, 2009

  THE PHYSICAL SOCIETY OF JAPAN

Keywords

• ensemble teachers
• on-line learning
• generalization error
• statistical mechanics
• slow switching

Details

• CRID: 1390282679173321088
• NII Article ID: 130005437468
• NII Article ID: 10025960015
• NII Article ID: 210000107786
• NII Book ID: AA00704814
• DOI: 10.1143/jpsj.78.053001
• ISSN: 13474073
• ISSN: 00319015
• NDL BIB ID: 10224995
• Web Site: http://id.ndl.go.jp/bib/10224995
• Web Site: https://ndlsearch.ndl.go.jp/books/R000000004-I10224995
• Web Site: https://journals.jps.jp/doi/pdf/10.1143/JPSJ.78.053001
• Text Lang: en
• Data Source:
  • JaLC
  • NDL
  • Crossref
  • CiNii Articles
  • KAKEN
• Abstract License Flag: Disallowed