Evaluation of IDF Checkers Based on Two Different Corpora

• KAWAMURA Yoshiko

  Tokyo International University

• KITAMURA Tatsuya

  Konan University

• TOMIOKA Yosuke

  Central Japan Railway Company

Bibliographic Information

Other Title

• 異なるコーパスを元に開発した単語レベル判定システムの比較運用実験

Abstract

The aim of this study is to establish a reliable criterion for rating the level of Japanese words, and to develop an automatic word level rating system based on the criterion. We have already developed word level rating systems based on the coverage for the Japanese language proficiency test (Kawamura, 1999), word familiarity, and word frequency (Kawamura and Kitamura, 2008), and released them on our web page (http://language.tiu.ac.jp/) as part of Reading Tutor. However, they are not sufficient enough to rate the level of Japanese words for JSL/JFL learners. We are developing two kinds of word level rating systems based on the inverse document frequency (IDF): calculated from a newspaper database and from Yahoo-Chiebukuro. In the present study, these two systems are evaluated with texts at different levels.

Journal

• The journal of Japanese Language Education Methods

  The journal of Japanese Language Education Methods 16 (2), 24-25, 2009

  Japanese Language Education Methods

Keywords

• 単語レベル判定レベル
• IDF
• コーパス
• 単語出現頻度
• 日本語能力試験出題基準

Details

• CRID: 1390282680758235136
• NII Article ID: 110009497285
• DOI: 10.19022/jlem.16.2_24
• ISSN: 24239909
• ISSN: 18813968
• Web Site: https://dsc.repo.nii.ac.jp/?action=repository_uri&item_id=409
• Text Lang: ja
• Data Source:
  • JaLC
  • CiNii Articles
  • IDR
  • KAKEN
• Abstract License Flag: Disallowed