What Test Constructors Should Keep in Mind: Constructing and Scoring a Translation Test
-
- USHIRO Yuji
- University of Tsukuba
-
- KOGA Tsutomu
- Graduate School, University of Tsukuba
-
- SATO Tsuyoshi
- Graduate School, University of Tsukuba
-
- IN'NAMI Yo
- Graduate School, University of Tsukuba
-
- HIJIKATA Yuko
- Graduate School, University of Tsukuba
-
- NIKLAI Gergely
- Graduate School, University of Tsukuba
-
- MURATA Erina
- Graduate School, University of Tsukuba
この論文をさがす
抄録
Translation tests are widely used for high school term tests and entrance examinations as well as university entrance examinations. Although a considerable number of papers point out the possibility of low reliability for scoring, little is known about the factors raters play in the reliability of scoring (Watanabe, 1994). This study examines how the professional backgrounds of raters affect rating criteria. The results indicated that novice raters tended to over-estimate examinees' comprehension whereas experienced raters were more likely to focus on the correctness of the Japanese sentence. In addition, it turned out that the difficulty of sentences affected the scoring of both experienced and novice raters. After administering a sorting task, the difficulty of the sentences showed that the perception of sentence difficulty did not correspond to the difficulty of examinees' translation. The paper closes by suggesting several pedagogical implications for administering translation tests. Of particular importance is that test developers should consider not only the complexity of sentence structures and vocabulary, but also the examinees' topic familiarity of the sentences to be translated.
収録刊行物
-
- 日本言語テスト学会研究紀要
-
日本言語テスト学会研究紀要 7 (0), 145-162, 2005
日本言語テスト学会
- Tweet
詳細情報 詳細情報について
-
- CRID
- 1390282681050283264
-
- NII論文ID
- 110009607545
-
- NII書誌ID
- AA11825708
-
- ISSN
- 2433006X
-
- NDL書誌ID
- 7429506
-
- 本文言語コード
- en
-
- データソース種別
-
- JaLC
- NDL
- Crossref
- CiNii Articles
-
- 抄録ライセンスフラグ
- 使用不可