An Examination of Reliability of an Oral Reading Test for EFL Learners Using Generalizability Theory
-
- SHIMIZU Maki
- Takasaki University of Health and Welfare
Bibliographic Information
- Other Title
-
- 英語学習者のための音読テストの信頼性 : 一般化可能性理論からの検討
Abstract
An oral reading test designed to assess EFL learners' reading ability or oral reading ability requires human raters, and therefore, the inter-rater reliability must be examined. The present study firstly investigated the relation between rater training and reliability. Two English teachers evaluated 26 students' oral reading performance and the ratings given by a trained rater were compared with those given by a non-trained rater. Results of correlation analyses and generalizability (G) theory showed that the oral reading test had high reliability, and the rater training, which did not change reliability, only made wide variations in ratings. Secondly, the present study attempted to find how many criteria should be included in a rating scale, and the ideal number of raters to ensure reliability. It was shown by G theory that two raters with three criteria would show the best performance in terms of cost effectiveness. Thirdly, we examined whether teacher-rated fluency could be replaced by an oral reading rate, which was an objective measurement. In regard to the latter, implications were drawn for future research in this area.
Journal
-
- ARELE: Annual Review of English Language Education in Japan
-
ARELE: Annual Review of English Language Education in Japan 20 (0), 181-190, 2009
The Japan Society of English Language Education
- Tweet
Details 詳細情報について
-
- CRID
- 1390282680798751104
-
- NII Article ID
- 110008512381
-
- ISSN
- 24320412
- 13448560
-
- Text Lang
- en
-
- Data Source
-
- JaLC
- CiNii Articles
-
- Abstract License Flag
- Disallowed