Group Optimization Using Item Response Theory for Peer Assessment

• NGUYEN Thien Duc

  The University of Electro-Communications

• UTO Masaki

  The University of Electro-Communications

• UENO Maomi

  The University of Electro-Communications

Bibliographic Information

Other Title

• ピアアセスメントにおける項目反応理論を用いたグループ構成最適化

Abstract

As an assessment method based on social constructivism, peer assessment has attracted much attention in recent years. When learners increase as in MOOCs, peer assessment is often conducted by dividing learners into groups. However, in this case, the accuracy of peer assessment depends on a way of forming groups. To optimize the accuracy, this study develops a group optimization method using item response theory. However, experimental results show that the method cannot sufficiently improve the accuracy compared to random groups. Therefore, the study further proposes an external rater selection method to assign a few appropriate outside-group raters to each learner. Experimental results demonstrate that the proposed method can sufficiently improve the accuracy.

Journal

• 電子情報通信学会論文誌D 情報・システム

  電子情報通信学会論文誌D 情報・システム J101-D (2), 431-445, 2018-02-01

  The Institute of Electronics, Information and Communication Engineers

Keywords

• peer assessment
• item response theory
• group formation
• rater selection
• ability measurement
• optimization problem

Details

• CRID: 1390283687150687488
• NII Article ID: 120006549764
• DOI: 10.14923/transinfj.2017jdp7040
• ISSN: 18810225
• ISSN: 18804535
• Web Site: https://uec.repo.nii.ac.jp/records/8873
• Text Lang: ja
• Data Source:
  • JaLC
  • IRDB
  • CiNii Articles
  • KAKEN
• Abstract License Flag: Disallowed