Understanding Developer Commenting in Code Reviews

• HIRAO Toshiki

  Nara Institute of Science and Technology

• GAIKOVINA KULA Raula

  Nara Institute of Science and Technology

• IHARA Akinori

  Wakayama University

• MATSUMOTO Kenichi

  Nara Institute of Science and Technology

Abstract

Modern code review is a well-known practice to assess the quality of software where developers discuss the quality in a web-based review tool. However, this lightweight approach may risk an inefficient review participation, especially when comments becomes either excessive (i.e., too many) or underwhelming (i.e., too few). In this study, we investigate the phenomena of reviewer commenting. Through a large-scale empirical analysis of over 1.1 million reviews from five OSS systems, we conduct an exploratory study to investigate the frequency, size, and evolution of reviewer commenting. Moreover, we also conduct a modeling study to understand the most important features that potentially drive reviewer comments. Our results find that (i) the number of comments and the number of words in the comments tend to vary among reviews and across studied systems; (ii) reviewers change their behaviours in commenting over time; and (iii) human experience and patch property aspects impact the number of comments and the number of words in the comments.

Journal

• IEICE Transactions on Information and Systems

  IEICE Transactions on Information and Systems E102.D (12), 2423-2432, 2019-12-01

  The Institute of Electronics, Information and Communication Engineers

Keywords

• modern code review
• review comments
• mining software repositories
• empirical study
• machine learning

Details

• CRID: 1390564227352415616
• NII Article ID: 130007754459
• DOI: 10.1587/transinf.2019mpp0005
• ISSN: 17451361
• ISSN: 09168532
• Web Site: https://www.jstage.jst.go.jp/article/transinf/E102.D/12/E102.D_2019MPP0005/_pdf
• Text Lang: en
• Data Source:
  • JaLC
  • Crossref
  • CiNii Articles
  • KAKEN
• Abstract License Flag: Disallowed