Evaluation Methods for Web Retrieval Tasks Considering Hyperlink Structure

• EGUCHI Koji

  the National Institute of Informatics

• OYAMA Keizo

  the National Institute of Informatics

• ISHIDA Emi

  the National Institute of Informatics

• KANDO Noriko

  the National Institute of Informatics

• KURIYAMA Kazuko

  Shirayuri College

Abstract

This paper proposes the evaluation methods for measuring retrieval effectiveness of Web search engine systems, attempting to make them suitable for real Web environment. With this objective, we constructed 100-gigabyte and 10-gigabyte document sets that were mainly gathered from the '.jp' domain, and conducted an evaluation workshop at the third NTCIR Workshop from 2001 to 2002, where we assessed the retrieval effectiveness of a certain number of Web search engine systems using the common data set. Conventional evaluation workshops assessed the relevance of the retrieved documents, which were submitted by the workshop participants, by considering the contents of individual pages. On the other hand, we assessed the relevance of the retrieved pages by considering the relationship between the pages referenced by hyperlinks.

Journal

• IEICE Transactions on Information and Systems, D

  IEICE Transactions on Information and Systems, D 86 (9), 1804-1813, 2003-09-01

  The Institute of Electronics, Information and Communication Engineers

Keywords

• evaluation methods
• test collections
• Web information retrieval

Details

• CRID: 1571980076883606400
• NII Article ID: 110004069205
• NII Book ID: AA10826272
• ISSN: 09168532
• Text Lang: en
• Data Source:
  • CiNii Articles