History-Pattern Encoding for Large-Scale Dynamic Multidimensional Datasets and Its Evaluations

• MAKINO Masafumi

  NTT Neo-meito, Corporation

• TSUJI Tatsuo

  University of Fukui

• HIGUCHI Ken

  University of Fukui

抄録

In this paper, we present a new encoding/decoding method for dynamic multidimensional datasets and its implementation scheme. Our method encodes an n-dimensional tuple into a pair of scalar values even if n is sufficiently large. The method also encodes and decodes tuples using only shift and and/or register instructions. One of the most serious problems in multidimensional array based tuple encoding is that the size of an encoded result may often exceed the machine word size for large-scale tuple sets. This problem is efficiently resolved in our scheme. We confirmed the advantages of our scheme by analytical and experimental evaluations. The experimental evaluations were conducted to compare our constructed prototype system with other systems; (1) a system based on a similar encoding scheme called history-offset encoding, and (2) PostgreSQL RDBMS. In most cases, both the storage and retrieval costs of our system significantly outperformed those of the other systems.

収録刊行物

• IEICE Transactions on Information and Systems

  IEICE Transactions on Information and Systems E99.D (4), 989-999, 2016

  一般社団法人 電子情報通信学会

キーワード

• tuple encoding
• dynamic multidimensional datases
• large scale datasets

詳細情報

• CRID: 1390282679354274304
• NII論文ID: 130005141369
• DOI: 10.1587/transinf.2015dap0025
• ISSN: 17451361
• ISSN: 09168532
• Web Site: https://www.jstage.jst.go.jp/article/transinf/E99.D/4/E99.D_2015DAP0025/_pdf
• 本文言語コード: en
• データソース種別:
  • JaLC
  • Crossref
  • CiNii Articles
  • KAKEN
• 抄録ライセンスフラグ: 使用不可