Performance analysis of large-scale parallel-distributed processing with backup tasks for cloud computing
この論文をさがす
抄録
In cloud computing, a large-scale parallel-distributed processing service is provided where a huge task is split into a number of subtasks and those subtasks are processed on a cluster of machines called workers. In such a processing service, a worker which takes a long time for processing a subtask makes the response time long (the issue of stragglers). One of efficient methods to alleviate this issue is to execute the same subtask by another worker in preparation for the slow worker (backup tasks). In this paper, we consider the efficiency of backup tasks. We model the task-scheduling server as a single-server queue, in which the server consists of a number of workers. When a task enters the server, the task is split into subtasks, and each subtask is served by its own worker and an alternative distinct worker. In this processing, we explicitly derive task processing time distributions for the two cases that the subtask processing time of a worker obeys Weibull or Pareto distribution. We compare the mean response time and the total processing time under backup-task scheduling with those under normal scheduling. Numerical examples show that the efficiency of backup-task scheduling significantly depends on workers' processing time distribution.
収録刊行物
-
- Journal of Industrial and Management Optimization
-
Journal of Industrial and Management Optimization 10 (1), 113-129, 2014-01
American Institute of Mathematical Sciences
- Tweet
キーワード
詳細情報 詳細情報について
-
- CRID
- 1050845760710924672
-
- NII論文ID
- 120005385483
-
- NII書誌ID
- AA11975766
-
- ISSN
- 15475816
- 1553166X
-
- HANDLE
- 2433/182214
-
- 本文言語コード
- en
-
- 資料種別
- journal article
-
- データソース種別
-
- IRDB
- Crossref
- CiNii Articles
- KAKEN