A Deep Reinforcement Learning Based Approach for Cost- and Energy-Aware Multi-Flow Mobile Data Offloading

• ZHANG Cheng

  Department of Computer Science and Communications Engineering, Waseda University

• LIU Zhi

  Department of Mathematical and Systems Engineering, Shizuoka University

• GU Bo

  Department of Information and Communications Engineering, Kogakuin University

• YAMORI Kyoko

  Department of Management Information, Asahi University Global Information and Telecommunication Institute, Waseda University

• TANAKA Yoshiaki

  Global Information and Telecommunication Institute, Waseda University Department of Communications and Computer Engineering, Waseda University

Abstract

With the rapid increase in demand for mobile data, mobile network operators are trying to expand wireless network capacity by deploying wireless local area network (LAN) hotspots on to which they can offload their mobile traffic. However, these network-centric methods usually do not fulfill the interests of mobile users (MUs). Taking into consideration many issues such as different applications' deadlines, monetary cost and energy consumption, how the MU decides whether to offload their traffic to a complementary wireless LAN is an important issue. Previous studies assume the MU's mobility pattern is known in advance, which is not always true. In this paper, we study the MU's policy to minimize his monetary cost and energy consumption without known MU mobility pattern. We propose to use a kind of reinforcement learning technique called deep Q-network (DQN) for MU to learn the optimal offloading policy from past experiences. In the proposed DQN based offloading algorithm, MU's mobility pattern is no longer needed. Furthermore, MU's state of remaining data is directly fed into the convolution neural network in DQN without discretization. Therefore, not only does the discretization error present in previous work disappear, but also it makes the proposed algorithm has the ability to generalize the past experiences, which is especially effective when the number of states is large. Extensive simulations are conducted to validate our proposed offloading algorithms.

Journal

• IEICE Transactions on Communications

  IEICE Transactions on Communications E101.B (7), 1625-1634, 2018-07-01

  The Institute of Electronics, Information and Communication Engineers

Keywords

• wireless LAN
• multiple-flow
• mobile data offloading
• reinforce- ment learning
• deep Q-network
• DQN

Details

• CRID: 1390845712969705856
• NII Article ID: 130007386770
• DOI: 10.1587/transcom.2017cqp0014
• ISSN: 17451345
• ISSN: 09168516
• Web Site: https://www.jstage.jst.go.jp/article/transcom/E101.B/7/E101.B_2017CQP0014/_pdf
• Text Lang: en
• Data Source:
  • JaLC
  • Crossref
  • CiNii Articles
  • KAKEN
• Abstract License Flag: Disallowed