Q-learning Based Ad-Hoc Network Formation Strategy for Wireless Nodes with Random Mobility Models 


Vol. 46,  No. 11, pp. 1834-1845, Nov.  2021
10.7840/kics.2021.46.11.1834


PDF
  Abstract

Since a decentralized network can be formed and maintained by multiple nodes without direct control from network infrastructure, it can be deployed in a wide range of applications. As more nodes need to be taken into account, however, computational complexity required for an optimal network significantly increases. It is more challenging to maintain higher network throughput because of node mobility. For a mobile ad-hoc network that consists of battery-powered mobile devices, in particular, it is even more important to consider power consumption required for node mobility and data transmission. In this paper, we propose an algorithm for a mobile ad-hoc network formation based on Q-learning. The proposed algorithm enables relay nodes with random movement to learn how to manage transmission power for minimizing total power consumption and maximizing network throughput without a central coordination. We confirm that the proposed solution can achieve high network throughput while minimizing power consumption regardless of network size and mobility patterns.

  Statistics
Cumulative Counts from November, 2022
Multiple requests among the same browser session are counted as one view. If you mouse over a chart, the values of data points will be shown.


  Cite this article

[IEEE Style]

N. Kim, M. Kwon, H. Park, "Q-learning Based Ad-Hoc Network Formation Strategy for Wireless Nodes with Random Mobility Models," The Journal of Korean Institute of Communications and Information Sciences, vol. 46, no. 11, pp. 1834-1845, 2021. DOI: 10.7840/kics.2021.46.11.1834.

[ACM Style]

Nayoung Kim, Minhae Kwon, and Hyunggon Park. 2021. Q-learning Based Ad-Hoc Network Formation Strategy for Wireless Nodes with Random Mobility Models. The Journal of Korean Institute of Communications and Information Sciences, 46, 11, (2021), 1834-1845. DOI: 10.7840/kics.2021.46.11.1834.

[KICS Style]

Nayoung Kim, Minhae Kwon, Hyunggon Park, "Q-learning Based Ad-Hoc Network Formation Strategy for Wireless Nodes with Random Mobility Models," The Journal of Korean Institute of Communications and Information Sciences, vol. 46, no. 11, pp. 1834-1845, 11. 2021. (https://doi.org/10.7840/kics.2021.46.11.1834)