A Double Q-Learning Based Routing Protocol for Unmanned Aerial Multi-Hop Networks 


Vol. 46,  No. 11, pp. 1873-1881, Nov.  2021
10.7840/kics.2021.46.11.1873


PDF
  Abstract

The Unmanned Aerial Multi-hop Network or Flying Ad-Hoc Network is a special type of mobile ad hoc networks, consisting of multiple UAVs(Unmanned Aerial Vehicles) to perform a variety of missions such as ISR(Intelligent Surveillance and Reconnaissance), sensing data collection, etc. In general, UAVs have problems with poor connectivity and low network performance due to their dynamic mobility and limited resources. Therefore, it is very important to design a routing protocol that operates in light-weight and adaptive manners. In this paper, we propose a double Q-learning based routing protocol that takes into account the minimum number of hops and link quality towards a destination. The proposed scheme adjusts an interval of node discovery messages according to network conditions to reduce the control message overhead. Via the OPNET simulator, we have performed a validation study of the proposed scheme and found out the fact that its packet delivery ratio becomes higher but the delay of data transmission is lower, compared to the existing QMR(Q-learning based Multi-objective optimization Routing) scheme as well as the simplest Q-learning based routing protocol.

  Statistics
Cumulative Counts from November, 2022
Multiple requests among the same browser session are counted as one view. If you mouse over a chart, the values of data points will be shown.


  Cite this article

[IEEE Style]

J. Lim and Y. Ko, "A Double Q-Learning Based Routing Protocol for Unmanned Aerial Multi-Hop Networks," The Journal of Korean Institute of Communications and Information Sciences, vol. 46, no. 11, pp. 1873-1881, 2021. DOI: 10.7840/kics.2021.46.11.1873.

[ACM Style]

Jae-won Lim and Young-Bae Ko. 2021. A Double Q-Learning Based Routing Protocol for Unmanned Aerial Multi-Hop Networks. The Journal of Korean Institute of Communications and Information Sciences, 46, 11, (2021), 1873-1881. DOI: 10.7840/kics.2021.46.11.1873.

[KICS Style]

Jae-won Lim and Young-Bae Ko, "A Double Q-Learning Based Routing Protocol for Unmanned Aerial Multi-Hop Networks," The Journal of Korean Institute of Communications and Information Sciences, vol. 46, no. 11, pp. 1873-1881, 11. 2021. (https://doi.org/10.7840/kics.2021.46.11.1873)