Reinforcement Learning-Based Autonomous Underwater Vehicle Waypoint Generation Algorithm in Dynamic Environments 


Vol. 50,  No. 5, pp. 712-721, May  2025
10.7840/kics.2025.50.5.712


PDF Full-Text
  Abstract

This paper proposes a method to optimize the autonomous torpedo maneuver path for reaching the target of torpedoes, which are explosive projectile weapons in naval operations. For flexible maneuvering of torpedoes, movement in various directions is considered. Also, the obstacles in the actual marine environment and the minimization of the waypoint that occurs when the angle of the torpedoes is changed considered to increase the efficiency of torpedo maneuvering. Consequently, this study presents the environment that reflects the action of the torpedo in various directions according to the maximum rotation angle. Torpedo maneuver strategy is formulated by applying a Markov Decision Process based reinforcement learning algorithm, Q-Learning. Compared to the general Q-Learning algorithm, the superiority of the proposed algorithm is assessed and its applicability in the actual marine environment, through the success rate of reaching the target point and the number of waypoints.

  Statistics
Cumulative Counts from November, 2022
Multiple requests among the same browser session are counted as one view. If you mouse over a chart, the values of data points will be shown.


  Related Articles
  Cite this article

[IEEE Style]

E. J. Roh, H. Lee, I. Song, S. Kim, Y. Kim, S. Park, J. Kim, "Reinforcement Learning-Based Autonomous Underwater Vehicle Waypoint Generation Algorithm in Dynamic Environments," The Journal of Korean Institute of Communications and Information Sciences, vol. 50, no. 5, pp. 712-721, 2025. DOI: 10.7840/kics.2025.50.5.712.

[ACM Style]

Emily Jimin Roh, Hyunsoo Lee, Ilseok Song, Seunghwan Kim, Youngdae Kim, Soohyun Park, and Joongheon Kim. 2025. Reinforcement Learning-Based Autonomous Underwater Vehicle Waypoint Generation Algorithm in Dynamic Environments. The Journal of Korean Institute of Communications and Information Sciences, 50, 5, (2025), 712-721. DOI: 10.7840/kics.2025.50.5.712.

[KICS Style]

Emily Jimin Roh, Hyunsoo Lee, Ilseok Song, Seunghwan Kim, Youngdae Kim, Soohyun Park, Joongheon Kim, "Reinforcement Learning-Based Autonomous Underwater Vehicle Waypoint Generation Algorithm in Dynamic Environments," The Journal of Korean Institute of Communications and Information Sciences, vol. 50, no. 5, pp. 712-721, 5. 2025. (https://doi.org/10.7840/kics.2025.50.5.712)
Vol. 50, No. 5 Index

Search
(IN TITLE, AUTHOR, ABSTRACT,KEYWORDS)

Advanced Search ▼

POPULAR KEYWORDS
(TOP 10 KEYWORDS)

Recent Publications
(LAST 3 YEARS)






pISSN : 1226 - 4717
eISSN : 2287 - 3880