Implementation of Digital Virtual Environment Model Considering Obstacles and Traffic Lights, and Research on Multi-Lane Autonomous Driving Based on Deep Reinforcement Learning 


Vol. 49,  No. 6, pp. 862-873, Jun.  2024
10.7840/kics.2024.49.6.862


PDF
  Abstract

In this paper, a self-driving system in a digital virtual road environment utilizing deep reinforcement learning is proposed. Using ML-Unity, a digital virtual environment is created to simulate a multi-lane road with various obstacles and traffic lights. Multiple sensors are deployed on the vehicle to observe the current road and driving environment, facilitating the development of the autonomous driving system. Information about obstacles, traffic lights, and surrounding vehicles is acquired through the digital virtual environment. This information is then mapped to the state space of the deep reinforcement learning model to dynamically determine actions, such as driving direction and speed, to maximize performance in terms of driving distance and time. The paper introduces a system design that combines priority experience replay-based Deep Q-Network (DQN) with exploration strategies and a novel reward function to achieve fast learning and stable driving. Through experiments in the digital virtual space, the proposed system is validated to successfully perform lane-keeping, obstacle avoidance, and compliant driving with traffic signals compared to vanilla DQN.

  Statistics
Cumulative Counts from November, 2022
Multiple requests among the same browser session are counted as one view. If you mouse over a chart, the values of data points will be shown.


  Related Articles
  Cite this article

[IEEE Style]

J. Lee and S. Yoo, "Implementation of Digital Virtual Environment Model Considering Obstacles and Traffic Lights, and Research on Multi-Lane Autonomous Driving Based on Deep Reinforcement Learning," The Journal of Korean Institute of Communications and Information Sciences, vol. 49, no. 6, pp. 862-873, 2024. DOI: 10.7840/kics.2024.49.6.862.

[ACM Style]

Jae-yeong Lee and Sang-Jo Yoo. 2024. Implementation of Digital Virtual Environment Model Considering Obstacles and Traffic Lights, and Research on Multi-Lane Autonomous Driving Based on Deep Reinforcement Learning. The Journal of Korean Institute of Communications and Information Sciences, 49, 6, (2024), 862-873. DOI: 10.7840/kics.2024.49.6.862.

[KICS Style]

Jae-yeong Lee and Sang-Jo Yoo, "Implementation of Digital Virtual Environment Model Considering Obstacles and Traffic Lights, and Research on Multi-Lane Autonomous Driving Based on Deep Reinforcement Learning," The Journal of Korean Institute of Communications and Information Sciences, vol. 49, no. 6, pp. 862-873, 6. 2024. (https://doi.org/10.7840/kics.2024.49.6.862)
Vol. 49, No. 6 Index

Search
(IN TITLE, AUTHOR, ABSTRACT,KEYWORDS)

Advanced Search ▼

POPULAR KEYWORDS
(TOP 10 KEYWORDS)

Recent Publications
(LAST 3 YEARS)






pISSN : 1226 - 4717
eISSN : 2287 - 3880