TY  - JOUR
T1  - A Study on Highway Driving Decision Making with Hybrid Action for Autonomous Vehicles Using Deep Reinforcement Learning
AU  - Kim, Seongjun 
AU  - Shin, Kyu-min 
AU  - Jeon, Jun-seo 
AU  - Bang, Ji-yoon 
AU  - Kim, Junyoung 
AU  - Jung, Soyi 
JO  - The Journal of Korean Institute of Communications and Information Sciences
PY  - 2024
DA  - 2024/1/1
DO  - 10.7840/kics.2024.49.12.1671
KW  - Autonomous Driving
KW  - Deep Reinforcement Learning
KW  - Lane-Change
KW  - PPO
KW  - highway
KW  - Hybrid Action
AB  - Various traffic situations on multi-lane highways pose challenges for autonomous driving, requiring adherence to traffic rules. Traditional rule-based decision-making struggles with safety in complex environments, leading to research on deep reinforcement learning (DRL). This paper proposes a decision-making method based on proximal policy optimization (PPO) with hybrid actions. The DRL model inputs the states of the ego vehicle and surrounding vehicles, outputting continuous longitudinal control and discrete lateral lane changes. For lane changes, actuator-level steering is controlled via pure pursuit. Experiments show that agents with hybrid actions are safer than those using only continuous or discrete actions.