HighwayLLM: Decision-making and navigation in highway driving with RL-informed language model


Yıldırım M., Dagda B., Asodia V., Fallah S.

ROBOTICS AND AUTONOMOUS SYSTEMS, cilt.193, 2025 (SCI-Expanded, Scopus) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 193
  • Basım Tarihi: 2025
  • Doi Numarası: 10.1016/j.robot.2025.105114
  • Dergi Adı: ROBOTICS AND AUTONOMOUS SYSTEMS
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus, Academic Search Premier, Aerospace Database, Applied Science & Technology Source, Communication Abstracts, Compendex, Computer & Applied Sciences, INSPEC, zbMATH
  • İstanbul Üniversitesi-Cerrahpaşa Adresli: Evet

Özet

Autonomous driving is a complex task which requires advanced decision making and control algorithms. Understanding the rationale behind the autonomous vehicles' decision is crucial to ensure their safe and effective operation on highway driving. This study presents a novel approach, HighwayLLM, which harnesses the reasoning capabilities of large language models (LLMs) to predict the future waypoints for ego-vehicle's navigation. Our approach also utilizes a pre-trained Reinforcement Learning (RL) model to serve as a high-level planner, making decisions on appropriate meta-level actions. The HighwayLLM combines the output from RL model and the current state information to make safe, collision-free, and explainable predictions for next states, thereby constructing a trajectory for the ego-vehicle. Subsequently, a PID-based controller guides the vehicle to the waypoints predicted by the LLM agent. This integration of LLM with RL and PID enhances decision-making process, provides interpretability for highway autonomous driving and reduces the number of collisions compared to the baseline method.