Driving Assistant Companion With Voice Interface Using Long Short-Term Memory Networks

Abstract

In this paper, we propose a driving assistant companion system that provides drivers with useful information using a long short-term memory network in a data-driven fashion. Our system can be viewed as an advanced driver-assistance system for faster learning and better driving. The assistant companion predicts upcoming events on the road by using real-time sensory measurements from range finding sensors and provides informative narrations to enhance learnability and driving performance. In contrast to a conventional navigation system, our system predicts events from the online stream of sensory measurements without resorting to priors and map information. To demonstrate the effectiveness of the proposed system, we implemented our system on The Open Racing Car Simulator and conducted an experimental study with 16 human drivers. Experimental results show that our system enhanced learnability, driving performance, and reliability.