Detecting abnormal movement of driver's head based on spatial-temporal features of video using deep neural network DNN

Abstract

<p>The development of tracking and surveillance devices makes extracting useful information efficiently. Head tracking is an efficient method to obtain then analyze trajectory data and make a decision based on the spatiotemporal information of videos. Many applications are based on head tracking such as diseases some diagnosis, the gestures languages, and drowsiness detection and so on. Abnormal head movement detection can be achieved using spatial information based on a single image (one frame) at a time without considering the temporal information over time. In this paper, a new method based on multi-images is proposed to track head in order to detect abnormal head movement depending on spatiotemporal Feature using Deep Neural Network DNN that employed the 3-Dimensional Convolution Neural Networks 3D CNN. The proposed method extracts the spatial information as well as the temporal information available in a video then analysis this information to make the decision based on time series (sequences of frames); these time series provides the tracking to the head overtime to make the decision. The new dataset created and gathered to implement with the proposed system and called Normal Abnormal Head Movement Dataset (NAHM) video dataset. The new dataset provides different subjects with different conditions that give more efficiency in the implementation of the proposed system. The accuracy of the training set that achieves by the proposed system reach to 88% and of validation set reaches to 86%. The values of loss function reach to 0.3 for the training set and 0.4 for the validation set.</p>