Driver Fatigue Research Articles

Driver drowsiness is associated with altered facial thermal patterns: Machine learning insights from a thermal imaging approach

Driver drowsiness is a significant factor in road accidents. Thermal imaging has emerged as an effective tool for detecting drowsiness by enabling the analysis of facial thermal patterns. However, it is not clear which facial areas are most affected and correlate most strongly with drowsiness. This study examines the variations and importance of various facial areas and proposes an approach for detecting driver drowsiness. Twenty participants underwent tests in a driving simulator, and temperature changes in various facial regions were measured. The random forest method was employed to evaluate the importance of each facial region. The results revealed that temperature changes in the nasal area exhibited the highest value, while the eyes had the most correlated changes with drowsiness. Furthermore, drowsiness was classified with an accuracy of 88 % utilizing thermal variations in the facial region identified as the most important regions by the random forest feature importance model. These findings provide a comprehensive overview of facial thermal imaging for detecting driver drowsiness and introduce eye temperature as a novel and effective measure for investigating cognitive activities.

Fatigue Driving Detection and Early Warning System based on EEG Signals

The fatigue driving detection and warning system based on EEG signals aims to use EEG technology to monitor the mental state of drivers in real time, so as to identify and warn fatigue driving behavior in time, so as to improve road safety. The design of the system is based on a deep understanding of the connection between EEG signals and the fatigue state, by analyzing the changes in frequency bands such as α wave, β wave, θ wave and δ wave, which are closely related to the alert state and fatigue in humans. The development of the system first considers the main factors induced by fatigue, such as sleep deprivation, long work hours and environmental monotony, which can significantly affect the activity of brain waves. From these physiological and environmental factors, the system requirements analysis emphasizes the need for real-time data processing and high accuracy, as well as a user interface design that provides clear and intuitive feedback to users (drivers and regulators). In terms of implementation, the system integrates EEG monitoring equipment for data acquisition, uses advanced signal processing algorithm to extract fatigue-related features, and uses machine learning model for real-time analysis and fatigue state determination. In addition, the system design includes an emergency response mechanism, once signs of fatigue are detected, it can automatically trigger an alarm, issue a warning to the driver, and if necessary through the vehicle control system to ensure driving safety. This comprehensive system not only improves driving safety, but also provides strong data support for traffic management departments.

Real-time Driver Drowsiness Detection Techniques using Machine Learning Algorithms and Models

This paper is a report on the research conducted in the field of electronics and communication engineering to develop a system for driver drowsiness detection to prevent accidents happening because of driver fatigue and sleepiness. The document discusses the solution by Tensor flow machine learning tool and open CV image pre-processing available for detecting fatigue and their efficacy in preventing accidents in the current state of traffic. Furthermore, the paper states the overview of the observations made by the authors in order to help further optimization in the mentioned field to achieve the utility at a better efficiency for a safer road. Key Words: Deep Learning, Convolutional Neural Networks (CNNs), Real-time Monitoring, Facial Feature Analysis, Eye Closure Detection, EEG Signal Analysis

Processing and Integration of Multimodal Image Data Supporting the Detection of Behaviors Related to Reduced Concentration Level of Motor Vehicle Users

This paper introduces a comprehensive framework for the detection of behaviors indicative of reduced concentration levels among motor vehicle operators, leveraging multimodal image data. By integrating dedicated deep learning models, our approach systematically analyzes RGB images, depth maps, and thermal imagery to identify driver drowsiness and distraction signs. Our novel contribution includes utilizing state-of-the-art convolutional neural networks (CNNs) and bidirectional long short-term memory (Bi-LSTM) networks for effective feature extraction and classification across diverse distraction scenarios. Additionally, we explore various data fusion techniques, demonstrating their impact on improving detection accuracy. The significance of this work lies in its potential to enhance road safety by providing more reliable and efficient tools for the real-time monitoring of driver attentiveness, thereby reducing the risk of accidents caused by distraction and fatigue. The proposed methods are thoroughly evaluated using a multimodal benchmark dataset, with results showing their substantial capabilities leading to the development of safety-enhancing technologies for vehicular environments. The primary challenge addressed in this study is the detection of driver states not relying on the lighting conditions. Our solution employs multimodal data integration, encompassing RGB, thermal, and depth images, to ensure robust and accurate monitoring regardless of external lighting variations

Classification of driver fatigue in conditionally automated driving using physiological signals and machine learning

Conditionally automated vehicles (Level 3 SAE) are emerging on the roads, but long periods without engaging in a non-driving-related task can reduce drivers’ vigilance. This study aims to determine whether driver fatigue can be accurately predicted using physiological signals and machine learning (ML) techniques in such a context. 63 young drivers completed two separate conditional automated drives of 30 min each, in either a rural or a urban area. Half of them had been mildly sleep-deprived the previous night (slept less than six hours). Electrocardiogram (ECG), electrodermal activity (EDA), and respiration were collected, along with subjective measures of sleepiness and affective state. Using ML, sleep deprivation, driving environment, and sleepiness could be predicted from physiological features with an accuracy of 99%, 85%, and 73% respectively. Signal segmentation increased model accuracy, and EDA features were the most predictive. The differences between the results obtained from statistical analyses of sleepiness measures and the accuracy achieved by ML models are discussed. The results of this empirical study indicate that even mild sleep deprivation affects the physiological state of drivers, which can have serious consequences when combined with long periods of inactivity. Car manufacturers and researchers should take this into account when designing intelligent systems capable of providing drivers with appropriate warnings before a critical situation arises.

Ultra-Wide Band Radar Empowered Driver Drowsiness Detection with Convolutional Spatial Feature Engineering and Artificial Intelligence

Driving while drowsy poses significant risks, including reduced cognitive function and the potential for accidents, which can lead to severe consequences such as trauma, economic losses, injuries, or death. The use of artificial intelligence can enable effective detection of driver drowsiness, helping to prevent accidents and enhance driver performance. This research aims to address the crucial need for real-time and accurate drowsiness detection to mitigate the impact of fatigue-related accidents. Leveraging ultra-wideband radar data collected over five minutes, the dataset was segmented into one-minute chunks and transformed into grayscale images. Spatial features are retrieved from the images using a two-dimensional Convolutional Neural Network. Following that, these features were used to train and test multiple machine learning classifiers. The ensemble classifier RF-XGB-SVM, which combines Random Forest, XGBoost, and Support Vector Machine using a hard voting criterion, performed admirably with an accuracy of 96.6%. Additionally, the proposed approach was validated with a robust k-fold score of 97% and a standard deviation of 0.018, demonstrating significant results. The dataset is augmented using Generative Adversarial Networks, resulting in improved accuracies for all models. Among them, the RF-XGB-SVM model outperformed the rest with an accuracy score of 99.58%.

Development of sleepiness in professional truck drivers: Real-road testing for driver drowsiness and attention warning (DDAW) system evaluation.

All new vehicle types within the European Union must now be equipped with a driver drowsiness and attention warning system starting from 2022. The specific requirements for the test procedure necessary for type approval are defined in the Annex of EU Regulation C/2021/2639. The objectives of this study were to: (i) investigate how sleepiness develops in professional truck drivers under real-road driving conditions; and (ii) assess the feasibility of a test procedure for validating driver drowsiness and attention warning systems according to the EU regulation. Twenty-four professional truck drivers participated in the test. They drove for 180 km on a dual-lane motorway, first during daytime after a normal night's sleep and then at nighttime after being awake since early morning. The results showed higher sleepiness levels during nighttime driving compared with daytime, with a faster increase in sleepiness with distance driven, especially during the night. Psychomotor vigilance task results corroborated these findings. From a driver drowsiness and attention warning testing perspective, the study design with sleep-deprived drivers at night was successful in inducing the targeted sleepiness level of a Karolinska Sleepiness Scale score of ≥ 8. Many drivers who reported a Karolinska Sleepiness Scale ≥ 8 during the drives also acknowledged feeling sleepy in the post-drive questionnaire. Reaching high levels of sleepiness on real roads during daytime is more problematic, not the least from legal and ethical perspectives as higher traffic densities during the daytime lead to increased risks.

Enhancing Driver Safety: Deep Learning Approach for Drowsiness Detection and Accident Prevention

Road safety concerns have spurred the development of innovative technologies aimed at reducing accidents, particularly those caused by driver fatigue. The main scope of the driver drowsiness detection system is to minimize road accidents caused by fatigue or sleepiness of drivers. This system leverages deep learning and computer vision, employing a Raspberry Pi camera to monitor facial expressions, including yawning, to assess the driver's alertness. Upon detecting signs of drowsiness, such as prolonged eye closure or altered facial expressions, the system triggers a buzzer alert by analyzing the Eye Aspect Ratio (EAR) and Mouth Aspect Ratio (MAR) ratios. Integrated within an embedded system, it utilizes frontal face detection algorithms and Haar cascade classifiers to localize key facial features in real-time, facilitating efficient monitoring for signs of fatigue or distraction. Additionally, it issues vibration alerts if the seat belt is not fastened. The seat belt remainder will be helpful to ensure the safety of the driver, reduces accidents and monitors the driver's heart rate, triggering a PANIC message if irregularities are detected. At traffic signals, the system automatically reduces vehicle speed using a vibration motor. In the unfortunate event of an accident, the system initiates speed reduction and promptly notifies registered contacts through the Blynk application, thereby significantly reducing accidents caused by drowsy driving.

P‐64: Research on Displayable Scheme of Camera Under Panel Based on Automobile Display

CUP (Camera Under Panel) is applied to the automobile and can identify the driver's identity, monitor the driver's fatigue, attention, and monitor dangerous driving behaviors. The commonly used blind hole technology now leads to the inability to display the camera hole area. Therefore, we proposes a scheme for camera under panel applied to automobile, which is based on the Mini LED backlight structure design to achieve full screen display. At the same time, optical simulation analysis and related experiments were conducted to verify the feasibility of the scheme.

Enhancing Road Safety: A Driver Fatigue Detection and Behaviour Monitoring System using Advanced Computer Vision Techniques

Driver drowsiness is a major hazard to road safety, necessitating the development of reliable detection technologies. This study describes a revolutionary driver fatigue detection system that uses cutting-edge computer vision technologies. This system uses the MediaPipe framework for accurate face and hand detection and the Eye Aspect Ratio (EAR) for drowsiness detection. Furthermore, it uses the OpenCV solvePnP function for estimating rotation vector, and converting it to a rotation angle of the head, to check driver attention. By continuously monitoring these indicators, when the system successfully detects any instances of driver tiredness or inattention, it records his or her behavior and delivers notifications to help prevent accidents. This study helps to improve road safety by utilizing cutting-edge computer vision techniques to prevent driver fatigue and boost attentive driving practices.

SPARK: A High-Efficiency Black-Box Domain Adaptation Framework for Source Privacy-Preserving Drowsiness Detection.

Developing an effective and efficient electroencephalography (EEG)-based drowsiness monitoring system is crucial for enhancing road safety and reducing the risk of accidents. For general usage, cross-subject evaluation is indispensable. Despite progress in unsupervised domain adaptation (UDA) and source-free domain adaptation (SFDA) methods, these often rely on the availability of labeled source data or white-box source models, posing potential privacy risks. This study explores a more challenging setting of UDA for EEG-based drowsiness detection, termed black-box domain adaptation (BBDA). In BBDA, adaptation in the target domain relies solely on a black-box source model, without access to the source data or parameters of the source model. Specifically, we propose a framework called Self-distillation and Pseudo-labelling for Ensemble Deep Random Vector Functional Link (edRVFL)-based Black-box Knowledge Adaptation (SPARK). SPARK employs entropy-based selection of high-confidence samples, which are then pseudo-labeled to train a student edRVFL network. Subsequently, ensemble self-distillation is performed to extract knowledge by training the edRVFL using refined labels introduced by ensemble learning. This process further improves the robustness of the student edRVFL network. The features of the edRVFL are beneficial for improving the computational efficiency of the framework, making it more suitable for tasks involving small datasets. The proposed SPARK framework is evaluated on two publicly available driver drowsiness datasets. Experimental results demonstrate its superior performance over strong baselines, while significantly reducing training time. These findings underscore the potential for practical integration of the proposed framework into drowsiness monitoring systems, thereby contributing substantially to the privacy preservation of source subjects.

Driver Drowsiness Detection using CNN

Abstract: Driver drowsiness is a significant factor contributing to road accidents worldwide, posing a major threat to public safety. This project presents a robust and efficient approach to detecting driver drowsiness using Convolutional Neural Networks (CNN). The proposed system aims to enhance road safety by monitoring drivers in real-time and providing timely warnings to prevent accidents caused by fatigue. The methodology involves capturing video frames of the driver's face using a camera installed in the vehicle. The CNN model is trained on a comprehensive dataset containing images of alert and drowsy states. Key facial landmarks and features, such as eye closure duration, yawning frequency, and head position, are extracted and analyzed to determine the driver's level of alertness. By leveraging the powerful feature extraction capabilities of CNNs, the system can accurately distinguish between alert and drowsy states with high precision. Experimental results demonstrate the effectiveness of the proposed system in real-world scenarios, achieving a high accuracy rate in detecting drowsiness. The system's performance is evaluated against various benchmarks, showcasing its potential for integration into modern vehicles as a preventive safety measure. The deployment of this CNN-based drowsiness detection system can significantly reduce the risk of accidents, contributing to safer driving conditions and saving lives.

Drowsy Driver Detection System

Abstract: Drowsy driver detection system is a safety technology designed to identify the potential signs of fatigue or drowsiness of the driver to prevent accidents caused as a result of not being alert. It is a significant risk factor for traffic accidents which has led to thousands of accidents, injuries, and fatalities each year. In this system we have used some techniques to monitor the driver’s behavior or state. This involves tracking facial features, eye movements or blink patterns and yawning. The system identifies signs of fatigue, such as slow eyelid closure, increased blink duration and yawn which often indicate drowsiness. As technology advances, these systems are becoming more accurate, efficient and integrated with other vehicle safety features. The continued development of drowsy driver detection technology holds significant promise for reducing traffic accidents and improving overall road safety.

Driver drowsiness detection system

Driver drowsiness detection system

Correction: Driver fatigue detection based on improved YOLOv7

Correction: Driver fatigue detection based on improved YOLOv7

Heavy vehicle driver fatigue: Observing work and rest behaviours of truck drivers in Australia

The extant transport literature suggests that truck driver fatigue is a leading contributor in truck crashes. Various factors are known to affect a truck driver’s ability to comply with work and rest requirements, including long working hours, irregular work schedules, sleep deprivation and driving at night. In Australia, while control measures restrict the number of hours of work a truck driver may undertake without rest, they travel vast distances and work with a high level of autonomy. This makes it difficult for transport companies to monitor and manage truck drivers’ work and rest compliance; thereby relying on them to self-manage driver fatigue at designated rest-stops. However, there is little Australian research examining rest-stop behaviour of truck drivers in relation to driver fatigue compliance. To better understand how truck drivers manage driver fatigue, an exploratory participant observation study of truck drivers (N = 378) was undertaken at two Australian truck rest stops in rural New South Wales. The findings indicate that while most truck drivers comply with rest requirements regarding driver fatigue, load type, driver changeovers, access to parking, and time spent on work-related activities at the rest areas affects the time truck drivers spend at rest, and these factors are likely to increase the risk of truck drivers not complying with driver fatigue regulation. They are also likely to increase the number of truck drivers involved in fatigue related crashes.

Evaluating Acceptance of Novel Vehicle-Mounted Perfume Automatic Dispersal Device for Fatigued Drivers

This paper evaluates the influence of different variables on drivers’ willingness to accept and use a vehicle-mounted perfume automatic dispersal device (VP-ADD) connected to the vehicle’s electronic map. Based on the technical acceptance model, we clarify and condense the explanation of the model used to evaluate the impact of user behavior attitudes and device characteristics on six factors, perceived usefulness, perceived ease of use, attitude towards use, intention to use, perceived playfulness, and perceived risk, proposing eight hypotheses. Then, we assessed the responses of 562 drivers in China using SPSS for reliability and validity and AMOS for structural equation modeling to test our hypotheses. The findings reveal that the perceived usefulness, ease of use, playfulness, and risk significantly affected the willingness to accept and use the VP-ADD. Furthermore, the perceived risk has a negative influence, while the perceived usefulness, perceived ease of use, perceived playfulness, and attitude towards use have a positive influence. This research is significant for further development and application of the VP-ADD. It is essential to alleviate driver fatigue, ensure traffic safety, and provide theoretical and empirical support for designing more popular driving assistance devices. Furthermore, it offers valuable insights for developing fatigue driving warning policies, in-vehicle device guidelines, and traffic safety regulations.

Advancements in driver fatigue detection: A comprehensive analysis of eye movement and facial feature approaches

This article goes into sophisticated tiredness detection methods that make use of computer vision algorithms, including the Eye Movement and Facial Feature approaches. Eye movement analysis, which emphasizes blink frequency, Scanning speed, and gaze length, excels in tasks requiring sustained visual attention, which is critical in high-attention vocations. Facial Feature detection, on the other hand, monitors changes in expressions, muscle activity, and emotions, providing flexibility across a wide range of settings. Eye movement enables accurate indications, real-time responsiveness, and task-specific precision, which is especially important in high-attention occupations. Facial Feature is ideal for a variety of scenarios since it gives complete assessments, flexibility, contextual analysis, and non-intrusiveness. Case examples show how eye-tracking and convolutional neural networks may be used to improve accuracy. This study helps to weariness management by detailing the advantages and disadvantages of Eye Movement and Facial Feature methods. Given the pervasiveness of fatigue, knowing these sensing systems is critical for maintaining safety, productivity, and general well-being in a variety of professional and everyday life scenarios.

TFormer: A time–frequency Transformer with batch normalization for driver fatigue recognition

Within the framework of the advanced human-cybernetic interfaces (HCI), Cross-subject electroencephalogram (EEG)-based driver fatigue recognition is emerging as a pivotal application in the paradigm of Industry 5.0. Recognizing the importance of ensuring driver safety through proactive monitoring, it is essential to offer a general EEG decoding system to improve road safety. This work investigated the use of Transformers for the challenging cross-subject EEG decoding task due to the great success the Transformers have achieved in various applications. Previous research focused on using Transformers to capture global temporal information, but less work targeted global frequency-domain patterns. Furthermore, in order to leverage a standard Transformer architecture grounded in natural language processing for EEG decoding, it is imperative to account for inherent characteristics in EEG and make pertinent adjustments accordingly. In this work, we proposed a time–frequency Transformer (TFormer) that can automatically learn the global time–frequency patterns from raw EEG data. TFormer consisted of three components: convolutional stems for input embedding, time–frequency multi-head cross-attention (TF-MCA) for integrating time-domain patterns into frequency points, and self-attention to further learn global time-frequency patterns. Moreover, we analyzed TFormer’s internal settings and found batch normalization (BN) more suitable for cross-subject EEG decoding than layer normalization (LN). The experiment results demonstrated the superiority of the proposed model compared to existing methods. Overall, our work contributes to the development of Transformer models in EEG decoding and illustrates a different way to leverage Transformers for decoding raw EEG data.

Advancements in Fatigue Detection: Integrating fNIRS and Non-Voluntary Attention Brain Function Experiments.

Driving fatigue is a significant concern in contemporary society, contributing to a considerable number of traffic accidents annually. This study explores novel methods for fatigue detection, aiming to enhance driving safety. This study utilizes electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) to monitor driver fatigue during simulated driving experiments lasting up to 7 h. Analysis reveals a significant correlation between behavioral data and hemodynamic changes in the prefrontal lobe, particularly around the 4 h mark, indicating a critical period for driver performance decline. Despite a small participant cohort, the study's outcomes align closely with established fatigue standards for drivers. By integrating fNIRS into non-voluntary attention brain function experiments, this research demonstrates promising efficacy in accurately detecting driving fatigue. These findings offer insights into fatigue dynamics and have implications for shaping effective safety measures and policies in various industrial settings.