Real-time Human Behavior Research Articles

DRIVER DROWSINESS DETECTION SYSTEM

The proposed system utilizes facial landmark detection and eye aspect ratio calculation to detect drowsiness in real-time from a webcam feed. It employs the dlib library for face detection and facial landmark prediction. The eye aspect ratio (EAR) is computed from the distances between specific points on the eyes. When the EAR falls below a predefined threshold for a certain number of consecutive frames, it triggers an alert indicating potential drowsiness. The alert includes visual cues on the video feed, an auditory alert using the playsound library, and even sends an instant WhatsApp message using pywhatkit to notify a designated contact about the drowsiness. This system serves as a useful tool for monitoring driver fatigue or alertness in various contexts, promoting safety and awareness. Its capacity to swiftly identify and alert users to the onset of drowsiness represents a significant leap forward in safety technology. By mitigating the risk of accidents stemming from fatigue-induced impairments, this project underscores the pivotal role of computer vision in real-time human behavior monitoring, offering a versatile and invaluable tool for fostering safety and awareness across various domains. Keywords: Drowsiness Detection; Python; Whatsapp messaging; Webcam feed; Computer Vision; Alert System; Real-time monitoring; Eye-Aspect Ratio; Frame Processing; Facial Recognition.

Adaptive temporal compression for reduction of computational complexity in human behavior recognition

The research on video analytics especially in the area of human behavior recognition has become increasingly popular recently. It is widely applied in virtual reality, video surveillance, and video retrieval. With the advancement of deep learning algorithms and computer hardware, the conventional two-dimensional convolution technique for training video models has been replaced by three-dimensional convolution, which enables the extraction of spatio-temporal features. Specifically, the use of 3D convolution in human behavior recognition has been the subject of growing interest. However, the increased dimensionality has led to challenges such as the dramatic increase in the number of parameters, increased time complexity, and a strong dependence on GPUs for effective spatio-temporal feature extraction. The training speed can be considerably slow without the support of powerful GPU hardware. To address these issues, this study proposes an Adaptive Time Compression (ATC) module. Functioning as an independent component, ATC can be seamlessly integrated into existing architectures and achieves data compression by eliminating redundant frames within video data. The ATC module effectively reduces GPU computing load and time complexity with negligible loss of accuracy, thereby facilitating real-time human behavior recognition.

Socially Compliant Robot Navigation in Crowded Environment by Human Behavior Resemblance Using Deep Reinforcement Learning

Social robots have evolved in diverse applications with the emergence of deep reinforcement learning methods. However, safe and secure navigation of social robots in a complex crowded environment remains a challenging task. The robot can safely navigate in a crowd only if it can predict the next action of humans, however this task becomes difficult because of the unpredictable human behavior. To address the issue of socially compliant navigation, the robot needs to learn real-time human behavior. This manuscript models Danger-Zone for the robot by considering all possible actions that humans can take at given time. The Danger Zones are formulated by considering the real time human behavior. The robot is trained to avoid these danger zones for safe and secure navigation. The proposed model is tested on the three state of art methods, Collision Avoidance with Deep Reinforcement Learning (CADRL), Long Short Term Memory Reinforcement Learning (LSTM-RL) and Social Attention with Reinforcement Learning (SARL) in multi-agent navigation. Experimental results signify that proposed model can understand human behavior and navigate in a socially compliant manner with safety as the highest priority.

Review and Challenges of Technologies for Real-Time Human Behavior Monitoring.

A person's behavior significantly influences their health and well-being. It also contributes to the social environment in which humans interact, with cascading impacts to the health and behaviors of others. During social interactions, our understanding and awareness of vital nonverbal messages expressing beliefs, emotions, and intentions can be obstructed by a variety of factors including greatly flawed self-awareness. For these reasons, human behavior is a very important topic to study using the most advanced technology. Moreover, technology offers a breakthrough opportunity to improve people's social awareness and self-awareness through machine-enhanced recognition and interpretation of human behaviors. This paper reviews (1) the social psychology theories that have established the framework to study human behaviors and their manifestations during social interactions and (2) the technologies that have contributed to the monitoring of human behaviors. State-of-the-art in sensors, signal features, and computational models are categorized, summarized, and evaluated from a comprehensive transdisciplinary perspective. This review focuses on assessing technologies most suitable for real-time monitoring while highlighting their challenges and opportunities in near-future applications. Although social behavior monitoring has been highly reported in psychology and engineering literature, this paper uniquely aims to serve as a disciplinary convergence bridge and a guide for engineers capable of bringing new technologies to bear against the current challenges in real-time human behavior monitoring.

Online Human Interaction Detection and Recognition With Multiple Cameras

We address the problem of detecting and recognizing online the occurrence of human interactions as seen by a network of multiple cameras. We represent interactions by forming temporal trajectories, coupling together the body motion of each individual and their proximity relationships with others, and also sound whenever available. Such trajectories are modeled with kernel state-space (KSS) models. Their advantage is being suitable for the online interaction detection, recognition, and also for fusing information from multiple cameras, while enabling a fast implementation based on online recursive updates. For recognition, in order to compare interaction trajectories in the space of KSS models, we design so-called pairwise kernels with a special symmetry. For detection, we exploit the geometry of linear operators in Hilbert space, and extend to KSS models the concept of parity space, originally defined for linear models. For fusion, we combine KSS models with kernel construction and multiview learning techniques. We extensively evaluate the approach on four single view publicly available data sets, and we also introduce, and will make public, a new challenging human interactions data set that we have collected using a network of three cameras. The results show that the approach holds promise to become an effective building block for the analysis of real-time human behavior from multiple cameras.