Abnormal Behavior Recognition Research Articles

A lightweight and explainable model for driver abnormal behavior recognition

With the advancement of intelligent transportation systems, accurate identification of driver abnormal behavior is crucial for enhancing road safety. However, the limited computing power of vehicular systems poses a challenge for running efficient and explainable behavior recognition models. This paper proposes a lightweight and explainable driver abnormal behavior recognition model based on an improved You Only Look Once version 8 (YOLOv8). Firstly, a Spatial and Channel Reconstruction Convolution (SCConv) module is introduced to optimize the Convolution to Feature (C2f) structure, enhancing the model's feature extraction capabilities while reducing parameter redundancy. Secondly, a Spatial Pyramid Pooling with Fast Large Separable Kernel Attention (SPPF-LSKA) module is designed to better capture image context and integrate global information. Additionally, a Dynamic upsample (Dysample) module is introduced to improve the model's ability to capture subtle driver movements. Lastly, a Lightweight Shared Group Normalization Convolution Detection Head (LSGCDH) is designed to enhance the model's generalization ability, significantly reducing the model's computational load, parameter count, and size. Experimental results demonstrate that our approach has significant advantages for edge device deployment compared to mainstream algorithms. The visualization results effectively corroborate the role of each improved structure, enhancing the explainability of the abnormal behavior recognition model, which is beneficial for deployment in vehicular systems and contributes to improving road traffic safety.

A Review of Abnormal Crowd Behavior Recognition Technology Based on Computer Vision

Abnormal crowd behavior recognition is one of the research hotspots in computer vision. Its goal is to use computer vision technology and abnormal behavior detection models to accurately perceive, predict, and intervene in potential abnormal behaviors of the crowd and monitor the status of the crowd system in public places in real time, to effectively prevent and deal with public security risks and ensure public life safety and social order. To this end, focusing on the abnormal crowd behavior recognition technology in the computer vision system, a systematic review study of its theory and cutting-edge technology is conducted. First, the crowd level and abnormal behaviors in public places are defined, and the challenges faced by abnormal crowd behavior recognition are expounded. Then, from the dimensions based on traditional methods and based on deep learning, the mainstream technologies of abnormal behavior recognition are discussed, and the design ideas, advantages, and limitations of various methods are analyzed. Next, the mainstream software tools are introduced to provide a comprehensive reference for the technical framework. Secondly, typical abnormal behavior datasets at home and abroad are sorted out, and the characteristics of these datasets are compared in detail from multiple perspectives such as scale, characteristics, and uses, and the performance indicators of different algorithms on the datasets are compared and analyzed. Finally, the full text is summarized and the future development direction of abnormal crowd behavior recognition technology is prospected.

Improved identification of network anomalies through optimal CURE clustering

Abstract In this paper, we propose an advanced network anomaly behavior identification framework to overcome the constraints inherent in conventional rule- or signature-based approaches, which often struggle with emerging and previously unknown threats. Central to our framework is an Enhanced CURE (Cluster Updating and REfining) clustering algorithm, meticulously tailored and refined to incorporate a density-based methodology. This enhancement enables the algorithm to discern subtle shifts in network anomaly patterns with heightened precision. The implementation workflow commences with the application of the optimized CURE algorithm to analyze network data, followed by the deployment of a sophisticated anomaly degree ranking mechanism. This mechanism, through meticulous calculation of individual data points' anomaly degrees and subsequent ranking, effectively isolates those deviating significantly from standard behavioral norms, incorporating a strategic threshold to filter out false positives. To validate our methodology's efficacy and its superiority over existing techniques, experiments were conducted utilizing a substantial real-world network dataset. These tests affirm not only a marked increase in the accuracy of abnormal behavior recognition and a reduction in computational intricacy but also demonstrate the adaptability across diverse network ecosystems. Our approach has proven successful in pinpointing a wide array of network anomalies, encompassing malicious cyberattacks, fraudulent activities, unauthorized intrusions, and breaches of security protocols, thereby highlighting its comprehensive capability in bolstering network defense strategies. Despite the notable advancements and successful identification of various network anomalies, our framework currently lacks integration with real-time learning capabilities, limiting its immediate responsiveness to rapidly evolving attack patterns and necessitating ongoing research for dynamic updates and adaptive learning mechanisms.

Temporally enhanced abnormal behavior detection based on multi-channel coupling

Abnormal behavior detection in surveillance videos based on deep learning has becomea hot topic in current research. However, due to the complexity and variability of crowd movement and external environment, detecting abnormal behavior faces great challenges. Current abnormal behavior recognition models have limitations in feature extraction and pay insufficient attention to dynamic temporal features. To address these problems, a spatiotemporal enhancement anomaly detection method based on multi-channel coupling is proposed. Based on the SlowFast network, a multi-channel coupled temporal enhancement module and a spatial enhancement module are introduced respectively to extract more discriminative static and dynamic feature information. A large number of experiments are carried out on three benchmark datasets (Violent Flow, Hockey Fight, and Real-life Violence Situations). The results show that the prediction accuracy of the proposed abnormal behavior recognition method reaches 95.3%、97.3%and respectively 94%, thus verifying the effectiveness of the method.

An intelligent recognition method of factory personnel behavior based on deep learning

The real-time and accurate recognition of abnormal behavior among factory personnel helps enhance their awareness of hazardous environments, thereby reducing the occurrence of accidents. This paper proposes a behavior recognition network based on an attention mechanism and a high-efficiency convolution module. The Bi-Level Routing Attention was introduced to the backbone network, thus enhancing the attention of the recognition network to the target region effectively. The recognition accuracy was further strengthened by improving the neck network based on the ConvNeXt Block module while reducing the model complexity. Thirteen additional recognition models were constructed to enhance the original network from various perspectives. Subsequently, the mean average precision and detection speed of each model were evaluated. Experimental results demonstrated that the detection accuracy of the target recognition network proposed in this paper has been significantly improved, the detection speed meets the real-time requirements, and the comprehensive performance is the most superior compared with other diverse and improved networks. The proposed recognition model can accurately identify a variety of factory personnel's abnormal behaviors in real-time, and it has practical application significance for the problem of personnel safety identification in the factory.

XFMP: A Benchmark for Explainable Fine-Grained Abnormal Behavior Recognition on Medical Personal Protective Equipment

XFMP: A Benchmark for Explainable Fine-Grained Abnormal Behavior Recognition on Medical Personal Protective Equipment

Survey on machine vision-based intelligent water quality monitoring techniques in water treatment plant: Fish activity behavior recognition-based schemes and applications

Abstract Water is a vital resource essential to the survival and development of all creatures. With the rapid growth of industry and agriculture, people face a severe threat of ecological destruction and environmental pollution while living earthly lives. Water pollution, in particular, harms people’s health the most. As a result, water supply security has become a top priority. As a critical point in water supply safety, monitoring water quality effectively and forecasting sudden water contamination on time has become a research hotspot worldwide. With the rapid development and wide applications of artificial intelligence and computer vision technologies, biological activity identification-based intelligent water quality monitoring methods have drawn widespread attention. They were taking fish activities as the water-quality indicator has gained extensive attention by introducing advanced computer vision and artificial intelligence technologies with low cost and ease of carrying. This article comprehensively reviews recent progress in the research and applications of machine vision-based intelligent water quality monitoring and early warning techniques based on fish activity behavior recognition. In detail, it addresses water quality-oriented fish detection and tracking, activity recognition, and abnormal behavior recognition-based intelligent water quality monitoring. It analyzes and compares the performance and their favorite application conditions. Finally, it summarizes and discusses the difficulties and hotspots of water quality monitoring based on the fish’s abnormal behavior recognition and their future development trends.

ABNet: AI-Empowered Abnormal Action Recognition Method for Laboratory Mouse Behavior.

The automatic recognition and quantitative analysis of abnormal behavior in mice play a crucial role in behavioral observation experiments in neuroscience, pharmacology, and toxicology. Due to the challenging definition of abnormal behavior and difficulty in collecting training samples, directly applying behavior recognition methods to identify abnormal behavior is often infeasible. This paper proposes ABNet, an AI-empowered abnormal action recognition approach for mice. ABNet utilizes an enhanced Spatio-Temporal Graph Convolutional Network (ST-GCN) as an encoder; ST-GCN combines graph convolution and temporal convolution to efficiently capture and analyze spatio-temporal dynamic features in graph-structured data, making it suitable for complex tasks such as action recognition and traffic prediction. ABNet trains the encoding network with normal behavior samples, then employs unsupervised clustering to identify abnormal behavior in mice. Compared to the original ST-GCN network, the method significantly enhances the capabilities of feature extraction and encoding. We conduct comprehensive experiments on the Kinetics-Skeleton dataset and the mouse behavior dataset to evaluate and validate the performance of ABNet in behavior recognition and abnormal motion detection. In the behavior recognition experiments conducted on the Kinetics-Skeleton dataset, ABNet achieves an accuracy of 32.7% for the top one and 55.2% for the top five. Moreover, in the abnormal behavior analysis experiments conducted on the mouse behavior dataset, ABNet achieves an average accuracy of 83.1%.

SSRLM: A self-supervised representation learning method for identifying one ship with multi-MMSI codes

It is of great practical significance for maritime safety and shipping development to achieve “One Ship with One Maritime Mobile Service Identity (MMSI) Code” in accordance with regulations. However, the current “One Ship with Multiple MMSI Codes” violation identification method lacks practicability and generalization. Aiming at the these problems, this paper proposes a self-supervised representation learning model for the “One Ship with Multiple MMSI Codes” abnormal behavior recognition task, named SSRLM. Firstly, we construct a new dataset about “One Ship with Multiple MMSI Codes”, named HN_MulMI. Secondly, the SSRLM model learns the contextual interdependencies among different trajectory features in the HN_MulMI dataset through an unsupervised pre-training scheme, and extracts a dense vectorial representation of the ship’s motion trajectories. Finally, by using the unique characteristics of the “One Ship with Multiple MMSI Codes” trajectory sequence, the SSRLM model captures its feature dependencies through a fine-tuning scheme to accomplish the abnormal behavior detection task. Experimental results in the two scenarios of HN_MulMI test set demonstrate that the proposed model outperform the state-of-the-art models in recent years, the average precision, recall and F1-score rates is up to about 99.26% and 93.5%. Meanwhile, we also conducted comparative experiments on three public datasets to verify the generalization performance, achieving 90.31%, 93.2% and 95.14% results in the F1 score evaluation indicators, further confirming the good recognition performance of the SSLLM model. Finally, our model has been applied to the actual scene and achieved good results.

The use of convolutional neural networks for abnormal behavior recognition in crowd scenes

This study introduces the Abnormality Converging Scene Analysis Method (ACSAM) to detect abnormal group behavior using monitored videos or CCTV images in crowded scenarios. Abnormal behavior recognition involves classifying activities and gestures in continuous scenes, which traditionally presents significant computational challenges, particularly in complex crowd scenes, leading to reduced recognition accuracy. To address these issues, ACSAM employs a convolutional neural network (CNN) enhanced with Abnormality and Crowd Behavior Training layers to accurately detect and classify abnormal activities, regardless of crowd density. The method involves extracting frames from the input scene and using CNN to perform conditional validation of abnormality factors, comparing current values with previous high values to maximize detection accuracy. As the abnormality factor increases, the identification rate improves with higher training iterations. The system was tested on 26 video samples and trained on 34 samples, demonstrating superior performance to other approaches like DeepROD, MSI-CNN, and PT-2DCNN. Specifically, ACSAM achieved a 12.55% improvement in accuracy, a 12.97% increase in recall, and a 10.23% enhancement in convergence rate. These results suggest that ACSAM effectively overcomes the computational challenges inherent in crowd scene detection, offering a robust solution for real-time abnormal behavior recognition in crowded environments.

Research into the Applications of a Multi-Scale Feature Fusion Model in the Recognition of Abnormal Human Behavior.

Due to the increasing severity of aging populations in modern society, the accurate and timely identification of, and responses to, sudden abnormal behaviors of the elderly have become an urgent and important issue. In the current research on computer vision-based abnormal behavior recognition, most algorithms have shown poor generalization and recognition abilities in practical applications, as well as issues with recognizing single actions. To address these problems, an MSCS-DenseNet-LSTM model based on a multi-scale attention mechanism is proposed. This model integrates the MSCS (Multi-Scale Convolutional Structure) module into the initial convolutional layer of the DenseNet model to form a multi-scale convolution structure. It introduces the improved Inception X module into the Dense Block to form an Inception Dense structure, and gradually performs feature fusion through each Dense Block module. The CBAM attention mechanism module is added to the dual-layer LSTM to enhance the model's generalization ability while ensuring the accurate recognition of abnormal actions. Furthermore, to address the issue of single-action abnormal behavior datasets, the RGB image dataset RIDS (RGB image dataset) and the contour image dataset CIDS (contour image dataset) containing various abnormal behaviors were constructed. The experimental results validate that the proposed MSCS-DenseNet-LSTM model achieved an accuracy, sensitivity, and specificity of 98.80%, 98.75%, and 98.82% on the two datasets, and 98.30%, 98.28%, and 98.38%, respectively.

Abnormal Behavior Recognition Based on 3D Dense Connections.

Abnormal behavior recognition is an important technology used to detect and identify activities or events that deviate from normal behavior patterns. It has wide applications in various fields such as network security, financial fraud detection, and video surveillance. In recent years, Deep Convolution Networks (ConvNets) have been widely applied in abnormal behavior recognition algorithms and have achieved significant results. However, existing abnormal behavior detection algorithms mainly focus on improving the accuracy of the algorithms and have not explored the real-time nature of abnormal behavior recognition. This is crucial to quickly identify abnormal behavior in public places and improve urban public safety. Therefore, this paper proposes an abnormal behavior recognition algorithm based on three-dimensional (3D) dense connections. The proposed algorithm uses a multi-instance learning strategy to classify various types of abnormal behaviors, and employs dense connection modules and soft-threshold attention mechanisms to reduce the model's parameter count and enhance network computational efficiency. Finally, redundant information in the sequence is reduced by attention allocation to mitigate its negative impact on recognition results. Experimental verification shows that our method achieves a recognition accuracy of 95.61% on the UCF-crime dataset. Comparative experiments demonstrate that our model has strong performance in terms of recognition accuracy and speed.

A Cross-Domain Abnormal Behavior Recognition Model and Application Based on Transfer Learning

A Cross-Domain Abnormal Behavior Recognition Model and Application Based on Transfer Learning

Video Abnormal Behavior Recognition and Trajectory Prediction Based on Lightweight Skeleton Feature Extraction.

Video action recognition based on skeleton nodes is a highlighted issue in the computer vision field. In real application scenarios, the large number of skeleton nodes and behavior occlusion problems between individuals seriously affect recognition speed and accuracy. Therefore, we proposed a lightweight multi-stream feature cross-fusion (L-MSFCF) model to recognize abnormal behaviors such as fighting, vicious kicking, climbing over the wall, et al., which could obviously improve recognition speed based on lightweight skeleton node calculation, and improve recognition accuracy based on occluded skeleton node prediction analysis in order to effectively solve the behavior occlusion problem. The experiments show that our proposed All-MSFCF model has a video action recognition average accuracy rate of 92.7% for eight kinds of abnormal behavior recognition. Although our proposed lightweight L-MSFCF model has an 87.3% average accuracy rate, its average recognition speed is 62.7% higher than the full-skeleton recognition model, which is more suitable for solving real-time tracing problems. Moreover, our proposed Trajectory Prediction Tracking (TPT) model could real-time predict the moving positions based on the dynamically selected core skeleton node calculation, especially for the short-term prediction within 15 frames and 30 frames that have lower average loss errors.

Implanted potential sensing separator enables smart battery internal state monitor and safety alert

The current battery management system is limited to testing external characteristics, leaving the battery's internal status as a “black box”. Advanced characterization techniques and battery sensing technologies are needed to assess the battery's internal state. However, due to their short lifespan, low sensitivity, invasive nature, and high cost, these technologies face challenges in practical applications and commercialization. Here, we propose a smart battery implanted with a potential sensor for in-situ measurement of anode potential, enabling the recognition of severe side reactions and abnormal Li plating behavior. Specifically, the potential sensing material is directly integrated into the battery separator, which provides a reliable potential reference and serves as a sensing terminal. The porous structure of the separator facilitates lithium-ion transport while simultaneously enabling high-accuracy monitoring with non-destructive implantation. Additionally, the potential sensing separator can detect pre-existing or latent defects in the battery at an early stage, which are difficult to discern from the battery's external characteristics in a timely manner. Furthermore, we have developed a multi-point potential sensor monitoring system that can not only monitor the distribution of anode potential but also pinpoint the location of battery defects.

An algorithm for abnormal behavior recognition based on sharing human target tracking features

An algorithm for abnormal behavior recognition based on sharing human target tracking features

Design of Nanny's Abnormal Behavior Recognition Bracelet Based on Human Activity Recognition(HAR) Deep Learning Model

Design of Nanny's Abnormal Behavior Recognition Bracelet Based on Human Activity Recognition(HAR) Deep Learning Model

An effective framework of human abnormal behaviour recognition and tracking using multiscale dilated assisted residual attention network

The prevention of certain unwanted crime events and eliminating them even before their execution can be done by automatic identification of abnormal behavior in humans. Hence automatic prediction of abnormal human behavior is a difficult task to perform. Some of the automated model has been implemented and provided the most promising results. The manual intervention is being the greatest approach in earlier time, yet it brings with numerous errors, consumes more time and more cost effective. Henceforth, the automated model is suggested for identifying the activities. As the scholar focus on machine and deep learning, this classifier may extract the hand-crafted features. But it fails to yield the appropriate solution for finding the activities. Since it belongs to the video frames, the object detection is highly Ineffective feature vector and inadequate scale measures of the learning model paves the way for performance degradation. This issue can be resolved by including an attention mechanism in the deep learning model for both monitoring and classification purposes. The recommended Human Abnormal Behavior Recognition and Tracking (HABRT) model performs the following operations, such as the collection of video, categorizing the behavior in the video as normal or abnormal, monitoring, extraction of the object, and classification of the abnormality. The input video with such frames is initially gathered from publically available databases. By using these frames, the abnormal behavior classification is done by Multiscale Dilated assisted Residual Attention Network (MD-RAN), For further enhancement, the hyper-parameters in the MD-RAN are optimally selected by novel Modified Random Parameter-based Chimp Optimization Algorithm (MRP-ChOA). Once the abnormal frames are obtained, the activity tracking is achieved by Adaptively Modified You Only Look Once (YOLO) V3 (AM-YOLO V3). This model encompasses with multiple layers, so that utilized number of layers are determined optimally using MRP-ChOA. Consequently, the objects are extracted from the abnormal frames with the help of AM-YOLO V3. Finally, the abnormalities are classified by using the same MD-RAN. At last, the performance is analyzed and validated with diverse parameters, which are then compared with other algorithms. While implementing the dataset 1, the accuracy value attains maximum in contrast with 3.14% of DTCN, 2.308% of CNN-RNN and 13.7% of ResAttenConvLSTM, correspondingly. Thus, the findings reveal that it has the potential to deliver extensive results for abnormal recognition and tracking.

Deep Unsupervised Transfer Adversarial Network for Abnormal Driving Behavior Recognition Based on Smartphone Sensors

Deep Unsupervised Transfer Adversarial Network for Abnormal Driving Behavior Recognition Based on Smartphone Sensors

HCMT: A Novel Hierarchical Cross-Modal Transformer for Recognition of Abnormal Behavior

HCMT: A Novel Hierarchical Cross-Modal Transformer for Recognition of Abnormal Behavior