Video Target Research Articles

Spatiotemporal Information, Near-Field Perception, and Service for Tourists by Distributed Camera and BeiDou Positioning System in Mountainous Scenic Areas

The collaborative use of camera near-field sensors for monitoring the number and status of tourists is a crucial aspect of smart scenic spot management. This paper proposes a near-field perception technical system that achieves dynamic and accurate detection of tourist targets in mountainous scenic areas, addressing the challenges of real-time passive perception and safety management of tourists. The technical framework involves the following steps: Firstly, real-time video stream signals are collected from multiple cameras to create a distributed perception network. Then, the YOLOX network model is enhanced with the CBAM module and ASFF method to improve the dynamic recognition of preliminary tourist targets in complex scenes. Additionally, the BYTE target dynamic tracking algorithm is employed to address the issue of target occlusion in mountainous scenic areas, thereby enhancing the accuracy of model detection. Finally, the video target monocular spatial positioning algorithm is utilized to determine the actual geographic location of tourists based on the image coordinates. The algorithm was deployed in the Tianmeng Scenic Area of Yimeng Mountain in Shandong Province, and the results demonstrate that this technical system effectively assists in accurately perceiving and spatially positioning tourists in mountainous scenic spots. The system demonstrates an overall accuracy in tourist perception of over 90%, with spatial positioning errors less than 1.0 m and a root mean square error (RMSE) of less than 1.14. This provides auxiliary technical support and effective data support for passive real-time dynamic precise perception and safety management of regional tourist targets in mountainous scenic areas with no/weak satellite navigation signals.

Construction of University Football Basic Teaching and Training System Based on Object Detection and Tracking Algorithm

Football, often referred to as soccer outside the UK and Europe, is a highly popular activity on many university campuses. As a result, football training programs are offered across many institutions, training students at a range of skill levels. Therefore, this paper investigates a deep learning (DL)-based algorithm for recognizing and tracking targets in sports training videos. The study specifically addresses those videos tailored to identifying small targets, by generating new multi-scale features and modifying anchor point generation rules. Experimental results demonstrate the algorithm's strong performance in tracking football targets. Compared to Histogram of Oriented Gradients, the DL-based model achieved a 29.58% increase in accuracy and a 39.68% decrease in error rates when recognizing football player movement features. This algorithm accurately locates the edge contours of a football player's movements, meaning that universities can, and should, actively reform football teaching and training to enhance teaching effectiveness by utilizing this powerful algorithm.

HRTracker: Multi-Object Tracking in Satellite Video Enhanced by High-Resolution Feature Fusion and an Adaptive Data Association

Multi-object tracking in satellite videos (SV-MOT) is an important task with many applications, such as traffic monitoring and disaster response. However, the widely studied multi-object tracking (MOT) approaches for general images can rarely be directly introduced into remote sensing scenarios. The main reasons for this can be attributed to the following: (1) the existing MOT approaches would cause a significant rate of missed detection of the small targets in satellite videos; (2) it is difficult for the general MOT approaches to generate complete trajectories in complex satellite scenarios. To address these problems, a novel SV-MOT approach enhanced by high-resolution feature fusion and a two-step association method is proposed. In the high-resolution detection network, a high-resolution feature fusion module is designed to assist detection by maintaining small object features in forward propagation. By utilizing features of different resolutions, the performance of the detection of small targets in satellite videos is improved. Through high-quality detection and the use of an adaptive Kalman filter, the densely packed weak objects can be effectively tracked by associating almost every detection box instead of only the high-score ones. The comprehensive experimental results using the representative satellite video datasets (VISO) demonstrate that the proposed HRTracker with the state-of-the-art (SOTA) methods can achieve competitive performance in terms of the tracking accuracy and the frequency of ID conversion, obtaining a tracking accuracy score of 74.6% and an ID F1 score of 78.9%.

A credibility scoring algorithm to match surveillance video targets and UWB tags

A credibility scoring algorithm to match surveillance video targets and UWB tags

Low-Quality Video Target Detection Based on EEG Signal Using Eye Movement Alignment.

The target detection based on electroencephalogram (EEG) signals is a new target detection method. This method recognizes the target by decoding the specific neural response when an operator observes the target, which has important theoretical and application values. This paper focuses on the EEG detection of low-quality video targets, which breaks through the limitation of previous target detection based on EEG signals only for high-quality video targets. We first design an experimental paradigm for EEG-based low-quality video target detection and propose an epoch extraction method based on eye movement signals to solve the asynchronous problem faced by low-quality video target detection. Then, the neural representation in the process of operator recognition is analyzed based on the time domain, frequency domain, and source space domain, respectively. We design the time-frequency features based on continuous wavelet transform according to the neural representation and obtain an average decoding test accuracy of 84.56%. The research results of this paper lay the foundation for the development of a video target detection system based on EEG signals in the future.

CenterADNet: Infrared Video Target Detection Based on Central Point Regression.

Infrared video target detection is a fundamental technology within infrared warning and tracking systems. In long-distance infrared remote sensing images, targets often manifest as circular spots or even single points. Due to the weak and similar characteristics of the target to the background noise, the intelligent detection of these targets is extremely complex. Existing deep learning-based methods are affected by the downsampling of image features by convolutional neural networks, causing the features of small targets to almost disappear. So, we propose a new infrared video weak-target detection network based on central point regression. We focus on suppressing the image background by fusing the different features between consecutive frames with the original image features to eliminate the background's influence. We also employ high-resolution feature preservation and incorporate a spatial-temporal attention module into the network to capture as many target features as possible and improve detection accuracy. Our method achieves superior results on the infrared image weak aircraft target detection dataset proposed by the National University of Defense Technology, as well as on the simulated dataset generated based on real-world observation. This demonstrates the efficiency of our approach for detecting weak point targets in infrared continuous images.

Detection-Free Object Tracking for Multiple Occluded Targets in Plenoptic Video

Multiple object tracking (MOT) is a fundamental task in vision, but MOT techniques for plenoptic video are scarce. Almost all 2D MOT algorithms that show high performance mostly use the detection-based method which has the disadvantage of operating only for a specific object. To enable tracking of arbitrary desired objects, this paper introduces a groundbreaking detection-free tracking method for MOT in plenoptic videos. The proposed method deviates from traditional detection-based tracking methods, emphasizing the challenges of tracking targets with occlusions. The paper presents specialized algorithms that exploit the multifocal information of plenoptic video, including the focal range restriction and dynamic focal range adjustment schemes to secure robustness for occluded object tracking. To the improvement of the spatial searching capability, the anchor ensemble and the dynamic change of spatial search region algorithms are also proposed. Additionally, in terms of MOT, to reduce the computation time involved, the motion-adaptive time scheduling technique is proposed, which improves computation speed while guaranteeing a certain level of accuracy. Experimental results show a significant improvement in tracking performance, with a 77% success rate based on intersection over union for occluded targets in plenoptic videos, marking a substantial advancement in the field of plenoptic object tracking.

Advancing the implementation of take-home naloxone by community pharmacists: Testing the role of COM-B.

Opioid-related overdose fatalities are rising despite the increased accessibility of take-home naloxone (THN). Targeted implementation strategies are needed to improve the distribution of naloxone. This study investigates the effectiveness of a short video targeting pharmacists that addresses implementation barriers. A pre-post, mixed methods design was adopted to examine the effect of a brief behaviour change intervention (an educational video informed by the capability, opportunity, motivation affecting behaviour (COM-B) model), on factors affecting pharmacists' implementation of THN in Western Australia. Paired samples t-tests for were used to investigate intentions, knowledge, skill, confidence, feasibility, appropriateness, acceptability, attitudes, anticipated patient reactions, social support and implementation climate. Structural equation modelling examined the associations between constructs and to test the proposed mediation of motivation on capability and opportunity affecting intentions to discuss and provide THN. We analysed data from 102 participants. At follow-up and after all participants had viewed the video, participants had significantly improved intentions, skill, confidence, anticipated reactions, social support and perceptions that THN implementation was feasible, appropriate and acceptable. No significant differences were seen for attitudes, knowledge or implementation climate. The proposed mediation effect of motivation on the associations between opportunity and intentions and capability and intentions was not supported. A short video directly targeting identified implementation barriers has the ability to improve key influences in the provision of THN. Dissemination of information to community pharmacists is a challenge. Implementation strategies addressing knowledge and targeting other levels of influence on intentions and behaviour are required.

A Video Target Re-Recognition Method Based on Adaptive Attention Enhancement and Multi-Scale Feature Fusion

A Video Target Re-Recognition Method Based on Adaptive Attention Enhancement and Multi-Scale Feature Fusion

Application of Multi-sensory interaction design Based on Machine Learning in Virtual Reality

Virtual reality (VR) technology is well-known to the public for its unparalleled sense of environmental immersion, which is accompanied by a large amount of human-computer interaction between users and objects in the virtual environment. Users transmit and obtain information through their senses, so the processing mechanism of information in various senses under the background of VR technology has become the foundation of research. In the process of natural information dissemination, users’ senses are synergistically involved, so whether there is a correlation between various senses that affects users’ final perception has become an important theoretical support for studying multi-sensory interaction. Facial expression recognition is an important component of multi-sensory interaction technology. Therefore, this article mainly uses machine learning algorithms to achieve real-time detection of facial targets in images or videos, as well as classification and recognition of facial expressions. To meet the task requirements of the expression recognition module, this article selects the DeepID network model based on deep learning in the field of facial recognition as the basic model for the expression recognition function. This study utilizes the excellent feature extraction ability of the original network for facial images and introduces residual modules and attention mechanisms, making the modified network model more suitable for facial expression multi classification recognition tasks. The recognition accuracy of the facial expression classification algorithm proposed by this work reaches 97.2%.

Sports Video Object Tracking Algorithm Based on Optimized Particle Filter

INTRODUCTION: Particle filter based human motion video target tracking technology has become a trend. This project intends to apply particle filters to image processing of human activities. Firstly, an improved particle filter model is used to track moving video objects. The purpose is to further improve the tracking effect and increase the tracking accuracy. HSV distribution model was used to establish target observation model. The algorithm is combined with the weight reduction algorithm to realize the human motion trajectory detection in the target observation mode. The model was then confirmed by an examination of sports player videos. Experiments show that this method can be used to track people in moving images of sports. Compared with other methods, this method has higher computational accuracy and speed.

Single Object Tracking in Satellite Videos Based on Feature Enhancement and Multi-Level Matching Strategy

Despite significant advancements in remote sensing object tracking (RSOT) in recent years, achieving accurate and continuous tracking of tiny-sized targets remains a challenging task due to similar object interference and other related issues. In this paper, from the perspective of feature enhancement and a better feature matching strategy, we present a tracker SiamTM specifically designed for RSOT, which is mainly based on a new target information enhancement (TIE) module and a multi-level matching strategy. First, we propose a TIE module to address the challenge of tiny object sizes in satellite videos. The proposed TIE module goes along two spatial directions to capture orientation and position-aware information, respectively, while capturing inter-channel information at the global 2D image level. The TIE module enables the network to extract discriminative features of the targets more effectively from satellite images. Furthermore, we introduce a multi-level matching (MM) module that is better suited for satellite video targets. The MM module firstly embeds the target feature map after ROI Align into each position of the search region feature map to obtain a preliminary response map. Subsequently, the preliminary response map and the template region feature map are subjected to the Depth-wise Cross Correlation operation to get a more refined response map. Through this coarse-to-fine approach, the tracker obtains a response map with a more accurate position, which lays a good foundation for the prediction operation of the subsequent sub-networks. We conducted extensive experiments on two large satellite video single-object tracking datasets: SatSOT and SV248S. Without bells and whistles, the proposed tracker SiamTM achieved competitive results on both datasets while running at real-time speed.

Retracted: Tennis Video Target Tracking Based on Mobile Network Communication and Machine Learning Algorithm

Retracted: Tennis Video Target Tracking Based on Mobile Network Communication and Machine Learning Algorithm

Transformer-Guided Video Inpainting Algorithm Based on Local Spatial-Temporal joint

INTRODUCTION: Video inpainting is a very important task in computer vision, and it’s a key component of various practical applications. It also plays an important role in video occlusion removal, traffic monitoring and old movie restoration technology. Video inpainting is to obtain reasonable content from the video sequence to fill the missing region, and maintain time continuity and spatial consistency.OBJECTIVES: In previous studies, due to the complexity of the scene of video inpainting, there are often cases of fast motion of objects in the video or motion of background objects, which will lead to optical flow failure. So the current video inpainting algorithm hasn’t met the requirements of practical applications. In order to avoid the problem of optical flow failure, this paper proposes a transformer-guided video inpainting model based on local Spatial-temporal joint.METHODS: First, considering the rich Spatial-temporal relationship between local flows, a Local Spatial-Temporal Joint Network (LSTN) including encoder, decoder and transformer module is designed to roughly inpaint the local corrupted frames, and the Deep Flow Network is used to calculate the local bidirectional corrupted flows. Then, the local corrupted optical flow map is input into the Local Flow Completion Network (LFCN) with pseudo 3D convolution and attention mechanism to obtain a complete set of bidirectional local optical flow maps. Finally, the roughly inpainted local frame and the complete bidirectional local optical flow map are sent to the Spatial-temporal transformer and the inpainted video frame is output.RESULTS: Experiments show that the algorithm achieves high quality results in the video target removal task, and has a certain improvement in indicators compared with advanced technologies.CONCLUSION: Transformer-Guided Video Inpainting Algorithm Based on Local Spatial-Temporal joint can obtain high-quality optical flow information and inpainted result video.

Retracted: Data Mining and Video Target Detection-Based Analysis of Martial Arts Cultural Communication and Martial Arts Athletes’ Posture

Retracted: Data Mining and Video Target Detection-Based Analysis of Martial Arts Cultural Communication and Martial Arts Athletes’ Posture

Convolutional neural network-based recognition method for volleyball movements

With the development of network technology and computer intelligent monitoring technology, a large number of video data came into being. In view of the analysis of specific targets in video, the traditional artificial analysis method can not meet the existing needs. In volleyball teaching in college physical education, because each student has different movements, intelligent processing of video data has become a key issue. Through collecting and sorting out the relevant research results on behavior recognition, it is found that in the research of deep learning, the algorithm structure applied in this paper is representative, and its strong learning ability, especially compared with the traditional algorithm, can more accurately identify human movements, natural language processing and so on, but the research on volleyball action recognition is still less. Therefore, this paper constructs a data set, improves the convolution neural network model, subsequently, new models are constructed through the neural network structure to improve the accuracy of the nonlinear expression and optimize the content of the input data. In order to more accurately analyze the effectiveness of this algorithm, the new data are obtained by grouping the volleyball games in college sports courses. Compared with the original paper, the accuracy of the improved 3D network is improved by 3.3%–88.5%, and the complexity is reduced by 33.6%.

Retracted: Soccer Player Video Target Tracking Based on Deep Learning

Retracted: Soccer Player Video Target Tracking Based on Deep Learning

Video Object Segmentation Using Multi-Scale Attention-Based Siamese Network

Video target segmentation is a fundamental problem in computer vision that aims to segment targets from a background by learning their appearance information and movement information. In this study, a video target segmentation network based on the Siamese structure was proposed. This network has two inputs: the current video frame, used as the main input, and the adjacent frame, used as the auxiliary input. The processing modules for the inputs use the same structure, optimization strategy, and encoder weights. The input is encoded to obtain features with different resolutions, from which good target appearance features can be obtained. After processing using the encoding layer, the motion features of the target are learned using a multi-scale feature fusion decoder based on an attention mechanism. The final predicted segmentation results were calculated from a layer of decoded features. The video object segmentation framework proposed in this study achieved optimal results on CDNet2014 and FBMS-3D, with scores of 78.36 and 86.71, respectively. It outperformed the second-ranked method by 4.3 on the CDNet2014 dataset and by 0.77 on the FBMS-3D dataset. Suboptimal results were achieved on the video primary target segmentation datasets SegTrackV2 and DAVIS2016, with scores of 60.57 and 81.08, respectively.

Evidence for bidirectional causation between trait and mental state inferences

To navigate the social world, people must understand each other's momentary thoughts and feelings (mental states) and enduring personalities (traits). How do people make trait and mental state inferences in the real world? Prior research has artificially separated these two processes, primarily studying each topic on its own. However, in real life, these two processes constantly co-occur and rely on partially overlapping information. It is likely that people inform one type of inferences with the other. Here we investigate this possibility using naturalistic paradigms, statistical learning, and stimulus optimization techniques. We first demonstrated the correlation between trait and mental state inferences of targets in naturalistic videos (Study 1) and familiar others in real life (Study 2). Targets perceived to have similar traits were judged to experience various mental states with similar frequencies. We showed that this association was causal in two experiments. Learning that two people experienced similar mental states across a range of situations caused participants to attribute similar traits to them (Study 3). Conversely, observing two people had similar traits caused participants to attribute similar mental states to them across a range of situations (Study 4). Together, these four preregistered studies (total N = 762) reveal that trait and mental state inferences continually run in parallel and that people rely on others' enduring traits to predict their momentary states, and vice versa. These findings highlight that biases in trait impressions may distort understanding of others' situation-specific states, and others' uncharacteristic states may influence judgments of their enduring traits.

Automatic detection method of small target in tennis game video based on deep learning

Due to the large number of frames and low video resolution, tennis match videos cannot accurately identify and extract effective data, which reduces the level of fine analysis of tennis matches. In order to solve the problem of poor detection effect of small targets in tennis video, an automatic detection method of small targets in tennis video based on deep learning is proposed. Non-maximum suppression algorithm is used to determine the position of the target between different adjacent video image sequences, and SVM classifier is used to train a large number of target behaviors. According to the hierarchical structure of dataset annotation, the hierarchical structure of tennis video for deep learning is optimized. The reconstruction algorithm is used to enhance the video image in the input VOC data set and improve the fine segmentation effect of the image. The difference video image is binarized to complete the automatic detection of small targets in tennis video. The experimental results show that the proposed method has high integrity of tennis video information collection, high recognition accuracy and short detection time.