Static Object Detection Research Articles

PBDB-T/Pentacene-Based Organic Optoelectronic Synaptic Transistor with Adjustable Critical Flicker Fusion Frequency for Dynamic Vision.

In the era of the Internet of Things and the rapid progress of artificial intelligence, there is a growing demand for advanced dynamic vision systems. Vision systems are no longer confined to static object detection and recognition, as the detection and recognition of moving objects are becoming increasingly important. To meet the requirements for more precise and efficient dynamic vision, the development of adaptive multimodal motion detection devices becomes imperative. Inspired by the varied response rates in biological vision, we introduce the concept of critical flicker fusion frequency (cFFF) and develop an organic optoelectronic synaptic transistor with adjustable cFFF. In situ Kelvin probe force microscopy analysis reveals that light signal recognition in this device originates from charge transfer in the poly[(2,6-(4,8-bis(5-(2-ethylhexyl)thiophen-2-yl)benzo[1,2-b:4,5-b']dithiophene)-co-(1,3-di(5-thiophene-2-yl)-5,7-bis(2-ethylhexyl)-benzo[1,2-c:4,5-c']dithiophene-4,8-dione)] (PBDB-T)/pentacene heterojunction, which can be effectively modulated by gate voltage. Building upon this, we implement different cFFF within a single device to facilitate the detection and recognition of objects moving at different speeds. This approach allows for resource allocation during dynamic detection, resulting in a reduction in power consumption. Our research holds great potential for enhancing the capabilities of dynamic visual systems.

Static object detection for video surveillance

Static object detection for video surveillance

적대적 생성 신경망을 사용한 유기 행동 검출

Abandoned luggage items in public areas will be a potential threat caused by bombs or biological warfare. We present a method for real-time automatic detection of abandoned luggage in video captured by surveillance cameras. Most works for abandoned objects detection use a preliminary step to detect foreground regions or objects, and use various techniques including deep learning to distinguish between abandoned luggage items and other objects. These object detection-based methods require direct learning of characteristics of different types of objects. However, it is difficult to detect a new type of unlearned object, and there is insufficient detection of the instantaneous situation in which an object is abandoned. In order to solve these problems, we propose reconstruction-based anomaly detection to identify unusual patterns that do not conform to expected behavior such as abandoning objects. The approach is comprised of two stages - first, static object detection based on YOLOv4 and second, abandoned luggage recognition based on anomaly detection using Ganerative Advesarial Networks (GAN). We demonstrate the proposed GAN-based anomaly detection for abandonment behavior by performing experiments on Abnormal Event CCTV Video Dataset.

Moving Object Segmentation Using Level Set Algorithm with GWO-KFCM Clustering

Video analytics is widely used to automatically analyze the videos to extract the required information and detect the various events object identification and traffic analysis. The segmentation of the image is referring to extracting the required region from an image. The major objective of the segmentation process is to cluster the images without being affected by the noises. The detection of the moving objects is a challenging task in video analysis due to the dynamic background of the video. The major drawback of the existing Kernel Fuzzy C-Means (KFCM) clustering is initialization of random centroids which increases the execution time to identify the segmented portions. In this research, the Grey Wolf Optimization (GWO) algorithm used to initialize the centroids of required clusters in KFCM and Level Set (LS) Algorithm is used to segment the objects in video sequence. The proposed KFCM-GWO-LS is implemented for moving and static object detection in the videos obtained from SBM-RGBD dataset. For object detection, determining central clusters are important which is performed by using KFCM. GWO helps in finding the best centroids clusters by matching with KFCM. The centroids clusters are segmented by using LS algorithm which undergoes over segmentation problem that is overcome by GWO. As all the three techniques are dependent on one another hybrid of all these techniques obtains better results. The proposed KFCM-GWO-LS is evaluated in terms of Recall, Specificity, Precision and F-measure and the experimental results showed that the proposed method improved the system performance from 0.3 % to 14.35 % compared to existing methods Multi-Sensor Scheduler Algorithm and Statistical Inference Theory model.

Robot perception of static and dynamic objects with an autonomous floor scrubber

This paper presents the perception system of a new professional cleaning robot for large public places. The proposed system is based on multiple sensors including 3D and 2D lidars, two RGB-D cameras and a stereo camera. The two lidars together with an RGB-D camera are used for dynamic object (human) detection and tracking, while the second RGB-D and stereo camera are used for detection of static objects (dirt and ground objects). A learning and reasoning module for spatial–temporal representation of the environment based on the perception pipeline is also introduced. Furthermore, a new dataset collected with the robot in several public places, including a supermarket, a warehouse and an airport, is released. Baseline results on this dataset for further research and comparison are provided. The proposed system has been fully implemented into the Robot Operating System (ROS) with high modularity, also publicly available to the community.

Dynamic and static object detection and tracking in an autonomous surface vehicle

ABSTRACT One of the main challenges that faces the monitoring of maritime structures and ports is related to constantly changing weather and surrounding conditions. These conditions make manual actions very expensive, unreliable and imprecise. To overcome these problems, using Autonomous Surface Vehicles (ASV) is the best option. In this research, as part of a research project, a stereo vision system was implemented on an ASV to detect and track static and dynamic obstacles. In order to examine the proposed algorithm, two sets of experiments have been designed; first, the ASV moves toward stationary objects to localise all static and dynamic objects. Second, the ASV tracks a target boat, which equipped with an RTK-GPS and estimates relative and absolute positions. The accuracy of the tracking algorithm was evaluated in the digital elevation map, with the lowest RMSE of 1.575, and 0.6621 (m) using raw and EKF data, respectively.

Detection of static objects in an image using texture analysis

Abstract The article deals with the design of a method for the automatic detection of static objects in the image captured by an optical microscope. The search algorithm for static objects in the image - non-moving cilia is based on texture description methods. The texture of the image is described by statistical values, where it can be noticed that background texture, cells and cilia have different mathematical statistical parameters. Just based on the different statistical parameters of the textures, the classification for each texture parameter was done separately. As a result, the resulting classification takes into account the most predominant group to which the pixel has been assigned. The output from the algorithm is a mask, where the original image is overlayed by the obtained mask and cilia area is contoured.

Abandoned Object Detection in Video-Surveillance: Survey and Comparison.

During the last few years, abandoned object detection has emerged as a hot topic in the video-surveillance community. As a consequence, a myriad of systems has been proposed for automatic monitoring of public and private places, while addressing several challenges affecting detection performance. Due to the complexity of these systems, researchers often address independently the different analysis stages such as foreground segmentation, stationary object detection, and abandonment validation. Despite the improvements achieved for each stage, the advances are rarely applied to the full pipeline, and therefore, the impact of each stage of improvement on the overall system performance has not been studied. In this paper, we formalize the framework employed by systems for abandoned object detection and provide an extensive review of state-of-the-art approaches for each stage. We also build a multi-configuration system allowing one to select a range of alternatives for each stage with the objective of determining the combination achieving the best performance. This multi-configuration is made available online to the research community. We perform an extensive evaluation by gathering a heterogeneous dataset from existing data. Such a dataset allows considering multiple and different scenarios, whereas presenting various challenges such as illumination changes, shadows, and a high density of moving objects, unlike existing literature focusing on a few sequences. The experimental results identify the most effective configurations and highlight design choices favoring robustness to errors. Moreover, we validated such an optimal configuration on additional datasets not previously considered. We conclude the paper by discussing open research challenges arising from the experimental comparison.

Abandoned or removed object detection from visual surveillance: a review

Intelligent Visual Surveillance is an important and challenging research field of image processing and computer vision. To prevent the ecological and economical losses from bomb blasting, an intelligent visual surveillance is required to keep an eye on public areas, infrastructures and discriminate an unattended object left among multiple objects at public places. An unattended object without its owner since a long time at public place is considered as an abandoned object. Identification of an abandoned object on real-time can prevent the terrorists attack through an automated video surveillance system. In recent decade, a good number of publications have been presented in the field of intelligent visual surveillance to identify the abandoned or removed objects. Furthermore, few surveys can be seen in the literature for the various human activity recognition but none of them focused deeply on abandoned or removed object detection in a review. In this paper, we present the state-of-the-art which demonstrates the overall progress of abandoned or removed object detection from the surveillance videos in the last decade. We include a brief introduction of the abandoned object detection with its issues and challenges. To acknowledge to the new researchers of this field, core technologies, and frequently used general steps to recognize abandoned or removed objects have been discussed in the literature such as foreground extraction, static object detection based on non-tracking or tracking approaches, feature extraction, classification and activity analysis to recognize abandoned object. The objective of this paper is to provide the literature review in the field of abandoned or removed object recognition from visual surveillance systems with its general framework to the researchers of this field.

Neuromorphic vision chips

The paper reviews the progress of neuromorphic vision chip research in decades. It focuses on two kinds of the neuromorphic vision chips: frame-driven (FD) and event-driven (ED) vision chips. The FD and ED vision chips are very different from each other in system architecture, image sensing, image information coding, image processing algorithm, design methodology. The vision chips can overcome serial data transmission and processing bottlenecks in traditional image processing systems. They can perform the high speed image capture and real-time image processing operations. This paper selects two typical chips from the two kinds of vision chips, respectively, and introduces their architectures, image sensing schemes, image processing processors and system operation. The FD neuromorphic reconfigurable vision chip comprises a high speed image sensor, a processing element array and self-organizing map neural network. The FD vision chip has the advantages in image resolution, static object detection, time-multiplex image processing, and chip area. The ED neuromorphic vision chip system is based on address-event-representation image sensor and event-driven multi-kernel convolution network. The ED vision chip has the advantages in fast sensing, low communication bandwidth, brain-like processing, and high energy efficiency. Finally, this paper discusses the architecture and the challenges of the future neuromorphic vision chip and indicates that the reconfigurable vision chip with left- and right-brain functions integrated in the three dimensional (3D) large-scale integrated circuit (LSI) technology becomes a trend of the research on the vision chip.

Nonmyopic View Planning for Active Object Classification and Pose Estimation

One of the central problems in computer vision is the detection of semantically important objects and the estimation of their pose. Most of the work in object detection has been based on single image processing, and its performance is limited by occlusions and ambiguity in appearance and geometry. This paper proposes an active approach to object detection in which the point of view of a mobile depth camera is controlled. When an initial static detection phase identifies an object of interest, several hypotheses are made about its class and orientation. Then, a sequence of views, which balances the amount of energy used to move the sensor with the chance of identifying the correct hypothesis, is planned. We formulate an active hypothesis testing problem, which includes sensor mobility, and solve it using a point-based approximate partially observable Markov decision process algorithm. The validity of our approach is verified through simulation and realworld experiments with the PR2 robot. The results suggest that the approach outperforms the widely used greedy viewpoint selection and provides a significant improvement over static object detection.

Real-time Foreground Object Detection Combining the PBAS Background Modelling Algorithm and Feedback from Scene Analysis Module

Abstract The article presents a hardware implementation of the foreground object detection algorithm PBAS (Pixel-Based Adaptive Segmenter) with a scene analysis module. A mechanism for static object detection is proposed, which is based on consecutive frame differencing. The method allows to distinguish stopped foreground objects (e.g. a car at the intersection, abandoned luggage) from false detections (so-called ghosts) using edge similarity. The improved algorithm was compared with the original version on popular test sequences from the changedetection.net dataset. The obtained results indicate that the proposed approach allows to improve the performance of the method for sequences with the stopped objects. The algorithm has been implemented and successfully verified on a hardware platform with Virtex 7 FPGA device. The PBAS segmentation, consecutive frame differencing, Sobel edge detection and advanced one-pass connected component analysis modules were designed. The system is capable of processing 50 frames with a resolution of 720 × 576 pixels per second

Motion spatially facilitates the detection of static objects

Motion spatially facilitates the detection of static objects

A unified approach to background adaptation and initialization in public scenes

Foreground detection methods generally assume that backgrounds are observed more frequently than foregrounds are, but the assumption is not valid in public scenes. Viewing background adaptation in public scenes as a unified problem with background initialization and stationary object detection, we formulate it as an energy minimization problem in dynamic Markov random fields. Constraining the connections among the sites with spatiotemporal reliabilities, we robustly handle object-wise changes and efficiently minimize the energy terms with a coordinate descent method. Evaluated with realistic sequences from i-LIDS, PETS, ETISEO and changedetection.net datasets, the proposed method outperforms state-of-the-art methods and temporal parameter adjustment.

Static Object Detection Based on a Dual Background Model and a Finite-State Machine

Detecting static objects in video sequences has a high relevance in many surveillance applications, such as the detection of abandoned objects in public areas. In this paper, we present a system for the detection of static objects in crowded scenes. Based on the detection of two background models learning at different rates, pixels are classified with the help of a finite-state machine. The background is modelled by two mixtures of Gaussians with identical parameters except for the learning rate. The state machine provides the meaning for the interpretation of the results obtained from background subtraction; it can be implemented as a look-up table with negligible computational cost and it can be easily extended. Due to the definition of the states in the state machine, the system can be used either full automatically or interactively, making it extremely suitable for real-life surveillance applications. The system was successfully validated with several public datasets.

SPATIOTEMPORAL CONTEXT INTEGRATION IN ROBOT VISION

Robust vision in dynamic environments using limited processing power is one of the main challenges in robot vision. This is especially true in the case of biped humanoids that use low-end computers. Techniques such as active vision, context-based vision, and multi-resolution are currently in use to deal with these highly demanding requirements. Thus, having as main motivation the development of robust and high performing robot vision systems, which can operate in dynamic environments, with limited computational resources, we propose a spatiotemporal context integration framework that improves the perceptual capabilities of a given robot vision system. Furthermore, we try to link the vision, tracking, and self-localization problems using a context filter to improve the performance of all these parts together more than to improve them separately. This framework computes: (i) an estimation of the poses of visible and nonvisible objects using Kalman filters; (ii) the spatial coherence of each current detection with all other simultaneous detections and with all tracked objects; and (iii) the spatial coherence of each tracked object with all current detections. Using a Bayesian approach, we calculate the a-posteriori probabilities for each detected and tracked object, which is used in a filtering stage. We choose as a first application of this framework, the detection of static objects in the RoboCup Standard Platform League domain, where Nao humanoid robots are employed. The proposed system is validated in simulations and using real video sequences. In noisy environments, the system is able to decrease largely the number of false detections and to improve effectively the self-localization of the robot.

61st Annual Meeting of the American Academy of Neurology Seattle, Washington April 25-May 2, 2009

61st Annual Meeting of the American Academy of Neurology Seattle, Washington April 25-May 2, 2009

DETECTING GHOST AND LEFT OBJECTS IN SURVEILLANCE VIDEO

This paper proposes an efficient method for detecting ghost and left objects in surveillance video, which, if not identified, may lead to errors or wasted computational power in background modeling and object tracking in video surveillance systems. This method contains two main steps: the first one is to detect stationary objects, which narrows down the evaluation targets to a very small number of regions in the input image; the second step is to discriminate the candidates between ghost and left objects. For the first step, we introduce a novel stationary object detection method based on continuous object tracking and shape matching. For the second step, we propose a fast and robust inpainting method to differentiate between ghost and left objects by reconstructing the real background using the candidate's corresponding regions in the current input and background image. The effectiveness of our method has been validated by experiments over a variety of video sequences and comparisons with existing state-of-art methods.