Static Camera Research Articles

Active Visual Perception Enhancement Method Based on Deep Reinforcement Learning

Traditional object detection methods using static cameras are constrained by their limited perspectives, hampering the effective detection of low-confidence targets. To address this challenge, this study introduces a deep reinforcement learning-based visual perception enhancement technique. This approach leverages pan–tilt–zoom (PTZ) cameras to achieve active vision, enabling them to autonomously make decisions and actions tailored to the current scene and object detection outcomes. This optimization enhances both the object detection process and information acquisition, significantly boosting the intelligent perception capabilities of PTZ cameras. Experimental findings demonstrate the robust generalization capabilities of this method across various object detection algorithms, resulting in an average confidence level improvement of 23.80%.

AI Enhancement Automated Movement Detection

This paper introduces an innovative artificial intelligence (AI) method aimed at tackling the challenges associated with detecting and tracking moving objects in video surveillance systems. By utilizing self-organization through artificial neural networks, our approach effectively manages scenes with dynamic backgrounds and gradual changes in lighting, ensuring robust detection across different types of videos recorded by stationary cameras. In the realm of moving object detection, our method leverages the adaptability of neural networks, enabling precise detection in complex visual environments. For object tracking, we propose a combination of Kalman filtering techniques and a sophisticated matching model based on Multiple Hypothesis Testing, ensuring accurate and consistent tracking across frames. Through experimental validation using various color video sequences, we demonstrate the effectiveness and reliability of our approach, highlighting its potential to enhance the performance of surveillance systems in real-world scenarios.

An Ecological Approach to Dynamic and Static Camera Framing Techniques

Media practitioners and scholars have long pointed out that a camera’s angle, movement, and distance are a fundamental part of video communication, as they alter the message in meaningful ways that in turn affect the viewer’s experience. Drawing on J. J. Gibson’s ecological approach to perception, this paper argues that camera effects are not arbitrary, but are rooted in how video interplays with our perceptual and motor systems, rendering it a universally accessible mode of communication. Through a comprehensive review of empirical and experimental studies on camerawork, the ecological paradigm is proposed as a coherent framework capable of explaining seemingly unrelated camera effects, with great potential to drive future research in audiovisual communication.

Portable Head-Mounted System for Mobile Forearm Tracking.

Computer vision (CV)-based systems using cameras and recognition algorithms offer touchless, cost-effective, precise, and versatile hand tracking. These systems allow unrestricted, fluid, and natural movements without the constraints of wearable devices, gaining popularity in human-system interaction, virtual reality, and medical procedures. However, traditional CV-based systems, relying on stationary cameras, are not compatible with mobile applications and demand substantial computing power. To address these limitations, we propose a portable hand-tracking system utilizing the Leap Motion Controller 2 (LMC) mounted on the head and controlled by a single-board computer (SBC) powered by a compact power bank. The proposed system enhances portability, enabling users to interact freely with their surroundings. We present the system's design and conduct experimental tests to evaluate its robustness under variable lighting conditions, power consumption, CPU usage, temperature, and frame rate. This portable hand-tracking solution, which has minimal weight and runs independently of external power, proves suitable for mobile applications in daily life.

In-Hand 3D Object Reconstruction from a Monocular RGB Video

Our work aims to reconstruct a 3D object that is held and rotated by a hand in front of a static RGB camera. Previous methods that use implicit neural representations to recover the geometry of a generic hand-held object from multi-view images achieved compelling results in the visible part of the object. However, these methods falter in accurately capturing the shape within the hand-object contact region due to occlusion. In this paper, we propose a novel method that deals with surface reconstruction under occlusion by incorporating priors of 2D occlusion elucidation and physical contact constraints. For the former, we introduce an object amodal completion network to infer the 2D complete mask of objects under occlusion. To ensure the accuracy and view consistency of the predicted 2D amodal masks, we devise a joint optimization method for both amodal mask refinement and 3D reconstruction. For the latter, we impose penetration and attraction constraints on the local geometry in contact regions. We evaluate our approach on HO3D and HOD datasets and demonstrate that it outperforms the state-of-the-art methods in terms of reconstruction surface quality, with an improvement of 52% on HO3D and 20% on HOD. Project webpage: https://east-j.github.io/ihor.

Bootstrap geometric ground calibration method for wide angle star sensors.

Wide angle star sensors are becoming more prevalent in aeronautics. A wide angle lens provides a greater field of view for star detection, but consequently incurs significant lens distortion. The effects of distortion complicate star identification, causing algorithms to fail or report false identifications. We address the issue of calibrating a wide angle star sensor without any specialized equipment, by analyzing two time-separated images captured from a static camera. An initial estimate of the focal length is obtained by observing the displacement of stars between the images. The focal length is subsequently used to build an initial estimate of camera intrinsics, and to identify stars in the image. A RANSAC-augmented Kabsch algorithm is implemented to determine camera orientation, while simultaneously removing false identifications. The identified stars are used to provide a precise estimate of camera focal length, before applying non-linear optimization in a radial search algorithm. The methodology was tested on two cameras, demonstrating the effectiveness of this algorithm in achieving a precise geometric calibration using real hardware, without any specialized calibration equipment.

OPTIMAL TRAFFIC CONTROL SYSTEM FOR TRAFFIC CONGESTION

A smart city's traffic management system is regarded as one of its primary components. Traffic jams are a common sight on the roadways in metropolitan areas due to the rapid increase in population and urban mobility. In order to address road traffic management issues and assist authorities with appropriate planning, an intelligent traffic management system utilizing the Yolo algorithm and Open CV approach is proposed in this project. A workable model for counting automobiles in traffic was developed using image processing as the basis. image processing methods classified and tallied moving vehicles in traffic scene video streams captured by stationary cameras. The following is the detection and tracking methodology. The adaptive background subtraction technique is initially used to separate the moving vehicles from the traffic scene. Using videos to isolated picture blobs are recognized as individual vehicles once the background is subtracted. Following blob identification, vehicles in a certain area are counted and classified. A count of vehicles was observed with an accuracy of ideal camera calibration. To support the goal, data is gathered from video footage of vehicles traveling toward and away from the camera in order to count and use signal switching. The created system's results demonstrate that, with more enhancements, it applicable to count and categorize vehicles in real-time. After that, an optimization framework makes use of these predictions to dynamically modify signal timings in response to shifting traffic conditions. The optimization method seeks to increase overall traffic flow efficiency, decrease delays, and shorten travel times. To sum up, utilizing real-time traffic data to optimize signal control presents a viable approach to improving urban traffic management. This method makes use yolo techniques to facilitate the creation of flexible and effective traffic control, which in turn helps to create more sustainable and seamless urban transportation networks. KEYWORDS: Image classification, Video tracking, Information analysis, Vehicle detection, Signal Switching.

A Novel Framework for Image Matching and Stitching for Moving Car Inspection under Illumination Challenges.

Vehicle exterior inspection is a critical operation for identifying defects and ensuring the overall safety and integrity of vehicles. Visual-based inspection of moving objects, such as vehicles within dynamic environments abounding with reflections, presents significant challenges, especially when time and accuracy are of paramount importance. Conventional exterior inspections of vehicles require substantial labor, which is both costly and prone to errors. Recent advancements in deep learning have reduced labor work by enabling the use of segmentation algorithms for defect detection and description based on simple RGB camera acquisitions. Nonetheless, these processes struggle with issues of image orientation leading to difficulties in accurately differentiating between detected defects. This results in numerous false positives and additional labor effort. Estimating image poses enables precise localization of vehicle damages within a unified 3D reference system, following initial detections in the 2D imagery. A primary challenge in this field is the extraction of distinctive features and the establishment of accurate correspondences between them, a task that typical image matching techniques struggle to address for highly reflective moving objects. In this study, we introduce an innovative end-to-end pipeline tailored for efficient image matching and stitching, specifically addressing the challenges posed by moving objects in static uncalibrated camera setups. Extracting features from moving objects with strong reflections presents significant difficulties, beyond the capabilities of current image matching algorithms. To tackle this, we introduce a novel filtering scheme that can be applied to every image matching process, provided that the input features are sufficient. A critical aspect of this module involves the exclusion of points located in the background, effectively distinguishing them from points that pertain to the vehicle itself. This is essential for accurate feature extraction and subsequent analysis. Finally, we generate a high-quality image mosaic by employing a series of sequential stereo-rectified pairs.

Stereo vision based systems for sea-state measurement and floating structures monitoring

Using computer vision techniques such as stereo vision systems for sea state measurement or for offshore structures monitoring can improve the measurement fidelity and accuracy with no significant additional cost. In this paper, two experiments (in-lab/open-sea) are conducted to study the performance of stereo vision system to measure the water wave surface elevation and rigid body heaving motion. For the in-lab experiment, regular water waves are generated in a wave tank for different frequencies and wave heights, where the water surface is scanned by the stereo vision camera installed on the top of the tank. Surface elevation inferred by the stereo vision is verified by an installed stationary side camera that records the water surface through the tank transparent side window, water surface elevation measured by the side camera recordings is extracted using edge detection algorithm. During the in-lab experiment a heaving buoy is installed to test the performance of Visual Simultaneous Localization and Mapping (VSLAM) algorithm to monitor the buoy heave motion. The VSLAM algorithm fuses a buoy onboard stereo vision recordings with an embedded Inertial Measurement Unit (IMU) to estimate the 6-DOF of a rigid body. The Buoy motion VSLAM measurements are verified by a KLT tracking algorithm implemented on the video recordings of the stationary side camera. The open-sea experiment is implemented in Lake Somerville, Texas. The stereo vision system is installed to measure the water surface elevation and directional spectrum of the wind generated irregular waves. The open-sea wave measurements by the stereo vision are verified by a Sofar commercial wave buoys deployed in the testing location.

Bruegel według Majewskiego. Literackie i malarskie problemy adaptacji

Lech Majewski’s The Mill and the Cross (2011) is a full-length feature film, a screen adaptation of Pieter Bruegel’s painting The Way of the Cross (1564). Majewski proves to be an excellent interpreter of Bruegel’s art, whom he considers a philosopher, an epic, and a poet. He relies on the research of Michael F. Gibson, and in his plotting he draws on a long-standing tradition of literary experience and digital technology (without this, it would have been impossible to faithfully reproduce the overall plan and realities of the painting). Majewski exposes the palimpsest nature of the narrative and shapes the film like a contemporary novel of space. In order to make the ideas of the screened painting comprehensible and to emphasize the fictionality of the depicted world, he introduces various versions of “literature about literature”. In the film, he perfectly integrates painterly features (word reduction, stop motion, long static camera shots) and literary features (the structure of an episodic novel of manners).

Development of a multi-object tracking algorithm with untrained features of object matching

The problem of multiple object tracking is one of the most difficult tasks in computer vision. The article is devoted to a task of multiple object tracking on video footage received from an unmanned aerial vehicle. Unlike a static camera platform, the mobile platform causes an accidental camera movement, which leads to sudden changes in the position, angle and scale of objects. Such aspects considerably hinder efficient object tracking. In this paper, we explore the possibilities of improving the tracking quality in the case of camera movements. We significantly outperform ByteTrack algorithm, one of the best tracking algorithms for the MOT Challenge dataset, on the Visdrone 2019 dataset.

The Application of CNN-Based Image Classification To Wildfire Early Detection

Wildfires have become increasingly common and devastating in recent years, yet many regions still rely on traditional methods of using human spotters atop lookout towers to detect fires. These methods are slow and inefficient, and as fires become more frequent demand for new detection methods has grown along with it. This study aims to utilize artificial intelligence along with stationary camera systems to perform early detection of wildfires. An open-source dataset of 1900 wildfire pictures was obtained and processed, and a convolutional neural network model was trained on the dataset. The final model achieved an accuracy of 95.59% on the validation dataset after being trained for 37 epochs.

Distributed multi-target tracking and active perception with mobile camera networks

Smart cameras are an essential component in surveillance and monitoring applications, and they have been typically deployed in networks of fixed camera locations. The addition of mobile cameras, mounted on robots, can overcome some of the limitations of static networks such as blind spots or back-lightning, allowing the system to gather the best information at each time by active positioning. This work presents a hybrid camera system, with static and mobile cameras, where all the cameras collaborate to observe people moving freely in the environment and efficiently visualize certain attributes from each person. Our solution combines a multi-camera distributed tracking system, to localize with precision all the people, with a control scheme that moves the mobile cameras to the best viewpoints for a specific classification task. The main contribution of this paper is a novel framework that exploits the synergies that result from the cooperation of the tracking and the control modules, obtaining a system closer to the real-world application and capable of high-level scene understanding. The static camera network provides global awareness of the control scheme to move the robots. In exchange, the mobile cameras onboard the robots provide enhanced information about the people on the scene. We perform a thorough analysis of the people monitoring application performance under different conditions thanks to the use of a photo-realistic simulation environment. Our experiments demonstrate the benefits of collaborative mobile cameras with respect to static or individual camera setups.

Edge-Computing-Facilitated Nighttime Vehicle Detection Investigations With CLAHE-Enhanced Images

In this study, we propose a novel CLAHE-based nighttime image contrast enhancement approach for vehicle detection under nighttime conditions, which improves the contrast of low-quality nighttime images while preventing over-enhancement by employing the image dehazing technique. To implement and evaluate our proposed contrast enhancement method on nighttime images, we consider a scenario of using a camera-based Internet of Things (IoT)-edge computing device for traffic and road surveillance. Edge-computing and IoT technology enable significant amounts of novel studies to advance traffic system monitoring, sensing, control, and management. Considering multiple metrics of image enhancement quality, the proposed nighttime image contrast enhancement method outperforms some existing well-performing CLAHE-based methods. To provide accurate vehicle detection under nighttime conditions and different challenges, including vehicle overlapping, low-light conditions, camera vibrations, and image distortion, must be addressed. For this purpose, a deep neural network based on YOLOv5 architecture has been designed and trained using our custom-labeled dataset. The developed neural network is proven to be effective in the detection of different vehicles under low-light ambient conditions using video captured from a stationary camera. Experiments on our dataset show that the proposed contrast enhancement method greatly improves the detection performance of the trained YOLOv5 model under low-environment-light conditions compared with the model trained using unenhanced images. The model trained with enhanced images can provide an improvement of 5.7% on F1 score, 6.3% on mAP <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$_{0.5,}$</tex-math> </inline-formula> and 3.4% on mAP <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$_{0.5:0.95} $</tex-math> </inline-formula> under specific conditions.

View Synthesis of Dynamic Scenes based on Deep 3D Mask Volume.

Image view synthesis has seen great success in reconstructing photorealistic visuals, thanks to deep learning and various novel representations. The next key step in immersive virtual experiences is view synthesis of dynamic scenes. However, several challenges exist due to the lack of high-quality training datasets, and the additional time dimension for videos of dynamic scenes. To address this issue, we introduce a multi-view video dataset, captured with a custom 10-camera rig in 120FPS. The dataset contains 96 high-quality scenes showing various visual effects and human interactions in outdoor scenes. We develop a new algorithm, Deep 3D Mask Volume, which enables temporally-stable view extrapolation from binocular videos of dynamic scenes, captured by static cameras. Our algorithm addresses the temporal inconsistency of disocclusions by identifying the error-prone areas with a 3D mask volume, and replaces them with static background observed throughout the video. Our method enables manipulation in 3D space as opposed to simple 2D masks, We demonstrate better temporal stability than frame-by-frame static view synthesis methods, or those that use 2D masks. The resulting view synthesis videos show minimal flickering artifacts and allow for larger translational movements.

Bridge vibration measurements using different camera placements and techniques of computer vision and deep learning

In this paper, a new framework is proposed for monitoring the dynamic performance of bridges using three different camera placements and a few visual data processing techniques at low cost and high efficiency. A deep learning method validated by an optical flow approach for motion tracking is included in the framework. To verify it, videos taken by stationary cameras of two shaking table tests were processed at first. Then, the vibrations of six pedestrian bridges were measured using structure-mounted, remote, and drone-mounted cameras, respectively. Two techniques, displacement and frequency subtractions, are applied to remove systematic motions of cameras and to capture the natural frequencies of the tested structures. Measurements on these bridges were compared with the data from wireless accelerometers and structural analysis. Influences of critical parameters for camera setting and data processing, such as video frame rates, data window size, and data sampling rates, were also studied carefully. The research results show that the vibrations and frequencies of structures on the shaking tables and existing bridges can be captured accurately with the proposed framework. These camera placements and data processing techniques can be successfully used for monitoring their dynamic performance.

REAL-TIME SMOKE DETECTION IN VIDEO

The paper considers algorithmic and software for early fire detection based on smoke detection from video sequences&#x0D; generated by a static video camera. To detect areas with smoke, an algorithm has been developed that allows&#x0D; you to select such areas on video frames that are characterized by a number of features: the presence of a stable&#x0D; directional movement, compliance with the color characteristics of smoke, and a decrease in the energy value of highfrequency&#x0D; components relative to the background model. The feature of the algorithm is a step-by-step spatiotemporal&#x0D; analysis of candidate areas, which provides satisfactory computational costs and real-time operation&#x0D; on modern computing tools for high-resolution video frames. The algorithm is implemented using the functions&#x0D; of the OpenCV computer vision library and multi-threaded processing. The features and main functionality of the software&#x0D; implemented as a stationary application are given. The results of experimental studies on the evaluation&#x0D; of the efficiency of the algorithm and its speed are presented.

OutcropHyBNet: Hybrid Backbone Networks with Data Augmentation for Accurate Stratum Semantic Segmentation of Monocular Outcrop Images in Carbon Capture and Storage Applications.

The rapid advancement of climate change and global warming have widespread impacts on society, including ecosystems, water security, food production, health, and infrastructure. To achieve significant global emission reductions, approximately 74% is expected to come from cutting carbon dioxide (CO2) emissions in energy supply and demand. Carbon Capture and Storage (CCS) has attained global recognition as a preeminent approach for the mitigation of atmospheric carbon dioxide levels, primarily by means of capturing and storing CO2 emissions originating from fossil fuel systems. Currently, geological models for storage location determination in CCS rely on limited sampling data from borehole surveys, which poses accuracy challenges. To tackle this challenge, our research project focuses on analyzing exposed rock formations, known as outcrops, with the goal of identifying the most effective backbone networks for classifying various strata types in outcrop images. We leverage deep learning-based outcrop semantic segmentation techniques using hybrid backbone networks, named OutcropHyBNet, to achieve accurate and efficient lithological classification, while considering texture features and without compromising computational efficiency. We conducted accuracy comparisons using publicly available benchmark datasets, as well as an original dataset expanded through random sampling of 13 outcrop images obtained using a stationary camera, installed on the ground. Additionally, we evaluated the efficacy of data augmentation through image synthesis using Only Adversarial Supervision for Semantic Image Synthesis (OASIS). Evaluation experiments on two public benchmark datasets revealed insights into the classification characteristics of different classes. The results demonstrate the superiority of Convolutional Neural Networks (CNNs), specifically DeepLabv3, and Vision Transformers (ViTs), particularly SegFormer, under specific conditions. These findings contribute to advancing accurate lithological classification in geological studies using deep learning methodologies. In the evaluation experiments conducted on ground-level images obtained using a stationary camera and aerial images captured using a drone, we successfully demonstrated the superior performance of SegFormer across all categories.

Comparing the uses and benefits of stationary cameras versus body-worn cameras in a local jail setting

Comparing the uses and benefits of stationary cameras versus body-worn cameras in a local jail setting

Deep dynamic face capture and recognition based on internet of things

AbstractFace recognition is widely used as identity authentication method in the Internet of Things (IoTs). However, compared with static camera, the background of IoT devices may change. Additionally, the facial expression or posture may change as well. Although face recognition has been researched for several decades, it is still a challenging task to design a robust face recognition system in IoT environment. This paper designs a special face recognition system by introducing deep transfer learning to adapt difference scenes in IoT environment. The face recognition system consists of two parts: terminal smart devices and cloud center. The terminal smart device consists of a camera to capture face picture, a wireless network part to communicate with cloud center, and a screen to show recognition result. The cloud center receives the face picture from terminal smart device and returns the face recognition result by using an offline deep transfer learning model. Compared with previous models, deep transfer learning model can better adapt different scenes. The experiments shows that the proposed face recognition system achieves more promising results than two source‐only models and two shallow transfer learning models.