Camera Speed Research Articles

Real-World Video Denoising for Visual Inspection in High-Dose Radiological Environments

In high-dose radiological environments, where precision and safety are of utmost importance, the ability to acquire accurate and clear visual information is of paramount importance for ensuring safety and reliability in critical industrial processes. However, these environments inherently introduce significant challenges due to the adverse effects of radiation on imaging equipment. As a consequence, inspection videos captured within such high-radiation environments often contain a significant amount of noise. This noise substantially complicates the task of identifying and assessing potential defects in vital components. It also diverts attention and resources toward investigating false positives created by noise, leading to inefficiencies, and for industrial processes on the critical path, this can further prolong the outage. Addressing this noise is essential not only for precision, but also for ensuring safety, reliability, and efficiency in critical industrial processes. In this paper, we present a custom-designed filter utilizing a priori information about camera position and trajectory to remove the noise from the inspection videos, making the defects easier to manually identify. As the camera movement is in one direction at a constant speed, the proposed approach uses this temporal and spatial information to accurately remove the noise. This approach applies to a subset of visual inspection problems throughout the nuclear industry, as well as many other industries where there is knowledge available about the camera speed and direction of travel. The proposed approach is compared with three accepted/well-known approaches, median filtering, bilateral filtering, and fast nonlocal means denoising, and an additional state-of-the-art deep learning model is also used for comparison. It was found that the proposed approach produces the most accurate video denoising in terms of visual quality and the retainment of the defect features throughout the videos tested.

Vection and Performance During Attention-Demanding Tasks in Virtual Reality

We investigated how attention-demanding aural and visual discrimination tasks attenuate visually-induced self-motion (vection) and how task accuracy and response time are affected by experiencing various levels of vection-inducing motion in a virtual environment. Seventeen seated observers were presented simulated motion at various virtual camera speeds from stationary to 15 m/s in a straight virtual corridor through a Vive Pro Virtual Reality headset as they performed aural, visual discrimination tasks, or no task at all. Observers generally perceived less vection at all motion levels when they performed visual discrimination tasks compared to when they had no task. Increased vection was associated with reduced accuracy on the visual task and increased response time to the aural task. These results suggest that the amount of vection perceived in virtual reality simulators can be attenuated when users perform attention-demanding tasks related to visual processing, and, conversely, vection-producing motion can affect performance in attention-demanding tasks.

Evaluation of the use of box size priors for 6D plane segment tracking from point clouds with applications in cargo packing

This paper addresses the problem of 6D pose tracking of plane segments from point clouds acquired from a mobile camera. This is motivated by manual packing operations, where an opportunity exists to enhance performance, aiding operators with instructions based on augmented reality. The approach uses as input point clouds, by its advantages for extracting geometric information relevant to estimating the 6D pose of rigid objects. The proposed algorithm begins with a RANSAC fitting stage on the raw point cloud. It then implements strategies to compute the 2D size and 6D pose of plane segments from geometric analysis of the fitted point cloud. Redundant detections are combined using a new quality factor that predicts point cloud mapping density and allows the selection of the most accurate detection. The algorithm is designed for dynamic scenes, employing a novel particle concept in the point cloud space to track detections’ validity over time. A variant of the algorithm uses box size priors (available in most packing operations) to filter out irrelevant detections. The impact of this prior knowledge is evaluated through an experimental design that compares the performance of a plane segment tracking system, considering variations in the tracking algorithm and camera speed (onboard the packing operator). The tracking algorithm varies at two levels: algorithm (Awpk\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$A_{wpk}$$\\end{document}), which integrates prior knowledge of box sizes, and algorithm (Awoutpk\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$A_{woutpk}$$\\end{document}), which assumes ignorance of box properties. Camera speed is evaluated at low and high speeds. Results indicate increments in the precision and F1-score associated with using the Awpk\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$A_{wpk}$$\\end{document} algorithm and consistent performance across both velocities. These results confirm the enhancement of the performance of a tracking system in a real-life and complex scenario by including previous knowledge of the elements in the scene. The proposed algorithm is limited to tracking plane segments of boxes fully supported on surfaces parallel to the ground plane and not stacked. Future works are proposed to include strategies to resolve this limitation.

Image Enhancement Thanks to Negative Grey Levels in the Logarithmic Image Processing Framework.

The present study deals with image enhancement, which is a very common problem in image processing. This issue has been addressed in multiple works with different methods, most with the sole purpose of improving the perceived quality. Our goal is to propose an approach with a strong physical justification that can model the human visual system. This is why the Logarithmic Image Processing (LIP) framework was chosen. Within this model, initially dedicated to images acquired in transmission, it is possible to introduce the novel concept of negative grey levels, interpreted as light intensifiers. Such an approach permits the extension of the dynamic range of a low-light image to the full grey scale in "real-time", which means at camera speed. In addition, this method is easily generalizable to colour images and is reversible, i.e., bijective in the mathematical sense, and can be applied to images acquired in reflection thanks to the consistency of the LIP framework with human vision. Various application examples are presented, as well as prospects for extending this work.

High-speed lateral scanning white-light phase shift interferometry.

In this study, we present lateral scanning white light interferometry (LS-WLI), where phase-shifting algorithms are applied to inspect the topography of a large field of view (FOV) with high-speed measurements. At a point, the interference signal must be acquired with a specific condition to adapt the phase-shifting algorithm. This means that all points have two points, of which the phase difference is π/2, when the number of points acquired in a phase period is multiple of 4, despite increasing the data points in a period. Consequently, stretching the fringe spacing in LS-WLI facilitates the application of phase-shift techniques, thereby enhancing stage speed, even with a fixed camera speed. Using the proposed method, we can successfully obtain a laterally expended topographic image as 5.25 mm × 1.25 mm, where the step height of the microstructure is 140 nm.

Security Drone for Surveillance in Military

Abstract: This paper presents the design and development of a sophisticated military security drone equipped with advanced components including Pixhawk flight controller, GPS module, camera, receiver, telemetry system, BLDC (Brushless Direct Current) motors, and electronic speed controller (ESC). The Pixhawk flight controller serves as the brain of the drone, managing flight dynamics, navigation, and mission planning with remarkable precision and reliability. Integrated with a highaccuracy GPS module, the drone achieves autonomous navigation capabilities, enabling it to execute pre-defined flight paths and perform missions with minimal human intervention. A high-resolution camera system is incorporated into the drone, providing real-time video surveillance and reconnaissance capabilities. This camera system is complemented by a receiver module, facilitating remote control and data transmission between the drone and ground control station.Furthermore, the telemetry system enables remote monitoring of the drone's vital parameters, including altitude, speed, battery status, and sensor readings. This real-time telemetry data enhances situational awareness and facilitates informed decision-making during missions.The propulsion system of the drone consists of BLDC motors and electronic speed controllers, offering efficient and reliable propulsion for sustained flight operations. These components are carefully integrated to optimize power consumption, flight endurance, and maneuverability, ensuring the drone's effectiveness in various operational scenarios. In summary, the integration of Pixhawk flight controller, GPS module, camera, receiver, telemetry, BLDC motors, and electronic speed controller in the design of the military security drone represents a significant advancement in unmanned aerial technology. The resulting drone platform offers enhanced capabilities for surveillance, reconnaissance, and security applications, contributing to the effectiveness and efficiency of military operations in diverse environments

Kinematic metrics and surgeon experience in robotic cholecystectomies: a pilot study on breaking down technical performance.

Recent studies have correlated surgical skill measured by video-based assessment with improved clinical outcomes. Certain automated measures of operative performance in robotic surgery can be gathered beyond video review called objective performance indicators (OPIs). We explore the relationship between OPIs, surgeon experience, and postoperative recovery, hypothesizing that more efficient dissection will be associated with experience. Fifty-six robotic cholecystectomies between February 2022 and March 2023 were recorded at a large tertiary referral center. Surgeon experience and clinical outcomes data from the EMR were obtained for all 56 cases with 10 completing the QOL survey. Two steps of robotic cholecystectomies were reviewed: dissection of Calot's triangle (DCT) and dissection of the gallbladder from the liver (DGL). Postoperative recovery was measured using the SF-36 well-being survey. Univariate analysis was conducted using Pearson's coefficient. Increased operative experience was associated with more efficient camera and instrument movements. DCT had 7 and DGL had 31 of 41 OPIs that correlated with experience. With respect to DGL, more experienced surgeons had reduced step duration and instrument path length and increased camera and instrument speeds. Several OPIs correlate with surgical experience and may form the basis of more instructive feedback for trainees and less experienced surgeons in improving intraoperative technique.

Research on full-field vibration displacement measurement based on grid CCD moiré method

The development of full-field, accurate vibration testing techniques has been vastly valued by the academic and engineering community. However, due to the limited data transmission speed of digital cameras, the contradiction between speed and resolution remains in the traditional full-field vibration measurement systems based on image measurement, failing to acquire high-resolution images at high-speed simultaneously. In this paper, a high-speed and high-resolution full-field vibration displacement measurement system is established based on the grid CCD moiré method. A periodic grid is arranged on the surface of the sample as a deformation carrier, and the periodic pixel of the digital camera is used as a reference grating that ‘enlarges’ the grid on the surface of the sample to form a grid CCD moiré with a geometry significantly larger than the original, capturing images for deformation analysis. This approach lowers the requirement of digital image resolution for high-resolution deformation measurement, reducing the contradiction between speed and resolution in full-field vibration measurement. In this paper, the principle and implementation of full-field vibration measurement using the CCD moiré method are introduced, and the experiment results of full-field in-plane vibration displacement measurement are included, verifying the effectiveness and reliability of the system.

Fish behavior in response to an approaching underwater camera

Responses of fish to camera survey gear can influence abundance estimates, and fish behaviors such as attraction or avoidance of an approaching camera platform can bias fish counts. In addition, artificial lighting is generally required for camera-based surveys in boreal systems at > 30 m depth. This study recorded the responses of fish and their apparent orientation as seen in camera images taken in two different areas in Alaska. Stereo-image methods were used to estimate fish movement, range from camera, and the movement of the camera platform itself by estimating the spatial relationship between fish and the seafloor. Change in the apparent position of feature points along the seafloor and the fish was used to derive fish and camera speed. A total of 670 individual fish across 19 near-bottom species were analyzed from a dataset of 3463 image frames from 112 separate camera deployments. Individual fish species were combined into groups and analyzed for reactions, orientation toward the camera, nearest approach to the camera, and swimming speed. Most fish did not react strongly to the camera. A number of distinct patterns in reactions were observed, with roundfish exhibiting the highest level of attraction to the camera and flatfish showing the highest number of strong avoidance reactions. Significant differences in approach distance and fish swimming speed across analysis groups, reactions and regions were found, with highest fish speeds observed with roundfish and closest approach of the camera observed with demersal rockfish and flatfish. The findings demonstrate distinct differences in reactions among groups and suggest that the potential attraction response of roundfish might lead to positive biases for density. Flatfish were reactive mostly at close ranges, and rockfishes exhibited neutral and moderate reactions, which may signal reasonable estimates of abundance for these groups using camera-based surveys.

An effective fusion positioning methodology for land vehicles in GPS-denied environments using low-cost sensors

It is still a main challenge to achieve accurate and reliable vehicle positioning in Global Position System (GPS)-denied environments using low-cost sensors. Although existing methods have obtained a certain performance improvement, there is still room for further enhancement in positioning accuracy due to the lack of effective observation information during GPS outages. To address this challenge, this paper proposes an effective fusion positioning methodology based on enhanced observation information. Firstly, a data denoising algorithm based on convolutional denoising autoencoder is developed to effectively filter the noises in inertial sensors, so as to provide more clean data for subsequent modeling. Then, a differential fusion strategy is designed to selectively fuse multiple observation information from monocular camera, low-cost GPS and wheel speed sensor with extended Kalman filter, which can further improve the positioning accuracy. Finally, a long short-term memory-based error prediction model is constructed to learn the mapping relationship between the result of data denoising and differential fusion. In the case of GPS outages, the error model provides accurate corrections to compensate for position errors of inertial navigation system. The performance of the proposed methodology was evaluated on real-world data collected in complex urban environments. Experimental results indicate that the proposed positioning methodology can obtain significant accuracy enhancement.

Digital camera's parameter identification for vibration-based structural health monitoring under different dynamic responses

Vibration-based structural health monitoring (SHM) is critical in assessing structures' integrity. However, traditional methods of contact vibration sensors, such as accelerometers, face inherent limitations regarding accessibility, coverage, and their impact on structural dynamics. In recent years, digitalisation has introduced novel possibilities for overcoming these challenges through camera-based measurements. Nonetheless, a knowledge gap exists concerning the interdependencies among camera speed, resolution, and the accuracy of extracted dynamic features from captured results. This paper aims to address this gap by examining the influence of camera settings on the accuracy and reliability of visual-based vibration measurements. The study measured the natural frequencies and resonance amplitudes of the cracked cantilever beams exhibiting diverse dynamics. During the tests, the camera records the vibration behaviour with different speed and resolution settings. Through analysis of the acquired data, this study seeks to establish trade-offs between camera parameters and measurement accuracy, ultimately enhancing the reliability and effectiveness of crack detection within visual-based vibration monitoring.

Rancang Bangun Robot Pelayan Pasien Berbasis Internet of Things (Iot)

The use of technology in the industrial revolution era and society is growing rapidly, especially the use of robots in facilitate human work. The function of robots is not only in the industrial world, but also in the world of health, for example robots to assist in serving patients. In supporting service activities in the robotic-based health world, a medical service robot design was made which aims to help reduce the duties of medical waiters while reducing the effects of COVID-19 transmission and analyze the results of designing and monitoring systems on medical service robots. The research method used is in the form of control testing and monitoring of medical service robots from the results of non-contact body temperature sensor measurements using a design tool that was made compared to standard measuring instruments and then calculating the percentage error of the measurement, hand sanitizer sensor reading distance, and connectivity esp32 cam, esp32 dev and camera 360 with wifi as well as connection time of esp32cam, esp32dev and camera 360 with wifi. The results of the measurement of the body temperature sensor have an error presentation rate ranging from 0.002% - 0.023%, the infrared sensor distance measurement reaches 14 cm and the robot connectivity distance gets good results with a distance of 505 cm, the connectivity speed of esp32 and IP cameras depends on the wifi speed used best results in this trial at 45 ms.

Experimental setup for the ultrasonic fractionation of flowing whole blood in a capillary

Abstract If a long ultrasound driving pulse is chosen such, that its frequency is greater than the resonance frequency of one cell type and less than the resonance frequency of another cell type, the cells are separated in different nodes and antinodes of the standing sound field. The purpose of this study was to build an experimental setup for the ultrasonic fractionation of whole blood in flow conditions. Blood fractionation is the separation of whole blood into its separate components, commonly used for analysis and transfusions. The experimental setup comprised a container with singleelement ultrasound transducers customisable in elevation and azimuth, focussed on a capillary through which blood was flowing. The acoustic focus coincided with the optical focus of a microscopic system to which a high-speed camera was attached. Ultrasound transducers were used with centre frequencies between 1MHz and 20MHz and with pressure amplitudes less than 1MPa. The duty cycle was greater than 10% in all experiments. The field of view was 0.2×0.2mm2. The optical resolution and camera speed allowed for visibility of red and white blood cells during flow conditions. Preliminary results show that red and white blood cells could be forced to move in opposite directions. The acoustic frequencies and pressures used were representative for those used in clinical diagnosis. We have shown that ultrasonic whole blood fractionation is feasible using ultrasound. Sonic fractionation speed might be an indicator for diseases such as malaria.

Intensity instability and correlation in amplified multimode wave mixing

The dynamics of optical nonlinearity in the presence of gain and feedback can be complex leading to chaos in certain regimes. Temporal, spectral, spatial, or polarization instability of optical fields can emerge from chaotic response of an optical chi ^{(2)} or chi ^{(3)} nonlinear medium placed between two cavity mirrors or before a single feedback mirror. The complex mode dynamics, high-order correlations, and transition to instability in these systems are not well known. We consider a chi ^{(3)} medium with amplified four-wave mixing process and study noise and correlation between multiple optical modes. Although individual modes show intensity instability, we observe relative intensity noise reduction close to the standard quantum noise, limited by the camera speed. We observe a relative noise reduction of more than 20 dB and fourth-order intensity correlation between four spatial modes. More than 100 distinct correlated quadruple modes can be generated using this process.

Estimating vehicle speed by analyzing the acoustic frequency of dashboard camera sound

Dashboard cameras are now widely distributed and help determine the cause of traffic accidents and vehicle speed. The simplest method to calculate the accident vehicle's speed uses a specific section's driving distance and time, determining the average speed. However, we cannot determine whether the vehicle was accelerating or decelerating. In addition, setting the reference point of the specific road section is difficult if the video is too dark or the resolution is too low. Therefore, this study aimed to calculate vehicle speed using sound data from dashboard camera videos. Herein, we suggest a method to calculate the speed of a vehicle in an accident by analyzing the engine sound frequency. Furthermore, our method was verified experimentally and in an actual case. We found that this method could obtain more information than other dashboard camera speed calculations, such as when the vehicle accelerates, decelerates, and shifts gears. However, torque converter slips increased error in the speed calculations. Therefore, we propose using the engine's sound obtained from dashboard camera videos to calculate vehicle speed if the torque converter slip is not severe.

Karakteristik spray diesel dan campuran biodiesel nyamplung pada ruang chamber dengan variasi temperatur ambient

Spray characteristics have an important role in improving the quality of combustion in compression engines. This study analyzes the effect of ambient temperature on spray characteristics including spray tip penetration, spray angle and velocity of spray. The research method uses an experimental method with ambient temperature variations of 60 o C, 80 o C, 100 o C controlled using a thermocouple and an ambient pressure of 0.3 MPa. the composition of the fuel uses diesel (diesel 100%), B30 (30% biodiesel), B100 (100% biodiesel). Image recording using camera speed 480 fms. Based on the experimental results, the ambient temperature increases the spray angle and B100 at all ambient temperatures has a spray tip penetration, velocity of spray is lower.

Correlation-Based Template Tracking Of Moving Object

This paper presents the correlation-based motion estimation technique for the 3D displacement of objects. Two high-speed cameras are configured as a stereovision system and synchronized in real-time. Finger and hand motions are captured in form of digital images at 1500 fps and 2000 fps respectively. A complete motion acquisition system is calibrated to determine the intrinsic and extrinsic parameters which were later used in the correlation algorithm. The grayscale image frames acquired from the cameras are correlated using square templates of 10x10 pixels created from the reference image. The finger and hand motion are discussed with varying camera speed as a measure of brightness inconsistency. The observations in the correlation coefficient indicate that the proposed algorithm is efficient up to 20 and 50 templates for the finger and hand motion cases respectively. The correlation coefficient for finger motion was increased to 0.987 and 0.972 for the left and right cameras, respectively, while the correlation coefficient for hand motion was 0.924 and 0.898. The proposed algorithm is developed in MATLAB and validated by tracing the sinusoidal motion of a solid rectangular element from the image correlation technique and an accelerometer sensor mounted over the block.

Camera keyframing with style and control

We present a novel technique that enables 3D artists to synthesize camera motions in virtual environments following a camera style , while enforcing user-designed camera keyframes as constraints along the sequence. To solve this constrained motion in-betweening problem, we design and train a camera motion generator from a collection of temporal cinematic features (camera and actor motions) using a conditioning on target keyframes. We further condition the generator with a style code to control how to perform the interpolation between the keyframes. Style codes are generated by training a second network that encodes different camera behaviors in a compact latent space, the camera style space. Camera behaviors are defined as temporal correlations between actor features and camera motions and can be extracted from real or synthetic film clips. We further extend the system by incorporating a fine control of camera speed and direction via a hidden state mapping technique. We evaluate our method on two aspects: i) the capacity to synthesize style-aware camera trajectories with user defined keyframes; and ii) the capacity to ensure that in-between motions still comply with the reference camera style while satisfying the keyframe constraints. As a result, our system is the first style-aware keyframe in-betweening technique for camera control that balances style-driven automation with precise and interactive control of keyframes.

Development of 3D Printed Smartphone-Based Multi-Purpose Fundus Camera (MultiScope) for Retinopathy of Prematurity

Retinopathy of Prematurity (ROP) is a prominent source of low vision and blindness in preterm babies. Wide-Field Digital Retinal Imaging (WFDRI) systems acquire accurate digital images which are very useful for identification, documentation and transmitting the various retinal diseases. This telemedicine technique has potential for an alternative tool for Binocular Indirect Ophthalmoscopy(BIO) in ROP screening, but it is very expensive and accessibility for poor communities is limited. Capabilities of good illumination, high resolution camera and processing speed of the modern smartphones are being identified as a substitute. Potential applications of 3D printing is that it provides a severe impact in medical field, especially in ophthalmology sector. Competences of 3D printing are very useful for the development of retinal camera from any smartphone with the help of 3D printable devices. The primary aim of this study is to develop a handheld 3D printed smartphone-based multi-purpose fundus camera for ROP screening. The secondary aim is to check the feasibility and compare the digital fundus images obtained from the developed fundus camera against the commercial RetCam imaging. The proposed cost effective and remote reading device is an alternative to WFDRI for ROP screening and can improve the potential of ROP care for low resource communities.

High-throughput spatial sensitive quantitative phase microscopy using low spatial and high temporal coherent illumination

High space-bandwidth product with high spatial phase sensitivity is indispensable for a single-shot quantitative phase microscopy (QPM) system. It opens avenue for widespread applications of QPM in the field of biomedical imaging. Temporally low coherence light sources are implemented to achieve high spatial phase sensitivity in QPM at the cost of either reduced temporal resolution or smaller field of view (FOV). In addition, such light sources have low photon degeneracy. On the contrary, high temporal coherence light sources like lasers are capable of exploiting the full FOV of the QPM systems at the expense of less spatial phase sensitivity. In the present work, we demonstrated that use of narrowband partially spatially coherent light source also called pseudo-thermal light source (PTLS) in QPM overcomes the limitations of conventional light sources. The performance of PTLS is compared with conventional light sources in terms of space bandwidth product, phase sensitivity and optical imaging quality. The capabilities of PTLS are demonstrated on both amplitude (USAF resolution chart) and phase (thin optical waveguide, height ~ 8 nm) objects. The spatial phase sensitivity of QPM using PTLS is measured to be equivalent to that for white light source and supports the FOV (18 times more) equivalent to that of laser light source. The high-speed capabilities of PTLS based QPM is demonstrated by imaging live sperm cells that is limited by the camera speed and large FOV is demonstrated by imaging histopathology human placenta tissue samples. Minimal invasive, high-throughput, spatially sensitive and single-shot QPM based on PTLS will enable wider penetration of QPM in life sciences and clinical applications.