Real-time Processing Method Research Articles

Real-time Information Acquisition and Processing Method for Penetration Information Based on Multi-information Fusion

Real-time Information Acquisition and Processing Method for Penetration Information Based on Multi-information Fusion

Obstacle feature point detection method for real-time processing by monocular camera and line laser

In this study, we propose a method for detecting feature points of obstacles by real-time processing using a monocular camera and a laser. Specifically, we propose an algorithm that detects laser beams emitted on obstacles by binarization, transforms pixel coordinates into distance using triangulation by a laser beam that is obliquely incident on the ground, and estimates the placement angle of the obstacle in real-time processing. No method has been devised to detect the placement angle of obstacles using a monocular camera and a laser. Furthermore, the proposed method does not calculate the linear distance from the camera, but from the position where the camera is moved horizontally parallel to the obstacle in front of the camera, thus detecting the placement angle independently of the placement position of the obstacle. As a result, it was confirmed that the placement angles of obstacles could be detected with a maximum error of 6∘\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$6^{\\circ }$$\\end{document} in six placement positions. Therefore, we succeeded in automatically detecting the placement angle of obstacles in real-time, independent of the illumination of the measurement environment, the reflectance of the obstacle.

Analysis of Real-time Processing Approaches for Large Data Volumes in Metering Infrastructure

Smart grid systems and communication technologies, such as Advanced Metering Infrastructure (AMI), have revolutionized utility service management and monitoring. AMI leverages smart meters equipped with advanced communication capabilities, facilitating bidirectional communication between utilities and consumers. The increasing deployment of smart meters and the adoption of sub-hourly data collection requirements by utility companies highlight significant data volume growth. Thus, there is a need for efficient real-time data processing solutions as existing approaches may not meet previously established Service-Level Agreements (SLAs) concerning performance, accuracy, and scalability metrics. This research aims to comprehensively review the latest publications relevant to distributed real-time data processing methods for smart grid applications and outline problems for further research. Specifically, the study delves into the effectiveness and application of reviewed approaches in managing the constant stream of data from smart meters and IoT devices within the smart grid context. By analysing existing methodologies and advancements, this study seeks to identify challenges and opportunities in real-time data processing for smart grid infrastructures, focusing on addressing the complexities of processing, managing, and storing large volumes of real-time data. The literature review revealed two primary applications of real-time data processing: optimization of data streaming performance and data analysis. The review encompasses various studies, each presenting distinct methodologies and technologies applied to address the challenges of processing large volumes of real- time data from smart meters and IoT devices. Future research should address the challenges and limitations discovered in this study.

Real-Time Defect Detection in Electronic Components during Assembly through Deep Learning

This paper introduces a pioneering method for real-time image processing in electronic component assembly, revolutionizing quality control in manufacturing. By promptly capturing images from pick-and-place machines during the interval between component pick-up and mounting, defects are identified and promptly addressed in line. This proactive approach ensures that defective components are rejected before mounting, effectively preventing issues from ever occurring, thus significantly enhancing efficiency and reliability. Leveraging rapid network protocols such as gRPC and orchestration via Kubernetes, in conjunction with C++ programming and TensorFlow, this approach achieves an impressive average turnaround time of less than 5 milli-seconds. Rigorously tested on 20 operational production machines, it not only ensures adherence to IPC-A-610 and IPC-STD-J-001 standards but also optimizes production efficiency and reliability.

Intelligent Methods for Forest Fire Detection Using Unmanned Aerial Vehicles

This research addresses the problem of early detection of smoke and open fire on the observed territory by unmanned aerial vehicles. We solve the tasks of improving the quality of incoming video data by removing motion blur and stabilizing the video stream; detecting the horizon line in the frame; and identifying fires using semantic segmentation with Euclidean–Mahalanobis distance and the modified convolutional neural network YOLO. The proposed horizon line detection algorithm allows for cutting off unnecessary information such as cloud-covered areas in the frame by calculating local contrast, which is equivalent to the pixel informativeness indicator of the image. Proposed preprocessing methods give a delay of no more than 0.03 s due to the use of a pipeline method for data processing. Experimental results show that the horizon clipping algorithm improves fire and smoke detection accuracy by approximately 11%. The best results with the neural network were achieved with YOLO 5m, which yielded an F1 score of 76.75% combined with a processing speed of 45 frames per second. The obtained results differ from existing analogs by utilizing a comprehensive approach to early fire detection, which includes image enhancement and alternative real-time video processing methods.

Publish/Subscribe Method for Real-Time Data Processing in Massive IoT Leveraging Blockchain for Secured Storage.

In the Internet of Things (IoT) era, the surge in Machine-Type Devices (MTDs) has introduced Massive IoT (MIoT), opening new horizons in the world of connected devices. However, such proliferation presents challenges, especially in storing and analyzing massive, heterogeneous data streams in real time. In order to manage Massive IoT data streams, we utilize analytical database software such as Apache Druid version 28.0.0 that excels in real-time data processing. Our approach relies on a publish/subscribe mechanism, where device-generated data are relayed to a dedicated broker, effectively functioning as a separate server. This broker enables any application to subscribe to the dataset, promoting a dynamic and responsive data ecosystem. At the core of our data transmission infrastructure lies Apache Kafka version 3.6.1, renowned for its exceptional data flow management performance. Kafka efficiently bridges the gap between MIoT sensors and brokers, enabling parallel clusters of brokers that lead to more scalability. In our pursuit of uninterrupted connectivity, we incorporate a fail-safe mechanism with two Software-Defined Radios (SDR) called Nutaq PicoLTE Release 1.5 within our model. This strategic redundancy enhances data transmission availability, safeguarding against connectivity disruptions. Furthermore, to enhance the data repository security, we utilize blockchain technology, specifically Hyperledger Fabric, known for its high-performance attributes, ensuring data integrity, immutability, and security. Our latency results demonstrate that our platform effectively reduces latency for 100,000 devices, qualifying as an MIoT, to less than 25 milliseconds. Furthermore, our findings on blockchain performance underscore our model as a secure platform, achieving over 800 Transactions Per Second in a dataset comprising 14,000 transactions, thereby demonstrating its high efficiency.

Real-time 3D shape measurement of dynamic scenes using fringe projection profilometry: lightweight NAS-optimized dual frequency deep learning approach.

Achieving real-time and high-accuracy 3D reconstruction of dynamic scenes is a fundamental challenge in many fields, including online monitoring, augmented reality, and so on. On one hand, traditional methods, such as Fourier transform profilometry (FTP) and phase-shifting profilometry (PSP), are struggling to balance measuring efficiency and accuracy. On the other hand, deep learning-based approaches, which offer the potential for improved accuracy, are hindered by large parameter amounts and complex structures less amenable to real-time requirements. To solve this problem, we proposed a network architecture search (NAS)-based method for real-time processing and 3D measurement of dynamic scenes with rate equivalent to single-shot. A NAS-optimized lightweight neural network was designed for efficient phase demodulation, while an improved dual-frequency strategy was employed coordinately for flexible absolute phase unwrapping. The experiment results demonstrate that our method can effectively perform 3D reconstruction with a reconstruction speed of 58fps, and realize high-accuracy measurement of dynamic scenes based on deep learning for what we believe to be the first time with the average RMS error of about 0.08 mm.

ArthroNavi framework: stereo endoscope-guided instrument localization for arthroscopic minimally invasive surgeries.

As an example of a minimally invasive arthroscopic surgical procedure, arthroscopic osteochondral autograft transplantation (OAT) is a common option for repairing focal cartilage defects in the knee joints. Arthroscopic OAT offers considerable benefits to patients, such as less post-operative pain and shorter hospital stays. However, performing OAT arthroscopically is an extremely demanding task because the osteochondral graft harvester must remain perpendicular to the cartilage surface to avoid differences in angulation. We present a practical ArthroNavi framework for instrument pose localization by combining a self-developed stereo endoscopy with electromagnetic computation, which equips surgeons with surgical navigation assistance that eases the operational constraints of arthroscopic OAT surgery. A prototype of a stereo endoscope specifically fit for a texture-less scene is introduced extensively. Then, the proposed framework employs the semi-global matching algorithm integrating the matching cubes method for real-time processing of the 3D point cloud. To address issues regarding initialization and occlusion, a displaying method based on patient tracking coordinates is proposed for intra-operative robust navigation. A geometrical constraint method that utilizes the 3D point cloud is used to compute a pose for the instrument. Finally, a hemisphere tabulation method is presented for pose accuracy evaluation. Experimental results show that our endoscope achieves 3D shape measurement with an accuracy of . The mean error of pose localization is 15.4deg (range of 10.3deg to 21.3deg; standard deviation of 3.08deg) in our ArthroNavi method, which is within the same order of magnitude as that achieved by experienced surgeons using a freehand technique. The effectiveness of the proposed ArthroNavi has been validated on a phantom femur. The potential contribution of this framework may provide a new computer-aided option for arthroscopic OAT surgery.

Real-Time Processing and High-Quality Imaging of Navigation Strip Data Using SSS Based on AUVs

In light of the prevailing approach in which data from side-scan sonar (SSS) from Autonomous Underwater Vehicles (AUVs) are primarily processed and visualized post mission, failing to meet the requirements in terms of timeliness for on-the-fly image acquisition, this paper introduces a novel method for real-time processing and superior imaging of navigation strip data from SSS aboard AUVs. Initially, a comprehensive description of the real-time processing sequence is provided, encompassing the integration of multi-source navigation data using Kalman filtering, and high-pass filtering of attitude and heading data to exclude anomalies, as well as the use of bidirectional filtering techniques within and between pings, ensuring real-time quality control of raw data. In addition, this study adopts the semantic segmentation Unet network for automatic real-time tracking of seafloor lines, devises a real-time correction strategy for radial distortion based on historical echo data, and utilizes the alternating direction multiplier method for real-time noise reduction in strip images. With the combined application of these four pivotal techniques, we adeptly address the primary challenges in real-time navigation data processing. In conclusion, marine tests conducted in Bohai Bay substantiate the efficacy of the methodologies delineated in this research, offering a fresh paradigm for real-time processing and superior visualization of SSS navigation strip data on AUVs.

Guided Linear Upsampling

Guided upsampling is an effective approach for accelerating high-resolution image processing. In this paper, we propose a simple yet effective guided upsampling method. Each pixel in the high-resolution image is represented as a linear interpolation of two low-resolution pixels, whose indices and weights are optimized to minimize the upsampling error. The downsampling can be jointly optimized in order to prevent missing small isolated regions. Our method can be derived from the color line model and local color transformations. Compared to previous methods, our method can better preserve detail effects while suppressing artifacts such as bleeding and blurring. It is efficient, easy to implement, and free of sensitive parameters. We evaluate the proposed method with a wide range of image operators, and show its advantages through quantitative and qualitative analysis. We demonstrate the advantages of our method for both interactive image editing and real-time high-resolution video processing. In particular, for interactive editing, the joint optimization can be precomputed, thus allowing for instant feedback without hardware acceleration.

Enhancing Human-Machine Interaction: Real-Time Emotion Recognition through Speech Analysis

Humans, as intricate beings driven by a multitude of emotions, possess a remarkable ability to decipher and respond to socio-affective cues. However, many individuals and machines struggle to interpret such nuanced signals, including variations in tone of voice. This paper explores the potential of intelligent technologies to bridge this gap and improve the quality of conversations. In particular, the authors propose a real-time processing method that captures and evaluates emotions in speech, utilizing a terminal device like the Raspberry Pi computer. Furthermore, the authors provide an overview of the current research landscape surrounding speech emotional recognition and delve into our methodology, which involves analyzing audio files from renowned emotional speech databases. To aid incomprehension, the authors present visualizations of these audio files in situ, employing dB-scaled Mel spectrograms generated through TensorFlow and Matplotlib. The authors use a support vector machine kernel and a Convolutional Neural Network with transfer learning to classify emotions. Notably, the classification accuracies achieved are 70% and 77%, respectively, demonstrating the efficacy of our approach when executed on an edge device rather than relying on a server. The system can evaluate pure emotion in speech and provide corresponding visualizations to depict the speaker's emotional state in less than one second on a Raspberry Pi. These findings pave the way for more effective and emotionally intelligent human-machine interactions in various domains.

New Real-Time High-Density Impulsive Noise Removal Method Applied to Medical Images.

This paper introduces a new method for real-time high-density impulsive noise elimination applied to medical images. A double process aimed at the enhancement of local data composed of Nested Filtering followed by a Morphological Operation (NFMO) is proposed. The major problem with heavily noisy images is the lack of color information around corrupted pixels. We show that the classic replacement techniques all come up against this problem, resulting in average restoration quality. We only focus on the corrupt pixel replacement phase. For the detection itself, we use the Modified Laplacian Vector Median Filter (MLVMF). To perform pixel replacement, two-window nested filtering is suggested. All noise pixels in the neighborhood scanned by the first window are investigated using the second window. This investigation phase increases the amount of useful information within the first window. The remaining useful information that the second window failed to produce in the case of a very strong connex noise concentration is then estimated using a morphological operation of dilatation. To validate the proposed method, NFMO is first evaluated on the standard image Lena with a range of 10% to 90% impulsive noise. Using the Peak Signal-to-Noise Ratio metric (PSNR), the image denoising quality obtained is compared to the performance of a wide variety of existing approaches. Several noisy medical images are subjected to a second test. In this test, the computation time and image-restoring quality of NFMO are assessed using the PSNR and the Normalized Color Difference (NCD) criteria. Finally, an optimized design for a field-programmable gate array (FPGA) is suggested to implement the proposed method for real-time processing. The proposed solution performs excellent quality restoration for images with high-density impulsive noise. When the proposed NFMO is used on the standard Lena image with 90% impulsive noise, the PSNR reaches 29.99 dB. Under the same noise conditions, NFMO completely restores medical images in an average time of 23 milliseconds with an average PSNR of 31.62 dB and an average NCD of 0.10.

A real-time processing method for GB-SAR monitoring data by using the dynamic Kalman filter based on the PS network

A real-time processing method for GB-SAR monitoring data by using the dynamic Kalman filter based on the PS network

AUV-Based Side-Scan Sonar Real-Time Method for Underwater-Target Detection

The limitations of underwater acoustic communications mean that the side-scan sonar data of an autonomous underwater vehicle (AUV) cannot be transmitted back and processed in real time, which means that targets cannot be detected in real time. To address the problem, this paper proposes an autonomous underwater vehicle-based side-scan sonar real-time detection method for underwater targets. First, the paper describes the system and operation of real-time underwater-target detection by the side-scan sonar mounted on the autonomous underwater vehicle. Next, it proposes a real-time processing method for side-scan sonar data, method for constructing a deep-learning-based underwater-target detection model, and real-time method for underwater-target detection based on navigation strip images, which, together, solve the three key technical problems of real-time data processing, deep-learning-based detection model construction, and real-time target detection based on the autonomous underwater vehicle. Finally, through sea-based experiments, the effectiveness of the proposed methods is evaluated, providing a new solution for the autonomous underwater vehicle-based side-scan sonar real-time detection of underwater targets.

Multi-point detection method of dynamic deflection of super long-span bridge based on chain laser model

Real-time monitoring of bridge deflection is of great significance for ensuring bridge safety. Aiming at the problems of poor real-time performance and low precision of deflection measurement of continuous multi-span and super long-span bridges, this paper proposes a multi-point chain laser detection model and method for dynamic deflection of super long-span bridges. Firstly, we construct a multi-point deflection parameter detection model based on chain laser reference and image processing, and give the system error adjustment scheme of the model; Then, the hardware framework of the system is designed, and the real-time deflection parameter data acquisition, processing and solution methods are analyzed. In addition, the related factors affecting the measurement accuracy of the system are analyzed, and the system error is analyzed and corrected. Finally, the principle prototype is built, and the intelligent monitoring platform based on cloud data processing is designed. The system parameter calibration experiment is carried out and verified on the displacement platform built outdoors. The results show that the measurement accuracy of the system can reach 1 mm under the condition of considering the pitch angle of the monitoring equipment, which can realize the real-time, dynamic and high-precision monitoring of the deflection of the long-span bridge beam.

Unsharp masking image enhancement the parallel algorithm based on cross-platform

In view of the low computational efficiency and the limitations of the platform of the unsharp masking image enhancement algorithm, an unsharp masking image enhancement parallel algorithm based on Open Computing Language (OpenCL) is proposed. Based on the analysis of the parallel characteristics of the algorithm, the problem of unsharp masking processing is implemented in parallel. Making use of the characteristics of data reuse in the algorithm, the effective allocation and optimization of global memory and constant memory are realized according to the access attributes of the data and the characteristics of the OpenCL storage model, and the use efficiency of off-chip memory is improved. Through the data storage access mode, the fast computing local memory access mode is discovered, and the logical data space transformation is used to convert the storage access mode, so as to improve the bandwidth utilization of the on-chip memory. The experimental results show that, compared with the CPU serial algorithm, the OpenCL accelerated unsharp masking image enhancement parallel algorithm greatly reduces the execution time of the algorithm while maintaining the same image quality, and achieves a maximum speedup of 16.71 times. The high performance and platform transplantation of the algorithm on different hardware platforms are realized. It provides a reference method for real-time processing of a large amount of data of high-resolution images for image enhancement.

New Real-Time Impulse Noise Removal Method Applied to Chest X-ray Images.

In this paper, we propose a new Modified Laplacian Vector Median Filter (MLVMF) for real-time denoising complex images corrupted by "salt and pepper" impulsive noise. The method consists of two rounds with three steps each: the first round starts with the identification of pixels that may be contaminated by noise using a Modified Laplacian Filter. Then, corrupted pixels pass a neighborhood-based validation test. Finally, the Vector Median Filter is used to replace noisy pixels. The MLVMF uses a 5 × 5 window to observe the intensity variations around each pixel of the image with a rotation step of π/8 while the classic Laplacian filters often use rotation steps of π/2 or π/4. We see better identification of noise-corrupted pixels thanks to this rotation step refinement. Despite this advantage, a high percentage of the impulsive noise may cause two or more corrupted pixels (with the same intensity) to collide, preventing the identification of noise-corrupted pixels. A second round is then necessary using a second set of filters, still based on the Laplacian operator, but allowing focusing only on the collision phenomenon. To validate our method, MLVMF is firstly tested on standard images, with a noise percentage varying from 3% to 30%. Obtained performances in terms of processing time, as well as image restoration quality through the PSNR (Peak Signal to Noise Ratio) and the NCD (Normalized Color Difference) metrics, are compared to the performances of VMF (Vector Median Filter), VMRHF (Vector Median-Rational Hybrid Filter), and MSMF (Modified Switching Median Filter). A second test is performed on several noisy chest x-ray images used in cardiovascular disease diagnosis as well as COVID-19 diagnosis. The proposed method shows a very good quality of restoration on this type of image, particularly when the percentage of noise is high. The MLVMF provides a high PSNR value of 5.5% and a low NCD value of 18.2%. Finally, an optimized Field-Programmable Gate Array (FPGA) design is proposed to implement the proposed method for real-time processing. The proposed hardware implementation allows an execution time equal to 9 ms per 256 × 256 color image.

A Deep Learning Application for Deformation Prediction from Ground-Based InSAR

Ground-based synthetic aperture radar interferometry (GB-InSAR) has the characteristics of high precision, high temporal resolution, and high spatial resolution, and is widely used in highwall deformation monitoring. The traditional GB-InSAR real-time processing method is to process the whole data set or group in time sequence. This type of method takes up a lot of computer memory, has low efficiency, cannot meet the timeliness of slope monitoring, and cannot perform deformation prediction and disaster warning forecasting. In response to this problem, this paper proposes a GB-InSAR time series processing method based on the LSTM (long short-term memory) model. First, according to the early monitoring data of GBSAR equipment, the time series InSAR method (PS-InSAR, SBAS, etc.) is used to obtain the initial deformation information. According to the deformation calculated in the previous stage and the atmospheric environmental parameters monitored, the LSTM model is used to predict the deformation and atmospheric delay at the next time. The phase is removed from the interference phase, and finally the residual phase is unwrapped using the spatial domain unwrapping algorithm to solve the residual deformation. The predicted deformation and the residual deformation are added to obtain the deformation amount at the current moment. This method only needs to process the difference map at the current moment, which greatly saves time series processing time and can realize the prediction of deformation variables. The reliability of the proposed method is verified by ground-based SAR monitoring data of the Guangyuan landslide in Sichuan Province.

A real-time data processing method based on twice weighted improved Kalman filter algorithm

The data obtained by sensor is strong randomness and deviates from Gaussian distribution. The Extended Kalman Filter (EKF) is cost-effective and easy to cause large errors while processing data. At the same time, the accuracy of the data prediction is not high enough. Therefore, an improved filter based on the original EKF is proposed to improve the prediction accuracy and noise reduction effect in this paper, which combines the predicted value and the measured value of the EKF twice to find the root mean square to obtain a more accurate predicted value. The noise reduction effect of EKF and TWEKF is compared by using MATLAB. And the root means square error (RMSE), signal-to-noise ratio (SNR), smoothness (S) and other quantitative judgment indexes prove that TWEKF has better noise reduction effect than EKF.

Research on Electrical Automation Monitoring System Model of Power Plant Based on CAN Bus

Using the traditional manual operation mode to control the electrical equipment of the power plant was not only inefficient and unsafe but also difficult to adapt to the use of new equipment. Therefore, this article puts forward the research on the model of power plant electrical automation monitoring system based on CAN bus, which was of great significance to improve the operation monitoring ability and management efficiency of power plant electrical equipment. Based on the analysis of the design mode and main functions of electrical equipment automation control system in power plant, this article expounded on the characteristics of CAN bus communication mode and its advantages in realizing electrical equipment automation control. According to the hierarchical management and structural characteristics of the electrical automation monitoring system, the real-time database architecture of the monitoring system was established, the real-time data monitoring and processing method of the electrical monitoring system was given, and then the electrical automation monitoring system model of the power plant was proposed. The experimental results showed that the electrical automation monitoring system proposed in this article was effective and feasible for real-time monitoring of the operation of electrical equipment. The model construction method of the electrical automation monitoring system proposed in this article can provide theoretical reference and technical support for improving the control mode of electrical equipment in power plants.