Real-time Image Processing Research Articles

“AgriVision” A Flutter -Based Application for RealTime Detection of Pesticides Residues on Fruits

“AgriVision” is a Flutter-based mobile application designed to address the critical issue of pesticide contamination on fruits. The application utilizes real-time image processing and machine learning techniques to detect pesticide residues on the surface of various fruits, ensuring food safety and healthstandards. By capturing and analyzing images through a smartphone camera, the app provides instant and reliablefeedback on the presence of harmful chemicals. The user-friendly interface, combined with the portability of the solution, offers farmers, consumers, and vendors a practical tool to assess fruit quality and promote safer agricultural practices. This project aims to contribute to healthier food choices and enhance consumer safety. Key Words: AgriVision , Flutter application , Real-time detection , Pesticide residues , Fruits , Agricultural technology , Pesticide detection , Mobile app , Food safety , AgriTech , Image processing , Machine learning , Smart agriculture , Fruit quality analysis.

Ultrasensitive dim-light neuromorphic vision sensing via momentum-conserved reconfigurable van der Waals heterostructure

Reconfigurable phototransistors featuring bipolar photoresponses are favorable for manipulating high-performance neuromorphic vision sensory. Here, we present a momentum-conserved reconfigurable phototransistor based on the van der Waals heterojunction between methylammonium lead iodide perovskite and two-dimensional Bi2O2Se semiconductor, which exhibits a synergistic interplay of interband hot-carrier transitions and reconfigurable heterointerface band alignments, eventually achieving the ultrahigh bipolar optoelectronic performances with the photoresponsivity of 6×107 AW−1, accompanied by the specific detectivity of 5.2×1011 Jones, and the dynamic range of 110 dB. Moreover, A 3×3 heterotransistor array is fabricated to perform in-sensor analog multiply-accumulate operations even under the challenging dim illumination of 0.1 μWcm−2 that comparable to natural moonlight. The reconfigurable heterotransistor array can be further adopted to enhance the traffic-light detection under dim-light conditions. Our advancement in momentum-conserved reconfigurable heterotransistor signifies a leap forward in real-time, energy-efficient, and low-light image processing for neuromorphic vision sensors.

Non-resonant background removal in broadband CARS microscopy using deep-learning algorithms

Broadband Coherent anti-Stokes Raman (BCARS) microscopy is an imaging technique that can acquire full Raman spectra (400–3200 cm−1) of biological samples within a few milliseconds. However, the CARS signal suffers from an undesired non-resonant background (NRB), deriving from four-wave-mixing processes, which distorts the peak line shapes and reduces the chemical contrast. Traditionally, the NRB is removed using numerical algorithms that require expert users and knowledge of the NRB spectral profile. Recently, deep-learning models proved to be powerful tools for unsupervised automation and acceleration of NRB removal. Here, we thoroughly review the existing NRB removal deep-learning models (SpecNet, VECTOR, LSTM, Bi-LSTM) and present two novel architectures. The first one combines convolutional layers with Gated Recurrent Units (CNN + GRU); the second one is a Generative Adversarial Network (GAN) that trains an encoder-decoder network and an adversarial convolutional neural network. We also introduce an improved training dataset, generalized on different BCARS experimental configurations. We compare the performances of all these networks on test and experimental data, using them in the pipeline for spectral unmixing of BCARS images. Our analyses show that CNN + GRU and VECTOR are the networks giving the highest accuracy, GAN is the one that predicts the highest number of true positive peaks in experimental data, whereas GAN and VECTOR are the most suitable ones for real-time processing of BCARS images.

Prototype for Multi-UAV Monitoring–Control System Using WebRTC

Most unmanned aerial vehicle (UAV) ground control station (GCS) solutions today are either web-based or native applications, primarily designed to support a single UAV. In this paper, our research aims to provide an open, universal framework intended for rapid prototyping, addressing these objectives by developing a Web Real-Time Communication (WebRTC)-based multi-UAV monitoring and control system for applications such as automated power line inspection (APOLI). The APOLI project focuses on identifying damage and faults in power line insulators through real-time image processing, video streaming, and flight data monitoring. The implementation is divided into three main parts. First, we configure UAVs for hardware-accelerated streaming using the GStreamer framework on the NVIDIA Jetson Nano companion board. Second, we develop the server-side application to receive hardware-encoded video feeds from the UAVs by utilizing a WebRTC media server. Lastly, we develop a web application that facilitates communication between clients and the server, allowing users with different authorization levels to access video feeds and control the UAVs. The system supports three user types: pilot/admin, inspector, and customer. Our research aims to leverage the WebRTC media server framework to develop a web-based GCS solution capable of managing multiple UAVs with low latency. The proposed solution enables real-time video streaming and flight data collection from multiple UAVs to a server, which is displayed in a web application interface hosted on the GCS. This approach ensures efficient inspection for applications like APOLI while prioritizing UAV safety during critical scenarios. Another advantage of the solution is its integration compatibility with platforms such as cloud services and native applications, as well as the modularity of the plugin-based architecture offered by the Janus WebRTC server for future development.

Development of Digital Image Processing Algorithms via FPGA Implementation

Real-time image processing is one of the fundamental elements in achieving IR 4.0. The rapid development of digital image processing techniques has enabled various applications in fields such as healthcare, transportation, and manufacturing. People are seeking higher-performance image processing as traditional image processing is no longer fulfilling the demands. FPGA-based digital image processing has become one of the choices for the public due to its parallel pipelining, which enables shorter processing time and better performance. Several digital image processing algorithms have been developed in this project, which are gray level transformation, brightness manipulation, contrast adjustment, thresholding, and inversion. They are the most popular algorithms used in digital image processing. Microsoft Paint is used to convert the format of the color input image to bitmap format, followed by MATLAB to convert it into a hexadecimal file to be read and written in FPGA. Platforms such as ModelSim Altera and Intel Quartus II are used to write Verilog HDL for digital image processing algorithms. As a result, five hexadecimal files are obtained from the simulation. The output hexadecimal files are further processed in MATLAB to generate respective images.

Spatio-temporal breather dynamics in microcomb soliton crystals

Solitons, the distinct balance between nonlinearity and dispersion, provide a route toward ultrafast electromagnetic pulse shaping, high-harmonic generation, real-time image processing, and RF photonic communications. Here we uniquely explore and observe the spatio-temporal breather dynamics of optical soliton crystals in frequency microcombs, examining spatial breathers, chaos transitions, and dynamical deterministic switching – in nonlinear measurements and theory. To understand the breather solitons, we describe their dynamical routes and two example transitional maps of the ensemble spatial breathers, with and without chaos initiation. We elucidate the physical mechanisms of the breather dynamics in the soliton crystal microcombs, in the interaction plane limit cycles and in the domain-wall understanding with parity symmetry breaking from third-order dispersion. We present maps of the accessible nonlinear regions, the breather frequency dependences on third-order dispersion and avoided-mode crossing strengths, and the transition between the collective breather spatio-temporal states. Our range of measurements matches well with our first-principles theory and nonlinear modeling. To image these soliton ensembles and their breathers, we further constructed panoramic temporal imaging for simultaneous fast- and slow-axis two-dimensional mapping of the breathers. In the phase-differential sampling, we present two-dimensional evolution maps of soliton crystal breathers, including with defects, in both stable breathers and breathers with drift. Our fundamental studies contribute to the understanding of nonlinear dynamics in soliton crystal complexes, their spatio-temporal dependences, and their stability-existence zones.

Unmanned aerial vehicle landing localization technology based on visual dual-channel uniqueness coding

Unmanned aerial vehicle (UAV) mainly uses GPS (Global Positioning System) for positioning, but it is difficult to locate in areas where GPS signal is missing or being disturbed. Therefore, the relative positioning technology based on visual method is also widely used in UAV landing, but due to the influence of cross wind and the motion of the landing plane, the traditional visual landing sign and positioning method is prone to lose the positioning target at the end stage of the landing. Therefore, this article proposes a landing sign based on double-layer unique coding, which can realize continuous positioning in the horizontal direction and accurate positioning of large-scale changes in the vertical direction. Firstly, real-time image acquisition and image processing are carried out through the airborne camera. Based on the flight altitude and encoding extraction effect of the UAV, the red or blue channel component is extracted, and then the image is preprocessed, edge detection, line detection, coding grid extraction, etc. As long as any 5 × 5 small squares of the whole pattern can be extracted, the perspective-n-point algorithm is used to obtain the relative pose estimation between the UAV and the landing sign. Experiments show that the landing sign and recognition algorithm effectively improve the UAV landing reliability.

A hybrid hue saturation lightness, gray level co-occurrence matrix, and k-nearest neighbour for palm-sugar classification

<span lang="EN-US">In recent years, there has been an increasing demand for high-quality raw materials driven by consumers and the food industry. This study aims to build a model to predict the type of </span><span lang="IN">palm</span><span lang="EN-US"> sugar using a hybrid method of hue</span><span lang="IN">-</span><span lang="EN-US">saturation</span><span lang="IN">-l</span><span lang="EN-US">ightness (HSL), gray level co-occurrence matrix (GLCM), and K-nearest neighbor (KNN). The price of palm sugar is determined based on the type and ingredients used. However, due to the lack of public knowledge in distinguishing the types of </span><span lang="IN">palm</span><span lang="EN-US"> sugar, there is the potential for price manipulation that can harm the community. The accuracy rate of 9</span><span lang="IN">7.6</span><span lang="EN-US">% of the palm sugar type prediction results shows that the model that was built has worked very well. The results have practical implications, such as developing automated systems to classify palm species in specific industries to benefit economics and operational efficiency. Future research directions may explore the integration of advanced machine-learning techniques and real-time image processing for further improving classification performance and scalability in industrial applications</span><span lang="IN">.</span>

Energy-efficient real-time visual image adversarial generation and processing algorithm for new energy vehicles

Energy-efficient real-time visual image adversarial generation and processing algorithm for new energy vehicles

Development and Evaluation of a New Algorithm for Real-Time Image Processing

When working with real-time images, creating and testing new methods is very important for making computers work faster and more accurately. This study describes a new method that is meant to solve problems in real-time picture processing applications by making them faster and better at what they do. It was created because of the need to deal with picture data that was getting more complicated in many areas, including autonomous systems, medical imaging, monitoring, and multimedia apps. Several new methods are built into the suggested program to help it reach its goals. To begin, it uses advanced parallel processing designs to speed up calculations without lowering their quality. The method cuts down on processing delays by making the best use of resources and job ordering. This makes it ideal for time-sensitive apps that need to make quick decisions based on real-time picture data. The algorithm also uses strong feature extraction techniques that are designed to work well with a wide range of picture traits and noise levels. This improves the algorithm's ability to work in a variety of settings, making sure it always works well in different working situations. Adaptive filtering mechanisms and advanced edge recognition algorithms are two important parts of the algorithm that work together to make it quick and easy to get useful information. A lot of testing was done to see how well the algorithm worked against the best available methods, using normal image processing datasets and real-life situations. A lot of attention was paid to performance measures like processing speed, accuracy in feature recognition, and computer economy. When compared to traditional methods, comparative research showed big gains in processing speed without sacrificing accuracy.

Energy efficiency assessment in advanced driver assistance systems with real-time image processing on custom Xilinx DPUs

Energy efficiency assessment in advanced driver assistance systems with real-time image processing on custom Xilinx DPUs

Design of an image processing system for heterogeneous computer architectures

Embedded real-time image processing systems are widely applied in various fields, enhancing visual experience and making life more convenient. With the development of embedded processors and operating systems, as well as in-depth research into image processing algorithms, the effects and speed of image processing have been significantly improved. This paper proposes an embedded image processing system design based on the current technological developments, centered around the Zybo processor. This includes a collaborative hardware and software design, specific hardware circuit design, and the design of a system software platform. The paper also discusses the establishment of a development environment for the Zybo system, the transplantation of the Linux operating system, the design of the file system, and the application of OpenCV library functions in image processing.

Optimization Algorithms for Real-Time Image Processing in IoT Networks

This study explores the application of optimization algorithms, with a focus on Particle Swarm Optimization (PSO), to enhance real-time image processing in Internet of Things (IoT) networks. Given the constraints of computational power and energy resources in IoT devices, efficient processing of image data is a critical challenge. The proposed PSO-based framework aims to minimize processing time and energy consumption while maintaining high accuracy in image analysis tasks. Experimental results demonstrate that PSO can reduce processing time by 10% and energy consumption by 15% on average, with a slight improvement in accuracy. Comparisons with traditional and other evolutionary optimization techniques reveal that PSO provides a superior balance between efficiency and performance, making it particularly well-suited for real-time IoT applications. The findings suggest that the integration of advanced optimization algorithms like PSO into IoT systems can significantly enhance their operational efficiency, scalability, and effectiveness, particularly in resource-constrained environments.

Design and Implementation of High-Performance FPGA Accelerator for Non-Separable Discrete Fourier Transform Optimizing Real-Time Image and Video Processing

Design and Implementation of High-Performance FPGA Accelerator for Non-Separable Discrete Fourier Transform Optimizing Real-Time Image and Video Processing

Design of a real-time image processing system based on FPGA

To enhance the real-time performance of image processing, effectively reduce video transmission bandwidth and storage space, and improve transmission efficiency, a real-time image processing system was designed using a Field Programmable Gate Array (FPGA). The system is mainly divided into image acquisition, image processing, and image display subsystems. Images are captured using a camera module and transmitted to the image processing module for processing, and finally displayed via an HDMI monitor. Measurements indicate that the system has strong real-time performance, low power consumption, and high portability, making it valuable in fields such as surveillance and security, medical imaging, and industrial automation.

A Review of Real Time Image Processing for Object Detection

A Review of Real Time Image Processing for Object Detection

Journal of real-time image processing: fourth issue of volume 21

Journal of real-time image processing: fourth issue of volume 21

Super-resolution radial fluctuations (SRRF) algorithm with better real-time performance

Super-resolution radial fluctuations (SRRF) is a type of statistical analysis based on fluorescence fluctuation characteristics to achieve super-resolution imaging. At present, facing the problems of slow reconstruction speed and weak real-time image processing. For dealing with these issues, parallel computing characteristics of FPGA is employed in this paper to achieve the acceleration of the algorithm. Firstly, the reconstruction process of SRRF algorithm process is split into five sub-modules, which are designed depended on the pipeline design idea. Secondly, the top-level module is designed to accomplish the sub-modules connection for executing the SRRF algorithmic process, while the reconstruction is finished by using the high-density image dataset. Finally, the single-frame image processing time is recorded and analysed in FPGA with the mainstream configuration of PC. The experimental results show that, in terms of the single frame image processing time, SRRF in FPGA is improved by 77.95% compared to PC, with real-time image processing capability under 10 ms image sampling period. In addition, the resolution-scaled Pearson coefficient (RSP) and resolution-scaled error (RSE) values of the reconstruction results in FPGA are similar to those of PC.

Real-time FPGA Implementation of an Optic Flow Algorithm Suitable for Background Oriented Schlieren Technique

Abstract To meet the demands of real-time displacement detection in embedded systems, a real-time optical flow calculation method suitable for background oriented schlieren (BOS) technology was transplanted and implemented on an Field Programmable Gate Array(FPGA) system. Firstly, through the analysis of different optical flow operation characteristics and the comparison of processing results in MATLAB with actual experimental data, an optical flow algorithm suitable for real-time processing of background shadow images was selected. Subsequently, by using hardware pipelining and multimodule parallel processing, the single-layer L&K optical flow algorithm was transplanted onto the FPGA and algorithm optimization was performed to achieve real-time optical flow calculation based on adjacent frame images. The key optimization techniques in this paper mainly include cleverly designing Double-Data-Rate Three Synchronous Dynamic Random Access Memory (DDR3) memory partitioning read and write logic to avoid image read and write conflicts; ensuring the timing alignment and data synchronization of consecutive frames by using burst read arbitration modules and two independent First In First Out (FIFO) buffers; and in optical flow calculation, constructing a 3×3 window using a shifting FIFO method to effectively save cache resources and improve computational speed. Experimental results show that the system can achieve real-time processing speeds of not less than 60fps for 1024×768 resolution images, meeting the requirements of practical applications.

A Comprehensive Study on Image Segmentation Using Pulse-Coupled Neural Networks

Pulse-Coupled Neural Network (PCNN) operates as a matrix of neurons, each uniquely corresponding to a pixel in the image being processed. Unlike traditional neural networks, PCNN does not require any training, making it highly suitable for image segmentation tasks. However, the complexity of PCNN arises from its numerous parameters, making parameter selection a challenging endeavor. In this work, we introduce a simplified PCNN architecture that includes an automatic parameter determination method. This approach is specifically designed for binary image segmentation and has been tested on various images, yielding results with distinct and desirable features. The proposed network iterates only four times, enhancing its efficiency. During pre-processing, RGB images are converted to HSV color space, and the V component undergoes further processing. This component is first filtered using an averaging filter, followed by a sharpening filter. The parameters for the PCNN are then generated automatically, eliminating the need for manual selection and making the network highly suitable for real-time image processing. The performance of the proposed network has been verified through tests on a variety of images. Key Words: Neural Networks, Pulse Coupled Neural Networks, Image Processing