Image Edge Research Articles

Temporally Coherent Video Cartoonization for Animation Scenery Generation

The automatic transformation of short background videos from real scenarios into other forms with a visually pleasing style, like those used in cartoons, holds application in various domains. These include animated films, video games, advertisements, and many other areas that involve visual content creation. A method or tool that can perform this task would inspire, facilitate, and streamline the work of artists and people who produce this type of content. This work proposes a method that integrates multiple components to translate short background videos into other forms that contain a particular style. We apply a fine-tuned latent diffusion model with an image-to-image setting, conditioned with the image edges (computed with holistically nested edge detection) and CLIP-generated prompts to translate the keyframes from a source video, ensuring content preservation. To maintain temporal coherence, the keyframes are translated into grids and the style is interpolated with an example-based style propagation algorithm. We quantitatively assess the content preservation and temporal coherence using CLIP-based metrics over a new dataset of 20 videos translated into three distinct styles.

Applications of GANs to Aid Target Detection in SAR Operations: A Systematic Literature Review

Research on unmanned autonomous vehicles (UAVs) for search and rescue (SAR) missions is widespread due to its cost-effectiveness and enhancement of security and flexibility in operations. However, a significant challenge arises from the quality of sensors, terrain variability, noise, and the sizes of targets in the images and videos taken by them. Generative adversarial networks (GANs), introduced by Ian Goodfellow, among their variations, can offer excellent solutions for improving the quality of sensors, regarding super-resolution, noise removal, and other image processing issues. To identify new insights and guidance on how to apply GANs to detect living beings in SAR operations, a PRISMA-oriented systematic literature review was conducted to analyze primary studies that explore the usage of GANs for edge or object detection in images captured by drones. The results demonstrate the utilization of GAN algorithms in the realm of image enhancement for object detection, along with the metrics employed for tool validation. These findings provide insights on how to apply or modify them to aid in target identification during search stages.

Devising an edge effect compensation procedure to eliminate structural distortions during frequency filtering

The object of this study is the process of filtering astronomical frames that contain images of potential objects in the Solar System. To recognize the image of each such object in contrast with the background of the frame, it is necessary to carry out frequency filtering of the image. Any frequency filtering using various image filters is aimed at reducing the dynamic range of the background substrate. Also, frequency filtering leads to an increase in the signal-to-noise ratio of the entire image or its fragments, depending on the configuration. However, the identified problem area of each image during frequency filtering is the distortion of the structure of its edges. Therefore, to solve this problem, an edge effect compensation procedure has been proposed to eliminate structural distortions during frequency filtering. Complementing the image with borders on all sides and the augmented extended image made it possible to introduce a formal connection between the pixel values of the extended image fragment and the pixel values of the extended original image. Testing was carried out using a high-pass Gaussian filter. The use of the devised edge effect compensation procedure made it possible to remove distortion of the structure of the image edges. The devised edge effect compensation procedure was tested in practice within the CoLiTec project. It was implemented during the in-frame processing stage of the Lemur software. The study showed that the use of the devised edge effect compensation procedure makes it possible to remove image artifacts compared to conventional filtering without taking into account the edge effect. Also, owing to edge effect compensation, structural image distortions were eliminated, and the signal-to-noise ratio was increased by 7–10 times

Elephant herding optimized features-based fast RCNN for classifying leukemia stages.

Leukemia is a cancer that develops in the bone marrow and blood that is brought on by an excessive generation of abnormal white blood cells. This disease damages deoxyribonucleic acid (DNA), which is associated with immature cells, particularly white blood cells. It is time-consuming and requires enhanced accuracy for radiologists to diagnose acute leukemia cells. To overcome this issue, we have studied the use of a novel proposed LEU-EHO NET. LEU-EHO NET has been proposed for classifying blood smear images based on leukemia-free and leukemia-infected images. Initially, the input blood smear images are pre-processed using two techniques: normalization and cropping black edges in images. The pre-processed images are then subjected to MobileNet for feature extraction. After that, Elephant Herding Optimization (EHO) is used to select the relevant feature from the retrieved characteristics. Finally, Faster RCNN is trained with the selected features to perform the classification task and discriminate between Normal and Abnormal. The total accuracy of the proposed LEU-EHO NET is 99.30%. The proposed LEU-EHO NET model enhances the overall accuracy by 0.69%, 16.21%, 1.10%, 1.71%, and 1.38% better than Inception v3 XGBoost, VGGNet, DNN, SVM and MobilenetV2 respectively. The approach needs to be improved so that overlapped cells can be segmented more accurately. Additionally, future work might improve classification accuracy by utilizing different deep learning models.

Infrared superpixel patch-image model for small target detection under complex background

The main problem of infrared small target detection in complex background is how to effectively eliminate the edge residue. In this paper, we propose an efficient method named Superpixel Patch Image (SPI) model to handle this challenging task. The SPI model can fit the edges of the background well, thus effectively eliminating edge interference in the process of target detection, and achieving excellent performance. The SPI method consists of three steps: Firstly, an improved Simple Linear Iterative Clustering (ISLIC) algorithm is proposed to generate compact superpixels that perfectly match the background edge. Secondly, setting each superpixel patch as a column, a large patch-image matrix is constructed, and the target foreground image and background image is separated by imprecisely augmented Lagrange multiplication. Finally, based on the comprehensively analysis of the distribution characteristics of the target and the highlighted edge in the foreground image, an adaptive threshold is used to extract the target from the foreground superpixel patch. The experimental results of real infrared scenes show that the presented SPI model achieves the best SCRG, BSF and ROC curves compared with the existing 9 state-of-art algorithms, and can effectively extract small targets under different complex backgrounds.

Dual cross perception network with texture and boundary guidance for camouflaged object detection

Camouflaged object detection (COD) is a task needs to segment objects that subtly blend into their surroundings effectively. Edge and texture information of the objects can be utilized to reveal the edges of camouflaged objects and detect texture differences between camouflaged objects and the surrounding environment. However, existing methods often fail to fully exploit the advantages of these two types of information. Considering this, our paper proposes an innovative Dual Cross Perception Network (DCPNet) with texture and boundary guidance for camouflaged object detection. DCPNet consists of two essential modules, namely Dual Cross Fusion Module (DCFM) and the Subgroup Aggregation Module (SAM). DCFM utilizes attention techniques to emphasize the information that exists in edges and textures by cross-fusing features of the edge, texture, and basic RGB image, which strengthens the ability to capture edge information and texture details in image analysis. SAM gives varied weights to low-level and high-level features in order to enhance the comprehension of objects and scenes of various sizes. Several experiments have demonstrated that DCPNet outperforms 13 state-of-the-art methods on four widely used assessment metrics.

Enhanced human motion detection with hybrid RDA-WOA-based RNN and multiple hypothesis tracking for occlusion handling

Human motion detection in complex scenarios poses challenges due to occlusions. This paper presents an integrated approach for accurate human motion detections by combining Adapted Canny Edge detection as a preprocessing step, backbone-modified Mask R-CNN for precise segmentation, Hybrid RDA-WOA-based RNN as a classification, and a Multiple-hypothesis model for effective occlusion handling. Adapted Canny Edge detection is utilized as an initial preprocessing step to highlight significant edges in the input image. The resulting edge map enhances object boundaries and highlights structural features, simplifying subsequent processing steps. The improved image is then passed through backbone-modified Mask R-CNN for the pixel-level segmentation of humans. Backbone-modified Mask R-CNN along with IoU, Euclidean Distance, and Z-Score recognizes moving objects in complex scenes exactly. After recognizing moving objects, the optimized Hybrid RDA-WOA-based RNN classifies humans. To handle the self-occlusion, Multiple Hypothesis Tracking (MHT) is used. Real-world situations frequently include occlusions where humans can be partially or completely hidden by objects. The proposed approach integrates a Multiple-hypothesis model into the detection pipeline to address this challenge. Moreover, the proposed human motion detection approach includes an optimized Hybrid RDA-WOA-based RNN trained with 2D representations of 3D skeletal motion. The proposed work was evaluated using the IXMAS, KTH, Weizmann, NTU RGB + D, and UCF101 Datasets. It achieved an accuracy of 98% on the IXMAS, KTH, Weizmann, and UCF101 Datasets and 97.1% on the NTU RGB + D Dataset. The simulation results unveil the superiority of the proposed methodology over the existing approaches.

Quantum image edge detection based on Haar wavelet transform

Quantum image edge detection based on Haar wavelet transform

Active contour model with improved second-order differential driven term

Driven terms in active contour models (ACMs) play a significant role in edge identification and image segmentation. However, in many existing ACMs, the driven terms are iteratively updated, resulting in slower segmentation speed because the image segmentation time increases with the iteration number. To address this problem, an ACM based on an improved second-order differential driven term (ISDDT) is presented, which can extract the edge information of images. The improved second-order differential driven term is computed only once before the iterations. Therefore, the computational complexity of our presented ACM is reduced, leading to a faster image segmentation speed. In addition, an improved regularization method with mean filtering is presented to improve the robustness of our ISDDT model. As an application, a target contour tracking method is developed based on our ISDDT model. Experimental results show that our ISDDT model segments images with inhomogeneous intensities well. The image segmentation speed of our proposed model has obvious advantages.

Connected smart elevator systems for smart power and time saving

Smart elevators provide substantial promise for time and energy management applications by utilizing cutting edge artificial intelligence and image processing technology. In order to improve operating efficiency, this project designs an elevator system that uses the YOLO model for object detection. Compared to traditional methods, our results show a 15% improvement in wait times and a 20% reduction in energy use. Due to the elevator’s increased accuracy and dependability, users’ qualitative feedback shows a high degree of pleasure. These results imply that intelligent elevator systems can make a significant contribution to more intelligent building management. Due to the elevator’s increased accuracy and dependability, users’ qualitative feedback shows a high degree of pleasure. These results imply that intelligent elevator systems can make a significant contribution to more intelligent building management. The successful integration of artificial intelligence (AI) and image processing technologies in elevator systems presents a promising foundation for future research and development. Further advancements in object detection algorithms, such as refining YOLO models for even higher accuracy and real-time adaptability, hold potential to enhance operational efficiency. Integrating smart elevators more deeply into IoT networks and building management systems could enable comprehensive energy management strategies and real-time decision-making. Predictive maintenance models tailored to elevator components could minimize downtime and optimize service schedules, enhancing overall reliability. Additionally, exploring adaptive user interfaces and personalized scheduling algorithms could further elevate user satisfaction by tailoring elevator interactions to individual preferences. Sustainable practices, including energy-efficient designs and integration of renewable energy sources, represent crucial avenues for reducing environmental impact. Addressing security concerns through advanced encryption and access control mechanisms will be essential for safeguarding sensitive data in smart elevator systems.

Flexible optoelectronic N-I-P synaptic device with visible spectrum perception for energy-efficient artificial vision and efferent neuromuscular system

We have designed a flexible photoelectric artificial synapse with an oxide/mixed perovskite/polymer N-I-P structure that exhibits essential synaptic plasticity. Formamidinium lead triiodide FAPbI3 perovskite doped with bromine and methylammonium (FAxMA1−xPbI2Br) is employed as the intrinsic layer to improve the optical properties of devices. Without requiring a power source in reaction to outside optical spikes, multiple pulse-dependent plasticity is reproduced on the synaptic devices, and the image's edges are sharpened using high-pass filtering. Additionally, the classical conditioning and spatiotemporal learning are copied under the electric pulse excitation. Significant negative differential resistance is evident, even after 1500 flex/flat mechanical operation. The recognition rate of letters in the visual system is as high as 92%, and the walking distance in the efferent neuromuscular system is controllable. The flexible optoelectronic N-I-P synaptic device is designed to facilitate energy-efficient information processing for neuromorphic computing.

Adaptive edge prior-based deep attention residual network for low-dose CT image denoising

Improving the diagnostic quality of low-dose CT (LDCT) images relies on effective noise removal. Recent advancements have highlighted the widespread use of deep residual networks for LDCT image denoising. These networks possess properties that aid in preserving image integrity and optimizing model performance. However, the denoising process faces challenges due to the complex patterns and intensity similarities between edge details and lesion regions. To address this issue, this paper introduces a novel approach called the cross-scale attentional residual network (RCANet), which utilizes an adaptive edge prior for LDCT image denoising. The adaptive edge prior enhances the denoising network’s ability to retain image boundary features and uniqueness. To distinguish subtle differences between LDCT image edge details and lesion areas, a cross-scale mapping dual-element module (CMDM) is designed to preserve rich edge texture information during model training. To prevent over-smoothing of denoised results, a compound loss function is proposed, combining MSE loss and multi-scale attention residual perception loss. To validate the effectiveness of the method, experiments were conducted on the AAPM-Mayo Clinic LDCT Grand Challenge dataset. The results demonstrate that RCANet surpasses state-of-the-art residual structure-based network models and performs comparably to leading denoising algorithms.

ICPNet: Advanced Maize Leaf Disease Detection with Multidimensional Attention and Coordinate Depthwise Convolution.

Maize is an important crop, and the detection of maize diseases is critical for ensuring food security and improving agricultural production efficiency. To address the challenges of difficult feature extraction due to the high similarity among maize leaf disease species, the blurring of image edge features, and the susceptibility of maize leaf images to noise during acquisition and transmission, we propose a maize disease detection method based on ICPNet (Integrated multidimensional attention coordinate depthwise convolution PSO (Particle Swarm Optimization)-Integrated lion optimisation algorithm network). Firstly, we introduce a novel attention mechanism called Integrated Multidimensional Attention (IMA), which enhances the stability and responsiveness of the model in detecting small speckled disease features by combining cross-attention and spatial channel reconstruction methods. Secondly, we propose Coordinate Depthwise Convolution (CDC) to enhance the accuracy of feature maps through multi-scale convolutional processing, allowing for better differentiation of the fuzzy edges of maize leaf disease regions. To further optimize model performance, we introduce the PSO-Integrated Lion Optimisation Algorithm (PLOA), which leverages the exploratory stochasticity and annealing mechanism of the particle swarm algorithm to enhance the model's ability to handle mutation points while maintaining training stability and robustness. The experimental results demonstrate that ICPNet achieved an average accuracy of 88.4% and a precision of 87.3% on the self-constructed dataset. This method effectively extracts the tiny and fuzzy edge features of maize leaf diseases, providing a valuable reference for disease control in large-scale maize production.

Structured adaptive boosting trees for detection of multicellular aggregates in fluorescence intravital microscopy

Fluorescence intravital microscopy captures large data sets of dynamic multicellular interactions within various organs such as the lungs, liver, and brain of living subjects. In medical imaging, edge detection is used to accurately identify and delineate important structures and boundaries inside the images. To improve edge sharpness, edge detection frequently requires the inclusion of low-level features. Herein, a machine learning approach is needed to automate the edge detection of multicellular aggregates of distinctly labeled blood cells within the microcirculation. In this work, the Structured Adaptive Boosting Trees algorithm (AdaBoost.S) is proposed as a contribution to overcome some of the edge detection challenges related to medical images. Algorithm design is based on the observation that edges over an image mask often exhibit special structures and are interdependent. Such structures can be predicted using the features extracted from a bigger image patch that covers the image edge mask. The proposed AdaBoost.S is applied to detect multicellular aggregates within blood vessels from the fluorescence lung intravital images of mice exposed to e-cigarette vapor. The predictive capabilities of this approach for detecting platelet-neutrophil aggregates within the lung blood vessels are evaluated against three conventional machine learning algorithms: Random Forest, XGBoost and Decision Tree. AdaBoost.S exhibits a mean recall, F-score, and precision of 0.81, 0.79, and 0.78, respectively. Compared to all three existing algorithms, AdaBoost.S has statistically better performance for recall and F-score. Although AdaBoost.S does not outperform Random Forest in precision, it remains superior to the XGBoost and Decision Tree algorithms. The proposed AdaBoost.S is widely applicable to analysis of other fluorescence intravital microscopy applications including cancer, infection, and cardiovascular disease.

Simple ultrasonic mixing to obtain charge transfer dopants of graphene oxide for highly responsive photodetectors and efficient image extraction

Regulating the charge-related properties in materials is highly valuable in the field of electronic devices. Charge transfer doping received significant attention as an efficient method of modulation. Graphene oxide (GO) is often used for regulation due to its abundance of oxygen-containing groups. However, the conventional operations to perform charge transfer doping for GO are complex, expensive and environmentally unfriendly. Here, we propose a charge transfer doping strategy by simply mixing GO suspension with 5 mg/ml 2,3,5,6-tetrafluoro-7,7,8,8-tetracyano-quinodimethane (F4TCNQ), together with ultrasonic treatment. Notably, the F4TCNQ-GO flexible photodetector exhibits outstanding responsivity (R) of up to 1.57 × 103 A/W in the 650 nm regime, surpassing most of the GO/graphene-based photodetectors reported in the past decade. Moreover, the photodetector successfully realizes in-sensor computing for complex pattern imaging, enabling clear and efficient multi-directional edge extraction. Experiments employing X-ray photoelectron spectra (XPS), X-ray diffraction spectra (XRD), Raman spectra, Ultraviolet–visible (UV–vis) spectra and scanning electron microscopy (SEM) reveal the stable non-covalent binding between GO and F4TCNQ through π-π interactions, as well as the electron transfer from GO to the F4TCNQ molecule, resulting in the formation of electron accumulation and depletion layers on the F4TCNQ molecule and GO, respectively. This finding holds great potential for regulating the electronic properties of a wide range of π-electron-rich two-dimensional materials in the fields of energy, biomedicine, environmental technology, and materials science.

MPE-DETR: A multiscale pyramid enhancement network for object detection in low-light images

Object detection has broad applications in areas such as autonomous driving, security surveillance, and deep-sea exploration. However, the performance of current detection algorithms significantly decreases due to the loss of detail, increased noise, and color distortion in images under low-light or nighttime conditions. To address this problem, we propose a plug-and-play multiscale pyramid enhancement network (MPENet), which elegantly cascades with RT-DETR to establish an end-to-end framework for low-light object detection, named MPE-DETR. First, MPENet utilizes Gaussian blur to decompose images into Gaussian pyramids and Laplacian pyramids at different resolutions. Specifically, we designed a high-frequency texture enhancement (HTE) module to capture the edge and texture information of images, and a low-frequency noise smoothing (LNS) module to better understand the overall structure of images and capture global-scale features. Additionally, by concatenating the output features of the HTE and LNS modules along the channel dimension, feature fusion across different scales is realized. We conducted experiments on the ExDark and ExDark + LOD datasets, which are designed for low-light object detection. The results indicate that the proposed method achieved an improvement of 2.1% in mAP@.5 compared to that of existing SOTA models on the ExDark dataset, and demonstrated strong generalizability and robustness on the ExDark + LOD dataset. The code and results are available at https://github.com/PZDJL/MPENet.

Multi-order optical spatial vortex filters for simultaneous contour extraction of various parts of an object

We study the transformation of the analyzed object by a variety of spatial filters including bandpass, differential, radial filters, various types of vortex filters, and Hilbert filters. Advantages and disadvantages of different filters in terms of clarity and direction-invariance of edge extraction, as well as the energy efficiency are numerically demonstrated. Based on the results obtained, multi-order optical spatial vortex filters with different parameters are developed for simultaneously extracting contours of various object parts. We show that a multi-order filter makes it possible to form a set of images in one plane with a clearly defined contour, object corners and various parts of the contour. Numerical and experimental testing of 4- and 5-channel spatial vortex filters of various types was applied for test objects. A possibility of using the proposed filters to simultaneously highlight the edges of the entire image and various parts of the image in order to extract more features from the analyzed image is shown.

4D Analysis and Research of Art Painting Intelligent Fusion Based on Calligraphy Character Image Edge Recognition Algorithm

4D Analysis and Research of Art Painting Intelligent Fusion Based on Calligraphy Character Image Edge Recognition Algorithm

Overlapping Shoeprint Detection by Edge Detection and Deep Learning.

In the field of 2-D image processing and computer vision, accurately detecting and segmenting objects in scenarios where they overlap or are obscured remains a challenge. This difficulty is worse in the analysis of shoeprints used in forensic investigations because they are embedded in noisy environments such as the ground and can be indistinct. Traditional convolutional neural networks (CNNs), despite their success in various image analysis tasks, struggle with accurately delineating overlapping objects due to the complexity of segmenting intertwined textures and boundaries against a background of noise. This study introduces and employs the YOLO (You Only Look Once) model enhanced by edge detection and image segmentation techniques to improve the detection of overlapping shoeprints. By focusing on the critical boundary information between shoeprint textures and the ground, our method demonstrates improvements in sensitivity and precision, achieving confidence levels above 85% for minimally overlapped images and maintaining above 70% for extensively overlapped instances. Heatmaps of convolution layers were generated to show how the network converges towards successful detection using these enhancements. This research may provide a potential methodology for addressing the broader challenge of detecting multiple overlapping objects against noisy backgrounds.

An improved method for upscaling 2D images using adaptive edge sharpening and an optimized directional anisotropic diffusion filter

Image upscaling employs various polynomial techniques, including bicubic and Lanczos, to minimize computing load for various real-time applications. Polynomial interpolation, on the other hand, results in blurring artifacts in high resolution (HR) images due to edge degradation. Many other interpolation approaches, including edge-based and dictionary learning-based schemes, result in blurring in the image’s high frequency (HF) region. As a result, a novel post-processing technique is proposed that uses the Lanczos method to upscale the low resolution (LR) image. To eliminate blur along the image’s edge, the edge component of the interpolated image is retrieved. Adaptive sharpening is used to make the edges more prominent, as predicting pixels in the high variance region is challenging. After the edge is extracted, the smooth region is filtered with an optimized directional anisotropic diffusion (ODAD) filter to preserve texture details and geometric regularity. The sharpened edge image is aggregated with the ODAD filtered image to generate an improved HR (IHR) image. The IHR is then scaled up and down to reduce blurring even further, resulting in a blurred HR image (BHR). The residual image is obtained by subtracting the BHR from the IHR images, which represent the undetected HF. Finally, the residual image and the IHR image are combined to generate the final restored image, which includes all prediction loss details. The results of the experiments show that the proposed algorithm outperforms existing methodologies, particularly in terms of visuality and parameter-wise measurement.