RGB Images Research Articles

Enhanced Estimation of Crown-Level Leaf Dry Biomass of Ginkgo Saplings Based on Multi-Height UAV Imagery and Digital Aerial Photogrammetry Point Cloud Data

Ginkgo is a multi-purpose economic tree species that plays a significant role in human production and daily life. The dry biomass of leaves serves as an accurate key indicator of the growth status of Ginkgo saplings and represents a direct source of economic yield. Given the characteristics of flexibility and high operational efficiency, affordable unmanned aerial vehicles (UAVs) have been utilized for estimating aboveground biomass in plantations, but not specifically for estimating leaf biomass at the individual sapling level. Furthermore, previous studies have primarily focused on image metrics while neglecting the potential of digital aerial photogrammetry (DAP) point cloud metrics. This study aims to investigate the estimation of crown-level leaf biomass in 3-year-old Ginkgo saplings subjected to different nitrogen treatments, using a synergistic approach that combines both image metrics and DAP metrics derived from UAV RGB images captured at varying flight heights (30 m, 60 m, and 90 m). In this study, image metrics (including the color and texture feature parameters) and DAP point cloud metrics (encompassing crown-level structural parameters, height-related and density-related metrics) were extracted and evaluated for modeling leaf biomass. The results indicated that models that utilized both image metrics and point cloud metrics generally outperformed those relying solely on image metrics. Notably, the combination of image metrics obtained from the 60 m flight height with DAP metrics derived from the 30 m height significantly enhanced the overall modeling performance, especially when optimal metrics were selected through a backward elimination approach. Among the regression methods employed, Gaussian process regression (GPR) models exhibited superior performance (CV-R2 = 0.79, rRMSE = 25.22% for the best model), compared to Partial Least Squares Regression (PLSR) models. The common critical image metrics for both GPR and PLSR models were found to be related to chlorophyll (including G, B, and their normalized indices such as NGI and NBI), while key common structural parameters from the DAP metrics included height-related and crown-related features (specifically, tree height and crown width). This approach of integrating optimal image metrics with DAP metrics derived from multi-height UAV imagery shows great promise for estimating crown-level leaf biomass in Ginkgo saplings and potentially other tree crops.

An automatic method for scoring poultry footpad dermatitis with deep learning and thermal imaging

Footpad dermatitis (FPD) is a common poultry condition that can negatively influence chickens’ production, welfare, and health. However, no automated tool for monitoring FPD in live chickens is currently available. The objective of this study was to develop and optimize deep learning models to monitor hens’ FPD scores (i.e., 0–2 scale with higher scores indicating poorer footpad conditions). A total of 700 Hy-Line W-36 hens were raised in four cage-free housing systems integrated with Electrostatic Particle Ionization and various bedding materials. A GoPro camera with an upward lens was placed inside a transparent box. Individual laying hens were placed on the top surface of the box to acquire RGB images. In addition, a thermal camera was used to record RGB and thermal images of footpads, and the images were manually scored to assess their footpad conditions. Preprocessing techniques (e.g., filtration, separation, and augmentation) were deployed to enhance dataset quality and size. Moreover, YOLOv8 models (YOLOv8n, YOLOv8s, YOLOv8m, YOLOv8l, and YOLOv8x) and YOLOv7 models (YOLOv7 and YOLOv7x) were comparatively evaluated for predicting FPD scores. The results show that the YOLOv8l outperformed other models, with higher recall (96.6 %), mAP@0.50 (97.0 %), and F1-score (95.0 %). Additionally, the YOLOv8l-FPD model exhibited a high mAP@0.50 for score 0 (98.0 %), score 1 (95.0 %), and score 2 (97.9 %) and F1-score (95.0 %) for all FPD scores. Notably, using thermal images could result in faster convergence of model training and slightly better FPD score prediction performance than RGB images. The proposed technique can be useful for non-invasive automatic FPD scoring and further improve automation levels and animal welfare in the egg industry.

Analysis of methods and algorithms for image filtering and quality enhancement

This paper addresses the prevalent issue of image noise and presents methods for its mitigation. The paper describes, analyses and tests a variety of image filtering techniques, with specific reference to their use in different contexts. The filtering methods can be classified into two principal categories: linear filters, which include the Gaussian and mean filters, and non-linear filters, which comprise the median filter, the Fast Fourier Transform (FFT), the Non-Local Means (NLM) filter, and the anisotropic diffusion filter. The efficacy of each filter is mathematically described and evaluated on RGB images using the Python programming language. The study delineates the evaluation metrics and their respective advantages and disadvantages. The Root Mean Square Error (RMSE) and Peak Signal-to-Noise Ratio (PSNR) are employed as criteria for the analysis of algorithm efficiency. Furthermore, the mean execution time for each algorithm is also monitored. The experimental data suggests that linear filters are relatively fast but produce inferior results and are best employed as preparatory measures. Non-linear filters have been demonstrated to be more robust and applicable to a variety of noise types, although it has been established that they require parameter fine-tuning. The study demonstrates that anisotropic diffusion is suitable for both manual image processing and real-time applications, offering an optimal balance between processing speed and denoised image quality. NLM is optimal for high-quality single image processing due to its superior results, despite a slower processing speed. FFT is noted for its efficiency in eliminating periodic noise. Further research will be conducted on advancing filtering techniques for different real-world scenarios and autonomous systems.

Diagnosis of odontogenic keratocysts and non-keratocysts using edge attention convolution neural network.

The study's objective was to develop an automated method for a histopathology recognition model for odontogenic keratocysts (OKC) and non-keratocyst (Non-KC) in jaw cyst sections stained with hematoxylin (H) and eosin (E) on a tiny bit of incisional biopsy prior to surgery. This hastens the speed and precision of diagnosis to patients. Also, navigates the clinicians with the therapeutic doctrine. To build such a system and to increase the accuracy of the existing models, the edge attention CNN model with Keras functional API was implemented which efficiently analyzes the texture information of the images. Approximately 2861 microscopic images at a 40X magnification were taken from 54 OKC, 23 Dentigerous cysts (DC), and 20 Radicular cysts. The model was trained using both RGB and canny edge-detected images. The model gave a good accuracy of 96.8%, which is suitable for real-time. Histopathological images are better analyzed through textural features. The proposed edge attention CNN highlights the edges, making texture analysis more precise. The suggested method will work for OKC and Non-KC diagnosis automation systems. The use of a whole slide imaging scanner has the potential to increase accuracy and remove human bias.

Pixel to practice: multi-scale image data for calibrating remote-sensing-based winter wheat monitoring methods

Site-specific crop management in heterogeneous fields has emerged as a promising avenue towards increasing agricultural productivity whilst safeguarding the environment. However, successful implementation is hampered by insufficient availability of accurate spatial information on crop growth, vigor, and health status at large scales. Challenges persist particularly in interpreting remote sensing signals within commercial crop production due to the variability in canopy appearance resulting from diverse factors. Recently, high-resolution imagery captured from unmanned aerial vehicles has shown significant potential for calibrating and validating methods for remote sensing signal interpretation. We present a comprehensive multi-scale image dataset encompassing 35,000 high-resolution aerial RGB images, ground-based imagery, and Sentinel-2 satellite data from nine on-farm wheat fields in Switzerland. We provide geo-referenced orthomosaics, digital elevation models, and shapefiles, enabling detailed analysis of field characteristics across the growing season. In combination with rich meta data such as detailed records of crop husbandry, crop phenology, and yield maps, this data set enables key challenges in remote sensing-based trait estimation and precision agriculture to be addressed.

Deep Learning Approach for Wildland Fire Recognition Using RGB and Thermal Infrared Aerial Image

Wildfires cause severe consequences, including property loss, threats to human life, damage to natural resources, biodiversity, and economic impacts. Consequently, numerous wildland fire detection systems were developed over the years to identify fires at an early stage and prevent their damage to both the environment and human lives. Recently, deep learning methods were employed for recognizing wildfires, showing interesting results. However, numerous challenges are still present, including background complexity and small wildfire and smoke areas. To address these challenging limitations, two deep learning models, namely CT-Fire and DC-Fire, were adopted to recognize wildfires using both visible and infrared aerial images. Infrared images detect temperature gradients, showing areas of high heat and indicating active flames. RGB images provide the visual context to identify smoke and forest fires. Using both visible and infrared images provides a diversified data for learning deep learning models. The diverse characteristics of wildfires and smoke enable these models to learn a complete visual representation of wildland fires and smoke scenarios. Testing results showed that CT-Fire and DC-Fire achieved higher performance compared to baseline wildfire recognition methods using a large dataset, which includes RGB and infrared aerial images. CT-Fire and DC-Fire also showed the reliability of deep learning models in identifying and recognizing patterns and features related to wildland smoke and fires and surpassing challenges, including background complexity, which can include vegetation, weather conditions, and diverse terrain, detecting small wildfire areas, and wildland fires and smoke variety in terms of size, intensity, and shape. CT-Fire and DC-Fire also reached faster processing speeds, enabling their use for early detection of smoke and forest fires in both night and day conditions.

Multi-spectral image transformer descriptor classification combined with molecular tools for early detection of tomato grey mould

Accurate early detection of plant diseases is a critical milestone in the development of self-navigating robots for precision agriculture and still remains one of the most significant challenges. Plant pathogens, like Botrytis cinerea causing grey mould disease, pose significant threats to agriculture and food safety. This study focuses on the early detection of B. cinerea in tomato crops using Artificial Intelligence. Specifically, the Deep Learning (DL) YOLOv8 architecture was employed to apply single class segmentation on plant captures to extract the tomato leaves locational information. Each plant capture includes five images from hyperspectral wavelengths (at 460, 540, 640, 775 and 875 nm) and one RGB images. The leaf segmentation achieved 81.7 % Mean Average Precision (mAP) at Intersection over Union (IoU) threshold 0.5 (mAP50). Then the for each leaf segment, and array of descriptors is extracted through various Transformer models. Finally, the descriptors are classified through a KNN or an LSTM solution and the results of all the descriptors for each leaf from each of the Transformer models, for each of the six images of the capture, are ensembled to yield the class of each leaf. The best ensemble results were produced by only accumulating results from some of the Transformer and specifically the MaxViT-L, the ViT-B (P:16 × 16 – C), the VOLO (D:5) and the XCIT-L (L:24 – P:16 × 16), by only using the results provided by the images at the hyperspectral wavelengths at 540, 640 nm and the RGB image, and by applying the LSTM solution. The process achieved a 79.41 % classification accuracy and 71.12 % F1-Score for all classes. Additionally, early, rapid and accurate detection of grey mould at the early stages of the infection or at latent infections when symptoms are not visible was assessed by comparative qPCR-based methods (qRT-PCR) for fungal biomass estimation in plant tissues and the rest of this study's methodology. The findings of this study represent a significant advancement in crop disease detection and management, and highlight the potential for integrating these methods into on-site digital systems (robots, mobile apps, etc.) under real-world settings. The results, demonstrate the effectiveness of combining segmentation and transformer-based classification models for early and accurate detection of grey mould disease.

JunoPerijove 34: Update Ganymede 3D-control network and new DEMs study

During the Juno Perijove 34 the JunoCam acquired four RGB images of Ganymede. These images and updated SPICE kernel for spacecraft's trajectories were used to refine previous 3D-control point network (CPN). As a result, 4954 control points were measured 22,098 times with a minimum of 2 and a maximum of 16 observations per point, based on the 302 best available images from all missions (Voyagers, Galileo and Juno). After adjustment more than 86% of points have accuracy better than 3 km (>97% - better than 5 km). A new libration value for Ganymede 18ʺ is obtained. This updated CPN was used for compiling a new Ganymede global mosaic to support the planning of observations within the JUICE mission. New detailed local DEMs were obtained by stereovectorization for Enki Catena and Tros crater regions. In the Enki chain, the ratio d/D of the depth of craters to their diameter ranges from 0.049 to 0.089 and correlates with the area types (dark or light).

A Review of Three-Dimensional RGB Images and Drone Thermal Camera Images Merged for Building Information Modeling for Energy Audit

The site visit is the core of the energy audit, where you inspect, measure, and document the building's energy performance and efficiency. Various tools and techniques may be used for this purpose, such as a walk-through survey to observe the building's condition, a blower door test to measure air tightness and infiltration, a thermographic scan to detect heat loss and gain, a lighting audit to assess lighting quality, quantity, and controls, a plug load audit to quantify appliance and equipment energy consumption, a submetering or data logging system to monitor specific systems or zones, and a power quality analyzer to measure electrical parameters and harmonics. Additionally, it is important to interview the building's owner, manager, and occupants in order to gain their feedback and suggestions on energy performance and issues. This paper review of how a drone can help in the energy audit of a building using thermal images and RGB images from thermal camera which will be use in Building Information Modelling (BIM). There are a variety of relevant literatures that serve as sources of inspiration for the conduct of this study. One example is the utilization of teleoperated helicopters that are equipped with an infrared thermal camera. These helicopters are intended to be investigated for energy audits in order to readily assess the conditions of the structure. More improvements will be made to the collected photographs, such as merging them with three-dimensional RGB images. This will allow for an exact determination of which area of the building need upgrading in order to reduce the amount of energy that is emitted; this notion is similar to that of finite element analysis.

Domain Adaptive Thermal Object Detection with Unbiased Granularity Alignment

Domain Adaptive Object Detection (DAOD) alleviates the challenge of labor-intensive annotations by transferring semantic information from a labeled source domain to an unlabeled target domain. However, the DAOD suffers from biased discrimination and negative transfer in the thermal domain due to the inherent heterogeneity between the RGB and thermal images. To address the above issues, we propose the Unbiased Granularity Alignment (UGA) framework to facilitate the unified alignment for RGB-Thermal DAOD. Specifically, we devise a Channel Self-encoding Adaptation (CSA) module to mitigate biased discrimination from the discriminative enhancement perspective. CSA aligns the intra-domain channel subspace for inter-domain channel harmonizing. Upon revisiting instance alignment, we uncovered inaccuracies proposals and unstable positive sample phenomena. Therefore, we propose the Relative Relationship Adaptation (RRA) module to mitigate negative transfer. RRA ensures inter-domain semantic consistency through sparse instance alignment. Extensive experiments are conducted on visible-to-thermal and visible-to-visible benchmarks to validate the effectiveness, and our UGA framework outperforms state-of-the-art by a remarkable margin. The code of our UGA is available at https://github.com/zyfone/UGA .

Automatic Method for Extracting Tree Branching Structures from a Single RGB Image

Creating automated methods for detecting branches in images is crucial for applications like harvesting robots and forest monitoring. However, the tree images encountered in real-world scenarios present significant challenges for branch detection techniques due to issues such as background interference, occlusion, and varying environmental lighting. While there has been notable progress in extracting tree trunks for specific species, research on identifying lateral branches remains limited. The primary challenges include establishing a unified mathematical representation for multi-level branch structures, conducting quantitative analyses, and the absence of suitable datasets to facilitate the development of effective models. This study addresses these challenges by creating a dataset encompassing various tree species, developing annotation tools for multi-level branch structure labeling, designing branch vector representations and quantitative metrics. Building on this foundation, the study introduces an automatic extraction model for multi-level branch structures that utilizes ResNet and a self-attention mechanism, along with a tailored loss function for branch extraction tasks. The study evaluated several model variants through both qualitative and quantitative experiments. Results from different tree images demonstrate that the final model can accurately identify the trunk structure and effectively extract detailed lateral branch structures, offering a valuable tool for applications in this area.

Assessment of Dataset Scalability for Classification of Black Sigatoka in Banana Crops Using UAV-Based Multispectral Images and Deep Learning Techniques

This paper presents an evaluation of different convolutional neural network (CNN) architectures using false-colour images obtained by multispectral sensors on drones for the detection of Black Sigatoka in banana crops. The objective is to use drones to improve the accuracy and efficiency of Black Sigatoka detection to reduce its impact on banana production and improve the sustainable management of banana crops, one of the most produced, traded, and important fruits for food security consumed worldwide. This study aims to improve the precision and accuracy in analysing the images and detecting the presence of the disease using deep learning algorithms. Moreover, we are using drones, multispectral images, and different CNNs, supported by transfer learning, to enhance and scale up the current approach using RGB images obtained by conventional cameras and even smartphone cameras, available in open datasets. The innovation of this study, compared to existing technologies for disease detection in crops, lies in the advantages offered by using drones for image acquisition of crops, in this case, constructing and testing our own datasets, which allows us to save time and resources in the identification of crop diseases in a highly scalable manner. The CNNs used are a type of artificial neural network widely utilised for machine training; they contain several specialised layers interconnected with each other in which the initial layers can detect lines and curves, and gradually become specialised until reaching deeper layers that recognise complex shapes. We use multispectral sensors to create false-colour images around the red colour spectra to distinguish infected leaves. Relevant results of this study include the construction of a dataset with 505 original drone images. By subdividing and converting them into false-colour images using the UAV’s multispectral sensors, we obtained 2706 objects of diseased leaves, 3102 objects of healthy leaves, and an additional 1192 objects of non-leaves to train classification algorithms. Additionally, 3640 labels of Black Sigatoka were generated by phytopathology experts, ideal for training algorithms to detect this disease in banana crops. In classification, we achieved a performance of 86.5% using false-colour images with red, red edge, and near-infrared composition through MobileNetV2 for three classes (healthy leaves, diseased leaves, and non-leaf extras). We obtained better results in identifying Black Sigatoka disease in banana crops using the classification approach with MobileNetV2 as well as our own datasets.

Specular highlight removal using Quaternion transformer

Specular highlight removal is a very important issue, because specular highlight reflections in images with illumination changes can give very negative effects on various computer vision and image processing tasks. Numerous state-of-the-art networks for the specular removal use convolutional neural networks (CNN), which cannot learn global context effectively. They capture spatial information while overlooking 3D structural correlation information of an RGB image. To address this problem, we introduce a specular highlight removal network based on Quaternion transformer (QformerSHR), which employs a transformer architecture based on Quaternion representation. In particular, a depth-wise separable Quaternion convolutional layer (DSQConv) is proposed to enhance computational performance of QformerSHR, while efficiently preserving the structural correlation of an RGB image by utilizing the Quaternion representation. In addition, a Quaternion transformer block (QTB) based on DSQConv learns global context. As a result, QformerSHR consisting of DSQConv and QTB performs the specular removal from natural and text image datasets effectively. Experimental results demonstrate that it is significantly more effective than state-of-the-art networks for the specular removal, in terms of both quantitative performance and subjective quality.

Autonomous Vehicles Traversability Mapping Fusing Semantic–Geometric in Off-Road Navigation

This paper proposes an evaluating and mapping methodology of terrain traversability for off-road navigation of autonomous vehicles in unstructured environments. Terrain features are extracted from RGB images and 3D point clouds to create a traversal cost map. The cost map is then employed to plan safe trajectories. Bayesian generalized kernel inference is employed to assess unknown grid attributes due to the sparse raw point cloud data. A Kalman filter also creates density local elevation maps in real time by fusing multiframe information. Consequently, the terrain semantic mapping procedure considers the uncertainty of semantic segmentation and the impact of sensor noise. A Bayesian filter is used to update the surface semantic information in a probabilistic manner. Ultimately, the elevation map is utilized to extract geometric characteristics, which are then integrated with the probabilistic semantic map. This combined map is then used in conjunction with the extended motion primitive planner to plan the most effective trajectory. The experimental results demonstrate that the autonomous vehicles obtain a success rate enhancement ranging from 4.4% to 13.6% and a decrease in trajectory roughness ranging from 5.1% to 35.8% when compared with the most developed outdoor navigation algorithms. Additionally, the autonomous vehicles maintain a terrain surface selection accuracy of over 85% during the navigation process.

MeST-Former: Motion-enhanced Spatiotemporal Transformer for generalizable Deepfake detection

The rise of Deepfake technology has sparked significant concerns due to its potential for misuse and malicious manipulation of multimedia content. Various detection approaches aimed at detecting Deepfake videos have been proposed, mostly relying on the identification of spatial and temporal artifacts. However, due to the different contexts of source images and the variety of generation techniques, current Deepfake detection methods usually perform well on training datasets, and yet generalize poorly to those unseen identities in new datasets. This issue is widely known as the generalization challenge of Deepfake detection. To address this challenge, this paper proposes an advanced spatiotemporal Deepfake video detector, named Motion-enhanced Spatiotemporal Transformer (MeST-Former). MeST-Former is based on the spatiotemporal modeling capacity of the video Swin Transformer. The spatial and temporal features are obtained from the RGB and motion images, respectively. To enhance the generalization ability of MeST-Former to unseen identities in unseen datasets, the ID-related components in the spatial and temporal features are detached. Specifically, MeST-Former adopts the newly proposed Identity-Decoupling Attention (IDC-Att) module to disentangle the ID-related and ID-unrelated components. Only the ID-unrelated components are used to construct more generalizable spatiotemporal representations. This process makes the constructed spatiotemporal features identity-agnostic and more generalizable to unseen identities. We conducted extensive experiments to evaluate the performance of the MeST-Former. Our results indicate that MeST-Former achieves accurate and generalizable Deepfake detection performance. Notably, MeST-Former also demonstrates high efficacy in detecting AI-animated talking-head videos.

Mask R-CNN and Centroid Tracking Algorithm to Process UAV Based Thermal-RGB Video for Drylot Cattle Heat Stress Monitoring

This study developed and evaluated an algorithm for processing thermal-RGB video feeds captured by an unmanned aerial vehicle (UAV) to automate heat stress monitoring in cattle housed in the drylots. The body surface temperature (BST) of individual cows was used as an indicator of heat stress. UAV data were collected using RGB and thermal infrared imagers, respectively, at 2 and 6.67 cm per pixel spatial resolution in Spring 2023 (dataset-1) and Summer 2024 (dataset-2). Study sites were two commercial drylots in Washington State. The custom algorithms were developed to: (1) detect and localize individual cows using a Mask R-CNN-based instance segmentation model combined with centroid tracking; and (2) extract BST by averaging the thermal-imagery pixels for each of the segmented cows. The algorithm showed higher detection accuracy with RGB images as input (F1 score: 0.89) compared to thermal (F1 score: 0.64). BST extraction with combined RGB and thermal imaging approach required corrections for alignment problems associated with differences in optics, imaging field of view, resolution, and lens properties. Consequently, thermal imaging-only approach was adopted for assessing real-time cow localization and BST estimation. Operating at one frame per second, algorithm successfully detected 72.4% and 81.65% of total cows in video frames from dataset-1 (38 s) and -2 (48 s), respectively. The mean absolute difference between algorithm output and ground truth (BSTGT) was 2.1 °C (dataset-1) and 3.3 °C (dataset-2), demonstrating satisfactory performance. With further refinements, this approach could be a viable tool for real-time heat stress monitoring in large-scale drylot production systems.

Deep Learning Applied to Imbalanced Malware Datasets Classification

In the current day, the evolution and exponential proliferation of malware involve modifications and camouflage of their structure through techniques like obfuscation, polymorphism, metamorphism, and encryption. With the advancements in deep learning, methods such as convolutional neural networks (CNN) have emerged as potent tools for deciphering intricate patterns within this malicious software. The present research uses the capacity of CNN to learn the global structure of the code converted to an RGB or grayscale image and decipher the patterns present in the malware datasets generated from these images. The study explores fine-tuning techniques, including bicubic interpolation, ReduceLROnPlateau, and class weight estimation, in order to generalize the model and reduce the risk of overfitting for malware that uses evasion techniques against classification. Taking advantage of transfer learning and the MobileNet architecture, we created a MobileNet fine-tuning (FT) model. The application of this new model in four datasets, including Microsoft Big 2015, Malimg, MaleVis, and a new Fusion dataset, achieved 98.71%, 99.08%, 96.04%, and 98.04% accuracy, respectively, which underscores the robustness of the proposed model. The Fusion dataset is a combination of the first three datasets, consisting of a set of 32,601 known malware image files representing a mix of 59 different families. Despite the success, the study reveals performance deterioration with an increase in the number of malware families, highlighting the need for further exploration into the limits of CNNs in malware classification.

Tri-channel visualised malicious code classification based on improved ResNet

As malicious code attacks continue to evolve, attackers leverage techniques like packing and code obfuscation to generate numerous variants, challenging traditional detection methods. Addressing the limitations of current deep learning-based malicious code classification approaches in feature extraction and accuracy, this paper introduces an innovative RGB visualization detection method based on a hybrid multi-head attention mechanism. Initially, a feature representation method utilizing RGB images is introduced. This approach focuses on semantic relationships between a malware’s binary information, assembly details, and API data, generating images with richer textural information. This technique effectively uncovers the deep dependencies between the original and variant versions of malicious code, providing stronger support for subsequent classification tasks. Furthermore, to tackle the issues of malware encryption and obfuscation, a deep neural network framework is adopted, incorporating a modular design philosophy and integrating a multi-head attention mechanism. This design not only enhances the expressiveness of critical features but also helps the model better focus on key aspects of the malicious code, thereby improving classification accuracy. Through comparative experiments and in-depth analysis, the effectiveness and superiority of the proposed RGB visualization method and MSA-ResNet model in the field of malicious code variant classification are validated. The accuracy rates achieved on the Kaggle and DataCon datasets are 99.49% and 97.70%, respectively, representing significant improvements over other methods. This approach demonstrates strong generalization capabilities and resistance to obfuscation, offering a new and effective tool for malicious code detection.Graphical

Revolutionizing tomato disease detection in complex environments.

In the current agricultural landscape, a significant portion of tomato plants suffer from leaf diseases, posing a major challenge to manual detection due to the task's extensive scope. Existing detection algorithms struggle to balance speed with accuracy, especially when identifying small-scale leaf diseases across diverse settings. Addressing this need, this study presents FCHF-DETR (Faster-Cascaded-attention-High-feature-fusion-Focaler Detection-Transformer), an innovative, high-precision, and lightweight detection algorithm based on RT-DETR-R18 (Real-Time-Detection-Transformer-ResNet18). The algorithm was developed using a carefully curated dataset of 3147 RGB images, showcasing tomato leaf diseases across a range of scenes and resolutions. FasterNet replaces ResNet18 in the algorithm's backbone network, aimed at reducing the model's size and improving memory efficiency. Additionally, replacing the conventional AIFI (Attention-based Intra-scale Feature Interaction) module with Cascaded Group Attention and the original CCFM (CNN-based Cross-scale Feature-fusion Module) module with HSFPN (High-Level Screening-feature Fusion Pyramid Networks) in the Efficient Hybrid Encoder significantly enhanced detection accuracy without greatly affecting efficiency. To tackle the challenge of identifying challenging samples, the Focaler-CIoU loss function was incorporated, refining the model's performance throughout the dataset. Empirical results show that FCHF-DETR achieved 96.4% Precision, 96.7% Recall, 89.1% mAP (Mean Average Precision) 50-95 and 97.2% mAP50 on the test set, with a reduction of 9.2G in FLOPs (floating point of operations) and 3.6M in parameters. These findings clearly demonstrate that the proposed method improves detection accuracy and reduces computational complexity, addressing the dual challenges of precision and efficiency in tomato leaf disease detection.

Enhancing Detection of Pedestrians in Low-Light Conditions by Accentuating Gaussian–Sobel Edge Features from Depth Maps

Owing to the low detection accuracy of camera-based object detection models, various fusion techniques with Light Detection and Ranging (LiDAR) have been attempted. This has resulted in improved detection of objects that are difficult to detect due to partial occlusion by obstacles or unclear silhouettes. However, the detection performance remains limited in low-light environments where small pedestrians are located far from the sensor or pedestrians have difficult-to-estimate shapes. This study proposes an object detection model that employs a Gaussian–Sobel filter. This filter combines Gaussian blurring, which suppresses the effects of noise, and a Sobel mask, which accentuates object features, to effectively utilize depth maps generated by LiDAR for object detection. The model performs independent pedestrian detection using the real-time object detection model You Only Look Once v4, based on RGB images obtained using a camera and depth maps preprocessed by the Gaussian–Sobel filter, and estimates the optimal pedestrian location using non-maximum suppression. This enables accurate pedestrian detection while maintaining a high detection accuracy even in low-light or external-noise environments, where object features and contours are not well defined. The test evaluation results demonstrated that the proposed method achieved at least 1–7% higher average precision than the state-of-the-art models under various environments.