Convolutional Neural Network Training Research Articles

A hybrid approach using convolutional neural networks and genetic algorithm to improve of sensing brain tumor prediction

Brain tumor is the most constantly diagnosed cancer, and the opinion of the brain is veritably sensitive and complex, which is the subject of numerous studies and inquiries. In computer vision, deep literacy ways, similar as the convolutional neural network (CNN), are employed due to their bracket capabilities using learned point styles and their capability to work with complex images. still, their performance is largely dependent on the network structure and the named optimization system for tuning the network parameters. In this paper, we present new yet effective styles for training convolutional neural networks. The maturity of current state-of-the-art literacy styles for convolutional neural networks are grounded on grade descent. In discrepancy to traditional convolutional neural network training styles, we propose an enhancement by incorporating the inheritable algorithm for brain tumor prediction. Our work involves designing a convolutional neural network model to grease the bracket process, training the model using different optimizers (Adam and the inheritable algorithm), and assessing the model through colorful trials on the brain magnetic resonance imaging (MRI) dataset. We demonstrate that the convolutional neural network model trained using the inheritable algorithm performs as well as the Adam optimizer, achieving a bracket delicacy of 99.5.

Image-based quantification of pool boiling heat flux on varied heating surfaces: Enhancing prediction performance with automated machine learning

The present study applied image-trained Convolutional Neural Networks (CNN) to quantify the heat flux dissipated in a pool boiling experiment. In total, four heating surfaces were used to generate over 200 thousand nucleate and film boiling images in two visualization modes: direct and indirect. In the former, the flow images included the heating surface; in the latter, the image was cropped and the heating surface was omitted. Prior to training and testing the CNN, the images were preprocessed, by grayscaling, downscaling, size uniformization and standardization. The main goals were to assess the CNN’s capability to generalize to multiple operating conditions, and to quantify the performance of a CNN architecture optimized with Automated Machine Learning (AutoML) in comparison with a reference architecture. The results suggest that multi-dataset training is required to improve the CNN generalization. In other words, the CNN must be trained, even if partially, with images of the specific heating surface for which it is trying to infer the heat flux. However, the results indicate a significant performance drop for the results of multi-surface trained CNNs when compared with single-surface CNNs, suggesting limited generalization capability. Furthermore, the results obtained showed that AutoML was capable of increasing the performance of CNN models when compared with parametrically determined architectures. Also, optimized architectures tend to present a larger number of convolutional layers associated with dense blocks and, at the same time, a reduced number of trainable variables.

Machine learning-based non-destructive terahertz detection of seed quality in peanut

Rapid identification of peanut seed quality is crucial for public health. In this study, we present a terahertz wave imaging system using a convolutional neural network (CNN) machine learning approach. Terahertz waves are capable of penetrating the seed shell to identify the quality of peanuts without causing any damage to the seeds. The specificity of seed quality on terahertz wave images is investigated, and the image characteristics of five different qualities are summarized. Terahertz wave images are digitized and used for training and testing of convolutional neural networks, resulting in a high model accuracy of 98.7% in quality identification. The trained THz-CNNs system can accurately identify standard, mildewed, defective, dried and germinated seeds, with an average detection time of 2.2 s. This process does not require any sample preparation steps such as concentration or culture. Our method swiftly and accurately assesses shelled seed quality non-destructively.

Data‐driven target localization using adaptive radar processing and convolutional neural networks

AbstractLeveraging the advanced functionalities of modern radio frequency (RF) modeling and simulation tools, specifically designed for adaptive radar processing applications, this paper presents a data‐driven approach to improve accuracy in radar target localization post adaptive radar detection. To this end, we generate a large number of radar returns by randomly placing targets of variable strengths in a predefined area, using RFView®, a high‐fidelity, site‐specific, RF modeling & simulation tool. We produce heatmap tensors from the radar returns, in range, azimuth [and Doppler], of the normalized adaptive matched filter (NAMF) test statistic. We then train a regression convolutional neural network (CNN) to estimate target locations from these heatmap tensors, and we compare the target localization accuracy of this approach with that of peak‐finding and local search methods. This empirical study shows that our regression CNN achieves a considerable improvement in target location estimation accuracy. The regression CNN offers significant gains and reasonable accuracy even at signal‐to‐clutter‐plus‐noise ratio (SCNR) regimes that are close to the breakdown threshold SCNR of the NAMF. We also study the robustness of our trained CNN to mismatches in the radar data, where the CNN is tested on heatmap tensors collected from areas that it was not trained on. We show that our CNN can be made robust to mismatches in the radar data through few‐shot learning, using a relatively small number of new training samples.

Evaluating CNN Models for Gait Recognition: A Study on the CASIA-B Dataset

Gait recognition, a form of biometric identification, has garnered considerable interest for its ability to identify individuals from a distance. Yet, its effectiveness depends significantly on the precision of the underlying categorization models. This study thoroughly evaluates many Convolutional Neural Network (CNN) models to determine their effectiveness in properly identifying and categorizing gait patterns. We train and test several CNN architectures using advanced deep learning techniques on the widely known CASIA-B dataset, which is a benchmark dataset for gait recognition research. The analyses involve models like as VGG16, VGG19, NASNetLarge, NASNetMobile, EfficientNetB0, and Xception, each well-known for their effectiveness in picture categorization tasks. We evaluate the performance of these models by conducting thorough experiments and detailed analysis, focusing on accuracy, validation loss, and other pertinent metrics. The Xception model demonstrated the highest accuracy of 97.17% of the models assessed. This model frequently surpasses similar models, demonstrating its strength and effectiveness in precisely recognizing gait patterns. On the other hand, the accuracy of other models varied from 9.78% to 93.85%, demonstrating the variable levels of efficacy among various designs. The findings have significant implications for the creation and implementation of gait recognition systems. The high precision demonstrated by the Xception model highlights the promise of CNN-based methods in progressing gait identification technology. Our work highlights the significance of choosing suitable model architectures for achieving the best performance in gait detection tasks. In the future, research may focus on using larger datasets and exploring other CNN architectures to improve the accuracy and reliability of gait detection systems. Our goal is to enhance gait recognition technology to improve biometric identification for security, surveillance, and healthcare applications. GUB JOURNAL OF SCIENCE AND ENGINEERING, Vol 10(1), 2023 P 17-26

CNNs for remote extraction of urban features: A survey-driven benchmarking

Accurate extraction of urban features such as buildings and roads lays the foundation for the current trends of digital twins of urban systems to support planning, monitoring, navigation, and decision processes. The process of such extraction involves training convolutional neural networks (CNNs) on high-resolution earth observation (EO) images. The spatial resolution of images has increased to a centimetre level and the CNNs are fast evolving in computer vision. The last 10 years of this development have resulted in both high-performance and computationally efficient CNNs, but they are merely benchmarked under a uniform setting. We present a survey-driven benchmark of CNNs starting with a systematic survey of 165 research articles to understand the state-of-the-art of urban feature extraction. The survey looks for the most prominent urban feature, EO source, benchmark dataset, CNN-based deep learning configuration, and hyperparameters. Further, more CNNs are searched in the computer vision domain. Identified from the survey and search, 65 CNNs are trained and evaluated in an encoder–decoder configuration using a benchmark dataset under uniform settings. Extensive hyperparameter tuning of the best-performing CNN is performed with six optimisers and nine loss functions. The tuned CNN is then tested as an encoder in other state-of-the-art encoder–decoder networks. The CNNs and network configurations with the highest scores are further benchmarked on the Massachusetts Building and WHU Building datasets. The findings from this survey-driven benchmark of CNNs will be useful for both academia and industry involved in the science of earth observation and computer vision.

Quantum-enhanced forecasting: Leveraging quantum gramian angular field and CNNs for stock return predictions

This paper presents the Quantum Gramian Angular Field (QGAF) method, which integrates quantum computing with deep learning to enhance forecasting in time series analysis. This method effectively converts stock return time series data into a format compatible with Convolutional Neural Network (CNN) training. Our empirical tests, conducted on stock market data from China, Hong Kong, and the United States, demonstrate that QGAF significantly outperforms the traditional GAF approach in accuracy. These findings underscore the potential of combining quantum computing and deep learning in financial time series forecasting.

Gasoline Engine Misfire Fault Diagnosis Method Based on Improved YOLOv8

In order to realize the online diagnosis and prediction of gasoline engine fire faults, this paper proposes an improved misfire fault detection algorithm model based on YOLOv8 for sound signals of gasoline engines. The improvement involves substituting a C2f module in the YOLOv8 backbone network by a BiFormer attention module and another C2f module substituted by a CBAM module that combines channel and spatial attention mechanisms which enhance the neural network’s capacity to extract the complex features. The normal and misfire sound signals of a gasoline engine are processed by wavelet transformation and converted to time–frequency images for the training, verification, and testing of convolutional neural network. The experimental results show that the precision of the improved YOLOv8 algorithm model is 99.71% for gasoline engine fire fault tests, which is 2 percentage points higher than for the YOLOv8 network model. The diagnosis time of each sound is less than 100 ms, making it suitable for developing IoT devices for gasoline engine misfire fault diagnosis and driverless vehicles.

Innovative infrastructure to access Brazilian fungal diversity using deep learning.

In the present investigation, we employ a novel and meticulously structured database assembled by experts, encompassing macrofungi field-collected in Brazil, featuring upwards of 13,894 photographs representing 505 distinct species. The purpose of utilizing this database is twofold: firstly, to furnish training and validation for convolutional neural networks (CNNs) with the capacity for autonomous identification of macrofungal species; secondly, to develop a sophisticated mobile application replete with an advanced user interface. This interface is specifically crafted to acquire images, and, utilizing the image recognition capabilities afforded by the trained CNN, proffer potential identifications for the macrofungal species depicted therein. Such technological advancements democratize access to the Brazilian Funga, thereby enhancing public engagement and knowledge dissemination, and also facilitating contributions from the populace to the expanding body of knowledge concerning the conservation of macrofungal species of Brazil.

Optimized CNN and adaptive RBFNN for channel estimation and hybrid precoding approaches for multi user millimeter wave massive MIMO

ABSTRACT The millimetre-wave (mmWave) communication satisfies the demand for high data rates due to the characteristic of wide bandwidth. Using massive multiple-input multiple-output (MIMO) technology, a significant propagation loss of mmWave communication is effectively compensated. However, it is challenging to provide a specialised radio frequency chain for each antenna due to the constrained physical area with closely spaced antennas and prohibitive power consumption in mmWave massive MIMO systems. This paper presents novel approaches for effective channel estimation and hybrid precoding in mmWave communication systems. To address the challenges of channel estimation, a convolutional neural network (CNN) is utilised, and network parameters are optimised using enhanced whale optimization algorithm (EWOA). The proposed CNN-based channel estimation method aims to accurately estimate the channel in mmWave systems with enhanced efficiency and reduced complexity. By training CNN using EWOA optimisation algorithm, the network parameters are fine-tuned to improve accuracy and generalisation capability of channel estimation process. Furthermore, hybrid precoding is achieved using adaptive radial-basis function neural networks (adaptive RBFNNs) which enables efficient precoding while minimising complexity. Moreover, the adaptive RBFNN approach determines the optimal precoding weights based on channel state information, resulting in a improved performance and a reduced computational overhead. The performance analysis is validated using the MATLAB/Simulink software and offers to provide effectual and reliable mmWave communication systems, facilitating the realisation of high-speed and high-capacity wireless networks.

378 Workload Assessment of Suturing Tasks and AI-Task Classification Using Electromyography

Abstract Aim It is well established that excess surgeon workload results in poorer performance. Workload can be divided into physical workload (PWL) and cognitive workload (CWL). The study aims are twofold: 1. Assess how the subjective PWL of suturing is affected by varying PWL and CWL 2. Develop an AI-classification algorithm for task detection using electromyography (EMG). Method Novices were trained in interrupted suturing and asked to suture under four conditions of varied workload. Tasks included were: 1. Control, 2. Different suture material (Silk), 3. Simultaneously undertaking a neurocognitive task and 4. Suturing at depth. Subjective workload was recorded using a validated workload questionnaire (SURG-TLX). EMG sensors recorded physiological data from the biceps brachii and extensor ulnar carpi. A convolutional neural network (CNN) was created for AI-task classification using EMG data. Results The depth task had the highest subjective workload. Subjective depth raw workload was significantly higher than Control (p=<0.01) and Silk (p=<0.001) but comparable to the neurocognitive task. Subjective depth weighted workload was significantly higher than the neurocognitive task (p=<0.05). Subjective depth adjusted workload was significantly higher than the neurocognitive and silk tasks (both p=<0.05). The CNN training accuracy was 76.4% (95%CI 75.5-77.4) and had a classification accuracy of 76.5% (95%CI 75.7-77.2). Conclusions The relationship between PWL and CWL on subjective PWL is complex. Despite this, the CNN was able to differentiate between tasks using objective EMG data with good accuracy. This CNN has potential to characterise CWL which can be further developed to detect excess workload to improve surgical training through objective benchmarks.

O-260 Identifying seminiferous tubules for sperm retrieval during microdissection testicular sperm extraction (M-TESE) using deep learning

Abstract Study question Is it possible to utilize artificial intelligence (AI) in the selection of seminiferous tubules for sperm retrieval during microdissection testicular sperm extraction (M-TESE)? Summary answer AI algorithm was able to segment seminiferous tubules deemed to be good candidates for sperm retrieval with IoU of 0.746 and F1 score of 72.5%. What is known already M-TESE is an advanced surgical procedure reserved for sperm retrieval in men with non-obstructive azoospermia (NOA). Meta-analysis have shown M-TESE might be superior in relation to sperm retrieval rates and postsurgical complications when compared to conventional techniques. Limitations of the technique are the relatively long learning curve for the surgeons and the longer intraoperative time required to identify the tubules with active spermatogenesis. Convolutional neural networks (CNNs) have been shown to successfully identify areas of interest in medical images such as CT and MRI scans. The possibility of utilizing trained CNNs in M-TESE procedures has so far not been studied. Study design, size, duration This is a cross sectional study analyzing image data gathered during M-TESE procedures including the first five men enrolled in a prospective study designed specifically to test the utilization of AI in the treatment of NOA. All participants signed written informed consent. Images were collected intraoperatively with low and high resolution cameras according to predefined protocol. Participants/materials, setting, methods CNN model with down and upsampling architecture was trained using patch-based technique with corresponding labelled truth image pairs based on combination of semi-automated hue saturation value thresholding and manual segmentation of seminiferous tubules. Tubules were allocated into two different classes by the operating surgeon according to the visual perception of their morphology as type 1 (i.e. larger, opaque, good candidates for micro dissection) and type 2 (i.e. sclerotic or atrophic; unlikely to harbor active spermatogenesis). Main results and the role of chance CNN models were trained on 1809 patches with corresponding ground truth segmented images. Two algorithms were tested: the first was trained solely to detect and semantically distinguish type 1 seminiferous tubules. The second was trained to semantically segment the major anatomical structures: tunica albuginea, testicular parenchyma, blood vessels; lobules and the two types of seminiferous tubules describe above. Validation was performed on 988 image patches not previously shown to the algorithm. After grid search for optimal learning rate and augmentation the first algorithm was able to segment type 1 tubules with F1 score of 72.5% and Jaccard Index (IoU) of 0.746. Training took 856 minutes on 48 core high performance computer (HPC) equipped with single graphics processing unit (GPU). Same computational environment was used in the training of the second algorithm. This model was able to segment anatomical structures such as parenchyma (IoU=0.732) and testicular lobules (IoU=0.683) but performed sub optimally on the clinically relevant type 1 tubules (IoU=0.432). The first trained algorithm was able to segment a single high resolution surgical image in 3.4 seconds on an HPC. However, the same procedure took 5.5 minutes on standard desktop computer with 8 core Intel processor without GPU. Limitations, reasons for caution The number of patients is relatively small and therefore more training data would be needed to achieve robust performance. Training data were labelled by single surgeon limiting the generalizability and possibly biasing the selection process. The need of HPC environment for real time segmentation can limit the clinical use. Wider implications of the findings This pilot study shows the potential of AI to help in choosing suitable tubules for micro dissection, shortening the learning curve for young andrological surgeons. The access to cluster based computation is getting easier by the day and can soon allow instant intraoperative AI segmentation, thus shortening the surgical procedure. Trial registration number NA

Smart agriculture: An intelligent approach for apple leaf disease identification based on convolutional neural network

AbstractPlant diseases pose a significant threat to global agricultural productivity and food safety. Early detection and accurate identification of these diseases are essential for effective disease management strategies. Traditional plant disease identification mainly relies on manual observation and experienced expert judgement, which has the disadvantages of being time‐consuming, labour‐intensive and low efficiency. Given the above problems, this study proposes a method for identifying apple leaf diseases based on a convolutional neural network combining hybrid attention and bidirectional long short‐term memory (BiLSTM). Appropriate apple leaf disease samples were selected from multiple public data sets to form an experimental data set. Then, the data set is imported into the improved convolutional neural network for training. Based on the original ResNet18 model, a new convolutional neural network, AppleNet, is constructed by adding a hybrid attention module and modifying the classifier structure. The experimental results show that the average recognition accuracy of AppleNet is 94.66%, which is 2.47% higher than that of the ResNet18 network. In addition, the training time of the model is only slightly increased. The ablation experiment further verified the effectiveness of the model modification. Compared with other advanced models in recognition accuracy and model training time, the superiority of AppleNet is confirmed. This study verifies that deep learning has great potential and application prospects in plant disease identification and provides a new technical solution for intelligent and convenient plant disease identification.

Wheat Leaf Disease Detection: A Lightweight Approach with Shallow CNN Based Feature Refinement

Improving agricultural productivity is essential due to rapid population growth, making early detection of crop diseases crucial. Although deep learning shows promise in smart agriculture, practical applications for identifying wheat diseases in complex backgrounds are limited. In this paper, we propose CropNet, a hybrid method that utilizes Red, Green, and Blue (RGB) imaging and a transfer learning approach combined with shallow convolutional neural networks (CNN) for further feature refinement. To develop our customized model, we conducted an extensive search for the optimal deep learning architecture. Our approach involves freezing the pre-trained model for feature extraction and adding a custom trainable CNN layer. Unlike traditional transfer learning, which typically uses trainable dense layers, our method integrates a trainable CNN, deepening the architecture. We argue that pre-trained features in transfer learning are better suited for a custom shallow CNN followed by a fully connected layer, rather than being fed directly into fully connected layers. We tested various architectures for pre-trained models including EfficientNetB0 and B2, DenseNet, ResNet50, MobileNetV2, MobileNetV3-Small, and Inceptionv3. Our approach combines the strengths of pre-trained models with the flexibility of custom architecture design, offering efficiency, effective feature extraction, customization options, reduced overfitting, and differential learning rates. It distinguishes itself from classical transfer learning techniques, which typically fine-tune the entire pre-trained network. Our aim is to provide a lightweight model suitable for resource-constrained environments, capable of delivering outstanding results. CropNet achieved 99.80% accuracy in wheat disease detection with reduced training time and computational cost. This efficient performance makes CropNet promising for practical implementation in resource-constrained agricultural settings, benefiting farmers and enhancing production.

A Digital Approach to via Edge Roughness Characterization and Quantification

This paper introduces a new digital integration that combines edge diffractometry with convolutional neural networks (CNN) for via metrology and inspection. The beam propagation method (BMP) was used to simulate the interferogram generated by edge diffractometry to characterize via edge roughness (VER). A comprehensive database was established to link different fringe patterns to VER for CNN training. The well-trained CNN-based methodology provided a fast and accurate assessment of VER, with a root mean squared error (RMSE) of 0.073 and an average mean absolute deviation ratio (MADR) of 2.274%. In addition, the proposed digital approach was compared to the multilayer perceptron machine (MLP) in terms of computational efficiency and predictive accuracy. The proposed digital integration greatly improved the accuracy and speed of VER measurement, characterization, and quantification, potentially enhancing device yield and reliability. The successful application of this digital approach could open up possibilities for various types of via or pattern metrology.

Unveiling Anomalies in Surveillance Videos

Abstract: The implementation of Convolutional Neural Network (CNN) algorithm for the detection of anomalies like fire and potholes in images or videos. Leveraging deep learning technique, the model aims to accurately identify fire, potholes, etc. within various contexts. The CNN architecture is trained on a dataset comprising diverse images to enhance its ability to generalize. This proposed project not only addresses safety concerns by promoting helmet usage and proper maintenance of roads but also contributes to the broader field of computer vision and object detection. This implementation involves training the CNN on annotated datasets, fine-tuning the model for optimal performance, and integrating it into a practical application for efficient anomaly identification. With a focus on real-time detection, the system utilizes image processing techniques and a trained CNN model to analyze visual data from cameras or video feeds. The system's versatility allows integration into surveillance systems, industrial sites, or any environment where fire detection is crucial for safety. By automating the detection process, the project contributes to minimizing human error and ensuring consistent monitoring. The proposed solution holds the potential to significantly impact safety protocols, particularly in industries where protective headgear is paramount. Potholes pose a significant threat to both drivers and pedestrians, leading to accidents and infrastructure damage. The proposed solution leverages CNN's ability to effectively process visual data, making it well-suited for image recognition tasks. Our approach involves training the CNN on a diverse dataset of road images to enable it to accurately identify potholes. The model will learn distinctive features and patterns associated with potholes, allowing for robust detection under various environmental conditions. Real-time implementation on embedded systems or cameras along roadways will enable instantaneous identification and alerting.

Audio Classification on the FSDKaggle2018 Dataset using Tensorflow, Keras

This project explores audio classification leveraging representation learning within the TensorFlow framework. The methodology focuses on the initial engineering of wave features derived from raw audio data, which are subsequently used to train convolutional neural networks (CNNs) for effective representation learning. By transforming the audio signals into a structured format amenable to convolutional processing, our system is designed to capture the intrinsic properties and patterns embedded in the sound waves. The feature engineering process is detailed where various envelope features such as the homomorphic envelogram, hilbert envelogram and wavelet decompositions help in extracting meaningful information from the raw audio signals. These engineered features provide a robust foundation for the subsequent layers of convolutional networks. The CNNs are meticulously architected to learn hierarchical representations, effectively capturing both low-level and high-level audio characteristics.This study attempts to reinforces the significance of tailored feature engineering in deep learning and demonstrate an effective audio classification pipeline using representation learning and open up new avenues for research in audio signal processing and machine learning.

Deepfake Detection using Integrate-backward-integrate Logic Optimization Algorithm with CNN

The emergence of deepfake technology has spurred the need for robust and adaptive methods to detect manipulated media content. This study explores the integration of the Integrate-backward-integrate (IbI) Logic Optimization Algorithm with Convolutional Neural Networks (CNNs) for enhanced deepfake detection. The proposed approach involves a multi-phase iterative process: the CNN initially trained on a diverse dataset encompassing both real and deepfake images. The CNN serves as the foundation for the IbI-driven optimization. The integration phase employs the trained CNN to forward-integrate images, classifying them as real or deepfake. Subsequently, the IbI Logic Optimization Algorithm engages in the backward phase, utilizing feedback from the CNN's performance to iteratively refine the network's parameters, architecture, and feature extraction capabilities. This iterative optimization process aims to adaptively enhance the CNN's ability to discern subtle nuances between authentic and manipulated visuals. The re-integration phase evaluates the refined CNN's performance through multiple iterations, seeking to iteratively improve deepfake detection accuracy. Validation occurs using separate datasets to prevent overfitting and ensure the model's generalizability. The proposed method aims to enhance the CNN's adaptability to evolving deepfake techniques, addressing the dynamic nature of manipulative media creation. This fusion of IbI Logic Optimization with CNNs presents a promising avenue for bolstering deepfake detection capabilities. However, the effectiveness of this approach relies on dataset quality, network architecture, and the dynamic nature of deepfake generation techniques. Continuous refinement and validation are essential to adapt the model to new challenges posed by advancing deepfake technologies.

Two-stage deep learning classification for diabetic retinopathy using gradient weighted class activation mapping

The fundus images of patients with Diabetic Retinopathy (DR) often display numerous lesions scattered across the retina. Current methods typically utilize the entire image for network learning, which has limitations since DR abnormalities are usually localized. Training Convolutional Neural Networks (CNNs) on global images can be challenging due to excessive noise. Therefore, it's crucial to enhance the visibility of important regions and focus the recognition system on them to improve accuracy. This study investigates the task of classifying the severity of diabetic retinopathy in eye fundus images by employing appropriate preprocessing techniques to enhance image quality. We propose a novel two-branch attention-guided convolutional neural network (AG-CNN) with initial image preprocessing to address these issues. The AG-CNN initially establishes overall attention to the entire image with the global branch and then incorporates a local branch to compensate for any lost discriminative cues. We conduct extensive experiments using the APTOS 2019 DR dataset. Our baseline model, DenseNet-121, achieves average accuracy/AUC values of 0.9746/0.995, respectively. Upon integrating the local branch, the AG-CNN improves the average accuracy/AUC to 0.9848/0.998, representing a significant advancement in state-of-the-art performance within the field.

Deep learning models and methods for solving the problems of remote monitoring of forest resources

Relevance. The need for precise data analysis in remote monitoring of Earth's forest resources through satellites and unmanned aerial vehicles. Aim. Analysis of the current research status in forest remote monitoring via satellites and unmanned aerial vehicles, formulation of directions for the prospective development of this area; implementation and investigation of new deep learning models for analyzing high and very high-resolution images of coniferous forests. Objects. Hardware, models, methods, information systems, and technologies for real-time analysis of remote monitoring data of forest resources, obtained in the form of high and very high-resolution images. Methods. Deep learning models and methods for classifying trees in images; methodology for conducting real-time remote forest monitoring; methods for training, validation, and research of convolutional neural networks. Results and conclusions. Analytical review of models, methods, and information technologies for real-time analysis of remote forest monitoring data; list of formulated directions for prospective development of methodology and tools for efficient remote forest monitoring; development of two models, Mo-U-Net and Mo-Res-U-Net, based on the classical U-Net model. Two datasets based on imagery from an unmanned aerial vehicle were created for training, validation, and research of these models. The research results were obtained for solving multiclass classification tasks of Siberian fir (A. sibirica) and Siberian pine (P. sibirica) trees infested by insect pests. The studies showed that unlike the classical U-Net model, these models provide a higher classification accuracy for all classes of A. sibirica and P. sibirica trees, including intermediate classes, with IoU and mIoU metrics above the threshold value of 0.5, indicating the practical value of such models for the forestry industry.