Convolutional Neural Network Method Research Articles

Progress in the application of artificial intelligence-assisted molecular modification of enzymes

Natural enzymes are often difficult to meet the needs of application and research in terms of activity, enantiomer selectivity or thermal stability. Therefore, it is an important task of enzyme engineering to explore efficient molecular modification technologies to improve the properties of such enzymes. The molecular modification technologies of enzymes mainly include rational design, directed evolution, and artificial intelligence-assisted design. Directed evolution and rational design are experiment-driven molecular modification approaches of enzymes and have been successfully applied to enzyme engineering. However, due to the huge space sizes of protein sequences and the lack of experimental data, the current modification methods still face major challenges. With the development of next-generation sequencing, high-throughput screening, protein databases, and artificial intelligence (AI), data-driven enzyme engineering is emerging as a promising solution to these challenges. The AI-assisted statistical learning method has been used to establish a model for predicting the sequence/structure-properties of enzymes in a data-driven manner. Excellent mutant enzymes can be selected according to the prediction results, which greatly improve the efficiency of molecular modification. Considering the application requirements of molecular modification of enzymes, this paper reviews the data acquisition methods and application examples of AI-assisted molecular modification of enzymes, with focuses on the convolutional neural network method for predicting protein thermostability, aiming to provide reference for researchers in this field.

Optimized convolution neural network-based model for detection and classification of pulmonary diseases

Pelican Optimization Algorithm-based Convolutional Neural Network (POA-CNN) method for the automated identification of pulmonary disorders such as COVID-19 and pneumonia is proposed in this research. The method makes use of several processing layers in order to comprehend the representation of stratified data. The three primary phases of the model are feature extraction via POA-based hyperparameter optimization, image classification, and image pre-processing. This approach improves existing systems' performance in detecting pulmonary diseases, highlighting the potential of deep learning in identifying and categorizing human diseases. The study uses a resizing, grayscale, and augmentation method to optimize an existing CNN model. A Convolutional Neural Network (CNN) is then applied to classify Pneumonia and Covid-19 cases. The proposed model achieves an accuracy rate of 97.28 and 97.00%, outperforming existing models. This technique is effective in detecting and classifying other pulmonary diseases, and can be used to automatically detect and classify these diseases. Higher accuracy findings show how successful the model is, making it a useful tool for pulmonary illness identification.

Acute leukemia prediction and classification using convolutional neural network and generative adversarial network

Acute Leukemia (AL) is a type of cancer that affects the blood cells and can be fatal if not detected and treated early. Flow cytometry is a key means of detecting AL, but requires manual processing by trained professionals, applying the manual gating method to huge amounts of raw data, making it time-consuming and labor-intensive. This study uses the deep learning Convolutional Neural Network (CNN) method for classification prediction based on two-dimensional graph for the parameter combinations of flow cytometry data to differentiate AL as normal, Acute Myeloid Leukemia (AML) and Acute Lymphoblastic Leukemia (ALL) three categories. This approach normalizes raw data, removes outliers, and further augments data using Generative Adversarial Networks (GAN) to generate two-dimensional scattergrams of different parameter combinations generated by four methods. We then assess post-training classification prediction accuracy to identify the most effective preprocessing method and parameter combination. Experimental results obtain accuracy rates of 73–86 %. In the two-dimensional scatter plot of different parameter combinations generated by the four methods, the combination of CD3 and CD7 cell population parameters had the best classification and prediction accuracy, with image classification and identification reaching a high of 86 % through the use of GAN-based data augmentation. Advances in medical testing technology has reduced analysis times and increased data throughput. At the same time, artificial intelligence techniques are increasingly used for analysis and detection, performing large numbers of repetitive actions to reduce the potential for subjective assessment error from manual analysis, thus allowing for the earlier detection and treatment of disease.

Sistem Presensi Pendeteksi Wajah menggunakan Metode Modified Region Convolutional Neural Network dan PCA

Attendance is an activity to collect data to find out the number of attendances at an event or activity. In order to increase effectiveness and time efficiency is important, it is necessary to have an artificial intelligence-based presence by means of face detection. This study aims to create a face detection attendance system using modified region convolutional neural network (MR-CNN) and principal component analysis (PCA) methods. This type of research is development research by applying the concept of digital image based on face recognition. This research applies a method in deep learning, namely MR-CNN through camera media to take images and the extraction process using the PCA method to reduce image resolution. Images that include various individuals who want to be recognized are stored and then used as datasets. From the dataset, the MR-CNN model was trained with training data. Our findings are in the form of a web-based facial short-attendance system. Where are the calculation results in this system has an accuracy value of 96.1%, so it can be used well for facial identification, and can be used at SMK Bhakti Anindya.

Enhancing Coincidence Time Resolution of PET detectors using short-time Fourier transform and residual neural network

Currently, a key metric for assessing the performance of time-of-flight positron emission tomography (TOF-PET) detectors is the Coincidence Time Resolution (CTR). In this study, our aim is to enhance CTR in PET detectors through features in frequency domain. To achieve this goal, we introduce a novel approach that integrates short-time Fourier transform (STFT) with a residual neural network (ResNet) to extract features from digitized waveforms obtained from PET detectors. A comparative analysis is performed by comparing the proposed method with the conventional constant fraction discriminator (CFD) and a convolutional neural network (CNN) using real data measured from a pair of lutetium yttrium oxyorthosilicate (LYSO)-SiPM units. The proposed method achieves an average CTR of 187 ps, which is 30.4% better than the CFD method and 4.5% better than the CNN. The method also reduces the average bias by 17.9% compared to the CNN method. A Class Activation Mapping (CAM) is also introduced to analyze the importance of different frequency components in Time of Flight (TOF) estimation and the attention of network on each time point, which may not only underscore the utility of STFT in accurate timing for waveforms with different rise time but also provide insights into why CNN may outperform traditional timing methods. The influence of loss function and data organization are also studied. The enhancement of proposed method in CTR of PET will contribute to the improvement of Signal-to-Noise Ratio (SNR) of PET images.

Comparative analysis of convolutional neural network and DenseNet121 transfer learning in agriculture focusing on crop leaf disease identification

PurposePlant cultivation holds a pivotal role in agriculture, necessitating precise disease identification for the overall health of plants. This research conducts a comprehensive comparative analysis between two prominent deep learning algorithms, convolutional neural network (CNN) and DenseNet121, with the goal of enhancing disease identification in tomato plant leaves.Design/methodology/approachThe dataset employed in this investigation is a fusion of primary data and publicly available data, covering 13 distinct disease labels and a total of 18,815 images for model training. The data pre-processing workflow prioritized activities such as normalizing pixel dimensions, implementing data augmentation and achieving dataset balance, which were subsequently followed by the modeling and testing phases.FindingsExperimental findings elucidated the superior performance of the DenseNet121 model over the CNN model in disease classification on tomato leaves. The DenseNet121 model attained a training accuracy of 98.27%, a validation accuracy of 87.47% and average recall, precision and F1-score metrics of 87, 88 and 87%, respectively. The ultimate aim was to implement the optimal classifier for a mobile application, namely Tanamin.id, and, therefore, DenseNet121 was the preferred choice.Originality/valueThe integration of private and public data significantly contributes to determining the optimal method. The CNN method achieves a training accuracy of 90.41% and a validation accuracy of 83.33%, whereas the DenseNet121 method excels with a training accuracy of 98.27% and a validation accuracy of 87.47%. The DenseNet121 architecture, comprising 121 layers, a global average pooling (GAP) layer and a dropout layer, showcases its effectiveness. Leveraging categorical_crossentropy as the loss function and utilizing the stochastic gradien descent (SGD) Optimizer with a learning rate of 0.001 guides the course of the training process. The experimental results unequivocally demonstrate the superior performance of DenseNet121 over CNN.

Modelling of improved LSTM +1D convolution neural network methods for the diagnosis of SKF bearings

Modelling of improved LSTM +1D convolution neural network methods for the diagnosis of SKF bearings

Internet street view image fusion method using convolutional neural network

The use of image fusion technology in the area of information processing is continuing to advance in depth thanks to ongoing hardware advancements and related research. An enhanced convolutional neural network approach is developed to fuse visible and infrared images, and image pre-processing is carried out utilising an image alignment method with edge detection in order to gain more accurate and trustworthy image information. The performance of the fast wavelet decomposition, convolutional neural network, and modified convolutional neural network techniques is compared and examined using four objective assessment criteria. The experimental findings demonstrated that the picture alignment was successful with an offset error of fewer than 3 pixels in the horizontal direction and an angle error of less than 0.3∘ in both directions. The revised convolutional neural network method increased the information entropy, mean gradient, standard deviation, and edge detection information by an average of 46.13%, 39.40%, 19.91%, and 3.72%. The runtime of the modified approach was lowered by 19.42% when compared to the convolutional neural network method, which enhanced the algorithm’s performance and boosted the effectiveness of picture fusion. The image fusion accuracy reached 98.61%, indicating that the method has better fusion performance and is of practical value for improving image fusion quality.

Modelling a self-defined CNN for effectual classification of PCOS from ultrasound images.

Polycystic Ovary Syndrome (PCOS) is a medical condition that causes hormonal disorders in women in their childbearing years. The hormonal imbalance leads to a delayed or even absent menstrual cycle. Women with PCOS mainly suffer from extreme weight gain, facial hair growth, acne, hair loss, skin darkening, and irregular periods, leading to infertility in rare cases. Doctors usually examine ultrasound images and conclude the affected ovary but are incapable of deciding whether it is a normal cyst, PCOS, or cancer cyst manually. To have access to the high-risk crucial PCOS and to detect the condition and the treatment aimed at mitigating health hazards such as endometrial hyperplasia/cancer, infertility, pregnancy complications, and the long-term burden of chronic diseases such as cardiometabolic disorders linked with PCOS. The proposed Self-Defined Convolution Neural Network method (SD_CNN) is used to extract the features and machine learning models such as SVM, Random Forest, and Logistic Regression are used to classify PCOS images. The parameter tuning is done with lesser parameters in order to overcome over-fitting issues. The self-defined model predicts the occurrence of the cyst based on the analyzed features and classifies the class labels effectively. The Random Forest Classifier was found to be the most reliable and accurate among Support Vector Machine (SVM) and Logistic Regression (LR), with accuracy being 96.43%. The proposed model establishes better trade-off compared to various other approaches and works effectually for PCOS prediction.

High-Resolution Recognition of Orbital Angular Momentum Modes in Asymmetric Bessel Beams Assisted by Deep Learning

Abstract Fractional orbital angular momentum (OAM) vortex beams present a promising way to increase the data throughput in optical communication systems. Nevertheless, high-precision recognition of fractional OAM with different propagation distances remains a significant challenge. We develop a convolutional neural network (CNN) method to realize high-resolution recognition of OAM modalities, leveraging asymmetric Bessel beams imbued with fractional OAM. Experimental results prove that our method achieves a recognition accuracy exceeding 94.3% for OAM modes, with an interval of 0.05, and maintains a high recognition accuracy above 92% across varying propagation distances. The findings of our research will be poised to significantly contribute to the deployment of fractional OAM beams within the domain of optical communications.

Acoustic estimation of the manatee population and classification of call categories using artificial intelligence

The population sizes of manatees in many regions remain largely unknown, primarily due to the challenging nature of conducting visual counts in turbid and inaccessible aquatic environments. Passive acoustic monitoring has shown promise for monitoring manatees in the wild. In this study, we present an innovative approach that leverages a convolutional neural network (CNN) for the detection, isolation and classification of manatee vocalizations from long-term audio recordings. To improve the effectiveness of manatee call detection and classification, the CNN works in two phases. First, a long-term audio recording is divided into smaller windows of 0.5 seconds and a binary decision is made as to whether or not it contains a manatee call. Subsequently, these vocalizations are classified into distinct vocal classes (4 categories), allowing for the separation and analysis of signature calls (squeaks). Signature calls are further subjected to clustering techniques to distinguish the recorded individuals and estimate the population size. The CNN was trained and validated using audio recordings from three different zoological facilities with varying numbers of manatees. Three different clustering methods (community detection with two different classifiers and HDBSCAN) were tested for their suitability. The results demonstrate the ability of the CNN to accurately detect manatee vocalizations and effectively classify the different call categories. In addition, our study demonstrates the feasibility of reliable population size estimation using HDBSCAN as clustering method. The integration of CNN and clustering methods offers a promising way to assess manatee populations in visually challenging and inaccessible regions using autonomous acoustic recording devices. In addition, the ability to differentiate between call categories will allow for ongoing monitoring of important information such as stress, arousal, and calf presence, which will aid in the conservation and management of manatees in critical habitats.

Chaos prediction of motor based on the integrated method of convolutional neural network and multi-reservoir echo state network

Chaos prediction of motor based on the integrated method of convolutional neural network and multi-reservoir echo state network

Image Segmentation Of Ornamental Plants Typical Of South Kalimantan Using The Convolutional Neural Network Method

One of the very important processes in the recognition of visually presented objects. Image segmentation is one of the important topics in computer science, especially in the field of digital image processing. The research method used is image segmentation using the Convolutional Neural Network (CNN) method; the results obtained in this study are accurate to the image of plants selected as the sample of this study. The dataset in this study used pictures or objects of ornamental plants, namely Black Orchids, Betel Lurih, and Aglonema Tri-Color. As for the samples used in this study, namely for these three types of objects, 50 pictures were taken for each object used. By using epochs of 15, researchers have determined to reduce system performance time and by epoch times of 17s, 18s, and 24s. The number of epochs that will be used also affects the time that will be taken by modeling training. Due to the increasing number of epochs, the time that will be required for training will be longer. Then, the accuracy value of the data trained is 0.7667 with a loss value of 0.4039, and the val_loss value is 0.4611 with a val_accuracy of 0.7333. The segmentation results obtained using the convolutional neural network model have a fairly good accuracy level of 0.7667 and a validation accuracy of 0.7333.

State-of-Charge Estimation of Lithium-Ion Battery Based on Convolutional Neural Network Combined with Unscented Kalman Filter

Estimation of the state-of-charge (SOC) of lithium-ion batteries (LIBs) is fundamental to assure the normal operation of both the battery and battery-powered equipment. This paper derives a new SOC estimation method (CNN-UKF) that combines a convolutional neural network (CNN) and an unscented Kalman filter (UKF). The measured voltage, current and temperature of the LIB are the input of the CNN. The output of the hidden layer feeds the linear layer, whose output corresponds to an initial network-based SOC estimation. The output of the CNN is then used as the input of a UKF, which, using self-correction, yields high-precision SOC estimation results. This method does not require tuning of network hyperparameters, reducing the dependence of the network on hyperparameter adjustment and improving the efficiency of the network. The experimental results show that this method has higher accuracy and robustness compared to SOC estimation methods based on CNN and other advanced methods found in the literature.

Classification of Coffee Fruit Maturity Level based on Multispectral Image Using Naïve Bayes Method

The current research about the classification of coffee fruit ripeness based on multispectral images has been developed using the Convolutional Neural Network (CNN) method to extract patterns from highdimensional multispectral images. The high complexity of CNN allows the model to capture complex features but requires more time and computational resources for model training and testing. Therefore, in this study, classification is performed using a more straightforward method such as Naïve Bayes because its complexity only depends on the number of features and samples. The method only considers each feature independently, so it has high speed and does not require a lot of computational resources. Naïve Bayes is applied to color and texture features extracted from multispectral images of coffee fruit. There are 300 features consisting of 60 color features and 240 texture features. Experiments were conducted based on the comparison of training and testing data and the use of each feature. The combination of color and texture features showed better performance than color or texture features alone, with the highest accuracy reaching 91.01%. In conclusion, using Naïve Bayes is still reasonably good in classifying the ripeness of coffee fruit based on multispectral images.

Modified reconstruction of boiler numerical temperature field based on flame image feature extraction

ABSTRACT Computational fluid dynamics (CFD) method is a common method to obtain the temperature field distribution within the furnace. However, in order to reduce computational complexity, the numerical simulation involve simplifications in boundary conditions and model parameters. As a result, the temperature field distribution deviates from the actual operating conditions. This paper proposes a numerical temperature field modification method based on flame images. Flame images corresponding to the operational conditions are collected using the Industrial Flame Monitoring System (IFMS). The flame images are preprocessed, and the contour of the flame’s core region is extracted using the Mask Region-based Convolutional Neural Network (Mask R-CNN) method. The geometric features of the flame are extracted, and matrix calculations are applied to modify the numerical temperature field. The modified temperature field exhibits a deviation in the combustion center, aligning with the actual operation of the boiler. A comparison between the modified temperature field and the temperature measurements from flue gas shows consistent temperature trends. The absolute error (AE) under different operating conditions is under 8.8 K, and the relative error (RE) remains below 1.3%. The analysis results demonstrate that it can enhance the accuracy of temperature field calculations by the modification from flame image features.

Interpreting convolutional neural network by joint evaluation of multiple feature maps and an improved NSGA-II algorithm

The ’black box’ characteristics of Convolutional Neural Networks (CNNs) present significant risks to their application scenarios, such as reliability, security, and division of responsibilities. Addressing the interpretability of CNN emerges as an urgent and critical issue in the field of machine learning. Recent research on CNN interpretability has either yielded unstable or inconsistent interpretations, or produced coarse-scale interpretable heatmaps, limiting their applicability in various scenarios. In this work, we propose a novel method of CNNs interpretation by incorporating a joint evaluation of multiple feature maps and employing multi-objective optimization (JE&MOO-CAM). Firstly, a method of joint evaluation for all feature maps is proposed to preserve the complete object instances and improve the overall activation values. Secondly, an interpretation method of CNNs under the MOO framework is proposed to avoid the instability and inconsistency of interpretation. Finally, the operators of selection, crossover, and mutation, along with the method of population initialization in NSGA-II, are redesigned to properly express the characteristics of CNNs. The experimental results, including both qualitative and quantitative assessments along with a sanity check conducted on three classic CNN models—VGG16, AlexNet, and ResNet50—demonstrate the superior performance of the proposed JE&MOO-CAM model. This model not only accurately pinpoints the instances within the image requiring explanation but also preserves the integrity of these instances to the greatest extent possible. These capabilities signify that JE&MOO-CAM surpasses six other leading state-of-the-art methods across four established evaluation criteria.

Convolutional neural network and glioma genotyping: A systematic review.

e14038 Background: Gliomas are the most common primary intracranial tumors. Overall, there are 23 different glioma types, and the grading and prognosis of each type are determined by their specific mutations. Several identified mutations are IDH gene status, CDKN2A/B homozygote delegation, PTEN mutation, p53 mutation, TERT promotor mutation, H3K27M mutation, MGMT promotor methylation, trisomy 7/monozomy10, EGFR amplification, ATRX mutation, 1p/19q codeletion, and BRAF mutation. These specific mutations and genomic features can have their distinctive radiologic features seen in different magnetic resonance imaging (MRI) sequences. By using a Convolutional Neural Network (CNN) for feature extraction, the genotyping power of MRI for glioma could be increased. To address this, we systematically reviewed the use of different CNN-based models to detect the genetic context of glioma based on the MRI images. Methods: We conducted a systematic search in PubMed, Embase, Scopus, Web of Science, and Google Scholar. We included original peer-reviewed human studies (retrospective or prospective), focusing on the use of CNN in individuals with glioma. We excluded animal studies, studies with no CNN-based models, reviews, book chapters, conference abstracts, and case reports. JBI checklists were utilized for quality assessment. Results: The initial search resulted in 973 articles. after removing duplicates, 563 studies entered the screening process by title and abstract. 59 studies met our inclusion criteria (56 retrospective and 3 prospective cohort studies) with a total of 26434 glioma patients included (studies ranged from 21 – 2648 individuals). 31 studies used CNN methods only in different stages of image processing (tumor segmentation, feature extraction, image encoder) and 28 studies used CNN as a classifier and mutation predictor. ResNet was the most commonly used CNN-based model (n = 14). U-net (n = 7) and DenseNet models (n = 4) were other commonly used CNN-based models. Included studies targeted IDH status (n=44), 1p/19q codeletion (n=18), MGMT promotor methylation (n=11), ATRX mutation (n=5), TERT promotor mutation (n=5), CDKN2A/B homozygote deletion (n=3), PTEN mutation (n=3), p53 mutation (n=3), H3K27M mutation (n=2), trisomy 7/monozomy10 (n=2), EGFR amplification (n=2), and BRAF mutation (n=1). Highly severe methodological heterogeneity among these studies excluded the possibility of meta-analysis. Conclusions: Current studies have shown that, as a non-invasive method, using CNN-based models on multiple MRI sequences increases the power of early detection and prediction of glioma genetic types before pathological confirmation and has promising results. However, DL performance varies among mutations. Combining multiple DL models with clinical and radiomic features in different and larger databases can further increase the final results.

Face recognition for smart door security access with convolutional neural network method

Face recognition for smart door security access with convolutional neural network method

Image Classification of Traditional Indonesian Cakes Using Convolutional Neural Network (CNN)

Indonesia is one of the countries famous for its traditional culinary. Traditional cakes in Indonesia are traditional snacks typical of the archipelago's culture which have a variety of textures, shapes, colors that vary and some are similar so that there are still many people who do not know the name of the cake from the many types of traditional Indonesian cakes. The problem can be solved by creating a traditional cake image recognition system that can be programmed and trained to classify various types of traditional Indonesian cakes. The Convolutional Neural Network method with the AlexNet architecture model is used in this research to predict various kinds of traditional Indonesian cakes. The dataset used in this research is 1846 datasets with 8 classes of cake images. This study trained the AlexNet model with several optimizers, namely, Adam optimizer, SGD, and RMSprop. The best parameters from the model testing results are at batchsize 16, epoch 50, learning rate 0.01 for SGD optimizer and learning rate 0.001 for Adam and RMSprop optimizers. Each optimizer tested produces different accuracy, precision, recall, and f1_score values. The highest test results that have been carried out on the image dataset of typical Indonesian traditional cakes are obtained by the Adam optimizer with an accuracy value of 79%.