RMSprop Optimizer Research Articles

DIAGNOSIS OF PROSTATE CANCER WITH ENHANCED EFFICIENCY USING FINE-TUNED CNN AND TRANSFER LEARNING

Cancer is one of the high-risk diseases for humans. Prostate cases are the second most common disease in men after lung cancer, and early diagnosis is vital. Artificial intelligence technologies have begun to be used in the diagnosis of prostate cancer, and more effective and sensitive results have been obtained, preventing potential errors in human-centered methods. In this study, in order to increase the classification performance in the diagnosis of prostate cancer, transfer learning methods and fine-tuning processes, which have higher success and learning ability with less training data, unlike machine learning methods, were applied. The two-class data set consisting of prostate cancer MR images, ‘significant’ and ‘not-significant’, was classified with Alexnet, Densenet201, Googlenet, and Vgg16 models with the feature extraction approach, and 71.40%, 72.05%, 65%, and 80.13% accuracy results were obtained respectively. To increase these rates, pre-trained transfer learning models were used and accuracy results of 89.74%, 94.32%, 85.59%, and 91.05% were achieved, respectively. A 98.10% validation result was obtained using the cross-validation method in the Densenet201 model. DenseNet201 model achieved the highest accuracy result of 98.63% in transfer learning with the combination of the RMSProp optimization method. The proposed transfer learning model provided an improvement of approximately 26% compared to the feature extraction method.

Betta Fish Identification System Based On Convolutional Neural Network

This study developed an automated identification system based on the Convolutional Neural Network (CNN) to classify Betta Splendens, a fish species with high economic value in Indonesia. The system aims to improve accuracy and efficiency in the identification process. The research was divided into several experiments, where the data was split into 320 images for training, 80 for validation, and 100 for testing. We used two optimizers, Adam and RMSprop. The Adam optimizer experiments conducted two stages with learning rates of 0.0001 and 0.001, each with 100 and 200 epochs. The results showed that a lower learning rate (0.0001) with 200 epochs yielded the best test accuracy of 71%, while a learning rate of 0.001 caused accuracy to stagnate at 66%, indicating potential overfitting. The RMSprop optimizer with a learning rate of 0.00001 demonstrated good stability, though with slightly lower accuracy than Adam. This study highlights the importance of selecting the appropriate learning rate and number of epochs to achieve an optimal balance between training, validation, and testing accuracy, ensuring the model generalizes well to new data.

Long-short-term memory (LSTM)-based modeling of the stiffness of 3D-printed PLA parts

This study applied a computationally efficient Taguchi-based long-short-term memory (LSTM) algorithm to predict the elastic modulus of 3D-printed polylactic acid (PLA) specimens. 128 data points were collected from the literature, and 80% were allocated for training and the rest for the validation of the LSTM algorithm. The results suggested that the LSTM algorithm, configured with 25 units in the first memory cell, 100 units in the second memory cell, the “selu” activation function in the first memory cell, the “elu” activation function in the second memory cell, the RMSprop optimizer, and a learning rate of 0.01, was precisely able to predict the elastic modulus of 3D-printed PLA parts.

Hybridization of Machine Learning Model with Bee Colony based Feature Selection for Medical Data Classification

Nowadays, an important count of biomedical data is created continuously in several biomedical equipment and experiments because of quick technical enhancements in biomedical science. The study of clinical and health data is vital to enhance the analysis precision, prevention, and treatment. Initial analysis and treatment are extremely important approaches for preventing deaths in many diseases. Accordingly, the data mining and machine learning (ML) approaches are helpful tools for utilizing minimization error and for providing helpful data for analysis. But the data obtained in digital machines takes higher dimensionality, and not every data attained in digital machines is significant to specific diseases. This article develops an artificial bee colony-based feature selection with optimal hybrid ML model for medical data classification (ABCFS-OHML) technique. The presented ABCFS-OHML technique mainly aims to identify and classify the presence of disease using medical data. To attain this, the presented ABCFS-OHML technique initially pre-processes the input data in two ways namely null value removal and data transformation. Furthermore, the presented ABCFS-OHML technique uses ABCFS model for the choice of effectual subset of features. At last, root means square propagation with convolutional neural network-Hop field neural network (CNN-HFNN) model for classification purposes. The usage of RMSProp optimizer assists in attaining optimal hyperparameter selection of the CNN-HFNN method. The performance validation of the ABCFS-OHML technique takes place using three medical datasets. The comparison study reported that the ABCFS-OHML technique has accurately classified the medical data over other recent approaches.

Potato Beetle Detection with Real-Time and Deep Learning

In this study, deep learning methods were used to detect potato beetles (Leptinotarsa decemlineata) on potato plants. High-resolution images were taken of fields with the help of a drone. Since these images were large in size, each one was divided into six equal parts. Then, according to the image, the potato beetles were divided into three classes: adult, late-stage potato beetle, and no beetles. A data set was created with 3000 images in each class, making 9000 in total. Different filters were applied to the images that made up the data set. In this way, problems that may have arisen from the camera in real-time detection were minimized. At the same time, the accuracy rate was increased. The created data set was used with six different deep learning models: MobileNet, InceptionV3, ResNet101, AlexNet, DenseNet121, and Xception. The deep learning models were tested with Sgd, Adam, and Rmsprop optimization methods and their performances were compared. In order to evaluate the success of the models more accurately, they were tested on a second data set created with images taken from a different field. As a result of this study, the highest accuracy of 99.81% was obtained. In the test results from a second field that did not exist in the data set, 92.95% accuracy was obtained. The average accuracy rate was 96.30%.

Performance of Deep Feed-Forward Neural Network Algorithm Based on Content-Based Filtering Approach

Background: Selecting a restaurant in a diverse city like Bandung can be challenging. This study leverages Twitter data and local restaurant information to develop an advanced recommendation system to improve decision-making. Objective: The system integrates content-based filtering (CBF) with deep feedforward neural network (DFF) classification to enhance the accuracy and relevance of restaurant recommendations. Methods: Data was sourced from Twitter and PergiKuliner, with restaurant-related tweets converted into rating values. The CBF combined Bag of Words (BoW) and cosine similarity, followed by DFF classification. SMOTE was applied during training to address data imbalance. Results: The initial evaluation of CBF showed a Mean Absolute Error (MAE) of 0.0614 and a Root Mean Square Error (RMSE) of 0.0934. The optimal DFF configuration in the first phase used two layers with 32/16 nodes, a dropout rate of 0.3, and a 20% test size. This setup achieved an accuracy of 81.08%, precision of 82.89%, recall of 76.93%, and f1-scores of 79.23%. In the second phase, the RMSprop optimizer improved accuracy to 81.30%, and tuning the learning rate to 0.0596 further increased accuracy to 89%, marking a 9.77% improvement. Conclusion: The research successfully developed a robust recommendation system, significantly improving restaurant recommendation accuracy in Bandung. The 9.77% accuracy increase highlights the importance of hyperparameter tuning. SMOTE also proved crucial in balancing the dataset, contributing to a well-rounded learning model. Future studies could explore additional contextual factors and experiment with recurrent or convolutional neural networks to enhance performance further.

Lumpy skin disease diagnosis in cattle: A deep learning approach optimized with RMSProp and MobileNetV2.

Lumpy skin disease (LSD) is a critical problem for cattle populations, affecting both individual cows and the entire herd. Given cattle's critical role in meeting human needs, effective management of this disease is essential to prevent significant losses. The study proposes a deep learning approach using the MobileNetV2 model and the RMSprop optimizer to address this challenge. Tests on a dataset of healthy and lumpy cattle images show an impressive accuracy of 95%, outperforming existing benchmarks by 4-10%. These results underline the potential of the proposed methodology to revolutionize the diagnosis and management of skin diseases in cattle farming. Researchers and graduate students are the audience for our paper.

An efficient method for disaster tweets classification using gradient-based optimized convolutional neural networks with BERT embeddings

Event of the disastrous scenarios are actively discussed on microblogging platforms like Twitter which can lead to chaotic situations. In the era of machine learning and deep learning, these chaotic situations can be effectively controlled by developing efficient methods and models that can assist in classifying real and fake tweets. In this research article, an efficient method named BERT Embedding based CNN model with RMSProp Optimizer is proposed to effectively classify the tweets related disastrous scenario. Tweet classification is carried out via some of the popular the machine learning algorithms such as logistic regression and decision tree classifiers. Noting the low accuracy of machine learning models, Convolutional Neural Network (CNN) based deep learning model is selected as the primary classification method. CNNs performance is improved via optimization of the parameters with gradient based optimizers. To further elevate accuracy and to capture contextual semantics from the text data, BERT embeddings are included in the proposed model. The performance of proposed method - BERT Embedding based CNN model with RMSProp Optimizer achieved an F1 score of 0.80 and an Accuracy of 0.83. The methodology presented in this research article is comprised of the following key contributions:•Identification of suitable text classification model that can effectively capture complex patterns when dealing with large vocabularies or nuanced language structures in disaster management scenarios.•The method explores the gradient based optimization techniques such as Adam Optimizer, Stochastic Gradient Descent (SGD) Optimizer, AdaGrad, and RMSprop Optimizer to identify the most appropriate optimizer that meets the characteristics of the dataset and the CNN model architecture.•“BERT Embedding based CNN model with RMSProp Optimizer” – a method to classify the disaster tweets and capture semantic representations by leveraging BERT embeddings with appropriate feature selection is presented and models are validated with appropriate comparative analysis.

Image Classification of Traditional Indonesian Cakes Using Convolutional Neural Network (CNN)

Indonesia is one of the countries famous for its traditional culinary. Traditional cakes in Indonesia are traditional snacks typical of the archipelago's culture which have a variety of textures, shapes, colors that vary and some are similar so that there are still many people who do not know the name of the cake from the many types of traditional Indonesian cakes. The problem can be solved by creating a traditional cake image recognition system that can be programmed and trained to classify various types of traditional Indonesian cakes. The Convolutional Neural Network method with the AlexNet architecture model is used in this research to predict various kinds of traditional Indonesian cakes. The dataset used in this research is 1846 datasets with 8 classes of cake images. This study trained the AlexNet model with several optimizers, namely, Adam optimizer, SGD, and RMSprop. The best parameters from the model testing results are at batchsize 16, epoch 50, learning rate 0.01 for SGD optimizer and learning rate 0.001 for Adam and RMSprop optimizers. Each optimizer tested produces different accuracy, precision, recall, and f1_score values. The highest test results that have been carried out on the image dataset of typical Indonesian traditional cakes are obtained by the Adam optimizer with an accuracy value of 79%.

НОВЫЙ ПОДХОД НА ОСНОВЕ ТРАНСФЕРНОГО ГЛУБОКОГО ОБУЧЕНИЯ ДЛЯ ПРОГНОЗИРОВАНИЯ ОПУХОЛЕЙ ГОЛОВНОГО МОЗГА

A brain tumor refers to an abnormal collection or aggregation of cells in the brain that has the potential to be life-threatening owing to the cells’ capacity to penetrate and metastasize to organs that are nearby. It is possible to save lives by making a correct diagnosis of this potentially fatal condition. Within the last several years, there has been a noticeable increase in the functionality of deep learning applications. As a result, improving the module’s architecture leads to better approximations in the monitored configuration. Through the provision of trustworthy datasets, the categorization of tumors via the use of deep learning algorithms has successfully achieved significant progress. The purpose of this article is to use transfer module algorithms for the prediction of brain tumors. These modules include MobileNet, VGG19, InceptionResNetV2, Inception, and DenseNet201. The suggested module uses three main optimizers: Adam, SGD, and RMSprop. The simulation findings indicate that the pre-trained MobileNet module with the RMSprop optimizer outperformed all other evaluated modules. In addition to having the shortest amount of time required for computing, it obtained an accuracy of 99.6 %, a sensitivity of 99.4 %, and a specificity of 100 %.

Enhancing Qur'anic Recitation Experience with CNN and MFCC Features for Emotion Identification

In this study, MFCC feature extraction and CNN algorithms are used to examine the identification of emotions in the murottal sounds of the Qur'an. A CNN model with labelled emotions is trained and tested, as well as data collection of Qur'anic murottal voices from a variety of readers using MFCC feature extraction to capture acoustic properties. The outcomes show that MFCC and CNN work together to significantly improve emotion identification. The CNN model attains an accuracy rate of 56 percent with the Adam optimizer (batch size 8) and a minimum of 45 percent with the RMSprop optimizer (batch size 16). Notably, accuracy is improved by using fewer emotional parameters, and the Adam optimizer is stable across a range of batch sizes. With its insightful analysis of emotional expression and user-specific recommendations, this work advances the field of emotion identification technology in the context of multitonal music.

Reinforcement learning-based heuristic planning for optimized energy management in power-split hybrid electric heavy duty vehicles

In this work, we systematically integrate relevant expertise, specifically on the optimal brake-specific fuel consumption (BSFC) curve, battery characteristics and terrain information into the development of an energy management plan for heavy-duty power-split hybrid electric vehicles. We utilize deep deterministic policy gradient (DDPG) algorithm as one of the most sophisticated reinforcement learning technique. Initially, we begin by explaining the vehicle configuration's system modeling. Subsequently, we then present an energy management approach based on deep Q-learning concepts. A novel algorithm, Deep Deterministic Policy Gradient, for energy management control, have been created to combat the “curse of dimensionality” in reinforcement learning. The new AMSGrad optimization technique is used by DDPG algorithm to update the weight of neural networks. We robustly train the proposed control system in realistic driving environment. The Knowledge Incorporation (KI) based DDPG based system is compared systematically to the conventional DDDPG methodology and the benchmark Dynamic Programming (DP) method, the latter of which usually uses the RMSProp Optimizer in its formulation. The results show that as compared to the typical DQL policy, deep reinforcement learning approaches, notably expert Knowledge incorporation KI-DDPG and terrain information with the AMSGrad optimizer, achieve faster training speeds and reduced fuel consumption while maintaining the terminal state of charge (SOC).

From Plants to Pixels: The Role of Artificial Intelligence in Identifying Sericea Lespedeza in Field-Based Studies

The increasing use of convolutional neural networks (CNNs) has brought about a significant transformation in numerous fields, such as image categorization and identification. In the development of a CNN model to classify images of sericea lespedeza [SL; Lespedeza cuneata (Dum-Cours) G. Don] from weed images, four architectures were explored: CNN model variant 1, CNN model variant 2, the Visual Geometry Group (VGG16) model, and ResNet50. CNN model variant 1 (batch normalization with adjusted dropout method) demonstrated 100% validation accuracy, while variant 2 (RMSprop optimization with adjusted learning rate) achieved 90.78% validation accuracy. Pre-trained models, like VGG16 and ResNet50, were also analyzed. In contrast, ResNet50’s steady learning pattern indicated the potential for better generalization. A detailed evaluation of these models revealed that variant 1 achieved a perfect score in precision, recall, and F1 score, indicating superior optimization and feature utilization. Variant 2 presented a balanced performance, with metrics between 86% and 93%. VGG16 mirrored the behavior of variant 2, both maintaining around 90% accuracy. In contrast, ResNet50’s results revealed a conservative approach for class 0 predictions. Overall, variant 1 stood out in performance, while both variant 2 and VGG16 showed balanced results. The reliability of CNN model variant 1 was highlighted by the significant accuracy percentages, suggesting potential for practical implementation in agriculture. In addition to the above, a smartphone application for the identification of SL in a field-based trial showed promising results with an accuracy of 98–99%. The conclusion from the above is that a CNN model with batch normalization has the potential to play a crucial role in the future in redefining and optimizing the management of undesirable vegetation.

COVID-19 Diagnosis from Blood Gas Using Multivariate Linear Regression

With the impact of the COVID-19 outbreak, almost all scientists and nations began to show great interest in the subject for a long time. Studies in the field of outbreak, diagnosis and prevention are still ongoing. Issues such as methods developed to understand the spread mechanisms of the disease, prevention measures, vaccine and drug research are among the top priorities of the world agenda. The accuracy of the tests applied in the outbreak management has become extremely critical. In this study, it is aimed to obtain a function that finds the positive or negative COVID-19 test from the blood gas values of individuals by using Machine Learning methods to contribute to the outbreak management. Using the Multivariate Linear Regression (MLR) model, a linear function is obtained to represent the COVID-19 dataset taken from the Van province of Turkey. The data set obtained from Van Yüzüncü Yıl University Dursun Odabaş Medical Center consists of blood gas analysis samples (109 positive, 1146 negative) taken from individuals. It is thought that the linear function to be obtained by using these data will be an important method in determining the test results of individuals. Gradient Descent optimization methods are used to find the optimum values of the coefficients in the function to be obtained. In the study, the RMSProp optimization algorithm has a success rate of 58-91.23% in all measurement methods, and it is seen that it is much more successful than other optimization algorithms.

Comparing Optimizer Strategies For Enhancing Emotion Classification In IndoBERT Models

Emotions are one of the reactions of human when they receive physical or verbal action. Every human action is based on emotion. Every opinion expressed in the comments column also contains the author's emotions. This research aims to classify five emotions, Marah, Takut, Senang, Cinta, and Sedih and evaluate the performance of three commonly used optimizer, Adam, RMSProp, and Nadam. The processed data used IndoBERT model for Indonesian text classification. The research purpose to search the best optimizer for text classification. The result shows classification used Adam Optimizer 90,21%, RMSProp Optimizer 82.11, and Nadam Optimizer 88.61%. The Adam optimizer applied to the IndoBERT model yielded the best results. This shows a significant improvement from previous studies, which had emotion classification.

Optimizer algorithms and convolutional neural networks for text classification

<span lang="EN-US">Lately, deep learning has improved the algorithms and the architectures of several natural language processing (NLP) tasks. In spite of that, the performance of any deep learning model is widely impacted by the used optimizer algorithm; which allows updating the model parameters, finding the optimal weights, and minimizing the value of the loss function. Thus, this paper proposes a new convolutional neural network (CNN) architecture for text classification (TC) and sentiment analysis and uses it with various optimizer algorithms in the literature. Actually, in NLP, and particularly for sentiment classification concerns, the need for more empirical experiments increases the probability of selecting the pertinent optimizer. Hence, we have evaluated various optimizers on three types of text review datasets: small, medium, and large. Thereby, we examined the optimizers regarding the data amount and we have implemented our CNN model on three different sentiment analysis datasets so as to binary label text reviews. The experimental results illustrate that the adaptive optimization algorithms Adam and root mean square propagation (RMSprop) have surpassed the other optimizers. Moreover, our best CNN model which employed the RMSprop optimizer has achieved 90.48% accuracy and surpassed the state-of-the-art CNN models for binary sentiment classification problems.</span>

Application of Convolutional Neural Network ResNet-50 V2 on Image Classification of Rice Plant Disease

Rice is the most important crop in global food security and socioeconomic stability. A part of the world's population makes rice a food requirement but the problem is found that all rice varieties suffer from several diseases and pests. Therefore, it is necessary to ensure the quality of healthy and proper rice growth by detecting diseases present in rice plants and treatment of affected plants. In this study, the Convolutional Neural Network (CNN) algorithm was applied in classifying diseases on the leaves of rice plants by experimenting with several parameters and architecture to get the best accuracy. This study was conducted image classification of rice plant disease using CNN architecture ResNet-50V2 with data using preprocessing Augmentation. The test was conducted with three optimizers such as SGD, Adam, and RMSprop by combining various parameters, namely epoch, batch size, learning rate, and SGD and RMSprop optimizers. Division of image data with 70:30 ratio of training data and test data; 80:20; 90:10. From these results, it was found that Adam was the best optimizer in the 80:20 data division in this study with an accuracy level of 0.9992, followed by the SGD optimizer with an accuracy level of 0.9983, while the RMSProp optimizer was ranked third with an accuracy level of 0.9978.

State of health estimation of lithium-ion battery based on CNN–WNN–WLSTM

Accurate and stable estimation of the state of health (SOH), which is one of the critical indicators to characterize the ability of lithium-ion (Li-ion) batteries to store and release energy, is critical in the stable driving of electric vehicles. In this paper, a novel SOH estimation method based on the aging factors of battery, which combines convolutional neural network (CNN), wavelet neural network (WNN), and wavelet long short-term memory (WLSTM) named CNN–WNN–WLSTM, is designed. The proposed CNN–WNN–WLSTM estimation scheme inherits both the fast convergence and robust stability of the WNN, as well as the ability of long short-term memory neural network (LSTM) to extract the time series features of the data; moreover, using CNN can make the proposed algorithm extract the data features from the original battery data automatically, and the WNN–WLSTM is then adopted to produce the final SOH estimation by exploiting the features from the CNN. To further speed and achieve global optimization, the RMSprop optimizer, instead of the usually used Adagrad optimizer, is chosen as the solver of the CNN–WNN–WLSTM network. Experimental results on data set from the NASA Ames Prognostics Center of Excellence show that the proposed algorithm can be commendably used for Li-ion battery health management by quantitative comparison with other commonly used machine learning methods, such as back-propagation neural network, WNN, LSTM, WLSTM, convolutional neural network–long short-term memory neural network (CNN–LSTM), and Gaussian process regression.

Prediction of nitrous oxide emission of a municipal wastewater treatment plant using LSTM-based deep learning models.

Accurate assessment of greenhouse gas emissions from wastewater treatment plants is crucial for mitigating climate change. N2O is a potent greenhouse gas that is emitted from wastewater treatment plants during the biological denitrification process. In this study, we developed and evaluated deep learning models for predicting N2O emissions from a WWTP in Switzerland. Six key parameters were selected to obtain the optimal LSTM model by adjusting experimental parameter conditions. The optimal parameter condition was achieved with 150 neurons, the tanh activation function, the RMSprop optimization algorithm, a learning rate of 0.001, no dropout regularization, and a batch size of 128. Under the same conditions, we compared the performance of recurrent neural networks (RNNs) and Long Short-Term Memory (LSTM) networks. We found that LSTM models outperformed RNN models in predicting N2O emissions. The optimal LSTM model achieved a 36% improvement in mean absolute error (MAE), a 19% improvement in root mean squared error (RMSE), and a 6.92% improvement in R2 score compared to the RNN model. Additionally, LSTM models demonstrated better resilience to sudden changes in the target sequence, exhibiting a 9.54% higher percentage of explained variance compared to RNNs. These results highlight the potential of LSTM models for accurate and robust prediction of N2O emissions from wastewater treatment plants, contributing to effective greenhouse gas mitigation strategies.

Application of Machine Learning in Estimating Milk Yield According to the Phenotypic and Pedigree Data of Holstein-Friesian Cattle in Serbia

Summary This paper presents a deep neural network (DNN) approach designed to estimate the milk yield of Holstein-Friesian cattle. The DNN comprised stacked dense (fully connected) layers, each hidden layer followed by a dropout layer. Various configurations of the DNN were tested, incorporating 2 and 3 hidden layers containing 8 to 54 neurons. The experiment involved testing the DNN with different activation functions such as the sigmoid, tanh, and rectified linear unit (ReLU). The dropout rates ranging from 0 to 0.3 were employed, with the output layer using a linear activation function. The DNN models were trained using the Adam, SGD, and RMSprop optimizers, with the root mean square error serving as the loss metric. The training dataset comprised information from a unique database containing records of dairy cows in the Republic of Serbia, totaling 3,406 cows. The input parameters (a total of 27) for the DNN included breeding and milk yield data from the cow’s mother, as well as the father’s ID, whereas the output parameters (a total of 8) consisted of milk yield parameters (a total of 3) and breeding parameters of the cow (a total of 5). Training iterations were conducted using a batch size of 8 over 500, 1000, and 5000 epochs.