Hyperparameter Tuning Research Articles

Assessment of Ensemble-Based Machine Learning Algorithms for Exoplanet Identification

This paper presents a comprehensive assessment procedure for evaluating Ensemble-based Machine Learning algorithms in the context of exoplanet classification. Each of the algorithm hyperparameter values were tuned. Deployments were carried out using the cross-validation method. Performance metrics, including accuracy, sensitivity, specificity, precision, and F1 score, were evaluated using confusion matrices generated from each implementation. Machine Learning (ML) algorithms were trained and used to identify exoplanet data. Most of the current research deals with traditional ML algorithms for this purpose. The Ensemble algorithm is another type of ML technique that combines the prediction performance of two or more algorithms to obtain an improved final prediction. Few studies have applied Ensemble algorithms to predict exoplanets. To the best of our knowledge, no paper that has exclusively assessed Ensemble algorithms exists, highlighting a significant gap in the literature about the potential of Ensemble methods. Five Ensemble algorithms were evaluated in this paper: Adaboost, Random Forest, Stacking, Random Subspace Method, and Extremely Randomized Trees. They achieved an average performance of more than 80% in all metrics. The results underscore the substantial benefits of fine tuning hyperparameters to enhance predictive performance. The Stacking algorithm achieved a higher performance than the other algorithms. This aspect is discussed in this paper. The results of this work show that it is worth increasing the use of Ensemble algorithms to improve exoplanet identification.

Benchmarking data handling strategies for landslide susceptibility modeling using random forest workflows

Machine learning (ML) algorithms are frequently used in landslide susceptibility modeling. Different data handling strategies may generate variations in landslide susceptibility modeling, even when using the same ML algorithm. This research aims to compare the combinations of inventory data handling, cross validation (CV), and hyperparameter tuning strategies to generate landslide susceptibility maps. The results are expected to provide a general strategy for landslide susceptibility modeling using ML techniques. The authors employed eight landslide inventory data handling scenarios to convert a landslide polygon into a landslide point, i.e., the landslide point is located on the toe (minimum height), on the scarp (maximum height), at the center of the landslide, randomly inside the polygon (1 point), randomly inside the polygon (3 points), randomly inside the polygon (5 points), randomly inside the polygon (10 points), and 15 m grid sampling. Random forest models using CV–nonspatial hyperparameter tuning, spatial CV–spatial hyperparameter tuning, and spatial CV–forward feature selection–no hyperparameter tuning were applied for each data handling strategy. The combination generated 24 random forest ML workflows, which are applied using a complete inventory of 743 landslides triggered by Tropical Cyclone Cempaka (2017) in Pacitan Regency, Indonesia, and 11 landslide controlling factors. The results show that grid sampling with spatial CV and spatial hyperparameter tuning is favorable because the strategy can minimize overfitting, generate a relatively high-performance predictive model, and reduce the appearance of susceptibility artifacts in the landslide area. Careful data inventory handling, CV, and hyperparameter tuning strategies should be considered in landslide susceptibility modeling to increase the applicability of landslide susceptibility maps in practical application.

Deep Learning Enhanced CNN with Bio-Inspired Techniques and BCE For Effective Lung Nodules Detection & Classification For Accurate Diagnosis

Objectives: To propose a new hybrid deep learning model to boost lung nodule detection and classification in combination with a bioinspired method for efficient hyper-parameter optimization to maximize true positive and nodule discrimination rates. Methods: In order to extract the intrinsic and complex features from different lung nodules, deep learning-based enhanced CNN (ECNN) is used. Segmentation masks are generated using Mask-RCNN to isolate and capture the ROIs, which serve as input to CNN. Prior to segmentation and extraction, data cleaning, transformation, and augmentation is done. Hyper-parameter optimization is done using a bio-inspired differential evolution method, which helps to identify the learning rate and number of layers to achieve optimal performance. We utilize BCE to quantify the performance of classification tasks. A large-scale CT-DICOM image dataset with 25,1135 images is used for this research work, collected from the cancer imaging archive, which has a clinically proven record of 355 instances with detailed image analysis, tumor location, and bounding boxes with a resolution of 512x512 pixels. 175794 images are used for training, and 75341 images are used for testing and validation. The performance of the new system is assessed using MATLAB, where results are compared with existing models such as SVM-WSS, GCPSO-PNN, and 3D-DLCNN models. Findings: The newly suggested ECNN with DE Bio-inspired model boosts the performance of lung nodule detection and classification with 94.7% accuracy, 93.8% sensitivity, 94.5% specificity, 93.4% F1 score, 92.4% dice coefficient, 0.1 Log Loss and AUC-ROC with 0.93 TPR and 0.07 FPR. Novelty: The novel method presents an advanced computational model using deep learning and bio-inspired algorithms for robust classification of lung nodules, which significantly improves the early diagnosis. This CAD model overcomes the limitations of the existing approaches SVM-WSS, GCPSO-PNN, and 3D-DLCNN in terms of segmentation, classification, error detection, and hyper-parameter tuning. Keywords: Lung Nodules, Deep Learning, Disease Classification, Image Processing, ECNN- DE Classifier, CT-DICOM Dataset

Optimizing gene selection for Alzheimer’s disease classification: A Bayesian approach to filter and embedded techniques

Alzheimer’s disease (AD) classification, which is crucial for identifying AD-associated genes, relies heavily on effective feature selection (FS) to tackle the curse of dimensionality. Traditional methods like filter, wrapper, and embedded techniques have their drawbacks, including ignoring feature independence, sensitivity to classifier choices, and high computational costs. Hybrid approaches combining these methods seek to harness their collective strengths but face challenges, particularly in selecting the optimal number of features from each method. This selection is typically manual or requires time-intensive k-fold cross-validation (KFCV), significantly increasing computational demands and complicating the process with the need for extensive parameter optimization across families, thereby escalating the complexity and resource requirements of model development. To overcome these challenges, this work proposes a framework for optimal FS and classification in AD using a combination of filter and embedded techniques, enhanced with hyperparameter tuning. Firstly, gene expression data (GED) from the AD Neuroimaging Initiative (ADNI) is preprocessed. Then, Chi-square filter selection is applied to decrease correlated features. Next, Logistic Regression with ElasticNet penalty (LREN) is employed to further refine the feature set. Finally, Bayesian Optimization (BO) is introduced to automatically determine the optimal number of features (k for Chi-square and max_features for LREN), iteratively evaluating different combinations to find the set that maximizes model accuracy. The selection process is used primarily in the function of BO to tune automatically the (k and max_features while minimizing the number of features and maximizing the accuracy of the Support Vector Machine (SVM). The SVM was used as a classifier to overcome the problem of embedded selection sensitivity to the model of selection. The tuned features are then used to select relevant features from the ADNI dataset and fitted to different models. We evaluated the performance of five classifiers—logistic regression (LR), SVM, Ridge Classifier (RC), stochastic gradient descent classifier (SGD), and Gaussian Naïve Bayes(GNB) across various metrics. Among these, SVM achieved 100% performance in all metrics. This approach significantly reduced the FS time and the number of initial features to 0.6% and 0.02%, respectively. Notably, it identified 6 out of 20 selected features as directly AD-related. Comparative analysis reveals that the proposed method outperforms existing approaches on the ADNI dataset and other datasets. Statistical tests were conducted to assess the significance of the results compared to other methods, confirming a significant improvement and underscoring the effectiveness of the proposed framework in optimal FS and biological relevance confirmation.

Rapid shear capacity prediction of TRM-strengthened unreinforced masonry walls through interpretable machine learning deployed in a web app

The presented study provides an efficient and reliable tool for rapid shear capacity estimation of TRM-strengthened unreinforced masonry walls. For this purpose, a data-driven methodology based on a machine learning system is proposed using a dataset constituted of experimental results selected from the bibliography. The outlier points of the dataset were detected using the Cook’s distance methodology and removed from the raw dataset, which consisted of 113 examples and 11 input variables. In the processed dataset, 17 machine learning methods were trained, optimized through hyperparameter tuning, and compared on the test set. The most effective models were the optimized instances of XGBoost and CatBoost methods, which combined into a voting model to leverage the predictive capacity of more than a single regressor. The final blended model shows remarkable predicting capacity with the determination factor (R2) equal to 0.95 and the mean absolute percentage error equal to 8.03%. Also, the model’s predictions are compared with those of existing analytical relationships, and it is found to perform the best of all. In sequence, machine learning interpretation methods are applied to find how the predictors influence the target output. Am, ft, and n⋅tf were identified as the most significant predictors with a mainly positive influence on the shear capacity. Finally, the built machine learning system is employed in a user-friendly web app for easy access and usage by professionals and researchers.

Comparative Study on Stock Movement Prediction Using Hybrid Deep Learning Model

Applying machine learning techniques in stock market prediction has evolved significantly, with deep learning methodologies gaining prominence. Conventional algorithms such as Linear Regression and Neural Networks initially dominated but struggled to capture complex temporal dependencies in financial data. Recent research has explored deep learning architectures like LSTM and CNN and hybrids such as CNN-LSTM and LSTM-CNN, showcasing promising results. However, there's a gap in research comparing these models across different datasets, particularly in predicting stock movements. This study addresses this gap by conducting a comparative analysis of deep learning and hybrid models for stock movement prediction in the Indonesian banking sector. The evaluation based on RMSE and MAE reveals that the LSTM-CNN hybrid consistently outperforms other models, showcasing its versatility and accuracy across different data characteristics. Then, exploration through hyperparameter tuning demonstrates the criticality of parameter selection in optimizing model performance. These findings contribute to advancing predictive modeling in financial markets, offering valuable insights for investors, analysts, and policymakers. Further research in hyperparameter tuning and model optimization holds promise for enhancing accuracy and reliability in stock price prediction.

The risk factors determined by four machine learning methods for the change of difference of bone mineral density in post-menopausal women after three years follow-up

The prevalence of osteoporosis has drastically increased recently. It is not only the most frequent but is also a major global public health problem due to its high morbidity. There are many risk factors associated with osteoporosis were identified. However, most studies have used the traditional multiple linear regression (MLR) to explore their relationships. Recently, machine learning (Mach-L) has become a new modality for data analysis because it enables machine to learn from past data or experiences without being explicitly programmed and could capture nonlinear relationships better. These methods have the potential to outperform conventional MLR in disease prediction. In the present study, we enrolled a Chinese post-menopause cohort followed up for 4 years. The difference of T-score (δ-T score) was the dependent variable. Information such as demographic, biochemistry and life styles were the independent variables. Our goals were: (1) Compare the prediction accuracy between Mach-L and traditional MLR for δ-T score. (2) Rank the importance of risk factors (independent variables) for prediction of δ T-score. Totally, there were 1698 postmenopausal women were enrolled from MJ Health Database. Four different Mach-L methods namely, Random forest (RF), eXtreme Gradient Boosting (XGBoost), Naïve Bayes (NB), and stochastic gradient boosting (SGB), to construct predictive models for predicting δ-BMD after four years follow-up. The dataset was then randomly divided into an 80% training dataset for model building and a 20% testing dataset for model testing. A 10-fold cross-validation technique for hyperparameter tuning was used. The model with the lowest root mean square error for the validation dataset was viewed as the best model for each ML method. The averaged metrics of the RF, SGB, NB, and XGBoost models were used to compare the model performance of the benchmark MLR model that used the same training and testing dataset as the Mach-L methods. We defined that the priority demonstrated in each model ranked 1 as the most critical risk factor and 22 as the last selected risk factor. For Pearson correlation, age, education, BMI, HDL-C, and TSH were positively and plasma calcium level, and baseline T-score were negatively correlated with δ-T score. All four Mach-L methods yielded lower prediction errors than the MLR method and were all convincing Mach-L models. From our results, it could be noted that education level is the most important factor for δ-T Score, followed by DBP, smoking, SBP, UA, age, and LDL-C. All four Mach-L outperformed traditional MLR. By using Mach-L, the most important six risk factors were selected which are, from the most important to the least: DBP, SBP, UA, education level, TG and sleeping hour. δ T score was positively related to SBP, education level, UA and TG and negatively related to DBP and sleeping hour in postmenopausal Chinese women.

Deep Learning with Crested Porcupine Optimizer for Detection and Classification of Paddy Leaf Diseases for Sustainable Agriculture

India has a vast number of inhabitants and the main food source distribution is from agriculture. Agricultural lands are being demolished generally owing to plant and crop illnesses. The detection of plant diseases by using image processing models can aid agriculturalists in defending the farming area from damaging or affecting it. Paddy is the main harvest worldwide. Early recognition of the paddy diseases at dissimilar phases of development is very vital in paddy production. However, the present manual technique in identifying and classifying paddy diseases needs a very educated farmer and is time-consuming. Deep learning (DL) is an effectual research area in the classification of agriculture patterns where it can efficiently solve the problems of diseases identification. Therefore, the articles focus on the design and expansion of Deep Learning based Crested Porcupine Optimizer for the Detection and Classification of Paddy Leaf Diseases (DLCPO-DCPLD) method for Sustainable Agriculture. The main aim of the DLCPO-DCPLD method use DL method for the recognition and identification of rice plant leaf diseases. To accomplish this, the DLCPO-DCPLD technique performs the image pre-processing using Median Filtering (MF) to recover the excellence of the input frames. Next, the ConvNeXt-L method is applied for extraction of feature vectors from the pre-processed images. Also, the Conditional Variational Autoencoder (CVAE) model is utilized for the automated classification of Paddy Leaf diseases. Eventually, the hyperparameter tuning of the CVAE technique is accomplished by implementing the Crested Porcupine Optimizer (CPO) technique. To safeguard the enhanced predictive results of the DLCPO-DCPLD method, a sequence of experimentations is implemented on the benchmark dataset. The experimental validation of the DLCPO-DCPLD method portrayed a superior accuracy value of 99.12% over existing approaches.

Android-Based App Guava Leaf Diseases Identification using Convolution Neural Network

Guava is an economically significant fruit crop in many regions. Conventional plant disease identification depends on skilled workers visually inspecting samples, which can be laborious and error-prone. Therefore, the goal of this study is to create an Android app that uses InceptionV3 to precisely determine the health of guava plants, with an emphasis on hyperparameter tuning and ideal model selection. Inception V3 was chosen as the base model for this study as it outperformed the 25 pre-trained models from Keras API. The Guava leaves dataset consists of 120 raw images collected from real-time capture and the Google website. The images belong to four categories: Algal Spot, Red Rust, Whitefly, and Healthy leaf. The dataset was split into 60% for training and 40% for validation. To increase the number of images, augmentation was performed to multiply each training by 5 times. The 2048 features were extracted from the second last layer of Inception V3. These features were saved in the Numpy format to facilitate hyperparameter tuning. The best hyperparameter tuning results were achieved with a batch size of 4, a learning rate of 0.001, and the Adamax optimizer for 50 epochs, resulting in a validation accuracy of 0.99. This set of hyperparameters was used to train the model, yielding in a training accuracy of 0.98 and a validation accuracy of 0.9. The trained model was exported in the tflite file format and integrated into an Android app developed using Android Studio. To evaluate the performance evaluation of the app, 15 unseen images per class were used and the app achieved an overall F1-Score of 0.85, a recall of 0.85, a precision of 0.89, and a test accuracy of 0.85.

Modeling Emotion Recognition System from Facial Images Using Convolutional Neural Networks

Emotion classification is the process of identifying human emotions. Implementing technology to help people with emotional classification is considered a relatively popular research field. Until now, most of the work has been done to automate the recognition of facial cues (e.g., expressions) from several modalities (e.g., image, video, audio, and text). Deep learning architecture such as Convolutional Neural Networks (CNN) demonstrates promising results for emotion recognition. The research aims to build a CNN model while improving accuracy and performance. Two models are proposed in the research with some hyperparameter tuning followed by two datasets and other existing architecture that will be used and compared with the proposed architecture. The two datasets used are Facial Expression Recognition 2013 (FER2013) and Extended Cohn-Kanade (CK+), both of which are commonly used datasets in FER. In addition, the proposed model is compared with the previous model using the same setting and dataset. The result shows that the proposed models with the CK+ dataset gain higher accuracy, while some models with the FER2013 dataset have lower accuracy compared to previous research. The model trained with the FER2013 dataset has lower accuracy because of overfitting. Meanwhile, the model trained with CK+ has no overfitting problem. The research mainly explores the CNN model due to limited resources and time.

Advanced mathematical modeling of mitigating security threats in smart grids through deep ensemble model

A smart grid (SG) is a cutting-edge electrical grid that utilizes digital communication technology and automation to effectively handle electricity consumption, distribution, and generation. It incorporates energy storage systems, smart meters, and renewable energy sources for bidirectional communication and enhanced energy flow between grid modules. Due to their cyberattack vulnerability, SGs need robust safety measures to protect sensitive data, ensure public safety, and maintain a reliable power supply. Robust safety measures, comprising intrusion detection systems (IDSs), are significant to protect against malicious manipulation, unauthorized access, and data breaches in grid operations, confirming the electricity supply chain’s integrity, resilience, and reliability. Deep learning (DL) improves intrusion recognition in SGs by effectually analyzing network data, recognizing complex attack patterns, and adjusting to dynamic threats in real-time, thereby strengthening the reliability and resilience of the grid against cyber-attacks. This study develops a novel Mountain Gazelle Optimization with Deep Ensemble Learning based intrusion detection (MGODEL-ID) technique on SG environment. The MGODEL-ID methodology exploits ensemble learning with metaheuristic approaches to identify intrusions in the SG environment. Primarily, the MGODEL-ID approach utilizes Z-score normalization to convert the input data into a uniform format. Besides, the MGODEL-ID approach employs the MGO model for feature subset selection. Meanwhile, the detection of intrusions is performed by an ensemble of three classifiers such as long short-term memory (LSTM), deep autoencoder (DAE), and extreme learning machine (ELM). Eventually, the dung beetle optimizer (DBO) is utilized to tune the hyperparameter tuning of the classifiers. A widespread simulation outcome is made to demonstrate the improved security outcomes of the MGODEL-ID model. The experimental values implied that the MGODEL-ID model performs better than other models.

BundleMoCap++: Efficient, robust and smooth motion capture from sparse multiview videos

Producing smooth and accurate motions from sparse videos without requiring specialized equipment and markers is a long-standing problem in the research community. Most approaches typically involve complex processes such as temporal constraints, multiple stages combining data-driven regression and optimization techniques, and bundle solving over temporal windows. These increase the computational burden and introduce the challenge of hyperparameter tuning for the different objective terms. In contrast, BundleMoCap++ offers a simple yet effective approach to this problem. It solves the motion in a single stage, eliminating the need for temporal smoothness objectives while still delivering smooth motions without compromising accuracy. BundleMoCap++ outperforms the state-of-the-art without increasing complexity. Our approach is based on manifold interpolation between latent keyframes. By relying on a local manifold smoothness assumption and appropriate interpolation schemes, we efficiently solve a bundle of frames using two or more latent codes. Additionally, the method is implemented as a sliding window optimization and requires only the first frame to be properly initialized, reducing the overall computational burden. BundleMoCap++’s strength lies in achieving high-quality motion capture results with fewer computational resources. To do this efficiently, we propose a novel human pose prior that focuses on the geometric aspect of the latent space, modeling it as a hypersphere, allowing for the introduction of sophisticated interpolation techniques. We also propose an algorithm for optimizing the latent variables directly on the learned manifold, improving convergence and performance. Finally, we introduce high-order interpolation techniques adapted for the hypersphere, allowing us to increase the solving temporal window, enhancing performance and efficiency.

Machine Learning-Based Prediction of Neurodegenerative Disease in Patients With Type 2 Diabetes by Derivation and Validation in 2 Independent Korean Cohorts: Model Development and Validation Study.

Several machine learning (ML) prediction models for neurodegenerative diseases (NDs) in type 2 diabetes mellitus (T2DM) have recently been developed. However, the predictive power of these models is limited by the lack of multiple risk factors. This study aimed to assess the validity and use of an ML model for predicting the 3-year incidence of ND in patients with T2DM. We used data from 2 independent cohorts-the discovery cohort (1 hospital; n=22,311) and the validation cohort (2 hospitals; n=2915)-to predict ND. The outcome of interest was the presence or absence of ND at 3 years. We selected different ML-based models with hyperparameter tuning in the discovery cohort and conducted an area under the receiver operating characteristic curve (AUROC) analysis in the validation cohort. The study dataset included 22,311 (discovery) and 2915 (validation) patients with T2DM recruited between 2008 and 2022. ND was observed in 133 (0.6%) and 15 patients (0.5%) in the discovery and validation cohorts, respectively. The AdaBoost model had a mean AUROC of 0.82 (95% CI 0.79-0.85) in the discovery dataset. When this result was applied to the validation dataset, the AdaBoost model exhibited the best performance among the models, with an AUROC of 0.83 (accuracy of 78.6%, sensitivity of 78.6%, specificity of 78.6%, and balanced accuracy of 78.6%). The most influential factors in the AdaBoost model were age and cardiovascular disease. This study shows the use and feasibility of ML for assessing the incidence of ND in patients with T2DM and suggests its potential for use in screening patients. Further international studies are required to validate these findings.

Impact of Energy Prices and Macroeconomic Variables on GDP Prediction UK: Machine Learning Approach

Gross Domestic Product (GDP) is one of the critical indicators of an economy. This study aims to predict the GDP of the United Kingdom using vital macroeconomic variables from 1990 to 2018 as predictors, which include energy prices, unemployment rate, Real Effective Exchange Rate (REER) inflation and net migration. Several machine learning models, namely Support Vector Regression (SVR), Random Forest (RF) and Gradient Boosting Machines (GBM), were implemented, analysed and compared. The models were trained on both scaled and unscaled data, with hyperparameter tuning applied to optimise performance. The models’ performances and accuracy were analysed by employing evaluation metrics Root Mean Squared Error (RMSE), Mean Absolute Error (MAE), and Mean Absolute Percentage Error (MAPE). As per the findings, after hyperparameter tuning, the SVR model performed best in GDP prediction, followed by GBM. The results of this study underscore the critical role of macroeconomic variables in GDP prediction while highlighting the potential of machine learning models to produce valuable and reliable insight into economic forecasting.

A method for temperature sensor and model selection for machine tool thermal error modelling using ANFIS and ANN

AbstractThermal errors account for a significant part of the dimensional errors of components produced by precision machine tools. These errors are commonly compensated using predictions from temperature-based empirical models. The accuracy and robustness of these predictions are affected by the locations of temperature sensors used to obtain the model’s input data. Methods for sensor selection found in literature are often difficult to replicate and automate because they require tuning of several hyperparameters. This work presents a sensor and model selection approach that uses proper orthogonal decomposition (POD) and QR pivoting to select a subset of sensors that have been preinstalled in the machine tool as possible model inputs. These sensors are then sorted according to their correlation with the thermal error being modelled. The final set of inputs and thermal error model structure is chosen using Bayesian Information Criterion (BIC) to limit model overfitting. The approach was tested by modelling the Y-axis thermal error measured from air-cutting experiments performed under different spindle speeds and feed rates. This enabled determination of the structure and the choice inputs for Adaptive Neuro Fuzzy Inference System (ANFIS) and Artificial Neural Network (ANN) thermal error models. The accuracy of these models was compared to that of models trained using inputs selected by conventional approaches: the least absolute shrinkage and selection operator (LASSO), fuzzy c-means clustering (FCM), and principal component regression (PCR). The presented approach had better or comparable results to the conventional approaches while using fewer inputs. The presented approach is also well suited for automation compared to conventional approaches that require expert input.

Deep learning-powered visual place recognition for enhanced mobile multimedia communication in autonomous transport systems

The progress of autonomous transport systems (ATS) involves efficient multimedia communication for real-time data tradeoffs and environmental issues. Deep learning (DL) powered visual place recognition (VPR) was developed as an effective tool to improve mobile multimedia communication in ATS. VPR relates to the capability of a method or device to recognize and identify particular places or locations from the visual scene. This procedure involves inspecting visual data, like images or video frames, to control the unique features or features connected with diverse locations. By leveraging camera sensors, VPR allows vehicles to detect their surroundings, enabling context-aware communication and enhancing the entire system's performance. DL-empowered VPR offers a transformative manner to improve mobile multimedia communication in ATS. By identifying and understanding their situation, autonomous vehicles can communicate most effectively and operate reliably and safely, paving the way for a future characterized by seamless and intelligent transportation. This article develops a novel Deep Learning-Powered Visual Place Recognition for Enhanced Multimedia Communication in Autonomous Transport Systems (DLVPR-MCATS) methodology. The main aim of the DLVPR-MCATS methodology is to recognize visual places or not utilize optimal DL approaches. For this purpose, the DLVPR-MCATS approach utilizes a bilateral filtering (BF) based preprocessing model. For the feature fusion model, the DLVPR-MCATS approach follows three models: residual network (ResNet), EfficientNet, and MobileNetv2. Moreover, the hyperparameter tuning method uses the Harris Hawks Optimization (HHO) model. Finally, the bidirectional long short-term memory (BiLSTM) technique is implemented to recognize visual places. A wide range of simulations is executed to validate the solution of the DLVPR-MCATS method. The experimental validation of the DLVPR-MCATS method portrayed a superior performance over other models concerning various aspects.

A generalizable and interpretable model for early warning of pest-induced crop diseases using environmental data

Pest infestations and resulting crop diseases threaten global food security. Traditional pest and disease monitoring methods are time-consuming and prone to delays, thus necessitating the development of effective prediction strategies that facilitate early and timely detection. In response to this challenge, this research proposes a generalizable and interpretable machine learning model to predict two major rice pests—Green Leafhopper and Yellow Stem Borer—and a No Pest class using environmental data collected from various regions in India. The dataset, comprising factors such as temperature, humidity, and rainfall, underwent rigorous preprocessing. Key features like temperature difference, humidity difference, and vapor pressure deficit were engineered to enhance the model’s performance. Twelve baseline models were trained and their performance was evaluated using F1 scores and AUC values due to the imbalanced nature of the dataset. Through statistical analysis of baseline models, Random Forest, Balanced Random Forest, XGBoost, and CatBoost models, were selected for hyperparameter tuning via Optuna. The tuned CatBoost model demonstrated superior performance, achieving AUC values of 0.99 for Green Leafhoppers, 0.98 for Yellow Stem Borers, 1.00 for No Pest class and an overall F1 score of 0.9414 with a mean AUC value of 0.9912 across all classes. Additionally, Explainable Artificial Intelligence techniques, particularly SHAP, were employed to interpret the model’s predictions, identifying the relative importance of environmental factors in pest occurrence. This interpretability aligns the model’s predictions with established agronomic knowledge, enhancing its practical utility for early pest and disease detection. The generalizability of the proposed model suggests it can be adapted to other crops and regions, offering a valuable tool for early warning systems in agriculture, promoting sustainable practices, and reducing crop losses due to pests and diseases.

Machine learning based modeling for estimation of drug solubility in supercritical fluid by adjusting important parameters

Here, we employed machine learning models to predict how well Capecitabine drug would dissolve in supercritical carbon dioxide as the green solvent. The vision is to investigate the drug suitability for processing of nanodrugs with enhanced bioavailability in the body. In the employed data set, P (pressure) and T (temperature) serve as inputs, and Y, the solubility, is the only output for building the models. This study uses DT (Decision Tree) and MLP (Multilayer perceptron) as the core models. However, the raw and individual form of conventional algorithms may not provide accurate and general results. Ensemble methods like boosting improve the model performance. Also, single and ensemble models mounted on these models have hyper-parameters whose optimization affects the final models. Meta-heuristic algorithms are popular for tuning hyper-parameters. In this research, we used a new hybrid framework by coupling the basic models with the Adaboost algorithm (as an ensemble method) and PO and CS algorithms (as optimizers) to obtain four different models. The MLP model boosted with Adaboost and tuned with PO algorithm showed the best fitting accuracy among all models. This model reduces the RMSE error rate to 1.71, MSE to 2.92, and MAE to 1.42.

Predictive modeling and benchmarking for diamond price estimation: integrating classification, regression, hyperparameter tuning and execution time analysis

Predictive modeling and benchmarking for diamond price estimation: integrating classification, regression, hyperparameter tuning and execution time analysis

Acoustic process monitoring during the laser beam welding of stainless-steel foils using an adjustable ring mode laser beam source

Electrification of the mobility sector is vital to meet the targets for reducing greenhouse gas emissions. Besides battery-based mobility solutions, polymer electrolyte membrane fuel cells (PEMFCs) are a promising technology for electrifying drive trains, especially in heavy-duty applications, such as maritime or logistics. Bipolar plates, a key component of PEMFCs, can consist of two stainless-steel foils that must be welded to be gas-tight. In order to join the two metal foils, laser beam welding is the state-of-the-art technology. Current challenges include process instabilities at higher welding speeds, such as the humping effect, which can cause weld seam imperfections. Therefore, applying sensors for laser beam welding is a promising approach to monitor the welding process. AISI 316L foils were welded within the scope of this work with various process parameters using an adjustable ring mode laser beam source. Additionally, an optical microphone was used as a process monitoring system. By applying different parameter settings and due to the introduction of artificial faults, weld seam defects, such as a burn-through or a gap, were induced. After utilizing a noise reduction algorithm for the acoustic signals, numerous features in the time and frequency domains were extracted, with which multiple machine learning algorithms were trained and compared concerning their performance. A light gradient boosting machine was identified as a suitable machine learning model for weld seam classification. Finally, hyperparameter tuning was conducted, which resulted in a cross-validation accuracy of 94.78%, depending on the quality categories considered.