Multilayer Perceptron Model Research Articles

Air Pollutant Concentration Forecasting with WTMP: Wavelet Transform-Based Multilayer Perceptron

Atmospheric pollutants’ real-time changes and the internal interactions among various data make it challenging to efficiently predict concentration variations. In order to extract more information from the time series of pollutants and improve the accuracy of prediction models, we propose a type of Multilayer Perceptron model based on wavelet decomposition, named Wavelet Transform-based Multilayer Perceptron (WTMP) model. This model decomposes pollutant data through overlapping discrete wavelet transforms to extract non-stationarity and nonlinear dependencies in the time series. It combines the decomposed data with static covariate information such as data collection time and inputs them into an improved Multilayer Perceptron (MLP) model, reconstructing and outputting the prediction results. Finally, the model is validated using atmospheric pollutant data collected at a specific location in Ruian City, Zhejiang Province, China. The results indicate that the model performs well with minimal prediction errors.

A Novel Technique in Determining Mud Cake Permeability in SiO2 Nanoparticles and KCl Salt Water Based Drilling Fluid using Deep Learning Algorithm

The permeability of the mud cake formed at the formation-wellbore interface is an important factor in the designing of water-based drilling fluids. This study presents a novel approach to utilizing experimental thixotropic and rheological parameters of polymeric water-based drilling fluids having varying concentrations of SiO2 nanoparticles and KCl salt. A fully connected feed-forward multi-layered neural network, more commonly known as a Multilayer Perceptron (MLP) was developed to predict the mud cake permeability using input parameters such as SiO2 & KCl concentration, differential pressure, temperature, mud cake thickness, API LPLT and HPHT filter loss volume and spurt loss volume. The results suggested that the developed Multilayer Perceptron model effectively determined the mud cake permeability based on the input parameters of the WBDF mentioned above. The model converged on the global minima, minimizing the loss function using the Gradient descent algorithm. A higher Coefficient of Determination (R2) value i.e., 0.8781, and a lesser Root Mean Square Error (RMSE) value i.e., 0.04378 indicates the higher accuracy of the model. Pearson’s Coefficient of Correlation obtained via the heatmap indicates that mud cake permeability is strongly influenced by the differential pressure followed by filter loss volume, spurt loss volume, mud cake thickness, and temperature. Previous similar studies have focused on using machine learning algorithms, this study utilized a robust deep learning algorithm i.e., Multilayer Perceptron (MLP) neural network to simultaneously model the combined effects of SiO2 nanoparticles and KCl salt concentrations on mud cake permeability, offering an unprecedented level of accuracy in predicting key WBDF performance parameters

Spatial analysis and soft computational modeling for hazard assessment of potential toxic elements in potable groundwater

Swiftly increasing population and industrial developments of urban areas has accelerated the worsening of the water quality in recent years. Groundwater samples from different locations of the Doon valley, Garhwal Himalaya were analyzed to measure concentrations of six potential toxic elements (PTEs) viz. chromium (Cr), nickel (Ni), arsenic (As), molybdenum (Mo), cadmium (Cd), and lead (Pb) using Inductively Coupled Plasma Mass Spectrometer (ICP-MS) with the aim to study the spatial distribution and associated hazards. In addition, machine learning algorithms have been used for prediction of water quality and identification of influencing PTEs. The results inferred that the mean values (in the units of µg L−1) of analyzed PTEs were observed in the order of Mo (1.066) > Ni (0.744) > Pb (0.337) > As (0.186) > Cr (0.180) > Cd (0.026). The levels and computed risks of PTEs were found below the safe limits. The radial basis function neural network (RBF-NN) algorithms showed high level of accuracy in the predictions of heavy metal pollution index (HPI), heavy metal evaluation index (HEI), non-carcinogenic (N-CR) and carcinogenic (CR) parameters with determination coefficient values ranged from 0.912 to 0.976. However, the modified heavy metal pollution index (m-HPI) and contamination index (CI) predictions showed comparatively lower coefficient values as 0.753 and 0.657, respectively. The multilayer perceptron neural network (MLP-NN) demonstrated fluctuation in precision with determination coefficient between 0.167 and 0.954 for the prediction of computed indices (HPI, HEI, CI, m-HPI). In contrast, the proficiency in forecasting of non-carcinogenic and carcinogenic hazards for both sub-groups showcased coefficient values ranged from 0.887 to 0.995. As compared to each other, the radial basis function (RBF) model indicated closer alignments between predicted and actual values for pollution indices, while multilayer perceptron (MLP) model portrayed greater precision in prediction of health risk indices.

Enhanced robustness in machine learning: Application of an adaptive robust loss function

In the field of machine learning, the selection of a loss function plays a pivotal role in determining the training dynamics and generalization capability of models. Traditional loss functions such as mean square error (MSE) and cross-entropy are often not equipped to handle noisy and anomalous data effectively, which can result in models that perform poorly in practical scenarios. To address these shortcomings, this study introduces a novel adaptive robust loss function, enhanced by a tunable parameter , which allows for flexibility in adjusting the robustness of the function according to the nature of the data being processed. Our research demonstrates that this new loss function significantly improves the performance of linear regression and multilayer perceptron models, particularly in environments laden with noisy and anomalous data. By adapting the parameter , the function can cater to varying levels of data irregularities, thus enhancing the models accuracy and reliability across diverse and complex data environments. This adaptive mechanism not only offers a substantial theoretical contribution to the understanding of robust loss functions but also provides a practical tool for machine learning practitioners to develop models that are resilient to data imperfections. The implications of this research are profound, suggesting a shift towards more adaptive and robust approaches in machine learning model development.

Forecast of Sugarcane Yield in Chongzuo, Guangxi—LSTM Model Based on Fusion of Trend Yield and Meteorological Yield

Purpose: This paper develops a high-precision yield fusion prediction model for the sugarcane industry in Chongzuo, Guangxi, based on the trend yield and meteorological yield using the long short-term memory (LSTM) model to cope with the multiple factors affecting sugarcane production. Decision support is provided to agricultural producers, policymakers, and supply chain managers so that they can plan resource allocation, market strategies, and policy directions more effectively. Methods: The paper modeled trend yield and weather yield separately to explore the complex relationship between the two in influencing sugarcane production. Trend yields were predicted using the exponential smoothing and multilayer perceptron (MLP) models, while meteorological yields were modeled using stepwise regression. The predicted yields were used again as input variables into the LSTM deep learning network to fit the nonlinear relationship between the two yields. Results: The results showed that (1) the fusion strategy of meteorological yield and MLP trend yield adopted by the model was superior to the fusion strategy of meteorological yield and exponentially smoothed trend yield, achieving a very low mean square error (MSE) of 0.011 and a goodness of fit as high as 0.979, which indicated that the model prediction was highly in agreement with the actual yield, confirming the validity of the method. (2) The prediction curve is basically consistent with the trend of actual sugarcane yield, which predicts that the sugarcane yield in Chongzuo, Guangxi, is expected to maintain a stable and small growth trend in the next eight years. (3) The fusion prediction model proposed in this study provides an accurate and practical solution for sugarcane yield prediction in Chongzuo, Guangxi, with the unique advantage of effectively analyzing and integrating the natural and socio-economic factors affecting the yield, which is of significant reference value for the prediction of sugarcane yield in the local area and even in similar ecoregions.

Prediction of human O-linked glycosylation sites using stacked generalization and embeddings from pre-trained protein language model.

O-linked glycosylation, an essential post-translational modification process in Homo sapiens, involves attaching sugar moieties to the oxygen atoms of serine and/or threonine residues. It influences various biological and cellular functions. While threonine or serine residues within protein sequences are potential sites for O-linked glycosylation, not all serine and/or threonine residues undergo this modification, underscoring the importance of characterizing its occurrence. This study presents a novel approach for predicting intracellular and extracellular O-linked glycosylation events on proteins, which are crucial for comprehending cellular processes. Two base multi-layer perceptron models were trained by leveraging a stacked generalization framework. These base models respectively employ ProtT5 and Ankh O-linked glycosylation site-specific embeddings whose combined predictions are used to train the meta-multi-layer perceptron model. Trained on extensive O-linked glycosylation datasets, the stacked-generalization model demonstrated high predictive performance on independent test datasets. Furthermore, the study emphasizes the distinction between nucleocytoplasmic and extracellular O-linked glycosylation, offering insights into their functional implications that were overlooked in previous studies. By integrating the protein language model's embedding with stacked generalization techniques, this approach enhances predictive accuracy of O-linked glycosylation events and illuminates the intricate roles of O-linked glycosylation in proteomics, potentially accelerating the discovery of novel glycosylation sites. Stack-OglyPred-PLM produces Sensitivity, Specificity, Matthews Correlation Coefficient, and Accuracy of 90.50%, 89.60%, 0.464, and 89.70%, respectively on a benchmark NetOGlyc-4.0 independent test dataset. These results demonstrate that Stack-OglyPred-PLM is a robust computational tool to predict O-linked glycosylation sites in proteins. The developed tool, programs, training, and test dataset are available at https://github.com/PakhrinLab/Stack-OglyPred-PLM. Supplementary data are available at Bioinformatics online.

Predicting interfacial tension in brine-hydrogen/cushion gas systems under subsurface conditions: Implications for hydrogen geo-storage

Underground hydrogen storage (UHS) critically relies on cushion gas to maintain pressure balance during injection and withdrawal cycles, prevent excessive water inflow, and expand storage capacity. Interfacial tension (IFT) between brine and hydrogen/cushion gas mixtures is a key factor affecting fluid dynamics in porous media. This study develops four machine learning models— Decision Trees (DT), Random Forests (RF), Support Vector Machines (SVM), and Multi-Layer Perceptrons (MLP)—to predict IFT under geo-storage conditions. These models incorporate variables such as pressure, temperature, molality, overall gas density, and gas composition to evaluate the impact of different cushion gases. A group-based data splitting method enhances the realism of our tests by preventing information leakage between training and testing datasets. Shapley Additive Explanations (SHAP) reveal that while the MLP model prioritizes gas composition, the RF model focuses more on operational parameters like pressure and temperature, showing distinct predictive dynamics. The MLP model excels, achieving coefficients of determination (R2) of 0.96, root mean square error (RMSE) of 2.10 mN/m, and average absolute relative deviation (AARD) of 3.25%. This robustness positions the MLP model as a reliable tool for predicting IFT values between brine and hydrogen/cushion gas (es) mixtures beyond the confines of the studied dataset. The findings of this study present a promising approach to optimizing hydrogen geo-storage through accurate predictions of IFTs, offering significant implications for the advancement of energy storage technologies.

EGMA: Ensemble Learning-Based Hybrid Model Approach for Spam Detection

Spam messages have emerged as a significant issue in digital communication, adversely affecting users’ mental health, personal safety, and network resources. Traditional spam detection methods often suffer from low detection rates and high false positives, underscoring the need for more effective solutions. This paper proposes the EGMA model, an ensemble learning-based hybrid approach for spam detection in SMS messages, which integrates gated recurrent unit (GRU), multilayer perceptron (MLP), and hybrid autoencoder models utilizing a majority voting algorithm. The EGMA model enhances performance by incorporating additional statistical features extracted from message content and employing text vectorization techniques, such as Term Frequency–Inverse Document Frequency (TF-IDF) and CountVectorizer. The proposed model achieved impressive classification accuracies of 99.28% on the SMS Spam Collection dataset, 99.24% on the Email Spam dataset, 99.00% on the Enron-Spam dataset, 98.71% on the Super SMS dataset, and 95.09% on UtkMl’s Twitter Spam dataset. These results demonstrate that the EGMA model outperforms individual models and existing methods in the literature, providing a robust solution for enhancing spam detection performance and effectively mitigating the threats that spam messages pose in digital communication.

Critical comparison of potential machine learning methods for lightning thermal damage assessment of composite laminates

The present study assesses the potential of using machine learning (ML) methods to predict the extent of lightning thermal damage in fiber-reinforced composite laminates using three supervised machine learning (SML) algorithms: (1) linear regression (LR), (2) decision tree (DT)-based, and (3) MLP models. These models were based on the 10 most significant factors that influence the severity of lightning damage, including three current waveform parameters, four material configurations, and three orthogonal electrical conductivities of each composite. All models demonstrated good performance with coefficient of determination (R2) values between 0.84 ~ 0.96. The multilayer perceptron (MLP) regression model trained with the lightning matrix damage dataset showed the most promising results (R2 > 0.94). Additional hyperparameter optimization was performed to improve the prediction performance of the baseline MLP model. The hyperparameter optimization (Adam optimizer, tanh activation function, and three hidden layers with 234 neurons) slightly improved the performance of the baseline MLP model by ~0.02, but achieved faster convergence. This result suggests that the baseline MLP model trained with the lightning matrix damage dataset is sufficiently accurate and robust. This paper highlights that ML-informed regression models can serve as an efficient first pass-estimator of lightning matrix damage in composite laminates, potentially reducing the amount of extremely time-consuming and expensive laboratory-scale lightning tests or streamlining the development of complex lightning damage models for future design.

A hybrid predictive modeling approach for catalyzed polymerization reactors

Polymerization reactions are characterized by complex, nonlinear behaviors that pose significant challenges for conventional modeling techniques. Accurate and reliable models are crucial for advancing material science and enabling technological innovations across various industries. Conventional first-principles models often fall short in capturing the intricate dynamics of polymeric systems, leading to limitations in predictive accuracy. In this work, we propose a novel hybrid modeling approach that combines a conventional first-principles model with the strengths of a data-driven multi-layer perceptron (MLP) model and also a linear regression (LR) model to enhance the predictability of polymerization processes. Utilizing this hybrid approach significantly reduces the mean absolute error for predicting the concentrations of main reagents by 84% and 86%, respectively, in experiments with significantly deviant outcomes. Our results indicate that the model is capable of predicting the concentrations of both the main and side products with a maximum error margin of 3.5%.

Exploring the Mechanisms and Preventive Strategies for the Progression from Idiopathic Pulmonary Fibrosis to Lung Cancer: Insights from Transcriptomics and Genetic Factors.

Background: Idiopathic pulmonary fibrosis (IPF) leads to excessive fibrous tissue in the lungs, increasing the risk of lung cancer (LC) due to heightened fibroblast activity. Advances in nucleotide point mutation studies offer insights into fibrosis-to-cancer transitions. Methods: A two-sample Mendelian randomization (TSMR) approach was used to explore the causal relationship between IPF and LC. A weighted gene co-expression network analysis (WGCNA) identified shared gene modules related to immunogenic cell death (ICD) from transcriptomic datasets. Machine learning selected key genes, and a multi-layer perceptron (MLP) model was developed for IPF prediction and diagnosis. SMR and PheWAS were used to assess the expression of key genes concerning IPF risk. The impact of core genes on immune cells in the IPF microenvironment was explored, and in vivo experiments were conducted to examine the progression from IPF to LC. Results: The TSMR approach indicated a genetic predisposition for IPF progressing to LC. The predictive model, which includes eight ICD key genes, demonstrated a strong predictive capability (AUC = 0.839). The SMR analysis revealed that the elevated expression of MS4A4A was associated with an increased risk of IPF (OR = 1.275, 95% CI: 1.029-1.579; p = 0.026). The PheWAS did not identify any significant traits linked to MS4A4A expression. The rs9265808 locus in MS4A4A was identified as a susceptibility site for the progression of IPF to LC, with mutations potentially reprogramming lung neutrophils and increasing the LC risk. In vivo studies suggested MS4A4A as a promising therapeutic target. Conclusions: A causal link between IPF and LC was established, an effective prediction model was developed, and MS4A4A was highlighted as a therapeutic target to prevent IPF from progressing to LC.

Research on Momentum Prediction of Tennis Match Based on Scoring Model and Multilayer Perceptron

During a tennis match, players may encounter various circumstances that can significantly influence their performance. This force, known as "momentum," can drastically alter the game's flow and ultimately determine the winner. Addressing the challenge of analyzing and predicting momentum shifts, this study applied the Entropy Weight TOPSIS method combined with fuzzy comprehensive evaluation to assess player performance across technical, physical, and psychological factors. These methods provided a comprehensive analysis of the players' performance metrics, revealing patterns linked to momentum changes. Following this, Pearson correlation analysis was conducted to identify key performance indicators strongly associated with match outcomes. These indicators were then integrated into a Multilayer Perceptron (MLP) model, which demonstrated high predictive accuracy, with an R-value of 0.868, effectively capturing momentum shifts in real-time. The study's findings offer valuable insights for improving strategic decision-making during matches and hold potential applications in other fields that require real-time predictive analysis.

Predictive modeling of membrane reactor efficiency using advanced artificial neural networks for green hydrogen production

The imperative to decarbonize the energy sector has prompted substantial advancements in clean electricity generation, with hydrogen emerging as a promising low-carbon energy carrier. While hydrogen synthesis from renewable sources is crucial, challenges persist, necessitating innovative approaches for efficient and sustainable production. This study leverages diverse artificial neural network (ANN) models to assess and predict system efficiency based on key operational variables in membrane reactor systems. The multilayered perceptron (MLP) and radial basis function (RBF) methodologies are employed, with the MLP models optimized across twelve training algorithms and eight activation functions, exploring up to three hidden layers with variable neuron counts. The MLP model, utilizing the Levenberg-Marquard training algorithm and Tangent-Sigmoid activation function, achieved a high correlation coefficient (R2) of 0.9975 for training and 0.9962 for testing, and a mean squared error (MSE) of 0.00425 for training and 0.23951 for testing, indicating precise and accurate efficiency predictions. The Log-Sigmoid activation function also performed well, with R² values of 0.9971 (training) and 0.9961 (testing), and MSE values of 0.004086 (training) and 0.17694 (testing). Optimization of the RBF network identified the best performance with a spread parameter of 1 and 35 neurons, although the MLP model demonstrated superior accuracy and reduced computational time. Statistical analysis, encompassing correlation coefficient, mean squared error, Root Mean Squared error, absolute average deviation, absolute average relative deviation, and runtime, confirms the network’s consistent and accurate estimation of system efficiency across various input variables. The study highlights that applying tansig and logsig activation functions, configured with neuron counts of 20, 17, 6 and 23, 20, 2 at the first, second and third hidden layers, respectively, offers enhanced accuracy and reliability. The MLP model’s high performance underscores its potential to identify optimal conditions for H2 generation based on system efficiency, thereby advancing membrane reactor technology for hydrogen production.

LDAGM: prediction lncRNA-disease asociations by graph convolutional auto-encoder and multilayer perceptron based on multi-view heterogeneous networks

BackgroundLong non-coding RNAs (lncRNAs) can prevent, diagnose, and treat a variety of complex human diseases, and it is crucial to establish a method to efficiently predict lncRNA-disease associations.ResultsIn this paper, we propose a prediction method for the lncRNA-disease association relationship, named LDAGM, which is based on the Graph Convolutional Autoencoder and Multilayer Perceptron model. The method first extracts the functional similarity and Gaussian interaction profile kernel similarity of lncRNAs and miRNAs, as well as the semantic similarity and Gaussian interaction profile kernel similarity of diseases. It then constructs six homogeneous networks and deeply fuses them using a deep topology feature extraction method. The fused networks facilitate feature complementation and deep mining of the original association relationships, capturing the deep connections between nodes. Next, by combining the obtained deep topological features with the similarity network of lncRNA, disease, and miRNA interactions, we construct a multi-view heterogeneous network model. The Graph Convolutional Autoencoder is employed for nonlinear feature extraction. Finally, the extracted nonlinear features are combined with the deep topological features of the multi-view heterogeneous network to obtain the final feature representation of the lncRNA-disease pair. Prediction of the lncRNA-disease association relationship is performed using the Multilayer Perceptron model. To enhance the performance and stability of the Multilayer Perceptron model, we introduce a hidden layer called the aggregation layer in the Multilayer Perceptron model. Through a gate mechanism, it controls the flow of information between each hidden layer in the Multilayer Perceptron model, aiming to achieve optimal feature extraction from each hidden layer.ConclusionsParameter analysis, ablation studies, and comparison experiments verified the effectiveness of this method, and case studies verified the accuracy of this method in predicting lncRNA-disease association relationships.

Application of Machine Learning Models for Malware Classification With Real and Synthetic Datasets

Stacking of multiple Machine Learning (ML) classifiers have gained popularity in addressing anomalous data classification along with Deep Learning (DL) algorithms. This study compares traditional ML classifiers, multi-layer stacking ML classifiers, and DL classifiers using an open-source malware dataset-containing equal numbers of benign and malware samples. The results on the realistic dataset indicate that the DL classifier, utilizing a Bidirectional Long Short-Term Memory (BiLSTM) model, outperformed the stacked classifiers with Logistic Regression (LR) and Support Vector Machine (SVM) as Meta learners by 36.78% and 39.69%, respectively, in terms of classification accuracy and performance. The research work was extended to study the impact of Generative Adversarial Network (GAN) based synthetic dataset of relatively smaller size on deep learning models. It was observed that the Deep Learning Multi-Layer Perceptron (DLMLP) Model had relatively superior performance as compared to complex deep learning models like Long Short-Term Memory LSTM and BiLSTM

Uncovering factors predicting BRAF mutation in cutaneous melanoma

Abstract Introduction/Objective BRAF mutations are considered to be the most common genetic alteration in cutaneous melanoma (CM). Patient management relies on assessing molecular biomarkers enabling the personalization of patients’ treatment. The goal of this study was to develop the tools for predicting BRAF mutation using routine clinical and histological features. Methods/Case Report A total of 2041 CM cases were enrolled in the study to identify factors associated with BRAF mutation. Variables included sex, age, primary location, stage, histological type, ulceration, mitosis, Clark level, Breslow thickness, lymphocytes, lymphovascular invasion (LVI), perineural invasion (PNI), regression, microsatellite, association with nevus. Results (if a Case Study enter NA) The Ukrainian population demonstrated a high rate of BRAF mutation in CM, associated with the younger age and location at non-sun-expose skin. This study also revealed gender-specific differences in CM anatomic distribution and BRAF mutation subtype prevalence. By using the genetic selection method, the minimal set of variables related to BRAF mutations was defined and included age, primary tumor location, histological type, ulceration, LVI, and association with nevus. To encounter non- linear links, the non-linear neural network modeling was applied. For this aim multilayer perceptron (MLP) with one hidden layer was used. The hidden layer architecture included 4 neurons with a logistic activating function. The AUROCMLP6 of the model was 0.79 (0.74 – 0.84). When applying the optimal threshold, the following characteristics of the model were reached: sensitivity - 89.4% (84.5 – 93.1%); specificity - 50.7% (42.2% – 59.1%); positive predictive value (PPV) - 73.1% (69.6% – 76.3%) and NPV - 76.0% (67.6% – 82.8%) respectively. The developed MLP model allows the prediction of BRAF status in CM, facilitating decisions concerning further patient management. Conclusion The developed MLP model, relying on 6 variables analysis allows the prediction of BRAF status in melanoma, facilitating decisions concerning further patient management.

Simultaneous Recognition and Detection of Adenosine Phosphates by Machine Learning Analysis for Surface-Enhanced Raman Scattering Spectral Data.

Adenosine phosphates (adenosine 5'-monophosphate (AMP), adenosine 5'-diphosphate (ADP), and adenosine 5'-triphosphate (ATP)) play important roles in energy storage and signal transduction in the human body. Thus, a measurement method that simultaneously recognizes and detects adenosine phosphates is necessary to gain insight into complex energy-relevant biological processes. Surface-enhanced Raman scattering (SERS) is a powerful technique for this purpose. However, the similarities in size, charge, and structure of adenosine phosphates (APs) make their simultaneous recognition and detection difficult. Although approaches that combine SERS and machine learning have been studied, they require massive quantities of training data. In this study, limited AP spectral data were obtained using fabricated gold nanostructures for SERS measurements. The training data were created by feature selection and data augmentation after preprocessing the small amount of acquired spectral data. The performances of several machine learning models trained on these generated training data were compared. Multilayer perceptron model successfully detected the presence of AMP, ADP, and ATP with an accuracy of 0.914. Consequently, this study establishes a new measurement system that enables the highly accurate recognition and detection of adenosine phosphates from limited SERS spectral data.

Integration of machine learning and CFD for modeling mass transfer in water treatment using membrane separation process

This study aims to assess the efficacy of machine learning models in predicting solute concentration (C) distribution in a membrane separation process, using the input parameters which are spatial coordinates. Computational fluid dynamics (CFD) was employed with machine learning for simulation of process. The models evaluated include Kernel Ridge Regression (KRR), Radius nearest neighbor regression (RNN), K-nearest neighbors (KNN), LASSO, and Multi-Layer Perceptron (MLP). Additionally, Harris Hawks Optimization (HHO) was utilized to fine-tune the hyperparameters of these models. Leading the way is the MLP model, which achieves a remarkable test R2 value of 0.98637 together with very low RMSE and MAE values. Strongness and generalization capacity are shown by its consistent performance on test and training datasets. To conclude, the effectiveness of using machine learning regression methods more especially, KRR, KNN, RNN, LASSO, and MLP in estimating concentration from spatial coordinates was demonstrated in this work. For separation science via membranes where predictive modeling of spatial data is essential, the results offer important new perspectives by developing hybrid model.

A hybrid model of ARIMA and MLP with a Grasshopper optimization algorithm for time series forecasting of water quality

Water quality monitoring of rivers is necessary in order to properly manage their basins so that steps can be taken to control the amount of pollutants and bring them to the allowable level. The ARIMA (autoregressive integrated moving average) model does not consider nonlinear patterns in modeling water quality components. Also, in modeling using the MLP (Multilayer Perceptrons) model, both linear and nonlinear pattern are not controlled equally. Therefore, in the present study, linear time series models (ARIMA), MLP model, and a hybrid model of MLP and ARIMA optimized by a Grasshopper optimization algorithm are used to predict water quality components in the statistical period of 2011–2019. In the proposed hybrid method, the ability of the ARIMA and the MLP model are exploited. Observational water quality data for forecasting time series in the hybrid method include dissolved oxygen, water temperature, and boron over 108 months. Since, the hybrid model is capable of realizing the nonlinear essence of complicated time series, it makes more reliable forecasts. In the hybrid model, the correlation coefficients between the observational data and the predicted values are 0.9 for dissolved oxygen, 0.91 for water temperature, and 0.91 for boron. To compare the three ARIMA, MLP, and hybrid models, the accuracy indices of each model are calculated. The results show that the hybrid model’s higher accuracy compared with the other two models.

Multi-Layer Perceptron and Radial Basis Function Networks in Predictive Modeling of Churn for Mobile Telecommunications Based on Usage Patterns

Customer retention is a key priority for mobile telecommunications companies, as acquiring new customers is significantly more costly than retaining existing ones. A major challenge in this field is predicting customer churn—users discontinuing services. Traditional predictive models such as rule-based systems often struggle with the complex, non-linear nature of customer behavior. To address this, we propose the use of deep learning techniques, specifically multi-layer perceptron (MLP) and radial basis function (RBF) networks, to improve the accuracy of churn predictions. However, while neural networks excel in predictive performance, they are often criticized for being “black-box” models, lacking interpretability. A real-world data set is considered, which originally contained information about 15,000 randomly selected clients. Various network structures and configurations are analyzed. The obtained results are compared with results generated using fuzzy rule-based and rough-set rule-based systems. The MLP model achieved an almost perfect accuracy of 0.999 with an F-measure of 0.989, outperforming traditional methods such as fuzzy rule-based and rough-set systems. Although the RBF model slightly lagged in accuracy, it demonstrated a superior recall of 0.993, indicating better identification of potential churners. These results demonstrate that neural network models significantly enhance predictive performance in churn modeling. The interpretability of the model is also discussed since it bears significance in real applications. Our contribution lies in showing that deep learning methods significantly enhance churn prediction accuracy, though the challenge of model interpretability remains a critical area for future work.