Extreme Learning Machine Method Research Articles

Weighted Two-Hidden-Layer Extreme Learning Machine Method with Improved Gray Wolf Optimization for Complex Data Classification

Extreme Learning Machine (ELM) is widely popular for its advantages such as fast training speed and good generalization performance. However, the randomness of hidden layer parameters in ELM leads to unstable prediction performance of the model. We propose a novel two-hidden-layer extreme learning machine (TELM) for complex data classification. Firstly, the idea of weighting is introduced into TELM, and a weighted two-hidden-layer extreme learning machine (WTELM) model is proposed to improve the classification accuracy of the model. Secondly, the convergence factor and position update formula in gray wolf optimization algorithm (GWO) are adjusted to enhance the optimization algorithm’s ability to search for optimal parameters. Finally, an improved gray wolf optimization (IGWO) is utilized to search for the optimal parameters of the WTELM model. The impact of different intelligent optimization algorithms on the model’s classification results is compared. The experimental results demonstrate that the classification accuracy of the WTELM model has been improved by about 11–18% compared to traditional ELM models. Moreover, compared to the WTELM model, the classification accuracy of the IGWO-WTELM model has improved by about 1–19%. This indicates that the method proposed in this paper is significantly superior to traditional ELM methods and their variants, improving the stability, training speed and classification accuracy of the model.

Short-Term Electrical Load Forecasting of 150 kV Ternate System Using Optimally Pruned Extreme Learning Machine (OPELM)

Short-term electrical loads forecasting is one of the most important factors in the design and operation of electrical systems. The purpose of electric load forecasting is to balance electricity demand and electricity supply. The load characteristics of Ternate City vary, so this study uses the Optimally Pruned Extreme Learning Machine (OPELM) method to predict electrical loads. The advantages of OPELM are the fast-learning speed and the selection of the right model, even though the data has a non-linear pattern. The accuracy of the OPELM method can be determined using a comparison method, namely the ELM method. Mean Absolute Percentage Error (MAPE) is used as the accuracy criterion. The results of the comparison of accuracy criteria show that the predictive performance of OPELM is better than that of ELM. The minimum error average of the OPELM forecast test results shows a MAPE of 5,2557%, for Saturday's forecast, while the ELM method gives a MAPE of 6.4278% on the same day.

Surface Roughness Prediction in Ultra-Precision Milling: An Extreme Learning Machine Method with Data Fusion.

This paper pioneers the use of the extreme learning machine (ELM) approach for surface roughness prediction in ultra-precision milling, leveraging the excellent fitting ability with small datasets and the fast learning speed of the extreme learning machine method. By providing abundant machining information, the machining parameters and force signal data are fused on the feature level to further improve ELM prediction accuracy. An ultra-precision milling experiment was designed and conducted to verify our proposed data-fusion-based ELM method. The results show that the ELM with data fusion outperforms other state-of-art methods in surface roughness prediction. It achieves an impressively low mean absolute percentage error of 1.6% while requiring a mere 18 s for model training.

Structural properties and diameter prediction of fine denier polyester fiber based on machine learning algorithms

Fine denier polyester fibers have attracted attention in electronic information industry owing to their unique structural properties and ultra fine diameters. Since there is a close connection between melt-spinning process parameters and their structural properties and diameters, the influence of process parameters on fiber structural properties and diameters is an issue worth further exploration. This study aims to construct prediction models based on the Gaussian process regression (GPR), radial basis function neural network (RBFNN) and extreme learning machine (ELM) algorithms to predict the structural properties and diameter of fine denier polyester fibers. For this purpose, firstly, fine denier polyester fibers with different structural properties (i.e., orientation degree and crystallinity) and diameters are produced by changing the key melt-spinning parameters, namely spinning temperature, take-up speed and metering pump speed. Then GPR, RBFNN and ELM methods are applied to predict the structural properties and diameter of fine denier polyester fibers based on the experimental data. Lastly, different predictive performance indicators, namely mean square error (MSE) and mean absolute error (MAE) are imported to evaluate the above three methods. The predicted results which the MSE values of GPR, RBFNN and ELM models are respectively 0.461, 0.358, 0.136, and the MAE values of GPR, RBFNN and ELM models are respectively 0.625, 0.564, 0.320 show that ELM model provided superior performance over the GPR and RBFNN models in predicting the structural properties and diameter of fine denier polyester fibers.

Detection of coal wagon load distributions based on geometrical features using extreme learning machine methods

Detection of coal wagon load distributions based on geometrical features using extreme learning machine methods

Modified Extreme Learning Machine Algorithm with Deterministic Weight Modification for Investment Decisions based on Sentiment Analysis

Background: A significant problem in economics is stock market prediction. Due to the noise and volatility, however, timely prediction is typically regarded as one of the most difficult challenges. A sentiment-based stock price prediction that takes investors' emotional trends into account to overcome these difficulties is essential. Objective: This study aims to enhance the ELM's generalization performance and prediction accuracy. Methods: This article presents a new sentiment analysis based-stock prediction method using a modified extreme learning machine (ELM) with deterministic weight modification (DWM) called S-DELM. First, investor sentiment is used in stock prediction, which can considerably increase the model's predictive power. Hence, a convolutional neural network (CNN) is used to classify the user comments. Second, DWM is applied to optimize the weights and biases of ELM. Results: The results of the experiments demonstrate that the S-DELM may not only increase prediction accuracy but also shorten prediction time, and investors' emotional tendencies are proven to help them achieve the expected results Conclusion: The performance of S-DELM is compared with different variants of ELM and some conventional method

A novel parallel series data-driven model for IATA-coded flight delays prediction and features analysis

Predicting and analysing flight delays is essential for successful air traffic management and control. We propose a novel parallel-series model and novel adaptive bidirectional extreme learning machine (AB-ELM) method for prediction and feature analysis to better understand the causes of flight delays as stated by the International Air Transport Association (IATA). The IATA-coded flight delays are rarely examined in the existing studies. The IATA-coded flight delay subcategories decision boundaries are improved by the proposed parallel-series model. In application areas, where multiclass-multilabel classification may produce erroneous performance, the parallel-series model can be regarded as an alternate strategy. To improve network generalization performance, the proposed AB-ELM optimizes the covariance objective function by altering the learning rate adaptively during gradient ascent as opposed to gradient descent. The historical data from one of Hong Kong's international airlines, which contains information about the airport, flight, aircraft, weather, and IATA flight delay subcategories is considered a case study. Using fourteen different sampling approaches, the influence of imbalanced and noisy data was reduced. The results showed that employing proper sampling approaches in conjunction with the parallel-series model and AB-ELM method is effective for uncovering hidden patterns in the complicated IATA-coded flight delay subcategories system. When compared to other data-driven approaches, AB-ELM attained a high accuracy of 80.66 percent. This study enables airlines to develop adequate contingency measures in advance based on potential flight delay reasons and duration.

Identification Of Hijaiyah Letters Image Using Extreme Learning Machine Method

The development of digital image processing technology has many benefits, one of which is the identification of an object, such as the identification of the image of the hijaiyah letter. Hijaiyah letters are the letters of the arabic alphabet as the original language of the Qur'an. In essence, humans have the ability to recognize and distinguish hijaiyah letter patterns from one another, but this is not the case with computers, using digital images and machine learning, in this study an identification concept was built by recognizing the image of hijaiyah letters using one of the machine learning methods. namely the extreme learning machine (ELM) method. Extreme learning machine (ELM) is a feedforward neural network with one hidden layer or better known as single hidden layer feedforward neural networks (SLFNs). Therefore, the purpose of this study is that the computer can identify objects as well as human capabilities and see how accurate the results obtained in the ELM method are. The digital image identification process using the extreme learning machine (ELM) method is carried out in two stages, namely training and testing, where previously the preprocessing process was carried out first by changing the color of the RGB image to HSV and processing the color v, then segmentation was carried out with the aim of separating the objects (foreground) with the background, then to make it easier to recognize the pattern, a morphological process is carried out. From the simulation carried out on the test data, the results obtained an average accuracy of 90% with an error of 10%.

MULTI-STRATEGY IMPROVED TUNA SWARM OPTIMIZATION (TSO)-BASED HYBRID KERNEL EXTREME LEARNING MACHINE MODEL FOR EARLY DIAGNOSIS OF PARKINSON’S DISEASE

Parkinson’s disease (PD) is a neurodegenerative disease that progresses slowly. In this study, a tuna swarm optimization (TSO)-based hybrid kernel extreme learning machine (HKELM) method was proposed for early phonetic recognition of PD. Herein, HKELM models were optimized using multi-strategy (reverse learning and greedy selection swarm initialization, sin–cos strategy disturbance, and Weibull variation disturbance) improved TSO for early diagnosis of PD. The HKELM was employed for early diagnosis of PD and its classification accuracy was evaluated. The results of the experiments reveal that, as compared to the unimproved tuna technique for optimizing ELM, the suggested algorithm converges faster, can leap out of the local optimal, and has higher optimization accuracy.

Evaluation of the Improved Extreme Learning Machine for Machine Failure Multiclass Classification

The recent advancements in sensor, big data, and artificial intelligence (AI) have introduced digital transformation in the manufacturing industry. Machine maintenance has been one of the central subjects in digital transformation in the manufacturing industry. Predictive maintenance is the latest maintenance strategy that relies on data and artificial intelligence techniques to predict machine failure and remaining life assessment. However, the imbalanced nature of machine data can result in inaccurate machine failure predictions. This research will use techniques and algorithms centered on Extreme Learning Machine (ELM) and their development to find a suitable algorithm to overcome imbalanced machine datasets. The dataset used in this research is Microsoft Azure for Predictive Maintenance, which has significantly imbalanced failure classes. Four improved ELM methods are evaluated in this paper, i.e., extreme machine learning with under-sampling/over-sampling, weighted-ELM, and weighted-ELM with radial basis function (RBF) kernel and particle swarm optimization (PSO). Our simulation results show that the combination of ELM with under-sampling gained the highest performance result, in which the average F1-score reached 0.9541 for binary classification and 0.9555 for multiclass classification.

Effectiveness of Crop Recommendation and Yield Prediction using Hybrid Moth Flame Optimization with Machine Learning

Agriculture is the main source of income, food, employment, and livelihood for most rural people in India. Several crops can be destroyed yearly due to a lack of technical skills and changing weather patterns such as rainfall, temperature, and other atmospheric parameters that play an enormous role in determining crop yield and profit. Therefore, selecting a suitable crop to increase crop yield is an essential aspect of improving real-life farming scenarios. Anticipating crop yield is one of the major concerns in agriculture and plays a critical role in global, regional, and field decision-making. Crop yield forecasting is based on crop parameters and meteorological, atmospheric, and soil conditions. This paper introduces a crop recommendation and yield prediction system using a Hybrid Moth Flame Optimization with Machine Learning (HMFO-ML) model. The presented HMFO-ML method effectively recommends crops and forecasts crop yield accurately and promptly. The proposed model used a Probabilistic Neural Network (PNN) for crop recommendation and the Extreme Learning Machine (ELM) method for the crop yield forecasting process. The HMFO algorithm was used to improve the forecasting rate of the ELM approach. A wide-ranging simulation analysis was carried out to evaluate the HMFO-ML model, showing its advantages over other models, as it exhibited a maximum R2 score of 98.82% and an accuracy of 99.67%.

Application of Extreme Learning Machine Method With Particle Swarm Optimization to Classify of Heart Disease

Penyakit jantung koroner adalah tersumbatnya suplai darah jantung. Penyakit jantung adalah penyebab utama kematian di seluruh dunia. Berbagai faktor risiko berkontribusi terhadap penyakit jantung, termasuk merokok, gaya hidup tidak sehat, kolesterol tinggi, dan hipertensi. Dengan demikian, prediksi penyakit dapat dilakukan untuk mengidentifikasi individu yang berisiko guna mencegah peningkatan kematian akibat penyakit jantung. Penambangan data, khususnya metode Extreme Machine Learning (ELM), biasanya digunakan untuk tujuan ini. ELM adalah metode jaringan saraf dalam kecepatan pelatihan dan tidak memerlukan propagasi balik, dan menentukan jumlah node tersembunyi yang optimal dan mencapai hasil yang akurat tetap menjadi tantangan. Pada penelitian ini, ELM dengan Particle Swarm Optimization (PSO) diusulkan untuk mengoptimalkan klasifikasi penyakit jantung, yang bertujuan untuk mencapai hasil optimal dengan pembelajaran cepat. Penelitian ini mengikuti proses yang sistematis, termasuk pengumpulan data, preprocessing, pemodelan, dan evaluasi menggunakan analisis matriks konfusi. Hasil dan pembahasan menyajikan efektivitas metode yang diusulkan dengan mengevaluasi akurasi klasifikasi berdasarkan berbagai parameter, seperti ukuran populasi, jumlah node tersembunyi, dan iterasi. Temuan menunjukkan bahwa ELM dengan optimasi PSO dapat memberikan hasil klasifikasi yang akurat untuk diagnosis penyakit jantung, dengan tingkat akurasi yang menjanjikan.

Accurately predicting the performance of MOF-based mixed matrix membranes for CO2 removal using a novel optimized extreme learning machine by BAT algorithm

The increasing number of mixed matrix membranes (MMMs) based on metal organic frameworks (MOFs) for carbon capture has created a demand for accurate and swift evaluation of their separation performance. Machine learning (ML) has emerged as a valuable tool for this purpose, providing an efficient approach for screening these materials and accelerating their practical application. In this study, we developed and optimized a novel and reliable hybrid machine learning paradigm based on the extreme learning machines (ELM) method using the BAT algorithm optimization. In order to predict the performance of MMMs, including gas permeability and selectivity parameters, nine machine learning models were developed by incorporating descriptors and fingerprints for polymer featurization, physical and structural features of MOFs as well as operating conditions. The impact of input features on MMMs performance was also explored using RReliefF analysis. The study found that the performance of the hybrid ELM-based algorithms was significantly improved by using the BAT algorithm. Furthermore, the RReliefF analysis revealed that the cage size of the MOF and the type of polymer matrix used are the most significant parameters in forecasting the permeability of MOF-based MMMs, while the loading amount and pressure were identified as critical determinants of selectivity. Overall, these findings contribute to the development of more efficient and accurate methods for evaluating MMMs, which are crucial for carbon capture applications.

Survival Prediction with Extreme Learning Machine, Supervised Principal Components and Regularized Cox Models in High-Dimensional Survival Data by Simulation

Mortality risks of important diseases such as cancer can be estimated using gene profiles which are high-dimensional data obtained from gene expression sequences. However, it is impossible to analyze high-dimensional data with classical techniques due to multicollinearity, time-consuming processing load, and difficulty interpreting the results. For this purpose, extreme learning machine methods, which can solve regression and classification problems, have become one of the most preferred machine learning methods regarding fast data analysis and ease of application. The goal of this study is to compare estimation performance of risk score and short-term survival with survival extreme learning machine methods, L2-penalty Cox regression, and supervised principal components analysis in generated high-dimensional survival data. The survival models have been evaluated by Harrell’s concordance index, integrated Brier score, F1 score, kappa coefficient, the area under the curve, the area under precision-recall, accuracy, and Matthew’s correlation coefficient. All results showed that survival extreme learning machine methods that allow analyzing high-dimensional survival data without the necessity of dimension reduction perform very competitive with the other popular classical methods used in the study.

Classification of Character Types of Wayang Kulit Using Extreme Learning Machine Algorithm

Wayang Kulit, which is an original Indonesian culture, is conditioned by the meaning of life in every performance. However, Wayang Kulit is currently less popular among young people due to a lack of understanding of the art of Wayang Kulit performance. To be able to provide knowledge to the younger generation about Wayang Kulit, one of which is by introducing the characters that exist in Wayang Kulit performances. This study aims to build an image classification system for Wayang Kulit characters by applying the neural network method using Extreme Learning Machine (ELM) and morphological feature extraction. Morphological feature extraction provides information about the shape characteristics of objects present in the image which are then used for input in the classification process. The Extreme Learning Machine (ELM) method may arbitrarily establish the weight value between the input neurons and the hidden layer during the classification step, resulting in a quicker learning pattern. Based on the test results using the confusion matrix, the accuracy value is calculated to get a value of 81%.

Improving the Performance of CNN by Using Dominant Patterns of CNN for Hand Detection

Many applications have used hand gestures for software interaction, image- and video-based action analysis, and behavioral monitoring. Hand detection is an essential step in the pipeline of these applications, and Convolutional Neural Networks (CNN) has provided superior solutions. However, CNN has similar features between hand and non-hand images, called non-dominant features. These features affect miss-classifications and long-time computation. Therefore, this paper focuses on the selection of dominant CNN features for hand detection, and it is our proposed method (DP-CNN) that selects the dominant feature patterns (DP) from the trained CNN features and classifies them using the Extreme Learning Machine (ELM) method. Evaluation results show the proposed method (DP-CNN-ELM), which can increase the accuracy and the F1-score of CNN. In addition, the proposed method can reduce the time computation of CNN in training and testing.

APPLICATION OF EXTREME LEARNING MACHINE METHOD ON STOCK CLOSING PRICE FORECASTING PT ANEKA TAMBANG (PERSERO) TBK

Artificial neural networks are modeling methods that can capture complex input and output relationships. This method is widely used in forecasting and classification. However, in its application, there are some disadvantages in terms of low learning rate resulting in computational delay. Extreme Learning Machine (ELM) was introduced to overcome these problems. This method is believed to be able to produce more accurate forecasting results with a low level of forecasting error. In Indonesia, stocks are one of the most popular investments for investors. Stock prices tend to be volatile which is influenced by the amount of market supply and demand, so forecasting analysis is needed to minimize the risks that may occur. This research applies the ELM method to forecast the closing price of PT ANTM Tbk shares from January 1, 2018 - October 31, 2022. The data used is secondary data obtained from the official website https://id.investing.com. The ELM method is applied by dividing training data for ELM modeling and testing data used in the forecasting process. The model architecture of the ELM method uses a combination of inputs obtained from the PACF plot, hidden nodes with a range of 5-50, and one output layer. The results of this study show excellent forecasting accuracy in terms of forecasting. This is measured by the MAPE value of 0.0358. The architecture formed in the ELM process is one input, 31 hidden nodes, and one output. Forecasting the closing price of PT ANTM Tbk shares with 1-31-1 architecture produces a forecasting value that shows a low decline, but is quite stable.

Fault Detection of Wastewater Treatment Plants Based on an Improved Kernel Extreme Learning Machine Method

In order to ensure the stable operation, improve efficiency, and enhance sustainability of wastewater treatment systems, this paper investigates the fault detection problem in wastewater treatment process based on an improved kernel extreme learning machine method. Firstly, a kernel extreme learning machine (KELM) model optimized by an improved mutation bald eagle search (IMBES) optimizer is proposed to generate point predictions of effluent quality parameters. Then, based on the point prediction results, the confidence interval of effluent quality parameters is calculated using kernel density estimation (KDE) method. This interval represents the bounds of system uncertainty and unknown disturbance at normal conditions and can be treated as the threshold for fault diagnosis. Finally, the effectiveness of the proposed method is illustrated by two datasets obtained from the BSM1 wastewater simulation platform and an actual water platform. Experimental results show that compared with other methods such as CNN, LSTM, and IBES-LSSVM, this method has a significant improvement in prediction accuracy, and at the same confidence level, it ensures fault detection rate while generating smaller confidence intervals.

Carbon Trading Price Prediction of Three Carbon Trading Markets in China Based on a Hybrid Model Combining CEEMDAN, SE, ISSA, and MKELM

Carbon trading has been deemed as the most effective mechanism to mitigate carbon emissions. However, during carbon trading market operation, competition among market participants will inevitably occur; hence, the precise forecasting of the carbon trading price (CTP) has become a significant element in the formulation of competition strategies. This investigation has established a hybrid CTP forecasting framework combining complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN), sample entropy (SE) method, improved salp swarm algorithm (ISSA), and multi-kernel extreme learning machine (MKELM) methods to improve forecasting accuracy. Firstly, the initial CTP data sequence is disintegrated into several intrinsic mode functions (IMFs) and a residual sequence by a CEEMDAN method. Secondly, to save calculation time, SE method has been utilized to reconstruct the IMFs and the residual sequence into new IMFs. Thirdly, the new IMFs are fed into the MKELM model, combing RBF and the poly kernel functions to utilize their superior learning and generalization abilities. The parameters of the MKELM model are optimized by ISSA, combining dynamic inertia weight and chaotic local searching method into the SSA to enhance the searching speed, convergence precision, as well as the global searching ability. CTP data in Guangdong, Shanghai, and Hubei are selected to prove the validity of the established CEEMDAN-SE-ISSA-MKELM model. Through a comparison analysis, the established CEEMDAN-SE-ISSA-MKELM model performs the best with the smallest MAPE and RMSE values and the highest R2 value, which are 0.76%, 0.53, and 0.99, respectively, for Guangdong,. Thus, the presented model would be extensively applied in CTP forecasting in the future.

Novel Incremental Regularized Extreme Learning Machine Method Based on Improved Particle Swarm Optimization for Nonlinear Multivariate Calibration of Visible and Near-Infrared Spectroscopy

Novel incremental regularized extreme learning machine (IR-ELM) based upon improved particle swarm optimization (IPSO-IR-ELM) is reported for the nonlinear multivariate calibration of visible/near-infrared (Vis/NIR) spectroscopy. IR-ELM is employed to construct a nonlinear calibration model for samples. Combined with IPSO, three parts of the IR-ELM algorithm are intelligently optimized. First, the regularization coefficient of the initial network in IR-ELM is optimized by IPSO. Second, IPSO is used again to select the optimal input weights and hidden biases while adding new hidden nodes in IR-ELM. Third, the 2-norm of the output matrix in IR-ELM is introduced as the conditional constraint in IPSO for updating the particle position. The performance of the reported method was tested with two Vis/NIR spectra datasets: blood hemoglobin and water pH. Key spectral variables were selected by successive projections algorithm and employed to establish the calibration models. Compared with partial least squares, ELM, error minimized extreme learning machine, and IR-ELM, IPSO-IR-ELM achieved the highest accuracy and best generalization. For the blood hemoglobin dataset, the RMSEP (root mean square error of prediction) was 0.210 g·dL−1, and the R p 2 (coefficient of determination of prediction) was 0.973. For the water pH dataset, the RMSEP was 0.825, and the R p 2 was 0.899. The results demonstrate that IPSO-IR-ELM is an alternative nonlinear multivariate calibration approach for Vis/NIR spectroscopy.