Self-adaptive Evolutionary Extreme Learning Machine Research Articles

Evaluation of ice-seabed interaction mechanism in sand by using self-adaptive evolutionary extreme learning machine

Recent discovered oil and gases in the Arctic area have heightened the need for more attention to ice-seabed interaction during an ice scouring event. The seabed is gouged by these drifting icebergs in warmer months threatening the subsea pipelines transferring the hydrocarbons from offshore to onshore. The simulation of ice scouring seabed needs costly large deformation finite element analysis for the guaranteed operational integrity of the subsea pipelines. In this paper, a cost-effective alternative approach using the self-adaptive evolutionary extreme learning machine (SaE-ELM) algorithm was taken to model the ice-induced seabed scour. Initially, using parameters governing the ice gouging process, 17 SaE-ELM models were developed. Then, a comprehensive dataset was established and properly allocated for training and testing of the developed models. The optimal number of hidden layer neurons and the best activation function were opted for the SaE-ELM network. The premium SaE-ELM models and the most influencing inputs were recognized by conducting a sensitivity analysis. The vertical component of load showed a significant impact on the reaction forces, rather the soil depth and berm height possessed a striking effect for modeling the soil displacements. Ultimately, a set of the SaE-ELM-based equations were presented to estimate the subgouge soil parameters.

Optimized extreme learning machine for detecting DDoS attacks in cloud computing

Distributed denial of service (DDoS) attack is a serious security threat to cloud computing that affects the availability of cloud services. Therefore, defending against these attacks becomes imperative. In this paper, we present a DDoS attack detection system based on an improved Self-adaptive evolutionary extreme learning machine (SaE-ELM). SaE-ELM model is improved by incorporating two more features. Firstly, it can adapt the best suitable crossover operator. Secondly, it can automatically determine the appropriate number of hidden layer neurons. These features improve the learning and classification capabilities of the model. The proposed system is evaluated using four datasets namely, NSL-KDD, ISCX IDS 2012, UNSW-NB15, and CICIDS 2017. It achieves the detection accuracy of 86.80%, 98.90%, 89.17%, and 99.99% with NSL-KDD, ISCX IDS 2012, UNSW-NB15, and CICIDS 2017 datasets, respectively. The experiments show that the performance of the proposed attack detection system is better than the system based on original SaE-ELM and state-of-the-art techniques. However, it shows a longer training time than SaE-ELM based system.

Discrimination of Tetrastigma hemsleyanum according to geographical origin by near-infrared spectroscopy combined with a deep learning approach.

Recently, deep learning has presented as a powerful approach to overcome the deficiencies of the conventional biochemical approaches. In this study, a method for discriminating medicinal plant Tetrastigma hemsleyanum from different origins was proposed using near-infrared spectroscopy (NIRS) and deep learning models. Support vector machine (SVM), self-adaptive evolutionary extreme learning machine (SAE-ELM), and convolutional neural network (CNN) were used to process the near-infrared spectral data (4000-5600cm-1). The results indicated that the average recognition accuracy of SVM on the test set samples (n=60) reached 90%. The average recognition accuracy of SAE-ELM was 98.3%, while CNN correctly discriminated 100% of T. hemsleyanum from different origins. Notably, CNN avoids tedious redundant data preprocessing and is also able to save the trained model for the next call to achieve rapid detection. As above, this study provides an effective deep learning-based method for discriminating the geographical origins of T. hemsleyanum as well as providing a convenient and satisfactory approach to ensure the famous-region of other medicinal plants.

Comparison of extreme learning machine models for gasoline octane number forecasting by near-infrared spectra analysis

The octane number is often used in the evaluation of the gasoline quality due to its antiknock property. The traditional ASTM-CFR internal combustion engine method costs an enormous amount of expenditure and time to determine its level of each product upgrade. The extreme learning machine (ELM) and its improved models are a new type of single-hidden layer feed-forward neural network (SLFN). This structure has advantages over the traditional neural network technology in regression tasks. Based on the response relationship between the near-infrared spectra and the octane number, 60 groups of collected gasoline data are divided into training and test sets. The ELM, online sequential extreme learning machine (OS-ELM), and self-adaptive evolutionary extreme learning machine (SaDE-ELM) models are applied to the prediction task of the octane number. The statistical parameters RMSE, CORR, and R2 and the execution time are used as the performance comparison criteria for the three models. The simulation results show that the OS-ELM and the SaDE-ELM improve the prediction accuracy, the generalization ability, the stability of the ELM in different levels.

Designing a New Data Intelligence Model for Global Solar Radiation Prediction: Application of Multivariate Modeling Scheme

Global solar radiation prediction is highly desirable for multiple energy applications, such as energy production and sustainability, solar energy systems management, and lighting tasks for home use and recreational purposes. This research work designs a new approach and investigates the capability of novel data intelligent models based on the self-adaptive evolutionary extreme learning machine (SaE-ELM) algorithm to predict daily solar radiation in the Burkina Faso region. Four different meteorological stations are tested in the modeling process: Boromo, Dori, Gaoua and Po, located in West Africa. Various climate variables associated with the changes in solar radiation are utilized as the exploratory predictor variables through different input combinations used in the intelligent model (maximum and minimum air temperatures and humidity, wind speed, evaporation and vapor pressure deficits). The input combinations are then constructed based on the magnitude of the Pearson correlation coefficient computed between the predictors and the predictand, as a baseline method to determine the similarity between the predictors and the target variable. The results of the four tested meteorological stations show consistent findings, where the incorporation of all climate variables seemed to generate data intelligent models that performs with best prediction accuracy. A closer examination showed that the tested sites, Boromo, Dori, Gaoua and Po, attained the best performance result in the testing phase, with a root mean square error and a mean absolute error (RMSE-MAE [MJ/m2]) equating to about (0.72-0.54), (2.57-1.99), (0.88-0.65) and (1.17-0.86), respectively. In general, the proposed data intelligent models provide an excellent modeling strategy for solar radiation prediction, particularly over the Burkina Faso region in Western Africa. This study offers implications for solar energy exploration and energy management in data sparse regions.

Spectral Kurtosis Entropy and Weighted SaE-ELM for Bogie Fault Diagnosis under Variable Conditions.

Bogies are crucial for the safe operation of rail transit systems and usually work under uncertain and variable operating conditions. However, the diagnosis of bogie faults under variable conditions has barely been discussed until now. Thus, it is valuable to develop effective methods to deal with variable conditions. Besides, considering that the normal data for training are much more than the faulty data in practice, there is another problem in that only a small amount of data is available that includes faults. Concerning these issues, this paper proposes two new algorithms: (1) A novel feature parameter named spectral kurtosis entropy (SKE) is proposed based on the protrugram. The SKE not only avoids the manual post-processing of the protrugram but also has strong robustness to the operating conditions and parameter configurations, which have been validated by a simulation experiment in this paper. In this paper, the SKE, in conjunction with variational mode decomposition (VMD), is employed for feature extraction under variable conditions. (2) A new learning algorithm named weighted self-adaptive evolutionary extreme learning machine (WSaE-ELM) is proposed. WSaE-ELM gives each sample an extra sample weight to rebalance the training data and optimizes these weights along with the parameters of hidden neurons by means of the self-adaptive differential evolution algorithm. Finally, the hybrid method based on VMD, SKE, and WSaE-ELM is verified by using the vibration signals gathered from real bogies with speed variations. It is demonstrated that the proposed method of bogie fault diagnosis outperforms the conventional methods by up to 4.42% and 6.22%, respectively, in percentages of accuracy under variable conditions.

Hybrid model for renewable energy and loads prediction based on data mining and variational mode decomposition

Accurate renewable resource and load forecasting plays a key role in the progress of power grid planning schemes. In this study, a hybrid short-term forecasting method based K -means clustering and variational mode decomposition (VMD) technique is proposed to deal with the problem of forecasting accuracy. K -means clustering is a means of data mining approach and used for classifying data into several clusters. A cluster selection method is adopted to extract similar features from historical days. To better analyse the time series of historical data, VMD decomposes time series data into an ensemble of components with different frequencies. Self-adaptive evolutionary extreme learning machine as a novel and fast regression tool is trained and used for predicting each component. Eventually, the forecasting result generated by reconstructing all the predicted components values. The performance of the proposed hybrid forecasting model is evaluated by using real data from National Renewable Energy Laboratory. The simulation results show that it can obtain better forecasting accuracy than some previously reported methods.

An advanced approach for optimal wind power generation prediction intervals by using self-adaptive evolutionary extreme learning machine

Abstract This paper proposes a novel and hybrid intelligent algorithms to directly modelling prediction intervals (PIs), as an accurate, optimum, reliable and high efficient wind power generation prediction intervals (PIs) are developed by using extreme learning machines (ELM) and self-adaptive evolutionary extreme learning machines (SAEELM). Given significant of uncertainties existed in the wind power generation, SAEELM is the state-of-the-art technology to estimate and quantify the potential uncertainties that may result in risk facing the power system planning, economical operation, and control. In SAEELM, a single hidden layer extreme learning machine is constructed, where the output weight matrix is optimised by using the self-adaptive differential evolution (DE) optimisation method. Also, selecting and adjusting the control parameters and generation strategies involved in differential evolution algorithm to minimises the developed objective cost function. Different case studies using Australian real wind farms have been conducted and analysed. By comparing the statistical analysis and results to other models and methods, e.g. artificial neural networks (ANN), support vector machines (SVM), and Bootstrap, therefore, the proposed approach is an efficient, accurate, robust, and reliable for dealing with uncertainties involved in the integrated power systems, and generation of high-quality PIs. Moreover, the proposed SAEELM based algorithm has a better generalisation than other methods and has a high potential for practical applications.

A comparison of the performance of some extreme learning machine empirical models for predicting daily horizontal diffuse solar radiation in a region of southern Iran

ABSTRACTThis study uses the empirical models of extreme learning machine (ELM) method to predict daily horizontal diffuse solar radiation (HDSR). As a possibility for modification, the recent hybrid ELM methods such as complex ELM (C-ELM), self-adaptive evolutionary ELM (SaE-ELM), and online sequential ELM (OS-ELM) have been developed for the prediction of the daily HDSR. The empirical model of ELM predicts the HDSR using clearness index as the sole predictor. For this aim, two types of correlations are evaluated: (1) the diffuse fraction-clearness index and (2) the diffuse coefficient-clearness index. The measured diffuse and global solar radiation data sets of southern Iranian cities (Yazd, Shiraz, Bandar Abbas, Bushehr, and Zahedan) are utilized to evaluate the models. The precision of the C-ELM, SaE-ELM, OS-ELM, and ELM models is evaluated for different regions on the basis of five statistical performance evaluation parameters. The results confirm that the performance of hybrid ELM is pretty accurate and trustworthy. Fully complex ELM exhibits the best performance among these hybrid methods, having values of 0.87 and 0.30 for R2 and RMSE measures, respectively, in the testing phase. Therefore, it is able to be recognized as an appropriate tool for daily solar radiation forecasting issues.

Dolphin Swarm Extreme Learning Machine

As a novel learning algorithm for a single hidden-layer feedforward neural network, the extreme learning machine has attracted much research attention for its fast training speed and good generalization performances. Instead of iteratively tuning the parameters, the extreme machine can be seen as a linear optimization problem by randomly generating the input weights and hidden biases. However, the random determination of the input weights and hidden biases may bring non-optimal parameters, which have a negative impact on the final results or need more hidden nodes for the neural network. To overcome the above drawbacks caused by the non-optimal input weights and hidden biases, we propose a new hybrid learning algorithm named dolphin swarm algorithm extreme learning machine adopting the dolphin swarm algorithm to optimize the input weights and hidden biases efficiently. Each set of input weights and hidden biases is encoded into one vector, namely the dolphin. The dolphins are evaluated by root mean squared error and updated by the four pivotal phases of the dolphin swarm algorithm. Eventually, we will obtain an optimal set of input weights and hidden biases. To evaluate the effectiveness of our method, we compare the proposed algorithm with the standard extreme learning machine and three state-of-the-art methods, which are the particle swarm optimization extreme learning machine, evolutionary extreme learning machine, and self-adaptive evolutionary extreme learning machine, under 13 benchmark datasets obtained from the University of California Irvine Machine Learning Repository. The experimental results demonstrate that the proposed method can achieve superior generalization performances than all the compared algorithms.

Prediction of scour depth around bridge piers using self-adaptive extreme learning machine

Accurate prediction of pier scour can lead to economic design of bridge piers and prevent catastrophic incidents. This paper presents the application of self-adaptive evolutionary extreme learning machine (SAELM) to develop a new model for the prediction of local scour around bridge piers using 476 field pier scour measurements with four shapes of piers: sharp, round, cylindrical, and square. The model network parameters are optimized using the differential evolution algorithm. The best SAELM model calculates the scour depth as a function of pier dimensions and the sediment mean diameter. The developed SAELM model had the lowest error indicators when compared to regression-based prediction models for root mean square error (RMSE) (0.15, 0.65, respectively) and mean absolute relative error (MARE) (0.50, 2.0, respectively). The SAELM model was found to perform better than artificial neural networks or support vector machines on the same dataset. Parametric analysis showed that the new model predictions are influenced by pier dimensions and bed-sediment size and produce similar trends of variations of scour-hole depth as reported in literature and previous experimental measurements. The prediction uncertainty of the developed SAELM model is quantified and compared with existing regression-based models and found to be the least, ±0.03 compared with ±0.10 for other models.

Rational and self-adaptive evolutionary extreme learning machine for electricity price forecast

Electricity price forecast is of great importance to electricity market participants. Given the sophisticated time-series of electricity price, various approaches of extreme learning machine (ELM) have been identified as effective prediction approaches. However, in high dimensional space, evolutionary extreme learning machine (E-ELM) is time-consuming and difficult to converge to optimal region when just relying on stochastic searching approaches. In the meanwhile, due to the complicated functional relationship, objective function of E-ELM seems difficult also to be mined directly for some useful mathematical information to guide the optimum exploring. This paper proposes a new differential evolution (DE) like algorithm to enhance E-ELM for more accurate and reliable prediction of electricity price. An approximation model for producing DE-like trail vector is the key mechanism, which can use simpler mathematical mapping to replace the original yet complicated functional relationship within a small region. Thus, the evolutionary procedure frequently dealt with some rational searching directions can make the E-ELM more robust and faster than supported only by the stochastic methods. Experimental results show that the new method can improve the performance of E-ELM more efficiently.

Interpretation of DGA for transformer fault diagnosis with complementary SaE-ELM and arctangent transform

This paper presents a novel approach for power transformer incipient fault diagnosis through the analysis of dissolved gas in oil. The proposed approach is implemented for improving the diagnosis accuracy by dissolved gas analysis (DGA) of power transformer based on the combined use of a multi-classification algorithm self-adaptive evolutionary extreme learning machine (SaE-ELM) and a simple arctangent transform (AT). On the one hand, the SaE-ELM algorithm has the ability to approximate any nonlinear functions with its structure parameters, i.e. hidden node biases and output weights, optimized self-sufficiently. On the other hand, the AT can alter the data structure of the experiment data, which will enhance the generalization capability for SaE-ELM as well as other machine learning algorithms. Thus, the combination of SaEELM and AT can complement each other and improve the diagnosis accuracy from the aspect of both algorithm and data structure. The performances of the proposed approach are compared with that derived from ANN, SVM, and ELM methods, respectively. Experimental results with both published and power utility provided data indicate that the developed approach can significantly improve the accuracies for power transformer fault diagnosis.

Multi-Level Forecasting Model of Coal Mine Water Inrush based on Self-Adaptive Evolutionary Extreme Learning Machine

This paper constructs a forecasting model for coal mining water inrush from the floor through the analysis and careful study of the mechanism of water inrush in coal mining and the Self-Adaptive Evolutionary Extreme Learning Machine (SaE-ELM) which obtains self-learning, generalization performance and speediness is used. In SaE-ELM, the network hidden node parameters are optimized by the self-adaptive differential evolution algorithm, whose trial vector generation strategies and th eir associated control parameters are self-adapted in a strategy pool by learning f rom their previous experiences in generating promising solutions. Large amounts of historical data of mining water inrush is collected and the main controlling factors are extracted as sample data to train and test the forecasting model by the SaE-ELM, which can forecast both the existence of a water inrush from the floor and the lev el of the water inrush. Experiments are given to prove that the proposed method reduces the time of model construction and computation, and improves the speed and accuracy of the forecast of coal mining water inrush.

Self-Adaptive Evolutionary Extreme Learning Machine

In this paper, we propose an improved learning algorithm named self-adaptive evolutionary extreme learning machine (SaE-ELM) for single hidden layer feedforward networks (SLFNs). In SaE-ELM, the network hidden node parameters are optimized by the self-adaptive differential evolution algorithm, whose trial vector generation strategies and their associated control parameters are self-adapted in a strategy pool by learning from their previous experiences in generating promising solutions, and the network output weights are calculated using the Moore–Penrose generalized inverse. SaE-ELM outperforms the evolutionary extreme learning machine (E-ELM) and the different evolutionary Levenberg–Marquardt method in general as it could self-adaptively determine the suitable control parameters and generation strategies involved in DE. Simulations have shown that SaE-ELM not only performs better than E-ELM with several manually choosing generation strategies and control parameters but also obtains better generalization performances than several related methods.