Improved Extreme Learning Machine Algorithm Research Articles

Study of scintillation detector fault diagnosis based on ELM method

This paper proposes a method for scintillation detector fault diagnosis based on the Extreme Learning Machine (ELM) algorithm. A related characteristics database is established including the falling edge time, signal amplitude of nuclear pulse signals, and energy spectrum peak channel, low channel address count of energy spectrum signal under various operating conditions. Then a diagnosis model for scintillation detector is created by improved ELM algorithm which have changed the activation function of the hidden layers and modified the number of hidden layers. An experiment system is also constructed for collecting and validating fault data, the diagnostic experiment results show that this method can not only classify the faults of the failed detector, but also distinguish intelligently the severity of various faults.

Feature recognition of irregular pellet images by regularized Extreme Learning Machine in combination with fractal theory

As we know, the fractal theory is an effective method for irregular image processing and analysis, which is difficult to implement using other baseline methods. However, Extreme Learning Machine (ELM) algorithm in combination with fractal theory can provide a better solution than the single fractal theory in image processing, transformation, data prediction, and so on. The features including fractal dimension, area ratio, and average perimeter of hematite, magnetite, calcium silicate, calcium ferrite, and stomata in the microstructure of irregular pellet images are extracted by artificial intelligence (AI) technologies. An AL-based ELM model suitable for the features of pellet images was constructed, the ELM model was optimized by regularization, and the feature parameters of pellet images were predicted by improved ELM algorithm, the optimal number of neuron nodes in the hidden layer was obtained for every mineral. The results show that the efficiency of model training and prediction in the feature for irregular pellet images is highly comparable to baseline methods. The method can be used as a reference in the intelligent prediction, control, and optimization of pellet image quality.

An improved extreme learning machine algorithm for transient electromagnetic nonlinear inversion

Transient electromagnetic method (TEM) inversion is significantly nonlinear. To eliminate the multicollinearity problem faced by the extreme learning machine (ELM) algorithm for TEM inversion, an improved ELM algorithm (F-ELM) based on fractal dimension technology is proposed. By reducing the dimension of the hidden layer output matrix (H) based on fractal dimension theory without losing the main statistical information, the proposed algorithm can not only guarantee the full column rank of the newly produced hidden layer output matrix (H′) but also enhance the training speed of the overall process. To prove the effectiveness of the F-ELM algorithm, a synthetic example and a field example using TEM inversion are established in this study. The experimental results illustrate that compared with the ordinary ELM algorithm and its variants, the proposed algorithm greatly reduces the computing time, improves the inversion accuracy and stability of the algorithm. Furthermore, it is also proven that the F-ELM algorithm is a very effective technique for TEM inversion.

Neural network algorithm based on Legendre improved extreme learning machine for solving elliptic partial differential equations

To provide a new numerical algorithm for solving elliptic partial differential equations (PDEs), the Legendre neural network (LNN) and improved extreme learning machine (IELM) algorithm are introduced to propose a Legendre improved extreme learning machine (L-IELM) method, which is applied to solving elliptic PDEs in this paper. The product of two Legendre polynomials is chosen as basis functions of hidden neurons. Single hidden layer LNN is used to construct approximate solutions and its derivatives of differential equations. IELM algorithm is used for network weights training, and the algorithm steps of the proposed L-IELM method are summarized. Finally, in order to evaluate the present algorithm, various test examples are selected and solved by the proposed approach to validate the calculation accuracy. Comparative study with the earlier methods in literature is described to verify the superiority of the presented L-IELM method. Experiment results show that the proposed L-IELM algorithm can perform well in terms of accuracy and execution time, which in addition provides a new algorithm for solving elliptic PDEs.

A Model to Predict Crosscut Stress Based on an Improved Extreme Learning Machine Algorithm

The analysis of crosscut stability is an indispensable task in underground mining activities. Crosscut instabilities usually cause geological disasters and delay of the project. On site, mining engineers analyze and predict the crosscut condition by monitoring its convergence and stress; however, stress monitoring is time-consuming and expensive. In this study, we propose an improved extreme learning machine (ELM) algorithm to predict crosscut’s stress based on convergence data, for the first time in literature. The performance of the proposed technique is validated using a crosscut response by means of the FLAC3D finite difference program. It is found that the improved ELM algorithm performs higher generalization performance compared to traditional ELM, as it eliminates the random selection for input weights. Furthermore, a crosscut construction project in an underground mine, Yanqianshan iron mine, located in Liaoning Province (China), is selected as the case study. The accuracy and efficiency of the improved ELM algorithm has been demonstrated by comparing predicted stress data to measured data on site. Additionally, a comparison is conducted between the improved ELM algorithm and other commonly used artificial neural network algorithms.

A novel improved extreme learning machine algorithm in solving ordinary differential equations by Legendre neural network methods

This paper develops a Legendre neural network method (LNN) for solving linear and nonlinear ordinary differential equations (ODEs), system of ordinary differential equations (SODEs), as well as classic Emden–Fowler equations. The Legendre polynomial is chosen as a basis function of hidden neurons. A single hidden layer Legendre neural network is used to eliminate the hidden layer by expanding the input pattern using Legendre polynomials. The improved extreme learning machine (IELM) algorithm is used for network weights training when solving algebraic equation systems, and several algorithm steps are summed up. Convergence was analyzed theoretically to support the proposed method. In order to demonstrate the performance of the method, various testing problems are solved by the proposed approach. A comparative study with other approaches such as conventional methods and latest research work reported in the literature are described in detail to validate the superiority of the method. Experimental results show that the proposed Legendre network with IELM algorithm requires fewer neurons to outperform the numerical algorithm in the latest literature in terms of accuracy and execution time.

Extreme Learning Machine With Affine Transformation Inputs in an Activation Function.

The extreme learning machine (ELM) has attracted much attention over the past decade due to its fast learning speed and convincing generalization performance. However, there still remains a practical issue to be approached when applying the ELM: the randomly generated hidden node parameters without tuning can lead to the hidden node outputs being nonuniformly distributed, thus giving rise to poor generalization performance. To address this deficiency, a novel activation function with an affine transformation (AT) on its input is introduced into the ELM, which leads to an improved ELM algorithm that is referred to as an AT-ELM in this paper. The scaling and translation parameters of the AT activation function are computed based on the maximum entropy principle in such a way that the hidden layer outputs approximately obey a uniform distribution. Application of the AT-ELM algorithm in nonlinear function regression shows its robustness to the range scaling of the network inputs. Experiments on nonlinear function regression, real-world data set classification, and benchmark image recognition demonstrate better performance for the AT-ELM compared with the original ELM, the regularized ELM, and the kernel ELM. Recognition results on benchmark image data sets also reveal that the AT-ELM outperforms several other state-of-the-art algorithms in general.

A Novel Hybrid of a Fading Filter and an Extreme Learning Machine for GPS/INS during GPS Outages.

In this paper, a novel algorithm based on the combination of a fading filter (FF) and an extreme learning machine (ELM) is presented for Global Positioning System/Inertial Navigation System (GPS/INS) integrated navigation systems. In order to increase the filtering accuracy of the model, a variable fading factor fading filter based on the fading factor is proposed. It adjusts the fading factor by the ratio of the estimated covariance before and after the moment which proves to have excellent performance in our experiment. An extreme learning machine based on a Fourier orthogonal basis function is introduced that considers the deterioration of the accuracy of the navigation system during GPS outages and has a higher positioning accuracy and faster learning speed than the typical neural network learning algorithm. In the end, a simulation and real road test are performed to verify the effectiveness of this algorithm. The results show that the accuracy of the fading filter based on a variable fading factor is clearly improved, and the proposed improved ELM algorithm can provide position corrections during GPS outages more effectively than the other algorithms (ELM and the traditional radial basis function neural network).

Neural network method for lossless two-conductor transmission line equations based on the IELM algorithm

With the increasing demands for vast amounts of data and high-speed signal transmission, the use of multi-conductor transmission lines is becoming more common. The impact of transmission lines on signal transmission is thus a key issue affecting the performance of high-speed digital systems. To solve the problem of lossless two-conductor transmission line equations (LTTLEs), a neural network model and algorithm are explored in this paper. By selecting the product of two triangular basis functions as the activation function of hidden layer neurons, we can guarantee the separation of time, space, and phase orthogonality. By adding the initial condition to the neural network, an improved extreme learning machine (IELM) algorithm for solving the network weight is obtained. This is different to the traditional method for converting the initial condition into the iterative constraint condition. Calculation software for solving the LTTLEs based on the IELM algorithm is developed. Numerical experiments show that the results are consistent with those of the traditional method. The proposed neural network algorithm can find the terminal voltage of the transmission line and also the voltage of any observation point. It is possible to calculate the value at any given point by using the neural network model to solve the transmission line equation.

An Algorithm for Surface Defect Identification of Steel Plates Based on Genetic Algorithm and Extreme Learning Machine

Defects on the surface of steel plates are one of the most important factors affecting the quality of steel plates. It is of great importance to detect such defects through online surface inspection systems, whose ability of defect identification comes from self-learning through training samples. Extreme Learning Machine (ELM) is a fast machine learning algorithm with a high accuracy of identification. ELM is implemented by a hidden matrix generated with random initialization parameters, while different parameters usually result in different performances. To solve this problem, an improved ELM algorithm combined with a Genetic Algorithm was proposed and applied for the surface defect identification of hot rolled steel plates. The output matrix of the ELM’s hidden layers was treated as a chromosome, and some novel iteration rules were added. The algorithm was tested with 1675 samples of hot rolled steel plates, including pockmarks, chaps, scars, longitudinal cracks, longitudinal scratches, scales, transverse cracks, transverse scratches, and roll marks. The results showed that the highest identification accuracies for the training and the testing set obtained by the G-ELM (Genetic Extreme Learning Machine) algorithm were 98.46% and 94.30%, respectively, which were about 5% higher than those obtained by the ELM algorithm.

Bio-inspired neural network with application to license plate recognition: hysteretic ELM approach

Purpose This paper aims to present a bio-inspired neural network for improvement of information processing capability of the existing artificial neural networks. Design/methodology/approach In the network, the authors introduce a property often found in biological neural system – hysteresis – as the neuron activation function and a bionic algorithm – extreme learning machine (ELM) – as the learning scheme. The authors give the gradient descent procedure to optimize parameters of the hysteretic function and develop an algorithm to online select ELM parameters, including number of the hidden-layer nodes and hidden-layer parameters. The algorithm combines the idea of the cross validation and random assignment in original ELM. Finally, the authors demonstrate the advantages of the hysteretic ELM neural network by applying it to automatic license plate recognition. Findings Experiments on automatic license plate recognition show that the bio-inspired learning system has better classification accuracy and generalization capability with consideration to efficiency. Originality/value Comparing with the conventional sigmoid function, hysteresis as the activation function enables has two advantages: the neuron’s output not only depends on its input but also on derivative information, which provides the neuron with memory; the hysteretic function can switch between the two segments, thus avoiding the neuron falling into local minima and having a quicker learning rate. The improved ELM algorithm in some extent makes up for declining performance because of original ELM’s complete randomness with the cost of a litter slower than before.

A Novel Improved ELM Algorithm for a Real Industrial Application

It is well known that the feedforward neural networks meet numbers of difficulties in the applications because of its slow learning speed. The extreme learning machine (ELM) is a new single hidden layer feedforward neural network method aiming at improving the training speed. Nowadays ELM algorithm has received wide application with its good generalization performance under fast learning speed. However, there are still several problems needed to be solved in ELM. In this paper, a new improved ELM algorithm named R-ELM is proposed to handle the multicollinear problem appearing in calculation of the ELM algorithm. The proposed algorithm is employed in bearing fault detection using stator current monitoring. Simulative results show that R-ELM algorithm has better stability and generalization performance compared with the original ELM and the other neural network methods.