MLP Neural Nets Research Articles

Performance of Multiple Models for Estimating Rodent Activity Intensity in Alpine Grassland Using Remote Sensing

Rodents are a vital part of the natural succession chain of the alpine grassland ecosystem, and rodent activities have an important impact on alpine grassland ecology. Moderate rodent population activities positively improve soil permeability, promote nutrient cycling, and promote biodiversity. However, too much rodent population or excessive activity intensity will bring negative effects on the ecological environment. Therefore, it is of great significance to accurately grasp the rodent activity intensity (RAI) in alpine grassland to cope with the changes in rodent populations and maintain the stability of the alpine grassland ecosystem. The Zoige alpine grassland was used as the study area in this study. In addition, UAV was sent to sample the rodent activity area in the alpine grassland. With the aid of field survey data, the surface information of rodent activity in the experimental area was identified, and the RAI index in the sample plot was calculated. Then, based on Sentinel-2A satellite remote sensing multi-spectral data and spectral index, multiple linear regression (MLR), multi-layer perceptron neural networks (MPL neural nets), random forest (RF), and support vector regression (SVR) were used to construct four models for RAI and Sentinel-2 datasets. The accuracy of the four models was compared and analyzed. The results showed that the RF model had the highest prediction accuracy (R2 = 0.8263, RWI = 0.8210, LCCC = 0.8916, RMSE = 0.0840, MAE = 0.0549), followed by the SVR model, the MLP neural nets model, and the MLR model. Overall, the nonlinear relationship between rodent activity intensity and satellite remote sensing images is obvious. Machine learning with strong nonlinear fitting ability can better characterize the RAI in alpine grassland. The RF model, with the best accuracy, can quantitatively estimate RAI in the alpine grassland, providing theoretical and technical support for monitoring RAI and rodent control in the alpine grassland.

Estimating Ore Production in Open-pit Mines Using Various Machine Learning Algorithms Based on a Truck-Haulage System and Support of Internet of Things

This study aimed to develop and assess the feasibility of different machine learning algorithms for predicting ore production in open-pit mines based on a truck-haulage system with the support of the Internet of Things (IoT). Six machine learning algorithms, namely the random forest (RF), support vector machine (SVM), multi-layer perceptron neural networks (MLP neural nets), classification and regression tree, k-nearest neighbors, and M5Tree model, were developed and investigated to estimate ore production at a limestone open-pit mine in South Korea. Systems of IoT were used to collect a massive database of 16,217 observations (big data). To process this big data, a downscaling method was applied to reduce the size of the original observations to improve the computational cost of the machine learning models. Subsequently, three validation datasets were selected from the original observations and used to evaluate (after downscaling the observations) the performance and accuracy of the machine learning models in practical engineering through various performance metrics. The results revealed that the models used can be potentially used for predicting ore production in open-pit mines. The SVM, MLP neural nets, and RF models demonstrated high accuracy, with the SVM model exhibiting the most superior performance and the highest accuracy. An assessment of the validation datasets also confirmed the feasibility and stability of the models for predicting ore production. Furthermore, a sensitivity analysis indicated that the relative operation start time, relative operation end time, and interval between the operation times were the most important input variables for improving ore production in practical engineering.

Prediction of soil compression coefficient for urban housing project using novel integration machine learning approach of swarm intelligence and Multi-layer Perceptron Neural Network

In many engineering projects, the soil compression coefficient is an important parameter used for estimating the settlement of soil layers. The common practice of determining the soil compression coefficient via the oedometer test is time-consuming and expensive. This study proposes a machine learning solution to replace the conventional tests used for obtaining the coefficient of soil compression. The new approach is an integration of the Multi-Layer Perceptron Neural Network (MLP Neural Nets) and Particle Swarm Optimization (PSO). These two computational intelligence methods work synergistically to establish a prediction model of soil compression coefficient. The PSO metaheuristic is employed to optimize the MLP Neural Nets model structure. To train and validate the proposed method, named as PSO-MLP Neural Nets, a dataset of 154 soil samples featuring 12 influencing factors has been collected from the geotechnical investigation process of a high-rise building project. Experimental results show that the proposed PSO-MLP Neural Nets has attained the most accurate prediction of the soil compression coefficient performance with RMSE = 0.0267, MAE = 0.0145, and R2 = 0.884. The result of the proposed model is significantly better than those obtained from other benchmark methods including the backpropagation neural network, the radial basis function neural network, the support vector regression, the random forest, and the Gaussian process. Based on the experimental results, the newly constructed PSO-MLP Neural Nets is very potential to be a new alternative to assist geotechnical engineers in design phase of civil engineering projects.

A comparative study of artificial neural networks in predicting blast-induced air-blast overpressure at Deo Nai open-pit coal mine, Vietnam

Air-blast overpressure (AOp) is one of the undesirable effects caused by blasting operations in open-pit mines. This side effect of blasting can seriously undermine surrounding residential structures and living quality. To control and mitigate this situation, this study using artificial neural networks to predict AOp implemented at Deo Nai open-pit coal mine, Vietnam. A total of 146 events of blasting were recorded, of which 80% (118 observations) was used for training and 20% (28 observations) was used for testing. A resampling technique, namely tenfold cross-validation, was performed with three repeats to increase the accuracy of the predictive models. In this paper, three different types of neural networks were developed to predict AOp including multilayer perceptron neural network (MLP neural nets), Bayesian regularized neural networks (BRNN) and hybrid neural fuzzy inference system (HYFIS). Each type was tested with ten model configurations to discover the best performing ones based on comparing standard metrics, including root-mean-square error (RMSE), coefficient of determination (R2), and a simple ranking method. Eight parameters were considered for these models, including charge per delay, burden, spacing, length of stemming, powder factor, air humidity, and monitoring distance. The results indicated that MLP neural nets model with RMSE = 2.319, R2 = 0.961 on testing datasets and a total ranking of 12 yielded the most accurate prediction over BRNN and HYFIS models.

A hybrid machine learning ensemble approach based on a Radial Basis Function neural network and Rotation Forest for landslide susceptibility modeling: A case study in the Himalayan area, India

In this paper, a hybrid machine learning ensemble approach namely the Rotation Forest based Radial Basis Function (RFRBF) neural network is proposed for spatial prediction of landslides in part of the Himalayan area (India). The proposed approach is an integration of the Radial Basis Function (RBF) neural network classifier and Rotation Forest ensemble, which are state-of-the art machine learning algorithms for classification problems. For this purpose, a spatial database of the study area was established that consists of 930 landslide locations and fifteen influencing parameters (slope angle, road density, curvature, land use, distance to road, plan curvature, lineament density, distance to lineaments, rainfall, distance to river, profile curvature, elevation, slope aspect, river density, and soil type). Using the database, training and validation datasets were generated for constructing and validating the model. Performance of the model was assessed using the Receiver Operating Characteristic (ROC) curve, area under the ROC curve (AUC), statistical analysis methods, and the Chi square test. In addition, Logistic Regression (LR), Multi-layer Perceptron Neural Networks (MLP Neural Nets), Naïve Bayes (NB), and the hybrid model of Rotation Forest and Decision Trees (RFDT) were selected for comparison. The results show that the proposed RFRBF model has the highest prediction capability in comparison to the other models (LR, MLP Neural Nets, NB, and RFDT); therefore, the proposed RFRBF model is promising and should be used as an alternative technique for landslide susceptibility modeling.

Hybrid integration of Multilayer Perceptron Neural Networks and machine learning ensembles for landslide susceptibility assessment at Himalayan area (India) using GIS

The main objective of this study is to evaluate and compare the performance of landslide models using machine learning ensemble technique for landslide susceptibility assessment. This technique is a combination of ensemble methods (AdaBoost, Bagging, Dagging, MultiBoost, Rotation Forest, and Random SubSpace) and the base classifier of Multiple Perceptron Neural Networks (MLP Neural Nets). Ensemble techniques have been widely applied in other fields; however, their application is still rare in the assessment of landslide problems. Meanwhile, MLP Neural Nets, which is known as an artificial neural network, has been applied widely and efficiently in landslide problems. In the present study, landslide models of part Himalayan area (India) have been constructed and validated. For the evaluation and comparison of these models, receiver operating characteristic curve and Chi Square test methods have been applied. Overall, all landslide models performed well in landslide susuceptibility assessment but the performance of the MultiBoost model is the highest (AUC=0.886), followed by Dagging model (AUC=0.885), the Rotation Forest model (AUC=0.882), the Bagging and Random SubSpace models (AUC=0.881), and the AdaBoost model (AUC=0.876), respectively. Moreover, machine learning ensemble models have improved significantly the performance of the base classifier of MLP Neural Nets (AUC=0.874). Analysis of results indicates that landslide models using machine learning ensemble frameworks are promising methods which can be used as alternatives of individual base classifiers for landslide susceptibility assessment of other prone areas.

Landslide susceptibility assesssment in the Uttarakhand area (India) using GIS: a comparison study of prediction capability of naïve bayes, multilayer perceptron neural networks, and functional trees methods

The objective of this study is to make a comparison of the prediction performance of three techniques, Functional Trees (FT), Multilayer Perceptron Neural Networks (MLP Neural Nets), and Naive Bayes (NB) for landslide susceptibility assessment at the Uttarakhand Area (India). Firstly, a landslide inventory map with 430 landslide locations in the study area was constructed from various sources. Landslide locations were then randomly split into two parts (i) 70 % landslide locations being used for training models (ii) 30 % landslide locations being employed for validation process. Secondly, a total of eleven landslide conditioning factors including slope angle, slope aspect, elevation, curvature, lithology, soil, land cover, distance to roads, distance to lineaments, distance to rivers, and rainfall were used in the analysis to elucidate the spatial relationship between these factors and landslide occurrences. Feature selection of Linear Support Vector Machine (LSVM) algorithm was employed to assess the prediction capability of these conditioning factors on landslide models. Subsequently, the NB, MLP Neural Nets, and FT models were constructed using training dataset. Finally, success rate and predictive rate curves were employed to validate and compare the predictive capability of three used models. Overall, all the three models performed very well for landslide susceptibility assessment. Out of these models, the MLP Neural Nets and the FT models had almost the same predictive capability whereas the MLP Neural Nets (AUC = 0.850) was slightly better than the FT model (AUC = 0.849). The NB model (AUC = 0.838) had the lowest predictive capability compared to other models. Landslide susceptibility maps were final developed using these three models. These maps would be helpful to planners and engineers for the development activities and land-use planning.

Spatial prediction models for shallow landslide hazards: a comparative assessment of the efficacy of support vector machines, artificial neural networks, kernel logistic regression, and logistic model tree

Preparation of landslide susceptibility maps is considered as the first important step in landslide risk assessments, but these maps are accepted as an end product that can be used for land use planning. The main objective of this study is to explore some new state-of-the-art sophisticated machine learning techniques and introduce a framework for training and validation of shallow landslide susceptibility models by using the latest statistical methods. The Son La hydropower basin (Vietnam) was selected as a case study. First, a landslide inventory map was constructed using the historical landslide locations from two national projects in Vietnam. A total of 12 landslide conditioning factors were then constructed from various data sources. Landslide locations were randomly split into a ratio of 70:30 for training and validating the models. To choose the best subset of conditioning factors, predictive ability of the factors were assessed using the Information Gain Ratio with 10-fold cross-validation technique. Factors with null predictive ability were removed to optimize the models. Subsequently, five landslide models were built using support vector machines (SVM), multi-layer perceptron neural networks (MLP Neural Nets), radial basis function neural networks (RBF Neural Nets), kernel logistic regression (KLR), and logistic model trees (LMT). The resulting models were validated and compared using the receive operating characteristic (ROC), Kappa index, and several statistical evaluation measures. Additionally, Friedman and Wilcoxon signed-rank tests were applied to confirm significant statistical differences among the five machine learning models employed in this study. Overall, the MLP Neural Nets model has the highest prediction capability (90.2 %), followed by the SVM model (88.7 %) and the KLR model (87.9 %), the RBF Neural Nets model (87.1 %), and the LMT model (86.1 %). Results revealed that both the KLR and the LMT models showed promising methods for shallow landslide susceptibility mapping. The result from this study demonstrates the benefit of selecting the optimal machine learning techniques with proper conditioning selection method in shallow landslide susceptibility mapping.

MLP neural nets in design of technological process

MLP neural nets in design of technological process

A comparative study of different machine learning methods on microarray gene expression data

BackgroundSeveral classification and feature selection methods have been studied for the identification of differentially expressed genes in microarray data. Classification methods such as SVM, RBF Neural Nets, MLP Neural Nets, Bayesian, Decision Tree and Random Forrest methods have been used in recent studies. The accuracy of these methods has been calculated with validation methods such as v-fold validation. However there is lack of comparison between these methods to find a better framework for classification, clustering and analysis of microarray gene expression results.ResultsIn this study, we compared the efficiency of the classification methods including; SVM, RBF Neural Nets, MLP Neural Nets, Bayesian, Decision Tree and Random Forrest methods. The v-fold cross validation was used to calculate the accuracy of the classifiers. Some of the common clustering methods including K-means, DBC, and EM clustering were applied to the datasets and the efficiency of these methods have been analysed. Further the efficiency of the feature selection methods including support vector machine recursive feature elimination (SVM-RFE), Chi Squared, and CSF were compared. In each case these methods were applied to eight different binary (two class) microarray datasets. We evaluated the class prediction efficiency of each gene list in training and test cross-validation using supervised classifiers.ConclusionsWe presented a study in which we compared some of the common used classification, clustering, and feature selection methods. We applied these methods to eight publicly available datasets, and compared how these methods performed in class prediction of test datasets. We reported that the choice of feature selection methods, the number of genes in the gene list, the number of cases (samples) substantially influence classification success. Based on features chosen by these methods, error rates and accuracy of several classification algorithms were obtained. Results revealed the importance of feature selection in accurately classifying new samples and how an integrated feature selection and classification algorithm is performing and is capable of identifying significant genes.

Flexible nonlinear contextual classification

We present a framework for flexible nonlinear contextual image classification. The framework integrates classical and recent models for image classification, ranging from a multivariate Gaussian classifier, to MLP neural nets, classification trees and recent regression models based on general additive models, and combines them with a Markov random field for spatial context. The effect of using the different nonlinear discriminant functions is compared with the effect of using an MRF model for spatial context. In general, the use of an MRF model results in larger improvements in classification accuracy than using different nonlinear discriminant functions, but the combination of them can give large improvements.