Fuzzy Adaptive Resonance Theory Research Articles

Fuzzy adaptive resonance theory failure mode effect analysis non-healthcare setting for infectious disease: review

<span>Fuzzy adaptive resonance theory (ART) is an ART network that is developed as one of the alternative methods to evaluate risk priority number (RPN) in failure mode and effect analysis (FMEA). Not only is FMEA are common technique as an analysis tool in industrial sectors, but also, especially during the global emergency COVID-19 pandemic hits, FMEA is used in prevention and mitigation measures. Many alternative methods have been proposed. However, not many investigations use clustering models such as Fuzzy ART in FMEA. This paper aims to provide a comprehensive review and then propose a model for systematic risk analysis which implement the fuzzy ART model, named clustering- transmission causes and effects analysis (c-TCEA), for the prevention and mitigation of infectious diseases.</span>

Applying deep learning in brain computer interface to classify motor imagery

Deep-learning (DL) is a new paradigm in the artificial intelligence field associated with learning structures able to connect directly numeric data with high-level patterns or categories. DL seems to be a suitable technique to deal with computationally challenging Brain Computer Interface (BCI) problems. Following DL strategy, a new modular and self-organized architecture to solve BCI problems is proposed. A pattern recognition system to translate the measured signals in order to establish categories representing thoughts, without previous pre-processing, is developed. To achieve an easy interpretability of the system internal functioning, a neuro-fuzzy module and a learning methodology are carried out. The whole learning process is based on machine learning. The architecture and the learning method are tested on a representative BCI application to detect and classify motor imagery thoughts. Data is gathered with a low-cost device. Results prove the efficiency and adaptability of the proposed DL architecture where the used classification module (S-dFasArt) exhibits a better behaviour compared with the usual classifiers. Additionally, it employs neuro-fuzzy modules which allow to offer results in a rules format. This improves the interpretability with respect to the black-box description. A DL architecture, going from the raw data to the labels, is proposed. The proposed architecture, based on Adaptive Resonance Theory (ART) and Fuzzy ART modules, performs data processing in a self-organized way. It follows the DL paradigm, but at the same time, it allows an interpretation of the operation stages. Therefore this approach could be called Transparent Deep Learning.

Imbalanced dataset classification using fuzzy ARTMAP and computational intelligence techniques

Recently, fuzzy adaptive resonance theory mapping (ARTMAP) neural networks are applied to solving complex problems due to their plasticity-stability capability and resonance property. An imbalanced dataset occurs when there is the presence of one class containing a greater number of instances than other classes. It is skewed representation of data. Many standard algorithms have failed in mitigating imbalanced dataset problems. There are four paradigms used-data level, algorithm level, cost-sensitive, and ensemble method in solving imbalanced dataset problems. Here we put forward a method to solve the imbalanced dataset problem by a brain-neuron framework and an ensemble of a special type of artificial neural network (ANN) called fuzzy ARTMAP thereafter we applied a clustering algorithm known as fuzzy C-means clustering to handle missing value and also propose to make fuzzy ARTMAP cost-sensitive. Results indicate 100% accuracy in classification.

Recommendation System with Biclustering

The massive growth of online commercial data has raised the request for an automatic recommender system to benefit both users and merchants. One of the most frequently used recommendation methods is collaborative filtering, but its accuracy is limited by the sparsity of the rating dataset. Most existing collaborative filtering methods consider all features when calculating user/item similarity and ignore much local information. In collaborative filtering, selecting neighbors and determining users' similarities are the most important parts. For the selection of better neighbors, this study proposes a novel biclustering method based on modified fuzzy adaptive resonance theory. To reflect the similarity between users, a new measure that considers the effect of the number of users' common items is proposed. Specifically, the proposed novel biclustering method is first adopted to obtain local similarity and local prediction. Second, item-based collaborative filtering is used to generate global predictions. Finally, the two resultant predictions are fused to obtain a final one. Experiment results demonstrate that the proposed method outperforms state-of-the-art models in terms of several aspects on three benchmark datasets.

Design of ensemble recurrent model with stacked fuzzy ARTMAP for breast cancer detection

PurposeIn time and accurate detection of cancer can save the life of the person affected. According to the World Health Organization (WHO), breast cancer occupies the most frequent incidence among all the cancers whereas breast cancer takes fifth place in the case of mortality numbers. Out of many image processing techniques, certain works have focused on convolutional neural networks (CNNs) for processing these images. However, deep learning models are to be explored well.Design/methodology/approachIn this work, multivariate statistics-based kernel principal component analysis (KPCA) is used for essential features. KPCA is simultaneously helpful for denoising the data. These features are processed through a heterogeneous ensemble model that consists of three base models. The base models comprise recurrent neural network (RNN), long short-term memory (LSTM) and gated recurrent unit (GRU). The outcomes of these base learners are fed to fuzzy adaptive resonance theory mapping (ARTMAP) model for decision making as the nodes are added to the F_2ˆa layer if the winning criteria are fulfilled that makes the ARTMAP model more robust.FindingsThe proposed model is verified using breast histopathology image dataset publicly available at Kaggle. The model provides 99.36% training accuracy and 98.72% validation accuracy. The proposed model utilizes data processing in all aspects, i.e. image denoising to reduce the data redundancy, training by ensemble learning to provide higher results than that of single models. The final classification by a fuzzy ARTMAP model that controls the number of nodes depending upon the performance makes robust accurate classification.Research limitations/implicationsResearch in the field of medical applications is an ongoing method. More advanced algorithms are being developed for better classification. Still, the scope is there to design the models in terms of better performance, practicability and cost efficiency in the future. Also, the ensemble models may be chosen with different combinations and characteristics. Only signal instead of images may be verified for this proposed model. Experimental analysis shows the improved performance of the proposed model. This method needs to be verified using practical models. Also, the practical implementation will be carried out for its real-time performance and cost efficiency.Originality/valueThe proposed model is utilized for denoising and to reduce the data redundancy so that the feature selection is done using KPCA. Training and classification are performed using heterogeneous ensemble model designed using RNN, LSTM and GRU as base classifiers to provide higher results than that of single models. Use of adaptive fuzzy mapping model makes the final classification accurate. The effectiveness of combining these methods to a single model is analyzed in this work.

Multiple perspectives on analyzing risk factors in FMEA

As an important part of the Design for X tools, Design for Quality (DFQ) is used to reduce cost and improve quality of products while maintaining reliability in preliminary design phase. As a powerful tool to reduce and eliminate possible failures, failure mode and effects analysis (FMEA) is broadly applied in detail design phase. However, scholars have criticized the traditional FMEA model for several shortages. In the past decades, nearly all the FMEA methods have been presented to heighten the rationality of ranking results by considering the risk factors (severity (S), occurrence (O) and detection (D)) simultaneously. The simultaneous analysis of risk factors (RFs) may result in the ignorance of impact on failure modes from extreme RFs. In fact, different combinations of RFs may obtain more comprehensive risk information about failure modes. Thus, a novel FMEA classification method is proposed by combining risk factors in pairs (i.e., S&O, S&D and O&D) to conduct risk assessment which can avoid interaction effect caused by simultaneous analysis of risk factors. Specifically, the fuzzy adaptive resonance theory is used to conduct failure modes classification based on the assessment results of S&O, S&D and O&D obtained by the grey relational analysis. Finally, a real case study, i.e., the final assembly process of spark plugs, from an automotive manufacturer in China is adopted to clarify the advantages of the proposed method.

An Enhanced Fuzzy Clustering to Pattern Recognition for Cloud Computing, by using Model Aggregation and Model Selection

Numerical schemes research on clustering models has been quite intensive in the past decade. Many models have been proposed to address the clustering tasks. Most clustering models are influenced by presentation order, complex shapes, architecture configuration, and learning instability. Hence, in the present study, a novel clustering-based method for cloud computing that provides an improvement in recognition rate, is described. The evaluation, based on 10-fold Cross-validation, showed that the proposed model, which is named BaggingCluster, yielded good results and performed better than Self Organizing Map and fuzzy Adaptive Resonance Theory. Experimental studies demonstrate that our model provides an efficient model for cloud computing.

An Enhanced Weight Update Method for Simplified ARTMAP to Classify Groundwater Data

The groundwater for aquatic purposes must be assessed prior to its consumption. Huge number of conventional methods are existing for assessing the quality of groundwater. The water quality index is one of the important conventional methods to assess the groundwater quality. But the conventional methods alone are not enough to assess groundwater quality as well as classify based on its purity. In this paper, we propose an enhanced weight update method for Simplified Fuzzy Adaptive Resonance Theory model to classify the groundwater quality depending on the relative weights of the groundwater quality parameters. Finding the optimal weights is the key to achieve better accuracy of the model, most of the nonlinear models fails to exhibit good accuracy if they fail to learn the optimal weights in the learning process. The aim of the work is to find the good fit between the predicted and the actual groundwater quality grades by identifying the optimal weights of the network by the enhanced weight update method. The Simplified Fuzzy Adaptive Resonance Theory map with the enhanced weight update method performance is justified by comparing it with the Simplified Fuzzy Adaptive Resonance Theory Map. The enhanced weight update method improves the accuracy of the Simplified Fuzzy Adaptive Resonance Theory Map in classifying and predicting the groundwater quality.

Class imbalance learning using fuzzy ART and intuitionistic fuzzy twin support vector machines

The classification in imbalanced datasets is one of the main problems for machine learning techniques. Support vector machine (SVM) is biased to the majority class samples, and the minority class samples may incorrectly be considered as noise. Therefore, SVM has poor predictive accuracy for imbalanced datasets and generates inaccurate classification models. Existing class imbalance learning (CIL) techniques can make SVM less sensitive to class imbalance, but these methods suffer from issues related to noise and outliers. Moreover, despite the solid theoretical basis and good classification performance, SVM is not appropriate for the classification of large-scale datasets because the training complexity of SVM is closely related to the dataset size. Class imbalance learning (CIL) using Fuzzy adaptive resonance theory (ART) and intuitionistic fuzzy twin SVM (CIL-FART-IFTSVM), which can be applied to address the class imbalance issue in the presence of noise and outliers and large scale datasets, is proposed to overcome these substantial difficulties. In this method, we modify the distribution of the datasets using fuzzy adaptive resonance theory (Fuzzy ART) as a clustering method to overcome the imbalance problem. Then, after data reduction, IFTSVM is utilized to find excellent non-parallel hyperplanes in the generated data points. Finally, a coordinate descent system with shrinking by an active set is applied to reduce the computational complexity. Forty-five imbalanced datasets are considered to validate the performance of the proposed CIL-FART-IFTSVM method. The Friedman test and the bootstrap technique with 95% confidence intervals are applied to quantify the results statistically. The experimental results indicate that the method proposed in this paper has a better performance compared with other methods, and the training time is significantly better than that of other classifiers for large-scale datasets.

Zebrafish behavior feature recognition using three-dimensional tracking and machine learning

In this work, we aim to construct a new behavior analysis method by using machine learning. We used two cameras to capture three-dimensional (3D) tracking data of zebrafish, which were analyzed using fuzzy adaptive resonance theory (FuzzyART), a type of machine learning algorithm, to identify specific behavioral features. The method was tested based on an experiment in which electric shocks were delivered to zebrafish and zebrafish swimming was tracked in 3D simultaneously to find electric shock-associated behaviors. By processing the obtained data with FuzzyART, we discovered that distinguishing behaviors were statistically linked to the electric shock based on the machine learning algorithm. Moreover, our system could accept user-supplied data for detection and quantitative analysis of the behavior features, such as the behavior features defined by the 3D tracking analysis above. This system could be applied to discover new distinct behavior features in mutant zebrafish and used for drug administration screening and cognitive ability tests of zebrafish in the future.

Integration of hard and soft supervised machine learning for flood susceptibility mapping

Flooding is a destructive natural phenomenon that causes many casualties and property losses in different parts of the world every year. Efficient flood susceptibility mapping (FSM) can reduce the risk of this hazard, and has become the main approach in flood risk management. In this study, we evaluated the prediction ability of artificial neural network (ANN) algorithms for hard and soft supervised machine learning classification in FSM by using three ANN algorithms (multi-layer perceptron (MLP), fuzzy adaptive resonance theory (FART), self-organizing map (SOM)) with different activation functions (sigmoidal (-S), linear (-L), commitment (-C), typicality (-T)). We used integration of these models for predicting the spatial expansion probability of flood events in the Ajichay river basin, northwest Iran. Inputs to the ANN were spatial data on 10 flood influencing factors (elevation, slope, aspect, curvature, stream power index, topographic wetness index, lithology, land use, rainfall, and distance to the river). The FSMs obtained as model outputs were trained and tested using flood inventory datasets earned based on previous records of flood damage in the region for the Ajichay river basin. Sensitivity analysis using one factor-at-a-time (OFAT) and all factors-at-a-time (AFAT) demonstrated that all influencing factors had a positive impact on modeling to generate FSM, with altitude having the greatest impact and curvature the least. Model validation was carried out using total operating characteristic (TOC) with an area under the curve (AUC). The highest success rate was found for MLP-S (92.1%) and the lowest for FART-T (75.8%). The projection rate in the validation of FSMs produced by MLP-S, MLP-L, FART-C, FART-T, SOM-C, and SOM-T was found to be 90.1%, 89.6%, 71.7%, 70.8%, 83.8%, and 81.1%, respectively. While integration of hard and soft supervised machine learning classification with activation functions of MLP-S and MLP-L showed a strong flood prediction capability for proper planning and management of flood hazards, MLP-S is a promising method for predicting the spatial expansion probability of flood events.

Classification of Groundwater by Applying Simplified Fuzzy Adaptive Resonance Theory

Classification of Groundwater by Applying Simplified Fuzzy Adaptive Resonance Theory

Role-Based Profiling Using Fuzzy Adaptive Resonance Theory for Securing Database Systems

Very large amounts of time and effort have been invested by the research community working on database security to achieve high assurance of security and privacy. An important component of a secure database system is intrusion detection system which has the ability to successfully detect anomalous behavior caused by applications and users. However, modeling the normal behavior of a large number of users in a huge organization is quite infeasible and inefficient. The main purpose of this research investigation is thus to model the behavior of roles instead of users by applying adaptive resonance theory neural network. The observed behavior which deviates from any of the established role profiles is treated as malicious. The proposed model has the advantage of identifying insider threat and is applicable for large organizations as it is based on role profiling instead of user profiling. The proposed system is capable of detecting intrusion with high accuracy along with minimized false alarms.

A Comparative Study on Fuzzy Clustering for Cloud Computing. Taking Web Service as a case

Abstract This study addresses the increasingly encountered challenge of data clustering. We present a comparative study to data clustering for cloud computing using Fuzzy C-MEANS and Adaptive Resonance Theory. To reduce variance and improve generalization ability, we used a resampling method based on 10-fold cross-validation. The typical initialization scheme is applied to improve the convergence speed of training and thus, reach the optimal solution. Experimental results on cloud computing datasets showed that the typical initialization-based Fuzzy Adaptive Resonance Theory model is effective and achieves improved accuracy for pattern recognition task compared to Fuzzy C-MEANS.

A Brain-Inspired Adaptive Space Representation Model Based on Grid Cells and Place Cells.

Grid cells and place cells are important neurons in the animal brain. The information transmission between them provides the basis for the spatial representation and navigation of animals and also provides reference for the research on the autonomous navigation mechanism of intelligent agents. Grid cells are important information source of place cells. The supervised learning and unsupervised learning models can be used to simulate the generation of place cells from grid cell inputs. However, the existing models preset the firing characteristics of grid cell. In this paper, we propose a united generation model of grid cells and place cells. First, the visual place cells with nonuniform distribution generate the visual grid cells with regional firing field through feedforward network. Second, the visual grid cells and the self-motion information generate the united grid cells whose firing fields extend to the whole space through genetic algorithm. Finally, the visual place cells and the united grid cells generate the united place cells with uniform distribution through supervised fuzzy adaptive resonance theory (ART) network. Simulation results show that this model has stronger environmental adaptability and can provide reference for the research on spatial representation model and brain-inspired navigation mechanism of intelligent agents under the condition of nonuniform environmental information.

Improved algorithm for de‐interleaving radar signals with overlapping features in the dynamically varying electromagnetic environment

As an indispensable part of electronic support measure, the de-interleaving technique is used to separate interleaved radar pulse streams. At present, clustering based on radar features is one of the most effective de-interleaving methods. In a dynamically varying electromagnetic environment, the features of intercepted radar pulses overlap each other. Compared with other de-interleaving algorithms, the fuzzy adaptive resonance theory (Fuzzy ART) has obvious advantages in classifying such radar features. However, it still faces several problems: (i) the vigilance parameter used to regulate de-interleaving performance is difficult to reach its optimal value and (ii) since the unified discrimination threshold is selected for different regions, the algorithm suffers from category proliferation problem. This study addresses these problems by constructing a new vigilance model to replace the unified vigilance parameter and introducing a dual-vigilance mechanism to ART-based de-interleaving systems. It demonstrates this idea in the context of Fuzzy ART, presented as Fuzzy ART based on a 3D fuzzy model with two vigilance thresholds (2VT-3DFA). 2VT-3DFA suppressed the excessive proliferation of categories, and its clustering quality was 20% higher than that of conventional algorithms in dynamically varying signal environment.

Harmonic current classification using hybrid FAM-RBF neural network

In this paper, the type of customers of electricity in Malaysia is classified into the type of electricity consumers based on the harmonic current data. A hybrid of Fuzzy Adaptive Resonance Theory with Mapping Algorithm (Fuzzy ARTMAP) and Radial Basis Function (RBF) neural network is developed (namely FAM-RBF), and it is used to classify the harmonic current into types of consumers. The result of the proposed neural network is discussed, and compared with other neural networks in this paper. The comparison result shows that the proposed FAM-RBF obtained the best performance result and is a truthful neural network to be used in this application.

Improved de-interleaving algorithm of radar pulses based on dual fuzzy vigilance ART

As a core part of the electronic warfare (EW) system, de-interleaving is used to separate interleaved radar signals. The de-interleaving algorithm based on the fuzzy adaptive resonance theory (fuzzy ART) is plagued by the problems of premature saturation and performance improving dilemma. This study proposes a dual fuzzy vigilance ART (DFV-ART) algorithm to address these problems and make the following improvements. Firstly, a correction method is introduced to prevent the network from prematurely saturating; then, the fuzzy vigilance models (FVM) are constructed to replace the conventional vigilance parameter, reducing the error probability in the overlapping region; finally, a dual vigilance mechanism is introduced to solve the performance improving dilemma. Simulation results show that the proposed algorithm could improve the clustering accuracy (quantization error dropped 60%) and the de-interleaving performance (clustering quality increased by 10%) while suppressing the excessive proliferation of categories.

Hardware Implementation of Parallelized Fuzzy Adaptive Resonance Theory Neural Network

A hardware implementation design of parallelized fuzzy Adaptive Resonance Theory neural network is described and simulated. Parallel category choice and resonance are implemented in the network. Continuous-time and discrete-time winner-take-all neural circuits identifying the largest of M inputs are used as the winner-take-all units. The continuous-time circuit is described by a state equation with a discontinuous right-hand side. The discrete-time counterpart is governed by a difference equation. Corresponding functional block-diagrams of the circuits include M feed-forward hard- limiting neurons and one feedback neuron, which is used to compute the dynamic shift of inputs. The circuits combine arbitrary finite resolution of inputs, high convergence speed to the winner-take-all operation, low computational and hardware implementation complexity, and independence of initial conditions. The circuits are also used for finding elements of input vector with minimal/maximal values to normalize them in the range [0,1].

Distributed dual vigilance fuzzy adaptive resonance theory learns online, retrieves arbitrarily-shaped clusters, and mitigates order dependence

This paper presents a novel adaptive resonance theory (ART)-based modular architecture for unsupervised learning, namely the distributed dual vigilance fuzzy ART (DDVFA). DDVFA consists of a global ART system whose nodes are local fuzzy ART modules. It is equipped with distributed higher-order activation and match functions and a dual vigilance mechanism. Together, these allow DDVFA to perform unsupervised modularization, create multi-prototype cluster representations, retrieve arbitrarily-shaped clusters, and reduce category proliferation. Another important contribution is the reduction of order-dependence, an issue that affects any agglomerative clustering method. This paper demonstrates two approaches for mitigating order-dependence: pre-processing using visual assessment of cluster tendency (VAT) or post-processing using a novel Merge ART module. The former is suitable for batch processing, whereas the latter also works for online learning. Experimental results in online mode carried out on 30 benchmark data sets show that DDVFA cascaded with Merge ART statistically outperformed the best other ART-based systems when samples were randomly presented. Conversely, they were found to be statistically equivalent in offline mode when samples were pre-processed using VAT. Remarkably, performance comparisons to non-ART-based clustering algorithms show that DDVFA (which learns incrementally) was also statistically equivalent to the non-incremental (offline) methods of density-based spatial clustering of applications with noise (DBSCAN), single linkage hierarchical agglomerative clustering (SL-HAC), and k-means, while retaining the appealing properties of ART. Links to the source code and data are provided. Considering the algorithm’s simplicity, online learning capability, and performance, it is an ideal choice for many agglomerative clustering applications.