Deep Fuzzy Rule-Based Classification System With Improved Wang–Mendel Method

Abstract

Wang–Mendel (WM) fuzzy system is an effective and interpretable model for solving tabular data classification problem. However, original WM fuzzy system is weak in handling dataset with high dimensionality or large volume. Meanwhile, its capability of characterizing data is narrow, which results from lacking hierarchical transformation of features like deep learning-based models. In this article, we propose a deep fuzzy rule-based classification system (DFRBCS) based on improved WM method, in which fuzzy technique and deep learning strategy are combined to make a desirable tradeoff between model’s interpretability and prediction accuracy. We first redefine the consequent part of fuzzy rule in WM fuzzy system with class probability vector, which endows the improved WM fuzzy system with capacity for serving as building block of deep model. The model structure of DFRBCS is designed in layer-by-layer manner, where raw features can be transformed hierarchically. For every layer in DFRBCS, it contains many improved WM fuzzy systems whose input spaces are generated by shuffling and sliding window operation on concatenated outputs of fuzzy systems in previous layer. Comparative experiments are conducted on 45 real-world datasets with various sizes and dimensionality between our method, five baseline models, and the other deep fuzzy classifiers (D-TSK-FC, HID-TSK-FC, FCCI-TSK, DSA-FC, and MEEFIS). The experimental results show that DFRBCS is competitive in classification performance and promising in model’s interpretability.