Data preprocessing strategy in constructing convolutional neural network classifier based on constrained particle swarm optimization with fuzzy penalty function

Abstract

Convolutional neural networks (CNNs) have attracted increasing attention in recent years because of their powerful abilities to extract and represent spatial/temporal information. However, for general data, its features are assumed to have weak or no correlation, and directly applying CNN to classify such data could result in poor classification performance. To address this problem, a combined technique of original data representation method of fuzzy penalty function-based constrained particle swarm optimization (FCPSO) and CNN, so-called FCPSO-CNN is designed to effectively solve the classification problems for generic dataset and applied to recognize (classify) black plastic wastes in recycling problems. In more detail, CPSO is introduced to optimize feature reordering matrix under constraints and the construction of this matrix is driven by fitness function of CNN that quantifies classification performance. The Mamdani type fuzzy inference system (FIS) is employed to realize the fuzzy penalty function (FPF) which is utilized to realize the constrained problems of CPSO as well as alleviate the issues of the original penalty function method suffering from the lack of robustness. Experimental results demonstrate that FCPSO-CNN achieves the best classification accuracy on 13 out of 17 datasets; the statistical analysis also confirms the superiority of FCPSO-CNN. An interesting point is worth to mention that some feature reordering matrices in the infeasible space come with better classification accuracy. It has been found that the proposed method results in more accurate solution than one-dimensional CNN, random reordering feature-based CNN and some well-known classifiers (e.g., Naive Bayes, Multilayer perceptron, Support vector machine).