Fuzzy deep belief networks for semi-supervised sentiment classification

Abstract

By embedding prior knowledge into the learning structure, this paper presents a two-step semi-supervised learning method called fuzzy deep belief networks (FDBN) for sentiment classification. First, we train the general deep belief networks (DBN) by the semi-supervised learning taken on training dataset. Then, we design a fuzzy membership function for each class of reviews based on the learned deep architecture. Since the training of DBN maps each review into the DBN output space, the distribution of all training samples in the space is treated as prior knowledge and is encoded by a series of fuzzy membership functions. Second, based on the fuzzy membership functions and the DBN obtained in the first step, a novel FDBN architecture is constructed and the supervised learning stage is applied to improve the classification performance of the FDBN. FDBN not only inherits the powerful abstraction ability of DBN, but also demonstrates the attractive fuzzy classification ability for handling sentiment data. To inherit the advantages of both active learning and FDBN, we also propose an active FDBN (AFD) semi-supervised learning method. The empirical validation on five sentiment classification datasets demonstrates the effectiveness of FDBN and AFD methods.