Distributed semi-supervised learning algorithm based on extreme learning machine over networks using event-triggered communication scheme

Abstract

In this paper, we propose a distributed semi-supervised learning (DSSL) algorithm based on the extreme learning machine (ELM) algorithm over communication network using the event-triggered (ET) communication scheme. In DSSL problems, training data consisting of labeled and unlabeled samples are distributed over a communication network. Traditional semi-supervised learning (SSL) algorithms cannot be used to solve DSSL problems. The proposed algorithm, denoted as ET-DSS-ELM, is based on the semi-supervised ELM (SS-ELM) algorithm, the zero gradient sum (ZGS) distributed optimization strategy and the ET communication scheme. Correspondingly, the SS-ELM algorithm is used to calculate the local initial value, the ZGS strategy is used to calculate the globally optimal value and the ET scheme is used to reduce communication times during the learning process. According to the ET scheme, each node over the communication network broadcasts its updated information only when the event occurs. Therefore, the proposed ET-DSS-ELM algorithm not only takes the advantages of traditional DSSL algorithms, but also saves network resources by reducing communication times. The convergence of the proposed ET-DSS-ELM algorithm is guaranteed by using the Lyapunov method. Finally, some simulations are given to show the efficiency of the proposed algorithm.