Principal weighted least square support vector machine: An online dimension-reduction tool for binary classification

Abstract

As relevant technologies advance, streamed data are frequently encountered in various applications, and the need for scalable algorithms becomes urgent. In this article, we propose the principal weighted least square support vector machine (PWLSSVM) as a novel tool for SDR in binary classification where most SDR methods suffer since they assume continuous Y. We further show that the PWLSSVM can be employed for the online SDR for the streamed data. Namely, the PWLSSVM estimator can be directly updated from the new data without having old data. We explore the asymptotic properties of the PWLSSVM estimator and demonstrate its promising performance in terms of both estimation accuracy and computational efficiency for both simulated and real data.