Formula omitted]-Kernel-free soft quadratic surface support vector regression

Abstract

In this paper, we propose a new regression method called the ∊-kernel-free soft quadratic surface support vector regression (∊-SQSSVR). After converting the n-dimensional regression problem into the (n+1)-dimensional classification problem, the principle of maximizing the sum of relative geometrical margin of each training point is used to construct our optimization problem, where the quadratic surface is restricted to be a hyperparaboloid by setting both the (n+1)-th row and (n+1)-th column of the corresponding matrix to be zero. The existence and uniqueness of the optimal solution to both primal and dual problems are also addressed. It should be pointed out that our model is nonlinear and kernel-free, so it does not need to select kernel function and corresponding parameters. At the same time, it is highly interpretable. In addition, our model is still a quadratic convex programming problem similar to the standard SVR. To visualize the effectiveness of our ∊-SQSSVR, 6 artificial datasets and 15 benchmark datasets are implemented in numerical experiments. The results show that our method is less time-consuming and as good as the nonlinear standard SVR with kernel function in comprehensive performances.