A novel approach for the hyperparameters of support vector regression

Abstract

In order to determine the hyperparameters of support vector regression (SVR), an approach with a two structured method is proposed to determine the kernel parameter /spl sigma/ and /spl epsi/ in the /spl epsi/-insensitive loss function. Firstly, the kernel parameter /spl sigma/ of a Gaussian kernel function is determined by the competitive agglomeration (CA) clustering algorithm. The CA clustering algorithm incorporates the advantage of both hierarchical and partitioned clustering algorithms. Besides, it can find the nearly optimum number of clusters as well as its center of clusters in the clustering process. Secondly, the repeated SVR approach is proposed to obtain a proper /spl epsi/ in the /spl epsi/-insensitive loss function that can be included in most of the data. Based on the efficiently structured way for choosing the hyperparameters /spl sigma/ and /spl epsi/, the simulation results have shown that the proposed approach comes close to the optimum hyperparameter region.