Abstract

This paper formulates a support vector machine with quantile hyper-spheres (QHSVM) for pattern classification. The idea of QHSVM is to build two quantile hyper-spheres with the same center for positive or negative training samples. Every quantile hyper-sphere is constructed by using pinball loss instead of hinge loss, which makes the new classification model be insensitive to noise, especially the feature noise around the decision boundary. Moreover, the robustness and generalization of QHSVM are strengthened through maximizing the margin between two quantile hyper-spheres, maximizing the inner-class clustering of samples and optimizing the independent quadratic programming for a target class. Besides that, this paper proposes a novel local center-based density estimation method. Based on it, ρ-QHSVM with surrounding and clustering samples is given. Under the premise of high accuracy, the execution speed of ρ-QHSVM can be adjusted. The experimental results in artificial, benchmark and strip steel surface defects datasets show that the QHSVM model has distinct advantages in accuracy and the ρ-QHSVM model is fit for large-scale datasets.

Highlights

  • Support vector machine (SVM) [1] proposed by Vapnik and his cooperators has become an excellent tool for machine learning

  • For θ = 0%, compared with SVM and twin support vector machine (TWSVM), twinhypersphere support vector machine (THSVM) and QHSVM have better classification accuracies, which shows that the nonparallel hyper-planes and inner-class clustering of samples strengthen the performance of classifiers

  • All these results show that QHSVM performs the best in accuracy for datasets with noise samples, which is due to pinball losses, two nonparallel support hyper-spheres and inner-class clustering of samples

Read more

Summary

Introduction

Support vector machine (SVM) [1] proposed by Vapnik and his cooperators has become an excellent tool for machine learning. Different versions of classifiers have been extended from SVDD because the inner-class of samples can be gathered to the greatest extent These classifiers include maximal-margin spherical-structured multi-class SVM (MSM-SVM) [20], twin support vector hyper-sphere (TSVH) [21], twinhypersphere support vector machine (THSVM) [22], maximum margin and minimum volume hyper-spheres machine with pinball loss (Pin-M3HM) [23] and least squares twin support vector hyper-sphere (LS-TSVH) [24]. A novel support vector machine with quantile hyper-spheres (QHSVM) for pattern classification is proposed. It inherits the excellent genes of SVDD_neg, TWSVM and Pin-SVM.

Support vector machines with hinge loss and pinball loss
Twin support vector machine
Support vector data description with negative examples
Pinball losses for quantile hyper-spheres
Primal formulation and analysis
QHSVM with surrounding and clustering samples
Solution to ρ-QHSVM
Experiments and results analysis
Artificial datasets
UCI datasets with noise samples
PASCAL VOC dataset
Strip steel surface defects datasets
Conclusions

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.