Nonlinear Support Vector Machine Classification Research Articles

Implementation of a non-linear SVM classification for seizure EEG signal analysis on FPGA

An automatic detection method for disease diagnosis plays an important role in the medical field. A computer-aided diagnosis (CAD) system for seizure detection using electroencephalogram (EEG) data is significant in protecting patients' lives. This paper presents machine learning algorithm-based seizure detection approach implemented in both software and hardware using EEG recordings. The input EEG signal is subjected to pre-processing, decomposition using wavelet transform and classification by a support vector machine (SVM) classifier. The maximum and variance statistical values of the decomposed EEG sub-bands are computed to generate a feature vector, while classification accuracy and computational complexity are taken into account. Gaussian Radial Basis Function (RBF) kernel based Non-Linear SVM (NLSVM) is used in this proposed approach to solve both two-class and three-class classification problems. In three-class classification, the one-against-one (OAO) technique is used. The competency of the proposed technique is evaluated using two distinct datasets provided by Bonn University, Germany & Neurology and Sleep Centre, New Delhi. The adequate parameters of the NLSVM classifier model are determined by using MATLAB software in the training phase and the best performing NLSVM model is selected for implementation on the Field-Programmable Gate Array (FPGA). The proposed seizure detection method is implemented with Verilog code and examined on a Xilinx Zynq-7000 XC7Z020 FPGA board to evaluate its performance. The experimental results show that the proposed method with a minimal number of features achieved a good performance metric for seizure detection and is comparable with that of the state-of-the-art methods.

Lattice-Based Homomorphic Encryption For Privacy-Preserving Smart Meter Data Analytics

Abstract Privacy-preserving smart meter data collection and analysis are critical for optimizing smart grid environments without compromising privacy. Using homomorphic encryption techniques, smart meters can encrypt collected data to ensure confidentiality, and other untrusted nodes can further compute over the encrypted data without having to recover the underlying plaintext. As an illustrative example, this approach can be useful to compute the monthly electricity consumption without violating consumer privacy by collecting fine-granular data through small increments of time. Toward that end, we propose an architecture for privacy-preserving smart meter data collection, aggregation and analysis based on lattice-based homomorphic encryption. Furthermore, we compare the proposed method with the Paillier and Boneh–Goh–Nissim (BGN) cryptosystems, which are popular alternatives for homomorphic encryption in smart grids. We consider different services with different requirements in terms of multiplicative depth, e.g. billing, variance and nonlinear support vector machine classification. Accordingly, we measure and show the practical overhead of using the proposed homomorphic encryption method in terms of communication traffic (ciphertext size) and latency. Our results show that lattice-based homomorphic encryption is more efficient than Paillier and BGN for both multiplication and addition operations while offering more flexibility in terms of the computation that can be evaluated homomorphically.

Umpire Gesture Detection and Recognition using HOG and Non-Linear Support Vector Machine (NL-SVM) Classification of Deep Features in Cricket Videos

Gesture Recognition pertains to recognizing meaningful expressions of motion by a human, involving the hands, arms, face, head, and/or body. It is of utmost importance in designing an intelligent and efficient human–computer interface. The applications of gesture recognition are manifold, ranging from sign language through medical rehabilitation, monitoring patients or elder people, surveillance systems, sports gesture analysis, human behaviour analysis etc., to virtual reality. In recent years, there has been increased interest in video summarization and automatic sports highlights generation in the game of Cricket. In Cricket, the Umpire has the authority to make important decisions about events on the field. The Umpire signals important events using unique hand on signals and gestures. The primary intention of our work is to design and develop a new robust method for Umpire Action and Non-Action Gesture Identification and Recognition based on the Umpire Segmentation and the proposed Histogram Oriented Gradient (HOG) feature Extraction oriented Non-Linear Support Vector Machine (NL-SVM) classification of Deep Features. Primarily the 80% of Umpire action and non-action images in a cricket match, about 1, 93, 000 frames, the Histogram of Oriented Gradient Deep Features are calculated and trained the system having six gestures of Umpire pose. The proposed HOG Feature Extraction oriented Non-Linear Support Vector Machine classification method achieves the maximal accuracy of 97.95%, the maximal sensitivity of 98.87%, the maximal specificity of 98.89% and maximal Precision of 97.02% which indicates its superiority.

A novel embedded min-max approach for feature selection in nonlinear Support Vector Machine classification

In recent years, feature selection has become a challenging problem in several machine learning fields, such as classification problems. Support Vector Machine (SVM) is a well-known technique applied in classification tasks. Various methodologies have been proposed in the literature to select the most relevant features in SVM. Unfortunately, all of them either deal with the feature selection problem in the linear classification setting or propose ad-hoc approaches that are difficult to implement in practice. In contrast, we propose an embedded feature selection method based on a min-max optimization problem, where a trade-off between model complexity and classification accuracy is sought. By leveraging duality theory, we equivalently reformulate the min-max problem and solve it without further ado using off-the-shelf software for nonlinear optimization. The efficiency and usefulness of our approach are tested on several benchmark data sets in terms of accuracy, number of selected features and interpretability.

Classifying early and late mild cognitive impairment stages of Alzheimer\u2019s disease by fusing default mode networks extracted with multiple seeds

BackgroundThe default mode network (DMN) in resting state has been increasingly used in disease diagnosis since it was found in 2001. Prior work has mainly focused on extracting a single DMN with various techniques. However, by using seeding-based analysis with more than one desirable seed, we can obtain multiple DMNs, which are likely to have complementary information, and thus are more promising for disease diagnosis. In the study, we used 18 early mild cognitive impairment (EMCI) participants and 18 late mild cognitive impairment (LMCI) participants of Alzheimer’s disease (AD). First, we used seeding-based analysis with four seeds to extract four DMNs for each subject. Then, we conducted fusion analysis for all different combinations of the four DMNs. Finally, we carried out nonlinear support vector machine classification based on the mixing coefficients from the fusion analysis.ResultsWe found that (1) the four DMNs corresponding to the four different seeds indeed capture different functional regions of each subject; (2) Maps of the four DMNs in the most different joint source from fusion analysis are centered at the regions of the corresponding seeds; (3) Classification results reveal the effectiveness of using multiple seeds to extract DMNs. When using a single seed, the regions of posterior cingulate cortex (PCC) extractions of EMCI and LMCI show the largest difference. For multiple-seed cases, the regions of PCC extraction and right lateral parietal cortex (RLP) extraction provide complementary information for each other in fusion, which improves the classification accuracy. Furthermore, the regions of left lateral parietal cortex (LLP) extraction and RLP extraction also have complementary effect in fusion. In summary, AD diagnosis can be improved by exploiting complementary information of DMNs extracted with multiple seeds.ConclusionsIn this study, we applied fusion analysis to the DMNs extracted by using different seeds for exploiting the complementary information hidden among the separately extracted DMNs, and the results supported our expectation that using the complementary information can improve classification accuracy.

Innovative assessment scheme of navigation risk based on improved multi-source information fusion techniques

To deal with highly time complexity and unstable assessments for conflicting evidences from various navigation factors, we put forward an innovative assessment scheme of navigation risk based on the improved multi-source information fusion techniques. Different from the existing studies, we first deduce the nonlinear support vector machine classification model for the general scenario. The slack variable is adaptively computed based on the Euclidean distance ratio. Considering the unsatisfactory characteristics of the standard Dempster–Shafer evidence theory, the optimal combination rule is derived step by step. What"s more, the lowly dimensional Kalman filter is applied to forecast the navigation risk. Simultaneously, the time complexity of each technique is analyzed. With respect to the vessel navigation risk, the assessment results are provided to indicate the reliability and efficiency of the proposed scheme.

The relative importance of imaging markers for the prediction of Alzheimer's disease dementia in mild cognitive impairment - Beyond classical regression.

Selecting a set of relevant markers to predict conversion from mild cognitive impairment (MCI) to Alzheimer's disease (AD) has become a challenging task given the wealth of regional pathologic information that can be extracted from multimodal imaging data.Here, we used regularized regression approaches with an elastic net penalty for best subset selection of multiregional information from AV45-PET, FDG-PET and volumetric MRI data to predict conversion from MCI to AD. The study sample consisted of 127 MCI subjects from ADNI-2 who had a clinical follow-up between 6 and 31 months. Additional analyses assessed the effect of partial volume correction on predictive performance of AV45- and FDG-PET data.Predictor variables were highly collinear within and across imaging modalities. Penalized Cox regression yielded more parsimonious prediction models compared to unpenalized Cox regression. Within single modalities, time to conversion was best predicted by increased AV45-PET signal in posterior medial and lateral cortical regions, decreased FDG-PET signal in medial temporal and temporobasal regions, and reduced gray matter volume in medial, basal, and lateral temporal regions. Logistic regression models reached up to 72% cross-validated accuracy for prediction of conversion status, which was comparable to cross-validated accuracy of non-linear support vector machine classification. Regularized regression outperformed unpenalized stepwise regression when number of parameters approached or exceeded the number of training cases. Partial volume correction had a negative effect on the predictive performance of AV45-PET, but slightly improved the predictive value of FDG-PET data.Penalized regression yielded more parsimonious models than unpenalized stepwise regression for the integration of multiregional and multimodal imaging information. The advantage of penalized regression was particularly strong with a high number of collinear predictors.

Engine Fault Diagnostic System Based on Non-Linear Support Vector Machine

The car engine failures in the course of time and place have many possibilities. The engine fault diagnosis system developed in .NET platform. The core of the system make use of noise wavelet energy features and non-linear support vector machine classification. After the experiment, the system has fairly good results.