Multi-class Classification Approach Research Articles

Performance Analysis of Multiclass Support Vector Machine Classification for Diagnosis of Coronary Heart Diseases

Automatic diagnosis of coronary heart disease helps the doctor to support in decision making a diagnosis. Coronary heart disease have some types or levels. Referring to the UCI Repository dataset, it divided into 4 types or levels that are labeled numbers 1-4 (low, medium, high and serious). The diagnosis models can be analyzed with multiclass classification approach. One of multiclass classification approach used, one of which is a support vector machine (SVM). The SVM use due to strong performance of SVM in binary classification. This research study multiclass performance classification support vector machine to diagnose the type or level of coronary heart disease. Coronary heart disease patient data taken from the UCI Repository. Stages in this study is preprocessing, which consist of, to normalizing the data, divide the data into data training and testing. The next stage of multiclass classification and performance analysis. This study uses multiclass SVM algorithm, namely: Binary Tree Support Vector Machine (BTSVM), One-Against-One (OAO), One-Against-All (OAA), Decision Direct Acyclic Graph (DDAG) and Exhaustive Output Error Correction Code (ECOC). Performance parameter used is recall, precision, F-measure and Overall accuracy.

What Goes Around Comes Around: Learning Sentiments in Online Medical Forums

It has been shown that online health-related discussions significantly influence the attitudes and behavioral intentions of the discussion participants. Although empirical evidence strongly supports the importance of emotions in health-related online discussions, there are few studies of the relationship between a subjective language and online discussions of personal health. In this work, we study sentiments expressed on online medical forums. Individual posts are classified into one of five categories. We identified three categories as sentimental (encouragement, gratitude, confusion) and two categories as neutral (facts, endorsement). A total of 1438 messages were annotated manually by two annotators with a strong inter-annotator agreement (Fleiss kappa = 0.737 when the posts were annotated in the context of discussion and Fleiss kappa = 0.763 when the posts were annotated as individual entities). Using machine learning multi-class classification approach, we assess the feasibility of automated recognition of the five sentiment categories. As well as considering the predominant sentiments expressed in individual posts, we analyze transitions between sentiments in online discussions.

A multi-class SVM approach based on the l1-norm minimization of the distances between the reduced convex hulls

Multi-class classification is an important pattern recognition task that can be addressed accurately and efficiently by Support Vector Machine (SVM). In this work we present a novel SVM-based multi-class classification approach based on the center of the configuration, a point which is equidistant to all classes. The center of the configuration is obtained from the dual formulation by minimizing the distances between the reduced convex hulls using the l1-norm, while the decision functions are subsequently constructed from this point. This work also extends the ideas of Zhou et al. (2002) [37] to multi-class classification. The use of l1-norm provides a single linear programming formulation, which reduces the complexity and confers scalability compared with other multi-class SVM methods based on quadratic programming formulations. Experiments on benchmark datasets demonstrate the virtues of our approach in terms of classification performance and running times compared with various other multi-class SVM methods.

Using machine learning techniques for evaluating tomato ripeness

Tomato quality is one of the most important factors that helps ensuring a consistent marketing of tomato fruit. As ripeness is the main indicator for tomato quality from customers perspective, the determination of tomato ripeness stages is a basic industrial concern regarding tomato production in order to get high quality product. Automatic ripeness evaluation of tomato is an essential research topic as it may prove benefits in ensuring optimum yield of high quality product, this will increase the income because tomato is one of the most important crops in the world. This article presents an automated multi-class classification approach for tomato ripeness measurement and evaluation via investigating and classifying the different maturity/ripeness stages. The proposed approach uses color features for classifying tomato ripeness stages. The approach proposed in this article uses Principal Components Analysis (PCA) in addition to Support Vector Machines (SVMs) and Linear Discriminant Analysis (LDA) algorithms for feature extraction and classification, respectively. Experiments have been conducted on a dataset of total 250 images that has been used for both training and testing datasets with 10-fold cross validation. Experimental results showed that the proposed classification approach has obtained ripeness classification accuracy of 90.80%, using one-against-one (OAO) multi-class SVMs algorithm with linear kernel function, ripeness classification accuracy of 84.80% using one-against-all (OAA) multi-class SVMs algorithm with linear kernel function, and ripeness classification accuracy of 84% using LDA algorithm.

Probabilistic Novelty Detection With Support Vector Machines

Novelty detection, or one-class classification, is of particular use in the analysis of high-integrity systems, in which examples of failure are rare in comparison with the number of examples of stable behaviour, such that a conventional multi-class classification approach cannot be taken. Support Vector Machines (SVMs) are a popular means of performing novelty detection, and it is conventional practice to use a train-validate-test approach, often involving cross-validation, to train the one-class SVM, and then select appropriate values for its parameters. An alternative method, used with multi-class SVMs, is to calibrate the SVM output into conditional class probabilities. A probabilistic approach offers many advantages over the conventional method, including the facility to select automatically a probabilistic novelty threshold. The contributions of this paper are (i) the development of a probabilistic calibration technique for one-class SVMs, such that on-line novelty detection may be performed in a probabilistic manner; and (ii) the demonstration of the advantages of the proposed method (in comparison to the conventional one-class SVM methodology) using case studies, in which one-class probabilistic SVMs are used to perform condition monitoring of a high-integrity industrial combustion plant, and in detecting deterioration in patient physiological condition during patient vital-sign monitoring.

A multi-class classification approach for target localization in wireless sensor networks

Target localization problem, in which the location of an unknown target is estimated, is one of the key issues in applications of wireless sensor networks (WSNs). Target localization methods that directly use raw sensor data can suffer from uncertainty or disturbance caused by the surrounding environmental elements and noise. Especially, when using WSNs, the limited communication capacity can impose a significant limit on the amount of data that can be processed. Considering these issues, various methods have been proposed, especially using machine learning techniques such as neural networks or support vector machines. In this paper, we employ a multi-class classification algorithm for target localization, in which a pseudo probability map is constructed using modified support vector domain description. A local classification strategy which uses information from local neighbors only is proposed in order to reduce communication costs. Experimental results using an acoustic WSN are compared with Platt’s method to validate the multi-class classification algorithm.

Two New Prediction-Driven Approaches to Discrete Choice Prediction

The ability to predict consumer choices is essential in understanding the demand structure of products and services. Typical discrete choice models that are targeted at providing an understanding of the behavioral process leading to choice outcomes are developed around two main assumptions: the existence of a utility function that represents the preferences over a choice set and the relatively simple and interpretable functional form for the utility function with respect to attributes of alternatives and decision makers. These assumptions lead to models that can be easily interpreted to provide insights into the effects of individual variables, such as price and promotion, on consumer choices. However, these restrictive assumptions might impede the ability of such theory-driven models to deliver accurate predictions and forecasts. In this article, we develop novel approaches targeted at providing more accurate choice predictions. Specifically, we propose two prediction-driven approaches: pairwise preference learning using classification techniques and ranking function learning using evolutionary computation. We compare our proposed approaches with a multiclass classification approach, as well as a standard discrete choice model. Our empirical results show that the proposed approaches achieved significantly higher choice prediction accuracy.

Process knowledge based multi-class support vector classification (PK-MSVM) approach for surface defects in hot rolling

Random surface defects occur during the hot bar rolling of steels and are identified either by manual or by automated inspection techniques. Manual inspection techniques are purely based on the process knowledge of the inspector such as the location, type and kind of defects, and the primary sources of these defects. The automated techniques, to identify and classify the defects, rely on machine vision technologies and image processing algorithms based on support vector machines, wavelets, image processing and statistical inference. Both these approaches have their own advantages and limitations. To improve the accuracy of classification of these defects a process knowledge based support vector classification scheme is proposed (called PK-MSVM) which combines feature extraction task of automated inspection with the process knowledge. The defect observation data from the imaging sensor is transformed to include this process knowledge. Three attributes of the defects – length to width ratio, longitudinal location and transverse location- are used for this transformation are they are closely related to the thermo-mechanics of the rolling process. Different formulations of the multi-class support vector machines (MSVMs) are compared for this classification with or without process knowledge based transformation: one-against-one, one-against-all and Hastie’s algorithm of multi class SVM. It is found that the new approach (PK-MSVM) performs better than traditional MSVM for all the three formulations. For the best case, the performance sees a jump of more than 100%. Thus incorporating process knowledge in identification and classification does increase the reliability of inspection considerably.

Multi Class Classification Approach for Classification of ADAMs, MMPs and Their Subclasses

The MMPs and ADAMs are cell surface proteases which belong to metalloprotease family. They play an important role in skin aging, skin disorders, anticancer therapy and other physiological disorders. Thus there arises the need to understand the relationships among various parameters of these proteins for prediction of their classes, structures and functionality. The computational approaches for prediction of their classes are fast and economical therefore can be used to complement the existing wet lab techniques. Realizing their importance, in this paper an attempt has been made to correlate them with their amino acid composition and predict them with fair accuracy. This is a novel method where ADAMs and MMPs have been classified on the basis of amino acid composition using Support Vector Machine. The SVM has been implemented using Lib SVM package. The method discriminates MMP subfamily from ADAM proteases with Matthew's correlation coefficient of 0.98 using amino acid composition. The method is further able to predict three major subclasses or subfamilies of MMPs with an overall Matthew's correlation coefficient (MCC) and accuracy of 0.782 and 89.01% respectively using amino acid composition. The performance of the method was evaluated using 5-fold cross-validation where accuracy of 98% was obtained.

Using One-Class SVMs and Wavelets for Audio Surveillance

This paper presents a method aimed at recognizing environmental sounds for surveillance and security applications. We propose to apply one-class support vector machines (1-SVMs) together with a sophisticated dissimilarity measure in order to address audio classification, and more specifically, sound recognition. We illustrate the performance of this method on an audio database, which consists of 1015 sounds belonging to nine classes. The database used presents high intraclass diversity in temps of signal properties and some kind of interclass similarities. A large discrepancy in the number of items in each class implies nonuniform probability of sound appearances. The method proceeds as follows: first, the use of a set of state-of-the-art audio features is studied. Then, we introduce a set of novel features obtained by combining elementary features. Experiments conducted on a nine-class classification problem show the superiority of this novel sound recognition method. The best recognition accuracy (96.89%) is obtained when combining wavelet-based features, MFCCs, and individual temporal and frequency features. Our 1-SVM-based multiclass classification approach overperforms the conventional hidden Markov model-based system in the experiments conducted, the improvement in the error rate can reach 50%. Besides, we provide empirical results showing that the single-class SVM outperforms a combination of binary SVMs. Additional experiments demonstrate our method is robust to environmental noise.

Error‐corrected output coding‐based class decomposition approach for remote sensing classification

This paper discusses the application of an error‐corrected output coding (ECOC)‐based class decomposition approach for land cover classification. Exhaustive and random techniques to generate error‐correcting output codes were used. A univariate decision tree and a backpropagation neural network were used as base classifiers. Results from the ECOC‐based class decomposition approach are compared with the multiclass classification approach. Results suggest that an ECOC‐based class decomposition approach performs well with both decision tree and neural network classifiers in comparison with a multiclass approach and results are significantly better. Results using an ECOC‐based class decomposition approach indicate a significant improvement in classification accuracy with noisy as well as small training data sets. A study with a random technique‐based class decomposition approach suggests that the size of codes used to decompose the multiclass problem affects the classification accuracy but no significant improvement is achieved beyond a code length of 21 using both classifiers, except increased computational cost. A boosting and ECOC‐based class decomposition approach perform equally well as a univariate decision tree as base classifier using a large training data set. Further, the performance of boosting degrades with increases in the amount of noise in the training data set in comparison with the ECOC‐based approach, as well as with smaller training data sets.