Multi-class Support Vector Machine Research Articles

Lightweight Multi-Class Support Vector Machine-Based Medical Diagnosis System with Privacy Preservation.

Machine learning, powered by cloud servers, has found application in medical diagnosis, enhancing the capabilities of smart healthcare services. Research literature demonstrates that the support vector machine (SVM) consistently demonstrates remarkable accuracy in medical diagnosis. Nonetheless, safeguarding patients' health data privacy and preserving the intellectual property of diagnosis models is of paramount importance. This concern arises from the common practice of outsourcing these models to third-party cloud servers that may not be entirely trustworthy. Few studies in the literature have delved into addressing these issues within SVM-based diagnosis systems. These studies, however, typically demand substantial communication and computational resources and may fail to conceal classification results and protect model intellectual property. This paper aims to tackle these limitations within a multi-class SVM medical diagnosis system. To achieve this, we have introduced modifications to an inner product encryption cryptosystem and incorporated it into our medical diagnosis framework. Notably, our cryptosystem proves to be more efficient than the Paillier and multi-party computation cryptography methods employed in previous research. Although we focus on a medical application in this paper, our approach can also be used for other applications that need the evaluation of machine learning models in a privacy-preserving way such as electricity theft detection in the smart grid, electric vehicle charging coordination, and vehicular social networks. To assess the performance and security of our approach, we conducted comprehensive analyses and experiments. Our findings demonstrate that our proposed method successfully fulfills our security and privacy objectives while maintaining high classification accuracy and minimizing communication and computational overhead.

An Intelligent Facial Expression Recognition System Using a Hybrid Deep Convolutional Neural Network for Multimedia Applications

Recognizing facial expressions plays a crucial role in various multimedia applications, such as human–computer interactions and the functioning of autonomous vehicles. This paper introduces a hybrid feature extraction network model to bolster the discriminative capacity of emotional features for multimedia applications. The proposed model comprises a convolutional neural network (CNN) and deep belief network (DBN) series. First, a spatial CNN network processed static facial images, followed by a temporal CNN network. The CNNs were fine-tuned based on facial expression recognition (FER) datasets. A deep belief network (DBN) model was then applied to integrate the segment-level spatial and temporal features. Deep fusion networks were jointly used to learn spatiotemporal features for discrimination purposes. Due to its generalization capabilities, we used a multi-class support vector machine classifier to classify the seven basic emotions in the proposed model. The proposed model exhibited 98.14% recognition performance for the JaFFE database, 95.29% for the KDEF database, and 98.86% for the RaFD database. It is shown that the proposed method is effective for all three databases, compared with the previous schemes for JAFFE, KDEF, and RaFD databases.

SS-MASVM: An advanced technique for assessing failure probability of high-dimensional complex systems using the multi-class adaptive support vector machine

The integrity of structures in contemporary engineering practices is heavily influenced by inherent uncertainties, which necessitates the development of reliable structural reliability analysis methods for uncertainty quantification and probabilistic analysis. This paper investigates the integration of surrogate models and subset simulation (SS) to accurately compute the failure probabilities of high-dimensional complex systems. Focus is placed on enhancing the computational efficiency and accuracy through using the multi-class adaptive support vector machine (MASVM). The proposed SS-MASVM method incorporates more efficient learning functions, integrates K-means clustering, and employs SS technology for precise estimation of failure probabilities of high-dimensional complex systems. Numerical and engineering structural examples validate the effectiveness of the proposed method and highlight its potential in practical reliability analysis, and the results disclose that the SS-MASVM is efficient and accurate for assessing the complex system reliability.

Early pigment spot segmentation and classification from iris cellular image analysis with explainable deep learning and multiclass support vector machine.

Globally, retinal disorders impact thousands of individuals. Early diagnosis and treatment of these anomalies might halt their development and prevent many people from developing preventable blindness. Iris spot segmentation is critical due to acquiring iris cellular images that suffer from the off-angle iris, noise, and specular reflection. Most currently used iris segmentation techniques are based on edge data and noncellular images. The size of the pigment patches on the surface of the iris increases with eye syndrome. In addition, iris images taken in uncooperative settings frequently have negative noise, making it difficult to segment them precisely. The traditional diagnosis processes are costly and time consuming since they require highly qualified personnel and have strict environments. This paper presents an explainable deep learning model integrated with a multiclass support vector machine to analyze iris cellular images for early pigment spot segmentation and classification. Three benchmark datasets MILE, UPOL, and Eyes SUB were used in the experiments to test the proposed methodology. The experimental results are compared on standard metrics, demonstrating that the proposed model outperformed the methods reported in the literature regarding classification errors. Additionally, it is observed that the proposed parameters are highly effective in locating the micro pigment spots on the iris surfaces.

Using Generic Direct M-SVM Model Improved by Kohonen Map and Dempster–Shafer Theory to Enhance Power Transformers Diagnostic

Many power transformers throughout the world are nearing or have gone beyond their theoretical design life. Since these important assets represent approximately 60% of the cost of the substation, monitoring their condition is necessary. Condition monitoring helps in the decision to perform timely maintenance, to replace equipment or extend its life after evaluating if it is degraded. The challenge is to prolong its residual life as much as possible. Dissolved Gas Analysis (DGA) is a well-established strategy to warn of fault onset and to monitor the transformer’s status. This paper proposes a new intelligent system based on DGA; the aim being, on the one hand, to overcome the conventional method weaknesses; and, on the other hand, to improve the transformer diagnosis efficiency by using a four-step powerful artificial intelligence method. (1) Six descriptor sets were built and then improved by the proposed feature reduction approach. Indeed, these six sets are combined and presented to a Kohonen map (KSOM), to cluster the similar descriptors. An averaging process was then applied to the grouped data, to reduce feature dimensionality and to preserve the complete information. (2) For the first time, four direct Multiclass Support Vector Machines (M-SVM) were introduced on the Generic Model basis; each one received the KSOM outputs. (3) Dempster–Shafer fusion was applied to the nine membership probabilities returned by the four M-SVM, to improve the accuracy and to support decision making. (4) An output post-processing approach was suggested to overcome the contradictory evidence problem. The achieved AUROC and sensitivity average percentages of 98.78–95.19% (p-value < 0.001), respectively, highlight the remarkable proposed system performance, bringing a new insight to DGA analysis.

Wavelet Scattering Transform based Doppler signal classification

Normal blood supply to the human brain may be marred by the presence of a clot inside the blood vessels. This clot structure called emboli inhibits normal blood flow to the brain. It is considered as one of the main sources of stroke. Presence of emboli in human’s can be determined by the analysis of transcranial Doppler signal. Different signal processing and machine learning algorithms have been used for classifying the detected signal as an emboli, Doppler speckle, and an artifact. In this paper, we sought to make use of the wavelet transform based algorithm called Wavelet Scattering Transform, which is translation invariant and stable to deformations for classifying different Doppler signals. With its architectural resemblance to Convolutional Neural Network, Wavelet Scattering Transform works well on small datasets and subsequently was trained on a dataset consisting of 300 Doppler signals.To check the effectiveness of extracted Scattering transform based features for Doppler signal classification, learning algorithms that included multi-class Support vector machine, k-nearest neighbor and Naive Bayes algorithms were trained. Comparative analysis was done with respect to the handcrafted Continuous wavelet transform features extracted from samples and Wavelet scattering with Support vector machine achieved an accuracy of 98.89%. Also, with set of extracted scattering coefficients, Gaussian process regression was performed and a regression model was trained on three different sets of scattering coefficients with zero order scattering coefficients providing least prediction loss of 34.95%.

User’s Learning Capability Aware E-Content Recommendation System For Enhanced Learning Experience

E-learning is inevitable during these pandemic days and most of the learners find it comfortable to learn online. However, the main challenge is to locate the appropriate data in line with the learner’s requirement. Considering the necessity of this issue, this article presents an e-content recommendation system that considers the user’s learning capability. This work categorizes the documents into three categories such as basic, intermediate and advanced levels. Based on the users’ learning capability, corresponding documents are recommended and this idea enhances the overall learning experience. This work is based on three phases such as data pre-processing, feature extraction and classification. The collected documents are pre-processed for preparing the documents suitable for further processes. Features such as Parts-OF-Speech (POS) tagging, Term Frequency - Inverse Document Frequency (TF-IDF) and semantic similarity based on WordNet are extracted and the multiclass Support Vector Machine (SVM) is employed for distinguishing between the classes. The performance of the work is tested and the results prove the efficacy of the work with 98% accuracy rates, in contrast to the comparative techniques.

Multi-class nonparallel support vector machine

Multi-class nonparallel support vector machine

Circuit fault detection model using multiclass support vector machine

ABSTRACT Fault detection in a complex circuit is a tedious process, and it requires specialised manpower to detect and localise the faults. Manual detection is quite time consuming and might be wrong some times. Identification of faults automatically by analysing the circuit using transforms and machine learning algorithm is presented in this research work. A hardware model and a software model are developed to generate the test and train samples, and they are used in simulation analysis to detect the faults. A simple adiabatic adder using metal-oxide-semiconductor field-effect transistor is used in the hardware module, and multiple techniques like adaptive median filtering, Hilbert transform, geometric algebraic scale-invariant feature transform and multiclass support vector machine are used in the simulation model to detect the faults in the circuit. All the stages of simulation analysis results are presented to validate the performance of the proposed model. Normal and faulty conditions are accurately detected by the proposed model with maximum detection accuracy, which reduces the human efforts in designing and developing a circuit.

A Negative Emotion Recognition System with Internet of Things-Based Multimodal Biosignal Data

Previous studies to recognize negative emotions for mental healthcare have used heavy equipment directly attaching electroencephalogram (EEG) electrodes to the head, and they have proposed binary classification methods to identify negative emotions. To tackle this problem, we propose a negative emotion recognition system to collect multimodal biosignal data such as five EEG signals from an EEG headset and heart rate, galvanic skin response, and skin temperature from a smart band for classifying multiple negative emotions. This consists of an Android Internet of Things (IoT) application, a oneM2M-compliant IoT server, and a machine learning server. The Android IoT application uploads the biosignal data to the IoT server. By using the biosignal data stored in the IoT server, the machine learning server recognizes the negative emotions of disgust, fear, and sadness using a multiclass support vector machine (SVM) model with a radial basis function kernel. The experimental results demonstrate that the multimodal biosignal data approach achieves 93% accuracy. Moreover, when considering only data from the smart band, the system achieved 98% accuracy by optimizing the hyperparameters of the multiclass SVM model. Based on these results, we plan to develop a metaverse system that detects and expresses negative emotions in real time.

Multi-Class Support Vector Machine Classification for Detecting Alopecia Areata and Scalp Diseases

Alopecia Areata is a health condition marked by the absence of hair in specific regions, such as the scalp, face, and parts of the body. It occurs due to an autoimmune reaction where the body's immune system erroneously targets the hair follicles, leading to irregular hair loss patterns. It can affect people of all ages, genders, and ethnicities, and it is estimated to affect about 2% of the population worldwide. Timely identification and precise diagnosis of this condition are crucial in order to implement effective treatment strategies. The most common type of alopecia is alopecia areata (AA), which is typically detected and diagnosed using medical image processing models. In this study, we describe a unique method for image processing that incorporates a multiclass support vector machine classification approach. Our proposed methodology aims to attain accurate detection and categorization of a wide range of scalp issues, encompassing Alopecia Areata and other related conditions. The proposed approach entails capturing images of individuals with alopecia disease, enhancing the quality of the images through preprocessing techniques, and extracting distinctive features from scalp images using a range of image processing methods. Next, the extracted features are fed into a Multi-class SVM classifier, and a machine learning model is trained to achieve precise classification of the various conditions associated with alopecia areata. The evaluation of the proposed method using hair and scalp image databases demonstrates that the Multi-class SVM model achieves an accuracy of 89.3%, outperforming other models in terms of classification accuracy.

Hand gesture classification framework leveraging the entropy features from sEMG signals and VMD augmented multi-class SVM

To improve the classification accuracy of hand movements from sEMG signals, this paper puts forward a unified hand gesture classification framework which exploits the potentials of variational mode decomposition (VMD) and multi-class support vector machine (SVM). Acquiring the sEMG signals from 25 intact subjects for ten functional activities in real-time, we implement a non-recursive adaptive decomposition technique to sEMG signals and perform power spectral analysis to identify the dominant narrow-band intrinsic mode functions (IMFs) that contain prominent biomarkers. Subsequently, to compute the optimal feature vectors from a set of entropy measures, this work investigates the performance of two techniques namely minimum redundancy and maximum relevance (MRMR) technique and kernel principal component analysis (kPCA). After extracting the optimal set of entropy features, the proposed approach implements a multi-class SVM based on one-vs-one (OVO) strategy to classify the hand gestures. The performance of the multi-class SVM compared with those of the K-nearest neighbor (KNN) and naïve bayes (NB) classifiers highlight that multi-class SVM offers superior performance with an average classification accuracy of 99.98%. Moreover, for statistical analysis of the experimental results, this work performs Friedman test to analyze the significance of the SVM, KNN and NB classifier performances. Finally, the performance comparison of the proposed approach with those of the state-of-the-art techniques highlights the superiority of the proposed framework to improve the hand gesture classification accuracy.

An effective feature selection using improved marine predators algorithm for Alzheimer’s disease classification

<span lang="EN-US">Alzheimer’s disease (AD) is an irremediable neurodegenerative illness developed by the fast deterioration of brain cells. AD is mostly common in elder people and it extremely disturbs the physical and mental health of patients, therefore early detection is essential to prevent AD development. However, the precise detection of AD and mild cognitive impairment (MCI) is difficult during classification. In this paper, the Residual network i.e., ResNet-18 is used for extracting the features, and the proposed improved marine predators algorithm (IMPA) is developed for choosing the optimum features to perform an effective classification of AD. The multi-verse optimizer (MVO) used in the IMPA helps to balance exploration and exploitation, which leads to the selection of optimal relevant features. Further, the classification of AD is accomplished using the multiclass support vector machine (MSVM). Open access series of imaging studies-1 (OASIS-1) and Alzheimer disease neuroimaging initiative (ADNI) datasets are used to evaluate the IMPA-MSVM method. The performance of the IMPA-MSVM method is analyzed using accuracy, sensitivity, specificity, positive predictive value (PPV) and matthews correlation coefficient (MCC). The existing methods such as the <a name="_Hlk134426295"></a>deep learning-based segmenting method using SegNet (DLSS), mish activation function (MAF) with spatial transformer network (STN) and BrainNet2D are used to evaluate the IMPA-MSVM method. The accuracy of IMPA-MSVM for the ADNI dataset is 98.43% which is more when compared to the DLSS and MAF-STN.</span>

A Secure and Efficient Biometric Template Protection Scheme for Palmprint Recognition System

The accuracy and security of a biometric system are the two sides of a coin. A biometric system must be simple, flexible, efficient, and secure enough from unauthorized access. Concerning these requirements, this paper presents an enhanced palmprint recognition system with superior performance and improved biometric template protection schemes. This method comprises five components: image preprocessing, feature extraction, cancelable biometrics, classification, and Bio-cryptosystem. The palm texture region is extracted from the input hand image during preprocessing. A feature representation technique is then used to extract discriminant features from the palmprint texture patterns. The extracted features are then analyzed using an information coding scheme to compute a user-specific token. Here, the user-specific tokens along with the original palmprint features are used to calculate the feature vectors for the cancelable biometric system. A novel Bio-Cryptosystem has been proposed to protect templates with high security where there is no need to remember the users&#x2019; tokens. Cancelable feature vectors are kept online in encrypted form using the proposed Bio-Cryptosystem, which is used to identify or verify the subjects after decryption. The original feature vectors are kept offline to prevent these from external attacks and misuse. Finally, the multi-class linear support vector machine has been used for user classification. For experimental purposes, two benchmark hand image databases: BOSPHORUS and CASIA-Palmprint, are employed, and the proposed system has achieved nearly 100&#x0025; correct recognition rate in cancelable domain for both the employed databases. Finally, the performance comparison in terms of both verification and identification for the palmprint and the cancelable palmprint recognition systems with the existing state-of-the-art methods shows the superiority of the proposed system. <i>Impact Statement</i> &#x2014;We have improved the biometric template protection scheme by modifying the cancelable biometric technique with two security levels capable of protecting the biometric information from the dictionary, brute-force, database, channel, replay, and spoofing attacks. To avoid the difficulty of remembering long user passwords/tokens, an automatic key generation technique of user passwords has been proposed. Two different keys are generated: the first one used for cancelable biometrics and the second for encryption-decryption processes. Both these keys are not needed to store or remember and are helpful for a multi-factor authentication system. A novel Bio-cryptographic algorithm instead of traditional Bio-Cryptographic algorithms have been introduced within the proposed system. Several attacks and challenging issues of biometric recognition systems have been considered with maintaining outstanding performance in terms of accuracy and security.

Next-generation cyber attack prediction for IoT systems: leveraging multi-class SVM and optimized CHAID decision tree

Billions of gadgets are already online, making the IoT an essential aspect of daily life. However, the interconnected nature of IoT devices also leaves them open to cyber threats. The quantity and sophistication of cyber assaults aimed against Internet of Things (IoT) systems have skyrocketed in recent years. This paper proposes a next-generation cyber attack prediction framework for IoT systems. The framework uses the multi-class support vector machine (SVM) and the improved CHAID decision tree machine learning methods. IoT traffic is classified using a multi-class support vector machine to identify various types of attacks. The SVM model is then optimized with the help of the CHAID decision tree, which prioritizes the attributes most relevant to the categorization of attacks. The proposed framework was evaluated on a real-world dataset of IoT traffic. The findings demonstrate the framework's ability to categorize attacks accurately. The framework may determine which attributes are most crucial for attack categorization to enhance the SVM model's precision. The proposed technique focuses on network traffic characteristics that can be signs of cybersecurity threats on IoT networks and affected Network nodes. Selected feature vectors were also created utilizing the elements acquired on every IoT console. The evaluation results on the Multistep Cyber-Attack Dataset (MSCAD) show that the proposed CHAID decision tree can significantly predict the multi-stage cyber attack with 99.72% accuracy. Such accurate prediction is essential in managing cyber attacks in real-time communication. Because of its efficiency and scalability, the model may be used to forecast cyber attacks in real time, even in massive IoT installations. Because of its computing efficiency, it can make accurate predictions rapidly, allowing for prompt detection and action. By locating possible entry points for attacks and mitigating them, the framework helps strengthen the safety of IoT systems.

Electric powered wheelchair control using user-independent classification methods based on surface electromyography signals.

Wheelchairs are one of the most popular assistive technology (AT) among individuals with motor impairments due to their comfort and mobility. People with finger problems may find it difficult to operate wheelchairs using the conventional joystick control method. Therefore, in this research study, a hand gesture-based control method is developed for operating an electric-powered wheelchair (EPW). This study selected a comfort-based hand position to determine the stop maneuver. An additional exploration was undertaken to investigate four gesture recognition methods: linear regression (LR), regularized linear regression (RLR), decision tree (DT), and multi-class support vector machine (MC-SVM). The first two methods, LR and RLR, have promising accuracy values of 94.85% and 95.88%, respectively, but each new user must be trained. To overcome this limitation, this study explored two user-independent classification methods: MC-SVM and DT. These methods effectively addressed the finger dependency issue and demonstrated remarkable success in recognizing gestures across different users. MC-SVM has about 99.05% of both precision and accuracy, and the DT has about 97.77% accuracy and precision. All six participants were successful in controlling the EPW without any collisions. According to the experimental results, the proposed approach has high accuracy and can address finger dependency issues.

Fusing Local Shallow Features and Global Deep Features to Identify Beaks.

Cephalopods are an essential component of marine ecosystems, which are of great significance for the development of marine resources, ecological balance, and human food supply. At the same time, the preservation of cephalopod resources and the promotion of sustainable utilization also require attention. Many studies on the classification of cephalopods focus on the analysis of their beaks. In this study, we propose a feature fusion-based method for the identification of beaks, which uses the convolutional neural network (CNN) model as its basic architecture and a multi-class support vector machine (SVM) for classification. First, two local shallow features are extracted, namely the histogram of the orientation gradient (HOG) and the local binary pattern (LBP), and classified using SVM. Second, multiple CNN models were used for end-to-end learning to identify the beaks, and model performance was compared. Finally, the global deep features of beaks were extracted from the Resnet50 model, fused with the two local shallow features, and classified using SVM. The experimental results demonstrate that the feature fusion model can effectively fuse multiple features to recognize beaks and improve classification accuracy. Among them, the HOG+Resnet50 method has the highest accuracy in recognizing the upper and lower beaks, with 91.88% and 93.63%, respectively. Therefore, this new approach facilitated identification studies of cephalopod beaks.

Protein classification by autofluorescence spectral shape analysis using machine learning

Depending on the relative numbers and spatial arrangement of Tryptophan (Trp; W) and Tyrosine (Tyr; Y) residues, different proteins produce distinct autofluorescence (AF) spectral shapes when excited at ∼280 nm. Yet, considering the vast number and heterogeneous forms in nature, visual analysis and precise identification of proteins based on their AF spectra is challenging and further compounded in cases when different proteins produce substantially similar AF spectral shapes. There is, thus, a serious need to develop a methodology to address this problem. The current study proposes a practical technology to quickly identify proteins using machine learning (ML) algorithms based on their AF spectra. Specifically, AF spectra of fifteen different standard proteins of varying origin with distinct structural and Trp/Tyr compositions were recorded; based on the spectral features selected by the Minimum-Redundancy-Maximum-Relevance (mRMR) algorithm, a multiclass Support Vector Machine (SVM) learning model with Radial Basis Function (RBF), Polynomial, and Linear kernels classified the proteins with high accuracy of 99.06%, 99.03%, and 98.29% respectively. Since protein identification is the key to understand biological functions and disease diagnosis, the proposed methodology could offer a viable alternative to and improve the existing protein identification techniques.

Learning Framework for Compound Facial Emotion Recognition

Background:Facial emotion recognition (FER) is a vital research area in machine vision and artificial intelligence due to its application in academics and industry. Although FER can primarily be conducted using multiple sensors, research shows that using facial images/videos to recognize facial expressions is a better way to convey emotions because visual expressions carry essential information.Objective:This paper focuses on implementing learning frameworks that combine machine learning and deep learning for detecting 50 classes of compound emotions using the iCV Multi- Emotion Facial Expression Dataset (iCV-MEFED).Methods:In the proposed methodology, we used a deep learning Inception v3 CNN-based model to extract features for each image, and a Multi-Class Support Vector Machine (mSVM) classifier was used to detect the corresponding 50 classes of basic and compound emotions.Results:The proposed learning framework for the iCV-MEFED dataset has an accuracy of 26%, outperforming the state-of-the-art results.Conclusion:Moreover, the results got are compared with competition results in terms of misclassification results, which shows our methodology gives the best result of 74.00%.

Research on Mental Workload of Deep-Sea Oceanauts Driving Operation Tasks from EEG Data.

A person's present mental state is closely associated with the frequency and temporal domain features of spontaneous electroencephalogram (EEG) impulses, which directly reflect neurophysiological signals of brain activity. EEG signals are employed in this study to measure the mental workload of drivers while they are operating a vehicle. A technique based on the quantum genetic algorithm (QGA) is suggested for improving the kernel function parameters of the multi-class support vector machine (MSVM). The performance of the algorithm based on the quantum genetic algorithm is found to be superior to that of other ways when other methods and the quantum genetic algorithm are evaluated for the parameter optimization of kernel function via simulation. A multi-classification support vector machine based on the quantum genetic algorithm (QGA-MSVM) is applied to identify the mental workload of oceanauts through the collection and feature extraction of EEG signals during driving simulation operation experiments in a sea basin area, a seamount area, and a hydrothermal area. Even with a limited data set, QGA-MSVM is able to accurately identify the cognitive burden experienced by ocean sailors, with an overall accuracy of 91.8%.