Parameter Selection Of Support Vector Machine Research Articles

A MENTAL ILLNESS EARLY WARNING ANALYSIS MODEL USING AN IMPROVED SVM ALGORITHM AND EEG SIGNALS

The fast-paced lifestyle, intense competition, and constantly changing environment of modern society are important factors contributing to the emergence of psychological disorders. Factors such as work pressure, family conflicts, and interpersonal relationship difficulties pose challenges to individual mental health. Prolonged use of electronic devices and the widespread use of social media further exacerbate mental health issues, as the constant influx of information makes it difficult for people to relax and focus. The harm of psychological disorders to individuals and society cannot be ignored. It not only diminishes the quality of life for patients but also affects work efficiency and social participation. In extreme cases, psychological disorders can lead to serious consequences like suicide, causing immense pain to families and society. Therefore, prioritizing mental health, raising awareness of mental well-being, and timely intervention and treatment of psychological disorders are crucial for individual happiness and social stability. Based on this, this study employs an improved Support Vector Machine (SVM) and Electroencephalogram (EEG) signals for the diagnosis of psychological disorders, aiming for more effective treatment of mental health conditions. Specifically, the EEG signals of the experimental subjects are first collected as training data for the model. The dataset undergoes preprocessing operations such as cleaning and normalization. Due to the limited availability of published information about individuals with psychological disorders, an ensemble SVM algorithm is used as a warning model to improve the accuracy of psychological disorder diagnosis. This algorithm utilizes a differential measurement method to adjust the selection of SVM parameters. The training sample size remains constant, with several iterations of training performed. By combining the differential measurement method, a specific parameter combination is obtained, maximizing the differentiation between base classifiers. This ultimately addresses issues such as small sample size and insufficient sample information in the dataset. Experimental results demonstrate that the model used in this study exhibits good performance in diagnosing psychological disorders.

A multi-strategy improved snake optimizer and its application to SVM parameter selection

<p>Support vector machine (SVM) is an effective classification tool and maturely used in various fields. However, its performance is very sensitive to parameters. As a newly proposed swarm intelligence algorithm, snake optimizer algorithm (SO) can help to solve the parameter selection problem. Nevertheless, SO has the shortcomings of weak population initialization, slow convergence speed in the early stage, and being easy to fall into local optimization. To address these problems, an improved snake optimizer algorithm (ISO) was proposed. The mirror opposition-based learning mechanism (MOBL) improved the population quality to enhance the optimization speed. The novel evolutionary population dynamics model (NEPD) was beneficial for searching accurately. The differential evolution strategy (DES) helped to reduce the probability of falling into local optimal value. The experimental results of classical benchmark functions and CEC2022 showed that ISO had higher optimization precision and faster convergence rate. In addition, it was also applied to the parameter selection of SVM to demonstrate the effectiveness of the proposed ISO.</p>

Real-time Face-based Gender Identification System Using Pelican Support Vector Machine

Gender identification from video is an emerging research field that aims to automatically classify the gender of individuals based on video data. Due to the numerous applications for this task, it has received a lot of attention, including surveillance, human-computer interaction, and targeted marketing. In this study, we propose a gender identification system that utilizes the Pelican optimizer algorithm in combination with a Support Vector Machine (SVM) classifier. The Pelican optimizer is a metaheuristic algorithm inspired by the hunting behaviour of pelicans and has shown promising results in solving optimization problems. Pelican optimizer algorithm (POA) is applied to optimize the SVM parameter selection process such as kernel function. The POA algorithm searches for an optimal subset of parameters that maximizes the classification performance of the SVM model after the application of preprocessing and feature extraction techniques such as Local Binary Pattern (LBP). Finally, the selected optimized parameters otherwise known as POA-SVM classifier learns a decision boundary based on the labeled training data. The POA-SVM model is trained to distinguish between male and female samples and generalize the classification to unseen video data. Experimental evaluations are conducted using a benchmark dataset consisting of video samples with labelled gender information. The effectiveness of the suggested system is contrasted with other cutting-edge gender identification techniques. The results demonstrate the effectiveness of the Pelican Optimization Algorithm-SVM system, showing improved accuracy of 95%, and sensitivity of 94.4% at a faster recognition rate in gender classification from video data.

DEVELOPMENT OF HEALTH INSURANCE CLAIM PREDICTION METHOD BASED ON SUPPORT VECTOR MACHINE AND BAT ALGORITHM

Health insurance industry is very much needed by the community in handling the financial risks in the health sector. The number of claims greatly affects the achievement of profits and the sustainability of the health insurance industry. Therefore, filing claims by insurance users from year to year is important to be predicted in insurance firm. The Machine Learning (ML) method promises to be a good solution for predicting health insurance claims compared to conventional data analytics methods. Support Vector Machine (SVM) is one of the superior ML approaches. Nonetheless, SVM performance is controlled by the suitable selection of SVM parameters. The SVM parameters is typically selected by trial and error, sometimes resulting in not optimal performance and taking a long time to complete. Swarm intelligence-based algorithms can be used to select the best parameters from SVM. This method is capable of locating the global best solution, is simple to implemented, and doesn't involve derivatives. One of the best swarm intelligence algorithms is the Bat Algorithm (BA). BA has a faster convergence rate than other algorithms, for example Particle Swarm Optimization (PSO). Based on this situation, this paper offers the new classification model for predicting health insurance claim based on SVM and BA. The metrics utilized for evaluation are accuracy, recall, precision, f1-score, and computing time. The experimental outcomes show that the proposed approach is superior to the conventional SVM and the hybrid of SVM and PSO in forecasting health insurance claims. In addition, the proposed method has a substantially shorter computing time than the hybrid of SVM and PSO. The outcomes of the experiments also indicate that the new classification model for predicting health insurance claim based on the SVM and BA can avoid over-fitting condition.

HEALTH CLAIM INSURANCE PREDICTION USING SUPPORT VECTOR MACHINE WITH PARTICLE SWARM OPTIMIZATION

The number of claims plays an important role the profit achievement of health insurance companies. Prediction of the number of claims could give the significant implications in the profit margins generated by the health insurance company. Therefore, the prediction of claim submission by insurance users in that year needs to be done by insurance companies. Machine learning methods promise the great solution for claim prediction of the health insurance users. There are several machine learning methods that can be used for claim prediction, such as the Naïve Bayes method, Decision Tree (DT), Artificial Neural Networks (ANN) and Support Vector Machine (SVM). The previous studies show that the SVM has some advantages over the other methods. However, the performance of the SVM is determined by some parameters. Parameter selection of SVM is normally done by trial and error so that the performance is less than optimal. Some optimization algorithms based heuristic optimization can be used to determine the best parameter values of SVM, for example Particle Swarm Optimization (PSO) and Genetic Algorithm (GA). They are able to search the global optimum, easy to be implemented. The derivatives aren’t needed in its computation. Several researches show that PSO give the better solutions if it is compared with GA. All particles in the PSO are able to find the solution near global optimal. For these reasons, this article proposes the health claim insurance prediction using SVM with PSO. The experimental results show that the SVM with PSO gives the great performance in the health claim insurance prediction and it has been proven that the SVM with PSO give better performance than the SVM standard.

Evaluation Model of College English Teaching Effect Based on Particle Swarm Algorithm and Support Vector Machine

Based on the principle of particle swarm algorithm and support vector machine, this article aims to improve the classification performance of college English teaching effect and explores the best support vector machine parameter optimization algorithm to promote college English teaching for the theory and application research of data analysis. First, the advantages and disadvantages of common support vector machine parameter selection methods such as grid search algorithm, gradient descent method, and swarm intelligence algorithm are studied. Secondly, this article has a detailed analysis and comparison of various other algorithms. Finally, the study analyzed the advantages and disadvantages of the quantum particle swarm algorithm, introduced the dual-center idea into the quantum particle swarm algorithm, and proposed an improved quantum particle swarm algorithm. Through simulation experiments, it is proved that the improved quantum particle swarm algorithm is more superior in optimizing the parameters of support vector machine. In general, this paper uses the PSO algorithm to simultaneously solve the SVM feature selection and parameter optimization problems and has achieved good results. Within the scope of the literature that the author has, there is still a lack of work in this area. Compared with the existing algorithms, the algorithm proposed in this paper has stronger feature selection ability and higher efficiency.

Binary classification of rainfall time-series using machine learning algorithms

Summer monsoon rainfall contributes more than 75% of the annual rainfall in India. For the state of Maharashtra, India, this is more than 80% for almost all regions of the state. The high variability of rainfall during this period necessitates the classification of rainy and non-rainy days. While there are various approaches to rainfall classification, this paper proposes rainfall classification based on weather variables. This paper explores the use of support vector machine (SVM) and artificial neural network (ANN) algorithms for the binary classification of summer monsoon rainfall using common weather variables such as relative humidity, temperature, pressure. The daily data, for the summer monsoon months, for nineteen years, was collected for the Shivajinagar station of Pune in the state of Maharashtra, India. Classification accuracy of 82.1 and 82.8%, respectively, was achieved with SVM and ANN algorithms, for an imbalanced dataset. While performance parameters such as misclassification rate, F1 score indicate that better results were achieved with ANN, model parameter selection for SVM was less involved than ANN. Domain adaptation technique was used for rainfall classification at the other two stations of Maharashtra with the network trained for the Shivajinagar station. Satisfactory results for these two stations were obtained only after changing the training method for SVM and ANN.

A Cutting Pattern Recognition Method for Shearers Based on ICEEMDAN and Improved Grey Wolf Optimizer Algorithm-Optimized SVM

When the shearer is cutting, the sound signal generated by the cutting drum crushing coal and rock contains a wealth of cutting status information. In order to effectively process the shearer cutting sound signal and accurately identify the cutting mode, this paper proposed a shearer cutting sound signal recognition method based on an improved complete ensemble empirical mode decomposition with adaptive noise (ICCEMDAN) and an improved grey wolf optimizer (IGWO) algorithm-optimized support vector machine (SVM). First, the approach applied ICEEMDAN to process the cutting sound signal and obtained several intrinsic mode function (IMF) components. It used the correlation coefficient to select the characteristic component. Meanwhile, this paper calculated the composite multi-scale permutation entropy (CMPE) of the characteristic components as the eigenvalue. Then, the method introduced a differential evolution algorithm and nonlinear convergence factor to improve the GWO algorithm. It used the improved GWO algorithm to realize the adaptive selection of SVM parameters and established a cutting sound signal recognition model. According to the proportioning plan, the paper made several simulation coal walls for cutting experiments and collected cutting sound signals for cutting pattern recognition. The experimental results show that the method proposed in this paper can effectively process the cutting sound signal of the shearer, and the average accuracy of the cutting pattern recognition model reached 97.67%.

Research on Pipeline Defect Classification Based on SVM

The defect identification and evaluation of buried steel pipeline is a long-term challenge in the field of pipeline detection, and the prerequisite for efficient identification of defects is the accurate extraction of pipeline damage signals. Aiming at the characteristics of buried pipeline defect signals, a method of pipeline defect signal extraction and recognition is proposed, which is based on support vector machine (SVM). A dictionary is obtained by learning from the original signal, the dictionary is used to construct a sparse model of the defect signal using a regularized orthogonal matching pursuit algorithm, and the feature vector of the signal is obtained according to the compressed sensing theory. Furthermore, multi-classification SVM is used to establish a mapping relationship between the feature vector of the defect signal and the actual defect type of the pipeline, and Genetic Algorithm-Particle Swarm Optimization is used to guide the selection of SVM parameters. The results showed that the proposed classification method can realize the accurate division of the damage degree of pipeline defects.

Application Analysis of Artificial Intelligence in Library Network Security

In the information age, the rapid development of computer network technology and artificial intelligence technology has created conditions for the development of traditional libraries to digital libraries. While computer network technology and artificial intelligence technology continue to promote the development of digital libraries, library network security issues also arise. The purpose of this paper is to explore the application analysis of artificial intelligence technology in library network security. This article puts forward the problem of library network system security, describes the concept and characteristics of library network system security, and aims at the basic factors affecting the security of digital library network system, constructs artificial intelligence-based books from the perspective of management and technology Preventive mechanism for library network system security. In terms of situation prediction, this article uses artificial intelligence technology and analytic hierarchy process to evaluate the network security situation. This method can quickly extract parameters and can quickly evaluate the current network, thereby improving the real-time performance of the situation assessment. The optimized support vector machine method overcomes the subjectivity of support vector machine parameter selection, thereby improving the prediction accuracy of the network security situation. The simulation experiment verifies that the optimized support vector machine prediction model has a higher value for the network security situation. Forecast accuracy. Experimental research shows that the PSO-SVR prediction model used in this article can predict the future situation value relatively closely, help library management network administrators analyze the future network situation, and prompt library management network administrators to adjust defense strategies in time based on threat assessment to maintain library management network Safe and healthy operation.

Fault Diagnosis of Wind Turbines Based on a Support Vector Machine Optimized by the Sparrow Search Algorithm

Fault diagnosis technology is key to the safe and stable operation of wind turbines. An effective fault diagnosis technology for wind turbines can quickly identify fault types to reduce the operation and maintenance costs of wind farms and improve power generation efficiency. Currently, most wind farms obtain operation and maintenance data via supervisory control and data acquisition (SCADA) systems, which contain rich information related to the operation characteristics of wind turbines. However, few SCADA systems provide fault diagnosis functionality. Support vector machines (SVMs) are a popular intelligence method in the fault diagnosis of wind turbines. SVM parameter selection is key for accurate model classification. The sparrow search algorithm (SSA) is a novel and highly efficient optimization method used to optimize the penalty factor and kernel function parameter of SVM in this paper and to construct the SSA-SVM wind turbine fault diagnosis model. Data are acquired from a wind farm SCADA system and form a faulting set after preprocessing and feature selection. Experiments show that the SSA-SVM diagnostic model effectively improves the accuracy of wind turbine fault diagnosis compared with the GS-SVM, GA-SVM and PSO-SVM models and has fast convergence speed and strong optimization ability. Moreover, the SSA-SVM diagnostic model can be used to diagnose faults in practical engineering applications.

Parameter selection of Gaussian kernel SVM based on local density of training set

Support vector machine (SVM) is regarded as one of the most effective techniques for supervised learning, while the Gaussian kernel SVM is widely utilized due to its excellent performance capabilities. To ensure high performance of models, hyperparameters, i.e. kernel width and penalty factor must be determined appropriately. This paper studies the influence of hyperparameters on the Gaussian kernel SVM when such hyperparameters attain an extreme value (0 or ∞). In order to improve computing efficiency, a parameter optimization method based on the local density and accuracy of Leave-One-Out (LOO) method are proposed. Kernel width of each sample is determined based on the local density needed to ensure a higher separability in feature space while the penalty parameter is determined by an improved grid search using the LOO method. A comparison with grid method is conducted to verify validity of the proposed method. The classification accuracy of five real-life datasets from UCI database are 0.9733, 0.9933, 0.7270, 0.6101 and 0.8867, which is slightly superior to the grid method. The results also demonstrate that this proposed method is computationally cheaper by 1 order of magnitude when compared to the grid method.

Privacy-Preserving Outsourced Support Vector Machine Design for Secure Drug Discovery

In this paper, we propose a framework for privacy-preserving outsourced drug discovery in the cloud, which we refer to as POD. Specifically, POD is designed to allow the cloud to securely use multiple drug formula providers’ drug formulas to train Support Vector Machine (SVM) provided by the analytical model provider. In our approach, we design secure computation protocols to allow the cloud server to perform commonly used integer and fraction computations. To securely train the SVM, we design a secure SVM parameter selection protocol to select two SVM parameters and construct a secure sequential minimal optimization protocol to privately refresh both selected SVM parameters. The trained SVM classifier can be used to determine whether a drug chemical compound is active or not in a privacy-preserving way. Lastly, we prove that the proposed POD achieves the goal of SVM training and chemical compound classification without privacy leakage to unauthorized parties, as well as demonstrating its utility and efficiency using three real-world drug datasets.

Genetic algorithm-based parameter optimization for EO-1 Hyperion remote sensing image classification

ABSTRACT Because hyperspectral remote sensing images have high band dimension and limited training samples, it is hard to achieve acceptable classification results using conventional statistical pattern recognition methods. Nevertheless, support vector machine (SVM) is suitable for hyperspectral image classification owing to its good generalization ability and minimal structural risk. Aimed to address the problems of large subjectivity, excessive time consumption, and low optimization accuracy in traditional SVM parameter selection, we applied genetic algorithm to optimize the model parameters. Using EO-1 Hyperion data as an example, an SVM object classification algorithm was proposed based on genetic algorithm optimization. To determine the effectiveness and superiority of this algorithm, a comprehensive evaluation and comparative analysis were performed with the classification effects of the cross-validation and maximum likelihood methods, respectively. Experimental results demonstrated that the proposed algorithm can effectively avert the aimlessness of artificial parameter selection and automatically optimize the SVM model parameters. It achieved relatively high overall classification accuracy (91.23%), which was 16.42% and 4.48% higher than the maximum likelihood method and cross-validation method, respectively.

The choice of methods for the construction of PCA-based features and the selection of SVM parameters for person identification by gait

The paper presents the results of the continued research of the principal component analysis (PCA) and support vector machine (SVM) techniques for person identification by gait. The experimental studies performed using the CASIA GAIT dataset allowed us to compare two methods of work with input data for PCA. According to the results of experiments, the optimal method of forming the feature space and the most effective parameters of the SVM-classifier were selected. The classification of video sequences recorded by video cameras located frontally, at an angle and orthogonal to the direction of objects movement was carried out.

Combination of condition monitoring and prognosis systems based on current measurement and PSO-LS-SVM method for wind turbine DFIGs with rotor electrical asymmetry

An important and strategic instrument in energy market is wind turbine (WT). WT consists of many components, whose operation and maintenance of them are very sensitive due to their unstable dynamic and environmental conditions. Condition monitoring (CM) and fault prognosis approaches are typical methods in order to decrease the production cost of energy and WT downtime. In this paper, a new combinatory system of CM and fault prognosis based on feature extraction and prediction algorithm is proposed. Firstly, 3 phase current signals are collected. In the next step, proper features selection is done in time and frequency domain. The CM operation is based on a feature amplitude value crossing of an alarm threshold. The fault prognosis is conducted with improved support vector machine (SVM) method. The least squares (LS) type of SVM method is used for fault prediction and particle swarm optimization (PSO) is used for the optimum selection of SVM and kernel parameters. When the trend of fault symptom crosses through the specific alarm threshold, the prognostics unit is activated and remaining useful life (RUL) prediction is performed using PSO-LSSVM. For a scenario of the fault, generator rotor winding failure based on rotor electrical asymmetry is created with different percentages in the doubly-fed induction generator. The effectiveness of the proposed prognosis structure is evaluated using a WT simulation setup. For this setup, a 2.5 Mw WT experimental data and equipment parameters are used. The statistical investigations show the precision of PSO-LSSVM in RUL prediction. The different simulations confirm that improved condition-based maintenance performances can be obtained.

A memetic algorithm using emperor penguin and social engineering optimization for medical data classification

Gene selection and classification of microarray data play an important role in cancer diagnosis and treatment. One of the most popular and faster classification model is support vector machine (SVM). However, the major challenge in SVM lies in the selection of its two parameters, namely, regularization parameter C and kernel parameter γ. Attempts have been made to improve the performance of SVM by tuning these two parameters with the help of metaheuristics. Although existing metaheuristics can search the promising regions of the search space, they are unable to explore the global optimum efficiently. In this paper, a memetic algorithm-based SVM (M-SVM) is presented for simultaneous feature selection and optimization of SVM parameters. The memetic algorithm is a fusion of local search strategy using social engineering optimizer (SEO) and global optimization framework using emperor penguin optimizer (EPO). The idea of embedding SEO in EPO is to enhance the exploitation capability of EPO. The performance of our algorithm is evaluated on seven standard benchmark datasets. To prove the efficacy of the method, it is compared with particle swarm optimization based SVM (PSO-SVM), genetic algorithm based SVM (GA-SVM), and fifteen other state-of-the-art methods. The experimental results confirm that the proposed method significantly outperforms other existing techniques in terms of accuracy and number of selected genes. The proposed method is validated using a statistical analysis, namely, ANOVA.

Generalization of Parameter Selection of SVM and LS-SVM for Regression

A Support Vector Machine (SVM) for regression is a popular machine learning model that aims to solve nonlinear function approximation problems wherein explicit model equations are difficult to formulate. The performance of an SVM depends largely on the selection of its parameters. Choosing between an SVM that solves an optimization problem with inequality constrains and one that solves the least square of errors (LS-SVM) adds to the complexity. Various methods have been proposed for tuning parameters, but no article puts the SVM and LS-SVM side by side to discuss the issue using a large dataset from the real world, which could be problematic for existing parameter tuning methods. We investigated both the SVM and LS-SVM with an artificial dataset and a dataset of more than 200,000 points used for the reconstruction of the global surface ocean CO2 concentration. The results reveal that: (1) the two models are most sensitive to the parameter of the kernel function, which lies in a narrow range for scaled input data; (2) the optimal values of other parameters do not change much for different datasets; and (3) the LS-SVM performs better than the SVM in general. The LS-SVM is recommended, as it has less parameters to be tuned and yields a smaller bias. Nevertheless, the SVM has advantages of consuming less computer resources and taking less time to train. The results suggest initial parameter guesses for using the models.

Dynamic measurement errors prediction for sensors based on firefly algorithm optimize support vector machine

The accuracy of dynamic measurement error predicting has the great significant influence on the precision and stability of the sensors. In order to solve the problem of the low accuracy of the model in traditional dynamic measurement error prediction, support vector machine (SVM) is applied to predicting the dynamic measurement error of sensors. However, in prediction tasks, a proper set of design parameters are essential for the performance and efficiency of SVM model. Hence, parameters selection for SVM by firefly algorithm (FA) is proposed in this study to avoid the local minimum value which occurs in the traditional method of parameter optimization. Two sensors of dynamic measurement error data are considered for modeling. Root mean squared error (RMSE) and mean absolute percentage error (MAPE) are employed to evaluate the performances of the models. These results are also compared with the results obtained from the grid search SVM (GS-SVM)and the particle swarm optimization SVM (PSO-SVM). Experimental results show that the model of SVM based on FA algorithm predicts more accurately and effectively on dynamic measurement errors prediction for sensors than the other models.

A support vector regression-firefly algorithm-based model for limiting velocity prediction in sewer pipes.

Sediment transport without deposition is an essential consideration in the optimum design of sewer pipes. In this study, a novel method based on a combination of support vector regression (SVR) and the firefly algorithm (FFA) is proposed to predict the minimum velocity required to avoid sediment settling in pipe channels, which is expressed as the densimetric Froude number (Fr). The efficiency of support vector machine (SVM) models depends on the suitable selection of SVM parameters. In this particular study, FFA is used by determining these SVM parameters. The actual effective parameters on Fr calculation are generally identified by employing dimensional analysis. The different dimensionless variables along with the models are introduced. The best performance is attributed to the model that employs the sediment volumetric concentration (C(V)), ratio of relative median diameter of particles to hydraulic radius (d/R), dimensionless particle number (D(gr)) and overall sediment friction factor (λ(s)) parameters to estimate Fr. The performance of the SVR-FFA model is compared with genetic programming, artificial neural network and existing regression-based equations. The results indicate the superior performance of SVR-FFA (mean absolute percentage error = 2.123%; root mean square error =0.116) compared with other methods.