Particle Swarm Optimization Support Vector Machine Research Articles

Firefly-SVM predictive model for breast cancer subgroup classification with clinicopathological parameters.

Breast cancer is a highly predominant destructive disease among women characterised with varied tumour biology, molecular subgroups and diverse clinicopathological specifications. The potentiality of machine learning to transform complex medical data into meaningful knowledge has led to its application in breast cancer detection and prognostic evaluation. The emergence of data-driven diagnostic model for assisting clinicians in diagnostic decision making has gained an increasing curiosity in breast cancer identification and analysis. This motivated us to develop a breast cancer data-driven model for subtype classification more accurately. In this article, we proposed a firefly-support vector machine (SVM) breast cancer predictive model that uses clinicopathological and demographic data gathered from various tertiary care cancer hospitals or oncological centres to distinguish between patients with triple-negative breast cancer (TNBC) and non-triple-negative breast cancer (non-TNBC). The results of the firefly-support vector machine (firefly-SVM) predictive model were distinguished from the traditional grid search-support vector machine (Grid-SVM) model, particle swarm optimisation-support vector machine (PSO-SVM) and genetic algorithm-support vector machine (GA-SVM) hybrid models through hyperparameter tuning. The findings show that the recommended firefly-SVM classification model outperformed other existing models in terms of prediction accuracy (93.4%, 86.6%, 69.6%) for automated SVM parameter selection. The effectiveness of the prediction model was also evaluated using well-known metrics, such as the F1-score, mean square error, area under the ROC curve, logarithmic loss and precision-recall curve. Firefly-SVM predictive model may be treated as an alternate tool for breast cancer subgroup classification that would benefit the clinicians for managing the patient with proper treatment and diagnostic outcome.

DPP IV Inhibitors Activities Prediction as An Anti-Diabetic Agent using Particle Swarm Optimization-Support Vector Machine Method

Diabetes mellitus is a chronic illness that can affect anyone, while the medicine that can entirely cure diabetes has not been discovered yet. Dipeptidyl Peptidase IV (DPP IV) inhibitor is one of the agents with potency as an anti-diabetic treatment. In this work, we utilized the machine learning method to predict the activity of DPP IV as an anti-diabetic agent. We combined Particle Swarm Optimization (PSO) method for features selection and the Support Vector Machine (SVM) for the prediction model. Three SVM kernels, i.e., radial basis function (RBF), polynomial, and linear, were utilized, and their performance was compared. A Hyperparameter tuning procedure was conducted to improve the performance of models. According to the results, we found that the best model obtained from SVM with RBF kernel with the value R2 of train and test set are 0.79 and 0.85, respectively.

Classification of Finger Movements Using EMG Signals with PSO SVM Algorithm

Electromyography (EMG) is a signal produced by human muscles when they contract or relax. This signal is widely used as a controller, for example, to control a robotic arm. This study aims to identify the pattern of finger movement in the form of finger movement using a bracelet-shaped device that has eight EMG sensors. This tool is placed on the lower right hand of a subject to get a signal from the EMG. This study uses the support vector machine (SVM) algorithm combined with the particle swarm optimization (PSO) method. For pattern recognition, the properties of the signal in the time domain are used. From this system, the success of pattern recognition is between 68% to 86%.

Classification of Finger Movements Using EMG Signals with PSO SVM Algorithm

Electromyography (EMG) is a signal produced by human muscles when they contract or relax. This signal is widely used as a controller, for example, to control a robotic arm. This study aims to identify the pattern of finger movement in the form of finger movement using a bracelet-shaped device that has eight EMG sensors. This tool is placed on the lower right hand of a subject to get a signal from the EMG. This study uses the support vector machine (SVM) algorithm combined with the particle swarm optimization (PSO) method. For pattern recognition, the properties of the signal in the time domain are used. From this system, the success of pattern recognition is between 68% to 86%.

Physiological Status Prediction Based on a Novel Hybrid Intelligent Scheme.

Physiological status plays an important role in clinical diagnosis. However, the temporal physiological data change dynamically with time, and the amount of data is large; furthermore, obtaining a complete history of data has become difficult. We propose a hybrid intelligent scheme for physiological status prediction, which can be effectively utilized to predict the physiological status of patients and provide a reference for clinical diagnosis. Our proposed scheme initially extracted the attribute information of nonlinear dynamic changes in physiological signals. The maximum discriminant feature subset was selected by employing conditional relevance mutual information feature selection. An optimal subset of features was fed into the particle swarm optimization-support vector machine classifier to perform classification. For the prediction task, the proposed hybrid intelligent scheme was tested on the Sleep Heart Health Study dataset for sleep status prediction. Experimental results demonstrate that our proposed intelligent scheme outperforms the conventional machine learning classification methods.

Micro-Expression Recognition by Using CNN Features with PSO Algorithm and SVM Methods

This study proposes a framework for defining ME expressions, in which preprocessing, feature extraction with deep learning, feature selection with an optimization algorithm, and classification methods are used. CASME-II, SMIC-HS, and SAMM, which are among the most used ME datasets in the literature, were combined to overcome the under-sampling problem caused by the datasets. In the preprocessing stage, onset, and apex frames in each video clip in datasets were detected, and optical flow images were obtained from the frames using the FarneBack method. The features of these obtained images were extracted by applying AlexNet, VGG16, MobilenetV2, EfficientNet, Squeezenet from CNN models. Then, combining the image features obtained from all CNN models. And then, the ones which are the most distinctive features were selected with the Particle Swarm Optimization (PSO) algorithm. The new feature set obtained was divided into classes positive, negative, and surprise using SVM. As a result, its success has been demonstrated with an accuracy rate of 0.8784 obtained in our proposed ME framework.

Improved VMD-ELM Algorithm for MEMS Gyroscope of Temperature Compensation Model Based on CNN-LSTM and PSO-SVM.

The micro-electro-mechanical system (MEMS) gyroscope is a micro-mechanical gyroscope with low cost, small volume, and good reliability. The working principle of the MEMS gyroscope, which is achieved through Coriolis, is different from traditional gyroscopes. The MEMS gyroscope has been widely used in the fields of micro-inertia navigation systems, military, automotive, consumer electronics, mobile applications, robots, industrial, medical, and other fields in micro-inertia navigation systems because of its advantages of small volume, good performance, and low price. The material characteristics of the MEMS gyroscope is very significant for its data output, and the temperature determines its accuracy and limits its further application. In order to eliminate the effect of temperature, the MEMS gyroscope needs to be compensated to improve its accuracy. This study proposed an improved variational modal decomposition-extreme learning machine (VMD-ELM) algorithm based on convolutional neural networks-long short-term memory (CNN-LSTM) and particle swarm optimization-support vector machines (PSO-SVM). By establishing a temperature compensation model, the gyro temperature output signal is optimized and reconstructed, and the gyro output signal with better accuracy is obtained. The VMD algorithm separates the gyro output signal and divides the gyro output signal into low-frequency signals, mid-frequency signals, and high-frequency signals according to the different signal frequencies. Once again, the PSO-SVM model is constructed by the mid-frequency temperature signal to find the temperature error. Finally, the signal is reconstructed through the ELM neural network algorithm, and then, the gyro output signal after noise is obtained. Experimental results show that, by using the improved method, the output of the MEMS gyroscope ranging from -40 to 60 °C reduced, and the temperature drift dramatically declined. For example, the factor of quantization noise (Q) reduced from 1.2419 × 10-4 to 1.0533 × 10-6, the factor of bias instability (B) reduced from 0.0087 to 1.8772 × 10-4, and the factor of random walk of angular velocity (N) reduced from 2.0978 × 10-5 to 1.4985 × 10-6. Furthermore, the output of the MEMS gyroscope ranging from 60 to -40 °C reduced. The factor of Q reduced from 2.9808 × 10-4 to 2.4430 × 10-6, the factor of B reduced from 0.0145 to 7.2426 × 10-4, and the factor of N reduced from 4.5072 × 10-5 to 1.0523 × 10-5. The improved algorithm can be adopted to denoise the output signal of the MEMS gyroscope to improve its accuracy.

Feasibility Study of the GST-SVD in Extracting the Fault Feature of Rolling Bearing under Variable Conditions

Feature information extraction is one of the key steps in prognostics and health management of rotating machinery. In the present study, an investigation about the feasibility of a methodology based on generalized S transform (GST) and singular value decomposition (SVD) methods for feature extraction in rolling bearing, due to local damage under variable conditions, is conducted. The technique adopts the GST method, following the time-frequency analysis, to transform a raw fault signal of the rolling bearing into a two-dimensional complex matrix. And then, the SVD method is performed to decompose the matrix to obtain the feature vectors. By this procedure it is possible to obtain the fault feature information of rolling bearing under different speeds and different loads. In order to streamline the feature parameters of the feature vectors to train more uncomplicated models, the principal component analysis (PCA) subsequently performed. The particle swarm optimization-support vector machine (PSO-SVM) model is used to identify and classify the different fault states of rolling bearing. Furthermore, in order to highlight the superiority of the proposed method some comparisons are conducted with the conventional methods. The obtained results show that the proposed method can effectively extract fault features of the rolling bearing under variable conditions.

Risk Assessment of Deep Coal and Gas Outbursts Based on IQPSO-SVM.

Coal and gas outbursts seriously threaten the mining safety of deep coal mines. The evaluation of the risk grade of these events can effectively prevent the occurrence of safety accidents in deep coal mines. Characterized as a high-dimensional, nonlinear, and small-sample problem, a risk evaluation method for deep coal and gas outbursts based on an improved quantum particle swarm optimization support vector machine (IQPSO-SVM) was constructed by leveraging the unique advantages of a support vector machine (SVM) in solving small-sample, high-dimension, and nonlinear problems. Improved quantum particle swarm optimization (IQPSO) is used to optimize the penalty and kernel function parameters of SVM, which can solve the optimal local risk and premature convergence problems of particle swarm optimization (PSO) and quantum particle swarm optimization (QPSO) in the training process. The proposed algorithm can also balance the relationship between the global search and local search in the algorithm design to improve the parallelism, stability, robustness, global optimum, and model generalization ability of data fitting. The experimental results prove that, compared with the test results of the standard SVM, particle swarm optimization support vector machine (PSO-SVM), and quantum particle swarm optimization support vector machine (QPSO-SVM) models, IQPSO-SVM significantly improves the risk assessment accuracy of coal and gas outbursts in deep coal mines. Therefore, this study provides a new idea for the prevention of deep coal and gas outburst accidents based on risk prediction and also provides an essential reference for the scientific evaluation of other high-dimensional and nonlinear problems in other fields. This study can also provide a theoretical basis for preventing coal and gas outburst accidents in deep coal mines and help coal mining enterprises improve their safety management ability.

MEEMD Decomposition-Prediction-Reconstruction Model of Precipitation Time Series.

To address the problem of low prediction accuracy of precipitation time series data, an improved overall mean empirical modal decomposition–prediction–reconstruction model (MDPRM) is constructed in this paper. First, the non-stationary precipitation time series are decomposed into multiple decomposition terms by the improved overall mean empirical modal decomposition (MEEMD). Then, a particle swarm optimization support vector machine (PSO-SVM) and convolutional neural network (CNN) and recurrent neural network (RNN) models are used to make predictions according to the characteristics of different decomposition terms. Finally, the prediction results of each decomposition term are superimposed and reconstructed to form the final prediction results. In addition, the application is carried out with the summer precipitation in the Wujiang River basin of Guizhou Province from 1961 to 2018, using the first 38 years of data to train MDPRM and the last 20 years of data to test MDPRM, and comparing with a feedback neural network (BP), a support vector machine (SVM), a particle swarm optimization support vector machine (PSO-SVM), a convolutional neural network (CNN), and a recurrent neural network (RNN), etc. The results show that the mean relative error (MAPE) of the proposed MDPRM is reduced from 0.31 to 0.09, the root mean square error (RMSE) is reduced from 0.56 to 0.30, and the consistency index (α) is significantly improved from 0.33 to 0.86, which has a higher prediction accuracy. Finally, the trained MDPRM predicts the average summer precipitation in the Wujiang River basin from 2019 to 2028 to be 466.42 mm, the minimum precipitation in 2020 to be 440.94 mm, and the maximum precipitation in 2024 to be 497.94 mm. Based on the prediction results, the agricultural drought level is evaluated using the Z index, which indicates that the summer is normal in the 10-year period. The study provides technical support for the effective guidance of regional water resources’ allocation and scheduling and drought mitigation.

Moderate embed cross validated and feature reduced Steganalysis using principal component analysis in spatial and transform domain with Support Vector Machine and Support Vector Machine-Particle Swarm Optimization

Moderate embed cross validated and feature reduced Steganalysis using principal component analysis in spatial and transform domain with Support Vector Machine and Support Vector Machine-Particle Swarm Optimization

Design of remote injury diagnosis system for Wushu competition based on wireless sensor network

INTRODUCTION: In this paper, a remote injury diagnosis system for Wushu competition based on wireless sensor network is designed to improve the safety of athletes in the process of Wushu competition. OBJECTIVES: Improve the safety of athletes during martial arts competitions. METHODS: The pulse sensor, temperature sensor and ECG sensor are set as the terminal nodes of the remote injury diagnosis system for Wushu competition. The physiological parameters of athletes in Wushu competition are collected by the sensor, and the collected parameters are transmitted to the wireless RF module. The wireless RF module uses the wireless sensor network to realize the wireless communication of various parameter data through the routing node and terminal node, and transmits the data to the remote diagnosis module. The remote diagnosis module uses the collected physiological parameters of athletes to realize the remote diagnosis of injury in Wushu competition through particle swarm optimization-support vector machine diagnosis model. RESULTS: The experimental results show that the designed system can remotely collect the physiological parameters of athletes in Wushu competition, and remotely diagnose the injury of Wushu competition according to the collected data, and the diagnosis accuracy is as high as 99%. CONCLUSION: It has good safety performance and is of practical significance.

Quantitative Identification of Internal and External Wire Rope Damage Based on VMD-AWT Noise Reduction and PSO-SVM.

As a common load-bearing component, mining wire rope produces different types of damage during a long period of operation, especially in the case of damage inside the wire rope, which cannot be identified by the naked eye, and it is difficult to accurately detect such damage using the present technology. In this study we designed a non-destructive testing device based on leakage magnetism, which can effectively detect the internal defects of wire rope damage, and carried out simulation analysis to lay a theoretical foundation for the subsequent experiments. To address the noise reduction problem in the design process, a variational mode decomposition–adaptive wavelet thresholding noise reduction method is proposed, which can improve the signal-to-noise ratio and also calculate the wavelet energy entropy in the reconstructed signal to construct multi-dimensional feature vectors. For the quantitative identification of system damage, a particle swarm optimization–support vector machine algorithm is proposed. Moreover, based on the signal following the noise reduction step, seven different feature vectors, namely, the waveform area, peak value, peak-valley value, wavelet energy entropy classification, and identification of internal and external damage defects, have been determined. The results show that the device can be used to effectively identify internal damage defects. In addition, the comparative analysis showed that the algorithm can reduce the system noise and effectively identify internal and external damage defects with a certain superiority.

Application of multi-SVM classifier and hybrid GSAPSO algorithm for fault diagnosis of electrical machine drive system

A method, being based on multi-class support vector machine (SVM) classifier and hybrid particle swarm optimization (PSO) and gravity search algorithm (GSA), is presented to diagnose the faults in electrical motor drive system. In this method, the global search ability of PSO and the local search ability of GSA are integrated to combine the advantages of PSO and GSA, and the multi-class SVM classifier is optimized by the hybrid GSAPSO algorithm to improve classification performance. To test the presented method, a series of simulation and experiment are studied. The diagnostic results display that the presented method can gain more precise classification accuracy than multi-class SVM with PSO and multi-class SVM with GSA.

Research on muscle fatigue recognition model based on improved wavelet denoising and long short-term memory

The automatic recognition technology of muscle fatigue has widespread application in the field of kinesiology and rehabilitation medicine. In this paper, we used surface electromyography (sEMG) to study the recognition of leg muscle fatigue during circuit resistance training. The purpose of this study was to solve the problem that the sEMG signals have a lot of noise interference and the recognition accuracy of the existing muscle fatigue recognition model is not high enough. First, we proposed an improved wavelet threshold function denoising algorithm to denoise the sEMG signal. Then, we build a muscle fatigue state recognition model based on long short-term memory (LSTM), and used the Holdout method to evaluate the performance of the model. Finally, the denoising effect of the improved wavelet threshold function denoising method proposed in this paper was compared with the denoising effect of the traditional wavelet threshold denoising method. We compared the performance of the proposed muscle fatigue recognition model with that of particle swarm optimization support vector machine (PSO-SVM) and convolutional neural network (CNN). The results showed that the new wavelet threshold function had better denoising performance than hard and soft threshold functions. The accuracy of LSTM network model in identifying muscle fatigue was 4.89% and 2.47% higher than that of PSO-SVM and CNN, respectively. The sEMG signal denoising method and muscle fatigue recognition model proposed in this paper have important implications for monitoring muscle fatigue during rehabilitation training and exercise.

Automated screening of COVID-19 using two-dimensional variational mode decomposition and locally linear embedding

In order to aid imaging physicians to effectively screen chest radiography medical images for presence of Coronavirus Disease 2019 (COVID-19), a novel computer aided diagnosis technology for automatic processing of COVID-19 images is proposed based on two-dimensional variational mode decomposition (2D-VMD) and locally linear embedding (LLE). 2D-VMD algorithm is used to decompose normal and COVID-19 images, and then feature extraction of intrinsic mode functions (IMFs) using Gabor filter. To better extract low-dimensional parameters which are useful for COVID-19 diagnosis, the performance of two dimensionality reduction techniques of principal component analysis (PCA) and LLE are compared, and the LLE is shown to offer satisfactory effect of dimension reduction. Thereafter, the particle swarm optimization-support vector machine (PSO-SVM) algorithm is used to classify. The simulation results show that the proposed technology has achieved accuracy of 99.33%, precision of 100%, recall of 98.63% and F-Measure of 99.31%. Hence, the developed diagnosis technology can be used as an important auxiliary tool to assist diagnosis of imaging physicians.

Bolt Loosening Detection of Rocket Connection Structure Based on Variational Modal Decomposition and Support Vector Machines

This paper designed a bolt-loosening Support Vector Machines’ conduct detection method with feature vectors comprising eigenvalue decomposition based on Variational Modal Decomposition (VMD) and Singular Value Decomposition (SVD), combined with permutation entropy. Particle Swarm Optimization-Support Vector Machines (PSO-SVMs) are used for small-sample machine learning and can effectively identify and judge the state of bolt preload. The effectiveness of the proposed method is verified in a typical example of a connection structure under random-amplitude impulse loads and Gaussian white noise with different signal-to-noise ratios. The effect of other bolt numbers being arranged is also discussed in the results. This method’s bolt-loosening identification rate is close to 90% under both equal-amplitude and variable-amplitude loads. Following the interference, with a signal-to-noise ratio of 20 dB, the method also has a recognition rate higher than 70% under various working conditions and bolt equipment schemes. The effectiveness of the method was verified by experiments.

Research on Fault Diagnosis of Rolling Bearings Based on Variational Mode Decomposition Improved by the Niche Genetic Algorithm.

Due to the influence of signal-to-noise ratio in the early failure stage of rolling bearings in rotating machinery, it is difficult to effectively extract feature information. Variational Mode Decomposition (VMD) has been widely used to decompose vibration signals which can reflect more fault omens. In order to improve the efficiency and accuracy, a method to optimize VMD by using the Niche Genetic Algorithm (NGA) is proposed in this paper. In this method, the optimal Shannon entropy of modal components in a VMD algorithm is taken as the optimization objective, by using the NGA to constantly update and optimize the combination of influencing parameters composed of α and K so as to minimize the local minimum entropy. According to the obtained optimization results, the optimal input parameters of the VMD algorithm were set. The method mentioned is applied to the fault extraction of a simulated signal and a measured signal of a rolling bearing. The decomposition process of the rolling-bearing fault signal was transferred to the variational frame by the NGA-VMD algorithm, and several eigenmode function components were obtained. The energy feature extracted from the modal component containing the main fault information was used as the input vector of a particle swarm optimized support vector machine (PSO-SVM) and used to identify the fault type of the rolling bearing. The analysis results of the simulation signal and measured signal show that: the NGA-VMD algorithm can decompose the vibration signal of a rolling bearing accurately and has a better robust performance and correct recognition rate than the VMD algorithm. It can highlight the local characteristics of the original sample data and reduce the interference of the parameters selected artificially in the VMD algorithm on the processing results, improving the fault-diagnosis efficiency of rolling bearings.

A Machine Learning-Based Approach to Discriminating Basaltic Tectonic Settings

The geochemical characteristics of magmatic rocks can distinguish the tectonic setting of magma formation and their geochemical signatures are discriminated by using the whole-rock geochemical data. As a new attempt of artificial intelligence technology in geochemistry, the machine learning discrimination method is gradually complementary to the classical discriminative graphical method. However, the feature selection of high-dimensional data and the determination of many unknown parameters are the two main factors affecting the classification accuracy of the algorithm. In this paper, a particle swarm optimized support vector machine (PSO-SVM) model is established to classify the tectonic environments of basaltic rocks in the GEOROC database. The model mainly relies on the powerful search capability of the particle swarm algorithm to find the best parameter combination selected by the SVM based on experience to improve the accuracy. In this study, based on the basalt samples in the database and the confusion matrix, the performance of PSO-SVM model is evaluated by simulation experiments. The results show that the model proposed in this paper is more effective in distinguishing the basaltic tectonic environments, with an accuracy of more than 90%. Therefore, compared with the traditional discriminant map method, the machine learning method based on the fusion of two algorithms performs better in the tectonic environment classification problems.

Machine Learning- and Feature Selection-Enabled Framework for Accurate Crop Yield Prediction

Agriculture is crucial for the existence of humankind. Agriculture provides a significant portion of the income for many people all around the world. Additionally, it provides a large number of work possibilities for the general public. Numerous farmers desire for a return to the old-fashioned techniques of farming, which provides little profit in today’s market. Long-term economic growth and prosperity are dependent on the success of agriculture and associated companies in the United States. Agribusiness crop yields may be increased by carefully selecting the right crops and putting in place supportive infrastructure. Weather, soil fertility, water availability, water quality, crop pricing, and other factors are taken into consideration while making agricultural predictions. Machine learning is critical in crop production prediction because it can anticipate crop output based on factors such as location, meteorological conditions, and season. It is advantageous for policymakers and farmers alike to be able to precisely estimate crop yields throughout the growing season since it allows them to anticipate market prices, plan import and export operations, and limit the social cost of crop losses. The use of this tool assists farmers in making informed decisions about which crops to grow on their land. In this study, a machine learning framework for agricultural yield prediction is presented. Crop information is collected in an experiment’s data set. Then, feature selection is performed using the Relief algorithm. Features are extracted using the linear discriminant analysis algorithm. Machine learning predictors, namely, particle swarm optimization-support vector machine (PSO-SVM), K-nearest neighbor, and random forest, are used for classification.