Linear Support Vector Classifier Research Articles

A fine-tuning of decision tree classifier for ransomware detection based on memory data

Ransomware has evolved into a pervasive and extremely disruptive cybersecurity threat, causing substantial operational and financial damage to individuals and businesses. This article explores the critical domain of Ransomware detection and employs Machine Learning (ML) classifiers, particularly Decision Tree (DT), for Ransomware detection. The article also delves into the usefulness of DT in identifying Ransomware attacks, leveraging the innate ability of DT to recognize complex patterns within datasets. Instead of merely introducing DT as a detection method, we adopt a comprehensive approach, emphasizing the importance of fine-tuning DT hyperparameters. The optimization of these parameters is essential for maximizing the DT capability to identify Ransomware threats accurately. The obfuscated-MalMem2022 dataset, which is well-known for its extensive and challenging Ransomware-related data, was utilized to evaluate the effectiveness of DT in detecting Ransomware. The implementation uses the versatile Python programming language, renowned for its efficiency and adaptability in data analysis and ML tasks. Notably, the DT classifier consistently outperforms other classifiers in Ransomware detection, including K-Nearest Neighbors, Gradient Boosting Tree, Naive Bayes, and Linear Support Vector Classifier. For instance, the DT demonstrated exceptional effectiveness in distinguishing between Ransomware and benign data, as evidenced by its remarkable accuracy of 99.97%.

Predicting Football Match Outcomes with Machine Learning Approaches

The increasing use of data-driven approaches has led to the development of models to predict football match outcomes. However, predicting match outcomes accurately remains a challenge due to the sport's inherent unpredictability. In this study, we have investigated the usage of different machine learning models in predicting the outcome of English Premier League matches. We assessed the performance of random forest, logistic regression, linear support vector classifier and extreme gradient boosting models for binary and multiclass classification. These models are trained with datasets obtained using different sampling techniques. The result showed that the models performed better when trained with dataset obtained using a balanced sampling technique for binary classification. Additionally, the models' predictions were evaluated by conducting simulation on football betting profits based on the 2022-2023 EPL season. The model achieved the highest accuracy is the binary class random forest, but the model provided the highest football betting profit is the binary class logistic regression.

A large-scale sentiment analysis using political tweets

<p><span lang="EN-US">Twitter has become a key element of political discourse in candidates’ campaigns. The political polarization on Twitter is vital to politicians as it is a popular public medium to analyze and predict public opinion concerning political events. The analysis of the sentiment of political tweet contents mainly depends on the quality of sentiment lexicons. Therefore, it is crucial to create sentiment lexicons of the highest quality. In the proposed system, the domain-specific of the political lexicon is constructed by using the supervised approach to extract extreme political opinions words, and features in tweets. Political multi-class sentiment analysis (PMSA) system on the big data platform is developed to predict the inclination of tweets to infer the results of the elections by conducting the analysis on different political datasets: including the Trump election dataset and the BBC News politics. The comparative analysis is the experimental results which are better political text classification by using the three different models (multinomial naïve Bayes (MNB), decision tree (DT), linear support vector classification (SVC)). In the comparison of three different models, linear SVC has the better performance than the other two techniques. The analytical evaluation results show that the proposed system can be performed with 98% accuracy in linear SVC.</span></p>

Enhancing Predictive Power: Integrating a Linear Support Vector Classifier with Logistic Regression for Patient Outcome Prognosis in Virtual Reality Therapy for Treatment-Resistant Schizophrenia.

(1) Background: Approximately 30% of schizophrenia patients are known to be treatment-resistant. For these cases, more personalized approaches must be developed. Virtual reality therapeutic approaches such as avatar therapy (AT) are currently undergoing investigations to address these patients' needs. To further tailor the therapeutic trajectory of patients presenting with this complex presentation of schizophrenia, quantitative insight about the therapeutic process is warranted. The aim of the study is to combine a classification model with a regression model with the aim of predicting the therapeutic outcomes of patients based on the interactions taking place during their first immersive session of virtual reality therapy. (2) Methods: A combination of a Linear Support Vector Classifier and logistic regression was conducted over a dataset comprising 162 verbatims of the immersive sessions of 18 patients who previously underwent AT. As a testing dataset, 17 participants, unknown to the dataset, had their first immersive session presented to the combinatory model to predict their clinical outcome. (3) Results: The model accurately predicted the clinical outcome for 15 out of the 17 participants. Classification of the therapeutic interactions achieved an accuracy of 63%. (4) Conclusion: To our knowledge, this is the first attempt to predict the outcome of psychotherapy patients based on the content of their interactions with their therapist. These results are important as they open the door to personalization of psychotherapy based on quantitative information about the interactions taking place during AT.

A novel method for detecting URLs phishing using hybrid machine learning algorithm

Abstract— The phishing attack is the type of cyberattack that targets people’s trust by masking the malicious intent of the attack as communications from reputable sources. The goal is to steal sensitive data from the victim(s) (banking information, social identification, credentials, etc.) for various purposes (selling for monetary gain, performing identity thief, using as a lever for escalation attack). In 2022, the number of reported phishing attacks will reach a whopping 255 million cases, an increment of 61% compared to 2021. Existing methods of phishing URL detection have limitations. The article proposes a method to increase the accuracy of detecting malicious URL by using machine learning methods Linear Support Vector Classification and multinomial Naive Bayes with voting mechanisms.

Breast Cancer Detection and Prevention Using Machine Learning.

Breast cancer is a common cause of female mortality in developing countries. Early detection and treatment are crucial for successful outcomes. Breast cancer develops from breast cells and is considered a leading cause of death in women. This disease is classified into two subtypes: invasive ductal carcinoma (IDC) and ductal carcinoma in situ (DCIS). The advancements in artificial intelligence (AI) and machine learning (ML) techniques have made it possible to develop more accurate and reliable models for diagnosing and treating this disease. From the literature, it is evident that the incorporation of MRI and convolutional neural networks (CNNs) is helpful in breast cancer detection and prevention. In addition, the detection strategies have shown promise in identifying cancerous cells. The CNN Improvements for Breast Cancer Classification (CNNI-BCC) model helps doctors spot breast cancer using a trained deep learning neural network system to categorize breast cancer subtypes. However, they require significant computing power for imaging methods and preprocessing. Therefore, in this research, we proposed an efficient deep learning model that is capable of recognizing breast cancer in computerized mammograms of varying densities. Our research relied on three distinct modules for feature selection: the removal of low-variance features, univariate feature selection, and recursive feature elimination. The craniocaudally and medial-lateral views of mammograms are incorporated. We tested it with a large dataset of 3002 merged pictures gathered from 1501 individuals who had digital mammography performed between February 2007 and May 2015. In this paper, we applied six different categorization models for the diagnosis of breast cancer, including the random forest (RF), decision tree (DT), k-nearest neighbors (KNN), logistic regression (LR), support vector classifier (SVC), and linear support vector classifier (linear SVC). The simulation results prove that our proposed model is highly efficient, as it requires less computational power and is highly accurate.

Inferring linear-B cell epitopes using 2-step metaheuristic variant-feature selection using genetic algorithm

Linear-B cell epitopes (LBCE) play a vital role in vaccine design; thus, efficiently detecting them from protein sequences is of primary importance. These epitopes consist of amino acids arranged in continuous or discontinuous patterns. Vaccines employ attenuated viruses and purified antigens. LBCE stimulate humoral immunity in the body, where B and T cells target circulating infections. To predict LBCE, the underlying protein sequences undergo a process of feature extraction, feature selection, and classification. Various system models have been proposed for this purpose, but their classification accuracy is only moderate. In order to enhance the accuracy of LBCE classification, this paper presents a novel 2-step metaheuristic variant-feature selection method that combines a linear support vector classifier (LSVC) with a Modified Genetic Algorithm (MGA). The feature selection model employs mono-peptide, dipeptide, and tripeptide features, focusing on the most diverse ones. These selected features are fed into a machine learning (ML)-based parallel ensemble classifier. The ensemble classifier combines correctly classified instances from various classifiers, including k-Nearest Neighbor (kNN), random forest (RF), logistic regression (LR), and support vector machine (SVM). The ensemble classifier came up with an impressively high accuracy of 99.3% as a result of its work. This accuracy is superior to the most recent models that are considered to be state-of-the-art for linear B-cell classification. As a direct consequence of this, the entire system model can now be utilised effectively in real-time clinical settings.

Mapping Oil Palm Plantations Using WorldView-2 Satellite Imagery and Machine Learning Algorithms

Currently, remote sensing has been used extensively in the agriculture industry for oil palm monitoring due to their large plantation area. Oil palm monitoring can be done by performing land cover classification using various classification methods and machine learning algorithms. This study was conducted to perform oil palm mapping using WorldView-2 satellite imagery and classify land cover features using machine learning algorithms such as Random Forest (RF) and Linear Support Vector Classifier (LSVC). A total of 58609 sampling points were classified into six classes which are water, built-up, bare soil, forest, mature oil palm (≥9 years) and young oil palm (3-8 years). The training and testing samples were split using 3-fold cross-validation. 67% of the total sampling points were used for training samples whereas the other 33% were used for testing samples. The methods used to validate the data in this study is by using spectral reflectance and Google Earth Pro. Accuracy assessment was conducted after obtaining the classification output such as Overall Accuracy (OA), Kappa Accuracy (KA), Precision, Recall and F1-score. As a result, the oil palm mapping using RF has a higher accuracy than LSVC which is 72.49% for OA and 62.98% for KA. The p-value obtained from the McNemar’s test conducted in this study is 0.683 (>0.05) which concludes that the predictive performance of the two models are equal.

Comparing the Performance of Machine Learning Algorithms in the Automatic Classification of Psychotherapeutic Interactions in Avatar Therapy

(1) Background: Avatar Therapy (AT) is currently being studied to help patients suffering from treatment-resistant schizophrenia. Facilitating annotations of immersive verbatims in AT by using classification algorithms could be an interesting avenue to reduce the time and cost of conducting such analysis and adding objective quantitative data in the classification of the different interactions taking place during the therapy. The aim of this study is to compare the performance of machine learning algorithms in the automatic annotation of immersive session verbatims of AT. (2) Methods: Five machine learning algorithms were implemented over a dataset as per the Scikit-Learn library: Support vector classifier, Linear support vector classifier, Multinomial Naïve Bayes, Decision Tree, and Multi-layer perceptron classifier. The dataset consisted of the 27 different types of interactions taking place in AT for the Avatar and the patient for 35 patients who underwent eight immersive sessions as part of their treatment in AT. (3) Results: The Linear SVC performed best over the dataset as compared with the other algorithms with the highest accuracy score, recall score, and F1-Score. The regular SVC performed best for precision. (4) Conclusions: This study presented an objective method for classifying textual interactions based on immersive session verbatims and gave a first comparison of multiple machine learning algorithms on AT.

AraMAMS: Arabic Multi-Aspect, Multi-Sentiment Restaurants Reviews Corpus for Aspect-Based Sentiment Analysis

The abundance of data on the internet makes analysis a must. Aspect-based sentiment analysis helps extract valuable information from textual data. Because of limited Arabic resources, this paper enriches the Arabic dataset landscape by creating AraMA, the first and largest Arabic multi-aspect corpus. AraMA comprises 10,750 Google Maps reviews for restaurants in Riyadh, Saudi Arabia. It covers four aspect categories—food, environment, service, and price—along with four sentiment polarities: positive, negative, neutral, and conflict. All AraMA reviews are labeled with at least two aspect categories. A second version, named AraMAMS, includes reviews labeled with at least two different sentiments, making it the first Arabic multi-aspect, multi-sentiment dataset. AraMAMS has 5312 reviews covering the same four aspect categories and sentiment polarities. Both corpora were evaluated using naïve biased (NB), support vector classification (SVC), linear SVC, and stochastic gradient descent (SGD) models. In the AraMA corpus, the aspect categories task achieved a 91.41% F1 measure result using the SVC model, while in the AraMAMS corpus, the best F1 measure result for aspect categories task reached 91.70% using the linear SVC model.

A Comparative Analysis of Machine Learning Techniques for Cyberbullying Detection on FormSpring in Textual Modality

Social media usage has increased tremendously with the rise of the internet and it has evolved into the most powerful networking platform of the twenty-first century. However, a number of undesirable phenomena are associated with increased use of social networking, such as cyberbullying (CB), cybercrime, online abuse and online trolling. Especially for children and women, cyberbullying can have severe psychological and physical effects, even leading to self-harm or suicide. Because of its significant detrimental social impact, the detection of CB text or messages on social media has attracted more research work. To mitigate CB, we have proposed an automated cyberbullying detection model that detects and classifies cyberbullying content as either bullying or non-bullying (binary classification model), creating a more secure social media experience. The proposed model uses Natural Language Processing (NLP) techniques and Machine Learning (ML) approaches to assess cyberbullying contents. Our main goal is to assess different machine learning algorithms for their performance in cyberbullying detection based on a labelled dataset from Formspring [1]. Nine popular machine learning classifiers namely Bootstrap Aggregation or Bagging, Stochastic Gradient Descent (SGD), Random Forest (RF), Decision Tree (DT), Linear Support Vector Classifier (Linear SVC), Logistic Regression (LR), Adaptive Boosting (AdaBoost), Multinomial Naive Bayes (MNB) and K-Nearest Neighbour (KNN) are considered for the work. In addition, we have experimented with a feature extraction method namely CountVectorizer to obtain features that aid for better classification. The results show that the classification accuracy of AdaBoost classifier is 86.52% which is found better than all other machine learning algorithms used in this study. The proposed work demonstrates the effectiveness of machine learning algorithms in automatic cyberbullying detection as against the very intense and time-consuming approaches for the same problem, thereby by facilitating easy incorporation of an effective approach as tools across different platforms enabling people to use social media safely.

Predictive value of radiomics analysis of enhanced CT for three-tiered microvascular invasion grading in hepatocellular carcinoma.

Microvascular invasion (MVI) is a major risk factor, for recurrence and metastasis of hepatocellular carcinoma (HCC) after radical surgery and liver transplantation. However, its diagnosis depends on the pathological examination of the resected specimen after surgery; therefore, predicting MVI before surgery is necessary to provide reference value for clinical treatment. Meanwhile, predicting only the existence of MVI is not enough, as it ignores the degree, quantity, and distribution of MVI and may lead to MVI-positive patients suffering due to inappropriate treatment. Although some studies have involved M2 (high risk of MVI), majority have adopted the binary classification method or have not included radiomics. To develop three-class classification models for predicting the grade of MVI of HCC by combining enhanced computed tomography radiomics features with clinical risk factors. The data of 166 patients with HCC confirmed by surgery and pathology were analyzed retrospectively. The patients were divided into the training (116 cases) and test (50 cases) groups at a ratio of 7:3. Of them, 69 cases were MVI positive in the training group, including 45 cases in the low-risk group (M1) and 24 cases in the high-risk group (M2), and 47 cases were MVI negative (M0). In the training group, the optimal subset features were obtained through feature selection, and the arterial phase radiomics model, portal venous phase radiomics model, delayed phase radiomics model, three-phase radiomics model, clinical imaging model, and combined model were developed using Linear Support Vector Classification. The test group was used for validation, and the efficacy of each model was evaluated through the receiver operating characteristic curve (ROC). The clinical imaging features of MVI included alpha-fetoprotein, tumor size, tumor margin, peritumoral enhancement, intratumoral artery, and low-density halo. The area under the curve (AUC) of the ROC values of the clinical imaging model for M0, M1, and M2 were 0.831, 0.701, and 0.847, respectively, in the training group and 0.782, 0.534, and 0.785, respectively, in the test group. After combined radiomics analyis, the AUC values for M0, M1, and M2 in the test group were 0.818, 0.688, and 0.867, respectively. The difference between the clinical imaging model and the combined model was statistically significant (p=0.029). The clinical imaging model and radiomics model developed in this study had a specific predictive value for HCC MVI grading, which can provide precise reference value for preoperative clinical diagnosis and treatment. The combined application of the two models had a high predictive efficacy.

Feasibility of artificial intelligence assisted quantitative muscle ultrasound in carpal tunnel syndrome

BackgroundIn case of focal neuropathy, the muscle fibers innervated by the corresponding nerves are replaced with fat or fibrous tissue due to denervation, which results in increased echo intensity (EI) on ultrasonography. EI analysis can be conducted quantitatively using gray scale analysis. Mean value of pixel brightness of muscle image defined as EI. However, the accuracy achieved by using this parameter alone to differentiate between normal and abnormal muscles is limited. Recently, attempts have been made to increase the accuracy using artificial intelligence (AI) in the analysis of muscle ultrasound images. CTS is the most common disease among focal neuropathy. In this study, we aimed to verify the utility of AI assisted quantitative analysis of muscle ultrasound in CTS.MethodsThis is retrospective study that used data from adult who underwent ultrasonographic examination of hand muscles. The patient with CTS confirmed by electromyography and subjects without CTS were included. Ultrasound images of the unaffected hands of patients or subjects without CTS were used as controls. Ultrasonography was performed by one physician in same sonographic settings. Both conventional quantitative grayscale analysis and machine learning (ML) analysis were performed for comparison.ResultsA total of 47 hands with CTS and 27 control hands were analyzed. On conventional quantitative analysis, mean EI ratio (i.e. mean thenar EI/mean hypothenar EI ratio) were significantly higher in the patient group than in the control group, and the AUC was 0.76 in ROC analysis. In the analysis using machine learning, the AUC was the highest for the linear support vector classifier (AUC = 0.86). When recursive feature elimination was applied to the classifier, the AUC value improved to 0.89.ConclusionThis study showed a significant increase in diagnostic accuracy when AI was used for quantitative analysis of muscle ultrasonography. If an analysis protocol using machine learning can be established and mounted on an ultrasound machine, a noninvasive and non-time-consuming muscle ultrasound examination can be conducted as an ancillary tool for diagnosis.

Non-Functional Requirements Classification Using Machine Learning Algorithms

Non-functional requirements define the quality attribute of a software application, which are necessary to identify in the early stage of software development life cycle. Researchers proposed automatic software Non-functional requirement classification using several Machine Learning (ML) algorithms with a combination of various vectorization techniques. However, using the best combination in Non-functional requirement classification still needs to be clarified. In this paper, we examined whether different combinations of feature extraction techniques and ML algorithms varied in the non-functional requirements classification performance. We also reported the best approach for classifying Non-functional requirements. We conducted the comparative analysis on a publicly available PROMISE_exp dataset containing labelled functional and Non-functional requirements. Initially, we normalized the textual requirements from the dataset; then extracted features through Bag of Words (BoW), Term Frequency and Inverse Document Frequency (TF-IDF), Hashing and Chi-Squared vectorization methods. Finally, we executed the 15 most popular ML algorithms to classify the requirements. The novelty of this work is the empirical analysis to find out the best combination of ML classifier with appropriate vectorization technique, which helps developers to detect Non-functional requirements early and take precise steps. We found that the linear support vector classifier and TF-IDF combination outperform any combinations with an F1-score of 81.5%.

Supervised machine learning classifies inflammatory bowel disease patients by subtype using whole exome sequencing data.

Inflammatory bowel disease (IBD) is a chronic inflammatory disorder with two main subtypes: Crohn's disease (CD) and Ulcerative Colitis (UC). Prompt subtype diagnosis enables the correct treatment to be administered. Using genomic data, we aimed to assess machine learning (ML) to classify patients according to IBD subtype. Whole exome sequencing from paediatric/adult IBD patients was processed using an in-house bioinformatics pipeline. This data was condensed into the per-gene, per-individual genomic burden score, GenePy. Data was split into training and testing datasets (80/20). Feature selection with a linear support vector classifier, and hyperparameter tuning with Bayesian Optimisation was performed (training data). The supervised ML method random forest was utilised to classify patients as CD or UC using three panels: I) all available genes, 2) autoimmune genes, 3) 'IBD' genes. ML results were assessed using AUROC, sensitivity and specificity on the testing dataset. 906 patients were included in analysis (600 CD, 306 UC). Training data included 488 patients, balanced according to the minority class of UC. The autoimmune gene panel generated the best performing ML model (AUROC=0.68), outperforming an IBD gene panel (AUROC =0.61). NOD2 was the top gene for discriminating CD and UC, regardless of the gene panel used. Lack of variation in genes with high GenePy scores in CD patients was the best classifier of a diagnosis of UC. We demonstrate promising classification of patients by subtype utilising random forest and WES data. Focussing on specific subgroups of patients, with larger datasets may result in better classification.

Use of Support Vector Machines Approach via ComBat Harmonized Diffusion Tensor Imaging for the Diagnosis and Prognosis of Mild Traumatic Brain Injury: A CENTER-TBI Study.

The prediction of functional outcome after mild traumatic brain injury (mTBI) is challenging. Conventional magnetic resonance imaging (MRI) does not do a good job of explaining the variance in outcome, as many patients with incomplete recovery will have normal-appearing clinical neuroimaging. More advanced quantitative techniques such as diffusion MRI (dMRI), can detect microstructural changes not otherwise visible, and so may offer a way to improve outcome prediction. In this study, we explore the potential of linear support vector classifiers (linearSVCs) to identify dMRI biomarkers that can predict recovery after mTBI. Simultaneously, the harmonization of fractional anisotropy (FA) and mean diffusivity (MD) via ComBat was evaluated and compared for the classification performances of the linearSVCs. We included dMRI scans of 179 mTBI patients and 85 controls from the Collaborative European NeuroTrauma Effectiveness Research in Traumatic Brain Injury (CENTER-TBI), a multi-center prospective cohort study, up to 21 days post-injury. Patients were dichotomized according to their Extended Glasgow Outcome Scale (GOSE) scores at 6 months into complete (n = 92; GOSE = 8) and incomplete (n = 87; GOSE <8) recovery. FA and MD maps were registered to a common space and harmonized via the ComBat algorithm. LinearSVCs were applied to distinguish: (1) mTBI patients from controls and (2) mTBI patients with complete from those with incomplete recovery. The linearSVCs were trained on (1) age and sex only, (2) non-harmonized, (3) two-category-harmonized ComBat, and (4) three-category-harmonized ComBat FA and MD images combined with age and sex. White matter FA and MD voxels and regions of interest (ROIs) within the John Hopkins University (JHU) atlas were examined. Recursive feature elimination was used to identify the 10% most discriminative voxels or the 10 most discriminative ROIs for each implementation. mTBI patients displayed significantly higher MD and lower FA values than controls for the discriminative voxels and ROIs. For the analysis between mTBI patients and controls, the three-category-harmonized ComBat FA and MD voxel-wise linearSVC provided significantly higher classification scores (81.4% accuracy, 93.3% sensitivity, 80.3% F1-score, and 0.88 area under the curve [AUC], p < 0.05) compared with the classification based on age and sex only and the ROI approaches (accuracies: 59.8% and 64.8%, respectively). Similar to the analysis between mTBI patients and controls, the three-category-harmonized ComBat FA and MD maps voxelwise approach yields statistically significant prediction scores between mTBI patients with complete and those with incomplete recovery (71.8% specificity, 66.2% F1-score and 0.71 AUC, p < 0.05), which provided a modest increase in the classification score (accuracy: 66.4%) compared with the classification based on age and sex only and ROI-wise approaches (accuracy: 61.4% and 64.7%, respectively). This study showed that ComBat harmonized FA and MD may provide additional information for diagnosis and prognosis of mTBI in a multi-modal machine learning approach. These findings demonstrate that dMRI may assist in the early detection of patients at risk of incomplete recovery from mTBI.

From Twitter to Aso-Rock: A sentiment analysis framework for understanding Nigeria 2023 presidential election

IntroductionSocial media platforms such as Facebook, LinkedIn, Twitter, among others have been used as tools for staging protests, opinion polls, campaign strategy, medium of agitation and a place of interest expression especially during elections. AimIn this work, a Natural Language Processing framework is designed to understand Nigeria 2023 presidential election based on public opinion using Twitter dataset. MethodsTwo million tweets with 18 features were collected from Twitter containing public and personal tweets of the three top contestants – Atiku Abubakar, Peter Obi and Bola Tinubu – in the forthcoming 2023 Presidential election. Sentiment analysis was performed on the preprocessed dataset using three machine learning models namely: Long Short-Term Memory (LSTM) Recurrent Neural Network, Bidirectional Encoder Representations from Transformers (BERT) and Linear Support Vector Classifier (LSVC) models. This study spanned ten weeks starting from the candidates’ declaration of intent to run for Presidency. ResultsThe sentiment models gave an accuracy, precision, recall, AUC and f-measure of 88%, 82.7%, 87.2%, 87.6% and 82.9% respectively for LSTM; 94%, 88.5%, 92.5%, 94.7% and 91.7% respectively for BERT and 73%, 81.4%, 76.4%, 81.2% and 79.2% respectively for LSVC. Result also showed that Peter Obi has the highest total impressions the highest positive sentiments, Tinubu has the highest network of active friends while Atiku has the highest number of followers. ConclusionSentiment analysis and other Natural Language Understanding tasks can aid in the understanding of the social media space in terms of public opinion mining. We conclude that opinion mining from Twitter can form a general basis for generating insights for election as well as modeling election outcomes.

IIL13Pred: improved prediction of IL-13 inducing peptides using popular machine learning classifiers

BackgroundInflammatory mediators play havoc in several diseases including the novel Coronavirus disease 2019 (COVID-19) and generally correlate with the severity of the disease. Interleukin-13 (IL-13), is a pleiotropic cytokine that is known to be associated with airway inflammation in asthma and reactive airway diseases, in neoplastic and autoimmune diseases. Interestingly, the recent association of IL-13 with COVID-19 severity has sparked interest in this cytokine. Therefore characterization of new molecules which can regulate IL-13 induction might lead to novel therapeutics.ResultsHere, we present an improved prediction of IL-13-inducing peptides. The positive and negative datasets were obtained from a recent study (IL13Pred) and the Pfeature algorithm was used to compute features for the peptides. As compared to the state-of-the-art which used the regularization based feature selection technique (linear support vector classifier with the L1 penalty), we used a multivariate feature selection technique (minimum redundancy maximum relevance) to obtain non-redundant and highly relevant features. In the proposed study (improved IL-13 prediction (iIL13Pred)), the use of the mRMR feature selection method is instrumental in choosing the most discriminatory features of IL-13-inducing peptides with improved performance. We investigated seven common machine learning classifiers including Decision Tree, Gaussian Naïve Bayes, k-Nearest Neighbour, Logistic Regression, Support Vector Machine, Random Forest, and extreme gradient boosting to efficiently classify IL-13-inducing peptides. We report improved AUC, and MCC scores of 0.83 and 0.33 on validation data as compared to the current method.ConclusionsExtensive benchmarking experiments suggest that the proposed method (iIL13Pred) could provide improved performance metrics in terms of sensitivity, specificity, accuracy, the area under the curve - receiver operating characteristics (AUCROC) and Matthews correlation coefficient (MCC) than the existing state-of-the-art approach (IL13Pred) on the validation dataset and an external dataset comprising of experimentally validated IL-13-inducing peptides. Additionally, the experiments were performed with an increased number of experimentally validated training datasets to obtain a more robust model. A user-friendly web server (www.soodlab.com/iil13pred) is also designed to facilitate rapid screening of IL-13-inducing peptides.

MBTI Personality Prediction Using Machine Learning and SMOTE for Balancing Data Based on Statement Sentences

The rise of social media as a platform for self-expression and self-understanding has led to increased interest in using the Myers–Briggs Type Indicator (MBTI) to explore human personalities. Despite this, there needs to be more research on how other word-embedding techniques, machine learning algorithms, and imbalanced data-handling techniques can improve the results of MBTI personality-type predictions. Our research aimed to investigate the efficacy of these techniques by utilizing the Word2Vec model to obtain a vector representation of words in the corpus data. We implemented several machine learning approaches, including logistic regression, linear support vector classification, stochastic gradient descent, random forest, the extreme gradient boosting classifier, and the cat boosting classifier. In addition, we used the synthetic minority oversampling technique (SMOTE) to address the issue of imbalanced data. The results showed that our approach could achieve a relatively high F1 score (between 0.7383 and 0.8282), depending on the chosen model for predicting and classifying MBTI personality. Furthermore, we found that using SMOTE could improve the selected models’ performance (F1 score between 0.7553 and 0.8337), proving that the machine learning approach integrated with Word2Vec and SMOTE could predict and classify MBTI personality well, thus enhancing the understanding of MBTI.

Real-time Twitter Sentiment Analysis for Moroccan Universities using Machine Learning and Big Data Technologies

In recent years, sentiment analysis (SA) has raised the interest of researchers in several domains, including higher education. It can be applied to measure the quality of the services supplied by the higher education institution and construct a university ranking mechanism from social media like Twitter. Hence, this study presents a novel system for Twitter sentiment prediction on Moroccan public universities in real-time. It consists of two phases: offline sentiment analysis phase and real-time prediction phase. In the offline phase, the collected French tweets about twelve Moroccan universities were classified according to their sentiment into ‘positive’, ‘negative’, or ‘neutral’ using six machine learning algorithms (random forest, multinomial Naive Bayes classifier, logistic regression, decision tree, linear support vector classifier, and extreme gradient boosting) with the term frequency-inverse document frequency (TF-IDF) and count vectorizer feature extraction techniques. The results reveal that random forest classifier coupled with TF-IDF has obtained the best test accuracy of 90%. This model was then applied on real-time tweets. The real-time prediction pipeline comprises Twitter streaming API for data collection, Apache Kafka for data ingestion, Apache Spark for real-time sentiment analysis, Elasticsearch for real-time data exploration, and Kibana for data visualization. The obtained results can be used by the Ministry of higher education, scientific research and innovation of Morocco for decision-making process.