Linear Support Vector Classifier Research Articles

DeepPL: A deep-learning-based tool for the prediction of bacteriophage lifecycle.

Bacteriophages (phages) are viruses that infect bacteria and can be classified into two different lifecycles. Virulent phages (or lytic phages) have a lytic cycle that can lyse the bacteria host after their infection. Temperate phages (or lysogenic phages) can integrate their phage genomes into bacterial chromosomes and replicate with bacterial hosts via the lysogenic cycle. Identifying phage lifecycles is a crucial step in developing suitable applications for phages. Compared to the complicated traditional biological experiments, several tools have been designed for predicting phage lifecycle using different algorithms, such as random forest (RF), linear support-vector classifier (SVC), and convolutional neural network (CNN). In this study, we developed a natural language processing (NLP)-based tool-DeepPL-for predicting phage lifecycles via nucleotide sequences. The test results showed that our DeepPL had an accuracy of 94.65% with a sensitivity of 92.24% and a specificity of 95.91%. Moreover, DeepPL had 100% accuracy in lifecycle prediction on the phages we isolated and biologically verified previously in the lab. Additionally, a mock phage community metagenomic dataset was used to test the potential usage of DeepPL in viral metagenomic research. DeepPL displayed a 100% accuracy for individual phage complete genomes and high accuracies ranging from 71.14% to 100% on phage contigs produced by various next-generation sequencing technologies. Overall, our study indicates that DeepPL has a reliable performance on phage lifecycle prediction using the most fundamental nucleotide sequences and can be applied to future phage and metagenomic research.

Predicting business bankruptcy: A comparative analysis with machine learning models

Business failure prediction has become crucially important for today's firms, enabling them to reduce financial risks and make informed decisions. This study uses a dataset of 6819 companies and 96 financial and macroeconomic variables to present a comparative analysis of machine learning (ML) models for predicting corporate bankruptcies. Behind this research is to improve the accuracy of bankruptcy prediction, which can help companies make more informed decisions and reduce financial risks. This study aims to evaluate the effectiveness of 16 ML algorithms in terms of accuracy, sensitivity, and other relevant metrics. The work uses methodologies that include data collection and cleaning, exploratory data analysis, model preprocessing and training, and model performance evaluation. Data preprocessing and hyperparameter optimization techniques were used to improve model performance. The evaluated algorithms include Classifiers such as Stacking Classifier (SCC), Randomized Search Classifier (RCV), Historical Gradient Boosting Classifier (HGBC), MLP Classifier (MLPC), K-Neighbors Classifier (KNC), Decision Tree Classifier (DTC), XGBRF Classifier (XGBRFC), Support Vector Classifier (SVC), Logistic Regression Classifier (LR), Linear SVC Classifier (LSVC). With an accuracy of 97.63 %, recall of 97.63 %, and F1-score of 97.63 %, the results show that the SCC algorithm was the best. Other models, such as RCV and DTC, also showed good results, with accuracies above 97 %. However, models such as PAC and BNB had lower performance and accuracy below 90 %. Finally, this study compares the results of ML models in predicting business failures and highlights their effectiveness. The SCC algorithm is considered the most suitable model for this task, as it suggests that it can help economic actors make more informed decisions and reduce financial risks in the context of firms.

Enhanced data preprocessing with novel window function in Raman spectroscopy: Leveraging feature selection and machine learning for raspberry origin identification

In this study, a simple and accurate approach is proposed for enhancing the origin identification of raspberry samples using a combination of innovative Raman spectral preprocessing techniques, feature selection, and machine learning algorithms. Window function was creatively introduced and combined with baseline removal technique to preprocess the Raman spectral data, reducing the dimensionality of the raw data and ensuring the quality of the processed data. An optimization process was conducted to determine the optimal parameter for the window function, resulting in a binning window width of 5 that yielded the highest accuracy. After applying three feature selection techniques, it was found that the information gain model had the best performance in extracting discriminative spectral features. Finally, ten different machine learning algorithms were employed to construct predictive models, and the optimal models were selected. Linear Support Vector Classifier (LinearSVC), Multi-Layer Perceptron Classifier (MLPClassifier), and Linear Discriminant Analysis (LDA) achieve accuracy, precision, recall, and F1 values above 0.96, while the Random Vector Functional Link Network Classifier (RVFLClassifier) surpasses 0.93 for these performance metrics. These results demonstrate the effectiveness of the proposed approach in identifying the origin of raspberry samples with high accuracy and robustness, providing a valuable tool for agricultural product authentication and quality control.

ECSYAPPS – A framework for analyzing the effectiveness of classification techniques for early prediction of students academic performance in education sector

Predicting students' academic performance is of paramount importance to educational institutions. If students' academic performance is predicted course-wise, semester-wise and year-wise then it will be helpful for students to a great extent. In this research article, we generate twenty nine dataset with the help of students' result analysis. Datasets 1 to 9 is the datasets of students' result in first attempt while datasets 10 to 19 represent datasets of students after passing all courses of semesters and datasets 20 to 29 is overall dataset of students' result analysis. To predict the course-wise, semester-wise and year-wise performance of students, we developed a framework titled as ECSYAPPS (Educational CourseSemesterYear-wiseAcademic Performance Prediction System) based on classification techniques and designed algorithm for analyzing students' performance in education sector. This ECSYAPPS predicts the course-wise, semester-wise and year-wise grade of students. Fifteen classification algorithms such as Logistic Regression (LR), Naive Bayes (NB), Decision Tree (DT), Random Forest (RF), Support Vector Machines (SVM), Linear Support Vector Classification (LSVC), K-Nearest Neighbors (KNN), Gradient Boosting (GB), Adaptive Boosting (AdaBoost), Bagging, Extreme Gradient Boosting (XGBoost), Light Gradient-Boosting Machine (LightGBM), Categorical Boosting (CatBoost), Linear Discriminant Analysis (LDA), and Stochastic Gradient Descent Classifier (SGDC) are selected and applied on 29 datasets and compared on basis of performance parameters such as Accuracy, Precision, Recall, F1-score and Mean Absolute Error (MAE). These fifteen classification algorithms are under ten classifiers such as Linear Model, Naive Bayes, Tree, Support Vector Machine, Nearest Neighbors, Ensemble, xgboost, lightgbm, Discriminant Analysis and catboost. If the accuracy of two more classification algorithms for a dataset is same then in that case Precision, Recall, F1-score and Mean Absolute Error (MAE) are compared for deciding the best classification algorithm for the dataset. In this way, best classification algorithm is selected for each of 29 datasets. It is found that classifiers xgboost works best for eleven datasets while ensemble techniques Gradient Boosting and AdaBoost work best for two datasets and six datasets respectively among 29 datasets. Other classification algorithms such as Decision Tree, LightGBM, LDA, and KNN are noted to be best classification algorithm for two, four, three, and two datasets respectively. This framework is tested on new eight datasets related to students' result two methods such as K-Fold Cross-validation and Train-Validation-Test method. The results of this framework on new datasets shows that accuracy obtained on test dataset or validation dataset as compared to the accuracy obtained on old dataset is less than 6%. This framework will be helpful for students as well instructor. For students, it will help them to improve the performance of difficult courses from students'point of view in the examination while faculty can use this framework to improve pedagogical practices.

Data acquisition in a simplified turbine model for prediction of unsteady vortex phenomena

Abstract The utilization of machine learning in finding decisions of engineering problems is the optimal way. This study presents a new tool that applies machine learning algorithms, to predict the frequency response of an unsteady vortex phenomenon known as the precessing vortex core (PVC) that appears in a conical draft tube behind a runner. The basic values involved in Linear Support Vector Classification model training are the two components of the time-averaged velocity profile at the cone diffuser inlet and cone angle which should be accurately measured. The paper introduces the approach to accumulating an experimental database and conducting primary analysis of the implemented regimes of swirling flow in a simplified hydraulic turbine model. It was obtained that it is necessary to clearly identify the zone of recirculation flow. The presence of this zone is a necessary, but not sufficient condition for the formation of the PVC in the flow. Injection of an axial jet in a situation with moderate swirl flow allows to shift the PVC frequency about by 10% relative to the PVC frequency without an additional jet.

Machine Learning-Driven Stroke Prediction Using Independent Dataset

The incidence of stroke cases has witnessed a rapid global rise, affecting not only the elderly but also individuals across all age groups. Accurate prediction of stroke occurrence demands the utilization of extensive data pre-processing techniques. Moreover, the automation of early stroke forecasting is crucial to prevent its onset at the initial stage. In this study, stroke prediction models are evaluated to estimate the likelihood of stroke based on various symptoms such as age, gender, pre-existing medical conditions, and social variables. The machine learning techniques employed include Linear Support Vector Classifier, Extreme Gradient Boosting Classifier, Multilayer Perceptron, Adaptive Boosting Classifier, Bootstrap Aggregating Classifier, and Light Gradient-Boosting Machine. The purpose of this paper is to optimize the hyperparameters of machine learning approaches in developing stroke prediction models. The goal was achieved through a comprehensive comparison of three different sampling techniques for handling imbalanced datasets and evaluating their performance by using various metrics. The most effective model is identified, which is the Adaptive Boosting Classifier utilizing the Tomek Links, with a cross-dataset accuracy of 99% which demonstrated a reliable performance and generalization as evidenced by high cross-validation scores and accuracy on an independent dataset. The next stage of this endeavor entails looking into multiple ways to forecast the development of new dangerous diseases such as breast cancer and skin disorders. In the long run, the aim of subsequent work is to build a powerful toolset that is obtainable to all medical practitioners, allowing for the pre-emptive diagnosis of all potentially hazardous illnesses.

FarmTechBot (FTB): Empowering farmers for better harvest

In an evolving world, the FarmTechBot (FTB) emerges as a pioneering digital assistant, empowering farmers with essential insights and real-time information crucial for optimizing agricultural practices. The presence of chatbot functionality capable of addressing queries related to soil, pest, and market linkage associates to overcome hurdles for users seeking real-time information. Furthermore, the lack of voice recognition capabilities limits accessibility, especially for users who prefer or require voice-based interaction. Additionally, the manual process of pest identification from uploaded crop images hampers efficiency, prolonging the time required for pest management. The FTB represents a significant advancement in agricultural technology, addressing the existing system's limitations and empowering farmers with real-time information, enhanced accessibility, and streamlined pest management capabilities. The FTB utilizes a combination of techniques including Histogram of Oriented Gradients (HOG) for image feature extraction and classification using Support Vector Classifier (SVC). In Natural Language Processing (NLP), it employs tokenization and TF-IDF vectorization for text preprocessing and representation, alongside Linear Support Vector Classifier (LinearSVC) for intent classification.

Understanding College Students’ Satisfaction With ChatGPT: An Exploratory And Predictive Machine Learning Approach Using Feature Engineering

Artificial Intelligence (AI) technologies are continually improving and becoming more pervasive in many facets of our lives. ChatGPT is one such cutting-edge artificial intelligence application, and it has received a lot of worldwide media attention, specifically from educationists, technologists, and learners. It is imperative to understand and evaluate the impact of ChatGPT on computer science students as it directly and holistically influences them. A quantitative instrumental case study explores ChatGPT’s impact on early adopters in education. A survey of undergraduate computer science students at a state university of Delhi was conducted to get insight into their opinion on adopting this revolutionising technology for their education, career, and overall satisfaction. An end-to-end data science approach is applied to encompass exploratory and predictive modelling with feature engineering solutions. Results reveal the most influential features contributing to students’ satisfaction in adopting ChatGPT for their day-to-day chores concerning their social life, education, and career. The Linear Support Vector classifier, a machine learning algorithm for predicting the satisfaction or dissatisfaction in students’ shows an accuracy score of 72.73% and 97.72%, respectively. The AUC for this multiclass prediction model is convincing and is 0.74, 0.71, and 0.96 for satisfied, neutral, and dissatisfied classes, respectively.

Feature Importance Analysis and Machine Learning for Alzheimer’s Disease Early Detection: Feature Fusion of the Hippocampus, Entorhinal Cortex, and Standardized Uptake Value Ratio

Introduction: Alzheimer’s disease (AD) is a progressive neurological disorder characterized by mild memory loss and ranks as a leading cause of mortality in the USA, accounting for approximately 120,000 deaths per year. It is also the primary form of dementia. Early detection is critical for timely intervention as the neurodegenerative process often starts 15–20 years before cognitive symptoms manifest. This study focuses on determining feature importance in AD classification using fused texture features from 3D magnetic resonance imaging hippocampal and entorhinal cortex and standardized uptake value ratio (SUVR) derived from positron emission tomography (PET) images. Methods: To achieve this objective, we employed four distinct classifiers (Linear Support Vector Classification, Linear Discriminant Analysis, Logistic Regression, and Logistic Regression Classifier with Stochastic Gradient Descent Learning). These classifiers were used to derive both average and top-ranked importance scores for each feature based on their outputs. Our framework is designed to distinguish between two classes, AD-negative (or mild cognitive impairment stable [MCIs]) and AD-positive (or MCI conversion [MCIc]), using a probabilistic neural network classifier and the Alzheimer’s Disease Neuroimaging Initiative (ADNI) database. Results: The findings from the feature importance highlight the crucial role of the GLCM texture features extracted from the hippocampus and entorhinal cortex, demonstrating their superior performance compared to the volume and SUVR. GLCM texture AD classification achieved approximately 90% sensitivity in identifying MCIc cases while maintaining low false positives (below 30%) when fused with other features. Moreover, the receiver operating characteristic curves validate the GLCMs’ superior performance in distinguishing between MCIs and MCIc. Additionally, fusing different types of features improved classification performance compared to relying solely on any single feature category. Conclusion: Our study emphasizes the pivotal role of GLCM texture features in early Alzheimer’s detection.

Sentiment Analysis - An optimized Weighted Horizontal Ensemble approach

Sentiment Analysis has gained authority as one of the primary means of analyzing feedbacks and opinion by individuals, organizations and governments. The result of sentiment analysis informs an organization on areas to improve and how best to manage customers. While sentiment analysis may be misleading as no algorithm has been considered 100% efficient, the choice of algorithms can optimize the result based on the dataset in question. This paper aims at studying various algorithms and implementing a weighted horizontal ensemble algorithm as a panacea to low confidence level in the results of sentiment analysis. We designed a system that implements the original Naive Bayes algorithm, Multinomial Naïve Bayes algorithm, Bernoulli Native Bayes algorithm, Logistic Regression algorithm, Linear Support Vector Classifier algorithm and the Stochastic Gradient Descent algorithm. Our dataset was sourced from the Stanford University. It contains fifty thousand (50,000) movie reviews. Dataset from the Nigerian movie review was used to test the models. The reviews were encoded as a sequence of word indices. An accuracy of over 91% was achieved. The Ensemble technique delivered an F1-measure of 90%. Ensemble technique provides a more reliable confidence level on sentiment analysis. The researchers also discovered that change in writing style can affect the performance of sentiment analysis

The effect of harmonization on the variability of PET radiomic features extracted using various segmentation methods

PurposeThis study aimed to examine the robustness of positron emission tomography (PET) radiomic features extracted via different segmentation methods before and after ComBat harmonization in patients with non-small cell lung cancer (NSCLC).MethodsWe included 120 patients (positive recurrence = 46 and negative recurrence = 74) referred for PET scanning as a routine part of their care. All patients had a biopsy-proven NSCLC. Nine segmentation methods were applied to each image, including manual delineation, K-means (KM), watershed, fuzzy-C-mean, region-growing, local active contour (LAC), and iterative thresholding (IT) with 40, 45, and 50% thresholds. Diverse image discretizations, both without a filter and with different wavelet decompositions, were applied to PET images. Overall, 6741 radiomic features were extracted from each image (749 radiomic features from each segmented area). Non-parametric empirical Bayes (NPEB) ComBat harmonization was used to harmonize the features. Linear Support Vector Classifier (LinearSVC) with L1 regularization For feature selection and Support Vector Machine classifier (SVM) with fivefold nested cross-validation was performed using StratifiedKFold with ‘n_splits’ set to 5 to predict recurrence in NSCLC patients and assess the impact of ComBat harmonization on the outcome.ResultsFrom 749 extracted radiomic features, 206 (27%) and 389 (51%) features showed excellent reliability (ICC ≥ 0.90) against segmentation method variation before and after NPEB ComBat harmonization, respectively. Among all, 39 features demonstrated poor reliability, which declined to 10 after ComBat harmonization. The 64 fixed bin widths (without any filter) and wavelets (LLL)-based radiomic features set achieved the best performance in terms of robustness against diverse segmentation techniques before and after ComBat harmonization. The first-order and GLRLM and also first-order and NGTDM feature families showed the largest number of robust features before and after ComBat harmonization, respectively. In terms of predicting recurrence in NSCLC, our findings indicate that using ComBat harmonization can significantly enhance machine learning outcomes, particularly improving the accuracy of watershed segmentation, which initially had fewer reliable features than manual contouring. Following the application of ComBat harmonization, the majority of cases saw substantial increase in sensitivity and specificity.ConclusionRadiomic features are vulnerable to different segmentation methods. ComBat harmonization might be considered a solution to overcome the poor reliability of radiomic features.

A complexity evaluation system for mitral valve repair based on preoperative echocardiographic and machine learning

BackgroundTo develop a novel complexity evaluation system for mitral valve repair based on preoperative echocardiographic data and multiple machine learning algorithms. MethodsFrom March 2021 to March 2023, 231 consecutive patients underwent mitral valve repair. Clinical and echocardiographic data were included in the analysis. The end points included immediate mitral valve repair failure (mitral replacement secondary to mitral repair failure) and recurrence regurgitation (moderate or greater mitral regurgitation [MR] before discharge). Various machine learning algorithms were used to establish the complexity evaluation system. ResultsA total of 231 patients were included in this study; the median ejection fraction was 66% (63–70%), and 159 (68.8%) patients were men. Mitral repair was successful in 90.9% (210 of 231) of patients. The linear support vector classification model has the best prediction results in training and test cohorts and the variables of age, A2 lesions, leaflet height, MR grades, and so on were risk factors for failure of mitral valve repair. ConclusionThe linear support vector classification prediction model may allow the evaluation of the complexity of mitral valve repair. Age, A2 lesions, leaflet height, MR grades, and so on may be associated with mitral repair failure.

CT Image-Based Radiomic Analysis for Detecting PD-L1 Expression Status in Bladder Cancer Patients

Rationale and ObjectivesThe role of Programmed death-ligand 1 (PD-L1) expression is crucial in guiding immunotherapy selection. This study aims to develop and evaluate a radiomic model, leveraging Computed Tomography (CT) imaging, with the objective of predicting PD-L1 expression status in patients afflicted with bladder cancer. Materials and MethodsThe study encompassed 183 subjects diagnosed with histologically confirmed bladder cancer, among which the PD-L1(+) cohort constituted 60.1% of the total population. Stratified random sampling was utilized at a 7:3 ratio. We employed five diverse machine learning algorithms—Decision Tree, Random Forest, Linear Support Vector Classification, Support Vector Machine, and Logistic Regression—to establish radiomic models on the training dataset. These models endeavored to predict PD-L1 expression status premised on radiomic features derived from region-of-interest (ROI) segmentation. Subsequent to this, the predictive performance of these models was examined on a validation set employing the receiver operating characteristic (ROC) curve. The DeLong test was utilized to contrast ROC curves, thereby pinpointing the model with superior predictive accuracy. ResultsSixteen features were chosen for the model construction. All five models revealed strong performance in the training set (AUC, 0.920-1) and commendable predictive ability in the validation set (AUC, 0.753-0.766). As per the DeLong test, no statistically significant disparities were observed among any of the models (P>0.05) in the validation set. Additional verification through the calibration curve and decision curve analysis indicated that the Logistic Regression model exhibited extraordinary precision and practicality. ConclusionOur machine learning model, grounded on radiomic features, demonstrated its proficiency in accurately distinguishing bladder cancer patients with high PD-L1 expression. Future research, incorporating more exhaustive datasets, could potentially augment the predictive efficiency of radiomic algorithms, thereby advancing their clinical utility.

Biosignal comparison for autism assessment using machine learning models and virtual reality

Clinical assessment procedures encounter challenges in terms of objectivity because they rely on subjective data. Computational psychiatry proposes overcoming this limitation by introducing biosignal-based assessments able to detect clinical biomarkers, while virtual reality (VR) can offer ecological settings for measurement. Autism spectrum disorder (ASD) is a neurodevelopmental disorder where many biosignals have been tested to improve assessment procedures. However, in ASD research there is a lack of studies systematically comparing biosignals for the automatic classification of ASD when recorded simultaneously in ecological settings, and comparisons among previous studies are challenging due to methodological inconsistencies. In this study, we examined a VR screening tool consisting of four virtual scenes, and we compared machine learning models based on implicit (motor skills and eye movements) and explicit (behavioral responses) biosignals. Machine learning models were developed for each biosignal within the virtual scenes and then combined into a final model per biosignal. A linear support vector classifier with recursive feature elimination was used and tested using nested cross-validation. The final model based on motor skills exhibited the highest robustness in identifying ASD, achieving an AUC of 0.89 (SD = 0.08). The best behavioral model showed an AUC of 0.80, while further research is needed for the eye-movement models due to limitations with the eye-tracking glasses. These findings highlight the potential of motor skills in enhancing objectivity and reliability in the early assessment of ASD compared to other biosignals.

Ensemble Methods to Optimize Automated Text Classification in Avatar Therapy

Background: Psychotherapeutic approaches such as Avatar Therapy (AT) are novel therapeutic attempts to help patients diagnosed with treatment-resistant schizophrenia. Qualitative analyses of immersive sessions of AT have been undertaken to enhance and refine the existing interventions taking place in this therapy. To account for the time-consuming and costly nature and potential misclassification biases, prior implementation of a Linear Support Vector Classifier provided helpful insight. Single model implementation for text classification is often limited, especially for datasets containing imbalanced data. The main objective of this study is to evaluate the change in accuracy of automated text classification machine learning algorithms when using an ensemble approach for immersive session verbatims of AT. Methods: An ensemble model, comprising five machine learning algorithms, was implemented to conduct text classification for avatar and patient interactions. The models included in this study are: Multinomial Naïve Bayes, Linear Support Vector Classifier, Multi-layer perceptron classifier, XGBClassifier and the K-Nearest-Neighbor model. Accuracy, precision, recall and f1-score were compared for the individual classifiers and the ensemble model. Results: The ensemble model performed better than its individual counterparts for accuracy. Conclusion: Using an ensemble methodological approach, this methodology might be employed in future research to provide insight into the interactions being categorized and the therapeutical outcome of patients based on their experience with AT with optimal precision.

A Machine Learning Ensemble Model for the Detection of Cyberbullying

The pervasive use of social media platforms, such as Facebook, Instagram, and X, has significantly amplified our electronic interconnectedness. Moreover, these platforms are now easily accessible from any location at any given time. However, the increased popularity of social media has also led to cyberbullying.It is imperative to address the need for finding, monitoring, and mitigating cyberbullying posts on social media platforms. Motivated by this necessity, we present this paper to contribute to developing an automated system for detecting binary labels of aggressive tweets.Our study has demonstrated remarkable performance compared to previous experiments on the same dataset. We employed the stacking ensemble machine learning method, utilizing four various feature extraction techniques to optimize performance within the stacking ensemble learning framework. Combining five machine learning algorithms,Decision Trees, Random Forest, Linear Support Vector Classification, Logistic Regression, and K-Nearest Neighbors into an ensemble method, we achieved superior results compared to traditional machine learning classifier models. The stacking classifier achieved a high accuracy rate of 94.00%, outperforming traditional machine learning models and surpassing the results of prior experiments that utilized the same dataset. The outcomes of our experiments showcased an accuracy rate of 0.94% in detection tweets as aggressive or non-aggressive.

BPAGS: a web application for bacteriocin prediction via feature evaluation using alternating decision tree, genetic algorithm, and linear support vector classifier.

The use of bacteriocins has emerged as a propitious strategy in the development of new drugs to combat antibiotic resistance, given their ability to kill bacteria with both broad and narrow natural spectra. Hence, a compelling requirement arises for a precise and efficient computational model that can accurately predict novel bacteriocins. Machine learning's ability to learn patterns and features from bacteriocin sequences that are difficult to capture using sequence matching-based methods makes it a potentially superior choice for accurate prediction. A web application for predicting bacteriocin was created in this study, utilizing a machine learning approach. The feature sets employed in the application were chosen using alternating decision tree (ADTree), genetic algorithm (GA), and linear support vector classifier (linear SVC)-based feature evaluation methods. Initially, potential features were extracted from the physicochemical, structural, and sequence-profile attributes of both bacteriocin and non-bacteriocin protein sequences. We assessed the candidate features first using the Pearson correlation coefficient, followed by separate evaluations with ADTree, GA, and linear SVC to eliminate unnecessary features. Finally, we constructed random forest (RF), support vector machine (SVM), decision tree (DT), logistic regression (LR), k-nearest neighbors (KNN), and Gaussian naïve Bayes (GNB) models using reduced feature sets. We obtained the overall top performing model using SVM with ADTree-reduced features, achieving an accuracy of 99.11% and an AUC value of 0.9984 on the testing dataset. We also assessed the predictive capabilities of our best-performing models for each reduced feature set relative to our previously developed software solution, a sequence alignment-based tool, and a deep-learning approach. A web application, titled BPAGS (Bacteriocin Prediction based on ADTree, GA, and linear SVC), was developed to incorporate the predictive models built using ADTree, GA, and linear SVC-based feature sets. Currently, the web-based tool provides classification results with associated probability values and has options to add new samples in the training data to improve the predictive efficacy. BPAGS is freely accessible at https://shiny.tricities.wsu.edu/bacteriocin-prediction/.

A fine-tuning of decision tree classifier for ransomware detection based on memory data

Ransomware has evolved into a pervasive and extremely disruptive cybersecurity threat, causing substantial operational and financial damage to individuals and businesses. This article explores the critical domain of Ransomware detection and employs Machine Learning (ML) classifiers, particularly Decision Tree (DT), for Ransomware detection. The article also delves into the usefulness of DT in identifying Ransomware attacks, leveraging the innate ability of DT to recognize complex patterns within datasets. Instead of merely introducing DT as a detection method, we adopt a comprehensive approach, emphasizing the importance of fine-tuning DT hyperparameters. The optimization of these parameters is essential for maximizing the DT capability to identify Ransomware threats accurately. The obfuscated-MalMem2022 dataset, which is well-known for its extensive and challenging Ransomware-related data, was utilized to evaluate the effectiveness of DT in detecting Ransomware. The implementation uses the versatile Python programming language, renowned for its efficiency and adaptability in data analysis and ML tasks. Notably, the DT classifier consistently outperforms other classifiers in Ransomware detection, including K-Nearest Neighbors, Gradient Boosting Tree, Naive Bayes, and Linear Support Vector Classifier. For instance, the DT demonstrated exceptional effectiveness in distinguishing between Ransomware and benign data, as evidenced by its remarkable accuracy of 99.97%.

Predicting Football Match Outcomes with Machine Learning Approaches

The increasing use of data-driven approaches has led to the development of models to predict football match outcomes. However, predicting match outcomes accurately remains a challenge due to the sport's inherent unpredictability. In this study, we have investigated the usage of different machine learning models in predicting the outcome of English Premier League matches. We assessed the performance of random forest, logistic regression, linear support vector classifier and extreme gradient boosting models for binary and multiclass classification. These models are trained with datasets obtained using different sampling techniques. The result showed that the models performed better when trained with dataset obtained using a balanced sampling technique for binary classification. Additionally, the models' predictions were evaluated by conducting simulation on football betting profits based on the 2022-2023 EPL season. The model achieved the highest accuracy is the binary class random forest, but the model provided the highest football betting profit is the binary class logistic regression.

A large-scale sentiment analysis using political tweets

<p><span lang="EN-US">Twitter has become a key element of political discourse in candidates’ campaigns. The political polarization on Twitter is vital to politicians as it is a popular public medium to analyze and predict public opinion concerning political events. The analysis of the sentiment of political tweet contents mainly depends on the quality of sentiment lexicons. Therefore, it is crucial to create sentiment lexicons of the highest quality. In the proposed system, the domain-specific of the political lexicon is constructed by using the supervised approach to extract extreme political opinions words, and features in tweets. Political multi-class sentiment analysis (PMSA) system on the big data platform is developed to predict the inclination of tweets to infer the results of the elections by conducting the analysis on different political datasets: including the Trump election dataset and the BBC News politics. The comparative analysis is the experimental results which are better political text classification by using the three different models (multinomial naïve Bayes (MNB), decision tree (DT), linear support vector classification (SVC)). In the comparison of three different models, linear SVC has the better performance than the other two techniques. The analytical evaluation results show that the proposed system can be performed with 98% accuracy in linear SVC.</span></p>