Chi Square Feature Selection Methods Research Articles

The value of CCTA combined with machine learning for predicting angina pectoris in the anomalous origin of the right coronary artery

BackgroundAnomalous origin of coronary artery is a common coronary artery anatomy anomaly. The anomalous origin of the coronary artery may lead to problems such as narrowing of the coronary arteries at the beginning of the coronary arteries and abnormal alignment, which may lead to myocardial ischemia due to the compression of the coronary arteries. Clinical symptoms include chest tightness and dyspnea, with angina pectoris as a common symptom that can be life-threatening. Timely and accurate diagnosis of anomalous coronary artery origin is of great importance. Coronary computed tomography angiography (CCTA) can provide detailed information on the characteristics of coronary arteries. Therefore, we combined CCTA and artificial intelligence (AI) technology to analyze the CCTA image features and clinical features of patients with anomalous origin of the right coronary artery to predict angina pectoris and the relevance of different features to angina pectoris.MethodsIn this retrospective analysis, we compiled data on 15 characteristics from 126 patients diagnosed with anomalous right coronary artery origins. The dataset encompassed both CCTA imaging attributes, such as the positioning of the right coronary artery orifices and the alignment of coronary arteries, and clinical parameters including gender and age. To identify the most salient features, we employed the Chi-square feature selection method, which filters features based on their statistical significance. We then focused on features yielding a Chi-square score exceeding a threshold of 1, thereby narrowing down the selection to seven key variables, including cardiac function and gender. Subsequently, we evaluated seven classifiers known for their efficacy in classification tasks. Through rigorous training and testing, we conducted a comparative analysis to identify the top three classifiers with the highest accuracy rates.ResultsThe top three classifiers in this study are Support Vector Machine (SVM), Ensemble Learning (EL), and Kernel Approximation Classifier. Among the SVM, EL and Kernel Approximation Classifier-based classifiers, the best performance is achieved for linear SVM, optimizable Ensembles Learning and SVM kernel, respectively. And the corresponding accuracy is 75.7%, 75.7%, and 73.0%, respectively. The AUC values are 0.77, 0.80, and 0.75, respectively.ConclusionsMachine learning (ML) models can predict angina pectoris caused by the origin anomalous of the right coronary artery, providing valuable auxiliary diagnostic information for clinicians and serving as a warning to clinicians. It is hoped that timely intervention and treatment can be realized to avoid serious consequences such as myocardial infarction.

Deep learning approach to detect cyberbullying on twitter

AbstractIn recent years, especially children and adolescents have shown increased interest in social media, making them a potential risk group for cyberbullying. Cyberbullying posts spread very quickly, often taking a long time to be deleted and sometimes remaining online indefinitely. Cyberbullying can have severe mental, psychological, and emotional effects on children and adolescents, and in extreme cases, it can lead to suicide. Turkey is among the top 10 countries with the highest number of children who are victims of cyberbullying. However, there are very few studies conducted in the Turkish language on this topic. This study aims to identify cyberbullying in Turkish Twitter posts. The Multi-Layer Detection (MLP) based model was evaluated using a dataset of 5000 tweets. The model was trained using both social media features and textual features extracted from the dataset. Textual features were obtained using various feature extraction methods such as Bag of Words (BOW), Term Frequency-Inverse Term Frequency (TF-IDF), Hashing Vectorizer, N-gram, and word embedding. These features were utilized in training the model, and their effectiveness was evaluated. The experiments revealed that the features obtained from TF-IDF and unigram methods significantly improved the model’s performance. Subsequently, unnecessary features were eliminated using the Chi-Square feature selection method. The proposed model achieved a higher accuracy of 93.2% compared to machine learning (ML) methods used in previous studies on the same dataset. Additionally, the proposed model was compared with popular deep learning models in the literature, such as LSTM, BLSTM, and CNN, demonstrating promising results.

An Improved Ensemble-Based Cardiovascular Disease Detection System with Chi-Square Feature Selection

Cardiovascular disease (CVD) is a leading cause of death globally; therefore, early detection of CVD is crucial. Many intelligent technologies, including deep learning and machine learning (ML), are being integrated into healthcare systems for disease prediction. This paper uses a voting ensemble ML with chi-square feature selection to detect CVD early. Our approach involved applying multiple ML classifiers, including naïve Bayes, random forest, logistic regression (LR), and k-nearest neighbor. These classifiers were evaluated through metrics including accuracy, specificity, sensitivity, F1-score, confusion matrix, and area under the curve (AUC). We created an ensemble model by combining predictions from the different ML classifiers through a voting mechanism, whose performance was then measured against individual classifiers. Furthermore, we applied chi-square feature selection method to the 303 records across 13 clinical features in the Cleveland cardiac disease dataset to identify the 5 most important features. This approach improved the overall accuracy of our ensemble model and reduced the computational load considerably by more than 50%. Demonstrating superior effectiveness, our voting ensemble model achieved a remarkable accuracy of 92.11%, representing an average improvement of 2.95% over the single highest classifier (LR). These results indicate the ensemble method as a viable and practical approach to improve the accuracy of CVD prediction.

Phishing URL Detection using Machine Learning

Abstract: Phishing attacks pose a significant threat in cyberspace, Cybercrimes such as Phishing means accessing personal data and violating security through the Internet and its main aim is to steal the information from the users using different techniques in that the primary one is Phishing which demands effective detection mechanisms. This study evaluates the performance of Gradient Boosting Classifier, Random Forest, and Decision Tree machine learning models in conjunction with feature selection techniques namely SelectKBest and Chi-Square. Initially, a comprehensive feature set of 30 attributes achieved a baseline accuracy of 97.4%. Through SelectKBest and Chi-Square feature selection methods, 13 key features were identified, leading to a slightly decreased accuracy of 95.6% upon model retraining. This research highlights the importance of feature selection in enhancing phishing detection accuracy while maintaining model interpretability. Technologies such as NumPy, Pandas, Matplotlib, Scikit-learn, and Flask drive. The project, emphasising the exploration of ML models, EDA (Exploratory Data Analysis) on phishing data, and understanding feature importance. The Machine Learning Models like Gradient Boosting Classifier, Random Forest and Decision tree are used to detect whether the given URL is Malicious URL or Legitimate URL using Comprehensive Feature set and Key Feature set. This Models and Feature sets are compared based on the Performance Metrics namely Accuracy, Precision, Recall and F1- score. This study contributes to advancing cyber defence mechanism through the fusion of sophisticated Machine Learning algorithms and meticulous Feature Selection methodologies.

Comparison of Gain Ratio and Chi-Square Feature Selection Methods in Improving SVM Performance on IDS

An intrusion detection system (IDS) is a security technology designed to identify and monitor suspicious activity in a computer network or system and detect potential attacks or security breaches. The importance of accuracy in IDS must be addressed, given that the response to any alert or activity generated by the system must be precise and measurable. However, achieving high accuracy in IDS requires a process that takes work. The complex network environment and the diversity of attacks led to significant challenges in developing IDS. The application of algorithms and optimization techniques needs to be considered to improve the accuracy of IDS. Support vector machine (SVM) is one data mining method with a high accuracy level in classifying network data packet patterns. A feature selection stage is needed for an optimal classification process, which can also be applied to SVM. Feature selection is an essential step in the data preprocessing phase; optimization of data input can improve the performance of the SVM algorithm, so this study compares the performance between feature selection algorithms, namely Information Gain Ratio and Chi-Square, and then classifies IDS data using the SVM algorithm. This outcome implies the importance of selecting the right features to develop an effective IDS.

Using Multilayer Perceptron Neural Network to Assess the Critical Factors of Traffic Accidents

This study is based on the traffic accident data of Taoyuan City from the government's open data. The study compiled the data set of traffic accidents in Taiwan from 2012 to 2017, and six classifiers were applied to evaluate the effectiveness of traffic accident prediction with the number of injuries as the prediction target. In order to verify the classifier's stability, cross-validation was used to evaluate the model during the training process, and the multilayer perceptron neural network (MLPNN) classifier performed best in testing the dataset's accuracy and evaluating the model's best performance. Then, a boosting ensemble learning approach and a combination of traffic accident factors improve the experiment's performance. According to this experiment, the results show that this study uses the Pearson Chi-square feature selection method to select important traffic factor combinations, and the boosting method indeed helps improve the effectiveness of the construction of the traffic accident model. Finally, the experimental results of the NN-MLP model have a correct rate of 77% and AUC is 78.7%. In constructing the model, it was found that the degree of injury, the part of the vehicle hit, the type of accident, the leading cause, the type of vehicle, and the period of the accident were the main factors causing dangerous traffic accidents. Doi: 10.28991/HIJ-2024-05-01-012 Full Text: PDF

Sentiment Analysis of Covid-19 Bansos Issues on Twitter using Chi-Square and Naïve Bayes

Social assistance or what is often called Bansos (Bantuan Sosial) is assistance in the form of goods or money from the government for the community that is temporary and selective. There were many reports from the public complaining that some had not received assistance or had not received it at all. This problematic social assistance has caused a stir in public reports on various social media, including Twitter. To find out the classification of public opinion related to social assistance on Twitter, it is necessary to do pre-processing and analysis of tweets. The dataset used is data crawled using the Twitter API and produces 702 tweet data in CSV format. Tweets retrieved based on the keyword 'bansos' in August 2021. The dataset is divided into two categories, positive and negative. Data with a total of 328 positive categories and 374 data of negative categories. The method applied in this study uses the Chi-Square feature selection method and the Naïve Bayes Classifier algorithm. The purpose of this research is to produce a website-based application that can classify tweets related to social assistance covid-19 into 2 categories, positive and negative by using the Chi-Square feature selection and the Naïve Bayes Classifier algorithm. The F1 score in the positive class is 85% and the negative class is 89% and produces an accuracy value of 87%. The results of the comparison between Naive Bayes and Naive Bayes using Chi-Square show that there is no difference in accuracy.

Survival Prediction of Children Undergoing Hematopoietic Stem Cell Transplantation Using Different Machine Learning Classifiers by Performing Chi-Square Test and Hyperparameter Optimization: A Retrospective Analysis

Bone marrow transplant (BMT) is an effective surgical treatment for bone marrow-related disorders. However, several associated risk factors can impair long-term survival after BMT. Machine learning (ML) technologies have been proven useful in survival prediction of BMT receivers along with the influences that limit their resilience. In this study, an efficient classification model predicting the survival of children undergoing BMT is presented using a public dataset. Several supervised ML methods were investigated in this regard with an 80-20 train-test split ratio. To ensure prediction with minimal time and resources, only the top 11 out of the 59 dataset features were considered using Chi-square feature selection method. Furthermore, hyperparameter optimization (HPO) using the grid search cross-validation (GSCV) technique was adopted to increase the accuracy of prediction. Four experiments were conducted utilizing a combination of default and optimized hyperparameters on the original and reduced datasets. Our investigation revealed that the top 11 features of HPO had the same prediction accuracy (94.73%) as the entire dataset with default parameters, however, requiring minimal time and resources. Hence, the proposed approach may aid in the development of a computer-aided diagnostic system with satisfactory accuracy and minimal computation time by utilizing medical data records.

COVID-19 lung infection detection using deep learning with transfer learning and ResNet101 features extraction and selection

Deep learning artificial intelligent (AI) methods have potential to help improve diagnostic efficiency and accuracy for reading portable CXRs. Public datasets taken from SIRM and Kaggle repositories comprised of COVID-19 (N = 130, 975), normal (N = 138, 1525), bacterial pneumonia (N = 145, 2521), non-COVID-19 viral pneumonia (N = 145, 1342) respectively CXRs were analyzed. On the first dataset, we first extracted 2048 features from last pooling layer of Residual Network 101 (ResNet101) which were fed into selected classifiers. The three-class (Covid-19, normal, viral) yielded highest accuracy of 97.30% using support vector machine linear (SVM-L). This accuracy was further improved to 98.20% by applying the chi-square feature selection method. The four-class using original ResNet101 features yielded highest accuracy of 85.06% which was further improved to 87.01% using chi-square and recursive feature elimination (RFE) feature selection methods. Moreover, using the second dataset, we utilized and optimized robust deep learning methods including densenet201, inception-V3, ResNet101, GoogleNet and VGG-19 using transfer learning approach. The densenet201 yielded the highest performance for three-class (Covid-19, normal, pneumonia) to detect Covid-19 with accuracy (99.92%).The results revealed that feature selection methods improved multiclass classification as dynamic deep feature may contains redundant information. Thus, proposed methods have the potential to improve diagnostic efficiency and accuracy for portable CXRs.

Smart Cities-Based Improving Atmospheric Particulate Matters Prediction Using Chi-Square Feature Selection Methods by Employing Machine Learning Techniques

ABSTRACT Particulate matter is emitted from diverse sources and affect the human health very badly. Dust particles exposure from the stated environment can affect our heart and lungs very badly. The particle pollution exposure creates a variety of problems including nonfatal heart attacks, premature deaths in people with lung or heart disease, asthma, difficulty in breathing, etc. In this article, we developed an automated tool by computing multimodal features to capture the diverse dynamics of ambient particulate matter and then applied the Chi-square feature selection method to acquire the most relevant features. We also optimized parameters of robust machine learning algorithms to further improve the prediction performance such as Decision Tree, SVM with Linear and Regression, Naïve Bayes (NB), Random Forest (RF), Ensemble Classifier, K-Nearest Neighbor, and XGBoost for classification. The classification results with and without feature selection methods yielded the highest detection performance with random forest, and GBM yielded 100% of accuracy and AUC. The results revealed that the proposed methodology is more robust to provide an efficient system that will detect the particulate matters automatically and will help the individuals to improve their lifestyle and comfort. The concerned department can monitor the individual’s healthcare services and reduce the mortality risk

A New Technique for Sentiment Analysis System Based on Deep Learning Using Chi-Square Feature Selection Methods

A New Technique for Sentiment Analysis System Based on Deep Learning Using Chi-Square Feature Selection Methods

Comparison of Four Data Mining Algorithms for Predicting Colorectal Cancer Risk

Background & Objective: Colorectal cancer (CRC) is one of the most prevalent malignancies in the world. The early detection of CRC is not only a simple process but also is the key to treatment. Data mining algorithms could be potentially useful in cancer prognosis, diagnosis, and treatment. Therefore, the main focus of this study is to measure the performance of some data mining classifier algorithms in predicting CRC and providing an early warning to the high-risk groups. Materials & Methods: This study was performed on 468 subjects, including 194 CRC patients and 274 non-CRC cases. We used the CRC dataset from Imam Hospital, Sari, Iran. The Chi-square feature selection method was utilized to analyze the risk factors. Next, four popular data mining algorithms were compared in terms of their performance in predicting CRC, and, finally, the best algorithm was identified. Results: The best outcome was obtained by J-48 with F-measure=0.826, receiver operating characteristic (ROC)=0.881, precision=0.826, and sensitivity =0.827. Bayesian net was the second-best performer (F-Measure=0.718, ROC=0.784, precision=0.719, and sensitivity=0.722) followed by random forest (F-Measure=0.705, ROC=0.758, precision=0.719, and sensitivity=0.712). The multilayer perceptron technique had the worst performance (F-Measure=0.702, ROC=0.76, precision=0.701, and sensitivity=0.703). Conclusion: According to the results of this study, J-48 could provide better insights than other proposed prediction models for clinical applications. © 2021, Zanjan University of Medical Sciences and Health Services. All rights reserved.

Feature Selection Approach for Improving the Accuracy of Software Bug Prediction

We recently noticed the advancement and growth in the field of artificial intelligence and in its various branches such as Machine Learning (ML) and Deep Learning in various vital fields such as robotics, smart cars, smart cities, health care, software engineering and many other fields. Software bug prediction are one of the most important ML uses in software engineering. In addition, the feature selection is one of ML methods that aim to reduce a feature set that are used for building models. In this paper, we propose to use the Chi-Square feature selection method to calculate features importance, then to build a ML models, first by using top ten important features and second by using top five important features, based on three of well-known ML classifications algorithms, Support Vector Machine, Naïve Bayes and Linear Discriminant Analysis, with adding and exploring more about the effeteness of new metric of code smell intensity, the performance results of our approach against baseline achieved an improvements as average accuracy among nine datasets reaching up to 5.12%, 4.15% and 1% on the NB, SVM and LDA classifiers respectively.

Spatial prediction of rotational landslide using geographically weighted regression, logistic regression, and support vector machine models in Xing Guo area (China)

ABSTRACTThis study evaluated the geographically weighted regression (GWR) model for landslide susceptibility mapping in Xing Guo County, China. In this study, 16 conditioning factors, such as slope, aspect, altitude, topographic wetness index, stream power index, sediment transport index, soil, lithology, normalized difference vegetation index (NDVI), landuse, rainfall, distance to road, distance to river, distance to fault, plan curvature, and profile curvature, were analyzed. Chi-square feature selection method was adopted to compare the significance of each factor with landslide occurence. The GWR model was compared with two well-known models, namely, logistic regression (LR) and support vcector machine (SVM). Results of chi-square feature selection indicated that lithology and slope are the most influencial factors, whereas SPI was found statistically insignificant. Four landslide susceptibility maps were generated by GWR, SGD-LR, SGD-SVM, and SVM models. The GWR model exhibited the highest performance in terms of success rate and prediction accuracy, with values of 0.789 and 0.819, respectively. The SVM model exhibited slightly lower AUC values than that of the GWR model. Validation result of the four models indicates that GWR is a better model than other widely used models.

Application of Feature Selection Methods and Ensembles on Network Security Dataset

Generally intrusion detection systems (IDS) use all the data features to classify normal and anomaly packet. It has been observed in the studies that some of the data features may be redundant or are less important in this classification process. Authors have studied NSL KDD dataset with different feature selected from Gain Ratio and ChiSquare feature selection methods and carried out the experiments with single Decision Tree and then applied ensemble with Random Forests and Decision Tree with Bagging. Results show that significant feature selection is very important in the design of a lightweight and efficient intrusion detection system. Random Forests are better than Single Decision Tree and Decision Tree with Bagging for the current dataset. Performance of Gain Ratio is better than Chi square feature selection method for this dataset.

Research on an Improved CHI Feature Selection Method

In order to make the features selected are distributed intensively in a certain class ,evenly in that certain class as much as possible, and make features appear in that certain class as many as possible , three adjusted parameters are added to the originally traditional CHI-square feature selection method through analyzing the relevance between features and classes. Var-CHI statistic method based on variance makes the precision and recall improved apparently by comparing the experiments of the traditional CHI-square feature selection method and the improved one.