Wrapper-based Feature Selection Research Articles

Two-Stage Training Framework Using Multicontrast MRI Radiomics for IDH Mutation Status Prediction in Glioma.

Purpose To develop a radiomics framework for preoperative MRI-based prediction of isocitrate dehydrogenase (IDH) mutation status, a crucial glioma prognostic indicator. Materials and Methods Radiomics features (shape, first-order statistics, and texture) were extracted from the whole tumor or the combination of nonenhancing, necrosis, and edema regions. Segmentation masks were obtained via the federated tumor segmentation tool or the original data source. Boruta, a wrapper-based feature selection algorithm, identified relevant features. Addressing the imbalance between mutated and wild-type cases, multiple prediction models were trained on balanced data subsets using random forest or XGBoost and assembled to build the final classifier. The framework was evaluated using retrospective MRI scans from three public datasets (The Cancer Imaging Archive [TCIA, 227 patients], the University of California San Francisco Preoperative Diffuse Glioma MRI dataset [UCSF, 495 patients], and the Erasmus Glioma Database [EGD, 456 patients]) and internal datasets collected from the University of Texas Southwestern Medical Center (UTSW, 356 patients), New York University (NYU, 136 patients), and University of Wisconsin-Madison (UWM, 174 patients). TCIA and UTSW served as separate training sets, while the remaining data constituted the test set (1617 or 1488 testing cases, respectively). Results The best performing models trained on the TCIA dataset achieved area under the receiver operating characteristic curve (AUC) values of 0.89 for UTSW, 0.86 for NYU, 0.93 for UWM, 0.94 for UCSF, and 0.88 for EGD test sets. The best performing models trained on the UTSW dataset achieved slightly higher AUCs: 0.92 for TCIA, 0.88 for NYU, 0.96 for UWM, 0.93 for UCSF, and 0.90 for EGD. Conclusion This MRI radiomics-based framework shows promise for accurate preoperative prediction of IDH mutation status in patients with glioma. Keywords: Glioma, Isocitrate Dehydrogenase Mutation, IDH Mutation, Radiomics, MRI Supplemental material is available for this article. Published under a CC BY 4.0 license. See also commentary by Moassefi and Erickson in this issue.

Predictive modeling of multi-class diabetes mellitus using machine learning and filtering iraqi diabetes data dynamics.

Diabetes is a persistent metabolic disorder linked to elevated levels of blood glucose, commonly referred to as blood sugar. This condition can have detrimental effects on the heart, blood vessels, eyes, kidneys, and nerves as time passes. It is a chronic ailment that arises when the body fails to produce enough insulin or is unable to effectively use the insulin it produces. When diabetes is not properly managed, it often leads to hyperglycemia, a condition characterized by elevated blood sugar levels or impaired glucose tolerance. This can result in significant harm to various body systems, including the nerves and blood vessels. In this paper, we propose a multiclass diabetes mellitus detection and classification approach using an extremely imbalanced Laboratory of Medical City Hospital data dynamics. We also formulate a new dataset that is moderately imbalanced based on the Laboratory of Medical City Hospital data dynamics. To correctly identify the multiclass diabetes mellitus, we employ three machine learning classifiers namely support vector machine, logistic regression, and k-nearest neighbor. We also focus on dimensionality reduction (feature selection-filter, wrapper, and embedded method) to prune the unnecessary features and to scale up the classification performance. To optimize the classification performance of classifiers, we tune the model by hyperparameter optimization with 10-fold grid search cross-validation. In the case of the original extremely imbalanced dataset with 70:30 partition and support vector machine classifier, we achieved maximum accuracy of 0.964, precision of 0.968, recall of 0.964, F1-score of 0.962, Cohen kappa of 0.835, and AUC of 0.99 by using top 4 feature according to filter method. By using the top 9 features according to wrapper-based sequential feature selection, the k-nearest neighbor provides an accuracy of 0.935 and 1.0 for the other performance metrics. For our created moderately imbalanced dataset with an 80:20 partition, the SVM classifier achieves a maximum accuracy of 0.938, and 1.0 for other performance metrics. For the multiclass diabetes mellitus detection and classification, our experiments outperformed conducted research based on the Laboratory of Medical City Hospital data dynamics.

Enhancing gastric cancer early detection: A multi-verse optimized feature selection model with crossover-information feedback

Gastric cancer (GC), an acknowledged malignant neoplasm, threatens life and digestive system functionality if not detected and addressed promptly in its nascent stages. The indispensability of early detection for GC to augment treatment efficacy and survival prospects forms the crux of this investigation. Our study introduces an innovative wrapper-based feature selection methodology, referred to as bCIFMVO-FKNN-FS, which integrates a crossover-information feedback multi-verse optimizer (CIFMVO) with the fuzzy k-nearest neighbors (FKNN) classifier. The primary goal of this initiative is to develop an advanced screening model designed to accelerate the identification of patients with early-stage GC. Initially, the capability of CIFMVO is validated through its application to the IEEE CEC benchmark functions, during which its optimization efficiency is measured against eleven cutting-edge algorithms across various dimensionalities—10, 30, 50, and 100. Subsequent application of the bCIFMVO-FKNN-FS model to the clinical data of 1632 individuals from Wenzhou Central Hospital—diagnosed with either early-stage GC or chronic gastritis—demonstrates the model's formidable predictive accuracy (83.395%) and sensitivity (87.538%). Concurrently, this investigation delineates age, gender, serum gastrin-17, serum pepsinogen I, and the serum pepsinogen I to serum pepsinogen II ratio as parameters significantly associated with early-stage GC. These insights not only validate the efficacy of our proposed model in the early screening of GC but also contribute substantively to the corpus of knowledge facilitating early diagnosis.

Optimized k-nearest neighbors for classification of prosthetic hand movements using electromyography signal

Electromyography (EMG) signals are essential, as they are used to measure muscular activity in different parts of the human body. The measurement and analysis of EMG signal lead to various applications of muscle disorders such as muscular dystrophy, myopathy, hand movements, etc. In this paper, an improved and effective hand movement classification model is developed for amputee subjects. It includes: (1) EMG feature extraction using Discrete Wavelet Transform (DWT), (2) EMG feature selection using binary Global Best Guided Gaussian Artificial Bee Colony (BGGABC), (3) Hand movements classification using Optimized k-nearest neighbors (OKNN) classifier. The EMG signal is taken from the DB3 of NinaPro dataset comprising 17 different prosthetic hand movements recorded from 11 amputee subjects. Thereafter, DWT is applied to decompose the EMG signal for extracting features. An improved wrapper-based feature selection technique (BGGABC) is used to select the optimal feature subset for effective classification. The two variants of KNN, i.e. Smallest Modified KNN and Largest Modified KNN are taken in which item strength to a class is optimized for efficient classification. The strength of an item to a class depends on distance and weight of an item to a class. Therefore, a multi-objective Non-dominated sorting genetic algorithm-II (NSGA-II) is used for optimizing these two contradictory parameters (distance and weight) simultaneously to have optimized variants, namely: Optimized Smallest KNN (OSKNN) and Optimized Largest KNN (OLKNN). Extensive results show that the proposed method OKNN achieved the highest classification accuracy of 93.07% (OLKNN) and 89.43% (OSKNN) compared with KNN variants and competitors.

Cumulative histogram as a feature selection technique for anomaly detection

AbstractThe enhancement of Intrusion Detection Systems (IDS) is required to ensure protection of network resources and services. This is a hot research topic, especially in the presence of advanced intrusions and attacks. This paper provides a comparison between Distributed Cumulative Histogram (DCH) as a Feature Selection (FS) technique, Information Gain Ratio (IGR) FS and wrapper-based FS in terms of accuracy and Root Mean Square Error (RMSE). The utilization of DCH of the traffic instances in normal and attack cases allows us to compare the traffic charts. We can observe the difference between effective features and less effective ones. We verify the feasibility of using DCH as an FS technique in the field of anomaly detection with just six selected features giving more accurate results with most classifiers compared to the IGR and wrapper-based FS. We applied our experiments on the modern UNSW dataset with the WEKA simulation platform that contains a group of classification, feature reduction and selection techniques.

Improved Ozone Level Detection through Feature Selection with Modified Whale Optimization Algorithm

This study presents a new approach for ozone level detection through feature selection by the modified Whale Optimization Algorithm (mWOA). This study aims to enhance the accuracy and efficiency of ozone level prediction models by selecting the most informative features from the dataset. As air quality deterioration poses significant risks to both human health and ecological equilibrium, pinpointing relevant features becomes essential for boosting prediction accuracy. The scope of the research includes comparing the performance of mWOA with the original WOA in two feature selection techniques: filter-based and wrapper-based. The experiments run proposed approaches on a multivariate time-series dataset with 20 repetitions. The evaluation criteria include processing time, number of features selected, and classification accuracy obtained by the kNN classifier. The statistical results demonstrate the effectiveness of the proposed mWOA approach, outperforming WOA due to the modified control parameter that enables a more precise exploration of the search area. The findings of this study reveal the improved performance of mWOA in selecting informative features, resulting in better prediction on average: 93.75% for filter-based and 94.49% for wrapper-based. In conclusion, the wrapper-based feature selection using the mWOA approach proves to be a valuable asset in enhancing the accuracy and efficiency of ozone level detection models. In the future, the proposed technique can be used for more applications in environmental science and engineering research.

CBDA: Chaos-based binary dragonfly algorithm for evolutionary feature selection

The goal of feature selection in machine learning is to simultaneously maintain more classification accuracy, while reducing lager amount of attributes. In this paper, we firstly design a fitness function that achieves both objectives jointly. Then we come up with a chaos-based binary dragonfly algorithm (CBDA) that incorporates several improvements over the conventional dragonfly algorithm (DA) for developing a wrapper-based feature selection method to solve the fitness function. Specifically, the CBDA innovatively introduces three improved factors, namely the chaotic map, evolutionary population dynamics (EPD) mechanism, and binarization strategy on the basis of conventional DA to balance the exploitation and exploration capabilities of the algorithm and make it more suitable to handle the formulated problem. We conduct experiments on 24 well-known data sets from the UCI repository with three ablated versions of CBDA targeting different components of the algorithm in order to explain their contributions in CBDA and also with five established comparative algorithms in terms of fitness value, classification accuracy, CPU running time, and number of selected features. The results show that the proposed CBDA has remarkable advantages in most of the tested data sets.

Securing cloud-enabled smart cities by detecting intrusion using spark-based stacking ensemble of machine learning algorithms

<abstract> <p>With the use of cloud computing, which provides the infrastructure necessary for the efficient delivery of smart city services to every citizen over the internet, intelligent systems may be readily integrated into smart cities and communicate with one another. Any smart system at home, in a car, or in the workplace can be remotely controlled and directed by the individual at any time. Continuous cloud service availability is becoming a critical subscriber requirement within smart cities. However, these cost-cutting measures and service improvements will make smart city cloud networks more vulnerable and at risk. The primary function of Intrusion Detection Systems (IDS) has gotten increasingly challenging due to the enormous proliferation of data created in cloud networks of smart cities. To alleviate these concerns, we provide a framework for automatic, reliable, and uninterrupted cloud availability of services for the network data security of intelligent connected devices. This framework enables IDS to defend against security threats and to provide services that meet the users' Quality of Service (QoS) expectations. This study's intrusion detection solution for cloud network data from smart cities employed Spark and Waikato Environment for Knowledge Analysis (WEKA). WEKA and Spark are linked and made scalable and distributed. The Hadoop Distributed File System (HDFS) storage advantages are combined with WEKA's Knowledge flow for processing cloud network data for smart cities. Utilizing HDFS components, WEKA's machine learning algorithms receive cloud network data from smart cities. This research utilizes the wrapper-based Feature Selection (FS) approach for IDS, employing both the Pigeon Inspired Optimizer (PIO) and the Particle Swarm Optimization (PSO). For classifying the cloud network traffic of smart cities, the tree-based Stacking Ensemble Method (SEM) of J48, Random Forest (RF), and eXtreme Gradient Boosting (XGBoost) are applied. Performance evaluations of our system were conducted using the UNSW-NB15 and NSL-KDD datasets. Our technique is superior to previous works in terms of sensitivity, specificity, precision, false positive rate (FPR), accuracy, F1 Score, and Matthews correlation coefficient (MCC).</p> </abstract>

Wrapper-Based Feature Selection to Classify Flatfoot Disease

Wrapper-Based Feature Selection to Classify Flatfoot Disease

A Hybrid Extreme Gradient Boosting and Long Short-Term Memory Algorithm for Cyber Threats Detection

The vast amounts of data, lack of scalability, and low detection rates of traditional intrusion detection technologies make it impossible to keep up with evolving and increasingly sophisticated cyber threats. Therefore, there is an urgent need to detect and stop cyber threats early. Deep Learning has greatly improved intrusion detection due to its ability to self-learn and extract highly accurate features. In this paper, a Hybrid XG Boosted and Long Short-Term Memory algorithm (HXGBLSTM) is proposed. A comparative analysis is conducted between the computational performance of six established evolutionary computation algorithms and the recently developed bio-inspired metaheuristic algorithm called Zebra Optimisation Algorithm. These algorithms include the Particle Swarm Optimisation Algorithm, the Bio-inspired Algorithms, Bat Optimisation Algorithm, Firefly Optimisation Algorithm, and Monarch Butterfly Optimisation Algorithm, as well as the Genetic Algorithm as an Evolutionary Algorithm. The dimensionality curse has been mitigated by using these metaheuristic methods for feature selection, and the results are compared with the wrapper-based feature selection XGBoost algorithm. The proposed algorithm uses the CSE-CIC -IDS2018 dataset, which contains the latest network attacks. XGBoost outperformed the other FS algorithms and was used as the feature selection algorithm. In evaluating the effectiveness of the newly proposed HXGBLSTM, binary and multi-class classifications are considered. When comparing the performance of the proposed HXGBLSTM for cyber threat detection, it outperforms seven innovative deep learning algorithms for binary classification and four of them for multi-class classification. Other evaluation criteria such as recall, F1 score, and precision have been also used for comparison. The results showed that the best accuracy for binary classification is 99.8\%, with F1-score of 99.83\%, precision of 99.85\%, and recall of 99.82\%, in extensive and detailed experiments conducted on a real dataset. The best accuracy, F1-score, precision, and recall for multi-class classification were all around 100\%, which does give the proposed algorithm an advantage over the compared ones.

Effectiveness of ELMo embeddings, and semantic models in predicting review helpfulness

Online product reviews (OPR) are a commonly used medium for consumers to communicate their experiences with products during online shopping. Previous studies have investigated the helpfulness of OPRs using frequency-based, linguistic, meta-data, readability, and reviewer attributes. In this study, we explored the impact of robust contextual word embeddings, topic, and language models in predicting the helpfulness of OPRs. In addition, the wrapper-based feature selection technique is employed to select effective subsets from each type of features. Five feature generation techniques including word2vec, FastText, Global Vectors for Word Representation (GloVe), Latent Dirichlet Allocation (LDA), and Embeddings from Language Models (ELMo), were employed. The proposed framework is evaluated on two Amazon datasets (Video games and Health & personal care). The results showed that the ELMo model outperformed the six standard baselines, including the fine-tuned Bidirectional Encoder Representations from Transformers (BERT) model. In addition, ELMo achieved Mean Square Error (MSE) of 0.0887 and 0.0786 respectively on two datasets and MSE of 0.0791 and 0.0708 with the wrapper method. This results in the reduction of 1.43% and 1.63% in MSE as compared to the fine-tuned BERT model on respective datasets. However, the LDA model has a comparable performance with the fine-tuned BERT model but outperforms the other five baselines. The proposed framework demonstrated good generalization abilities by uncovering important factors of product reviews and can be evaluated on other voting platforms.

Multi-objective metaheuristic optimization algorithms for wrapper-based feature selection: a literature survey

In the data mining and machine learning (ML) discipline, feature selection problem is considered among many researchers in the recent times. Feature selection process targets to minimize feature set number and maximize performance accuracy by identifying optimal features. Multiple objectives are considered while identifying the optimal feature hence multi-objective metaheuristic optimization algorithms (MOMOAs) are applied. In this study, literature review is performed MOMOAs-for solving wrapper feature selection problem (WFS). The literature review for solving WFS problem and discuss the challenges faced by the researchers in solving the feature selection problem. The literature review is performed on all relevant studies published in the last 12 years [2009-2022]. A detailed overview of the feature selection preliminaries, MOMOAs-WFS, role of the classifier in feature selection problem are presented. The outcome of this literature review is to highlight the existing works related to WFS problem using MOMOAs. Finally, the research areas for improvement are identified and emphasized for the scientists to survey in the field of MOMOAs.

A novel multi-objective wrapper-based feature selection method using quantum-inspired and swarm intelligence techniques

A novel multi-objective wrapper-based feature selection method using quantum-inspired and swarm intelligence techniques

FDF-HybridFS: Towards design of a failure detection framework using hybrid feature selection method for IP core networks that connect 5G core in NFV-based test environment

With the advancement of recent technologies, high-speed and secure internet connectivity is required for 5th-generation mobile networks. A massive number of smart devices connected to the networks generate a large amount of data. Consequently, increasing traffic has generated more strain on networks and devices. Therefore, to handle the huge amount of data generated by the various devices and to detect network and device failures, automation is expected to play an important role. Hence, these requirements have accelerated the necessity of automation. This study presents a novel hybrid feature-selection technique for detecting network and device failure in IP core networks that connect 5 G core networks for internet connectivity. This approach first performs feature ranking using the MI (Mutual information), CC (Correlation coefficient), and GI (Gini index) to get the three different feature sets. Subsequently, in order to acquire a single optimized feature set, features are combined using a union operation. This optimized feature set is fed to the wrapper-based Boruta feature selection algorithm. In addition, to handle the data imbalance problem, we have applied the SMOTETomek method. Finally, obtained optimized feature set is fed to the three most popular ensemble approaches, Random forest, LGBM (Light gradient boosting machine), and xGBoost for the detection of failure. The proposed detection system's performance is evaluated using the KDDI dataset provided by KDDI Corporation. The effectiveness of the proposed FDF-HybridFS is tested and compared with several recent state-of-the-art methods cited in the related work in terms of detection rate, precision, accuracy, and F1 score. An analysis of the proposed failure detection framework's performance on the KDDI dataset shows that it outperforms state-of-the-art methods in terms of both detection rate and detection accuracy.

IBGJO: Improved Binary Golden Jackal Optimization with Chaotic Tent Map and Cosine Similarity for Feature Selection.

Feature selection is a crucial process in machine learning and data mining that identifies the most pertinent and valuable features in a dataset. It enhances the efficacy and precision of predictive models by efficiently reducing the number of features. This reduction improves classification accuracy, lessens the computational burden, and enhances overall performance. This study proposes the improved binary golden jackal optimization (IBGJO) algorithm, an extension of the conventional golden jackal optimization (GJO) algorithm. IBGJO serves as a search strategy for wrapper-based feature selection. It comprises three key factors: a population initialization process with a chaotic tent map (CTM) mechanism that enhances exploitation abilities and guarantees population diversity, an adaptive position update mechanism using cosine similarity to prevent premature convergence, and a binary mechanism well-suited for binary feature selection problems. We evaluated IBGJO on 28 classical datasets from the UC Irvine Machine Learning Repository. The results show that the CTM mechanism and the position update strategy based on cosine similarity proposed in IBGJO can significantly improve the Rate of convergence of the conventional GJO algorithm, and the accuracy is also significantly better than other algorithms. Additionally, we evaluate the effectiveness and performance of the enhanced factors. Our empirical results show that the proposed CTM mechanism and the position update strategy based on cosine similarity can help the conventional GJO algorithm converge faster.

Machine learning and deep learning techniques for detecting malicious android applications: An empirical analysis

The open system architecture of android makes it vulnerable to a variety of cyberattacks. Cybercriminals use android applications to intrude into the system and steal confidential data. This situation poses a threat to user privacy and integrity of the system. This paper proposes a static analysis approach to detect malicious and benign Android applications using various machine learning and deep learning algorithms. The proposed work has been validated using a bench marked dataset comprising 11,449 benign and malicious Android applications. The proposed approach applies a wrapper-based feature selection method to filter irrelevant features. The results clearly show that the deep learning algorithms of DBN and MLP outperformed machine learning algorithms in detecting malicious Android applications.

Identifying relevant diffusion MRI microstructure biomarkers relating to exposure to repeated head impacts in contact sport athletes.

Repeated head impacts (RHI) without concussion may cause long-term sequelae. A growing array of diffusion MRI metrics exist, both empiric and modeled and it is hard to know which are potentially important biomarkers. Common conventional statistical methods fail to consider interactions between metrics and rely on group-level comparisons. This study uses a classification pipeline as a means towards identifying important diffusion metrics associated with subconcussive RHI. 36 collegiate contact sport athletes and 45 non-contact sport controls from FITBIR CARE were included. Regional/whole brain WM statistics were computed from 7 diffusion metrics. Wrapper-based feature selection was applied to 5 classifiers representing a range of learning capacities. Best 2 classifiers were interpreted to identify the most RHI-related diffusion metrics. Mean diffusivity (MD) and mean kurtosis (MK) are found to be the most important metrics for discriminating between athletes with and without RHI exposure history. Regional features outperformed global statistics. Linear approaches outperformed non-linear approaches with good generalizability (test AUC 0.80-0.81). Feature selection and classification identifies diffusion metrics that characterize subconcussive RHI. Linear classifiers yield the best performance and mean diffusion, tissue microstructure complexity, and radial extra-axonal compartment diffusion (MD, MK, De,⊥) are found to be the most influential metrics. This work provides proof of concept that applying such approach to small, multidimensional dataset can be successful given attention to optimizing learning capacity without overfitting and serves an example of methods that lead to better understanding of the myriad of diffusion metrics as they relate to injury and disease.

Inversed Control Parameter in Whale Optimization Algorithm and Grey Wolf Optimizer for Wrapper-based Feature Selection: A comparative study

Whale Optimization Algorithm (WOA) and Grey Wolf Optimizer (GWO) are well-perform metaheuristic algorithms used by various researchers in solving feature selection problems. Yet, the slow convergence speed issue in Whale Optimization Algorithm and Grey Wolf Optimizer could demote the performance of feature selection and classification accuracy. Therefore, to overcome this issue, a modified WOA (mWOA) and modified GWO (mGWO) for wrapper-based feature selection were proposed in this study. The proposed mWOA and mGWO were given a new inversed control parameter which was expected to enable more search area for the search agents in the early phase of the algorithms and resulted in a faster convergence speed. The objective of this comparative study is to investigate and compare the effectiveness of the inversed control parameter in the proposed methods against the original algorithms in terms of the number of selected features and the classification accuracy. The proposed methods were implemented in MATLAB where 12 datasets with different dimensionality from the UCI repository were used. kNN was chosen as the classifier to evaluate the classification accuracy of the selected features. Based on the experimental results, mGWO did not show significant improvements in feature reduction and maintained similar accuracy as the original GWO. On the contrary, mWOA outperformed the original WOA in terms of the two criteria mentioned even on high-dimensional datasets. Evaluating the execution time of the proposed methods, utilizing different classifiers, and hybridizing proposed methods with other metaheuristic algorithms to solve feature selection problems would be future works worth exploring.

Metaheuristic Optimization-Based Feature Selection for Imagery and Arithmetic Tasks: An fNIRS Study.

In recent decades, the brain-computer interface (BCI) has emerged as a leading area of research. The feature selection is vital to reduce the dataset's dimensionality, increase the computing effectiveness, and enhance the BCI's performance. Using activity-related features leads to a high classification rate among the desired tasks. This study presents a wrapper-based metaheuristic feature selection framework for BCI applications using functional near-infrared spectroscopy (fNIRS). Here, the temporal statistical features (i.e., the mean, slope, maximum, skewness, and kurtosis) were computed from all the available channels to form a training vector. Seven metaheuristic optimization algorithms were tested for their classification performance using a k-nearest neighbor-based cost function: particle swarm optimization, cuckoo search optimization, the firefly algorithm, the bat algorithm, flower pollination optimization, whale optimization, and grey wolf optimization (GWO). The presented approach was validated based on an available online dataset of motor imagery (MI) and mental arithmetic (MA) tasks from 29 healthy subjects. The results showed that the classification accuracy was significantly improved by utilizing the features selected from the metaheuristic optimization algorithms relative to those obtained from the full set of features. All of the abovementioned metaheuristic algorithms improved the classification accuracy and reduced the feature vector size. The GWO yielded the highest average classification rates (p < 0.01) of 94.83 ± 5.5%, 92.57 ± 6.9%, and 85.66 ± 7.3% for the MA, MI, and four-class (left- and right-hand MI, MA, and baseline) tasks, respectively. The presented framework may be helpful in the training phase for selecting the appropriate features for robust fNIRS-based BCI applications.

Diagnosis of Pulmonary Edema and Covid-19 from CT slices using Squirrel Search Algorithm, Support Vector Machine and Back Propagation Neural Network

A Computer Aided Diagnosis (CAD) framework to diagnose Pulmonary Edema (PE) and covid-19 from the chest Computed Tomography (CT) slices were developed and implemented in this work. The lung tissues have been segmented using Otsu’s thresholding method. The Regions of Interest (ROI) considered in this work were edema lesions and covid-19 lesions. For each ROI, the edema lesions and covid-19 lesions were elucidated by an expert radiologist, followed by texture and shape extraction. The extracted features were stored as feature vectors. The feature vectors were split into train and test set in the ratio of 80 : 20. A wrapper based feature selection approach using Squirrel Search Algorithm (SSA) with the Support Vector Machine (SVM) classifier’s accuracy as the fitness function was used to select the optimal features. The selected features were trained using the Back Propagation Neural Network (BPNN) classifier. This framework was tested on a real-time PE and covid-19 dataset. The BPNN classifier’s accuracy with SSA yielded 88.02%, whereas, without SSA it yielded 83.80%. Statistical analysis, namely Wilcoxon’s test, Kendall’s Rank Correlation Coefficient test and Mann Whitney U test were performed, which indicates that the proposed method has a significant impact on the accuracy, sensitivity and specificity of the novel dataset considered. Comparative experimentations of the proposed system with existing benchmark ML classifiers, namely Cat Boost, Ada Boost, XGBoost, RBF SVM, Poly SVM, Sigmoid SVM and Linear SVM classifiers demonstrate that the proposed system outperforms the benchmark classifiers’ results.