Learning Classifiers Research Articles

Stacking classifier method for prediction of human body performance

<p>A healthy body is the capital of success and supports human activities. To maintain health, humans need to avoid disease. A healthy life is everyone’s dream and should start early. Busy activities often hinder a healthy lifestyle. Nonetheless, it is important for every individual to lead a healthy lifestyle. Human activities determine health and the implementation of a healthy life. One method that can perform classification with machine learning is extreme gradient boosting (XGBoost). XGBoost is one of the techniques in machine learning for regression analysis and classification based on gradient boosting decision tree (GBDT). By using gradient descent to minimize the error when creating a new model, the algorithm is called gradient boosting. In determining a classification starting from determining the model to the results, usually only using one algorithm method, and combining other methods together with the method is an algorithm called random forest classifier. Among these merging methods are, stacking classifier, voting classifier, and bagging classifier. The conclusion obtained from the results of this research is that the test results show that the stacking classifier achieves the highest accuracy of 76.07%, making it the best method in this research. And the stacking classifier has a precision of 76.96%, recall of 75.83%, and F1-score of 75.81%. This shows that the model has a good balance between the ability to provide true positive results and the ability to recover positive data.</p>

Variational Continuous Label Distribution Learning for Multi-Label Text Classification

Variational Continuous Label Distribution Learning for Multi-Label Text Classification

A multimodal machine learning approach to generate news articles from geo-tagged images

Classical machine learning algorithms typically operate on unimodal data and hence it can analyze and make predictions based on data from a single source (modality). Whereas multimodal machine learning algorithm, learns from information across multiple modalities, such as text, images, audio, and sensor data. The paper leverages the functionalities of multimodal machine learning (ML) application for generating text from images. The proposed work presents an innovative multimodal algorithm that automates the creation of news articles from geo-tagged images by leveraging cutting-edge developments in machine learning, image captioning, and advanced text generation technologies. Employing a multimodal approach that integrates machine learning and transformer algorithms, such as visual geometry group network16 (VGGNet16), convolutional neural network (CNN) and a long short-term memory (LSTM) based system, the algorithm initiates by extracting the location from exchangeable image file format (Exif) data from the image. The features are extracted from the image and corresponding news headline is generated. The headlines are used for generating a comprehensive article with contemporary large language model (LLM). Further, the algorithm generates the news article big-science large open-science open-access multilingual language model (BLOOM). The algorithm was tested on real time photographs as well as images from the internet. In both the cases the news articles generated were validated with ROUGE and BULE score. The proposed work is found to be successful attempt in journalism field.

Improved performance of fake account classifiers with percentage overlap features selection

Feature selection plays a crucial role in the development of high-performance classification models. We propose an innovative method for detecting fake accounts. This method leverages the percentage overlap technique to refine feature selection. We introduce our technique upon earlier work that showcased the enhanced efficacy of the Naïve Bayesian classifier through dataset normalization. Our study employs a dataset of account profiles sourced from Twitter, which we normalize using the Min-Max method. We analyze the results through a series of comprehensive experiments involving diverse classification algorithms—such as Naïve Bayes, decision tree, k-nearest neighbors (KNN), deep learning, and support vector machines (SVM). Our experimental results demonstrate a 100% accuracy achieved by the SVM and deep learning classifiers. The results are attributed to the percentage overlap technique, which facilitates the identification of four highly informative features. These findings outperform models with more extensive feature sets, underscoring the efficacy of our approach.

A genetic algorithm-based feature selection approach for diabetes prediction

<p>Genetic algorithms have emerged as a powerful optimization technique for feature selection due to their ability to search through a vast feature space efficiently. This study discusses the importance of feature selection for prediction in healthcare and prominently focuses on diabetes mellitus. Feature selection is essential for improving the performance of prediction models, by finding significant features and removing unnecessary among them. The study aims to identify the most informative subset of features. Diabetes is a chronic metabolic disorder that poses significant health challenges worldwide. For the experiment, two datasets related to diabetes were downloaded from Kaggle and the results of both (datasets) with and without feature selection using the genetic algorithm were compared. Machine learning classifiers and genetic algorithms were combined to increase the precision of diabetes risk prediction. In the preprocessing phase, feature selection, machine learning classifiers, and performance metrics methods were applied to make this study feasible. The results of the experiment showed that genetic algorithm + logistic regression i.e., 80% (accuracy) works better for PIMA diabetes, and for Germany diabetes dataset genetic algorithm + random forest and genetic algorithm + K-Nearest Neighbor i.e., 98.5% performed better than other chosen classifiers. The researchers can better comprehend the importance of feature selection in healthcare through this study.</p>

Brain magnetic resonance imaging image classification for Alzheimer's disease and its hardware acceleration

<span lang="EN-US">Alzheimer's is a progressive neurodegenerative disorder and is considered the sixth leading cause of death after cancer and heart attack. Early detection and diagnosis provide individuals to go through a wider variety of clinical trials and get multiple medical benefits. Research on the application of deep learning and machine learning to the early detection of Alzheimer's disease has recently gained considerable attention. In this paper, we propose a deep learning classification framework to classify the individual with different progression stages of Alzheimer's disease such as mild cognitive impairment (MCI) and cognitive normal (CN). The dataset from Alzheimer’s disease neuroimaging initiative (ADNI) is considered in this paper which is a multisite having collection of Neuroimaging data for researchers. Structural magnetic resonance imaging (MRI) images are considered from the ADNI data set and feature extraction is done using a 2D discrete wavelet transform. 97% of data reduction is achieved during data pre-processing. The algorithm is trained and validated. The algorithm is accelerated in Nvidia Tx2 graphics processing unit (GPU) to get the better throughput. The result shows our algorithm outperforms the other deep learning algorithms with 91.56% accuracy. </span>

Deep learning and machine learning classification technique for integrated forecasting

Smart fisheries are increasingly using artificial intelligence (AI) technologies to increase their sustainability. The potential fishing zone (PFZ) forecasts several fish aggregation zones throughout the duration of the prediction in any sea. The autoregressive integrated moving average (ARIMA) and random forest model are used in the current study to provide a technique for locating viable fishing zones in deep marine seas. A significant amount of data was gathered for the database's creation, including monitoring information for Indian fishing fleets from 2017 to 2019. Using expert label datasets for validation, it was discovered that the model's detection accuracy was 98%. Our method uses salinity and dissolved oxygen, two crucial markers of water quality, to identify suitable fishing zones for the first time. In the current research, a system was created to identify and map the quantity of fishing activity. The tests use a number of parameter measurements to evaluate the contrast-enhanced computed tomography (CECT) approach to machine learning (ML) and deep learning (DL) methodologies. The findings showed that the CECT had a 94% accuracy rate compared to a convolutional neural network's 92% accuracy rate for the 80% training data and 20% testing data.

Enhancing EEG-based brain-computer interface systems through efficient machine learning classification techniques

Advances in the fields of neuroscience and computer science have greatly enhanced the human brain’s ability to communicate and interact with the surrounding environment. In addition, recent steps in machine learning (ML) have increased the use of electroencephalography (EEG)-based BCIs for artificial intelligence (AI) applications. The prevailing challenge in recording EEG sensor data is that the captured signals are mixed with noise, which makes their effective use difficult. Therefore, strengthening the classification stage becomes extremely important and plays a major role in addressing this problem. In this study, we chose five most widely used classification models that obtained the best results in this field and tested them on two open-source databases. We also focused on improving the hyperparameters of each algorithm to obtain best results. Our results indicate excellent results on the first dataset and acceptable for most models on the second, while RF showed superior performance on both with an accuracy of 100% on the first dataset and 86.47% on the second. This was achieved with the lowest training costs, and better performance compared to previous works we evaluated that used the same databases. These results provide valuable insights and advance the development of brain-computer interface (BCI) technology and design.

Data & Semantic Analysis Fake News Detection Based Domain-Specific Auto Encoder Learning

Abstract: Efforts to create technology for automatically detecting fake news are actively underway as the spread of misinformation on social media continues to escalate. However, most of these approaches primarily concentrate on the linguistic and structural aspects of fake news, such as identifying sources or authors, message length, and the frequency of negative language. In contrast, our study introduces a phony news detection model leveraging machine learning that incorporates user behaviors, news, and social capital-based social network dynamics. We used the XG Boost model to evaluate each feature's significance and identify the critical elements affecting the identification of fake news to capture the variables related to the spread of phony news entirely. We implemented SVM, RF, LR, CART, and NNET, well-known machine learning classification models, using these identified factors and assessed how well they detected bogus news. This work used a cross-validation process to prevent overfitting and to generalize the established models. Additionally, the predicted accuracy of the established models was compared. The RF model had the best forecast accuracy, about 94%, while the NNET had the worst performance rate, about 92.1%. As disinformation is created and disseminated with growing sophistication, the results of this study should improve the effectiveness of false news detection systems.

Machine Learning based approach for Diabetes Prediction

Diabetes is an illness brought on by an excessive amount of glucose within the body. Ignorance of diabetes is no longer acceptable. If neglected, it may also result in more severe health concerns for a person, such as heart-related problems, renal problems, blood pressure, eye damage, and effects on other body organs. Insulin hormone is affected, which leads to abnormal crab metabolism and elevates blood sugar levels. According to the World Health Organization, 422 million people worldwide suffer with diabetes. low- and middle-class people being disproportionately affected. The condition is caused by the body producing insufficient amounts of insulin. Additionally, this might reach 490 billion by 2030. To benefit from this challenging job, we may apply ensemble techniques and system learning for classification on this image to forecast whether diabetes will be present in a dataset. When comparing one version to another, the accuracy varies depending on the model. The assignment provides the accurate or improved accuracy version, indicating that the model can effectively predict diabetes. Our findings demonstrate that random forested areas outperformed other system mastery strategies in terms of accuracy. Keywords: Classification Algorithms, Supervised Learning, Unsupervised Learning, Random forest

Differential Artery–Vein Analysis Improves OCTA Classification of Diabetic Retinopathy

This study investigates the impact of differential artery-vein (AV) analysis in optical coherence tomography angiography (OCTA) on machine learning classification of diabetic retinopathy (DR). Leveraging deep learning for arterial-venous area (AVA) segmentation, six quantitative features, including perfusion intensity density (PID), blood vessel density (BVD), vessel area flux (VAF), blood vessel caliber (BVC), blood vessel tortuosity (BVT), and vessel perimeter index (VPI) features, were derived from OCTA images before and after AV differentiation. A support vector machine (SVM) classifier was utilized to assess both binary and multiclass classifications of control, diabetic patients without DR (NoDR), mild DR, moderate DR, and severe DR groups. Initially, one-region features, i.e., quantitative features extracted from the entire OCTA, were evaluated for DR classification. Differential AV analysis improved classification accuracies from 78.86% to 87.63% and from 79.62% to 85.66% for binary and multiclass classifications, respectively. Additionally, three-region features derived from the entire image, parafovea, and perifovea, were incorporated for DR classification. Differential AV analysis further enhanced classification accuracies from 84.43% to 93.33% and from 83.40% to 89.25% for binary and multiclass classifications, respectively. These findings highlight the potential of differential AV analysis in augmenting disease diagnosis and treatment assessment using OCTA.

Image Classification of Room Tidiness Using VGGNet with Data Augmentation

Tidiness becomes an essential aspect that everyone should maintain. Tidiness encompasses various elements, and one of the aspects closely related to it is the tidiness of a room. The tidiness of a room creates a comfortable and clean environment. The tidiness of a room is particularly crucial for individuals involved in businesses such as the hospitality industry. Therefore, a solution is needed to address this issue, and one of the approaches is to utilize Deep Learning for automatic room tidiness classification. One popular deep learning method for implementing image classification of room tidiness is the convolutional neural network (CNN), which creates a well-performing model for image classification with data augmentation. This research aims to develop an image classification model using CNN with the VGGNet architecture and data augmentation. This study is a reference for further development, with potential applications in the hospitality industry. The research results in a model that achieves an accuracy of 98.44% with a data proportion of 90% for training and validation, while the remaining 10% is used for testing purposes. The conclusion drawn from this study is that the CNN method, combined with data augmentation, can be utilized for image classification of room tidiness.

A study on deep learning for Vietnamese text classification

Text categorization aims to automatically assign given text passages or documents to predetermined categories or subjects. Despite the wide array of techniques employed in classifying English text, there remains a dearth of research on Vietnamese text classification. This paper introduces a novel approach utilizing a Long Short-Term Memory (LSTM) and Convolutional Neural Network (CNN) with a deep network structure for Vietnamese text classification. Our findings demonstrate a substantial improvement in classification accuracy when applying deep learning techniques to two Vietnamese news corpus datasets. This study contributes to the advancement of Vietnamese text classification by introducing and demonstrating the efficacy of LSTM and CNN with a deeper network structure. The results offer valuable insights for researchers and practitioners working on text categorization in the Vietnamese language.

Comparing nine machine learning classifiers for school-dropouts using a revised performance measure

Comparing nine machine learning classifiers for school-dropouts using a revised performance measure

Machine learning identifies the role of SMAD6 in the prognosis and drug susceptibility in bladder cancer

BackgroundBladder cancer (BCa) is among the most prevalent malignant tumors affecting the urinary system. Due to its highly recurrent nature, standard treatments such as surgery often fail to significantly improve patient prognosis. Our research aims to predict prognosis and identify precise therapeutic targets for novel treatment interventions.MethodsWe collected and screened genes related to the TGF-β signaling pathway and performed unsupervised clustering analysis on TCGA-BLCA samples based on these genes. Our analysis revealed two novel subtypes of bladder cancer with completely different biological characteristics, including immune microenvironment, drug sensitivity, and more. Using machine learning classifiers, we identified SMAD6 as a hub gene contributing to these differences and further investigated the role of SMAD6 in bladder cancer in the single-cell transcriptome data. Additionally, we analyzed the relationship between SMAD6 and immune checkpoint genes. Finally, we performed a series of in vitro assays to verify the function of SMAD6 in bladder cancer cell lines.ResultsWe have revealed two novel subtypes of bladder cancer, among which C1 exhibits a worse prognosis, lower drug sensitivity, a more complex tumor microenvironment, and a ‘colder’ immune microenvironment compared to C2. We identified SMAD6 as a key gene responsible for the differences and further explored its impact on the molecular characteristics of bladder cancer. Through in vitro experiments, we found that SMAD6 promoted the prognosis of BCa patients by inhibiting the proliferation and migration of BCa cells.ConclusionOur study reveals two novel subtypes of BCa and identifies SMAD6 as a highly promising therapeutic target.

Computed tomography machine learning classifier correlates with mortality in interstitial lung disease

BackgroundA machine learning classifier system, Fibresolve, was designed and validated as an adjunct to non-invasive diagnosis in idiopathic pulmonary fibrosis (IPF). The system uses a deep learning algorithm to analyze chest computed tomography (CT) imaging. We hypothesized that Fibresolve is a useful predictor of mortality in interstitial lung diseases (ILD). MethodsFibresolve was previously validated in a multi-site >500-patient dataset. In this analysis, we assessed the usefulness of Fibresolve to predict mortality in a subset of 228 patients with IPF and other ILDs in whom follow up data was available. We applied Cox regression analysis adjusting for the Gender, Age, and Physiology (GAP) score and for other known predictors of mortality in IPF. We also analyzed the role of Fibresolve as tertiles adjusting for GAP stages. ResultsDuring a median follow-up of 2.8 years (range 5 to 3434 days), 89 patients died. After adjusting for GAP score and other mortality risk factors, the Fibresolve score significantly predicted the risk of death (HR: 7.14; 95% CI: 1.31–38.85; p = 0.02) during the follow-up period, as did forced vital capacity and history of lung cancer. After adjusting for GAP stages and other variables, Fibresolve score split into tertiles significantly predicted the risk of death (p = 0.027 for the model; HR 1.37 for 2nd tertile; 95% CI: 0.77–2.42. HR 2.19 for 3rd tertile; 95% CI: 1.22–3.93). ConclusionsThe machine learning classifier Fibresolve demonstrated to be an independent predictor of mortality in ILDs, with prognostic performance equivalent to GAP based solely on CT images.

Handling Imbalanced Classification Problems by Weighted Generalization Memorization Machine

ABSTRACT Imbalanced classification problems are of great significance in life, and there have been many methods to deal with them, e.g. eXtreme Gradient Boosting (XGBoost), Logistic Regression (LR), Decision Trees (DT), and Support Vector Machine (SVM). Recently, a novel Generalization-Memorization Machine (GMM) was proposed to maintain good generalization ability with zero empirical for binary classification. This paper proposes a Weighted Generalization Memorization Machine (WGMM) for imbalanced classification. By improving the memory cost function and memory influence function of GMM, our WGMM also maintains zero empirical risk with well generalization ability for imbalanced classification learning. The new adaptive memory influence function in our WGMM achieves that samples are described individually and not affected by other training samples from different category. We conduct experiments on 31 datasets and compare the WGMM with some other classification methods. The results exhibit the effectiveness of the WGMM.

Advances in Deep Learning Recognition of Landslides Based on Remote Sensing Images

Against the backdrop of global warming and increased rainfall, the hazards and potential risks of landslides are increasing. The rapid generation of a landslide inventory is of great significance for landslide disaster prevention and reduction. Deep learning has been widely applied in landslide identification due to its advantages in terms of its deeper model structure, high efficiency, and high accuracy. This article first provides an overview of deep learning technology and its basic principles, as well as the current status of landslide remote sensing databases. Then, classic landslide deep learning recognition models such as AlexNet, ResNet, YOLO, Mask R-CNN, U-Net, Transformer, EfficientNet, DeeplabV3+ and PSPNet were introduced, and the advantages and limitations of each model were extensively analyzed. Finally, the current constraints of deep learning in landslide identification were summarized, and the development direction of deep learning in landslide identification was analyzed. The purpose of this article is to promote the in-depth development of landslide identification research in order to provide academic references for the prevention and mitigation of landslide disasters and post-disaster rescue work. The research results indicate that deep learning methods have the characteristics of high efficiency and accuracy in automatic landslide recognition, and more attention should be paid to the development of emerging deep learning models in landslide recognition in the future.

Quantitative profiling N1-methyladenosine (m1A) RNA methylation from Oxford nanopore direct RNA sequencing data

With the recent advanced direct RNA sequencing technique that proposed by the Oxford Nanopore Technologies, RNA modifications can be detected and profiled in a simple and straightforward manner. Majority nanopore-based modification studies were devoted to those popular types such as m6A and pseudouridine. To address current limitations on studying the crucial regulator, m1A modification, we conceived this study. We have developed an integrated computational workflow designed for the detection of m1A modifications from direct RNA sequencing data. This workflow comprises a feature extractor responsible for capturing signal characteristics (such as mean, standard deviations, and length of electric signals), a single molecule-level m1A predictor trained with features extracted from the IVT dataset using classical machine learning algorithms, a confident m1A site selector employing the binomial test to identify statistically significant m1A sites, and an m1A modification rate estimator. Our model achieved accurate molecule-level prediction (Average AUC = 0.9689) and reliable m1A site detection and quantification. To show the feasibility of our workflow, we conducted a study on in vivo transcribed human HEK293 cell line, and the results were carefully annotated and compared with other techniques (i.e., Illumina sequencing-based techniques). We believed that this tool will enabling a comprehensive understanding of the m1A modification and its functional mechanisms within cells and organisms.

Behaviour of Machine Learning algorithms in the classification of energy consumption in school buildings

Abstract The significance of energy efficiency in the development of smart cities cannot be overstated. It is essential to have a clear understanding of the current energy consumption (EC) patterns in both public and private buildings. One way to achieve this is by employing machine learning classification algorithms, which offer a broader perspective on the factors influencing EC. These algorithms can be applied to real data from databases, making them valuable tools for smart city applications. In this paper, our focus is specifically on the EC of public schools in a Portuguese city, as this plays a crucial role in designing a Smart City. By utilizing a comprehensive dataset on school EC, we thoroughly evaluate multiple ML algorithms. The objective is to identify the most effective algorithm for classifying average EC patterns. The outcomes of this study hold significant value for school administrators and facility managers. By leveraging the predictions generated from the selected algorithm, they can optimize energy usage and, consequently, reduce costs. The use of a comprehensive dataset ensures the reliability and accuracy of our evaluations of various ML algorithms for EC classification.