Multi-label Classification Approach Research Articles

Facial Expression Analysis Using Multi-label Classification

Emotions form the reflection of an individual's mental state. Automatic expression analysis and its recognition based on their facial landmarks are of critical use, particularly to understand the emotional states of physically disabled individuals like autistic children, deaf, dumb, and bedridden individuals. This approach helps in interpreting human emotions, which is crucial for designing computational models and interfaces that cater to their needs. While traditional research has focused on six basic emotion categories (happiness, surprise, sadness, anger, fear, disgust), your work expands this by exploring compound emotion categories. Compound emotions combine these basic categories to create nuanced emotional states. The research utilizes the CFEE_Database_230 dataset of facial expressions captured for analysis and training purposes. The proposed methodology has the following three steps: Analyze the dataset and extract the region of interest (ROI), Extract various statistical and potentially discriminating features and apply a multi-label classification approach to categorize sets of emotions. This involves comparing the feature values across different emotion classes and assigning appropriate labels, particularly focusing on compound emotion categories. Also, the research employs different classifiers and metrics to evaluate the effectiveness of the model. After applying the classification methods, the results are analyzed using various metrics to assess the accuracy and effectiveness of emotion recognition based on facial landmarks. Based on the findings, the Binary Relevance Method yielded the best performance with Mean Average Precision and hamming Loss of 0.7227±0.0344 and 0.1906±0.0227, respectively. Overall, the work contributes to advancing automatic emotion recognition by considering a broader range of emotional categories beyond the traditional basics. This is particularly beneficial for populations such as the physically disabled and autistic children, where traditional communication methods might be limited or challenging.

FutureCite: Predicting Research Articles’ Impact Using Machine Learning and Text and Graph Mining Techniques

The growth in academic and scientific publications has increased very rapidly. Researchers must choose a representative and significant literature for their research, which has become challenging worldwide. Usually, the paper citation number indicates this paper’s potential influence and importance. However, this standard metric of citation numbers is not suitable to assess the popularity and significance of recently published papers. To address this challenge, this study presents an effective prediction method called FutureCite to predict the future citation level of research articles. FutureCite integrates machine learning with text and graph mining techniques, leveraging their abilities in classification, datasets in-depth analysis, and feature extraction. FutureCite aims to predict future citation levels of research articles applying a multilabel classification approach. FutureCite can extract significant semantic features and capture the interconnection relationships found in scientific articles during feature extraction using textual content, citation networks, and metadata as feature resources. This study’s objective is to contribute to the advancement of effective approaches impacting the citation counts in scientific publications by enhancing the precision of future citations. We conducted several experiments using a comprehensive publication dataset to evaluate our method and determine the impact of using a variety of machine learning algorithms. FutureCite demonstrated its robustness and efficiency and showed promising results based on different evaluation metrics. Using the FutureCite model has significant implications for improving the researchers’ ability to determine targeted literature for their research and better understand the potential impact of research publications.

Multi-label image classification using adaptive graph convolutional networks: From a single domain to multiple domains

This paper proposes an adaptive graph-based approach for multi-label image classification. Graph-based methods have been largely exploited in the field of multi-label classification, given their ability to model label correlations. Specifically, their effectiveness has been proven not only when considering a single domain but also when taking into account multiple domains. However, the topology of the used graph is not optimal as it is pre-defined heuristically. In addition, consecutive Graph Convolutional Network (GCN) aggregations tend to destroy the feature similarity. To overcome these issues, an architecture for learning the graph connectivity in an end-to-end fashion is introduced. This is done by integrating an attention-based mechanism and a similarity-preserving strategy. The proposed framework is then extended to multiple domains using an adversarial training scheme. Numerous experiments are reported on well-known single-domain and multi-domain benchmarks. The results demonstrate that our approach achieves competitive results in terms of mean Average Precision (mAP) and model size as compared to the state-of-the-art. The code will be made publicly available.

YOLIC: An efficient method for object localization and classification on edge devices

In the realm of Tiny AI, we introduce “You Only Look at Interested Cells” (YOLIC), an efficient method for object localization and classification on edge devices. Through seamlessly blending the strengths of semantic segmentation and object detection, YOLIC provides improved computational efficiency and precision compared to traditional methods. By adopting Cells of Interest for classification instead of individual pixels, YOLIC encapsulates relevant information, reduces computational load, and enables rough object shape inference. Importantly, the need for bounding box regression is obviated, as YOLIC capitalizes on the predetermined cell configuration that provides information about potential object location, size, and shape. To tackle the issue of single-label classification limitations, a multi-label classification approach is applied to each cell for effectively recognizing overlapping or closely situated objects. This paper presents extensive experiments on multiple datasets to demonstrate that YOLIC achieves detection performance comparable to the state-of-the-art YOLO algorithms while surpassing in speed, exceeding 30fps on a Raspberry Pi 4B CPU.

BranchLabelNet: Anatomical Human Airway Labeling Approach using a Dividing-and-Grouping Multi-Label Classification.

Anatomical airway labeling is crucial for precisely identifying airways displaying symptoms such as constriction, increased wall thickness, and modified branching patterns, facilitating the diagnosis and treatment of pulmonary ailments. This study introduces an innovative airway labeling methodology, BranchLabelNet, which accounts for the fractal nature of airways and inherent hierarchical branch nomenclature. In developing this methodology, branch-related parameters, including position vectors, generation levels, branch lengths, areas, perimeters, and more, are extracted from a dataset of 1000 chest computed tomography (CT) images. To effectively manage this intricate branch data, we employ an n-ary tree structure that captures the complicated relationships within the airway tree. Subsequently, we employ a divide-and-group deep learning approach for multi-label classification, streamlining the anatomical airway branch labeling process. Additionally, we address the challenge of class imbalance in the dataset by incorporating the Tomek Links algorithm to maintain model reliability and accuracy. Our proposed airway labeling method provides robust branch designations and achieves an impressive average classification accuracy of 95.94% across fivefold cross-validation. This approach is adaptable for addressing similar complexities in general multi-label classification problems within biomedical systems.

Retraction Note to: Leakage detection and localization on water transportation pipelines: a multi-label classification approach

Retraction Note to: Leakage detection and localization on water transportation pipelines: a multi-label classification approach

K1K2NN: A novel multi-label classification approach based on neighbors for predicting COVID-19 drug side effects

COVID-19, a novel ailment, has received comparatively fewer drugs for its treatment. Side Effects (SE) of a COVID-19 drug could cause long-term health issues. Hence, SE prediction is essential in COVID-19 drug development. Efficient models are also needed to predict COVID-19 drug SE since most existing research has proposed many classifiers to predict SE for diseases other than COVID-19. This work proposes a novel classifier based on neighbors named K1 K2 Nearest Neighbors (K1K2NN) to predict the SE of the COVID-19 drug from 17 molecules' descriptors and the chemical 1D structure of the drugs. The model is implemented based on the proposition that chemically similar drugs may be assigned similar drug SE, and co-occurring SE may be assigned to chemically similar drugs. The K1K2NN model chooses the first K1 neighbors to the test drug sample by calculating its similarity with the train drug samples. It then assigns the test sample with the SE label having the majority count on the SE labels of these K1 neighbor drugs obtained through a voting mechanism. The model then calculates the SE-SE similarity using the Jaccard similarity measure from the SE co-occurrence values. Finally, the model chooses the most similar K2 SE neighbors for those SE determined by the K1 neighbor drugs and assigns these SE to that test drug sample. The proposed K1K2NN model has showcased promising performance with the highest accuracy of 97.53% on chemical 1D drug structure and outperforms the state-of-the-art multi-label classifiers. In addition, we demonstrate the successful application of the proposed model on gene expression signature datasets, which aided in evaluating its performance and confirming its accuracy and robustness.

Multi-label classification with imbalanced classes by fuzzy deep neural networks

Multi-label classification is an advantageous technique for managing uncertainty in classification problems where each data instance is associated with several labels simultaneously. Such situations are frequent in real-world scenarios, where decisions rely on imprecise or noisy data and adaptable classification methods are preferred. However, the problem of class imbalance represents a common characteristic of several multi-label datasets, in which the distribution of samples and their corresponding labels is non-uniform across the data space. In this paper, we propose a multi-label classification approach utilizing fuzzy logic in order to deal with the class imbalance problem. To eliminate the need for an expert to determine the logical rules of inference, deep neural networks are adopted, which have proven to be exceptionally effective for such problems. By combining both fuzzy inference systems and deep neural networks, the strengths and weaknesses of each approach can be mitigated. As a further development, a symbolic representation of time series is put in place to reduce data dimensionality and speed up the training procedure. This allows for more flexibility in model application, in particular with respect to time constraints arising from the causality of observed time series. Tests carried out on a multi-label classification dataset related to the current and voltage profiles of several household appliances show that the proposed model outperforms four baseline models for time series classification.

Enhancing Damage Localization in GFRP Composite Plates: A Novel Approach Using Feedback Optimization and Multi-Label Classification

Damage localization in GFRP (glass-fiber-reinforced polymer) composite plates is a crucial research area in marine engineering. This study introduces a feedback-based damage index (DI) combined with multi-label classification to enhance the accuracy of damage localization and address scenarios involving multiple damages. The research begins with the creation of a modal database for yachts’ GFRP composite plates using finite element modeling (FEM). A method for deriving a feedback-weighted matrix, based on the accuracy of the DI, is then developed. Sensitivity analysis reveals that the feedback DI is 50% more sensitive than the traditional DI, reducing false positives and missed detections. The associated feedback-weighted matrix depends solely on the structural shape, ensuring its transferability. To address the challenge for localizing multiple damages, a multi-label classification approach is proposed. The synergy between the feedback optimization and multi-label classification enables the rapid and precise localization of multiple damages in GFRP composite plates. Modal testing on damaged GFRP plates confirms the enhanced accuracy for combining the feedback DI with multi-label classification for pinpointing damage locations. Compared with traditional methods, this feedback DI method improves sensitivity, while multi-label classification effectively handles multiple damage scenarios, enhancing the overall efficiency of the damage diagnosis. The effectiveness of the proposed methods is validated through experimentation, offering robust theoretical support for composite plate damage diagnostics.

A new sentence embedding framework for the education and professional training domain with application to hierarchical multi-label text classification

In recent years, Natural Language Processing (NLP) has made significant advances through advanced general language embeddings, allowing breakthroughs in NLP tasks such as semantic similarity and text classification. However, complexity increases with hierarchical multi-label classification (HMC), where a single entity can belong to several hierarchically organized classes. In such complex situations, applied on specific-domain texts, such as the Education and professional training domain, general language embedding models often inadequately represent the unique terminologies and contextual nuances of a specialized domain. To tackle this problem, we present HMCCCProbT, a novel hierarchical multi-label text classification approach. This innovative framework chains multiple classifiers, where each individual classifier is built using a novel sentence-embedding method BERTEPro based on existing Transformer models, whose pre-training has been extended on education and professional training texts, before being fine-tuned on several NLP tasks. Each individual classifier is responsible for the predictions of a given hierarchical level and propagates local probability predictions augmented with the input feature vectors to the classifier in charge of the subsequent level. HMCCCProbT tackles issues of model scalability and semantic interpretation, offering a powerful solution to the challenges of domain-specific hierarchical multi-label classification. Experiments over three domain-specific textual HMC datasets indicate the effectiveness of HMCCCProbT to compare favorably to state-of-the-art HMC algorithms in terms of classification accuracy and also the ability of BERTEPro to obtain better probability predictions, well suited to HMCCCProbT, than three other vector representation techniques.

Multi-label Classification for Android Malware Based on Active Learning

The existing malware classification approaches (i.e., binary and family classification) can barely benefit subsequent analysis with their outputs. Even the family classification approaches suffer from lacking a formal naming standard and an incomplete definition of malicious behaviors. More importantly, the existing approaches are powerless for one malware with multiple malicious behaviors, while this is a very common phenomenon for Android malware in the wild. So that both of them actually cannot provide researchers with a direct and comprehensive enough understanding of malware. In this paper, we propose MLCDroid, an ML-based multi-label classification approach that can directly indicate the existence of pre-defined malicious behaviors. With an in-depth analysis, we summarize 6 basic malicious behaviors from real-world malware with security reports and construct a labeled dataset. We compare the results of 70 algorithm combinations to evaluate the effectiveness (best at 73.3%). Faced with the challenge of the expensive cost of data annotation, we further propose an active learning approach based on data augmentation, which can improve the overall accuracy to 86.7% with a data augmentation of 5,000+ high-quality samples from an unlabeled malware dataset. This is the first multi-label Android malware classification approach intending to provide more information on fine-grained malicious behaviors.

A Novel Deep Learning Approach for Myocardial Infarction Detection and Multi-Label Classification

A Novel Deep Learning Approach for Myocardial Infarction Detection and Multi-Label Classification

Optimizing Text Clustering Efficiency through Flexible Latent Dirichlet Allocation Method: Exploring the Impact of Data Features and Threshold Modification

A parallel corpus comprising Croatian EU legislative documents automatically translated into English spans 28 years and is enriched with metadata, including creation year and hierarchical classifier tags denoting descriptors, document types, and fields. However, nearly two-thirds of the approximately 1.5 thousand texts lack complete metadata, necessitating labor intensive manual efforts that pose challenges for human administration. This incompleteness issue can be observed in the case of official legal sites functioning as regular service provisioning databases. In response, this paper introduces an artificial cognitive and multilabel classification approach to expedite the tagging process with only a fraction of the manual effort. Leveraging the Latent Dirichlet Allocation (LDA) algorithm, our method assigns field values or tags to incompletely labeled documents. We implement a Flexible LDA variant, incorporating the influence of topics close to the most probable topic, regulated by a relative probability threshold (RPT). We evaluate the LDA prediction's dependence on document prefiltering and RPT values. Furthermore, we investigate the dependence of quantitative linguistic properties on the type and speciality of pre-processing tasks. Our algorithm, built on error-correcting optimizing codes, succesfully predicts a mixture of topic probabilities for these legal texts. This prediction is achieved by calculating the Hamming distance of binary feature vectors created using the legal fields of the EUROVOC multilingual thesaurus.

An analysis of annual reports from the sustainable development goals perspective

Purpose The sustainable development goals (SDGs) are introduced to guide achieving the sustainable goals and tackle the global problems. United Nations members may perform activities to achieve the predetermined goals and report on their SDG activities. The comprehension and commitment of several stakeholders are essential for the effective implementation of the SDGs. Countries encourage their stakeholders to perform and report their activities to meet the SDGs. The purpose of this study is to investigate the extent to which corporations’ annual reports address the SDGs to assess and comprehend their level of commitment to, priority of and integration of SDGs within their reporting structure. This research makes it easier to evaluate corporations’ sustainability performance and contributions to global sustainability goals by looking at the extent to which they address the SDGs. Design/methodology/approach In the study, it is revealed to what extent the reports meet the SDGs with the multilabel text classification approach. The SDG classification is carried out by examining the report with the help of a text analysis tool based on an enhanced version of gradient boosting. The implementation of a machine learning-based model allowed it to determine which SDGs are associated with the company’s operations without the requirement for the report’s authors to perform so. Therefore, instead of reading the texts to seek for “SDG” evidence as typically occurs in the literature, SDG proof was searched in relevant texts. Findings To show the feasibility of the study, the annual reports of the leading companies in Turkey are examined, and the results are interpreted. The study produced results including insights into the sustainable practices of businesses, priority SDG selection, benchmarking and business comparison, gaps and improvement opportunities identification and representation of the SDGs’ importance. Originality/value The findings of the analysis of annual reports indicate which SDGs they are concerned about. A gap in the literature can be noticed in the analysis of annual reports of companies that fall under a particular framework. In addition, it has sparked the idea of conducting research on a global scale and in a time series. With the aid of this research, decision-making procedures can be guided, and advancements toward the SDGs can be achieved.

Evaluating machine learning architectures for sound event detection for signals with variable signal-to-noise-ratios in the Beaufort Sea.

This paper explores the challenging polyphonic sound event detection problem using machine learning architectures applied to data recorded in the Beaufort Sea during the Canada Basin Acoustic Propagation Experiment. Four candidate architectures were investigated and evaluated on nine classes of signals broadcast from moored sources that were recorded on a vertical line array of hydrophones over the course of the yearlong experiment. These signals represent a high degree of variability with respect to time-frequency characteristics, changes in signal-to-noise ratio (SNR) associated with varying signal levels as well as fluctuating ambient sound levels, and variable distributions, which resulted in class imbalances. Within this context, binary relevance, which decomposes the multi-label learning task into a number of independent binary learning tasks, was examined as an alternative to the conventional multi-label classification (MLC) approach. Binary relevance has several advantages, including flexible, lightweight model configurations that support faster model inference. In the experiments presented, binary relevance outperformed conventional MLC approach on classes with the most imbalance and lowest SNR. A deeper investigation of model performance as a function of SNR showed that binary relevance significantly improved recall within the low SNR range for all classes studied.

EnML: Multi-label Ensemble Learning for Urdu Text Classification

Exponential growth of electronic data requires advanced multi-label classification approaches for the development of natural language processing (NLP) applications such as recommendation systems, drug reaction detection, hate speech detection, and opinion recognition/mining. To date, several machine and deep learning–based multi-label classification methodologies have been proposed for English, French, German, Chinese, Arabic, and other developed languages. Urdu is the 11th largest language in the world and has no computer-aided multi-label textual news classification approach. Unlike other languages, Urdu is lacking multi-label text classification datasets that can be used to benchmark the performance of existing machine and deep learning methodologies. With an aim to accelerate and expedite research for the development of Urdu multi-label text classification–based applications, this article provides multiple contributions as follows: First, it provides a manually annotated multi-label textual news classification dataset for the Urdu language. Second, it benchmarks the performance of traditional machine learning approaches particularly by adapting three data transformation approaches along with three top-performing machine learning classifiers and four algorithm adaptation-based approaches. Third, it benchmarks performance of 16 existing deep learning approaches and the four most widely used language models. Finally, it provides an ensemble approach that reaps the benefits of three different deep learning architectures to precisely predict different classes associated with a particular Urdu textual document. Experimental results reveal that proposed ensemble approach performance values (87% accuracy, 92% F1-score, and 8% hamming loss) are significantly higher than adapted machine and deep learning–based approaches.

A Multilabel Approach for Fault Detection and Classification of Transmission Lines using Binary Relevance

In Contemporary automation systems, Fault detection and classification of electrical transmission lines in grid systems are given top priority. The broad application of Machine Learning (ML) methods has enabled the substitute of conventional methods of fault identification and classification. These methods are more effective ones that can identify faults early on using a significant quantity of sensory data. So detecting simultaneous failures is difficult in the context of distracting the noise and several faults in the transmission lines. This study contributes by offering a unique way for concurrently detecting and classifying several faults using a multilabel classification approach based on binary relevance classifiers. The proposed binary relevance multilabel detection and classification models’ performances are examined. Under both ideal and problematic circumstances, faults in the dataset are collected. A variety of multilabel fault types detection and classification determines the suggested method’s effectiveness.

Predicting and characterising persuasion strategies in misinformation content over social media based on the multi-label classification approach

Persuasion aims at affecting the audience’s attitude and behaviour through a series of messages containing persuasion strategies. In the context of misinformation spread, identifying the persuasion strategies is important in order to warn people to be aware of the analogous persuasion attempts in the future. In this work, we address the prediction of persuasion strategies in micro-blogging posts through a multi-label classification approach based on a variety of lexical and semantic features. We conduct our experiments using a set of well-known multi-label classification algorithms, including multi-label decision tree, multi-label k-nearest neighbours, multi-label random forest, binary relevance and classifier chains. The results show that the model incorporating classifier chains and XGBoost algorithm achieves the best subset accuracy of 0.779 and the highest macro F1-score of 0.847. In addition, we evaluated and compared the features’ importance for different persuasion strategies and analysed the major errors of miss-out prediction. The findings of this article provide a benchmark for the multi-label classification of persuasion strategies in micro-blogging posts and lead to a better understanding of different persuasion attempts contained in social media misinformation.

Automated labelling of radiology reports using natural language processing: Comparison of traditional and newer methods

AbstractAutomated labelling of radiology reports using natural language processing allows for the labelling of ground truth for large datasets of radiological studies that are required for training of computer vision models. This paper explains the necessary data preprocessing steps, reviews the main methods for automated labelling and compares their performance. There are four main methods of automated labelling, namely: (1) rules‐based text‐matching algorithms, (2) conventional machine learning models, (3) neural network models and (4) Bidirectional Encoder Representations from Transformers (BERT) models. Rules‐based labellers perform a brute force search against manually curated keywords and are able to achieve high F1 scores. However, they require proper handling of negative words. Machine learning models require preprocessing that involves tokenization and vectorization of text into numerical vectors. Multilabel classification approaches are required in labelling radiology reports and conventional models can achieve good performance if they have large enough training sets. Deep learning models make use of connected neural networks, often a long short‐term memory network, and are similarly able to achieve good performance if trained on a large data set. BERT is a transformer‐based model that utilizes attention. Pretrained BERT models only require fine‐tuning with small data sets. In particular, domain‐specific BERT models can achieve superior performance compared with the other methods for automated labelling.

Distributed Online Multi-Label Learning with Privacy Protection in Internet of Things

With the widespread use of end devices, online multi-label learning has become popular as the data generated by users using the Internet of Things devices have become huge and rapidly updated. However, in many scenarios, the user data are often generated in a geographically distributed manner that is often inefficient and difficult to centralize for training machine learning models. At the same time, current mainstream distributed learning algorithms always require a centralized server to aggregate data from distributed nodes, which inevitably causes risks to the privacy of users. To overcome this issue, we propose a distributed approach for multi-label classification, which trains the models in distributed computing nodes without sharing the source data from each node. In our proposed method, each node trains its model with its local online data while it also learns from the neighbour nodes without transferring the training data. As a result, our proposed method achieved the online distributed approach for multi-label classification without losing performance when taking existing centralized algorithms as a reference. Experiments show that our algorithm outperforms the centralized online multi-label classification algorithm in F1 score, being 0.0776 higher in macro F1 score and 0.1471 higher for micro F1 score on average. However, for the Hamming loss, both algorithms beat each other on some datasets, and our proposed algorithm loses 0.005 compared to the centralized approach on average, which can be neglected. Furthermore, the size of the network and the degree of connectivity are not factors that affect the performance of this distributed online multi-label learning algorithm.