Macro-averaged F1-score Research Articles

Metadata Integration for Spam Reviews Detection on Vietnamese E-Commerce Websites

The problem of detecting spam reviews (opinions) has received significant attention in recent years, especially with the rapid development of e-commerce. Spam reviews are often classified based on comment content, but in some cases, it is insufficient for models to accurately determine the review label. In this work, we introduce the ViSpamReviews v2 dataset, which includes metadata of reviews with the objective of integrating supplementary attributes for spam review classification. We propose a novel approach to simultaneously integrate both textual and categorical attributes into the classification model. In our experiments, the product category proved effective when combined with deep neural network (DNN) models, while text features performed well on both DNN models and the model achieved state-of-the-art performance in the problem of detecting spam reviews on Vietnamese e-commerce websites, namely PhoBERT. Specifically, the PhoBERT model achieves the highest accuracy when combined with product description features generated from the SPhoBert model, which is the combination of PhoBERT and SentenceBERT. Using the macro-averaged F1 score, the task of classifying spam reviews achieved 87.22% (an increase of 1.64% compared to the baseline), while the task of identifying the type of spam reviews achieved an accuracy of 73.49% (an increase of 1.93% compared to the baseline).

Filtering offensive language from multilingual social media contents: A deep learning approach

In the face of uncontrolled offensive content on social media, automated detection emerges as a critical need. This paper tackles this challenge by proposing a novel approach for identifying offensive language in multilingual, code-mixed, and script-mixed settings. The study presents a novel multilingual hybrid dataset constructed by merging diverse monolingual and bilingual resources. Further, we systematically evaluate the impact of input representations (Word2Vec, Global Vectors for Word Representation (or GloVe), Bidirectional Encoder Representations from Transformers (or BERT), and uniform initialization) and deep learning models (Convolutional Neural Network (or CNN), Bidirectional Long Short Term Memory (or Bi-LSTM), Bi-LSTM-Attention, and fine-tuned BERT) on detection accuracy. Our comprehensive experiments on a dataset of 42,560 social media comments from five languages (English, Hindi, German, Tamil, and Malayalam) reveal the superiority of fine-tuned BERT. Notably, it achieves a macro average F1-score of 0.79 for monolingual tasks and an impressive 0.86 for code-mixed and script-mixed tasks. These findings significantly advance offensive language detection methodologies and shed light on the complex dynamics of multilingual social media, paving the way for more inclusive and safer online communities.

Research and Development of a Modern Deep Learning Model for Emotional Analysis Management of Text Data

There are many ways people express their reactions in the media. Text data is one of them, for example, comments, reviews, blog posts, messages, etc. Analysis of emotions expressed there is in high demand nowadays for various purposes. This research provides a method of performing sentiment analysis of text information using machine learning. The authors trained a classifier based on the BERT encoder, which recognizes emotions in text messages in English written in chat style. To handle raw chat-style messages, authors developed an enhanced text standardization layer. The list of emotions identified includes admiration, amusement, anger, annoyance, approval, caring, confusion, curiosity, desire, disappointment, disapproval, disgust, embarrassment, excitement, fear, gratitude, grief, joy, love, nervousness, optimism, pride, realization, relief, remorse, sadness, and surprise. The model solves the problem of multiclass multilabel text classification, which means that more than one class can be predicted from one piece of text. The authors trained the model on the GoEmotions dataset, which consists of 54,263 text comments from Reddit. The model reached a macro-averaged F1-Score of 0.50704 in emotions prediction and 0.7349 in sentiments prediction on the testing dataset. The presented model increased the quality of emotions prediction by 10.2% and sentiments prediction by 6.5% in comparison to the baseline approach.

Unobtrusive Cognitive Assessment in Smart-Homes: Leveraging Visual Encoding and Synthetic Movement Traces Data Mining.

The ubiquity of sensors in smart-homes facilitates the support of independent living for older adults and enables cognitive assessment. Notably, there has been a growing interest in utilizing movement traces for identifying signs of cognitive impairment in recent years. In this study, we introduce an innovative approach to identify abnormal indoor movement patterns that may signal cognitive decline. This is achieved through the non-intrusive integration of smart-home sensors, including passive infrared sensors and sensors embedded in everyday objects. The methodology involves visualizing user locomotion traces and discerning interactions with objects on a floor plan representation of the smart-home, and employing different image descriptor features designed for image analysis tasks and synthetic minority oversampling techniques to enhance the methodology. This approach distinguishes itself by its flexibility in effortlessly incorporating additional features through sensor data. A comprehensive analysis, conducted with a substantial dataset obtained from a real smart-home, involving 99 seniors, including those with cognitive diseases, reveals the effectiveness of the proposed functional prototype of the system architecture. The results validate the system's efficacy in accurately discerning the cognitive status of seniors, achieving a macro-averaged F1-score of 72.22% for the two targeted categories: cognitively healthy and people with dementia. Furthermore, through experimental comparison, our system demonstrates superior performance compared with state-of-the-art methods.

KDTM: Multi-Stage Knowledge Distillation Transfer Model for Long-Tailed DGA Detection

As the most commonly used attack strategy by Botnets, the Domain Generation Algorithm (DGA) has strong invisibility and variability. Using deep learning models to detect different families of DGA domain names can improve the network defense ability against hackers. However, this task faces an extremely imbalanced sample size among different DGA categories, which leads to low classification accuracy for small sample categories and even classification failure for some categories. To address this issue, we introduce the long-tailed concept and augment the data of small sample categories by transferring pre-trained knowledge. Firstly, we propose the Data Balanced Review Method (DBRM) to reduce the sample size difference between the categories, thus a relatively balanced dataset for transfer learning is generated. Secondly, we propose the Knowledge Transfer Model (KTM) to enhance the knowledge of the small sample categories. KTM uses a multi-stage transfer to transfer weights from the big sample categories to the small sample categories. Furthermore, we propose the Knowledge Distillation Transfer Model (KDTM) to relieve the catastrophic forgetting problem caused by transfer learning, which adds knowledge distillation loss based on the KTM. The experimental results show that KDTM can significantly improve the classification performance of all categories, especially the small sample categories. It can achieve a state-of-the-art macro average F1 score of 84.5%. The robustness of the KDTM model is verified using three DGA datasets that follow the Pareto distributions.

Automatic Prediction of Band Gaps of Inorganic Materials Using a Gradient Boosted and Statistical Feature Selection Workflow.

Machine learning (ML) methods can train a model to predict material properties by exploiting patterns in materials databases that arise from structure-property relationships. However, the importance of ML-based feature analysis and selection is often neglected when creating such models. Such analysis and selection are especially important when dealing with multifidelity data because they afford a complex feature space. This work shows how a gradient-boosted statistical feature-selection workflow can be used to train predictive models that classify materials by their metallicity and predict their band gap against experimental measurements, as well as computational data that are derived from electronic-structure calculations. These models are fine-tuned via Bayesian optimization, using solely the features that are derived from chemical compositions of the materials data. We test these models against experimental, computational, and a combination of experimental and computational data. We find that the multifidelity modeling option can reduce the number of features required to train a model. The performance of our workflow is benchmarked against state-of-the-art algorithms, the results of which demonstrate that our approach is either comparable to or superior to them. The classification model realized an accuracy score of 0.943, a macro-averaged F1-score of 0.940, area under the curve of the receiver operating characteristic curve of 0.985, and an average precision of 0.977, while the regression model achieved a mean absolute error of 0.246, a root-mean squared error of 0.402, and R2 of 0.937. This illustrates the efficacy of our modeling approach and highlights the importance of thorough feature analysis and judicious selection over a "black-box" approach to feature engineering in ML-based modeling.

Sensing complicated meanings from unstructured data: a novel hybrid approach

The majority of data on computers nowadays is in the form of unstructured data and unstructured text. The inherent ambiguity of natural language makes it incredibly difficult but also highly profitable to find hidden information or comprehend complex semantics in unstructured text. In this paper, we present the combination of natural language processing (NLP) and convolution neural network (CNN) hybrid architecture called automated analysis of unstructured text using machine learning (AAUT-ML) for the detection of complex semantics from unstructured data that enables different users to make understand formal semantic knowledge to be extracted from an unstructured text corpus. The AAUT-ML has been evaluated using three datasets data mining (DM), operating system (OS), and data base (DB), and compared with the existing models, i.e., YAKE, term frequency-inverse document frequency (TF-IDF) and text-R. The results show better outcomes in terms of precision, recall, and macro-averaged F1-score. This work presents a novel method for identifying complex semantics using unstructured data.

DRG-LLaMA : tuning LLaMA model to predict diagnosis-related group for hospitalized patients

In the U.S. inpatient payment system, the Diagnosis-Related Group (DRG) is pivotal, but its assignment process is inefficient. The study introduces DRG-LLaMA, an advanced large language model (LLM) fine-tuned on clinical notes to enhance DRGs assignment. Utilizing LLaMA as the foundational model and optimizing it through Low-Rank Adaptation (LoRA) on 236,192 MIMIC-IV discharge summaries, our DRG-LLaMA -7B model exhibited a noteworthy macro-averaged F1 score of 0.327, a top-1 prediction accuracy of 52.0%, and a macro-averaged Area Under the Curve (AUC) of 0.986, with a maximum input token length of 512. This model surpassed the performance of prior leading models in DRG prediction, showing a relative improvement of 40.3% and 35.7% in macro-averaged F1 score compared to ClinicalBERT and CAML, respectively. Applied to base DRG and complication or comorbidity (CC)/major complication or comorbidity (MCC) prediction, DRG-LLaMA achieved a top-1 prediction accuracy of 67.8% and 67.5%, respectively. Additionally, our findings indicate that DRG-LLaMA ’s performance correlates with increased model parameters and input context lengths.

Multi-Species Weed and Crop Classification Comparison Using Five Different Deep Learning Network Architectures

Highlights ConvNeXt model was applied for weed and crop species classification, a first in this field. Five CNN architectures were utilized to classify six weed species and eight crop species. CNN architectures with millions of parameters were trained for improved performance. All CNN models showcased impressive performance, except for Densenet. Abstract. The detection of individual weed and crop species from RGB images is a challenging task that becomes even more difficult as the number of species increases. This is because similarities in the phenotypic traits of weeds and crops make it difficult to accurately distinguish one species from another. In this study, five deep learning Convolutional Neural Networks (CNNs) were employed to classify six weed and eight crop species from North Dakota and assess the performance of each model for specific species from a single image. An automated data acquisition system was utilized to collect and process RGB images twice in a greenhouse setting. The first set of data was used to train the CNN models by updating all of its convolutional layers, while the second set was used to evaluate the performance of the models. The results showed that all CNN architectures, except Densenet, demonstrated strong performance, with macro average f1-scores (measurement of model accuracy) ranging from 0.85 to 0.87 and weighted average f1-scores ranging from 0.87 to 0.88. The presence of three weed classes—palmer amaranth, redroot pigweed, and waterhemp, all of which share similar phenotypic traits—negatively affected the model's performance. In conclusion, the results of this study indicate that CNN architectures hold great potential for classifying weed and crop species in North Dakota, with the exception of situations where plants have similar visible characteristics. Keywords: Deep learning, Precision agriculture, Weed and crop classification.

An outlier removal method based on PCA-DBSCAN for blood-SERS data analysis.

Surface-enhanced Raman spectroscopy (SERS) has shown promising potential in cancer screening. In practical applications, Raman spectra are often affected by deviations from the spectrometer, changes in measurement environments, and anomalies in spectrum characteristic peak intensities due to improper sample storage. Previous research has overlooked the presence of outliers in categorical data, leading to significant impacts on model learning outcomes. In this study, we propose a novel method, called Principal Component Analysis and Density Based Spatial Clustering of Applications with Noise (PCA-DBSCAN) to effectively remove outliers. This method employs dimensionality reduction and spectral data clustering to identify and remove outliers. The PCA-DBSCAN method introduces adjustable parameters (Eps and MinPts) to control the clustering effect. The effectiveness of the proposed PCA-DBSCAN method is verified through modeling on outlier-removed datasets. Further refinement of the machine learning model and PCA-DBSCAN parameters resulted in the best cancer screening model, achieving 97.41% macro-average recall and 97.74% macro-average F1-score. This paper introduces a new outlier removal method that significantly improves the performance of the SERS cancer screening model. Moreover, the proposed method serves as inspiration for outlier detection in other fields, such as biomedical research, environmental monitoring, manufacturing, quality control, and hazard prediction.

Machine Learning for Prediction of Non-Small Cell Lung Cancer Based on Inflammatory and Nutritional Indicators in Adults: A Cross-Sectional Study.

The aim of this study was to evaluate the potential benefit of blood inflammation in the diagnosis of non-small cell lung cancer (NSCLC) and propose a machine-learning-based method to predict NSCLC in asymptomatic adults. A cross-sectional study was evaluated using medical records of 139 patients with non-small cell lung cancer and physical examination data from May 2022 to May 2023 of 198 healthy controls. The NSCLC cohort comprised 128 cases of adenocarcinoma, 3 cases of squamous cell carcinoma, and 8 cases of other NSCLC subtypes. The correlation between inflammatory and nutritional markers, such as monocytes, neutrophils, LMR, NLR, PLR, PHR and non-small cell lung cancer was examined. Features were selected using Python's feature selection library and analyzed by five algorithms. The predictive ability of the model for non-small cell lung cancer diagnosis was assessed by precision, accuracy, recall, F1 score, and area under the curve (AUC). The results showed that the top 14 important factors were PDW, age, TP, RBC, HGB, LYM, LYM%, RDW, PLR, LMR, PHR, MONO, MONO%, gender. Additionally, the naive Bayes (NB) algorithm demonstrated the highest overall performance in predicting adult NSCLC among the five machine learning algorithms, achieving an accuracy of 0.87, a macro average F1 score of 0.85, a weighted average F1 score of 0.87, and an AUC of 0.84. In feature ranking, platelet distribution width was the most important feature, and the NB algorithm performed best in predicting adult NSCLC diagnosis.

CWE Prediction Using CVE Description - The Semantic Similarity Approach

With the growing number of cyber attacks, vulnerability management has gained prominence. Analyzing the vulnerabilities and their underlying weaknesses stored in the vulnerability database is a vital part of vulnerability management. View-1003 is used to label CWE values for the CVE entries in NVD from 2016 onwards. This view has 130 CWE values arranged in a hierarchical tree structure of two layers. Yet a vast number of CVEs are still unclassifed as the process of assigning CWE to known vulnerability is mostly manual. To automate the CWE prediction for CVE, a novel approach is proposed that captures the hierarchical relationship of CWEs in the MITRE tree and the semantic text similarity between CVE description and CWE information. This is achieved by using Cross-encoder models trained on each layer in the MITRE tree that capture the semantic similarity of string pairs created using CVE descriptions and CWE information. Accuracy of the two cross-encoder models on test data is 81.2% and 94.4% for the model trained on top layer and bottom layer of the MITRE tree respectively. A binary classifier model is used to connect the two cross-encoder models as part of the proposed approach. Accuracy of the binary classifier model is 90.9 % on the test data set. The proposed approach achieved an overall test data accuracy of 72.1% and a macro-averaged F1score of 0.735 on 13,896 CVE records. This work considers more CWEs on greater data size and provides a highly practical solution when compared to the existing approaches.

Automating the Identification of Feedback Quality Criteria and the CanMEDS Roles in Written Feedback Comments Using Natural Language Processing.

Manually analysing the quality of large amounts of written feedback comments is time-consuming and demands extensive resources and human effort. Therefore, this study aimed to explore whether a state-of-the-art large language model (LLM) could be fine-tuned to identify the presence of four literature-derived feedback quality criteria (performance, judgment, elaboration and improvement) and the seven CanMEDS roles (Medical Expert, Communicator, Collaborator, Leader, Health Advocate, Scholar and Professional) in written feedback comments. A set of 2,349 labelled feedback comments of five healthcare educational programs in Flanders (Belgium) (specialistic medicine, general practice, midwifery, speech therapy and occupational therapy) was split into 12,452 sentences to create two datasets for the machine learning analysis. The Dutch BERT models BERTje and RobBERT were used to train four multiclass-multilabel classification models: two to identify the four feedback quality criteria and two to identify the seven CanMEDS roles. The classification models trained with BERTje and RobBERT to predict the presence of the four feedback quality criteria attained macro average F1-scores of 0.73 and 0.76, respectively. The F1-score of the model predicting the presence of the CanMEDS roles trained with BERTje was 0.71 and 0.72 with RobBERT. The results showed that a state-of-the-art LLM is able to identify the presence of the four feedback quality criteria and the CanMEDS roles in written feedback comments. This implies that the quality analysis of written feedback comments can be automated using an LLM, leading to savings of time and resources.

Blood Cell Revolution: Unveiling 11 Distinct Types with ‘Naturalize’ Augmentation

Artificial intelligence (AI) has emerged as a cutting-edge tool, simultaneously accelerating, securing, and enhancing the diagnosis and treatment of patients. An exemplification of this capability is evident in the analysis of peripheral blood smears (PBS). In university medical centers, hematologists routinely examine hundreds of PBS slides daily to validate or correct outcomes produced by advanced hematology analyzers assessing samples from potentially problematic patients. This process may logically lead to erroneous PBC readings, posing risks to patient health. AI functions as a transformative tool, significantly improving the accuracy and precision of readings and diagnoses. This study reshapes the parameters of blood cell classification, harnessing the capabilities of AI and broadening the scope from 5 to 11 specific blood cell categories with the challenging 11-class PBC dataset. This transformation facilitates a more profound exploration of blood cell diversity, surpassing prior constraints in medical image analysis. Our approach combines state-of-the-art deep learning techniques, including pre-trained ConvNets, ViTb16 models, and custom CNN architectures. We employ transfer learning, fine-tuning, and ensemble strategies, such as CBAM and Averaging ensembles, to achieve unprecedented accuracy and interpretability. Our fully fine-tuned EfficientNetV2 B0 model sets a new standard, with a macro-average precision, recall, and F1-score of 91%, 90%, and 90%, respectively, and an average accuracy of 93%. This breakthrough underscores the transformative potential of 11-class blood cell classification for more precise medical diagnoses. Moreover, our groundbreaking “Naturalize” augmentation technique produces remarkable results. The 2K-PBC dataset generated with “Naturalize” boasts a macro-average precision, recall, and F1-score of 97%, along with an average accuracy of 96% when leveraging the fully fine-tuned EfficientNetV2 B0 model. This innovation not only elevates classification performance but also addresses data scarcity and bias in medical deep learning. Our research marks a paradigm shift in blood cell classification, enabling more nuanced and insightful medical analyses. The “Naturalize” technique’s impact extends beyond blood cell classification, emphasizing the vital role of diverse and comprehensive datasets in advancing healthcare applications through deep learning.

The risk co-de model: detecting psychosocial processes of risk perception in natural language through machine learning

This paper presents a classification system (risk Co-De model) based on a theoretical model that combines psychosocial processes of risk perception, including denial, moral disengagement, and psychological distance, with the aim of classifying social media posts automatically, using machine learning algorithms. The risk Co-De model proposes four macro-categories that include nine micro-categories defining the stance towards risk, ranging from Consciousness to Denial (Co-De). To assess its effectiveness, a total of 2381 Italian tweets related to risk events (such as the Covid-19 pandemic and climate change) were manually annotated by four experts according to the risk Co-De model, creating a training set. Each category was then explored to assess its peculiarity by detecting co-occurrences and observing prototypical tweets classified as a whole. Finally, machine learning algorithms for classification (Support Vector Machine and Random Forest) were trained starting from a text chunks x (multilevel) features matrix. The Support Vector Machine model trained on the four macro-categories achieved an overall accuracy of 86% and a macro-average F1 score of 0.85, indicating good performance. The application of the risk Co-De model addresses the challenge of automatically identifying psychosocial processes in natural language, contributing to the understanding of the human approach to risk and informing tailored communication strategies.

Machine Learning-Assisted Discovery of Novel Anti-HIV Drug Candidates: An Analysis Using Molecular Datasets

Human Immunodeficiency Virus (HIV) serves as a crisis of global public health, necessitating new anti-HIV agents due to the virus's rapid mutation and subsequent drug resistance. While current Combination Antiretroviral Therapy (CART) has helped control the infection and mortality rates, traditional drug development approaches are costly and inefficient. This study aims to address this issue by applying machine learning algorithms for lead compound discovery using the extensive, quality-assured DTP Antiviral Screen Databases. Three molecular datasets—Extended-Connectivity Fingerprints (ECFP), Simplified Molecular-Input Line-Entry System (SMILES), and 2D molecular IMAGES—were processed using Principal Component Analysis (PCA), train-test splitting, and dataset balancing. Six machine learning algorithms were employed, including linear and nonlinear models, optimized through 5-fold cross-validation. The Area Under the Receiver Operating Characteristic (AUROC) curve was utilized to evaluate the models' performance, as well as the macro averaged precision, averaged recall, averaged F1 score, and balanced accuracy metrics. The ensemble models were constructed from the top-performing individual models. The best individual model, a SVM model trained on the ECFP dataset, achieved performance metrics of 0.78 on macro-averaged precision; 0.68 on macro-averaged recall; 0.72 on macro-averaged F1 score; 0.71 on balanced accuracy; and 0.75 on AUROC when evaluated on the testing data. The best ensemble model, fused with SVM, kNN, and logistic regression trained on the ECFP dataset, achieved performance metrics of 0.82 on macro-averaged precision; 0.67 on macro-averaged recall; 0.72 on macro-averaged F1 score; and 0.70 on balanced accuracy when evaluated on the testing data. The models were then applied to a Pubmed-extracted drug dataset, identifying several promising anti-HIV drug candidates, fulfilling the study's objective to improve the efficiency and success rate of new anti-HIV drug screening and discovery. In summary, this research demonstrates the transformative potential of machine learning in accelerating and optimizing the drug discovery process for HIV treatment.

Complementary and Integrative Health Information in the literature: its lexicon and named entity recognition.

To construct an exhaustive Complementary and Integrative Health (CIH) Lexicon (CIHLex) to help better represent the often underrepresented physical and psychological CIH approaches in standard terminologies, and to also apply state-of-the-art natural language processing (NLP) techniques to help recognize them in the biomedical literature. We constructed the CIHLex by integrating various resources, compiling and integrating data from biomedical literature and relevant sources of knowledge. The Lexicon encompasses 724 unique concepts with 885 corresponding unique terms. We matched these concepts to the Unified Medical Language System (UMLS), and we developed and utilized BERT models comparing their efficiency in CIH named entity recognition to well-established models including MetaMap and CLAMP, as well as the large language model GPT3.5-turbo. Of the 724 unique concepts in CIHLex, 27.2% could be matched to at least one term in the UMLS. About 74.9% of the mapped UMLS Concept Unique Identifiers were categorized as "Therapeutic or Preventive Procedure." Among the models applied to CIH named entity recognition, BLUEBERT delivered the highest macro-average F1-score of 0.91, surpassing other models. Our CIHLex significantly augments representation of CIH approaches in biomedical literature. Demonstrating the utility of advanced NLP models, BERT notably excelled in CIH entity recognition. These results highlight promising strategies for enhancing standardization and recognition of CIH terminology in biomedical contexts.

Graph Convolutional Network with Interactive Memory Fusion for Aspect-based Sentiment Analysis

Aspect-based sentiment analysis (ABSA) aims to predict the sentiment polarity of a specified aspect in a sentence. Graph neural networks (GNN) based on dependency trees have been shown to be effective for ABSA by explicitly modeling the connection between aspect and opinion terms and exploiting local semantic and syntactic information in the sentence. However, most previous works have overlooked the use of global dependency information. In this paper, we propose a novel Graph Convolutional Network (GCN) with an Interactive Memory Fusion (IMF) mechanism (IMF-GCN) that incorporates both global and local structural information for aspect-based sentiment classification. The IMF mechanism efficiently fuses global and local structural dependency information by assigning different weights to global and local dependency modules. Syntactic constraints are also imposed to prevent the graph convolution propagation unrelated to the target words, further improving the model’s performance. The evaluation metrics used in the paper are accuracy and macro-average F1 scores, and the proposed approach achieves optimal results on three datasets with F1 scores of 79.60%, 82.19%, and 77.75%, which outperform the baseline model.

Machine learning based phase prediction and powder metallurgy assisted experimental validation of medium entropy compositionally complex alloys

Medium entropy alloys (MEAs) are a subset of compositionally complex alloys whose mixing entropy lies between R and 1.5 R where R is the universal gas constant. The properties of MEAs largely depend on the phases present in the alloy such as solid solution (SS), solid solution + intermetallic (SS + IM) and amorphous (AM). Hence, the correct prediction of phases can enable the efficient selection of material compositions with anticipated properties. In this paper, three machine learning (ML) algorithms viz. k nearest neighbors (KNNs), artificial neural network (ANN), and random forest (RF) were employed for the ternary phase classification problem. An MEA dataset was constructed by utilizing all reported MEAs till February 2023 to the best of authors’ knowledge. The study implied that the use of only three features (mixing enthalpy, atomic size mismatch, and a strain energy related parameter) were sufficient for the phase prediction in MEAs. Among the three ML algorithms, ANN had the highest macro averaged F1 score (86.7%) and accuracy (87.3%) in predicting the phases in MEAs, while RF has the lowest macro F1 score (84.67%) and accuracy (84.8%). However, for phase prediction between single phase SS and multi-phase SS (binary classification), distance-based algorithm (KNN) was found to be suitable. The prediction performance of ML model over a completely unseen data was assessed in the case study section. The experimentally determined phase details of three new MEA compositions fabricated by powder metallurgy route was also included in the unseen dataset. The SS and AM phases were correctly labeled nine times out of eleven instances by using ANN model. However, the model prediction for SS + IM phase was found to be less reliable (three out of five correct) owing to its relatively poor F1 score.

Improving Clothing Product Quality and Reducing Waste Based on Consumer Review Using RoBERTa and BERTopic Language Model

The disposability of clothing has emerged as a critical concern, precipitating waste accumulation due to product quality degradation. Such consequences exert significant pressure on resources and challenge sustainability efforts. In response, this research focuses on empowering clothing companies to elevate product excellence by harnessing consumer feedback. Beyond insights, this research extends to sustainability by providing suggestions on refining product quality by improving material handling, gradually mitigating waste production, and cultivating longevity, therefore decreasing discarded clothes. Managing a vast influx of diverse reviews necessitates sophisticated natural language processing (NLP) techniques. Our study introduces a Robustly optimized BERT Pretraining Approach (RoBERTa) model calibrated for multilabel classification and BERTopic for topic modeling. The model adeptly distills vital themes from consumer reviews, exhibiting astounding accuracy in projecting concerns across various dimensions of clothing quality. NLP’s potential lies in endowing companies with insights into consumer review, augmented by the BERTopic to facilitate immersive exploration of harvested review topics. This research presents a thorough case for integrating machine learning to foster sustainability and waste reduction. The contribution of this research is notable for its integration of RoBERTa and BERTopic in multilabel classification tasks and topic modeling in the fashion industry. The results indicate that the RoBERTa model exhibits remarkable performance, as demonstrated by its macro-averaged F1 score of 0.87 and micro-averaged F1 score of 0.87. Likewise, BERTopic achieves a coherence score of 0.67, meaning the model can form an insightful topic.