Learning Vector Quantization Research Articles

Ensemble LVQ Model for Photovoltaic Line-to-Line Fault Diagnosis Using K-Means Clustering and AdaGrad

Line-to-line (LL) faults are one of the most frequent short-circuit conditions in photovoltaic (PV) arrays which are conventionally detected and cleared by overcurrent protection devices (OCPDs). However, OCPDs are shown to face challenges when detecting LL faults under critical detection conditions, i.e., low mismatch levels and/or high fault impedance values. This occurs due to insufficient fault current, thus leaving the LL faults undetected and leading to power losses and even catastrophic fire hazards. To compensate for OCPD deficiencies, recent studies have proposed modern artificial intelligence (AI)-based methods. However, various limitations can still be witnessed even in AI-based methods, such as (i) most of the models requiring a massive training dataset, (ii) critical fault detection conditions not being taken into consideration, (iii) models not being accurate enough when dealing with critical conditions, etc. To this end, the present paper proposes a learning vector quantization (LVQ)-based ensemble learning model in which three LVQs are individually trained to detect and classify LL faults in PV arrays. The initial LVQ vectors are determined using the k-means clustering method, and the learning rate is optimized by the adaptive gradient (AdaGrad) optimizer. The training and testing datasets are collected according to the PV array’s current–voltage (I–V) characteristic curve, and several features are extracted based on the Canberra and chi-squared distance techniques. The model utilizes a small training dataset, considers various critical detection conditions for LL faults—such as different mismatch levels and fault impedance values—and the final experimental results show that the model achieves an impressive average accuracy of 99.26%.

Machine learning-based identification and validation of immune-related biomarkers for early diagnosis and targeted therapy in diabetic retinopathy

The early diagnosis of diabetic retinopathy (DR) is challenging, highlighting the urgent need to identify new biomarkers. Immune responses play a crucial role in DR, yet there are currently no reports of machine learning (ML) algorithms being utilized for the development of immune-related molecular markers in DR. Based on the datasets GSE102485 and GSE160306, differentially expressed genes (DEGs) were screened using Weighted Gene Co-expression Network Analysis (WGCNA). Five ML algorithms including Bayesian, Learning Vector Quantization (LVQ), Wrapper (Boruta), Random Forest (RF), and Logistic Regression were employed to select immune-related genes associated with DR (DR.Sig). Seven ML algorithms including Naive Bayes (NB), RF, Support Vector Machine (SVM), AdaBoost Classification Trees (AdaBoost), Boosted Logistic Regressions (LogitBoost), K-Nearest Neighbors (KNN), and Cancerclass were utilized to construct a predictive model for DR. The relationship between DR.Sig genes and immune cells was analyzed using single-sample Gene Set Enrichment Analysis (ssGSEA). Additionally, drug sensitivity prediction of DR.Sig genes and molecular docking were performed. Through the utilization of 5 ML algorithms, 6 immune-related biomarkers closely related to the occurrence of DR were identified, including FCGR2B, CSRP1, EDNRA, SDC2, TEK, and CIITA. The DR predictive model constructed based on these 6 DR.Sig genes using the Cancerclass algorithm demonstrated superior predictive performance compared to 4 previously published DR-related biomarkers. In vivo and in vitro experiments also provided strong validation of the expression of the 6 genes in DR. Positive correlations were observed between these genes and 22 types of immune cells. Molecular docking results revealed that CSRP1, EDNRA, and TEK exhibited the highest affinities with the small molecule compounds etoposide, FR-139317, and camptothecin, respectively. The models constructed based on various ML algorithms can effectively predict the occurrence of DR events and hold potential for targeted drug therapies, providing a basis for the early diagnosis and targeted treatment of DR.

Prediction of surface roughness at the machining of densified wood surfaces

ABSTRACT In this research, modeling and interpretation of the effects of the machining parameters on surface roughness (Rz) using artificial neural networks (ANN) and analysis methods (MLP, LVQ and Taguchi Design analysis) werw studied. Black poplar (Populus nigra) was selected as the experimental material. Specimens, which were transversal densified by a thermo-mechanical (TM) process at 0%, 20% and 40% compression ratios. The densified wood was processed at 1000, 1500 and 2000 mm/min feed speeds and in 12,000, 15,000, and 18,000 rpm rotation speeds in a CNC machine by using two different cutters. Rz surface-roughness values were measured. The modeling of Rz with artificial neural networks (ANN) is discussed. While 97% success was achieved in the classification made with multilayer perceptron (MLP) in estimating Rz, this success rate is 100% in the classification made with learning vector quantization (LVQ). MLP and LVQ are operations in the MATLAB R2019b software. Taguchi values were compared with the experimental data results, it was seen that the MSE value was 4.6%, the MAE value was 1.8%, and the RMSE value was 2.1%. These results showed that the presented models can accurately determine the appropriate parameters for the desired Rz. The prediction results and presented models can be applied for targeted industrial applications.

Breast Tumor Diagnosis Based on Molecular Learning Vector Quantization Neural Networks.

DNA nanotechnology plays a crucial role in precise cancer medicine. Currently, molecular logic circuits are applied to detect tumor-specific biomarkers and control the release of therapeutic drugs. However, these systems lack self-learning capabilities for intelligent diagnostics in biological samples, and their data processing capabilities are limited. Here, a molecular learning vector quantization neural network (LVQNN) model based on DNA strand displacement (DSD) technology for breast tumor diagnosis is developed. Compared to previous work, the molecular LVQNN boasts powerful computing abilities, handling high-dimensional data for intelligent cancer diagnosis. To verify the feasibility and versatility of the network, two distinct typical datasets are selected: one from a single source with cell morphology data from 569 cases, and a more extensive one spanning different populations and ages, with miRNA gene expression data from 1881 cases. By using the molecular LVQNN, diagnostic experiments are conducted on 50 and 120 public individuals from these two datasets, respectively, achieving accuracy rates of 94% and 97.5%. This study demonstrates that the LVQNN model exhibits significant advantages in breast cancer diagnosis and enhances diagnostic accuracy while introducing new approaches for intelligent cancer diagnosis, anticipated to bring significant breakthroughs and application prospects to precise cancermedicine.

Comparison of support vector machines (SVMs) and the learning vector quantization (LVQ) techniques for geological domaining: a case study from Darehzar porphyry copper deposit, SE Iran

Comparison of support vector machines (SVMs) and the learning vector quantization (LVQ) techniques for geological domaining: a case study from Darehzar porphyry copper deposit, SE Iran

A Novel Method of Using Machine Learning Techniques to Protect Clouds Against Distributed Denial of Service (DDoS) Attacks.

The term "cloud computing" describes a method of providing hardware- and software-based services over the internet. This allows users to access their data and apps from any device. The benefits of cloud computing include scalability, virtualization, access to user assets, lower infrastructure costs, and flexibility. However, one drawback is that it is susceptible to distributed denial of service attacks, which occur when multiple computer systems collaborate to target a particular resource, website, or server. Distributed denial of service (DDoS) attacks present a serious risk to computer networks and constitute a major cyber security challenge. This results in a denial of service for end users, as a result of false connection requests, a flood of messages, and twisted packets causing the system to slow down or even crash. Real people and services cannot access cloud computing. The issue of machine learning algorithms for identifying distributed denial of service (DDoS) attacks is explored in this article. In order to identify and defend cloud systems from harmful assaults, we developed a new machine learning approach in this work that is based on transfer learning. This study offers NSL-KDD datasets and two methodologies. There are two types of filters available: the Learning Vector Quantization (LVQ) Filters and the Principal Component Analysis (PCA) method, which reduces dimensionality. The features selected from each method were pooled using Decision Tree (DT), Naïve Bayes (NB), and Support Vector Machine (SVM) to detect distributed denial of service attacks (DDoS). We contrasted the results of several classifications. In terms of attack detection, LVQ-based DT performed better results as compared to other methods.

Towards Robust Colour Texture Analysis with Limited Training Data

Texture analysis plays an important role in different domains of healthcare, agriculture, and industry, where multi-channel sensors are gaining more attention. This contribution presents an interpretable and efficient framework for texture classification and segmentation that exploits colour or channel information and does not require much data to produce accurate results. This makes such a framework well-suited for medical applications and resource-limited hardware. Our approach builds upon a distance-based generalized matrix learning vector quantization (GMLVQ) algorithm. We extend it with parametrized angle-based dissimilarity and introduce a special matrix format for multi-channel images. Classification accuracy evaluation of various model designs was performed on VisTex and ALOT data, and the segmentation application was demonstrated on an agricultural data set. Our extension of parametrized angle dissimilarity measure leads to better model generalization and robustness against varying lighting conditions than its Euclidean counterpart. The proposed matrix format for multichannel images enhances classification accuracy while reducing the number of parameters. Regarding segmentation, our method shows promising results, provided with a small class-imbalanced training data set. Proposed methodology achieves higher accuracy than prior work benchmarks and a small-scale CNN while maintaining a significantly lower parameter count. Notably, it is interpretable and accurate in scenarios where limited and unbalanced training data are available.

SIFG: an ensemble model for sieving fake news from genuine without metadata by combining syntactic and semantic features

ABSTRACT With the emergence of the Internet, social media, and smartphones, almost everyone can now claim that they have news in their pockets. This phenomenon makes people aware of their surroundings and knowledgeable of current events. But, it also presents new challenges, such as automatic detection, machine/bot-generated fake news, limited or no metadata, etc. In this paper, we mitigate some of these challenges by taking a step toward SIeving Fake News from Genuine (SIFG) and presenting a system named SIFG. In SIFG we have used basic and advanced Natural Language Processing techniques to detect online fake news automatically. This makes SIFG independent of the metadata, such as the source, network structure and behavior, temporal propagation, and responses, about the news. We also introduce specific Parts of Speech patterns, utilize Generalized Relevance Learning Vector Quantization for feature selection, and employ ensemble learning to improve the performance of SIFG. When tested with a publicly available online fake news dataset of 10,000 fake and 10,000 genuine news, SIFG shows promising results and achieves an accuracy in the range of 89.85% − 95%.

Predicting Number of Vehicles Involved in Rural Crashes Using Learning Vector Quantization Algorithm

Roads represent very important infrastructure and play a significant role in economic, cultural, and social growth. Therefore, there is a critical need for many researchers to model crash injury severity in order to study how safe roads are. When measuring the cost of crashes, the severity of the crash is a critical criterion, and it is classified into various categories. The number of vehicles involved in the crash (NVIC) is a crucial factor in all of these categories. For this purpose, this research examines road safety and provides a prediction model for the number of vehicles involved in a crash. Specifically, learning vector quantization (LVQ 2.1), one of the sub-branches of artificial neural networks (ANNs), is used to build a classification model. The novelty of this study demonstrates LVQ 2.1’s efficacy in categorizing accident data and its ability to improve road safety strategies. The LVQ 2.1 algorithm is particularly suitable for classification tasks and works by adjusting prototype vectors to improve the classification performance. The research emphasizes how urgently better prediction algorithms are needed to handle issues related to road safety. In this study, a dataset of 564 crash records from rural roads in Calabria between 2017 and 2048, a region in southern Italy, was utilized. The study analyzed several key parameters, including daylight, the crash type, day of the week, location, speed limit, average speed, and annual average daily traffic, as input variables to predict the number of vehicles involved in rural crashes. The findings revealed that the “crash type” parameter had the most significant impact, whereas “location” had the least significant impact on the occurrence of rural crashes in the investigated areas.

Web-based Application for Diagnosis of Diabetes using Learning Vector Quantization (LVQ)

Diabetes is a chronic disease that causes the most deaths in the world. This disease can cause long-term complications that develop gradually, such as heart attacks, strokes, and problems with the kidneys, eyes, skin, and blood vessels. Therefore, early diagnosis of diabetes is crucial for patients to know their diabetes status. In this study, we designed a web-based application for diabetes diagnosis using Learning Vector Quantization (LVQ). The dataset was collected from Kaggle's Diabetes Dataset which contains eight attributes, namely pregnancy, glucose, blood pressure, insulin, skin thickness, BMI, diabetes lineage function, and age, with two classes, namely negative diabetes (healthy) and positive diabetes. The results show that the best accuracy is 73.1% with a learning rate of 0.001. These findings can help patients detect diabetes problems early.

Undersampling based on generalized learning vector quantization and natural nearest neighbors for imbalanced data

Undersampling based on generalized learning vector quantization and natural nearest neighbors for imbalanced data

Determination of early breeder in goldfish (Carassius auratus Linn.) with learning vector quantization, probabilistic and pattern recognition neural networks

It is common practice to categorize growing fish according to quality in fish farming centers. For such an application, experienced and estimating people are needed. By pre-selecting the right fish for the ornamental fish industry, it gets ahead of the competitors. This study deals with the classification of early breeder determination in goldfish using three different Artificial Neural Network (ANN) techniques. This classification model can help the fish industry assess classification risks and make the right decision. The used dataset was derived from the results of the classification section of 120 goldfish. It consisted of 7 input parameters (day, live weight, body length, head height, head width, body height, and current class). During trial, all goldfish fed by a diet contained 360 g crude protein and 4449.85 kcal metabolizable energy (kg / dry matter). The important types of classification ANNs, namely Learning Vector Quantization Neural Network (LVQNN), Probabilistic Neural Network (PNN), and Pattern Recognition Neural Network (PRNN) were employed for the machine learning scheme. The training and test performances of the ANN models were compared with the correct prediction ratio. They showed that all of the proposed ANN techniques were well at classification. However, the PRNN model was better than the LVQNN and PNN as a classifier for the breeder selection of goldfish. Therefore, the results of PRNN model such as histogram, Receiver Operating Characteristic (ROC) curve, regression, confusion matrix, accuracy, sensitivity, precision, and F1 score were given and discussed. Furthermore, the classification of early breeder determination in goldfish were examined for days with the best PRNN.

Intelligent support in manufacturing process selection based on artificial neural networks, fuzzy logic, and genetic algorithms: Current state and future perspectives

Technological advances, dynamic customer needs, growing uncertainty, and the imperative for sustainable development pressure manufacturing entities to enhance productivity and competitiveness. In this challenging landscape, decision-making in manufacturing process selection is critical. Adopting intelligent support is essential for balancing performance and costs through optimal process selection. Through a comprehensive review of 93 studies published between 2013 and 2023, this paper aims to provide a profound understanding of intelligent support in manufacturing process selection. The findings, which indicate significant interest in intelligent methodologies for manufacturing process selection, are of great importance. Fuzzy logic is prevalent in additive manufacturing due to its ability to handle complex and imprecise data. At the same time, artificial neural networks are favored in conventional manufacturing for leveraging extensive historical data. Genetic algorithms are primarily used for optimization challenges. As manufacturing evolves with new technologies and complex materials, this paper advocates adopting a generalized matrix learning vector quantization neural network for efficient and intelligent process selection in additive and conventional approaches due to its capacity to leverage historical data and handle complex and high dimensional data.

MEASUREMENT OF CLASSIFICATION PERFORMANCE WITH THE LEARNING VECTOR QUANTIZATION METHOD ON COVID-19 VACCINATION DATA AT THE PARUMPANAI HEALTH CENTER

In the midst of the COVID-19 pandemic, various countries are always trying their best to restore global stability. One effective way is the discovery of several vaccines to prevent transmission of the virus. Indonesia is one of the countries that is aggressively implementing the COVID-19 vaccination. The vaccination process which has been carried out from February 2021 until the end of 2021 has covered approximately 160 million people or 76.83% of the target set by the government. Vaccine recipients have criteria to be able to get vaccinated to avoid side effects or complications. So it is necessary to classify groups that can receive vaccines and also delay vaccination. This research aims to determine the performance of the learning vector quantization classification method. Learning vector quantization method classification produces 95% accuracy, 97% precision, and 96% sensitivity. From these performance measurements, it can be concluded that the learning vector quantization method is very good and can be used in the classification of COVID-19 vaccination recipients at the Parumpanai Public Health Center, East Luwu Regency.

Performance Evaluation of Some Selected Classification Algorithms in a Facial Recognition System

Facial Recognition (FR) has been an active area of research and has diverse applicable environment, it continues to be a challenging research topic. With the development of image processing and pattern recognition technology, there are many challenges in machine learning to select the appropriate classification algorithms, most especially in the area of classification of extracted features to have low classification time, high sensitivity and accuracy of the classification algorithms, so it is very important to explore the performance of different algorithms in image classification. The three selected supervised learning classification algorithms: Learning Vector Quantization (LVQ), Relevance Vector Machine (RVM), and Support Vector Machine (SVM) performance were evaluated so as to know the most effective out of the selected algorithms for facial images classification. The development of the system has four stages, the first stage is image acquisition and 180 images were taken by digital camera under same illumination and light colour background. The second stage is pre-processing to improve the images data by suppressing unwilling distortion; grayscale and normalization were used for image pre-processing. The third stage is feature extraction; Discrete Cosine Transform (DCT) is adopted for this purpose. While the fourth stage is face recognition classification, Receiver Operating Characteristics (ROC) was used to test the performance of each the three algorithms. However the Learning Vector Quantization algorithm, Relevance Vector Machine and Support Vector Machine performance have not been compared together to the most effective out of the three algorithms in term of False Positive Rate, Sensitivity, Specificity, Precision, Accuracy and Computation Time. Hence, this work evaluated the performance of the Learning Vector Quantization; Relevance Vector Machine and Support Vector Machine classification algorithms in facial recognition system and Support Vector Machine outwit the other two algorithms in facial recognition in term of specificity, recognition time and recognition accuracy at different threshold.

A selective LVQ algorithm for improving instance reduction techniques and its application for text classification

Instance-Based Learning, such as the k Nearest Neighbor (kNN), offers a straightforward and effective solution for text classification. However, as a lazy learner, kNN’s performance heavily relies on the quality and quantity of training instances, often leading to time and space inefficiencies. This challenge has spurred the development of instance-reduction techniques aimed at retaining essential instances and discarding redundant ones. While such trimming optimizes computational demands, it might adversely affect classification accuracy. This study introduces the novel Selective Learning Vector Quantization (SLVQ) algorithm, specifically designed to enhance the performance of datasets reduced through such techniques. Unlike traditional LVQ algorithms that employ random vector weights (codebook vectors), SLVQ utilizes instances selected by the reduction algorithm as the initial weight vectors. Importantly, as these instances often contain nominal values, SLVQ modifies the distances between these nominal values, rather than modifying the values themselves, aiming to improve their representation of the training set. This approach is crucial because nominal attributes are common in real-world datasets and require effective distance measures, such as the Value Difference Measure (VDM), to handle them properly. Therefore, SLVQ adjusts the VDM distances between nominal values, instead of altering the attribute values of the codebook vectors. Hence, the innovation of the SLVQ approach lies in its integration of instance reduction techniques for selecting initial codebook vectors and its effective handling of nominal attributes. Our experiments, conducted on 17 text classification datasets with four different instance reduction algorithms, confirm SLVQ’s effectiveness. It significantly enhances the kNN’s classification accuracy of reduced datasets. In our empirical study, the SLVQ method improved the performance of these datasets, achieving average classification accuracies of 82.55%, 84.07%, 78.54%, and 83.18%, compared to the average accuracies of 76.25%, 79.62%, 66.54%, and 78.19% achieved by non-fine-tuned datasets, respectively.

SurvivalLVQ: Interpretable supervised clustering and prediction in survival analysis via Learning Vector Quantization

Identifying subgroups with similar survival outcomes is a pivotal challenge in survival analysis. Traditional clustering methods often neglect the outcome variable, potentially leading to inaccurate representation of risk profiles. To address this, we present SurvivalLVQ, a novel interpretable method that adapts Learning Vector Quantization (LVQ) to survival analysis. Unlike traditional classification uses of LVQ, SurvivalLVQ groups individuals by survival probabilities and assigns a unique survival curve to each cluster, representing the collective survival behavior within that group. Moreover, it can predict individual survival curves using weighted averages from nearby clusters. When tested on 76 benchmark datasets, it outperformed other clustering methods and showed competitive prediction performance. SurvivalLVQ bridges the gap between clustering techniques and outcome-oriented methods. Its strong clustering performance, coupled with competitive prediction capabilities and with easy to interpret outcomes, make it a promising tool for various applications within survival analysis.

Prototype-Based Soft Feature Selection Package

This paper presents a prototype-based soft feature selection package (Sofes) wrapped around the highly interpretable Matrix Robust Soft Learning Vector Quantization (MRSLVQ) and the Local MRSLVQ algorithms. The process of assessing feature relevance with Sofes aligns with a comparable approach established in the Nafes package, with the primary distinction being the utilization of prototype-based induction learners influenced by a probabilistic framework. The numerical evaluation of test results aligns Sofes’ performance with the Nafes package's.

Research on Tractor Condition Recognition Based on Neural Networks

Tractor condition recognition has important research value in helping to understand the operating status of tractors and the trend of tillage depth changes in the field. Therefore, this article presents a method for recognizing tractor conditions, providing the basis for establishing the relationship between tractor conditions and the tillage depth of the attached agricultural machinery. This study designed a tractor condition recognition method based on neural networks. Using real-world vehicle data to establish a data set, K-means clustering analysis was used to label the data set based on four conditions: “accelerated start”, “constant speed”, “decelerated stop” and “turning”. The learning vector quantization (LVQ) neural network and the VGG-16 model of a CNN were selected for use recognizing the tractor conditions. The results showed that both the neural networks had good recognition effects. The average accuracy rates of the VGG-16 model of CNN and LVQ neural network were 90.25% and 79.7%, respectively, indicating that these models could be applied to tractor condition recognition and provide theoretical support for the correction of angle detection errors.

Compare the Performance of Distinct Neural Networks Techniques to diagnose the kidney stone disease

Artificial Neural Networks are excellent at identifying patterns or trends in data, which makes them perfect for forecasting or prediction. Thus, neural networks have extensive application in biological systems. The application of neural networks to kidney stone diagnosis is emphasized in this article. Kidney stone issues can be diagnosed with neural networks by applying technological concepts such as MLP, SVM, RBF, and BPA. The purpose of this research is to use three different neural network algorithms—each with its own specific design and set of properties to identify kidney stone disease. The performance of the three neural networks is compared in this research with respect to training data set size, model creation time, and accuracy. Kidney stone sickness will be diagnosed using radial basis function (RBF) networks, two layers feed forward perceptrons trained with the back propagation training algorithm, and learning vector quantization (LVQ). However, determining the best approach for any particular diagnostic had never been an easy task. Like many other illnesses, kidney stones have already been diagnosed using neural network algorithms. The main objective of this work is to recommend the best medical diagnostic instrument, such as kidney stone detection, to reduce diagnosis times and improve accuracy and efficiency.