Vector Quantization Method Research Articles

SVQ-MAE: an efficient speech pre-training framework with constrained computational resources

Self-supervised learning for speech pre-training models has achieved remarkable success in acquiring superior speech contextual representations by learning from unlabeled audio, excelling in numerous downstream speech tasks. However, the pre-training of these models necessitates significant computational resources and training duration, presenting a high barrier to entry into the realm of pre-training learning. In our efforts, by amalgamating the resource-efficient benefits of the generative learning model, Masked Auto Encoder, with the efficacy of the vector quantization method in discriminative learning, we introduce a novel pre-training framework: Speech Vector Quantization Masked Auto Encoder (SVQ-MAE). Distinct from the majority of SSL frameworks, which require simultaneous construction of speech contextual representations and mask reconstruction within an encoder-only module, we have exclusively designed a decoupled decoder for pre-training SVQ-MAE. This allows the additional decoupled decoder to undertake the mask reconstruction task solely, reducing the learning complexity of pretext tasks and enhancing the encoder’s efficiency in extracting speech contextual representations. Owing to this innovation, by using only 4 GPUs, SVQ-NAE can achieve high performance comparable to wav2vec 2.0, which requires 64 GPUs for training. In the Speech Processing Universal Performance Benchmark, SVQ-MAE surpasses wav2vec 2.0 in both keyword spotting and emotion recognition tasks. Furthermore, in cross-lingual ASR for Mandarin, upon fine-tuning on AISHELL-1, SVQ-MAE achieves a Character Error Rate of 4.09%, outperforming all supervised ASR models.

Quantized kernel recursive q-Rényi-like algorithm

This paper introduces the kernel recursive q-Rényi-like (KRqRL) algorithm, based on the q-Rényi kernel function and the kernel recursive least squares (KRLS) algorithm. To reduce the computational complexity and memory requirements of the KRqRL algorithm, an online vector quantization (VQ) method is employed to quantize the network size to a codebook size, resulting in the quantized KRqRL (QKRqRL) algorithm. This paper provides a detailed analysis of the convergence and computational complexity of the QKRqRL algorithm. In the simulation experiments, the network size of each algorithm is reduced to 25% of its original size. The performance of the QKRqRL algorithm is evaluated in terms of convergence speed, prediction error, and computation time under non-Gaussian noise conditions. Finally, the QKRqRL algorithm is further validated using sunspot data, demonstrating its superior stability and online prediction performance.

Systematization of sunflower genotypes based on seed phenotypic characteristics using neural networks

In recent years, various datasets related to the phenotyping of sunflower genotypes have become increasingly accessible. However, one of the key challenges remains the efficient and accurate prediction of phenotypes based on genotypes in the context of climate change. Analyzing phenotypes at different levels of organization and detecting connections between phenotypes and genotypes require the integration and processing of large, diverse, and often noisy datasets. Machine learning offers a broad arsenal of methods and approaches for identifying predictive patterns in such data. Therefore, the research aimed to develop a methodology for the systematization of sunflower genotypes based on seed phenotypic characteristics using the data vector quantization method and neural networks. The study revealed the phenotypic characteristics of sunflower seeds from various genotypes selected by the Institute of Oilseed Crops of NAAS, grown in the southern Steppe of Ukraine, including seed length, width, thickness, seed mass, kernel mass, and seed coat cracking force. For this purpose, appropriate laboratory equipment was developed, including two modules for determining the morphological and rheological properties of seeds. The developed methodology for the systematization of sunflower genotypes based on seed phenotypic characteristics includes the following steps: measuring the characteristics of sunflower seeds from various samples (parental components); studying the mutual correlation of characteristics; conducting hierarchical cluster analysis of the data using the Ward's method; determining the optimal number of groups; performing k-means clustering using the vector quantization method; determining the correspondence of ranges of characteristics to the group; training a neural network to group the data by samples and created groups; verifying the adequacy of the neural network on test data. The developed methodology was tested, and the MLP 30-15-3 neural network for grouping data by samples and created groups of sunflower seeds was developed in the Statistica software package. The network's training efficiency was 99.4%, and such of testing and validation was 95.6% and 96.7%, respectively.

Semantic-empowered visible light communication for image transmission based on deep convolutional generative adversarial network

In this paper, a semantic communication-based scheme was proposed to tackle the optimization challenge of transmission efficiency and link stability in indoor visible light communication (VLC) systems utilizing light-emitting diodes for image transmission. The semantic model, established by deep convolutional generative adversarial network (DCGAN) and vector quantization method, can effectively extract the essential characteristics of images. In addition, indoor VLC channel models including line-of-sight (LOS) and non-line-of-sight (NLOS) links are established in a 5*5*3 room, while incorporating noise interference encountered during signal transmission into the training process of the semantic model to enhance its anti-interference capability. Besides, the performance disparity between the semantic VLC system and the conventional VLC system using Better Portable Graphics (BPG) is assessed across various modulation formats, transmission distances, and receiving locations. The simulation results demonstrate that the semantic VLC system effectively enhances link stability and achieves a signal-to-noise ratio (SNR) gain exceeding 6 dB. Additionally, the semantic VLC system achieves superior performance compared to the conventional VLC system employing convolutional code at a rate of 1/2, without incurring additional bits consumption for error correction. Moreover, the practicality of the semantic VLC system is experimentally validated on an indoor physical testbed online enabled by the field programmable gate array (FPGA) with up to 1 Gbps data rate. In comparison with existing schemes, the semantic VLC system effectively reduces communication overhead by 40% while maintaining similar received image quality. Furthermore, it significantly enlarges the communication coverage of the VLC system by a factor of two without necessitating any hardware modifications and ensures stable transmission of images in high-speed scenarios.

MEASUREMENT OF CLASSIFICATION PERFORMANCE WITH THE LEARNING VECTOR QUANTIZATION METHOD ON COVID-19 VACCINATION DATA AT THE PARUMPANAI HEALTH CENTER

In the midst of the COVID-19 pandemic, various countries are always trying their best to restore global stability. One effective way is the discovery of several vaccines to prevent transmission of the virus. Indonesia is one of the countries that is aggressively implementing the COVID-19 vaccination. The vaccination process which has been carried out from February 2021 until the end of 2021 has covered approximately 160 million people or 76.83% of the target set by the government. Vaccine recipients have criteria to be able to get vaccinated to avoid side effects or complications. So it is necessary to classify groups that can receive vaccines and also delay vaccination. This research aims to determine the performance of the learning vector quantization classification method. Learning vector quantization method classification produces 95% accuracy, 97% precision, and 96% sensitivity. From these performance measurements, it can be concluded that the learning vector quantization method is very good and can be used in the classification of COVID-19 vaccination recipients at the Parumpanai Public Health Center, East Luwu Regency.

Vector Quantization Methods for Access Point Placement in Cell-Free Massive MIMO Systems

Vector Quantization Methods for Access Point Placement in Cell-Free Massive MIMO Systems

Quantized information-theoretic learning based Laguerre functional linked neural networks for nonlinear active noise control

Traditional functional linked neural networks (FLNNs) impose a significant computational burden due to their input expansion, primarily stemming from the utilization of digital filters. This paper presents a Laguerre FLNNs filter for nonlinear active noise control (NANC) systems. By employing the truncated Laguerre series, the presented filter achieves effective approximation of long primary paths with a reduced filter length. Moreover, we develop adaptive algorithms rooted in information-theoretic learning (ITL) within the framework of the Laguerre-FLNNs NANC model. Using the ITL criterions, a Laguerre filtered-s maximum correntropy criterion (LFsMCC) algorithm is derived and a Laguerre filtered-s quantized minimum error entropy criterion (LFsQMEE) algorithm is proposed by minimizing Renyi’s quadratic entropy. To reduce the computation cost, an online vector quantization method is utilized to improve the LFsQMEE. This technique selectively quantizes the error vectors, reducing them to a smaller subset of samples within the codebook. Moreover, an enhanced LFsQMEE with a fiducial point is introduced. The steady-state performance and the computational complexity are analyzed. Theoretical analysis is validated through simulations and the control performance of the proposed model and algorithms is tested in experiments with both simulated and real paths.

An efficient and straightforward online vector quantization method for a data stream through remove-birth updating.

The growth of network-connected devices has led to an exponential increase in data generation, creating significant challenges for efficient data analysis. This data is generated continuously, creating a dynamic flow known as a data stream. The characteristics of a data stream may change dynamically, and this change is known as concept drift. Consequently, a method for handling data streams must efficiently reduce their volume while dynamically adapting to these changing characteristics. This article proposes a simple online vector quantization method for concept drift. The proposed method identifies and replaces units with low win probability through remove-birth updating, thus achieving a rapid adaptation to concept drift. Furthermore, the results of this study show that the proposed method can generate minimal dead units even in the presence of concept drift. This study also suggests that some metrics calculated from the proposed method will be helpful for drift detection.

Machine Learning Algorithms for Predicting Factitious Disorder Using the Learning Vector Quantization Method

Factitious disorder is classified as a mental problem because it is related to severe emotional disorders. A person who has factitious disorder intentionally produces symptoms of the disease for the purpose of receiving care and attention in a medical setting. People with Factitious disorder act with the aim of attracting the sympathy and attention of others. Diagnosing factitious disorder is very difficult. The reason is, the sufferer looks fine. The doctor must eliminate any physical and mental illness before confirming the diagnosis of Factitious disorder. Along with the development of machine learning technology. Incorporation of patient data and the use of machine learning technology can help detect the disease. The purpose of this study was to build a system to predict the likelihood of a person being exposed to factual or unrelated disorders with the inputs that the patient entered. The method for diagnosing factitious disorder uses the Learning Vector Quantization method whether a person is a sufferer or not. The data was obtained from the questionnaire using 14 parameters and managed to get data as much as 30 training data. This research resulted in a maximum epoch value of 1000, a learning rate value of 0.1, a learning rate multiplier of 0.1, a minimum learning rate of 0.0001 and a training data of 5. The accuracy result obtained is 70%.

Generalized kernel maximum correntropy criterion with variable center: Formulation and performance analysis

Recently, the kernel adaptive filtering algorithm with the generalized maximum correntropy criterion (GMCC) has gained attention due to its excellent nonlinear system modeling ability and robustness to non-Gaussian noise. However, since the default center of the GMCC is located at zero, it hampers its performance in the non-zero mean noise environment. To overcome the problem, this paper proposes a kernel adaptive filtering algorithm based on the GMCC with variable center (GMCC-VC) called generalized kernel maximum correntropy criterion with variable center (GKMCC-VC). In addition, the online vector quantization (VQ) method is introduced to the GKMCC-VC algorithm for suppressing the increasing network size. The probability of divergence, the mean-square steady-state behavior, and the convergence condition of the GKMCC-VC algorithm are also obtained under some assumptions. The potential relationship between the GMCC-VC and the generalized minimum error entropy (GMEE) criteria is discussed in the paper. Finally, the simulation results verify the superiority of the proposed algorithm in modeling nonlinear systems and the correctness of the theoretical model.

Measuring the Maturity Level of Oil Palm Fruit For CPO Production Based on Color With Using the LVQ Method

Palm oil is a very important commodity besides oil and gas which also has a fairly good export value. The palm oil produced must be supported by the quality standards set by SNI. The level of maturity when harvesting oil palm fruit greatly influences the quality of Crude Palm Oil (CPO) production, which is crude palm oil that has a reddish color obtained from extraction or from the pressing process of oil palm fruit flesh. In fact, in the field of oil palm fruit harvest, there are still many oil palm fruit that are not ripe enough and can even be said to be still raw, entering the CPO production process. Determination of the maturity level of oil palm fruit is generally determined based on the amount of loose fruit and color, so handling the harvest of oil palm fruit is an important activity in improving the quality of CPO. It is necessary to build a system capable of managing and processing palm fruit images to measure the maturity level of the palm fruit to be produced. To obtain the right level of accuracy, this research uses the Learning Vector Quantization (LVQ) method. LVQ is a method for conducting supervised competitive layer learning. From the results of trials conducted, it is proven that the system can measure very ripe oil palm fruit with HSV values (0.052209; 0.896021; 0.791114).

Improved adolescent identity search algorithm for block-based image compression

Image compression has become an indispensable part of the digital world, reducing the costs of storing and transmitting high-quality images. Vector quantization method, which stands out among image compression methods, facilitates the storage and transmission of images without compromising image quality in the process of reducing their size. It uses a codebook to represent similar patterns in a set of images in this method. If the optimum codebook design is achieved, the loss in image quality is minimized by increasing the data compression ratio. It is efficient to use nature-inspired metaheuristic algorithms in the optimization of complex and multidimensional problems such as optimum codebook generation in the image compression process. In this paper, Adolescent Identity Search Algorithm (AISA), which simulates the identity search process of adolescents, is designed for the first time of optimum codebook generation in the block-based image compression process. In addition, improved AISA with various modifications has been proposed to avoid the capture of the conventional AISA by local minimums and to customize the search space. The proposed improved AISA is compared with various well-known metaheuristic algorithms in the literature, and the visual and numerical results are evaluated on various metrics. Based on the simulation results, it has been shown that the proposed IAISA is more efficient than the other metaheuristic algorithms for block-based image compression.

PERBANDINGAN METODE LVQ DAN BACKPROPAGATION UNTUK KLASIFIKASI STATUS GIZI ANAK DI KECAMATAN SANGKUP

The problem of children nutrition isi still a problem in various regions in Indonesia. Poor or poor nutrition of children is influenced by several factors, namely insufficient food intake and infectious diseases. Undernutrition or poor nutrition can be known from the nutritional status assessment obtained from classifying the nutrional status of children. Classification is a part of data mining that is often used to classify data based on certain data or variables. This study aims to compare the classification of the nutritional status of children using data mining with the learning vector quantization (LVQ) and backpropagation methods. Test were carried out using a comparasion ratio of training and testing data, namely 75% and 25%. From the research results, LVQ is superior with an accuracy of 95.12% and backpropagation of 80.49%.

Classification Appropriateness Recipient Help Non-Cash Food Using Learning Vector Quantization (LVQ) Method

Help Non-Cash Food is a program from the Government that is used to overcome poverty. The program is not functioning as well as it could because the procedure of receiving aid is not uniform, and individuals responsible for making choices are having trouble determining which families are qualified to receive the assistance. To overcome this problem, a classification system is needed to classify the eligibility of Non-Cash Food Assistance recipients so that the results are more efficient and accurate. This research uses the Learning Vector Quantization (LVQ) method with Python. This research aims to implement the LVQ method for the eligibility classification of non-cash food assistance recipients. System design is a stage that contains the process from start to finish of running this system which is described in the form of a flowchart, including system requirements that support this research, both software and hardware. In the process of analyzing the results and tests that are used as evaluation material in the process of finding a solution to a problem and making decisions in the process of planning activities, it is necessary to assess whether or not the LVQ approach is practicable to apply based on the findings of the research. In this study, 200 datasets were used with three epoch values and a learning rate of 0.1. The data set was randomly divided into a training portion of 80% and a testing portion of 20%. So that the results of this research using the LVQ method on the eligibility classification of recipients of Non-Cash Food Assistance obtain an accuracy of 97.5%.

Implementasi Metode Learning Vector Quantization (LVQ) Untuk Klasifikasi Keluarga Beresiko Stunting

Stunting is a condition where a child's height is too short compared to children of the same age. This condition affects the health of toddlers in the short and long term, such as suboptimal body posture in adulthood, decreased reproductive health, and decreased learning capacity, resulting in suboptimal performance in school. One of the causes of stunting is a lack of nutrition, basic health facilities, and poor parenting practices. However, the current data collection and classification of families at risk of stunting still use Microsoft Excel, which is ineffective in processing large data. Therefore, the LVQ method, which is an improvement of the Vector Quantization method, is used to accelerate the classification process. In this study, 5 parameters were tested, and the optimal result was achieved by using 7 input neurons, Chebychev distance as the distance measure, a learning rate of 0.1, 7 epochs, and 30% of training data. With these parameters, an accuracy of 99.38% was obtained. Based on these results, the LVQ method can help improve accuracy in classifying families at risk of stunting

Science Mapping and Country Clustering Regarding Challenges of Public Governance to Ensure Societal Well-Being

This study maps the challenges public governance faces in its mission to ensure a high level of societal well-being in European countries due to complex and multidimensional analysis, both on scientific and economic levels: bibliometric analysis, vector quantisation mapping, and clustering analysis of countries. The proposed research advocates considering relevant descriptors of the two phenomena, namely the six dimensions of public governance and the composite quality of life index, to analyse their interdependence by 2020, the year for which official statistics reveal data. Our research proposes a classification of the European Union Member States from the perspective of the progress made at the governmental decision-making level for the multidimensional approach to quality of life to identify the models of good practice. The methodological support was offered by cluster analysis and a vector quantisation method, namely K-means. KNIME software has allowed us to connect to various data sources visually. Clustering of European countries has revealed several disparities thus, Denmark and Finland (which are countries with a high level of quality of life) are examples of good practices, while countries such as Romania and Bulgaria are facing difficulties in significantly improving their quality of life due to the deficiencies of the governing act. Finally, the research highlights the channels through which public governance can substantially contribute to societal well-being, keeping in mind the relatively low importance of welfare given to formal aspects of democratic representation compared to the extent of quality governance.

Leaf Disease Detection

Abstract: Early disease identification is crucial for productive crop production in agriculture. illnesses such as bacterial spot, late blight, Septoria leaf spot, and yellow curved leaf the quality of the tomato harvest. Automatic classification techniques of plant diseases also assist in taking action once they are discovered diseased leaf symptoms Presented below is a Convolutional Learning Vector Quantization and Neural Network (CNN) model Method for detecting tomato leaf disease based on the (LVQ) algorithm and categorization. There are 500 tomato photos in the dataset. leaves that display four disease symptoms. We created a model of CNN for feature extraction and categorization automatically. Color Research on plant leaf diseases actively uses information. In our model, three channels based on RGB are subjected to filters.

Introduction of k-means clustering into random cascade model for disaggregation of rainfall from daily to 1-hour resolution with improved preservation of extreme rainfall

Temporal disaggregation of rainfall has been of particular focus because of the non-availability of higher-resolution rainfall data for a long-duration period. Fine temporal resolution rainfall is used in a multitude of hydrological applications. Researchers have proposed various disaggregation models to disaggregate coarse temporal resolution rainfall. In this paper, firstly, the microcanonical multiplicative random cascade (MMRC) model is applied for disaggregation from daily rainfall to a one-hour scale. The model is applied in four different rainfall stations for disaggregation having varying rainfall patterns and characteristics. It is observed that the MMRC model can generate statistically reliable rainfall time series; however, the extreme rainfall characteristics are not well conserved by the model for all the stations.This paper describes a new model based on a random multiplicative cascade process where classification and parameter generation is done by k-means clustering such that it can better conserve extreme rainfall conditions and generate a reliable rainfall time series (MMRC-K). K-means clustering is a vector quantization method that divides the observations into a particular number of clusters based on the nearest mean called cluster centroid. The novel approach is tested with the same four Indian cities. The use of k-means clustering has made the classification and parameter generation of the model robust such that it can work with data sets of varying characteristics. It is found that MMRC-K provides improved conservation of extreme rainfall characteristics compared to the MMRC model for all four stations. The MMRC-K model reproduces the IDF curves of Delhi and Mumbai stations quite well; however, a little discrepancy was observed at higher resolution and larger return periods in Kolkata and Chennai stations. Extreme rainfall at finer resolution is used in various hydrological analyses and design problems like urban drainage design, stormwater management, etc. The overall superior conservation of the extreme rainfall characteristics in the model-generated rainfall time series by the MMRC-K model compared to the MMRC model supports the potential applicability of the model for temporal disaggregation.

Quantized kernel recursive minimum error entropy algorithm

In this paper, we propose a online vector quantization (VQ) method based on the kernel recursive minimum error entropy (KRMEE) algorithm. According to information theoretic learning (ITL), the minimum error entropy criterion (MEE) is robust and can effective resistance to non-Gaussian noise. By combining the kernel recursive least squares (KRLS) algorithm with MEE criterion, KRMEE algorithm has been generated, which has excellent performance in non-Gaussian environments. However, with the size of data increases, the computational complexity will raise. We propose a quantized to solve this problem, the input space of the algorithm is quantized to suppress the linear growth radial basis function (RBF) network in kernel adaptive filtering (KAF). The VQ method is different from novelty criterion (NC), approximate linear dependency (ALD) criterion, and other sparsity methods, the online VQ method need to construct the dictionary, and calculate the distance by Euclidean norm. We propose a novel quantized kernel recursive minimum error entropy (QKRMEE) algorithm by combining VQ method with KRMEE algorithm, and update the solution with a recursive algorithm. In Mackey-Glass time series and a real-world datasets, Monte Carlo simulation experiments show that the proposed algorithm achieves better predictive performance in non-Gaussian noise environment. Meanwhile, the algorithm can restrain the growth of RBF network well, thus reducing the computational complexity and memory consumption effectively.

Accurate Reader Identification for the Arabic Holy Quran Recitations Based on an Enhanced VQ Algorithm

The Speaker identification process is not a new trend; however, for the Arabic Holy Quran recitation, there are still quite improvements that can make this process more accurate and reliable. This paper collected the input data from 14 native Arabic reciters, consisting of “Surah Al-Kawthar” speech signals from the Holy Quran. Moreover, this paper discusses the accuracy rates for 8 and 16 features. Indeed, a modified Vector Quantization (VQ) technique will be presented, in addition to realistically matching the centroids of the various codebooks and measuring systems’ effectiveness. Note that the VQ technique will be utilized to generate the codebooks by clustering these features into a finite number of centroids. The proposed system’s software was built and executed using MATLAB®. The proposed system’s total accuracy rate was 97.92% and 98.51% for 8 and 16 centroids codebooks, respectively. However, this study discussed two validation tactics to ensure that the outcomes are reliable and can be reproduced. Hence, the K-mean clustering algorithm has been used to validate the obtained results and discuss the outcomes of this study. Finally, it has been found that the improved VQ method gives a better result than the K-means method.