Improve Clustering Performance Research Articles

Deep attributed graph clustering with feature consistency contrastive and topology enhanced network

Deep attributed graph clustering has attracted considerable interest lately due to its capability to uncover meaningful latent knowledge from heterogeneous spaces, thereby improving our comprehension of real-world systems. However, ensuring the consistency of the clustering assignments generated from topological and attribute information remains a key issue, which is one of the reasons for the low performance of clustering. To tackle these issues, a novel deep clustering approach with Feature Consistency Contrastive and Topology Enhanced Network (FCC-TEN) is proposed, which consists of GAT and AE that can mine the topological and attributed information and achieve consistency contrastive learning to improve clustering performance. First, a Fusion Graph Convolutional Auto-encoder module is proposed to fuse the attribute information captured by each layer of the AE and enrich topological information for improving the feature extraction capability of AE. Then, using a Feature Consistency Contrastive module to uncover consistency information of the GAT and AE through contrastive learning at the feature and label level. Finally, clustering results are obtained directly by the clustering assignment obtained at the label level. Comprehensive testing on five improved datasets shows that our method provides advanced clustering performance. Moreover, visual analyses of the clustering results corroborate a gradual refinement of the clustering structure, proving the validity of our approach.

Assessing clustering methods using Shannon's entropy

Unsupervised clustering techniques are crucial for effectively partitioning datasets into meaningful subgroups. In this paper, we introduce a novel clustering fuzziness metric based on Shannon's entropy, which quantifies the level of uncertainty in clustering assignments. This metric is employed to develop a statistical test for evaluating clustering algorithms and to propose parametric corrections to enhance their performance. We provide empirical evidence showing that our approach significantly improves clustering quality compared to well-known algorithms such as Fuzzy K-Means (FKM) and Fanny. For instance, applying our correction method led to a notable decrease in Jensen-Shannon Divergence (JSD) values, indicating enhanced clustering accuracy. Our methodology is demonstrated through comprehensive experiments on both simulated and real-world datasets. Additionally, our approach proves effective in determining the optimal number of clusters, showing superiority over traditional methods. These results highlight the practical benefits of our metric and correction techniques for improving clustering performance.

Constrained Density-Based Spatial Clustering of Applications with Noise (DBSCAN) using hyperparameter optimization

This article proposes a hyperparameter optimization method for density-based spatial clustering of applications with noise (DBSCAN) with constraints, termed HC-DBSCAN. While DBSCAN is effective at creating non-convex clusters, it cannot limit the number of clusters. This limitation is difficult to address with simple adjustments or heuristic methods. We approach constrained DBSCAN as an optimization problem and solve it using a customized alternating direction method of multipliers Bayesian optimization (ADMMBO). Our custom ADMMBO enables HC-DBSCAN to reuse clustering results for enhanced computational efficiency, handle integer-valued parameters, and incorporate constraint functions that account for the degree of violations to improve clustering performance. Furthermore, we propose an evaluation metric, penalized Davies–Bouldin score, with a computational cost of O(N). This metric aims to mitigate the high computational cost associated with existing metrics and efficiently manage noise instances in DBSCAN. Numerical experiments demonstrate that HC-DBSCAN, equipped with the proposed metric, generates high-quality non-convex clusters and outperforms benchmark methods on both simulated and real datasets.

SPGMVC: Multiview Clustering via Partitioning the Signed Prototype Graph.

Multiview clustering (MVC) has been widely studied in machine learning and data mining for its capability of improving clustering performance by fusing the information from multiview data. In the past decade, a large number of MVC methods have made impressive progress, but most of them suffer from computational burdens, especially in large-scale tasks. Binary MVC (BMVC) is proposed to address this issue by representing the large-scale high-dimensional dataset as a group of consensus and low-dimensional binary codes. However, current BMVC-based approaches generate the clustering by executing binary k -means on the obtained binary codes, which fail to capture the embedded geometric information, leading to poor clustering performance. In addition, parameter selection is another "mission impossible" in unsupervised learning tasks including MVC. To tackle these challenges, a framework of multiview clustering via partitioning the signed prototype graph (SPGMVC) is proposed in this work. The SPGMVC framework offers several contributions. First, SPGMVC is designed as a unified framework for MVC. It combines effective technologies, such as consensus binary coding, code compression (CC), signed prototype graph (SPG) partitioning, and prototype-based cluster assignment. Second, SPGMVC partitions the signed graph (SG) based on the relationships between positive and negative edges. By capturing the underlying structure of the data, this partitioning strategy improves clustering accuracy (ACC). CC techniques are applied to reduce the graph's scale, enabling further partitioning and enhancing computational efficiency. Third, SPGMVC employs an alternate minimizing strategy to efficiently handle the optimization problem. This strategy has nearly linear time and space complexity with respect to the data volume, making it suitable for large-scale tasks. Fourth, SPGMVC proposes an automatic parameter selection strategy, eliminating the need for extensive parameter exploration. Comprehensive experiments illustrate the superiority of our model. The implementation of SPGMVC is available at: https://github.com/gepingyang/PSGMVC.

Projective Incomplete Multi-View Clustering.

Due to the rapid development of multimedia technology and sensor technology, multi-view clustering (MVC) has become a research hotspot in machine learning, data mining, and other fields and has been developed significantly in the past decades. Compared with single-view clustering, MVC improves clustering performance by exploiting complementary and consistent information among different views. Such methods are all based on the assumption of complete views, which means that all the views of all the samples exist. It limits the application of MVC, because there are always missing views in practical situations. In recent years, many methods have been proposed to solve the incomplete MVC (IMVC) problem and a kind of popular method is based on matrix factorization (MF). However, such methods generally cannot deal with new samples and do not take into account the imbalance of information between different views. To address these two issues, we propose a new IMVC method, in which a novel and simple graph regularized projective consensus representation learning model is formulated for incomplete multi-view data clustering task. Compared with the existing methods, our method not only can obtain a set of projections to handle new samples but also can explore information of multiple views in a balanced way by learning the consensus representation in a unified low-dimensional subspace. In addition, a graph constraint is imposed on the consensus representation to mine the structural information inside the data. Experimental results on four datasets show that our method successfully accomplishes the IMVC task and obtain the best clustering performance most of the time. Our implementation is available at https://github.com/Dshijie/PIMVC.

Progressive Neighbor-masked Contrastive Learning for Fusion-style Deep Multi-view Clustering

Fusion-style Deep Multi-view Clustering (FDMC) can efficiently integrate comprehensive feature information from latent embeddings of multiple views and has drawn much attention recently. However, existing FDMC methods suffer from the interference of view-specific information for fusion representation, affecting the learning of discriminative cluster structure. In this paper, we propose a new framework of Progressive Neighbor-masked Contrastive Learning for FDMC (PNCL-FDMC) to tackle the aforementioned issues. Specifically, by using neighbor-masked contrastive learning, PNCL-FDMC can explicitly maintain the local structure during the embedding aggregation, which is beneficial to the common semantics enhancement on the fusion view. Based on the consistent aggregation, the fusion view is further enhanced by diversity-aware cluster structure enhancement. In this process, the enhanced cluster assignments and cluster discrepancies are employed to guide the weighted neighbor-masked contrastive alignment of semantic structure between individual views and the fusion view. Extensive experiments validate the effectiveness of the proposed framework, revealing its ability in discriminative representation learning and improving clustering performance.

Deep Tensor Spectral Clustering Network via Ensemble of Multiple Affinity Tensors.

Tensor spectral clustering (TSC) is an emerging approach that explores multi-wise similarities to boost learning. However, two key challenges have yet to be well addressed in the existing TSC methods: (1) The construction and storage of high-order affinity tensors to encode the multi-wise similarities are memory-intensive and hampers their applicability, and (2) they mostly employ a two-stage approach that integrates multiple affinity tensors of different orders to learn a consensus tensor spectral embedding, thus often leading to a suboptimal clustering result. To this end, this paper proposes a tensor spectral clustering network (TSC-Net) to achieve one-stage learning of a consensus tensor spectral embedding, while reducing the memory cost. TSC-Net employs a deep neural network that learns to map the input samples to the consensus tensor spectral embedding, guided by a TSC objective with multiple affinity tensors. It uses stochastic optimization to calculate a small part of the affinity tensors, thereby avoiding loading the whole affinity tensors for computation, thus significantly reducing the memory cost. Through using an ensemble of multiple affinity tensors, the TSC can dramatically improve clustering performance. Empirical studies on benchmark datasets demonstrate that TSC-Net outperforms the recent baseline methods.

Non-negative consistency affinity graph learning for unsupervised feature selection and clustering

Feature selection plays a crucial role in data mining and pattern recognition tasks. This paper proposes an efficient method for robust unsupervised feature selection, called joint local preserving and low-rank representation with nonnegative and symmetric constraint (JLPLRNS). This approach utilizes an indicator matrix instead of the row sparsity of the projection matrix to directly select some significant features from the original data and adaptively preserves the local geometric structure of original data into the low-dimensional embedded feature subspace via learned indicator matrix. By simultaneously imposing nonnegative symmetric and low-rank constraints on the representation coefficient matrix, it cannot only make this matrix discriminative, sparse and weight consistency for each pair of data, but also uncover the global structure of original data. These effectively will improve clustering performance. An algorithm based on the augmented Lagrange multiplier method with an alternating direction strategy is designed to resolve this model. Experimental results on various real datasets show that the proposed method can effectively identify some important features in data and outperforms many state-of-the-art unsupervised feature selection methods in terms of clustering performance.

Information-enhanced deep graph clustering network

Graph clustering is a significant task in complex network research. Deep graph clustering aims to uncover the potential community structure in graph data using the powerful feature extraction capability of deep learning, garnering much attention in recent decades. However, existing graph clustering methods fall short in fully utilizing available information, particularly in effectively fusing structural and attribute information, as well as utilizing coarse-grained data. Consequently, learned node representations remain limited, leading to suboptimal clustering results. To address these challenges, we propose Information-Enhanced Deep Graph Clustering Network (IEDGCN) for unsupervised attribute graphs. IEDGCN introduces key components to enhance information utilization and improve clustering performance. Firstly, we design a new higher-order neighborhood-weighted attribute matrix, effectively integrating higher-order neighborhood information with attributes. Secondly, a graph generation model guides the learning of the structural feature space more effectively. Additionally, IEDGCN captures more coarse-grained information by utilizing community and higher-order neighborhood features to refine clustering results. Finally, the proposed method is uniformly guided through a jointly supervised strategy for representation learning and cluster assignment. Experimental results on different benchmark datasets demonstrate the effectiveness of IEDGCN compared to state-of-the-art methods, emphasizing the importance of information enhancement for graph clustering.

Contrastive cross-modal clustering with twin network

Cross-modal clustering (CMC) methods explore the correlation information between multiple modalities to improve clustering performance. However, the obvious differences between heterogeneous modalities make it difficult to obtain the correlation information directly. In this paper, we propose a novel Contrastive Cross-modal Clustering with Twin Network (3CTnet) for CMC, which contrasts the differences of multiple modalities to fully mine the correlation information. The 3CTnet contains two modal-special encoders and an attention-based correlation propagate module (CPM). First, the modal-special encoders are trained by pseudo-labels to learn the clustering structure and feature of single modality. Then we contrast the clustering structures and features of different modalities to explore the inter-cluster and inter-feature correlation information simultaneously. Finally, the CPM is designed to propagate the learned correlation information among modal-special encoders to further optimize the learning of features and clustering structures. The experiments show that 3CTnet outperforms the state-of-the-art CMC methods on six large datasets.

The methods for improving large-scale multi-view clustering efficiency: a survey

The diversity and large scale of multi-view data have brought more significant challenges to conventional clustering technology. Recently, multi-view clustering has received widespread attention because it can better use different views’ consensus and complementary information to improve clustering performance. Simultaneously, many researchers have proposed various algorithms to reduce the computational complexity to accommodate the demands of large-scale multi-view clustering. However, the current reviews do not summarize from the perspective of reducing the computational complexity of large-scale multi-view clustering. Therefore, this paper outlines various high-frequency methods used in recent years to reduce the computational complexity of large-scale multi-view clustering, i.e. third-order tensor t-SVD, anchors-based graph construction, matrix blocking, and matrix factorization, and compares the corresponding algorithms based on several open datasets. Finally, the strengths and weaknesses of the current algorithm and the point of improvement are analyzed.

Dynamic edge clustering and task scheduling for edge assisted metaverse system in the field of remote work and collaboration

SummaryThe metaverse, a future digital world for living, working, learning, and interacting, is rapidly gaining significance, particularly in the domain of remote work and collaboration. This emerging digital landscape demands high‐performance, low‐latency, and scalable services to provide an immersive user experience. The current technology used in metaverse systems has some limitations, which emphasize the importance of adopting emerging technologies like Edge Computing (EC). However, as the number of users and data volume increases, it can impact both system performance and scalability of the edge‐assisted metaverse system. Additionally, the uneven distribution of edge servers can cause inconsistencies and result in high latency. To overcome these challenges, this paper proposes a dynamic edge clustering and task scheduling approach for edge‐assisted metaverse systems (DTAM) in the field of remote work and collaboration. The proposed approach addresses the challenges of high user volume and uneven resource distribution by incorporating dynamic clustering and edge server assistance to improve clustering performance. Furthermore, a Prioritized Experience Replay‐based Deep Q‐learning algorithm with state augmentation (PERDQSA) for task scheduling is introduced to improve sample efficiency and performance. The performance of the proposed DTAM is evaluated against existing techniques, and experimental results demonstrate its significant superiority in terms of specific metrics such as bandwidth, task response time, energy efficiency, and latency. The experiments demonstrated that DTAM outperforms Transformation‐based Edge Computing Deep Q‐Learning (TransEC‐DQL) in several key metrics. Specifically, DTAM achieves 28.5% reduction in latency, 13.7% reduction in response time, and 6.4% improvement in bandwidth compared to TransEC‐DQL. These results signify that DTAM can deliver a significantly enhanced user experience in the metaverse, particularly in the context of remote work and collaboration.

Graph-Driven deep Multi-View Clustering with self-paced learning

Multi-view clustering has attracted widespread attention because it can improve clustering performance by integrating information from various views of samples. However, many existing methods either neglect graph information entirely or only partially incorporate it, leading to information loss and non-comprehensive representation. Besides, they usually make use of graph information by determining a fixed number of neighbors based on prior knowledge, which limits the exploration of graph information contained in data. To address these issues, we propose a novel method, termed Graph-Driven deep Multi-View Clustering with self-paced learning (GDMVC), which integrates both feature information and graph information to better explore information within the data. Additionally, based on the idea of self-paced learning, this method gradually increases the number of neighbors and updates the similarity matrix, progressively providing more graph information to guide representation learning. By this way, we avoid issues associated with a fixed number of neighbors and ensure a thorough exploration of graph information contained in the original data. Furthermore, this method not only ensures the consistency among views but also leverages graph information to further enhance the unified representation, aiming to obtain more separable cluster structures. Extensive experiments on real datasets demonstrate its effectiveness for multi-view clustering. Our code will be released on https://github.com/yff-java/GDMVC/.

Enhancing generalized spectral clustering with embedding Laplacian graph regularization

AbstractAn enhanced generalised spectral clustering framework that addresses the limitations of existing methods by incorporating the Laplacian graph and group effect into a regularisation term is presented. By doing so, the framework significantly enhances discrimination power and proves highly effective in handling noisy data. Its versatility enables its application to various clustering problems, making it a valuable contribution to unsupervised learning tasks. To optimise the proposed model, the authors have developed an efficient algorithm that utilises the standard Sylvester equation to compute the coefficient matrix. By setting the derivatives to zero, computational efficiency is maintained without compromising accuracy. Additionally, the authors have introduced smoothing strategies to make the non‐convex and non‐smooth terms differentiable. This enables the use of an alternative iteration re‐weighted procedure (AIwRP), which distinguishes itself from other first‐order optimisation algorithms by introducing auxiliary variables. The authors provide a provable convergence analysis of AIwRP based on the iteration procedures of unconstrained problems to support its effectiveness. Extensive numerical tests have been conducted on synthetic and benchmark databases to validate the superiority of their approaches. The results demonstrate improved clustering performance and computational efficiency compared to several existing spectral clustering methods, further reinforcing the advantages of their proposed framework. The source code is available at https://github.com/ZhangHengMin/LGR_LSRLRR.

Augmented Sparse Representation for Incomplete Multiview Clustering.

Incomplete multiview data are collected from multiple sources or characterized by multiple modalities, where the features of some samples or some views may be missing. Incomplete multiview clustering (IMVC) aims to partition the data into different groups by taking full advantage of the complementary information from multiple incomplete views. Most existing methods based on matrix factorization or subspace learning attempt to recover the missing views or perform imputation of the missing features to improve clustering performance. However, this problem is intractable due to a lack of prior knowledge, e.g., label information or data distribution, especially when the missing views or features are completely damaged. In this article, we proposed an augmented sparse representation (ASR) method for IMVC. We first introduce a discriminative sparse representation learning (DSRL) model, which learns the sparse representations of multiple views as applied to measure the similarity of the existing features. The DSRL model explores complementary and consistent information by integrating the sparse regularization item and a consensus regularization item, respectively. Simultaneously, it learns a discriminative dictionary from the original samples. The sparsity constrained optimization problem in the DSRL model can be efficiently solved by the alternating direction method of multipliers (ADMM). Then, we present a similarity fusion scheme, namely, a sparsity augmented fusion of sparse representations, to obtain a sparsity augmented similarity matrix across different views for spectral clustering. Experimental results on several datasets demonstrate the effectiveness of the proposed ASR method for IMVC.

An improved clustering method using particle swarm optimization algorithm and mitochondrial fusion model (PSO-MFM)

Computational models are foundational concepts in computer science; many of these models such as P systems are based on natural biological processes. P systems represent a wide framework for a variety of concepts of data mining, as models of data clustering approaches. Data clustering is a technique for analyzing data based on its structure that is widely utilized for many applications. In this paper, the proposed model (PSO-MFM) has combined the Particle Swarm Optimization algorithm (PSO) with Mitochondrial Fusion Model to overcome some constraints of clustering techniques. The solving of clustering problem based on particle swarm is investigated in the proposed model when mutual dynamic rules are used. It can find the best cluster centers for a data set and improve clustering performance by utilizing the distributed parallel computing concept of mutual dynamic rules of mitochondrial fusion model. The comparative results demonstrate that the proposed strategy outperforms competition models when it comes to clustering accuracy, stability and the most efficient in time complexity.

Fuzzy Evolutionary Algorithm in Construction Project for Valuation

Clustering algorithms has emerged as an important data mining technique for pattern recognition, data analysis and dimensionality reduction. Clustering is usually used in all fields to merge the same feature objects into a single group. The clustering method is incorporated with search algorithms to search the dataset from the databases. For large databases, there is a need of good clustering algorithm with high accuracy. Despite its high performance, the existing methods show some limitations. This paper focused on optimize the clustering method with a search structure for large multidimensional databases with dynamic indexes for the effective validation of construction projects. In the construction project validation to improve the clustering methods using Evolutionary Constrained Differential Optimization (ECDO) and Distributed Weighted Fuzzy C-Means algorithm to improve clustering performance than the centralized clustering approaches. The proposed methodology includes ECDO which presents new cluster tree indexing approach with cluster speed improvement in the validation of the construction projects. Distributed Fuzzy Possibilistic C-Means algorithm is proposed in improvement of cluster centre to overcome coincidence cluster problems. The comparative analysis stated that proposed ECDO model exhibits ~6% reduced memory utilization ~11% reduced scalability and ~8% minimized selectivity than the conventional WPCM model.

Clustering on hierarchical heterogeneous data with prior pairwise relationships

BackgroundClustering is a fundamental problem in statistics and has broad applications in various areas. Traditional clustering methods treat features equally and ignore the potential structure brought by the characteristic difference of features. Especially in cancer diagnosis and treatment, several types of biological features are collected and analyzed together. Treating these features equally fails to identify the heterogeneity of both data structure and cancer itself, which leads to incompleteness and inefficacy of current anti-cancer therapies.ObjectivesIn this paper, we propose a clustering framework based on hierarchical heterogeneous data with prior pairwise relationships. The proposed clustering method fully characterizes the difference of features and identifies potential hierarchical structure by rough and refined clusters.ResultsThe refined clustering further divides the clusters obtained by the rough clustering into different subtypes. Thus it provides a deeper insight of cancer that can not be detected by existing clustering methods. The proposed method is also flexible with prior information, additional pairwise relationships of samples can be incorporated to help to improve clustering performance. Finally, well-grounded statistical consistency properties of our proposed method are rigorously established, including the accurate estimation of parameters and determination of clustering structures.ConclusionsOur proposed method achieves better clustering performance than other methods in simulation studies, and the clustering accuracy increases with prior information incorporated. Meaningful biological findings are obtained in the analysis of lung adenocarcinoma with clinical imaging data and omics data, showing that hierarchical structure produced by rough and refined clustering is necessary and reasonable.

Parameter-Free Multiview K -Means Clustering With Coordinate Descent Method.

Recently, more and more real-world datasets have been composed of heterogeneous but related features from diverse views. Multiview clustering provides a promising attempt at a solution for partitioning such data according to heterogeneous information. However, most existing methods suffer from hyper-parameter tuning trouble and high computational cost. Besides, there is still an opportunity for improvement in clustering performance. To this end, a novel multiview framework, called parameter-free multiview k -means clustering with coordinate descent method (PFMVKM), is presented to address the above problems. Specifically, PFMVKM is completely parameter-free and learns the weights via a self-weighted scheme, which can avoid the intractable process of hyper-parameters tuning. Moreover, our model is capable of directly calculating the cluster indicator matrix, with no need to learn the cluster centroid matrix and the indicator matrix simultaneously as previous multiview methods have to do. What's more, we propose an efficient optimization algorithm utilizing the idea of coordinate descent, which can not only reduce the computational complexity but also improve the clustering performance. Extensive experiments on various types of real datasets illustrate that the proposed method outperforms existing state-of-the-art competitors and conforms well with the actual situation.

Penguin search with Harris-Hawk optimization algorithm to improve clustering performance in wireless network

<span>Integrating optimal search algorithm concepts across the wireless core and cluster structure enables next-generation wireless networks to effectively provide reliable low-delay communications and connectivity for internet of things (IoT) devices. This article describes penguin search with the Harris-Hawk optimization algorithm (PHHO) to improve clustering performance in wireless networks. The penguin search optimization algorithm (PSO) algorithm computes the fitness value for feature selection from the database. Harris-Hawk optimization (HHO) algorithm to reduce the time and energy required for network transmission. This mechanism builds the clusters based on node communication range. The node direction, node mobility, node bandwidth availability, and energy parameters to decide the cluster head (CH) by applying the HHO algorithm. This approach uses a PSO algorithm fitness function to select the feature subset to minimize error and overhead in the network. Using a network simulator (NS)-3, this method assesses and chooses the most efficient way for data transmission, and the result is compared to a baseline mechanism.</span>