Abstract

Nonnegative matrix factorization (NMF) is a popular tool for analyzing the latent structure of nonnegative data. For a positive pairwise similarity matrix, symmetric NMF (SNMF) and weighted NMF (WNMF) can be used to cluster the data. However, both of them are not very efficient for the ill-structured pairwise similarity matrix. In this paper, a novel model, called relationship matrix nonnegative decomposition (RMND), is proposed to discover the latent clustering structure from the pairwise similarity matrix. The RMND model is derived from the nonlinear NMF algorithm. RMND decomposes a pairwise similarity matrix into a product of three low rank nonnegative matrices. The pairwise similarity matrix is represented as a transformation of a positive semidefinite matrix which pops out the latent clustering structure. We develop a learning procedure based on multiplicative update rules and steepest descent method to calculate the nonnegative solution of RMND. Experimental results in four different databases show that the proposed RMND approach achieves higher clustering accuracy.

Highlights

  • Nonnegative matrix factorization NMF 1 has been introduced as an effective technique for analyzing the latent structure of nonnegative data such as images and documents

  • The overall cost of Symmetric NMF (SNMF), Weighted NMF (WNMF), and Relationship Matrix Nonnegative Decomposition (RMND) is related to qn[2], where n is the number of samples

  • We have presented a novel relationship matrix nonnegative decomposition RMND model for data clustering task

Read more

Summary

Introduction

Nonnegative matrix factorization NMF 1 has been introduced as an effective technique for analyzing the latent structure of nonnegative data such as images and documents. Symmetric NMF SNMF 10 is an extension of NMF It aims at learning clustering structure from the kernel matrix or pairwise similarity matrix which is positive semidefinite. When the similarity matrix is not positive semidefinite, SNMF is not able to capture the clustering structure. In SNMF, WNMF, and SSNMF, the low rank approximation to the pairwise similarity matrix is used. It is more sensitive to the unexpected noise It may produce undesirable performances in clustering tasks by minimizing the objective function from the viewpoint of reconstruction in the form as SNMF, WNMF, and SSNMF. We present a novel model, called relationship matrix nonnegative decomposition RMND , for data clustering tasks. According to the positive semidefiniteness, the SNMF formulation is incorporated in RMND, and a more tractable representation of pairwise similarity matrix is obtained. The detailed update rules for A and S can be found in 10

Proposed RMND Model
Learning Procedure
Computational Complexity Analysis
Numerical Experiments
Datasets
Evaluation Metrics for Clustering and Kernel Function
Experimental Results on the JAFFE Dataset
Clustering Performance Comparison
Clustering Performance Evaluation on Various Pairwise Similarity Matrix
Conclusions and Future Work
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call