Abstract

In multi-label learning, each object belongs to multiple class labels simultaneously. In the data explosion age, the size of data is often huge, i.e., large number of instances, features and class labels. The high dimension of both the feature and label spaces has posed great challenges to multi-label learning problems, e.g., high time and memory costs. In this paper, we propose a new framework for multi-label learning with a large number of class labels and features, i.e., M ulti- L abel L earning via F eature and L abel S pace D imension R eduction, namely MLL-FLSDR. Specifically, both the feature space and label space are reduced to low dimensional spaces respectively, in which the local structure of data points is utilized to constrain the geometrical structure on both the learned low dimensional spaces and guarantee the qualities of them. Then, an effective multi-label classifier is constructed from the low dimensional feature space to the latent label space. Last, the final prediction for new test data examples can be obtained by recovering from their prediction results in the latent label space with an encoding matrix learned in the previous stage. Extensive comparison experiments with the state-of-the-art approaches manifest the effectiveness of the proposed method MLL-FLSDR.

Highlights

  • Multi-label learning [1]–[4] concerns the problem that data examples with multiple class labels simultaneously

  • We propose to jointly perform feature space and label space dimension reduction for multi-label learning with large number of class labels in an unified framework

  • The learning framework of our proposed method MLL-FLSDR is shown in Figure 1, which is mainly composed of four components: (1) Encoding: Learning a low dimensional latent label space U from the original label space Y; (2) Decoding: Recovering the original label space Y from the latent label space U; (3) Feature Space Dimension Reduction: Mapping the feature matrix X into a low dimensional X by a transformation matrix P; and (4) Building a Classifier: Learning a multi-label classifier H from the transformed feature space X to the latent label space U

Read more

Summary

INTRODUCTION

Multi-label learning [1]–[4] concerns the problem that data examples with multiple class labels simultaneously. P is considered as a feature mapping matrix, and a multi-label classifier is learned from the low dimensional feature matrix to the original label space directly. It still suffer from the high computation of training and testing when the number of class labels is huge. We propose to jointly perform feature space and label space dimension reduction for multi-label learning with large number of class labels in an unified framework. 3) Extensive experiments with the state-of-the-art approaches manifest the effectiveness and superiority of our proposed method MLL-FLSDR in multi-label learning with a large number of class labels.

RELATED WORK
LEARNING THE LATENT LABEL SPACE
FEATURE TRANSFORMATION AND BUILDING A CLASSIFIER
OPTIMIZATION
PREDICTION
EVALUATION METRICS
EXPERIMENTAL RESULTS
PARAMETER ANALYSIS
Findings
CONCLUSION

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.