RelaGraph: Improving embedding on small-scale sparse knowledge graphs by neighborhood relations

Abstract

Learning a continuous dense low-dimensional representation of knowledge graphs (KGs), known as knowledge graph embedding (KGE), has been viewed as the key to intelligent reasoning for deep learning (DL) and gained much attention in recent years. To address the problem that the current KGE models are generally ineffective on small-scale sparse datasets, we propose a novel method RelaGraph to improve the representation of entities and relations in KGs by introducing neighborhood relations. RelaGraph extends the neighborhood information during entity encoding, and adds the neighborhood relations to mine deeper level of graph structure information, so as to make up for the shortage of information in the generated subgraph. This method can well represent KG components in a vector space in a way that captures the structure of the graph, avoiding underlearning or overfitting. KGE based on RelaGraph is evaluated on a small-scale sparse graph KMHEO, and the MRR reached 0.49, which is 34 percentage points higher than that of the SOTA methods, as well as it does on several other datasets. Additionally, the vectors learned by RelaGraph is used to introduce DL into several KG-related downstream tasks, which achieved excellent results, verifying the superiority of KGE-based methods.