Combined Networks with Multi-level Attention for Distantly-Supervised Relation Extraction

Abstract

Distantly-supervised relation extraction is expected to extract relational facts from very large corpora. However, it is inevitably accompanied by the problem of mislabeling, which affects the performance of relation extraction. To obtain richer information from sentences and make full use of the information of entity pairs, we propose the combined networks containing piecewise convolutional neural networks (PCNN) and bidirectional gated recurrent units (BiGRU) with multi-level attention. In this model, PCNN and BiGRU are utilized to obtain local features and sequence information. Then the multi-level attention is proposed to extract the most correlated information, which can affect the assignment of sentence attention weight. And it reduces the influence of wrong labeled instances indirectly. The experimental results show that our method can enhance the representation power of the network and prove the effectiveness of our model compared with several baseline methods.