Joint extraction of entities and relations based on character graph convolutional network and Multi-Head Self-Attention Mechanism

Abstract

ABSTRACT The traditional method of extracting entities and relations not only disregards the dependency between the two subtasks of entities and relations but also facilitates the cumulative propagation of errors. To solve these problems, a method – called MSBD – of joint extraction of entities and relations based on the Character Graph Convolutional Network (CGCN) and Multi-Head Self-Attention Mechanism (MS) is proposed. First, a new tagging scheme is used to tag the positions of entities and relations in the text. Second, to depict the hierarchical structure information between the entities and the relations in the text and the internal structure information of the entity, the CGCN is designed to obtain the character vector of the text. MS is introduced into the coding framework of Bidirectional Long Short-Term Memory (BiLSTM) to capture the relative position information between two entities in the text and represent the subspace information. The Dense Connected Convolutional Network (Dense Net) is embedded in the decoding framework to enhance the reuse and transmission of key information and achieve joint extraction of entities and relations in the text. The experimental results show that the P, R and F values are significantly improved for extracting entities and relations.