Multi-task learning based high-value patent and standard-essential patent identification model

Abstract

The high-value patent identification (HVPI) and the standard-essential patent identification (SEPI) are two important issues in the fields of intellectual property and the standardization, respectively. Almost all the HVPI and the SEPI are based on the single-task learning. In this paper, we unify the HVPI and the SEPI in a multi-task learning framework in consideration of the mutual reinforcement of the two tasks. In our model, we extract the patent structured features and embed the patent textual features using the pre-training model. Given these features, we explore a multi-task learning based identification model to identify the high-value patents and the standard-essential patents. We evaluate our model by comparing with two state-of-the-art models on the 5 balanced datasets and 2 imbalanced datasets. The results show our multi-task learning based model outperforms significantly these single-tasking learning based models in the measurements: precision, recall, F1 and accuracy. On the balanced datasets, the average increments of measurements are 1.3%, 1.29%, 1.28% and 1.28% respectively. On the imbalanced datasets, the average increments of measurements are 2.24%, 1.62%, 1.75% and 0.66% respectively.