Few-shot Knowledge Graph-to-Text Generation with Pretrained Language Models

Abstract

This paper studies how to automatically generate a natural language text that describes the facts in knowledge graph (KG). Considering the few-shot setting, we leverage the excellent capacities of pretrained language models (PLMs) in language understanding and generation. We make three major technical contributions, namely representation alignment for bridging the semantic gap between KG encodings and PLMs, relation-biased KG linearization for deriving better input representations, and multi-task learning for learning the correspondence between KG and text. Extensive experiments on three benchmark datasets have demonstrated the effectiveness of our model on KG-to-text generation task. %In particular, our model can achieve a very competitive performance with only several hundred labelled instances. In particular, our model outperforms all comparison methods on both fully-supervised and few-shot settings. Our code and datasets are available at \url{https://github.com/RUCAIBox/Few-Shot-KG2Text}.