Adding an Inception Network to Neural Network Open Information Extraction

Abstract

This article presents a method to resolve tuples from plain text by adding an inception network, and dependence path embedding to existing neural network methods of open information extraction (Open IE). Inception networks are used in analysis of computer vision, and dependence path embedding in text processing, but neither has been reported with Open IE. Performance was measured on benchmark datasets using two existing Open IE deep learning methods, one using bidirectional long short-term memory and BIO tagging (RnnOIE-verb), and another using a span-based model (SpanOIE). RnnOIE-verb was compared with RnnOIE-verb plus inception network and/or dependence path embedding. SpanOIE was compared with SpanOIE plus inception network. Performance slightly increased with the addition of inception network to RnnOIE-verb (before AUC 0.45, F1 0.59; after AUC 0.46, F1 0.60) and inception network to SpanOIE (before AUC 0.63, F1 0.748; after AUC 0.64, F1 0.764). The performance gain was minor but potentially relevant to an iterative process of improvement.