REEF: A Framework for Information Extraction and Automated Knowledge Graph Construction

Abstract

Summary We present Reef (Recursive Evidence Extraction Framework), a Python framework for automated information extraction from Petroleum Geoscience databases. Reef enables an end to end pipeline from raw documents to a Knowledge Graph. Reef makes possible two essential operations: 1/ discover entities in documents, characterize them and connect them to abstract concepts present in a knowledge graph and 2/ discover new knowledge with distant supervision. Knowledge graphs are key to build better search engines, Question Answering systems, recommendation engines, feed algorithms for the cross analysis of multiple datasets. Reef unique approach leverages a comprehensive stack of open source and state-of-the-art libraries for documents digitalization and parsing, Natural Language Processing, Language Modeling, Logic Reasoning and Graph Analysis. These foundational components are seconded by custom applications for specific tasks. Documents processed in Reef are digitized and sent through a pipeline where their content is filtered according to a flexible, easily extensible, Petroleum Geoscience specific object model. Information can be extracted from text, tables, figures, diagrams. Reef contains functions to infer information nature, digitize it, disambiguate and reconcile it into a graph database. Reef can be deployed in any cloud and delivers production ready knowledge graphs which can be served to third party applications.