Planning operators of concurrent RDF stream processing queries

Abstract

RDF stream processing (RSP), which aims to query data streams and linked datasets using common data model and query languages extended from RDF and SPARQL, is gaining popularity. However, most of the existing RSP engines do not provide any optimisation techniques for shared join operators among query plans from concurrent queries. Many number of shared join operators can incur the waste of a lot of CPU resources like a processing memory. Moreover, queries on shared operators cause a slow response time because they must be re-evaluated without reusing intermediate results. To solve these problems, we propose an efficient method of optimising query plans on multiple queries. First, the proposed method evicts some data that get notified from the streams in order to maintain an efficient memory usage. Second, the proposed method optimises query plans to maximise the reuse of shared join results. Experimental results show that the proposed method has significant improvements in terms of memory consumption and latency, compared to the state-the-of-art methods.