New Horizons in IoT Workflows Provisioning in Edge and Cloud Datacentres for Fast Data Analytics: The Osmotic Computing Approach

Abstract

Supporting Internet of Things (IoT) workflow enactment/execution on a combination of computational resources at the network edge and at a datacentre remains a challenge. Increasing volumes of data being generated through smart phones, IoT (Internet of Things) devices (which can vary significantly in scope and capability), need to be processed in a timely manner. Current practice involves using edge nodes (e.g. sensors or other low-capacity devices) as a means to acquire/collect data (i.e. as an "observation" mechanism). Subsequently, this data is transmitted to a datacentre/cloud for analysis/insight. Increasingly, the limitation with the use of a large-scale, centralised datacentre is being realised (such as speed of response for latency-sensitive applications), with the emergence of a number of paradigms to address this concern -- such as fog computing, edge computing, Cloud-of-Things, etc. All of these propose the use of dedicated servers (with varying capacity and capability) within micro/nano datacentres at the network edge, to overcome latency constraints associated with moving data to a central facility, and (lack of use of) increasing computational capability within edge devices. These paradigms also closely align with work in content distribution networks (e.g. from Akamai CDNs), which attempt to place data servers within one (or a small number of) hop of end users (currently 85% of users are supported in this way, with >175K Akamai servers) A key objective of this keynote talk is to understand how such emerging paradigms can be used to enable cloud systems (supported through large scale computational facilities) to be "stretched" to the network edge, to enable data-driven IoT workflows to be enacted efficiently over such combined infrastructure. We propose the combined use of (varying) capability at the network edge (referred to as an "Edge Datacentre" (EDC)) with capability within a Cloud Datacentre (CDC). Collectively, IoT devices and edge resources, like gateways (Raspberry Pi 3), software-defined network systems (Huawei CloudEngine 6800) and smart phones equipped with sensors, constitute a new set of computing resources -- and as potential components of an EDC. The keynote talk will have the following outline: 1.Overview of the research challenges involved with composing and orchestrating complex IoT workflows in cloud-edge continuum infrastructure 2.Discuss two case studies in healthcare and smart cities domain to understand how data-driven workflows can be applied to create/compose next-generation IoT applications. 3.Discuss our experience with running United Kingdom’s largest IoT infrastructure, namely, the Urban Observatory (http://www.urbanobservatory.ac.uk/)