Edge-cloud System Research Articles

Hybrid Edge–Cloud Models for Bearing Failure Detection in a Fleet of Machines

Real-time condition monitoring of machinery is increasingly being adopted to minimize costs and enhance operational efficiency. By leveraging large-scale data acquisition and intelligent algorithms, failures can be detected and predicted, thereby reducing machine downtime. In this paper, we present a novel hybrid edge–cloud system for detecting rotational bearing failures using accelerometer data. We evaluate both supervised and unsupervised neural network approaches, highlighting their respective strengths and limitations. Supervised models demonstrate high accuracy but require labeled datasets representative of the failures of interesting data that are challenging to acquire due to the rarity of anomalies. Conversely, unsupervised models rely on data from normal operational conditions, which is more readily available. However, these models classify all deviations from normalcy as anomalies, including those unrelated to failure, leading to costly false positives. To address these challenges, we propose a distributed system that integrates supervised and unsupervised learning. A compact unsupervised model is deployed on edge devices near the machines to compress sensor data, which are then transmitted to a centralized cloud-based system. Over time, these data are automatically labeled and used to train a supervised model, improving the accuracy of failure predictions. Our approach enables efficient, scalable failure detection across a fleet of machines while balancing the trade-offs between supervised and unsupervised learning.

Optimized Edge-Cloud System for Activity Monitoring Using Knowledge Distillation

Driven by the increasing care needs of residents in long-term care facilities, Ambient Assisted Living paradigms have become very popular, offering new solutions to alleviate this burden. This work proposes an efficient edge-cloud system for indoor activity monitoring in long-term care institutions. Action recognition from video streams is implemented via Deep Learning networks running at edge nodes. Edge Computing stands out for its power efficiency, reduction in data transmission bandwidth, and inherent protection of residents’ sensitive data. To implement Artificial Intelligence models on these resource-limited edge nodes, complex Deep Learning networks are first distilled. Knowledge distillation allows for more accurate and efficient neural networks, boosting recognition performance of the solution by up to 8% without impacting resource usage. Finally, the central server runs a Quality and Resource Management (QRM) tool that monitors hardware qualities and recognition performance. This QRM tool performs runtime resource load balancing among the local processing devices ensuring real-time operation and optimized energy consumption. Also, the QRM module conducts runtime reconfiguration switching the running neural network to optimize the use of resources at the node and to improve the overall recognition, especially for critical situations such as falls. As part of our contributions, we also release the manually curated Indoor Action Dataset.

Two-timescale joint service caching and resource allocation for task offloading with edge–cloud cooperation

Task offloading with edge–cloud cooperation has emerged as a pivotal solution for meeting the intricate array of application coupled with dynamically evolving business demand in 6G business scenarios, such as traffic sensing, environmental monitoring, and video surveillance in smart cities. Nonetheless, effectively leveraging heterogeneous edge–cloud network resources for effective task offloading presents substantial challenges. Additionally, the inherent differences in system decision cycles escalate the complexity of the task offloading problem to a new dimension. In this study, we delve into a two-timescale joint service caching and resource allocation optimization for task offloading within edge–cloud cooperation aiming to maximize long-term network performance while adhering to energy constraints. We propose a novel edge–cloud cooperation task offloading scheme that supports both edge–cloud and edge–edge cooperation to effectively balance the edge–cloud and edge–edge loads, promoting the efficient co-utilization of all edge–cloud system resources. Furthermore, we devise an online two-timescale Lyapunov-based joint optimization framework for service caching, task offloading, and computing resource allocation. Our two-timescale decision-making framework can flexibly accommodate the inherent differences in the sensitive decision optimization periods, thereby mitigating the degradation of task offloading performance caused by frequent service caching updates. Finally, theoretical analysis confirms that our proposed algorithm can converge to an approximate optimal solution in polynomial time, and the superiority of our scheme is validated by extensive simulation experiments.

Developing a Secure Service Ecosystem to Implement the Intelligent Edge Environment for Smart Cities

In the future, smart cities will provide key services including seamless communication, intelligent transport systems, advanced healthcare platforms, urban and infrastructure management, and digital services for local and regional government. Therefore, a new service and networking paradigm, called the Intelligent Edge Environment, has been specified. As a key part of this system, a new secure service ecosystem must be developed to provide the secure real-time movement of services on different High-Performance Edge Cloud Systems. This paper explores these issues by introducing the following mechanisms: a Resource Allocation Algorithm, a Resource Allocation Secure Protocol and finally a Secure Service Protocol. These systems were integrated into the Basic Capability System Library and a multithreaded FUSE client connected to the Service Management Framework. Docker was used as the migration mechanism. A prototype was developed and implemented using a FUSE-Network Memory System in which the Network Memory Server was migrated as users moved around. The result shows that this approach was safe and could be used to develop new applications and services for smart cities.

VLR-BPP: An intelligent virtual location replacement based bilateral privacy-preserving architecture for edge cloud systems

Mobile Crowdsourcing (MCS) has emerged as a significant edge-cloud computing paradigm in which workers perceive data at the network edge and report it to cloud-based computing services for processing, enabling the construction of various applications. Consequently, it is imperative to achieve Bilateral Location Privacy-Preserving (BLPP) to protect the privacy of both Data Requester (DR) and workers, as disclosing location information entails many sensitive details that can result in losses for DR and workers alike. The Local Differential Privacy (LDP) approach is widely employed in Privacy-Preserving (PP) techniques due to its inherent advantages, wherein owners release data with added noise, allowing for proactive customization of privacy strength without relying on any third party. However, the current state of LDP methods presents a dilemma: when privacy protection is strong, introducing excessive location noise can lead to a decrease in the accuracy of task-worker matching, while a high rate of task-worker matching necessitates the compromise of privacy strength. In this paper, an intelligent Virtual Location Replacement based enhanced Bilateral Privacy-Preserving (VLR-BPP) architecture is proposed to improve privacy protection strength and matching accuracy in MCS simultaneously. Within the VLR-BPP architecture, a Bipartite-Graph-based Matrix Completion (BGMC) model is employed to establish the spatiotemporal correlations among data. Then, a Virtual Location Replacement (VLR) strategy is proposed to obfuscate the locations of tasks or workers to their highly correlated virtual location before publishing. Based on VLR, three preemptive location virtualization approaches are introduced: Only Task Location Virtual (OTLV), Only Workers Location Virtual (OWLV), and Both Task and Workers Location Virtual (BTWLV). For workers and DR, Randomized Response (RR) techniques and Random Matrix Multiplication Mechanism (RMM) are used to implement LDP independently. A greedy algorithm is adopted to recruit workers for tasks. In response to the data submitted by workers, BGMC imputation mechanism is utilized to enhance data quality. Finally, simulations based on real-world datasets demonstrate that the performance of our architecture surpasses existing state-of-the-art methods in privacy protection and data collection quality by 18.92∼38.17% and 15.49∼50.77%, respectively.

Consensus in Data Management: With Use Cases in Edge-Cloud and Blockchain Systems

Consensus is a fundamental problem in distributed systems, involving the challenge of achieving agreement among distributed nodes. It plays a critical role in various distributed data management problems. This tutorial aims to provide a comprehensive primer for data management researchers on the topic of consensus and its fundamental and modern applications in data management. We begin by exploring the basic principles of consensus, including the problem statement, system models, failure scenarios, and various consensus algorithms such as Paxos and its variants. The tutorial then delves into the applications of consensus in distributed data management, focusing on distributed atomic commitment and data replication. We explain how consensus is integral to these areas and present examples of research and industry work that apply consensus to data management. The tutorial extends to modern use cases of consensus in the evolving landscapes of edge-cloud systems and blockchain technology. We discuss how consensus mechanisms are being adapted and applied in these areas, highlighting their growing importance in emerging areas of data management. By exploring these cutting-edge applications, participants will gain insights into how consensus is shaping ongoing and future research on distributed data management. The tutorial builds on the authors' recent book "Consensus in Data Management: from Distributed Commit to Blockchain". The book will serve as the foundation and reading material for the tutorial. This tutorial targets data management researchers and practitioners to equip them with the knowledge and perspective needed to innovate in these emerging fields. This includes graduate students and junior researchers starting their careers in the area of distributed data management. Also, it includes researchers in other areas of data management who wish to explore the area of distributed data management with the goal of utilizing it in their own fields.

An intelligent resource allocation strategy with slicing and auction for private edge cloud systems

The convergence of transformative technologies, including the Internet of Things (IoT), Big Data, and Artificial Intelligence (AI), has driven private edge cloud systems to the forefront of research efforts. The access to massive terminals and the emergence of personalized services pose serious challenges for efficient resource management in power private edge cloud systems. To address the challenge of inequitable resource allocation in the private edge cloud, this work proposes an intelligent resource allocation strategy with a slicing and auction approach. By formalizing the resource allocation problem as a Mixed Integer Nonlinear Programming (MINLP) puzzle, the method transforms it into a hierarchical allocation challenge for Mobile Network Operators (MNOs), Mobile Virtual Network Operators (MVNOs), and power terminals. The proposed Multi-hop Progressive Auction Algorithm (MPAA) addresses the sliced resource allocation problem between MNOs and MVNOs. Furthermore, a Terminal Resource Allocation Strategy (TRAS) based on improved particle swarm optimization is proposed to solve the spectrum resource allocation problem between MVNOs and power terminals. Extensive simulation results show that the bidding overhead of MPAA is reduced by 6.12% and the average terminal satisfaction of TRAS is improved by about 1.3% compared to conventional methods, thus improving the utilization of wireless resources within the power AIoT.

Intelligent architecture and platforms for private edge cloud systems: A review

The development of cloud, fog, and edge computing has led to great advances in reducing latency and saving bandwidth, and these methods have therefore been broadly applied in various domains, including healthcare, transportation, and the Internet of Things (IoT). Traditional edge computing solutions have proven to be insufficient in fulfilling the demanding prerequisites of low latency and high data rates. Additionally, publicly available edge cloud solutions fail to meet the required standards for ensuring privacy protection. Consequently, Private Edge Cloud Systems (PECSs) have garnered attention as a prospective solution owing to their capacity to mitigate privacy risks and their significant computing capacity. PECS research has seen significant growth, but there is a lack of detailed review of its issues, approaches, and applications in the literature. To explore the potential application value of PECS, this paper provides a systematic review of intelligent platforms and architecture for PECSs. Specifically, an overview of the fundamental characteristics of PECSs is provided. Second, we classify intelligent platforms and architectures and analyze their implementation techniques and realization methods. Third, we discuss four specific application scenarios. Finally, promising future research directions are discussed. The findings of this research show that PECSs can effectively meet the requirements for low latency and privacy protection and are a fertile domain for further research.

Community Detection-Empowered Self-Adaptive Network Slicing in Multi-Tier Edge-Cloud System

Community Detection-Empowered Self-Adaptive Network Slicing in Multi-Tier Edge-Cloud System

CLAID: Closing the Loop on AI & Data Collection — A cross-platform transparent computing middleware framework for smart edge-cloud and digital biomarker applications

The increasing number of edge devices with enhanced sensing capabilities, such as smartphones, wearables, and IoT devices equipped with sensors, holds the potential for innovative smart-edge applications in healthcare. These devices generate vast amounts of multimodal data, enabling the implementation of digital biomarkers which can be leveraged by machine learning solutions to derive insights, predict health risks, and allow personalized interventions. Training these models requires collecting data from edge devices and aggregating it in the cloud. To validate and verify those models, it is essential to utilize them in real-world scenarios and subject them to testing using data from diverse cohorts. Since some models are too computationally expensive to be run on edge devices directly, a collaborative framework between the edge and cloud becomes necessary. In this paper, we present CLAID, an open-source cross-platform middleware framework based on transparent computing compatible with Android, iOS, WearOS, Linux, macOS, and Windows. CLAID enables logical integration of devices running different operating systems into an edge-cloud system, facilitating communication and offloading between them, with bindings available in different programming languages. We provide Modules for data collection from various sensors as well as for the deployment of machine-learning models. Furthermore, we propose a novel methodology, ML-Model in the Loop for verifying deployed machine learning models, which helps to analyze problems that may occur during the migration of models from cloud to edge devices. We verify our framework in three different experiments and achieve 100% sampling coverage for data collection across different sensors as well as an equal performance of a cough detection model deployed on both Android and iOS devices. Additionally, we compare the memory and battery consumption of our framework across the two mobile operating systems.

Hierarchical Training of Deep Neural Networks Using Early Exiting.

Deep neural networks (DNNs) provide state-of-the-art accuracy for vision tasks, but they require significant resources for training. Thus, they are trained on cloud servers far from the edge devices that acquire the data. This issue increases communication cost, runtime, and privacy concerns. In this study, a novel hierarchical training method for DNNs is proposed that uses early exits in a divided architecture between edge and cloud workers to reduce the communication cost, training runtime, and privacy concerns. The method proposes a brand-new use case for early exits to separate the backward pass of neural networks between the edge and the cloud during the training phase. We address the issues of most available methods that, due to the sequential nature of the training phase, cannot train the levels of hierarchy simultaneously or they do it with the cost of compromising privacy. In contrast, our method can use both edge and cloud workers simultaneously, does not share the raw input data with the cloud, and does not require communication during the backward pass. Several simulations and on-device experiments for different neural network architectures demonstrate the effectiveness of this method. It is shown that the proposed method reduces the training runtime for VGG-16 and ResNet-18 architectures by 29% and 61% in CIFAR-10 classification and by 25% and 81% in Tiny ImageNet classification, respectively, when the communication with the cloud is done over a low bit rate channel. This gain in the runtime is achieved, while the accuracy drop is negligible. This method is advantageous for online learning of high-accuracy DNNs on sensor-holding low-resource devices such as mobile phones or robots as a part of an edge-cloud system, making them more flexible in facing new tasks and classes of data.

Robust and Lightweight Data Aggregation With Histogram Estimation in Edge-Cloud Systems

Robust and Lightweight Data Aggregation With Histogram Estimation in Edge-Cloud Systems

Delay-sensitive task offloading and efficient resource allocation in intelligent edge–cloud environments: A discretized differential evolution-based approach

The number of smart wireless devices (WDs) has enormously increased over the last few years due to the advancement of 5G/B5G networks. The advanced applications of such smart WDs, e.g., augmented reality, virtual reality, online gaming, etc., demand excessive resources. Although the WDs are equipped with limited resources, the evolution of edge computing and offloading techniques enables the WDs to offload their resource-intensive tasks to the nearby edge node. These edge nodes might experience higher loads and delays when WDs generate a huge number of tasks. Moreover, the wireless channel bandwidth and transmission data rate of the wireless channels are also limited. Therefore, optimizing the use of available bandwidth as a valuable resource and reducing latency emerge as crucial objectives while offloading tasks. In this paper, a delay-aware resource-constrained offloading problem for edge–cloud systems is mathematically formulated as a 0–1 integer linear programming, and it is shown to be NP-complete. Then, a delay-aware resource-constrained offloading algorithm based on a discretized differential evolution (DARC-DE) is designed. The objectives of the DARC-DE are to maximize the utilization of the resources as bandwidth and minimize the delay. The vectors are efficiently encoded along with the decoding technique. The fitness function is designed by considering execution, offloading, queuing, transmission delay, and bandwidth utilization. The DARC-DE is shown to be executed in polynomial time. To evaluate DARC-DE, extensive simulation is performed in two different scenarios with varying numbers of tasks and edges. Simulation results demonstrate that the proposed DARC-DE can minimize total delay by 15% to 40% in comparison to particle swarm optimization, genetic algorithm, and bees algorithm, respectively. Simulation results also indicate a significant improvement in bandwidth utilization. Taguchi method and alternative average convergence rate are conducted. The statistical tests—analysis of variance, post-hoc, and Friedman tests—are also performed.

Deep Meta Q-Learning Based Multi-Task Offloading in Edge-Cloud Systems

Resource-constrained edge devices can not efficiently handle the explosive growth of mobile data and the increasing computational demand of modern-day user applications. Task offloading allows the migration of complex tasks from user devices to the remote edge-cloud servers thereby reducing their computational burden and energy consumption while also improving the efficiency of task processing. However, obtaining the optimal offloading strategy in a multi-task offloading decision-making process is an NP-hard problem. Existing Deep learning techniques with slow learning rates and weak adaptability are not suitable for dynamic multi-user scenarios. In this article, we propose a novel deep meta-reinforcement learning-based approach to the multi-task offloading problem using a combination of first-order meta-learning and deep Q-learning methods. We establish the meta-generalization bounds for the proposed algorithm and demonstrate that it can reduce the time and energy consumption of IoT applications by up to 15%. Through rigorous simulations, we show that our method achieves near-optimal offloading solutions while also being able to adapt to dynamic edge-cloud environments.

Dynamic task scheduling in edge cloud systems using deep recurrent neural networks and environment learning approaches

The rapid growth of the cloud computing landscape has created significant challenges in managing the escalating volume of data and diverse resources within the cloud environment, catering to a broad spectrum of users ranging from individuals to large corporations. Ineffectual resource allocation in cloud systems poses a threat to overall performance, necessitating the equitable distribution of resources among stakeholders to ensure profitability and customer satisfaction. This paper addresses the critical issue of resource management in cloud computing through the introduction of a Dynamic Task Scheduling with Virtual Machine allocation (DTS-VM) strategy, incorporating Edge-Cloud computing for the Internet of Things (IoT). The proposed approach begins by employing a Recurrent Neural Network (RNN) algorithm to classify user tasks into Low Priority, Mid Priority, and High Priority categories. Tasks are then assigned to Edge nodes based on their priority, optimizing efficiency through the application of the Spotted Hyena Optimization (SHO) algorithm for selecting the most suitable edge node. To address potential overloads on the edge, a Fuzzy approach evaluates offloading decisions using multiple metrics. Finally, optimal Virtual Machine allocation is achieved through the application of the Stable Matching algorithm. The seamless integration of these components ensures a dynamic and efficient allocation of resources, preventing the prolonged withholding of customer requests due to the absence of essential resources. The proposed system aims to enhance overall cloud system performance and user satisfaction while maintaining organizational profitability. The effectiveness of the DTS-VM strategy is validated through comprehensive testing and evaluation, showcasing its potential to address the challenges posed by the diverse and expanding cloud computing landscape.

SLA-ORECS: an SLA-oriented framework for reallocating resources in edge-cloud systems

The emergence of the Fifth Generation (5G) era has ushered in a new era of diverse business scenarios, primarily characterized by data-intensive and latency-sensitive applications. Edge computing technology integrates the information services environment with cloud computing capabilities at the edge of the network. However, the evolving landscape of business models necessitates a unified edge architecture capable of accommodating diverse requirements, posing substantial challenges for service providers in meeting Service-Level Agreements (SLAs).In response to these challenges, we introduce SLA-ORECS. This innovative framework dynamically allocates dedicated and shared resources within the edge-cloud system to cater to service requests with varying SLAs, thereby facilitating performance isolation. Furthermore, we have developed an optimization algorithm to enhance the efficiency of SLA assurance during request dispatch.The evaluation of SLA-ORECS highlights its noteworthy performance improvements, particularly in terms of system throughput and average time consumption.

Exploring LLM-based Automated Repairing of Ansible Script in Edge-Cloud Infrastructures

Edge-Cloud system requires massive infrastructures located in closer to the user to minimize latencies in handling Big data. Ansible is one of the most popular Infrastructure as Code (IaC) tools crucial for deploying these infrastructures of the Edge-cloud system. However, Ansible also consists of code, and its code quality is critical in ensuring the delivery of high-quality services within the Edge-Cloud system. On the other hand, the Large Langue Model (LLM) has performed remarkably on various Software Engineering (SE) tasks in recent years. One such task is Automated Program Repairing (APR), where LLMs assist developers in proposing code fixes for identified bugs. Nevertheless, prior studies in LLM-based APR have predominantly concentrated on widely used programming languages (PL), such as Java and C, and there has yet to be an attempt to apply it to Ansible. Hence, we explore the applicability of LLM-based APR on Ansible. We assess LLMs’ performance (ChatGPT and Bard) on 58 Ansible script revision cases from Open Source Software (OSS). Our findings reveal promising prospects, with LLMs generating helpful responses in 70% of the sampled cases. Nonetheless, further research is necessary to harness this approach’s potential fully.

On-Cloud Linking Approach Using a Linkable Glue Layer for Metamorphic Edge Devices

As sensors operating at the edge continue to evolve, the amount of data that edge devices need to process is increasing. Cloud computing methods have been proposed to process complex data on edge devices that are powered by limited resources. However, the existing cloud computing approach, which provides services from servers determined at the compile stage on the edge, is not suitable for the metamorphic edge device proposed in this paper. Therefore, we have realized the operation of metamorphic edge devices by changing the service that accelerates the application in real time according to the surrounding environmental conditions on the edge device. The on-cloud linking approach separates the code for communication from the edge and server into a linkable glue layer. The separated communication code in the linkable glue layer is reconfigured in real time according to the environment of the edge device. To verify the computational acceleration of cloud computing and the real-time service change of the metamorphic edge device, we operated services that perform matrix multiplication operations with one process, two processes, and four processes in parallel on the edge–cloud system based on the on-cloud linking approach. Through the experiments, it was confirmed that the on-cloud linking approach changes the service provided in real time according to changes in external environmental data without changing the code built into the edge. When a square matrix operation with 1000 rows was loaded onto the proposed platform, the size of the code embedded into the edge device decreased by 8.88% and the operation time decreased by 96.7%.

Edge computing in the loop simulation framework for automotive use cases evaluation

Edge architectures provide local, decentralized services, enabling balancing network traffic and distributing hardware resources. Later, many new use cases can be implemented by combining the advantages of the edge computing concept with the services of 5G systems. One of the biggest beneficiaries of this could be the Vehicle-to-Cloud (V2C) technology, where it is necessary to efficiently process large amounts of data resulting from Vehicle-to-Everything communication (V2X) services. In specific use cases, this makes it possible to process sensor data collectively, enhanced by fusion, which promotes a more effective virtual representation of the real world. The effective implementation of these technologies is a complex task. One of the most important steps before tests on actual infrastructures with real vehicles is evaluating and validating edge cloud systems. We present a solution for this problem, the Cloud-in-the-Loop (CiL) simulation framework. It can orchestrate a real-size, telco-grade level, Kubernetes-based edge cloud infrastructure based on information gathered from a traffic simulator and performing fine-grained benchmarking and data collection. In addition to the performance analysis of the edge system, it also enables an in-depth examination of cloud-native applications serving complex automotive use cases. In this paper, we focus on presenting the developed framework and its capabilities by utilizing the system with implemented test applications, and give an example of testing QoS and QoE aspects of the edge cloud-based V2C concept.

Pre-trained Model-based Software Defect Prediction for Edge-cloud Systems

Edge-cloud computing is a distributed computing infrastructure that brings computation and data storage with low latency closer to clients. As interest in edge-cloud systems grows, research on testing the systems has also been actively studied. However, as with traditional systems, the amount of resources for testing is always limited. Thus, we suggest a function-level just-in-time (JIT) software defect prediction (SDP) model based on a pre-trained model to address the limitation by prioritizing the limited testing resources for the defect-prone functions. The pre-trained model is a transformer-based deep learning model trained on a large corpus of code snippets, and the fine-tuned pre-trained model can provide the defect proneness for the changed functions at a commit level. We evaluate the performance of the three popular pre-trained models (i.e., CodeBERT, GraphCodeBERT, UniXCoder) on edge-cloud systems in within-project and cross-project environments. To the best of our knowledge, it is the first attempt to analyse the performance of the three pre-trained model-based SDP models for edge-cloud systems. As a result, we can confirm that UniXCoder showed the best performance among the three in the WPDP environment. However, we also confirm that additional research is necessary to apply the SDP models to the CPDP environment.