Age of Processing: Age-Driven Status Sampling and Processing Offloading for Edge-Computing-Enabled Real-Time IoT Applications

Abstract

The freshness of status information is of great importance for time-critical Internet-of-Things (IoT) applications. A metric measuring status freshness is the Age of Information (AoI), which captures the time elapsed from the status being generated at the source node (e.g., a sensor) to the latest status update. However, in intelligent IoT applications such as video surveillance, the status information is revealed after some computation-intensive and time-consuming data processing operations, which would affect the status freshness. In this article, we propose a novel metric, Age of Processing (AoP), to quantify such status freshness, which captures the time elapsed of the newest received processed status data since it is generated. Compared with AoI, AoP further takes the data processing time into account. Since an IoT device has limited computation and energy resources, the IoT device can choose to offload the data processing to the nearby edge server under constrained status sampling frequency. We aim to minimize the <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">average</i> AoP in a long-term process by jointly optimizing the status sampling frequency and processing offloading policy. We first formulate this online problem as an infinite-horizon constrained Markov decision process (CMDP) with an average reward criterion. We then transform the CMDP problem into an unconstrained Markov decision process (MDP) by leveraging a Lagrangian method, and accordingly propose a Lagrangian transformation framework for the original CMDP problem. Furthermore, we integrate the framework with a perturbation-based refinement mechanism for achieving the optimal policy of the CMDP problem. Our investigation shows that to minimize the average AoP: 1) for processing offloading: the policy exploits good channel state to offload processing to the edge server and 2) for status sampling: the waiting time presents a threshold structure. Extensive numerical evaluations show that the proposed algorithm outperforms the benchmarks, with an average AoP reduction up to 30%.