Adaptive threshold based outlier detection on IoT sensor data: A node-level perspective

Abstract

The accuracy and reliability of IoT-based sensor networks depend on validating sensed data, including detecting outliers at the node level. This study proposes an online outlier detection approach using Multiple Linear Regression-based adaptive thresholds for real-time IoT/WSN sensor nodes. IoT sensors experience two outlier types: Errors, from sensor malfunctions or low battery, and Events, from sudden environmental changes. The Adaptive Threshold Based Outlier Detection (ATBOD) approach differentiates errors from events using an adaptive threshold that adjusts to real-time data patterns. Unlike existing methods that are used in literature, which lack automated model evolution and suffer from delays and high computational time, ATBOD enhances outlier detection sensitivity without increasing false alarms, which is crucial for efficient IoT sensor board operation. It also improves sensor board lifespan by discarding errors at the node level, preventing energy wastage from transmitting error data to the cloud. ATBOD outperforms existing algorithms, which are referenced for comparison, such as Enhanced Efficient Outlier Detection and Classification Approach (EEODCA), K Nearest Neighbor approximate outlier detection (KNN), and Modified Local Outlier Factor (LOF), in Error Detection Rate, Error False Positive Rate, and Energy Saving Ratio. These advancements represent a significant leap in performance, making ATBOD a superior method for real-time outlier detection in IoT sensor networks.