Abstract

Measures of distance or how data points are positioned relative to each other are fundamental in pattern recognition. The concept of depth measures how deep an arbitrary point is positioned in a dataset, and is an interesting concept in this regard. However, while this concept has received a lot of attention in the statistical literature, its application within pattern recognition is still limited.To increase the applicability of the depth concept in pattern recognition, we address the well-known computational challenges associated with the depth concept, by suggesting to estimate depth using incremental quantile estimators. The suggested algorithm can not only estimate depth when the dataset is known in advance, but can also track depth for dynamically varying data streams by using recursive updates. The tracking ability of the algorithm was demonstrated based on a real-life application associated with detecting changes in human activity from real-time accelerometer observations. Given the flexibility of the suggested approach, it can detect virtually any kind of changes in the distributional patterns of the observations, and thus outperforms detection approaches based on the Mahalanobis distance.

Highlights

  • Several attempts have been made to provide a desirable ordering of multivariate data and the concept of depth has become very popular

  • Depth gives a center-outward ordering and a wide range of depth measures have been developed (Mosler; 2013), such as depth based on distance metrics (Mahalanobis, spherical, projection and oja), weighted mean depths (Dyckerhoff and Mosler; 2011) and depth based on halfspaces and simplices (Tukey; 1975; Zhang; 2002; Liu et al.; 1999)

  • The concept has further been extended to measure the depth of regression models (Rousseeuw and Hubert; 1999) and the depth of functional data (LopezPintado and Romo; 2009; Lopez-Pintado et al.; 2014)

Read more

Summary

Introduction

Several attempts have been made to provide a desirable ordering of multivariate data and the concept of depth has become very popular. Kong and Mizera (2012) showed that contours with a specific Tukey depth can be estimated from the intersection of such halfspaces over different directions. Such contours can again be used to estimate the depth of any point. In this paper we suggest to use incremental quantile estimators (Hammer et al.; 2018, 2019). The QEWA and CondQ incremental quantile estimators, in Hammer et al (2018) and Hammer et al (2019), document state-of-the-art tracking performance, but these estimators are based on generalized exponentially weighted averages and are not robust to outliers which are common in real-life data streams.

The Concept of Depth
Efficient Estimation of Tukey Depth
Performance Metrics
Euclidean distance
Synthetic Experiments
Synthetic Experiments - Static Data Stream
Synthetic Experiments - Offline Setting
Synthetic Experiments - Dynamically Changing Data Streams
Real-life Data Examples
Activity Change Detection
Closing Remarks
Findings
Computation of Depth Error for Elliptic Distributions
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call