Abstract
In this paper, we propose a general method to detect outliers from contaminated estimates of various image estimation applications. The method does not require any prior knowledge about the purpose, theory or hardware of the application but simply relies on the law of edge consistency between sources and estimates. The method is termed as ALRe (anchored linear residual) because it is based on the residual of weighted local linear regression with an equality constraint exerted on the measured pixel. Given a pair of source and contaminated estimate, ALRe offers per-pixel outlier likelihoods, which can be used to compose the data weights of post-refinement algorithms, improving the quality of refined estimate. ALRe has the features of asymmetry, no false positive and linear complexity. Its effectiveness is verified on four applications, four post-refinement algorithms and three datasets. It demonstrates that, with the help of ALRe, refined estimates are better in the aspects of both quality and edge consistency. The results are even comparable to model-based and hardware-based methods. Accuracy comparison on synthetic images shows that ALRe could detect outliers reliably. It is as effective as the mainstream weighted median filter at spike detection and is significantly better at bad region detection.
Highlights
Edge consistency is crucial in many image processing applications producing perpixel estimates based on source images, such as depth estimation, object segmentation and alpha matting
We show that edge consistency itself is a valuable and under-exploited clue for general outlier detection
ALRe performs significantly better than WMF at bad region detection
Summary
Edge consistency is crucial in many image processing applications producing perpixel estimates based on source images, such as depth estimation, object segmentation and alpha matting. Outliers are caused by unexpected samples or improper designs of processing methods (termed artifacts in this situation) They might trigger large offsets and have very different forms between applications. Outlier detection methods are designed based on prior, model or hardware. These methods are effective but not general. A hypothesize-and-verify algorithm termed ALRe (anchored linear residual) is proposed to find pixels undermining edge consistency. It offers per-pixel outlier likelihoods of estimates based on the source. To the best of our knowledge, ALRe is the first general outlier detection method based on edge consistency.
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have