Abstract

In this paper, we propose a general method to detect outliers from contaminated estimates of various image estimation applications. The method does not require any prior knowledge about the purpose, theory or hardware of the application but simply relies on the law of edge consistency between sources and estimates. The method is termed as ALRe (anchored linear residual) because it is based on the residual of weighted local linear regression with an equality constraint exerted on the measured pixel. Given a pair of source and contaminated estimate, ALRe offers per-pixel outlier likelihoods, which can be used to compose the data weights of post-refinement algorithms, improving the quality of refined estimate. ALRe has the features of asymmetry, no false positive and linear complexity. Its effectiveness is verified on four applications, four post-refinement algorithms and three datasets. It demonstrates that, with the help of ALRe, refined estimates are better in the aspects of both quality and edge consistency. The results are even comparable to model-based and hardware-based methods. Accuracy comparison on synthetic images shows that ALRe could detect outliers reliably. It is as effective as the mainstream weighted median filter at spike detection and is significantly better at bad region detection.

Highlights

  • Edge consistency is crucial in many image processing applications producing perpixel estimates based on source images, such as depth estimation, object segmentation and alpha matting

  • We show that edge consistency itself is a valuable and under-exploited clue for general outlier detection

  • ALRe performs significantly better than WMF at bad region detection

Read more

Summary

Introduction

Edge consistency is crucial in many image processing applications producing perpixel estimates based on source images, such as depth estimation, object segmentation and alpha matting. Outliers are caused by unexpected samples or improper designs of processing methods (termed artifacts in this situation) They might trigger large offsets and have very different forms between applications. Outlier detection methods are designed based on prior, model or hardware. These methods are effective but not general. A hypothesize-and-verify algorithm termed ALRe (anchored linear residual) is proposed to find pixels undermining edge consistency. It offers per-pixel outlier likelihoods of estimates based on the source. To the best of our knowledge, ALRe is the first general outlier detection method based on edge consistency.

Related Works
Weighted Least Squares
Joint Bilateral Filter
Guided Filter
Weighted Median Filter
Outlier Detection
Intuition
Algorithm
Asymmetry
No False Positive residual residual
Transmission Refinement for Haze Removal
Refinements in Depth Estimation
Feathering
Edge-Preserving Smoothing
Summary
Experiments
Transmission Refinement
Disparity Refinement
Findings
Conclusions
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call