Holistic quaternion vector convolution filter for RGB-depth video contour detection

Abstract

A quaternion vector gradient filter is proposed for RGB-depth (RGB-D) video contour detection. First, a holistic quaternion vector system is introduced to synthetically express the color and depth information, by adding the depth to its scalar part. Then, a convolution differential operator for quaternion vector is proposed to highlight edges with both depth and chromatic variations but restrain the gradient of intensity term. In addition, the quaternion vector gradients are adaptively weighted utilizing depth confidence measure and the quadtree decomposition of the coding tree units in the video streaming. Results on the 3-D high-efficiency video coding test sequences and quantitative simulated experiments on Berkeley segmentation datasets both indicate the availability of the proposed gradient-based method on detecting the semantic contour of the RGB-D videos.