Interactive Image Segmentation Using Semi-transparent Wearable Glasses

Abstract

Since it is difficult to automatically and precisely extract an object of interest, interactive image segmentation techniques exploit user-provided segmentation seeds. In previous interactive segmentation applications, the segmentation seeds are typically provided by mouse clicks or finger touches. In this paper, the segmentation of an object is studied from the scene that the user sees through semi-transparent wearable glasses. In this application scenario, a front-view camera is used to obtain the segmentation seeds from the user's fingertip position. In particular, two segmentation methodologies called transparent segmentation and semi-transparent segmentation are considered to determine an effective segmentation scheme for the wearable glasses. Extensive user studies are performed to evaluate the user preferences and the segmentation accuracies of the two methodologies.