Semi‐automatic object segmentation using colour invariance and Graph Cuts

Abstract

Conventional semi-automatic or interactive methods, which require a small amount of user inputs for region segmentation of objects, have obtained the best segmentation results. A new semi-automatic segmentation technique by using coloured scale-invariant feature transform (CSIFT) to extract seed pixels in Graph Cuts is introduced here. First, CSIFT is used to extract feature points of objects in the image. Then, a voting process is used to extract the matched points as object seeds. The detailed technique via s–t Graph Cuts has been presented, and a new segmentation energy cost function with two colour-invariant descriptors has been proposed: colour-name descriptor and colour-shade descriptor. The colour-name descriptor introduces high-level considerations resembling top-down intervention, and the colour-shade descriptor allows us to include physical consideration derived from the image formation model capturing gradual colour surface variations and provides congruencies in the presence of shadows and highlights in the segmentation. The experimental results prove that the proposed method provides high-quality segmentations with object details.