Systematic skin segmentation: merging spatial and non-spatial data

Abstract

Skin detection is used in applications ranging from face detection, tracking of body parts, hand gesture analysis, to retrieval and blocking objectionable content. We present a systematic approach for robust skin segmentation using graph cuts. The skin segmentation process starts by exploiting the local skin information of detected faces. The detected faces are used as foreground seeds for calculating the foreground weights of the graph. If local skin information is not available, we opt for the universal seed. To increase the robustness, the decision tree based classifier is used to augment the universal seed weights when no local information is available in the image. With this setup, we achieve robust skin segmentation, outperforming off-line trained classifiers. The setup also provides a generic skin detection system, using positive training data only. With face detection, we take advantage of the contextual information present in the scene. With the weight augmentation, we provide a setup for merging spatial and non-spatial data. Experiments on two datasets with annotated pixel-level ground truth show that the systematic skin segmentation approach outperforms other approaches and provides robust skin detection.