Reconstruction enhanced probabilistic model for semisupervised tongue image segmentation

Abstract

SummaryTongue segmentation is a key step of automatic tongue diagnosis, and the major challenges for the effective segmentation lie in the large appearance variations of tongue caused by different diseases, for example, tongue coating and tongue texture. Moreover, the limited labeled data also hinders traditional supervised methods from their powerful learning ability. To alleviate these challenges, in this work, we propose a reconstruction enhanced probabilistic model for semisupervised tongue segmentation, named SemiTongue, in which, image reconstruction constraint combined with adversarial learning is used to improve the accuracy of tongue segmentation. Specifically, based on a shared feature encoder that served as an inference model, two separate branches in SemiTongue as the generative model, which are composed of a segmentation decoder and a reconstruction decoder, are utilized to generate the tongue segmentation and reconstruct original tongue image respectively. Then, a discriminator is employed to differentiate the generated segmentation map from the ground truth segmentation distribution. Moreover, semisupervised learning is conducted through discriminator by discovering the reliable region in the generated segmentation map of unlabeled images, which is further utilized to supervise the segmentation branch. Experimental results compared with state‐of‐the‐art methods on real‐world datasets demonstrate the effectiveness of SemiTongue.