The finite Gaussian mixture model (GMM) is a flexible and powerful tool for addressing many computer vision and pattern recognition problems. The Gaussian distribution is a probability distribution that is symmetric with respect to the mean. However, in many segmentation applications, the observed data obey an asymmetric distribution. Furthermore, the GMM is sensitive to imaging noise. To alleviate these issues, a new finite anisotropic asymmetric normal mixture model is presented in this paper. Note that GMM is a degraded case of our proposed model. First, the proposed model employs anisotropic spatial information to reduce the effect of imaging noise while preserving the details, such as edges, corners and slim structure objects. Second, the anisotropic spatial information is coupled into the skew normal distribution to fit the observed data obeying an asymmetric distribution. Then the modeling and estimation of the object intensity probability density function are proposed by using the anisotropic skew normal mixture model. The proposed model not only has the capability to fit the observed data obeying a non-symmetric distribution, but also can reduce the effect of noise while preserving the objects details. Finally, expectation maximization (EM) algorithm is adopted to estimate the model parameters in order to maximize the log-likelihood function. The experiment results on synthetic images and natural grayscale images demonstrate the superior performance of the proposed model compared with other state-of-the-art segmentation methods.