In this paper, a new method based on dichromatic reflection model (DRM) and exemplar patch is proposed to remove highlight pixels for light field images. Firstly, a Gaussian mixture model clustering method with strong generalization performance combined with depth information is used to classify saturated highlight pixels and unsaturated highlight pixels. A confidence strategy based on DRM is proposed to remove unsaturated highlight pixels, and an exemplar patch matching method based on gradient combined with the sum of square of color difference is designed to remove saturated highlight pixels. Meanwhile, a method named SSIME based on information entropy with structural similarity index measure is designed to quantitatively evaluate the effectiveness of proposed method. Experiments show that our proposed method not only effectively detects and removes specular highlights, but also applies to objects with a large range of highlights, which breakthroughs the limitation that large-region specular highlight cannot be removed due to the short baseline of the light field camera.