Underwater image restoration via backscatter pixel prior and color compensation

Abstract

The use of underwater cameras instead of divers to enter complex underwater areas for real-time monitoring of fish, shrimp, and algae is significant to the aquaculture industry. However, underwater images are severely degraded due to light absorption and scattering, limiting the development of underwater computer vision and robot vision perception. To solve blurriness and color degradation issues, this paper developed a restoration method based on backscatter pixel prior and color cast removal from the physical point of view of underwater image degradation. The proposed method used only a single underwater image as an input to estimate various parameters accurately, such as depth map, backscatter map, and illuminant map. Specifically, a backscatter estimation algorithm based on a depth map was proposed to improve the contrast of underwater images. Then, an algorithm was designed to remove color deviation based on the illuminant map. In particular, a color compensation strategy was created that could completely eliminate red artifacts in underwater images that were generated by the strong attenuation of the red channel. We designed comparative experiments from multiple angles on different real underwater image datasets. Experiments showed that the proposed method improved the contrast and removed the color deviation of light absorption compared to several reported methods. Even on underwater images with severe attenuation, the proposed method showed a significant positive effectiveness and stability on color cast removal.