Fully automated snow depth measurements from time-lapse images applying a convolutional neural network

Abstract

Time-lapse cameras in combination with simple measuring rods can form a highly reliable low-cost sensor network monitoring snow depth in a high spatial and temporal resolution. Depending on the number of cameras and the temporal recording resolution, such a network produces large sets of image time series. In order to extract the snow depth time series from these collections of images in acceptable time, automated processing methods have to be applied. Besides classic image processing based on edge detection methods, there are nowadays ready-to-use convolutional neural network frameworks like Mask R-CNN that facilitate instance segmentation and thus allow for fully automated snow depth measurements from images using a detectable measuring rod. This study investigates the applicability of Mask R-CNN embedded in a newly developed work flow for snow depth measurements. The new method is compared to an automated image processing method carried out utilizing functionalities provided by the OpenCV library. The quality of both methods was assessed with the inclusion of manual evaluations of the image series. As a result, the newly introduced work flow outperforms the present classic image processing method in regard to stability, accuracy and portability. By applying the Mask R-CNN framework, the overall RMSE of two considered time series is reduced to approximately 20% of the value produced by means of the classic image processing approach. Moreover, the ratio of values within five centimeter deviation from the reference value was increased from 75% to 88% on average. Since no parameters have to be adjusted, the Mask R-CNN framework is able to detect known shapes reliably in almost any environment, making the presented method highly flexible.