Effect of intra-year Landsat scene availability in land cover land use classification in the conterminous United States using deep neural networks

Abstract

The Landsat archive having consistent revisit times, near global extent and extensive multi-decadal temporal coverage offers a unique opportunity for land cover land use product generation. Along with this vast volume of freely available data, new classification methods based on deep learning have improved modeling capabilities. This manuscript investigates the effect of intra-annual Landsat scene availability in the accuracy of land cover land use classification in the conterminous United States. More specifically, we seek to quantify the effect of: i) increased monthly scene availability, and ii) specific months that may result in higher classification accuracy across different classes. Identifying specific months with comparable classification accuracy to the entire time series could offer significant computational gains for large-scale mapping. Our experiment incorporated deep learning classifiers and a wide range of reference data across the continental United States. Results were contrasted between five large U.S. climatic regions to further differentiate this intra-annual effect. Our findings indicate that the total number of months can have a highly variable effect in the classification accuracy ranging from minor (a few percentage points in terms of class F1 accuracy) to extremely beneficial (approaching 50% F1 improvement moving from four to twelve month observations). The benefit of increased month observations varied among climatic regions and classes: when all climate regions were combined, the grass/shrub and cultivated classes improved their F1 accuracy up to 30%, while the water class saw the least improvement of about 5%, partially due to its limited room for improvement. The effect of specific month combinations was also examined, where the total number of months was kept constant and the included months varied. The difference between the best month combination and the median combination value was estimated to be as high as about 30% for the four monthly observations scenario and the grass/shrub class. Further validation of the month selection importance comes from an example implementation scenario where F1 improvements can be as high as 10%. Our work demonstrated that month selection may offer such benefits that in some classes and climatic regions this time selection optimization is an inevitable choice due to large accuracy improvements. Also, the potential data reduction with targeted month selection would be particularly appealing to large-scale classification tasks. Due to the large extent of the climatic regions further studies are needed to quantify a more localized effect along with explanation of potential drivers.