A deep learning-based mobile application for tree species mapping in RGB images

Abstract

Tree species mapping is an important type of information demanded in different study fields. However, this task can be expensive and time-consuming, making it difficult to monitor extensive areas. Hence, automatic methods are required to optimize tree species mapping. Here, we propose a deep learning-based mobile application tool for tree species classification in high-spatial-resolution RGB images. Several deep learning architectures were evaluated, including mobile networks and traditional models. A total of 2,349 images were used, of which 1,174 images consisted of the Dipteryx alata species and 1,175 images of other local species. These images were manually annotated and randomly divided into training (70%), validation (20%), and testing (10%) subsets, considering the five-fold cross-validation. We evaluated the accuracy and speed (GPU and CPU) of all the implemented deep learning architectures. We found out that the traditional networks have the best performance in terms of F1 score; however, mobile networks are faster. Inception V3 model achieved the best accuracy (F1 score of 97.4%), and MobileNet the worst (F1 score of 83.84%). The MobileNet obtained the best classification speed for CPU (with a mean execution time of 102.8 ms) and GPU (72.4 ms) units. For comparison, Inception V3 achieved a mean execution time of 1058.3 ms for CPU and 634.5 ms for GPU. We conclude that the mobile application proposed can be successfully used to run mobile networks and traditional networks for image classification, but the balance between accuracy and execution time needs to be carefully assessed. This mobile app is a tool for researchers, policymakers, non-governmental organizations, and the general public who intends to assess the tree species, providing a GUI-based platform for non-programmers to access the capabilities of deep learning models in complex classification tasks. • Deep learning models executed in mobile applications can classify tree species in RGB. • Traditional networks are better (F1-score of 97.4%) than mobile (83.8%) networks. • Mobile networks are faster than traditional models in the mean execution time on task.