Renyi entropy analysis of a deep convolutional representation for texture recognition

Abstract

Despite the recent success of convolutional neural networks in computer vision in general, texture images still pose an important challenge to those models, especially when dealing with textures “in the wild”. In this context, deep learning models can benefit from the introduction of features long known to be useful for texture modeling. And that is the case of entropy, a measure of texture regularity that has played an important role in classical computer vision. Based on this observation, here we propose an alternative analysis over deep convolutional neural features based on entropy for texture representation and, particularly, texture classification. More precisely, we couple a module to the convolutional backbone that locally computes the Renyi entropy of the latent representation at multiple levels. The rationale for using Renyi entropy is essentially two-fold: (1) It connects the concept of entropy with multifractal theory, another well explored measure especially in domains of application where we seek some physical interpretation of the descriptors, e.g., in medicine, biology, and others; (2) It has an extra degree of freedom (α parameter) that can be fine-tuned. The main contribution of this study is the development of a strategy that can improve the performance of convolutional neural networks in texture recognition tasks, adding low computational cost. The effectiveness of our method is verified in texture classification of benchmark datasets, as well as in a practical task of plant species identification. Our method achieves a competitive accuracy of 84.5% in the classification of KTH-TIPS-2b and 80.9% in FMD, which are two challenging benchmark databases. Besides, an accuracy of 91.6% is obtained in the plant identification application, to our knowledge outperforming all the results previously published on this task. In both scenarios, the proposed descriptors outperform several approaches from the state-of-the-art, confirming the method potential as a rich and robust solution for texture analysis in general. The results also suggest that information-theoretical measures like entropy can be a reliable source of information to compose a precise and robust latent representation of texture images.