Analysis of the latent space of pre-trained deep convolutional neural networks in the problem of automatic segmentation of color images

Abstract

The paper presents a primary study of the latent space structure of neural networks trained for semantic segmentation. Segmentation was performed in a controlled environment of three classes of colored rectangular shapes. The classic autoencoder and U-net like architectures were chosen as reference architectures. To study the structure of the space, a combination of a perceptron that linearly separates classes and the compression algorithms UMAP and PCA was used. As a result, a tool was obtained for evaluating the quality of a neural network based on the degree of separability of classes in the latent space of the network.