Show Auto-Adaptive and Tell: Learned From the SEM Image Challenge

Abstract

Scanning electron microscopy (SEM) has been widely used in optical material science. However, a considerable quantity of human resources is required to analyze and describe SEM images. In recent years, the application of computer technology in material science and engineering developed endlessly. Computer science, including data processing, simulation technique, and mathematical model, promotes material science progress tremendously. Moreover, deep learning has been achieved success in image classification and image analysis. In this paper, we propose a novel automatic analysis tool using a triplet neural network called show auto-adaptive and tell to analyze optical SEM images automatically. Firstly, we collected SEM images and corresponding captioning from previous papers and built a database. Then, a triplet neural network with proposed loss function to train the show auto-adaptive and tell model on 60% of the dataset for SEM images analysis, test on 30% and validate on 10%. Finally, experiment on the four metrics index as the evaluation criterion shows that the novel method gets better performance than previous work.