Automated segmentation of large image datasets using artificial intelligence for microstructure characterisation and damage analysis

Abstract

Many properties of commonly used materials are driven by their microstructure, which can be influenced by the composition and manufacturing processes. To optimise future materials, understanding the microstructure is critically important. Here, we present two novel approaches based on artificial intelligence that allow the segmentation of the phases of a microstructure for which simple numerical approaches, such as thresholding, are not applicable: One is based on the nnU-Net neural network, and the other on generative adversarial networks (GAN).Using scanning electron microscopy images collected from large areas (∼1 mm2) of dual-phase steels as a case study, we demonstrate how both methods effectively segment intricate microstructural details, including martensite, ferrite, and damage sites, for subsequent analysis.Either method shows substantial generalizability across a range of image sizes and conditions, including heat-treated microstructures with different phase configurations. The nnU-Net excels in mapping large image areas. Conversely, the GAN-based method performs reliably on smaller images, providing greater step-by-step control and flexibility over the segmentation process.This study highlights the benefits of segmented microstructural data for various purposes, such as calculating phase fractions, modelling material behaviour through finite element simulation, and conducting geometrical analyses of damage sites and the local properties of their surrounding microstructure.