Accurate and semantic 3D reconstruction of maize leaves

Abstract

The rapid advances in equipment and technology for crop three-dimensional (3D) data acquisition have enabled the high-throughput and high-quality acquisition of crop 3D data. However, the challenge now lies in comprehending unstructured crop 3D data and extracting phenotypes and knowledge. Extracting semantic feature points from plant leaves and achieving high-precision 3D reconstruction is a prevalent and formidable issue in this field. In this study, we present an accurate method for semantic 3D reconstruction of maize leaves. The algorithm utilizes 3D point cloud data of maize leaves as the initial input. Subsequently, the semantic 3D reconstruction of maize leaves is achieved by means of point cloud preprocessing, initial triangular meshing, hole filling, remeshing, mesh parameterization, two-dimensional (2D) edge detection, 2D semantic point interpolation, 3D semantic point selection, mesh generation, and optimization of feature-point position. A total of 56 leaves from five different maize cultivars were reconstructed utilizing this method. The results indicate that the average distance error index dCDMP between the reconstructed mesh vertices and the input point cloud is less than 0.3 cm2 for all five cultivars, and the mean of the maximum distance error index dHDMP for each cultivar is within the range of 0.5–0.8 cm, indicating it is high-accuracy. The visualization of leaves shows good consistency between the reconstructed mesh and corresponding point cloud. Additionally, the reconstructed 3D mesh of the leaves exhibits enhanced triangular facet consistency. Each vertex can be precisely identified as a leaf vein point, leaf edge point, leaf tip point, or leaf surface point, and includes semantic data such as the position on the leaf blade, which can be directly employed for phenotype estimations. High-precision reconstruction of 3D models of crop organs that include semantic information and cultivar resolution yields significant benefits. This technology can improve the resolution and accuracy of crop morphological and structural research, and it is also crucial for crop phenomics, functional-structural plant modelling, and fusion research between plant phenotyping and crop models.