Characterizing Hyperspectral Microscope Imagery for Classification of Blueberry Firmness with Deep Learning Methods

Abstract

Firmness is an important quality indicator of blueberries. Firmness loss (or softening) of postharvest blueberries has posed a challenge in its shelf-life quality control and can be delineated with its microstructural changes. To investigate spatial and spectral characteristics of microstructures based on firmness, hyperspectral microscope imaging (HMI) was employed for this study. The mesocarp area with 20× magnification of blueberries was selectively imaged with a Fabry–Perot interferometer HMI system of 400–1000 nm wavelengths, resulting in 281 hypercubes of parenchyma cells in a resolution of 968 × 608 × 300 pixels. After properly processing each hypercube of parenchyma cells in a blueberry, the cell image with different firmness was examined based on parenchyma cell shape, cell wall segment, cell-to-cell adhesion, and size of intercellular spaces. Spectral cell characteristics of firmness were also sought based on the spectral profile of cell walls with different image preprocessing methods. The study found that softer blueberries (1.96–3.92 N) had more irregular cell shapes, lost cell-to-cell adhesion, loosened and round cell wall segments, large intercellular spaces, and cell wall colors that were more red than the firm blueberries (6.86–8.83 N). Even though berry-to-berry (or image-to-image) variations of the characteristics turned out large, the deep learning model with spatial and spectral features of blueberry cells demonstrated the potential for blueberry firmness classification with Matthew’s correlation coefficient of 73.4% and accuracy of 85% for test set.