Automation of green roof plant cover measurements using machine learning and a comparison of digital and thermal imaging techniques

Abstract

AbstractAimsPost‐analyses of digital red, green, blue (RGB) and thermal images have become increasingly popular as modern approaches to plant cover analysis. Image analyses are often coupled with semi‐automated or automated workflows to reduce the amount of human labor input compared with traditional manual procedures. This study aims to evaluate and compare different image segmentation methods for plant cover analysis using digital RGB and thermal images, focusing on the effectiveness of semi‐automated and manual segmentation techniques in monitoring plant cover on green roofs.LocationAn Extensive green roof in the City of Toronto.MethodsWe surveyed the plant cover of an extensive green roof using digital and thermal imagery. The plant cover values were obtained using three methods: traditional manual segmentation based on a visual examination (MS), ImageJ Color Threshold (CT) and Trainable Weka Segmentation (TWS), all performed within FIJI (a distribution of ImageJ). Manual segmentation based on visual examination was used as a reference standard.ResultsSignificant correlation was found between the cover estimation using the CT and TWS methods relative to MS, and between cover estimation using the thermal image and the RGB image. TWS overestimated plant cover on thermal images while producing an underestimation on RGB images. CT demonstrated a performance closer to MS than TWS, indicating that manually customized methods produced results more aligned with MS. The estimated cover values by MS were not significantly affected by the image type (digital RGB or thermal).ConclusionsResults suggest that RGB and thermal imaging techniques may provide complementary results and reveal unique information regarding the functioning of green roofs. The accuracy of supervised machine‐learning methods could be enhanced with site‐specific data to provide a more accurate and efficient estimation of plant cover, which might be beneficial for long‐term studies on green roofs and ecological sites in remote locations.