Single spectral imagery and faster R-CNN to identify hazardous and noxious substances spills

Abstract

The automatic identification (location, segmentation, and classification) by UAV- based optical imaging of spills of transparent floating Hazardous and Noxious Substances (HNS) benefits the on-site response to spill incidents, but it is also challenging. With a focus on the on-site optical imaging of HNS, this study explores the potential of single spectral imaging for HNS identification using the Faster R-CNN architecture. Images at 365 nm (narrow UV band), blue channel images (visible broadband of ∼400–600 nm), and RGB images of typical HNS (benzene, xylene, and palm oil) in different scenarios were studied with and without Faster R-CNN. Faster R-CNN was applied to locate and classify the HNS spills. The segmentation using Faster R-CNN-based methods and the original masking methods, including Otsu, Max entropy, and the local fuzzy thresholding method (LFTM), were investigated to explore the optimal wavelength and corresponding image processing method for the optical imaging of HNS. We also compared the classification and segmentation results of this study with our previously published studies on multispectral and whole spectral images. The results demonstrated that single spectral UV imaging at 365 nm combined with Faster R-CNN has great potential for the automatic identification of transparent HNS floating on the surface of the water. RGB images and images using Faster R-CNN in the blue channel are capable of HNS segmentation.