Object-based Image Analysis Algorithm Research Articles

Spatiotemporal changes of impervious surface areas in Great Mekong Subregion from 1992 to 2019

As one of the fastest growing economies in the world, the Great Mekong Subregion (GMS) has experienced dramatic changes in impervious surface areas (ISA) during the last few decades, which have a profound impact on human society and ecosystems. To quantify the impacts of rapid urbanization, it is essential to examine spatial distribution and dynamic change of ISA in the GMS. Thus we the applied object-based image analysis (OBIA) method to map ISA in the GMS from 1992 to 2019 using nighttime light data and Landsat images. Meanwhile, spatiotemporal changes of ISA across the GMS during the study period were analyzed. Our results show that (1) the OBIA algorithm was effective for mapping ISA in the GMS, with the overall accuracy reaching 92.28%. (2) The ISA in the GMS reached 17671.47 km2 in 2019, which is 4.36 times more than that in 1992. (3) The increase of ISA in the GMS mainly occurred in 10 metropolitan cities with the highest population densities, accounting for ∼93 % of the GMS’s total in 2019. There are different possible major driving factors for each city and member state. Monitoring the spatiotemporal changes of ISA in rapidly urbanized areas is crucial for promoting sustainable urban development and reducing the impact of urbanization.

Ultra-High-Resolution Mapping of Posidonia oceanica (L.) Delile Meadows through Acoustic, Optical Data and Object-based Image Classification

In this study, we present a framework for seagrass habitat mapping in shallow (5–50 m) and very shallow water (0–5 m) by combining acoustic, optical data and Object-based Image classification. The combination of satellite multispectral images-acquired from 2017 to 2019, together with Unmanned Aerial Vehicle (UAV) photomosaic maps, high-resolution multibeam bathymetry/backscatter and underwater photogrammetry data, provided insights on the short-term characterization and distribution of Posidonia oceanica (L.) Delile, 1813 meadows in the Calabrian Tyrrhenian Sea. We used a supervised Object-based Image Analysis (OBIA) processing and classification technique to create a high-resolution thematic distribution map of P. oceanica meadows from multibeam bathymetry, backscatter data, drone photogrammetry and multispectral images that can be used as a model for classification of marine and coastal areas. As a part of this work, within the SIC CARLIT project, a field application was carried out in a Site of Community Importance (SCI) on Cirella Island in Calabria (Italy); different multiscale mapping techniques have been performed and integrated: the optical and acoustic data were processed and classified by different OBIA algorithms, i.e., k-Nearest Neighbors’ algorithm (k-NN), Random Tree algorithm (RT) and Decision Tree algorithm (DT). These acoustic and optical data combinations were shown to be a reliable tool to obtain high-resolution thematic maps for the preliminary characterization of seagrass habitats. These thematic maps can be used for time-lapse comparisons aimed to quantify changes in seabed coverage, such as those caused by anthropogenic impacts (e.g., trawl fishing activities and boat anchoring) to assess the blue carbon sinks and might be useful for future seagrass habitats conservation strategies.

Monitoring Vineyard Canopy Management Operations Using UAV-Acquired Photogrammetric Point Clouds

Canopy management operations, such as shoot thinning, leaf removal, and shoot trimming, are among the most relevant agricultural practices in viticulture. However, the supervision of these tasks demands a visual inspection of the whole vineyard, which is time-consuming and laborious. The application of photogrammetric techniques to images acquired with an Unmanned Aerial Vehicle (UAV) has proved to be an efficient way to measure woody crops canopy. Consequently, the objective of this work was to determine whether the use of UAV photogrammetry allows the detection of canopy management operations. A UAV equipped with an RGB digital camera was used to acquire images with high overlap over different canopy management experiments in four vineyards with the aim of characterizing vine dimensions before and after shoot thinning, leaf removal, and shoot trimming operations. The images were processed to generate photogrammetric point clouds of every vine that were analyzed using a fully automated object-based image analysis algorithm. Two approaches were tested in the analysis of the UAV derived data: (1) to determine whether the comparison of the vine dimensions before and after the treatments allowed the detection of the canopy management operations; and (2) to study the vine dimensions after the operations and assess the possibility of detecting these operations using only the data from the flight after them. The first approach successfully detected the canopy management. Regarding the second approach, significant differences in the vine dimensions after the treatments were detected in all the experiments, and the vines under the shoot trimming treatment could be easily and accurately detected based on a fixed threshold.

Automatic UAV-based detection of Cynodon dactylon for site-specific vineyard management.

The perennial and stoloniferous weed, Cynodon dactylon (L.) Pers. (bermudagrass), is a serious problem in vineyards. The spectral similarity between bermudagrass and grapevines makes discrimination of the two species, based solely on spectral information from multi-band imaging sensor, unfeasible. However, that challenge can be overcome by use of object-based image analysis (OBIA) and ultra-high spatial resolution Unmanned Aerial Vehicle (UAV) images. This research aimed to automatically, accurately, and rapidly map bermudagrass and design maps for its management. Aerial images of two vineyards were captured using two multispectral cameras (RGB and RGNIR) attached to a UAV. First, spectral analysis was performed to select the optimum vegetation index (VI) for bermudagrass discrimination from bare soil. Then, the VI-based OBIA algorithm developed for each camera automatically mapped the grapevines, bermudagrass, and bare soil (accuracies greater than 97.7%). Finally, site-specific management maps were generated. Combining UAV imagery and a robust OBIA algorithm allowed the automatic mapping of bermudagrass. Analysis of the classified area made it possible to quantify grapevine growth and revealed expansion of bermudagrass infested areas. The generated bermudagrass maps could help farmers improve weed control through a well-programmed strategy. Therefore, the developed OBIA algorithm offers valuable geo-spatial information for designing site-specific bermudagrass management strategies leading farmers to potentially reduce herbicide use as well as optimize fuel, field operating time, and costs.

Mapping the 3D structure of almond trees using UAV acquired photogrammetric point clouds and object-based image analysis

The geometric features, such as canopy area, tree height and crown volume, of agricultural trees provide useful information to elucidate plantation status and to design input prescription maps adjusted to real crop needs. This work presents an innovative procedure for computing the 3-dimensional (3D) geometric features of almond trees by applying two phases: 1) generation of photogrammetric point clouds with unmanned aerial vehicle (UAV) technology, and 2) analysis of the point clouds using object-based image analysis (OBIA) techniques. To test this approach, a UAV with a visible-RGB (low-cost) sensor was flown over three experimental almond groves at different phenological stages for two years, and the validation field method consisted of registering the height of a total of 325 trees in the two fields. The OBIA algorithm developed in this study achieved successful results: i) the individual and overall similarity measures between manually delineated and automatically detected almond tree crowns were above 0.9, and ii) the validation assessment conducted to estimate tree height from the UAV-derived algorithm produced an R2 = 0.94, an overall root mean square error (RMSE) of 0.39 m. The information derived from the OBIA algorithm was used for generating 3D maps for every tree volume and volume growth, which would be useful to understand the linkages between tree and crop management operations in the context of precision agriculture, with relevant agro-environmental implications. Our findings show that an RGB, low-cost sensor on-board a UAV provided dense 3D point clouds can be used for accurately characterising almond tree architecture.

3-D Characterization of Vineyards Using a Novel UAV Imagery-Based OBIA Procedure for Precision Viticulture Applications

Precision viticulture has arisen in recent years as a new approach in grape production. It is based on assessing field spatial variability and implementing site-specific management strategies, which can require georeferenced information of the three dimensional (3D) grapevine canopy structure as one of the input data. The 3D structure of vineyard fields can be generated applying photogrammetric techniques to aerial images collected with Unmanned Aerial Vehicles (UAVs), although processing the large amount of crop data embedded in 3D models is currently a bottleneck of this technology. To solve this limitation, a novel and robust object-based image analysis (OBIA) procedure based on Digital Surface Model (DSM) was developed for 3D grapevine characterization. The significance of this work relies on the developed OBIA algorithm which is fully automatic and self-adaptive to different crop-field conditions, classifying grapevines, and row gap (missing vine plants), and computing vine dimensions without any user intervention. The results obtained in three testing fields on two different dates showed high accuracy in the classification of grapevine area and row gaps, as well as minor errors in the estimates of grapevine height. In addition, this algorithm computed the position, projected area, and volume of every grapevine in the field, which increases the potential of this UAV- and OBIA-based technology as a tool for site-specific crop management applications.

Object-based satellite image analysis applied for crop residue estimating using Landsat OLI imagery

ABSTRACTThe main objective of this study is to apply an object-based image analysis (OBIA) approach to satellite image processing and determining crop residue cover (CRC) and tillage intensity. To achieve this goal, we collected ground truth data using line-transect method from 35 plots of farmlands with an area of 528 ha. Accordingly, Landsat Operational Land Imager (OLI) satellite image together with global positioning system (GPS)-based survey data set were considered for applying the OBIA methods and deriving CRC. To process the data, object-based image processing steps including segmentation and classification were applied to develop intelligent objects and establish classification using spectral and spatial characteristics of CRC. We developed three categories of rule sets including mean indices, tillage indices, and grey-level co-occurrence matrix (GLCM) texture features using the OBIA algorithms and assign class method. Results were validated against of ground control data set and were collected by GPS in field survey. Results of this study indicated that the brightness, normalised difference tillage index, and GLCM texture feature mean performed out as effective techniques. Overall accuracy and kappa coefficient (κ) were computed to be about 0.91 and 0.86; 0.93 and 0.90; 0.60 and 0.35, respectively, for the above-mentioned indices. The foregoing discussion has attempted to demonstrate that the remotely sensed data can be effective approach and substitute for ground methods, especially in large areas.

An Automatic Random Forest-OBIA Algorithm for Early Weed Mapping between and within Crop Rows Using UAV Imagery

Accurate and timely detection of weeds between and within crop rows in the early growth stage is considered one of the main challenges in site-specific weed management (SSWM). In this context, a robust and innovative automatic object-based image analysis (OBIA) algorithm was developed on Unmanned Aerial Vehicle (UAV) images to design early post-emergence prescription maps. This novel algorithm makes the major contribution. The OBIA algorithm combined Digital Surface Models (DSMs), orthomosaics and machine learning techniques (Random Forest, RF). OBIA-based plant heights were accurately estimated and used as a feature in the automatic sample selection by the RF classifier; this was the second research contribution. RF randomly selected a class balanced training set, obtained the optimum features values and classified the image, requiring no manual training, making this procedure time-efficient and more accurate, since it removes errors due to a subjective manual task. The ability to discriminate weeds was significantly affected by the imagery spatial resolution and weed density, making the use of higher spatial resolution images more suitable. Finally, prescription maps for in-season post-emergence SSWM were created based on the weed maps—the third research contribution—which could help farmers in decision-making to optimize crop management by rationalization of the herbicide application. The short time involved in the process (image capture and analysis) would allow timely weed control during critical periods, crucial for preventing yield loss.

Early season weed mapping in sunflower using UAV technology: variability of herbicide treatment maps against weed thresholds

Site-specific weed management is defined as the application of customised control treatments only where weeds are located within the crop-field by using adequate herbicide according to weed emergence. The aim of the study was to generate georeferenced weed seedling infestation maps in two sunflower fields by analysing overlapping aerial images of the visible and near-infrared spectrum (using visible or multi-spectral cameras) collected by an unmanned aerial vehicle (UAV) flying at 30 and 60 m altitudes. The main tasks focused on the configuration and evaluation of the UAV and its sensors for image acquisition and ortho-mosaicking, as well as the development of an automatic and robust image analysis procedure for weed seedling mapping used to design a site-specific weed management program. The control strategy was based on seven weed thresholds with 2.5 steps of increasing ratio from 0 % (herbicide must be applied just when there is presence or absence of weed) to 15 % (herbicide applied when weed coverage >15 %). As a first step of the imagery analysis, sunflower rows were correctly matched to the ortho-mosaicked imagery, which allowed accurate image analysis using object-based image analysis [object-based-image-analysis (OBIA) methods]. The OBIA algorithm developed for weed seedling mapping with ortho-mosaicked imagery successfully classified the sunflower-rows with 100 % accuracy in both fields for all flight altitudes and camera types, indicating the computational and analytical robustness of OBIA. Regarding weed discrimination, high accuracies were observed using the multi-spectral camera at any flight altitude, with the highest (approximately 100 %) being those recorded for the 15 % weed threshold, although satisfactory results from 2.5 to 5 % thresholds were also observed, with accuracies higher than 85 % for both field 1 and field 2. The lowest accuracies (ranging from 50 to 60 %) were achieved with the visible camera at all flight altitudes and 0 % weed threshold. Herbicide savings were relevant in both fields, although they were higher in field 2 due to less weed infestation. These herbicide savings varied according to the different scenarios studied. For example, in field 2 and at 30 m flight altitude and using the multi-spectral camera, a range of 23–3 % of the field (i.e., 77 and 97 % of area) could be treated for 0–15 % weed thresholds. The OBIA procedure computed multiple data which permitted calculation of herbicide requirements for timely and site-specific post-emergence weed seedling management.

An automatic object-based method for optimal thresholding in UAV images: Application for vegetation detection in herbaceous crops

In precision agriculture, detecting the vegetation in herbaceous crops in early season is a first and crucial step prior to addressing further objectives such as counting plants for germination monitoring, or detecting weeds for early season site specific weed management. The ultra-high resolution of UAV images, and the powerful tools provided by the Object Based Image Analysis (OBIA) are the key in achieving this objective. The present research work develops an innovative thresholding OBIA algorithm based on the Otsu’s method, and studies how the results of this algorithm are affected by the different segmentation parameters (scale, shape and compactness). Along with the general description of the procedure, it was specifically applied for vegetation detection in remotely-sensed images captured with two sensors (a conventional visible camera and a multispectral camera) mounted on an Unmanned Aerial Vehicle (UAV) and acquired over fields of three different herbaceous crops (maize, sunflower and wheat). The tests analyzed the performance of the OBIA algorithm for classifying vegetation coverage as affected by different automatically selected thresholds calculated in the images of two vegetation indices: the Excess Green (ExG) and the Normalized Difference Vegetation Index (NDVI). The segmentation scale parameter affected the vegetation index histograms, which led to changes in the automatic estimation of the optimal threshold value for the vegetation indices. The other parameters involved in the segmentation procedure (i.e., shape and compactness) showed minor influence on the classification accuracy. Increasing the object size, the classification error diminished until an optimum was reached. After this optimal value, increasing object size produced bigger errors.