UAV-based 3D Research Articles

Estimating Maize Above-Ground Biomass Using 3D Point Clouds of Multi-Source Unmanned Aerial Vehicle Data at Multi-Spatial Scales

Crop above-ground biomass (AGB) is a key parameter used for monitoring crop growth and predicting yield in precision agriculture. Estimating the crop AGB at a field scale through the use of unmanned aerial vehicles (UAVs) is promising for agronomic application, but the robustness of the methods used for estimation needs to be balanced with practical application. In this study, three UAV remote sensing flight missions (using a multiSPEC-4C multispectral camera, a Micasense RedEdge-M multispectral camera, and an Alpha Series AL3-32 Light Detection and Ranging (LiDAR) sensor onboard three different UAV platforms) were conducted above three long-term experimental plots with different tillage treatments in 2018. We investigated the performances of the multi-source UAV-based 3D point clouds at multi-spatial scales using the traditional multi-variable linear regression model (OLS), random forest (RF), backpropagation neural network (BP), and support vector machine (SVM) methods for accurate AGB estimation. Results showed that crop height (CH) was a robust proxy for AGB estimation, and that high spatial resolution in CH datasets helps to improve maize AGB estimation. Furthermore, the OLS, RF, BP, and SVM methods all maintained an acceptable accuracy for AGB estimation; however, the SVM and RF methods performed slightly more robustly. This study is expected to optimize UAV systems and algorithms for specific agronomic applications.

UAV-Based 3D Spectrum Sensing in Spectrum-Heterogeneous Networks

In cognitive radio networks, collaborative spectrum sensing has been recognized as a key technology to enable secondary users (SUs) to detect spectrum holes and opportunistically access primary licensed spectrum band without harmful interference. Most of the existing studies focus on 1D or 2D spectrum opportunity detection and explicitly or implicitly assume that all SUs share the same spectrum opportunity. In this paper, we first investigate the issue of joint spatial-temporal spectrum sensing in 3D spectrum-heterogeneous space by leveraging the location flexibility of flying unmanned aerial vehicle (UAV) spectrum sensors. We divide the sensing space into three layers: black layer, grey layer, and white layer, which represent different spatial spectrum access opportunities. Then, we formulate the 3D spatial-temporal opportunity sensing model and derive the spatial-temporal false alarm and detection probabilities at both single UAV level and whole network level. Afterwards, we design a temporal fusion window and a spatial fusion sphere to address the composite spatial-temporal data fusion, called 3D spatial-temporal sensing (3DSTS). A comparison among 3DSTS, the benchmark 3D non-cooperative sensing (3DNCS) and 3D cooperative sensing (3DCS) shows the inefficiency of the traditional sensing schemes in the 3D spectrum-heterogeneous networks. Furthermore, we develop three improved versions of 3DSTS, which show much better detection performance. To maximize the utilization of spectrum resource and minimize the interference to the PU, a sensing-based power control scheme is also proposed. Finally, numerical simulations corresponding to the theoretical analysis are demonstrated.

Winter Wheat Canopy Height Extraction from UAV-Based Point Cloud Data with a Moving Cuboid Filter

Plant height can be used as an indicator to estimate crop phenology and biomass. The Unmanned Aerial Vehicle (UAV)-based point cloud data derived from photogrammetry methods contains the structural information of crops which could be used to retrieve crop height. However, removing noise and outliers from the UAV-based crop point cloud data for height extraction is challenging. The objective of this paper is to develop an alternative method for canopy height determination from UAV-based 3D point cloud datasets using a statistical analysis method and a moving cuboid filter to remove outliers. In this method, first, the point cloud data is divided into many 3D columns. Secondly, a moving cuboid filter is applied in each column and moved downward to eliminate noise points. The threshold of point numbers in the filter is calculated based on the distribution of points in the column. After applying the moving cuboid filter, the crop height is calculated from the highest and lowest points in each 3D column. The proposed method achieved high accuracy for height extraction with low Root Mean Square Error (RMSE) of 6.37 cm and Mean Absolute Error (MAE) of 5.07 cm. The canopy height monitoring window for winter wheat using this method starts from the beginning of the stem extension stage to the end of the heading stage (BBCH 31 to 65). Since the height of wheat has limited change after the heading stage, this method could be used to retrieve the crop height of winter wheat. In addition, this method only requires one operation of UAV in the field. It could be an effective method that can be widely used to help end-user to monitor their crops and support real-time decision making for farm management.

Streambank topography: an accuracy assessment of UAV-based and traditional 3D reconstructions

ABSTRACT Highly accurate digital surface models are an essential part of change-over-time analyses for monitoring erosion processes. Streambank topography presents a unique challenge for surface mapping due to dense riparian vegetation, canopy cover, and rapidly changing elevation values. The spatial heterogeneity of stream corridors has made the calculation of streambank erosion across larger spatial extents difficult. Contemporary technologies such as terrestrial laser scanners (TLS) and unmanned aerial vehicles (UAVs) offer new approaches for streambank topography mapping at very high spatial resolutions across varying spatial extents. To evaluate the accuracy of different technologies for streambank topography mapping, we compared streambank surface models derived via a UAV using structure-from-motion and from traditional aerial photogrammetry (i.e. Southwestern Ontario Orthoimagery Project; SWOOP) to that of a TLS benchmark across seven streambank segments. Additional comparisons were made for 22 manually measured stream transects to that of a TLS benchmark. Compared to our benchmark, the UAV-derived streambank surface model was the most accurate with an average root-mean-square-error of 0.104 m. Errors in the UAV surface model were correlated with georeferencing error. The UAV had an average 52% success rate for reconstructing the streambank topography across all field campaigns and was able to map up to 2037 m of streambank in one hour. The streambank surface model derived from traditional aerial photogrammetry and manual transect measurements had average root-mean-square-errors of 0.238 m and 0.274 m respectively. Both aerially-derived surface models tended to over measure elevation values compared to the TLS, whereas manual transect measurements consistently under measured elevation.

UAV-Based 3D Point Clouds of Freshwater Fish Habitats, Xingu River Basin, Brazil

Dense 3D point clouds were generated from Structure-from-Motion Multiview Stereo (SFM-MVS) photogrammetry for five representative freshwater fish habitats in the Xingu river basin, Brazil. The models were constructed from Unmanned Aerial Vehicle (UAV) photographs collected in 2016 and 2017. The Xingu River is one of the primary tributaries of the Amazon River. It is known for its exceptionally high aquatic biodiversity. The dense 3D point clouds were generated in the dry season when large areas of aquatic substrate are exposed due to the low water level. The point clouds were generated at ground sampling distances of 1.20–2.38 cm. These data are useful for studying the habitat characteristics and complexity of several fish species in a spatially explicit manner, such as calculation of metrics including rugosity and the Minkowski–Bouligand fractal dimension (3D complexity). From these dense 3D point clouds, substrate complexity can be determined more comprehensively than from conventional arbitrary cross sections.

Point cloud filtering on UAV based point cloud

Nowadays, Unmanned Aerial Vehicles (UAVs) have been attracted wide attentions such as a new measurement equipment and mapping, which are capable of the high-resolution point cloud data collection. In addition, a massive point cloud data has brought about the data filtering and irregular data organization for the generation of digital terrain models. Filtering of point clouds contains vegetations and artificial objects play a crucial role for bare earth terrain modelling. Topographical maps rely on the data structures which are built on bare ground terrain points. The bare earth surface extraction is not the only crucial to the topographical maps but also decision-making processes such as natural hazards management, deformation analysis and interpretation.In order to filter a UAV-based 3D raw point cloud data, in this paper, filtering performance of four different algorithms using open source and commercial software’s have been investigated, (1) curvature based (Multiscale Curvature Classification-MCC), (2) surface-based filtering (FUSION), (3) progressive TIN based (LasTool-LasGround module-commercial) and (4) physical simulation processing (Cloth Simulation Filtering-CSF). The applied filtering results were validated with the reference data set classified by operator. Although different filtering methodologies implemented on point clouds, these methods demonstrated similar results to extract ground on distinctive terrain feature such as dense vegetated, flat surface, rough and complex landscapes. The filtering algorithms’ results revealed that UAV-generated data suitable for extraction of bare earth surface feature on the different type of a terrain. Accuracy of the filtered point cloud reached the 93% true classification on flat surfaces from CSF filtering method.

ULTRA-HIGH PRECISION UAV-BASED LIDAR AND DENSE IMAGE MATCHING

Abstract. This paper presents a study on the potential of ultra-high accurate UAV-based 3D data capture. It is motivated by a project aiming at the deformation monitoring of a ship lock and its surrounding. This study is part of a research and development project initiated by the German Federal Institute of Hydrology (BfG) in Koblenz in partnership with the Office of Development of Neckar River Heidelberg (ANH). For this first official presentation of the project, data from the first flight campaign will be analysed and presented. Despite the fact that monitoring aspects cannot be discussed before data from additional flight campaigns will be available later this year, our results from the first campaign highlight the potential of high-end UAV-based image and LiDAR sensors and their data fusion. So far, only techniques from engineering geodesy could fulfil the aspired accuracy demands in the range of millimetres. To the knowledge of the authors, this paper for the first time addresses such ultra-high accuracy applications by combing high precision UAV-based LiDAR and dense image matching. As the paper is written at an early stage of processing only preliminary results can be given here.

Quantifying pruning impacts on olive tree architecture and annual canopy growth by using UAV-based 3D modelling

BackgroundTree pruning is a costly practice with important implications for crop harvest and nutrition, pest and disease control, soil protection and irrigation strategies. Investigations on tree pruning usually involve tedious on-ground measurements of the primary tree crown dimensions, which also might generate inconsistent results due to the irregular geometry of the trees. As an alternative to intensive field-work, this study shows a innovative procedure based on combining unmanned aerial vehicle (UAV) technology and advanced object-based image analysis (OBIA) methodology for multi-temporal three-dimensional (3D) monitoring of hundreds of olive trees that were pruned with three different strategies (traditional, adapted and mechanical pruning). The UAV images were collected before pruning, after pruning and a year after pruning, and the impacts of each pruning treatment on the projected canopy area, tree height and crown volume of every tree were quantified and analyzed over time.ResultsThe full procedure described here automatically identified every olive tree on the orchard and computed their primary 3D dimensions on the three study dates with high accuracy in the most cases. Adapted pruning was generally the most aggressive treatment in terms of the area and volume (the trees decreased by 38.95 and 42.05% on average, respectively), followed by trees under traditional pruning (33.02 and 35.72% on average, respectively). Regarding the tree heights, mechanical pruning produced a greater decrease (12.15%), and these values were minimal for the other two treatments. The tree growth over one year was affected by the pruning severity and by the type of pruning treatment, i.e., the adapted-pruning trees experienced higher growth than the trees from the other two treatments when pruning intensity was low (<10%), similar to the traditionally pruned trees at moderate intensity (10–30%), and lower than the other trees when the pruning intensity was higher than 30% of the crown volume.ConclusionsCombining UAV-based images and an OBIA procedure allowed measuring tree dimensions and quantifying the impacts of three different pruning treatments on hundreds of trees with minimal field work. Tree foliage losses and annual canopy growth showed different trends as affected by the type and severity of the pruning treatments. Additionally, this technology offers valuable geo-spatial information for designing site-specific crop management strategies in the context of precision agriculture, with the consequent economic and environmental benefits.Graphical

UAV-based LiDAR acquisition for the derivation of high-resolution forest and ground information

Laser scanning of forested areas helps in analyzing and understanding various aspects of forest conditions, including distribution of plants and trees, height distribution of trees, tree density, size and volume of wood, as well as ground surface properties. However, laser scanning of forest areas is also very challenging for many reasons. The best time for scanning is before trees leaf out in the spring or after trees cast their leaves in autumn before snowfall so an unmanned aerial vehicle (UAV) laser scanner can penetrate the forest from the tops of the trees down to the ground surface. To receive highly accurate laser data and high point density, the flight planning must be adjusted judiciously. Flight planning will be even more complex in steep terrain where the UAV cannot operate at a constant altitude. This paper discusses a UAV-based 3D laser data recording — light detection and ranging (LiDAR) scanning — of a forestry area with high accuracy and point cloud resolution. In addition, the point cloud of airborne laser scanning is compared with local terrestrial laser-scanning results. The forest area consists of mixed forests containing varying tree sizes and branch deformation. This paper summarizes our latest results in UAV-based LiDAR acquisition over a forest area to extract detailed forest and ground information and finds that UAV-based laser scanning is well suited for provision of both high-quality forest structural and terrain elevation information.

Potential Benefits of Combining Anomaly Detection with View Planning for UAV Infrastructure Modeling

This paper presents a novel method for UAV-based 3D modeling of large infrastructure objects, such as pipelines, canals and levees, that combines anomaly detection with automatic on-board 3D view planning. The study begins by assuming that anomaly detections are possible and focuses on quantifying the potential benefits of the combined method and the view planning algorithm. A simulated canal environment is constructed, and several simulated anomalies are created and marked. The algorithm is used to plan inspection flights for the anomaly locations, and simulated images from the flights are rendered and processed to construct 3D models of the locations of interest. The new flights are compared to traditional flights in terms of flight time, data collected and 3D model accuracy. When compared to a low speed, low elevation traditional flight, the proposed method is shown in simulation to decrease total flight time by up to 55%, while reducing the amount of image data to be processed by 89% and maintaining 3D model accuracy at areas of interest.

Performance Evaluation of Alternative Relative Orientation Procedures for UAV-based Imagery with Prior Flight Trajectory Information

Abstract. Thanks to recent advances at the hardware (e.g., emergence of reliable platforms at low cost) and software (e.g., automated identification of conjugate points in overlapping images) levels, UAV-based 3D reconstruction has been widely used in various applications. However, mitigating the impact of outliers in automatically matched points in UAV imagery, especially when dealing with scenes that has poor and/or repetitive texture, remains to be a challenging task. In spite of the fact that existing literature has already demonstrated that incorporating prior motion information can play an important role in increasing the reliability of the matching process, there is a lack of methodologies that are mainly suited for UAV imagery. Assuming the availability of prior information regarding the trajectory of a UAV-platform, this paper presents a two-point approach for reliable estimation of Relative Orientation Parameters (ROPs) of UAV-based images. This approach is based on the assumption that the UAV platform is moving at a constant flying height while maintaining the camera in a nadir-looking orientation. For this flight scenario, a closed-form solution that can be derived using a minimum of two pairs of conjugate points is established. In order to evaluate the performance of the proposed approach, experimental tests using real stereo-pairs acquired from different UAV platforms have been conducted. The derived results from the comparative performance analysis against the Nistér five-point approach demonstrate that the proposed two-point approach is capable of providing reliable estimate of the ROPs from UAV-based imagery in the presence of poor and/or repetitive texture with high percentage of matching outliers.

Performance Evaluation of Alternative Relative Orientation Procedures for UAV-based Imagery with Prior Flight Trajectory Information

Thanks to recent advances at the hardware (e.g., emergence of reliable platforms at low cost) and software (e.g., automated identification of conjugate points in overlapping images) levels, UAV-based 3D reconstruction has been widely used in various applications. However, mitigating the impact of outliers in automatically matched points in UAV imagery, especially when dealing with scenes that has poor and/or repetitive texture, remains to be a challenging task. In spite of the fact that existing literature has already demonstrated that incorporating prior motion information can play an important role in increasing the reliability of the matching process, there is a lack of methodologies that are mainly suited for UAV imagery. Assuming the availability of prior information regarding the trajectory of a UAV-platform, this paper presents a two-point approach for reliable estimation of Relative Orientation Parameters (ROPs) of UAV-based images. This approach is based on the assumption that the UAV platform is moving at a constant flying height while maintaining the camera in a nadir-looking orientation. For this flight scenario, a closed-form solution that can be derived using a minimum of two pairs of conjugate points is established. In order to evaluate the performance of the proposed approach, experimental tests using real stereo-pairs acquired from different UAV platforms have been conducted. The derived results from the comparative performance analysis against the Nistér five-point approach demonstrate that the proposed two-point approach is capable of providing reliable estimate of the ROPs from UAV-based imagery in the presence of poor and/or repetitive texture with high percentage of matching outliers.