Unmanned Aerial Vehicle Remote Sensing Research Articles

Forecasting of Hypoallergenic Wheat Productivity Based on Unmanned Aerial Vehicles Remote Sensing Approach—Case Study

Remote sensing methods based on UAV and hand-held devices as well have been used to assess the response to nitrogen and sulfur fertilization of hypoallergenic genotypes of winter wheat. The field experiment was conducted using the split-split-plot design with three repetitions. The first factor was the two genotypes of winter wheat specified as V1 (without allergic protein) and V2 (with allergic protein), and the second factor was three doses of sulfur fertilization: 0, 20 and 40 kg S per ha. The third factor consisted of six doses of nitrogen fertilization: 0, 40, 60, 80, 100 and 120 kg N·ha−1. Monitoring the values of the indicators depending on the level of nitrogen and sulfur fertilization allowed the results to be used in yield forecasting, assessment of plant condition, LAI value, nutritional status in the cultivation of wheat. The maximum yield should be expected at doses of 94 and 101 kg N ha−1 for genotypes V1 and V2, respectively, giving yields of 5.39 and 4.71 Mg ha−1. On the basis of the tested vegetation indices, the highest doses of N should be applied using the normalized difference RedEdge (NDRE), and the lowest ones based on the enhanced vegetation index (EVI), and, in the latter case, a reduction in yield of more than 200 kg ha−1 in the V2 genotype should be taken into account.

Monitoring Spatial and Time-Series Variations in Red Crown Rot Damage of Soybean in Farmer Fields Based on UAV Remote Sensing

ABSTRACT Red crown rot (RCR) is a soil-borne disease that damages soybean growth and decreases yield. Infected plants show earlier defoliation and pencil-like roots, sometimes resulting in mortality. This disease became common relatively recently, and information about its field-scale appearance is insufficient. Insufficient data is a major constraint when planning countermeasures. In this study, unmanned aerial vehicle (UAV)-acquired images were used to visualize the spatial and time series variation in the area damaged by RCR in the same farmer fields in 2018 and 2020. Field investigation showed that RCR severely damaged soybean production. The reductions of yield were estimated at 17.5 % and 12.7 % in 2018 and 2020, respectively. The visualized damage clarified the difference in the increasing rate and patterns of RCR between the two years. In 2018, the damaged area expanded along the planting row to the whole field, but in 2020, the expansion along the planting row was not great, and half of the fields remained sparsely damage. This difference implies that various factors are associated with damage occurrence and pathogen distribution. The method applied in this study is effective in visualizing RCR damage, but further improvement is required in the evaluation of intermediate damage and the generalization of the evaluation procedure.

Monitoring of Soybean Maturity Using UAV Remote Sensing and Deep Learning

Soybean breeders must develop early-maturing, standard, and late-maturing varieties for planting at different latitudes to ensure that soybean plants fully utilize solar radiation. Therefore, timely monitoring of soybean breeding line maturity is crucial for soybean harvesting management and yield measurement. Currently, the widely used deep learning models focus more on extracting deep image features, whereas shallow image feature information is ignored. In this study, we designed a new convolutional neural network (CNN) architecture, called DS-SoybeanNet, to improve the performance of unmanned aerial vehicle (UAV)-based soybean maturity information monitoring. DS-SoybeanNet can extract and utilize both shallow and deep image features. We used a high-definition digital camera on board a UAV to collect high-definition soybean canopy digital images. A total of 2662 soybean canopy digital images were obtained from two soybean breeding fields (fields F1 and F2). We compared the soybean maturity classification accuracies of (i) conventional machine learning methods (support vector machine (SVM) and random forest (RF)), (ii) current deep learning methods (InceptionResNetV2, MobileNetV2, and ResNet50), and (iii) our proposed DS-SoybeanNet method. Our results show the following: (1) The conventional machine learning methods (SVM and RF) had faster calculation times than the deep learning methods (InceptionResNetV2, MobileNetV2, and ResNet50) and our proposed DS-SoybeanNet method. For example, the computation speed of RF was 0.03 s per 1000 images. However, the conventional machine learning methods had lower overall accuracies (field F2: 63.37–65.38%) than the proposed DS-SoybeanNet (Field F2: 86.26%). (2) The performances of the current deep learning and conventional machine learning methods notably decreased when tested on a new dataset. For example, the overall accuracies of MobileNetV2 for fields F1 and F2 were 97.52% and 52.75%, respectively. (3) The proposed DS-SoybeanNet model can provide high-performance soybean maturity classification results. It showed a computation speed of 11.770 s per 1000 images and overall accuracies for fields F1 and F2 of 99.19% and 86.26%, respectively.

A Defect Detection Method Based on BC-YOLO for Transmission Line Components in UAV Remote Sensing Images

Vibration dampers and insulators are important components of transmission lines, and it is therefore important for the normal operation of transmission lines to detect defects in these components in a timely manner. In this paper, we provide an automatic detection method for component defects through patrolling inspection by an unmanned aerial vehicle (UAV). We constructed a dataset of vibration dampers and insulators (DVDI) on transmission lines in images obtained by the UAV. It is difficult to detect defects in vibration dampers and insulators from UAV images, as these components and their defective parts are very small parts of the images, and the components vary greatly in terms of their shape and color and are easily confused with the background. In view of this, we use the end-to-end coordinate attention and bidirectional feature pyramid network “you only look once” (BC-YOLO) to detect component defects. To make the network focus on the features of vibration dampers and insulators rather than the complex backgrounds, we added the coordinate attention (CA) module to YOLOv5. CA encodes each channel separately along the vertical and horizontal directions, which allows the attention module to simultaneously capture remote spatial interactions with precise location information and helps the network locate targets of interest more accurately. In the multiscale feature fusion stage, different input features have different resolutions, and their contributions to the fused output features are usually unequal. However, PANet treats each input feature equally and simply sums them up without distinction. In this paper, we replace the original PANet feature fusion framework in YOLOv5 with a bidirectional feature pyramid network (BiFPN). BiFPN introduces learnable weights to learn the importance of different features, which can make the network focus more on the feature mapping that contributes more to the output features. To verify the effectiveness of our method, we conducted a test in DVDI, and its mAP@0.5 reached 89.1%, a value 2.7% higher than for YOLOv5.

UAV Remote Sensing Prediction Method of Winter Wheat Yield Based on the Fused Features of Crop and Soil

The early and accurate acquisition of crop yields is of great significance for maintaining food market stability and ensuring global food security. Unmanned aerial vehicle (UAV) remote sensing offers the possibility of predicting crop yields with its advantages of flexibility and high resolution. However, most of the existing remote sensing yield estimation studies focused solely on crops but did not fully consider the influence of soil on yield formation. As an integrated system, the status of crop and soil together determines the final yield. Compared to crop-only yield prediction, the approach that additionally considers soil background information will effectively improve the accuracy and reduce bias in the results. In this study, a novel method for segmenting crop and soil spectral images based on different vegetation coverage is first proposed, in which pixels of crop and soil can be accurately identified by determining the discriminant value Q. On the basis of extracting crop and soil waveband’s information by individual pixel, an innovative approach, projected non-negative matrix factorization based on good point set and matrix cross fusion (PNMF-MCF), was developed to effectively extract and fuse the yield-related features of crop and soil. The experimental results on winter wheat show that the proposed segmentation method can accurately distinguish crop and soil pixels under complex soil background of four different growth periods. Compared with the single reflectance of crop or soil and the simple combination of crop and soil reflectance, the fused yield features spectral matrix FP obtained with PNMF−MCF achieved the best performance in yield prediction at the flowering, flag leaf and pustulation stages, with R2 higher than 0.7 in these three stages. Especially at the flowering stage, the yield prediction model based on PNMF-MCF had the highest R2 with 0.8516 and the lowest RMSE with 0.0744 kg/m2. Correlation analysis with key biochemical parameters (nitrogen and carbon, pigments and biomass) of yield formation showed that the flowering stage was the most vigorous season for photosynthesis and the most critical stage for yield prediction. This study provides a new perspective and complete framework for high-precision crop yield forecasting using UAV remote sensing technology.

Multispectral remote sensing for accurate acquisition of rice phenotypes: Impacts of radiometric calibration and unmanned aerial vehicle flying altitudes.

As a promising method, unmanned aerial vehicle (UAV) multispectral remote sensing (RS) has been extensively studied in precision agriculture. However, there are numerous problems to be solved in the data acquisition and processing, which limit its application. In this study, the Micro-MCA12 camera was used to obtain images at different altitudes. The piecewise empirical line (PEL) method suitable for predicting the reflectance of different ground objects was proposed to accurately acquire the reflectance of multi-altitude images by comparing the performance of the conventional methods. Several commonly utilized vegetation indices (VIs) were computed to estimate the rice growth parameters and yield. Then the rice growth monitoring and yield prediction were implemented to verify and evaluate the effects of radiometric calibration methods (RCMs) and UAV flying altitudes (UAV-FAs). The results show that the variation trends of reflectance and VIs are significantly different due to the change in component proportion observed at different altitudes. Except for the milking stage, the reflectance and VIs in other periods fluctuated greatly in the first 100 m and remained stable thereafter. This phenomenon was determined by the field of view of the sensor and the characteristic of the ground object. The selection of an appropriate calibration method was essential as a result of the marked differences in the rice phenotypes estimation accuracy based on different RCMs. There were pronounced differences in the accuracy of rice growth monitoring and yield estimation based on the 50 and 100 m-based variables, and the altitudes above 100 m had no notable effect on the results. This study can provide a reference for the application of UAV RS technology in precision agriculture and the accurate acquisition of crop phenotypes.

UAV Remote Sensing for High-Throughput Phenotyping and for Yield Prediction of Miscanthus by Machine Learning Techniques

Miscanthus holds a great potential in the frame of the bioeconomy, and yield prediction can help improve Miscanthus’ logistic supply chain. Breeding programs in several countries are attempting to produce high-yielding Miscanthus hybrids better adapted to different climates and end-uses. Multispectral images acquired from unmanned aerial vehicles (UAVs) in Italy and in the UK in 2021 and 2022 were used to investigate the feasibility of high-throughput phenotyping (HTP) of novel Miscanthus hybrids for yield prediction and crop traits estimation. An intercalibration procedure was performed using simulated data from the PROSAIL model to link vegetation indices (VIs) derived from two different multispectral sensors. The random forest algorithm estimated with good accuracy yield traits (light interception, plant height, green leaf biomass, and standing biomass) using 15 VIs time series, and predicted yield using peak descriptors derived from these VIs time series with root mean square error of 2.3 Mg DM ha−1. The study demonstrates the potential of UAVs’ multispectral images in HTP applications and in yield prediction, providing important information needed to increase sustainable biomass production.

Application of UAV Remote Sensing in Monitoring Water Use Efficiency and Biomass of Cotton Plants Adjacent to Shelterbelt.

Tree shelterbelts are crucial for maintaining the ecological environment of oasis, but they may also compete for soil water with adjacent crops, affecting crop yields. To evaluate the impacts of the shelterbelt on water use efficiency (WUE) and normalized water productivity (WP) of adjacent cotton plants, the biomass (B) and WUE of cotton with different distances from the shelterbelt (0.1H, 0.5H, 1H, 2H, and 3H; average tree height = 15 m [H]) were estimated based on unmanned aerial vehicle (UAV) remote sensing data combined with the FAO crop water response model AquaCrop. Besides, the accuracy and universality of the estimation method were also evaluated. The results showed that the method based on UAV remote sensing data and AquaCrop can accurately estimate the impact range and intensity of shelterbelt on WUE, water consumption, and B of adjacent cotton plants. Fierce water competition between shelterbelt and cotton was detected within 0.1H−1H, and the competitiveness of the shelterbelt was weaker in the plots >1H than in the 0.1H−1H. The B, actual evapotranspiration (Tc), and WUE of cotton at 0.1H decreased by 59.3, 48.8, and 23.6%, respectively, compared with those at 3H, but the cotton plants at 2H and 3H were completely unaffected by the shelterbelt. Besides, the B estimated based on WP (root mean square error [RMSE] = 108 g/m2, d = 0.89) was more accurate than that estimated based on WUE (RMSE = 118 g/m2, d = 0.85). This study clarifies the inter-species competition for soil water between crops and shelterbelts under drip irrigation in oases in China.

UAV Remote Sensing for Detecting within-Field Spatial Variation of Winter Wheat Growth and Links to Soil Properties and Historical Management Practices. A Case Study on Belgian Loamy Soil

Intra-field heterogeneity of soil properties, such as soil organic carbon (SOC), nitrogen (N), phosphorous (P), exchangeable cations, pH, or soil texture, is a function of complex interactions between biological factors, physical factors, and historic agricultural management. Mapping the crop growth and final yield heterogeneity and quantifying their link with soil properties can contribute to an optimization of amendment/fertilizer application and crop yield in a management variable zones (MVZ) approach. To this end, we studied a field of 17 ha consisting of four former fields that were merged in early 2017 and cropped with winter wheat in 2018. Historical management practices data were collected. The topsoil characteristics were analyzed by grid-based sampling and kriged to create maps. We tested the capacity of a multispectral MicaSense® RedEdge-MTM camera sensor embedded on an unmanned aerial vehicle (UAV) to map in-season growth of winter wheat. Relating several vegetation indices (VIs) to the plant area index (PAI) measured in the field highlighted the red-edge NDVI (RENDVI) as the most suitable to follow the crop growth throughout the growing season. The georeferenced final grain yield of the winter wheat was measured by a combine harvester. The spatial patterns in RENDVI at three phenological stages were mapped and analyzed together with the yield map. For each of these images a conditional inference forest (CI-forest) algorithm was used to identify the soil properties significantly influencing these spatial patterns. Historical management practices of the four former fields have induced significant heterogeneity in soil properties and crop growth. The spatial patterns of RENDVI are rather constant over time and their Spearman rank correlation with yield is similar along the growing season (r ≃ 0.7). Soil properties explain between 87% (mid-March) to 78% (mid-May) of the variance in RENDVI throughout the growing season, as well as 66% of the variance in yield. The pH and exchangeable K are the most significant factors explaining from 15 to 26% of the variance in crop growth. The methodology proposed in this paper to quantify the importance of soil parameters based on the CI-forest algorithm can contribute to a better management of amendment/fertilizer inputs by stressing the most important parameters to take into consideration for site-specific management. We also showed that heterogeneity induced by the soil properties can be described by a crop map early in the season and that this crop map can be used to optimize soil sampling and thus amendment/fertilizer management.

Intelligent Identification Method of Crop Species Using Improved U-Net Network in UAV Remote Sensing Image

Aiming at the problems of incomplete classification features extraction of remote sensing images and low accuracy of crop classification in existing crop classification and recognition methods, a crop classification and recognition method using improved U-Net in Unmanned Aerial Vehicle (UAV) remote sensing images is proposed. First, the experimental data set is preprocessed. The data set is expanded by flipping transformation, translation transformation, and random cutting, which expands the number of data sets, and then the original image is cut to meet the requirements of the experiment for image size; Moreover, the network structure of U-Net is deepened, and the atrous spatial pyramid pooling (ASPP) structure is introduced after the encoder to better understand the semantic information and improve the ability of model mining data features; Finally, in order to prevent the overfitting of the deepened model, the dropout layer is introduced to weaken the joint adaptability between various neurons. Experiments show that the comprehensive OA and Kappa indexes of the proposed crop classification and recognition method based on improved U-Net are 92.14% and 0.896, respectively, which are better than the comparison methods. Therefore, the proposed method has good ability of crop classification and recognition.

The Optimal Phenological Phase of Maize for Yield Prediction with High-Frequency UAV Remote Sensing

Unmanned aerial vehicle (UAV)-based multispectral remote sensing effectively monitors agro-ecosystem functioning and predicts crop yield. However, the timing of the remote sensing field campaigns can profoundly impact the accuracy of yield predictions. Little is known on the effects of phenological phases on skills of high-frequency sensing observations used to predict maize yield. It is also unclear how much improvement can be gained using multi-temporal compared to mono-temporal data. We used a systematic scheme to address those gaps employing UAV multispectral observations at nine development stages of maize (from second-leaf to maturity). Next, the spectral and texture indices calculated from the mono-temporal and multi-temporal UAV images were fed into the Random Forest model for yield prediction. Our results indicated that multi-temporal UAV data could remarkably enhance the yield prediction accuracy compared with mono-temporal UAV data (R2 increased by 8.1% and RMSE decreased by 27.4%). For single temporal UAV observation, the fourteenth-leaf stage was the earliest suitable time and the milking stage was the optimal observing time to estimate grain yield. For multi-temporal UAV data, the combination of tasseling, silking, milking, and dough stages exhibited the highest yield prediction accuracy (R2 = 0.93, RMSE = 0.77 t·ha−1). Furthermore, we found that the Normalized Difference Red Edge Index (NDRE), Green Normalized Difference Vegetation Index (GNDVI), and dissimilarity of the near-infrared image at milking stage were the most promising feature variables for maize yield prediction.

Object-Based Attention Mechanism for Color Calibration of UAV Remote Sensing Images in Precision Agriculture

Color calibration is a critical step for Unmanned Aerial Vehicles (UAV) remote sensing, especially in precision agriculture, which relies mainly on correlating color changes to specific quality attributes, e.g., plant health, disease, and pest stresses. In UAV remote sensing, the exemplar-based color transfer is popularly used for color calibration, where the automatic search for the semantic correspondences is the key to ensuring the color transfer accuracy. However, the existing attention mechanisms encounter difficulties in building the precise semantic correspondences between the reference image and the target one, in which the normalized cross correlation is often computed for feature reassembling. As a result, the color transfer accuracy is inevitably decreased by the disturbance from the semantically unrelated pixels, leading to semantic mismatch due to the absence of semantic correspondences. In this paper, we proposed an unsupervised object-based attention mechanism (OBAM) to suppress the disturbance of the semantically unrelated pixels, along with a further introduced weight-adjusted AdaIN (WAA) method to tackle the challenges caused by the absence of semantic correspondences. By embedding the proposed modules into a photorealistic style transfer method with progressive stylization, the color transfer accuracy can be improved while better preserving the structural details. We evaluated our approach on the UAV data of different crop types including rice, beans, and cotton. Extensive experiments demonstrate that our proposed method outperforms several state-of-the-art methods. As our approach requires no annotated labels, it can be easily embedded into the off-the-shelf color transfer approaches. Relevant codes and configurations will be available at http://github.com/huanghsheng/object-based-attention-mechanism.

UAV Remote Sensing Image Dehazing Based on Double-Scale Transmission Optimization Strategy

Current dehazing methods for unmanned aerial vehicle (UAV) remote sensing images often have texture detail loss and color distortion problems, especially in highlighted regions. This is mainly due to the rich texture and low intensity of UAV remote sensing images being ignored, which results in incorrect transmission estimation. In this paper, we propose a UAV remote sensing image dehazing method based on double-scale transmission optimization strategy. First, we propose a double-scale optimization strategy to estimate the transmission map with more accurate texture details and color preservation, especially in highlighted regions of hazy UAV images that are most severely distorted. Second, a UAV-adaptive haze-line prior algorithm is proposed to address the large scene depth and low intensity of UAV remote sensing images. Finally, we introduce a luminance-weighted frequency domain saliency model to avoid texture detail loss and color distortions for better transmission optimization, especially in highlighted regions. Compared with state-of-the-art methods, our method shows better detail performance and visual effects, especially for UAV images with highlighted regions.

Identification of High Nitrogen Use Efficiency Phenotype in Rice (Oryza sativa L.) Through Entire Growth Duration by Unmanned Aerial Vehicle Multispectral Imagery.

Identification of high Nitrogen Use Efficiency (NUE) phenotypes has been a long-standing challenge in breeding rice and sustainable agriculture to reduce the costs of nitrogen (N) fertilizers. There are two main challenges: (1) high NUE genetic sources are biologically scarce and (2) on the technical side, few easy, non-destructive, and reliable methodologies are available to evaluate plant N variations through the entire growth duration (GD). To overcome the challenges, we captured a unique higher NUE phenotype in rice as a dynamic time-series N variation curve through the entire GD analysis by canopy reflectance data collected by Unmanned Aerial Vehicle Remote Sensing Platform (UAV-RSP) for the first time. LY9348 was a high NUE rice variety with high Nitrogen Uptake Efficiency (NUpE) and high Nitrogen Utilization Efficiency (NUtE) shown in nitrogen dosage field analysis. Its canopy nitrogen content (CNC) was analyzed by the high-throughput UAV-RSP to screen two mixed categories (51 versus 42 varieties) selected from representative higher NUE indica rice collections. Five Vegetation Indices (VIs) were compared, and the Normalized Difference Red Edge Index (NDRE) showed the highest correlation with CNC (r = 0.80). Six key developmental stages of rice varieties were compared from transplantation to maturation, and the high NUE phenotype of LY9348 was shown as a dynamic N accumulation curve, where it was moderately high during the vegetative developmental stages but considerably higher in the reproductive developmental stages with a slower reduction rate. CNC curves of different rice varieties were analyzed to construct two non-linear regression models between N% or N% × leaf area index (LAI) with NDRE separately. Both models could determine the specific phenotype with the coefficient of determination (R2) above 0.61 (Model I) and 0.86 (Model II). Parameters influencing the correlation accuracy between NDRE and N% were found to be better by removing the tillering stage data, separating the short and long GD varieties for the analysis and adding canopy structures, such as LAI, into consideration. The high NUE phenotype of LY9348 could be traced and reidentified across different years, locations, and genetic germplasm groups. Therefore, an effective and reliable high-throughput method was proposed for assisting the selection of the high NUE breeding phenotype.

Quick Detection of Field-Scale Soil Comprehensive Attributes via the Integration of UAV and Sentinel-2B Remote Sensing Data

Satellite and unmanned aerial vehicle (UAV) remote sensing can be used to estimate soil properties; however, little is known regarding the effects of UAV and satellite remote sensing data integration on the estimation of soil comprehensive attributes, or how to estimate quickly and robustly. In this study, we tackled those gaps by employing UAV multispectral and Sentinel-2B data to estimate soil salinity and chemical properties over a large agricultural farm (400 ha) covered by different crops and harvest areas at the coastal saline-alkali land of the Yellow River Delta of China in 2019. Spatial information of soil salinity, organic matter, available/total nitrogen content, and pH at 0–10 cm and 10–20 cm layers were obtained via ground sampling (n = 195) and two-dimensional spatial interpolation, aiming to overlap the soil information with remote sensing information. The exploratory factor analysis was conducted to generate latent variables, which represented the salinity and chemical characteristics of the soil. A machine learning algorithm (random forest) was applied to estimate soil attributes. Our results indicated that the integration of UAV texture and Sentinel-2B spectral data as random forest model inputs improved the accuracy of latent soil variable estimation. The remote sensing-based information from cropland (crop-based) had a higher accuracy compared to estimations performed on bare soil (soil-based). Therefore, the crop-based approach, along with the integration of UAV texture and Sentinel-2B data, is recommended for the quick assessment of soil comprehensive attributes.

Detection of Abnormal Vibration Dampers on Transmission Lines in UAV Remote Sensing Images with PMA-YOLO

The accurate detection and timely replacement of abnormal vibration dampers on transmission lines are critical for the safe and stable operation of power systems. Recently, unmanned aerial vehicles (UAVs) have become widely used to inspect transmission lines. In this paper, we constructed a data set of abnormal vibration dampers (DAVDs) on transmission lines in images obtained by UAVs. There are four types of vibration dampers in this data set, and each vibration damper may be rusty, defective, or normal. The challenges in the detection of abnormal vibration dampers on transmission lines in the images captured by UAVs were as following: the images had a high resolution as well as the objects of vibration dampers were relatively small and sparsely distributed, and the backgrounds of cross stage partial networks of the images were complex due to the fact that the transmission lines were erected in a variety of outdoor environments. Existing methods of ground-based object detection significantly reduced the accuracy when dealing with complex backgrounds and small objects of abnormal vibration dampers detection. To address these issues, we proposed an end-to-end parallel mixed attention You Only Look Once (PMA-YOLO) network to improve the detection performance for abnormal vibration dampers. The parallel mixed attention (PMA) module was introduced and integrated into the YOLOv4 network. This module combines a channel attention block and a spatial attention block, and the convolution results of the input feature maps in parallel, allowing the network to pay more attention to critical regions of abnormal vibration dampers in complex background images. Meanwhile, in view of the problem that abnormal vibration dampers are prone to missing detections, we analyzed the scale and ratio of the ground truth boxes and used the K-means algorithm to re-cluster new anchors for abnormal vibration dampers in images. In addition, we introduced a multi-stage transfer learning strategy to improve the efficiency of the original training method and prevent overfitting by the network. The experimental results showed that the mAP@0.5 for PMA-YOLO in the detection of abnormal vibration dampers reached 93.8% on the test set of DAVD, 3.5% higher than that of YOLOv4. When the multi-stage transfer learning strategy was used, the mAP@0.5 was improved by a further 0.2%.

Monitoring the Work Cycles of Earthmoving Excavators in Earthmoving Projects Using UAV Remote Sensing

Monitoring the work cycles of earthmoving excavators is an important aspect of construction productivity assessment. Currently, the most advanced method for the recognition of work cycles is the “Stretching-Bending” Sequential Pattern (SBSP), which is based on fixed-carrier video monitoring (FC-SBSP). However, the application of this method presupposes the availability of preconstructed installation carriers to act as a surveillance camera as well as installed and commissioned surveillance systems that work in tandem with them. Obviously, this method is difficult to apply to projects with no conditions for a monitoring camera installation or which have a short construction time. This highlights the potential application of Unmanned Aerial Vehicle (UAV) remote sensing, which is flexible and mobile. Unfortunately, few studies have been conducted on the application of UAV remote sensing for the work cycle monitoring of earthmoving excavators. This research is necessary because the use of UAV remote sensing for monitoring the work cycles of earthmoving excavators can improve construction productivity and save time and costs, especially in post-disaster reconstruction projects involving harsh construction environments, and emergency projects with short construction periods. In addition, the challenges posed by UAV shaking may have to be taken into account when using the SBSP for UAV remote sensing. To this end, this study used application experiments in which stabilization processing of UAV video data was performed for UAV shaking. The application experimental results show that the work cycle performance of UAV remote-sensing-based SBSP (UAV-SBSP) for UAV video data was 2.45% and 5.36% lower in terms of precision and recall, respectively, without stabilization processing than after stabilization processing. Comparative experiments were also designed to investigate the applicability of the SBSP oriented toward UAV remote sensing. Comparative experimental results show that the same level of performance was obtained for the recognition of work cycles with the UAV-SBSP as compared with the FC-SBSP, demonstrating the good applicability of this method. Therefore, the results of this study show that UAV remote sensing enables effective monitoring of earthmoving excavator work cycles in construction sites where monitoring cameras are not available for installation, and it can be used as an alternative technology to fixed-carrier video monitoring for onsite proximity monitoring.

Using Improved Edge Detection Method to Detect Mining-Induced Ground Fissures Identified by Unmanned Aerial Vehicle Remote Sensing

Information on the ground fissures induced by coal mining is important to the safety of coal mine production and the management of environment in the mining area. In order to identify these fissures timely and accurately, a new method was proposed in the present paper, which is based on an unmanned aerial vehicle (UAV) equipped with a visible light camera and an infrared camera. According to such equipment, edge detection technology was used to detect mining-induced ground fissures. Field experiments show high efficiency of the UAV in monitoring the mining-induced ground fissures. Furthermore, a reasonable time period between 3:00 am and 5:00 am under the studied conditions helps UAV infrared remote sensing identify fissures preferably. The Roberts operator, Sobel operator, Prewitt operator, Canny operator and Laplacian operator were tested to detect the fissures in the visible image, infrared image and fused image. An improved edge detection method was proposed which based on the Laplacian of Gaussian, Canny and mathematical morphology operators. The peak signal-to-noise rate, effective edge rate, Pratt’s figure of merit and F-measure indicated that the proposed method was superior to the other methods. In addition, the fissures in infrared images at different times can be accurately detected by the proposed method except at 7:00 am, 1:00 pm and 3:00 pm.

UAV Remote Sensing Image Automatic Registration Based on Deep Residual Features

With the rapid development of unmanned aerial vehicle (UAV) technology, UAV remote sensing images are increasing sharply. However, due to the limitation of the perspective of UAV remote sensing, the UAV images obtained from different viewpoints of a same scene need to be stitched together for further applications. Therefore, an automatic registration method of UAV remote sensing images based on deep residual features is proposed in this work. It needs no additional training and does not depend on image features, such as points, lines and shapes, or on specific image contents. This registration framework is built as follows: Aimed at the problem that most of traditional registration methods only use low-level features for registration, we adopted deep residual neural network features extracted by an excellent deep neural network, ResNet-50. Then, a tensor product was employed to construct feature description vectors through exacted high-level abstract features. At last, the progressive consistency algorithm (PROSAC) was exploited to remove false matches and fit a geometric transform model so as to enhance registration accuracy. The experimental results for different typical scene images with different resolutions acquired by different UAV image sensors indicate that the improved algorithm can achieve higher registration accuracy than a state-of-the-art deep learning registration algorithm and other popular registration algorithms.

Exploring the Potential of Unmanned Aerial Vehicle (UAV) Remote Sensing for Mapping Plucking Area of Tea Plantations

Mapping plucking areas of tea plantations is essential for tea plantation management and production estimation. However, on-ground survey methods are time-consuming and labor-intensive, and satellite-based remotely sensed data are not fine enough for plucking area mapping that is 0.5–1.5 m in width. Unmanned aerial vehicles (UAV) remote sensing can provide an alternative. This paper explores the potential of using UAV-derived remotely sensed data for identifying plucking areas of tea plantations. In particular, four classification models were built based on different UAV data (optical imagery, digital aerial photogrammetry, and lidar data). The results indicated that the integration of optical imagery and lidar data produced the highest overall accuracy using the random forest algorithm (94.39%), while the digital aerial photogrammetry data could be an alternative to lidar point clouds with only a ~3% accuracy loss. The plucking area of tea plantations in the Huashan Tea Garden was accurately measured for the first time with a total area of 6.41 ha, which accounts for 57.47% of the tea garden land. The most important features required for tea plantation mapping were the canopy height, variances of heights, blue band, and red band. Furthermore, a cost–benefit analysis was conducted. The novelty of this study is that it is the first specific exploration of UAV remote sensing in mapping plucking areas of tea plantations, demonstrating it to be an accurate and cost-effective method, and hence represents an advance in remote sensing of tea plantations.