Cloud Images Research Articles

SAM-Net: Spatio-Temporal Sequence Typhoon Cloud Image Prediction Net with Self-Attention Memory

Cloud image prediction is a spatio-temporal sequence prediction task, similar to video prediction. Spatio-temporal sequence prediction involves learning from historical data and using the learned features to generate future images. In this process, the changes in time and space are crucial for spatio-temporal sequence prediction models. However, most models now rely on stacking convolutional layers to obtain local spatial features. In response to the complex changes in cloud position and shape in cloud images, the prediction module of the model needs to be able to extract both global and local spatial features from the cloud images. In addition, for irregular cloud motion, more attention should be paid to the spatio-temporal sequence features between input cloud image frames in the temporal sequence prediction module, considering the extraction of temporal features with long temporal dependencies, so that the spatio-temporal sequence prediction network can learn cloud motion trends more accurately. To address these issues, we have introduced an innovative model called SAM-Net. The self-attention module of this model aims to extract an inner image frame’s spatial features of global and local dependencies. In addition, a memory mechanism has been added to the self-attention module to extract interframe features with long temporal and spatial dependencies. Our method shows better performance than the PredRNN-v2 model on publicly available datasets such as MovingMNIST and KTH. We achieved the best performance in both the 4-time-step and 10-time-step typhoon cloud image predictions. On a cloud dataset consisting of 10 time steps, we observed a decrease in MSE of 180.58, a decrease in LPIPS of 0.064, an increase in SSIM of 0.351, and a significant improvement in PSNR of 5.56 compared to PredRNN-v2.

Enhancing Open-Space Gas Detection Limit: A Novel Environmentally Adaptive Infrared Temperature Prediction Method for Uncooled Spectroscopy

Gas cloud imaging with uncooled infrared spectroscopy is influenced by ambient temperature, complicating the quantitative detection of gas concentrations in open environments. To solve the aforementioned challenges, the paper analyzes the main factors influencing detection errors in uncooled infrared spectroscopy gas cloud imaging and proposes a temperature correction method to address them. Firstly, to mitigate the environmental effects on the radiative temperature output of uncooled infrared detectors, a snapshot-based, multi-band infrared temperature compensation algorithm incorporating environmental awareness was developed. This algorithm enables precise infrared radiation prediction across a wide operating temperature range. Validation tests conducted over the full temperature range of 0 °C to 80 °C demonstrated that the prediction error was maintained within ±0.96 °C. Subsequently, temperature compensation techniques were integrated, resulting in the development of a comprehensive uncooled infrared spectroscopy gas cloud imaging detection method. Ultimately, the detection limits for SF6, ethylene, cyclohexane, and ammonia were enhanced by 50%, 33%, 25%, and 67%, respectively.

Edge Computing for Smart-City Human Habitat: A Pandemic-Resilient, AI-Powered Framework

The COVID-19 pandemic has highlighted the need for a robust medical infrastructure and crisis management strategy as part of smart-city applications, with technology playing a crucial role. The Internet of Things (IoT) has emerged as a promising solution, leveraging sensor arrays, wireless communication networks, and artificial intelligence (AI)-driven decision-making. Advancements in edge computing (EC), deep learning (DL), and deep transfer learning (DTL) have made IoT more effective in healthcare and pandemic-resilient infrastructures. DL architectures are particularly suitable for integration into a pandemic-compliant medical infrastructures when combined with medically oriented IoT setups. The development of an intelligent pandemic-compliant infrastructure requires combining IoT, edge and cloud computing, image processing, and AI tools to monitor adherence to social distancing norms, mask-wearing protocols, and contact tracing. The proliferation of 4G and beyond systems including 5G wireless communication has enabled ultra-wide broadband data-transfer and efficient information processing, with high reliability and low latency, thereby enabling seamless medical support as part of smart-city applications. Such setups are designed to be ever-ready to deal with virus-triggered pandemic-like medical emergencies. This study presents a pandemic-compliant mechanism leveraging IoT optimized for healthcare applications, edge and cloud computing frameworks, and a suite of DL tools. The framework uses a composite attention-driven framework incorporating various DL pre-trained models (DPTMs) for protocol adherence and contact tracing, and can detect certain cyber-attacks when interfaced with public networks. The results confirm the effectiveness of the proposed methodologies.

Study of airborne LiDAR error based on flight simulation in atmospheric disturbance

Abstract The airborne LiDAR uses the aircraft as the observation platform, requiring the aircraft to keep a uniform speed and a straight-line cruise state, to obtain more accurate ranging information and a uniform laser foot point distribution cloud picture. Atmospheric turbulence is the main atmospheric disturbance that affects the aircraft movement in the cruise state, which can lead to a serious decrease in radar ranging accuracy and the distortion of cloud point distribution. In this paper, the motion error caused by atmospheric turbulence during flight is studied. The real-time simulation method based on the six degrees of freedom flight mechanics equation is used to establish the motion law of the carrier under atmospheric turbulence. The method’s reliability is verified by comparing it with flight test data. Then, the foot point distribution cloud image and ranging error of airborne LiDAR under different wind field intensities are simulated by real-time simulation of six degrees of freedom. The error law of radar motion affected by atmospheric turbulence is obtained.

Dual-path aggregation transformer network for super-resolution with images occlusions and variability

While Transformer-based approaches have recently achieved notable success in super-resolution, their extensive computational requirements impede widespread practical adoption. High-resolution meteorological satellite cloud imagery is essential for weather analysis and forecasting. Enhancing image resolution through super-resolution techniques facilitates the accurate identification and localization of geographic features by meteorological systems. However, current super-resolution methods fail to restore the intricacies of cloud formations and complex regions fully. This research introduces a novel dual-path aggregation Transformer network (DPAT) tailored to enhance the super-resolution of meteorological satellite cloud images. The DPAT network adeptly captures cloud imagery's subtle details and textures, effectively addressing occlusions and the variability inherent in satellite imagery. It bolsters the model's ability to manage the complex attributes of cloud images through the introduction of the Dual-path Aggregation Self-Attention (DASA) mechanism and the Multi-scale Feature Aggregation Block (MFAB), thereby enhancing performance in processing intricate cloud features. The DASA mechanism synthesizes features across spatial, depth, and channel dimensions via a dual-path approach, thoroughly exploiting feature correlations. The MFAB, designed to supplant the multilayer perceptron, incorporates shift convolution and a multi-scale interaction block to augment feature information, compensating for the deficiency in local information absorption due to fixed receptive fields. Experimental outcomes indicate that DPAT delivers superior super-resolution outcomes. With a parameter count of only 32% of the Enhanced Deep Residual Network (EDSR) or 77% of the Image Restoration using Shift Window Transformer (SwinIR), DPAT matches SwinIR's performance on the satellite cloud dataset. Moreover, DPAT balances accuracy and parameter economy across various datasets. This technology is expected to improve image super-resolution capabilities in multiple fields such as human action recognition and industrial recognition, and indirectly improve the accuracy of image perception tasks.

On the hypercomplex numbers and normed division algebras in all dimensions: A unified multiplication.

Mathematics is the foundational discipline for all sciences, engineering, and technology, and the pursuit of normed division algebras in all finite dimensions represents a paramount mathematical objective. In the quest for a real three-dimensional, normed, associative division algebra, Hamilton discovered quaternions, constituting a non-commutative division algebra of quadruples. Subsequent investigations revealed the existence of only four division algebras over reals, each with dimensions 1, 2, 4, and 8. This study transcends such limitations by introducing generalized hypercomplex numbers extending across all dimensions, serving as extensions of traditional complex numbers. The space formed by these numbers constitutes a non-distributive normed division algebra extendable to all finite dimensions. The derivation of these extensions involves the definitions of two new π-periodic functions and a unified multiplication operation, designated as spherical multiplication, that is fully compatible with the existing multiplication structures. Importantly, these new hypercomplex numbers and their associated algebras are compatible with the existing real and complex number systems, ensuring continuity across dimensionalities. Most importantly, like the addition operation, the proposed multiplication in all dimensions forms an Abelian group while simultaneously preserving the norm. In summary, this study presents a comprehensive generalization of complex numbers and the Euler identity in higher dimensions, shedding light on the geometric properties of vectors within these extended spaces. Finally, we elucidate the practical applications of the proposed methodology as a viable alternative for expressing a quantum state through the multiplication of specified quantum states, thereby offering a potential complement to the established superposition paradigm. Additionally, we explore its utility in point cloud image processing.

Open-loop narrowband magnetic particle imaging based on mixed-frequency harmonic magnetization response.

Magnetic particle imaging (MPI), a radiation-free, dynamic, and targeted imaging technique, has gained significant traction in both research and clinical settings worldwide. Signal-to-noise ratio (SNR) is a crucial factor influencing MPI image quality and detection sensitivity, and it is affected by ambient noise, system thermal noise, and the magnetization response of superparamagnetic nanoparticles. Therefore to address the high amplitude system and inherent thermal noise present in conventional MPI systems is essential to improve detection sensitivity and imaging resolution. This study introduces a novel open-loop, narrow-band MPI signal acquisition system based on mixed-frequency harmonic magnetization response. Allowing superparamagnetic nanoparticles to be excited by low frequency, high amplitude magnetic fields and high frequency, low amplitude magnetic fields, the excitation coil generates a mixed excitation magnetic field at a mixed frequency of 8.664 kHz (f H + 2f L ), and the tracer of superparamagnetic nanoparticles can generate a locatable superparamagnetic magnetization signal with rich harmonic components in the mixed excitation magnetic field and positioning magnetic field. The third harmonic signal is detected by a Gradiometer coil with high signal-to-noise ratio, and the voltage cloud image is formed. The experimental results show that the external noise caused by the excitation coil can be effectively reduced from 12 to about 1.5 μV in the imaging area of 30 mm × 30 mm, which improves the stability of the detection signal of the Gradiometer coil, realizes the detection of high SNR, and makes the detection sensitivity reach 10 μg Fe. By mixing excitation, the total intensity of the excitation field is reduced, resulting in a slight improvement of the resolution under the same gradient field, and the spatial resolution of the image reconstruction is increased from 2 mm under the single frequency excitation (20.7 kHz) in the previous experiment to 1.5 mm under the mixed excitation (8.664 kHz). These experimental results highlight the effectiveness of the proposed open-loop narrowband MPI technique in improving signal detection sensitivity, achieving high signal-to-noise ratio detection and improving the quality of reconstructed images by changing the excitation magnetic field frequency of the excitation coil, providing novel design ideas and technical pathways for future MPI systems.

A Statistical Study of Polar Mesospheric Cloud Fronts in the Northern Hemisphere

AbstractComplex spatial structures in polar mesospheric cloud (PMC) images provide visual clues to the dynamics that occur in the summer mesosphere. In this study, we document one such structure, a PMC front, by analyzing PMC images in the northern hemisphere from the Cloud Imaging and Particle Size (CIPS) instrument onboard the aeronomy of ice in the mesosphere (AIM) satellite. A PMC front is defined as a sharp boundary that separates cloudy and mostly clear regions, and where the clouds at the front boundary are brighter than the clouds in the cloudy region. We explore the environment that supports the formation of PMC fronts using near‐coincident temperature and water vapor observations from the Sounding of the Atmosphere using Broadband Emission Radiometry (SABER) satellite instrument. A comparison of PMC front locations to near‐coincident temperature profiles reveals the presence of inversion layers at PMC altitudes. The adiabatic and superadiabatic topside lapse rates of these temperature inversions indicate that some of the identified inversion layers may have been formed by gravity wave (GW) dissipation. The structure of the squared buoyancy frequency profiles indicates a stable layer or thermal duct that can be associated with large‐amplitude mesospheric inversion layers (MILs) that extend large distances. These inversion layers may be conducive to horizontal wave propagation. We hypothesize that ducted GWs may be a formation mechanism of PMC fronts.

The Ice Cloud Imager: retrieval of frozen water column properties

Abstract. The Ice Cloud Imager (ICI) aboard the second generation of the EUMETSAT Polar System (EPS-SG) will provide novel measurements of ice hydrometeors. ICI is a passive conically scanning radiometer that will operate within a frequency range of 183 to 664 GHz, helping to cover the present wavelength gap between microwave and infrared observations. Reliable global data will be produced on a daily basis. This paper presents the retrieval database to be used operationally and performs a final pre-launch assessment of ICI retrievals. Simulations are performed within atmospheric states that are consistent with radar reflectivities and represent the three-dimensional (3D) variability of clouds. The radiative transfer calculations use empirically based hydrometeor models. Azimuthal orientation of particles is mimicked, allowing for the consideration of polarisation. The degrees of freedom (DoFs) of the ICI retrieval database are shown to vary according to cloud type. The simulations are considered to be the most detailed performed to this date. Simulated radiances are shown to be statistically consistent with real observations. Machine learning is applied to perform inversions of the simulated ICI observations. The method used allows for the estimation of non-Gaussian uncertainties for each retrieved case. Retrievals of ice water path (IWP), mean mass height (Zm), and mean mass diameter (Dm) are presented. Distributions and zonal means of both database and retrieved IWP show agreement with DARDAR. Retrieval tests indicate that ICI will be sensitive to IWP between 10−2 and 101 kg m−2. Retrieval performance is shown to vary with climatic region and surface type, with the best performance achieved over tropical regions and over ocean. As a consequence of this study, retrievals from real observations will be possible from day one of the ICI operational phase.

Breaking the rain barrier: A novel approach in image processing with AMGR‐Net

AbstractImage quality is significantly impacted by rain, posing challenges in fields like surveillance, autonomous driving, and outdoor robotics. The field of image deraining, particularly for single image, has attracted considerable attention to improve image clarity in inclement weather. To overcome the inherent complexity of the single‐image rain removal task, we proposed a novel architecture of the attention mechanism and gated recurrent network (AMGR‐Net) that combines spatial and channel attention mechanisms with gated recurrent units. AMGR‐Net contains multiple modules, each of which uses convolution kernels and attention mechanisms to enhance feature extraction. AMGR‐Net demonstrates superior performance over state‐of‐the‐art methods in both synthetic and real‐world image datasets, as evidenced by higher peak signal to noise ratio and structural similarity index measurement scores. The integration of spatial attention significantly enhances feature expression, enabling more effective rain streak removal and detail preservation. Furthermore, this method also shows promising results in the application of stripe noise removal from meteorological satellite cloud images.

A Novel Model for Protecting the Privacy of Digital Images in Cloud Using Permutated Fragmentation and Encryption Algorithms

Maintaining privacy is becoming increasingly challenging due to growing reliance on cloud services and software, respectively. Our data is stored in a virtual environment on unreliable cloud machines, making it susceptible to privacy breaches if not handled properly. Encrypting data before uploading it can be a solution to this problem, but it can be time-consuming. However, all of the encryption methods used to safeguard digital data so far did not fulfillment privacy and integration requirements. This is because encryption cannot function independently. Data that is encrypted and stored on a single cloud server can still be accessed by attackers, compromising the privacy of the data. In this paper, we propose a new model based on the user's classification of privacy level. The proposed model divides the digital file into multiple fragments and separately encrypts each fragment; each fragment is encrypted as separated blocks. Additionally, permutation is implemented on encrypted fragments because they are stored in the cloud with replication fragments on another cloud service. This approach ensures that even if the attacker’s gains access to one fragment, they would not be able to access the entire file, thereby safeguarding the privacy of the data.

A Hybrid Spatial Fuzzy Inference and CNN Approach for Forecasting Changes in Remote Sensing

Satellite cloud images, captured by Earth observation satellites, provide crucial information for weather forecasting, aviation, natural resource management, and disaster response. This study presents a novel method for detecting changes in satellite cloud images, combining convolutional neural networks (CNNs) for feature extraction with a spatial complex fuzzy inference system (CFIS). The CNNs effectively capture color channel features in the image blurring and deblurring processes, while the CFIS models the spatiotemporal relationships in the data. Experiments conducted on a US Navy satellite image dataset demonstrate the effectiveness and stability of our proposed method, outperforming related studies in terms of both root mean square error (RMSE) and R-squared (R2) metrics.

GS–CDNet: a remote sensing image cloud detection method with geographic spatial data integration

ABSTRACT In optical remote sensing images, clouds exhibit irregular scales and boundaries that vary with elevation across diverse geographical locations. To accurately capture the diverse visual patterns of clouds, we propose a cloud image segmentation approach named GS-CDNet (Geographic Spatial Data-Cloud Detection Network), which is based on the integration of geospatial data with multifaceted self-attention feature extraction, multi-scale feature aggregation, and boundary clarification techniques.Firstly, we utilize geographical coordinates from optical remote sensing images to extract a raster DEM (Digital Elevation Model) from SRTM3. This process creates a dataset consisting of elevation images, longitude, and latitude maps as geospatial data, enhancing the model’s capability in spatial positioning for cloud detection. Secondly, the proposed method consists of three interconnected modules within the cloud detection network: the Interleaved Self-Attention module(ISAM) utilizes a variety of self-attention mechanisms in an interleaved manner to extract multi-scale feature information.The Bidirectional Multi-Scale Feature Fusion Module(BIMFM) is responsible for integrating features, enabling a more comprehensive contextual understanding. The Boundary Extraction Module(BEM) utilizes a residual structure to generate a boundary cloud mask, effectively addressing the common issue of boundary blurring in multi-scale cloud masks. Finally, we compared and evaluated GS-CDNet with other cloud detection methods and conducted an ablation study on the key components of the method. The validation of generalization performance demonstrates the exceptional performance of the proposed model in cloud mask generation. Geospatial data and the different modules of the method play a significant role in the model.

U-TPE: A universal approximate thumbnail-preserving encryption method for lossless recovery

Due to the limited local storage space, more and more people are accustomed to uploading images to the cloud, which has aroused concerns about privacy leaks. The traditional solution is to encrypt the images directly. However, in this way, users cannot easily browse the images stored in the cloud. Obviously, the traditional method has lost the visual usability of cloud images. To solve this problem, the Thumbnail-Preserving Encryption (TPE) method is proposed. Although approximate-TPE is more efficient than ideal TPE, it cannot restore the original image without damage and cannot encrypt some images with texture features. Inspired by the above, we propose a universal approximate thumbnail-preserving encryption method with lossless recovery. This method divides the image into equal-sized chunks, each of which is further divided into an embedding area and an adjustment area. The pixels of the embedding area are recorded by prediction. Then, the auxiliary information necessary to restore the image is encrypted and hidden in the embedding area of the encrypted image. Finally, the pixel values of the adjustment area in each block are adjusted so that the average value is close to the original block. Experimental results show that the proposed method can not only restore images losslessly but also process images with different texture features, achieving good generality. On the BOWS2 dataset, all images can be encrypted by adjusting the block size. In addition, it can resist third-party face recognition and comparison, achieving satisfactory results in balancing privacy and visual usability.

Field-grown tomato yield estimation using point cloud segmentation with 3D shaping and RGB pictures from a field robot and digital single lens reflex cameras

The aim of this study was to estimate field-grown tomato yield (weight) and quantity of tomatoes using a self-developed robot and digital single lens reflex (DSLR) camera pictures. The authors suggest a new approach to predicting tomato yield that is based on images taken in the field, 3D scanning, and shape. Field pictures were used for tomato segmentation to determine the ripeness of the crop. A convolution neural network (CNN) model using TensorFlow library was devised for the segmentation of tomato berries along with a small robot, which had a 59.3 % F1 score. To enhance the accurate tomato crop model and to estimate the yield later, point cloud imaging was applied using a Ciclops 3D scanner. The best fitting sphere model was generated using the 3D model. The most optimal model was the 3D model, which gave the best representation and provided the weight of the tomatoes with a relative error of 21.90 % and a standard deviation of 17.9665 %. The results indicate a consistent object-based classification of the tomato crop above the plant/row level with an accuracy of 55.33 %, which is better than in-row sampling (images taken by the robot). By comparing the measured and estimated yield, the average difference for DSLR camera images was more favorable at 3.42 kg.

Finite element analysis of anatomic plate fixation for proximal clavicular fractures

To explore establishment and finite element analysis of personalized proximal clavicular anatomical plate screw fixation model. A 40-year-old male healthy volunteer was selected and the finite element analysis modules of 3D reconstruction software Mimics 15.01, Hypermesh 2019 and Abaqus 2020 were used. The finite element model of anatomic plate at the proximal clavicle was established, and a vertical load of 250 N was applied to the distal end of long axis of clavicle about 15 mm, then the overall structure, plate and screw displacement cloud image, Mises stress distribution were observed. The displacement distribution of the overall structure shows the maximum displacement was distributed on the distal clavicle. Under the four conditions of normal upper limb weight, longitudinal clavicle fracture, oblique fracture and shoulder impact violence during fall, longitudinal clavicle fracture and oblique fracture, the maximum displacement were 1.04 mm, 1.03 mm, 1.35 mm and 1.33 mm, respectively. The displacement cloud map of titanium alloy steel plate showed the largest displacement was distributed near the distal clavicular bone, and the maximum displacement were 0.89 mm, 0.88 mm, 1.10 mm and 1.09 mm, respectively. The displacement cloud map of titanium alloy screw showed the largest displacement was distributed at the root of the distal screw, and the maximum displacement were 0.88 mm, 0.87 mm, 1.08 mm and 1.06 mm, respectively. Mises stress distribution showed the maximum stress was mainly distributed on titanium alloy plates and screws, and the stress on the clavicle was very small. Mises stress distribution cloud showed the maximum Mises stress was distributed at the second row of screw holes near the clavicle, and the maximum Mises stress were 673.1, 678.1, 648.5, 654.4 MPa, respectively. The maximum stresses of titanium alloy screws were 414.5, 417.4, 415.8 and 419.7 MPa, respectively. The biomechanical changes of personalized proximal clavicular anatomical plates are demonstrated by using 3D finite element method to provide biomechanical data for personalized proximal clavicular anatomical plates.

Assessing the Capacity of High-resolution Commercial Satellite Imagery for Grapevine Downy Mildew Detection and Surveillance in New York state.

Grapevine downy mildew (GDM), caused by the oomycete Plasmopara viticola, can cause 100% yield loss and vine death under conducive conditions. High resolution multispectral satellite platforms offer the opportunity to track rapidly spreading diseases like GDM over large, heterogeneous fields. Here, we investigate the capacity of PlanetScope (3 m) and SkySat (50 cm) imagery for season-long GDM detection and surveillance. A team of trained scouts rated GDM severity and incidence at a research vineyard in Geneva, NY, USA from June to August of 2020, 2021, and 2022. Satellite imagery acquired within 72 hours of scouting was processed to extract single-band reflectance and vegetation indices (VIs). Random forest models trained on spectral bands and VIs from both image datasets could classify areas of high and low GDM incidence and severity with maximum accuracies of 0.85 (SkySat) and 0.92 (PlanetScope). However, we did not observe significant differences between VIs of high and low damage classes until late July-early August. We identified cloud cover, image co-registration, and low spectral resolution as key challenges to operationalizing satellite-based GDM surveillance. This work establishes the capacity of spaceborne multispectral sensors to detect late-stage GDM and outlines steps towards incorporating satellite remote sensing in grapevine disease surveillance systems.

CloudSwinNet: A hybrid CNN-transformer framework for ground-based cloud images fine-grained segmentation

Solar irradiance is the main factor affecting the output of a photovoltaic (PV) power station. The dominant role of ground-based clouds on the variation of direct solar radiation in the whole sky. Ground-based cloud segmentation plays a crucial role in photovoltaic power generation prediction. Despite advancements, current cloud segmentation methods fail to meet the requirements of this application. While convolutional neural networks demonstrate impressive segmentation capabilities in ground-based cloud segmentation tasks, their inherent limitations hinder further performance enhancement. Hence, this paper introduces CloudSwinNet, a hybrid CNN-Transformer framework for ground-based cloud images fine-grained segmentation. CloudSwinNet leverages concepts from convolutional neural networks, including stepwise downsampling, local convolution, and skip connections. To further explore the fine-grained features in the ground-based cloud images, we incorporates the Fine-grained Feature Fusion Module (Fg-FFM) in encoder structure, while the jump connection structure integrates the GloRe spatial graph inference module. These additions enable comprehensive learning of multi-scale and long-range dependencies. We conducted extensive experiments on the fine-grained ground-based cloud dataset, demonstrating that CloudSwinNet outperforms six semantic segmentation networks in both qualitative and quantitative evaluations. The results of ablation experiments prove the effectiveness of the module introduced in this paper.

Support Vector Machine Framework for Detecting Ambiguous Contours of Space Debris Cloud

Operational spacecraft are prepared for collisions with space debris by installing protective walls (bumpers). A group of vaporized and liquefied microparticles generated by debris collisions is called a debris cloud. To evaluate the protective performance of bumpers, it is important to measure the spread velocity and angle of the debris cloud. However, debris cloud images exhibit ambiguous contours of debris clouds. Consequently, measurement errors in the spread velocity and spread angles occur because of the observer’s subjectivity. Commonly used derivative-based methods can detect steep contours; however, they cannot detect ambiguous contours such as those of debris clouds. In this study, a method for uniquely detecting the ambiguous contours of a debris cloud based on supervised machine learning and a continuous wavelet transform (CWT) is proposed. Feature points that indicate candidate points of the debris cloud contour are extracted using a method based on CWT. Four types of specific features for debris cloud contours were assigned to the feature points. Supervised machine learning using a support vector machine can detect the debris cloud contours. The proposed method enables the evaluation of the ambiguous contours of a debris cloud and the protection performance of a bumper without observer subjectivity.

3D modelling method and application to a digital campus by fusing point cloud data and image data

ObjectiveThe use of single-source data for real-world 3D modelling currently faces problems such as deformation, pulling and fuzzy texture at the bottom of buildings in some feature models because of the lack of images. Moreover, LIDAR generates a huge amount of data, and the massive raw data processing and point cloud parsing puts high demands on the hardware arithmetic and algorithms. Aiming at the deficiencies and defects of the two data sources of inclined photogrammetry and airborne laser point cloud in the construction of high-quality and high-precision city-level 3D models. Methodsthis study uses a university library building as an example and proposes the main technical process and method of modelling after fusing the point cloud data acquired by inclined photogrammetry and 3D laser scanning technology. This is accomplished in the reconstruction stage of multi-source data fusion through data spatial alignment, coordinate system unification and data spatial integration. At the stage of multi-source data fusion and reconstruction, through data spatial alignment, coordinate system unification, point cloud coarse alignment and the iterative closest point (ICP) algorithm, a realistic 3D model of a building is constructed to verify the effectiveness of the modelling method. ResultsThe method can effectively improve the accuracy of the real-life 3D model, repair the deficiencies in the model and optimise the details of the model. It can also significantly improve the fineness of the tilt photography model and perfectly present the geometric and texture information of the building, making it a superior method for fine 3D reconstruction. ConclusionThis 3D reconstruction method of buildings, which integrates low-altitude inclined photogrammetry and airborne light detection and ranging (LiDAR), has high positional accuracy and can provide new methods and new ideas for the construction of digital campuses as well as for other engineering applications.