Multi-scale Segmentation Research Articles

Segment Anything Model Combined with Multi-Scale Segmentation for Extracting Complex Cultivated Land Parcels in High-Resolution Remote Sensing Images

Accurate cultivated land parcel data are an essential analytical unit for further agricultural monitoring, yield estimation, and precision agriculture management. However, the high degree of landscape fragmentation and the irregular shapes of cultivated land parcels, influenced by topography and human activities, limit the effectiveness of parcel extraction. The visual semantic segmentation model based on the Segment Anything Model (SAM) provides opportunities for extracting multi-form cultivated land parcels from high-resolution images; however, the performance of the SAM in extracting cultivated land parcels requires further exploration. To address the difficulty in obtaining parcel extraction that closely matches the true boundaries of complex large-area cultivated land parcels, this study used segmentation patches with cultivated land boundary information obtained from SAM unsupervised segmentation as constraints, which were then incorporated into the subsequent multi-scale segmentation. A combined method of SAM unsupervised segmentation and multi-scale segmentation was proposed, and it was evaluated in different cultivated land scenarios. In plain areas, the precision, recall, and IoU for cultivated land parcel extraction improved by 6.57%, 10.28%, and 9.82%, respectively, compared to basic SAM extraction, confirming the effectiveness of the proposed method. In comparison to basic SAM unsupervised segmentation and point-prompt SAM conditional segmentation, the SAM unsupervised segmentation combined with multi-scale segmentation achieved considerable improvements in extracting complex cultivated land parcels. This study confirms that, under zero-shot and unsupervised conditions, the SAM unsupervised segmentation combined with the multi-scale segmentation method demonstrates strong cross-region and cross-data source transferability and effectiveness for extracting complex cultivated land parcels across large areas.

CelloType: A Unified Model for Segmentation and Classification of Tissue Images.

Cell segmentation and classification are critical tasks in spatial omics data analysis. We introduce CelloType, an end-to-end model designed for cell segmentation and classification of biomedical microscopy images. Unlike the traditional two-stage approach of segmentation followed by classification, CelloType adopts a multi-task learning approach that connects the segmentation and classification tasks and simultaneously boost the performance of both tasks. CelloType leverages Transformer-based deep learning techniques for enhanced accuracy of object detection, segmentation, and classification. It outperforms existing segmentation methods using ground-truths from public databases. In terms of classification, CelloType outperforms a baseline model comprised of state-of-the-art methods for individual tasks. Using multiplexed tissue images, we further demonstrate the utility of CelloType for multi-scale segmentation and classification of both cellular and non-cellular elements in a tissue. The enhanced accuracy and multi-task-learning ability of CelloType facilitate automated annotation of rapidly growing spatial omics data.

Multi-scale convolution enhanced transformer for multivariate long-term time series forecasting

In data analysis and forecasting, particularly for multivariate long-term time series, challenges persist. The Transformer model in deep learning methods has shown significant potential in time series forecasting. The Transformer model’s dot-product attention mechanism, however, due to its quadratic computational complexity, impairs training and forecasting efficiency. In addition, the Transformer architecture has limitations in modeling local features and dealing with multivariate cross-dimensional dependency relationship. In this article, a Multi-Scale Convolution Enhanced Transformer model (MSCformer) is proposed for multivariate long-term time series forecasting. As an alternative to modeling the time series in its entirety, a segmentation strategy is designed to convert the input original series into segmented forms with different lengths, then process time series segments using a new constructed multi-Dependency Aggregation module. This multi-Scale segmentation approach reduces the computational complexity of the attention mechanism part in subsequent models, and for each segment of length corresponds to a specific time scale, it also ensures that each segment retains the semantic information of the data sequence level, thereby comprehensively utilizing the multi-scale information of the data while more accurately capturing the real dependency of the time series. The Multi-Dependence Aggregate module captures both cross-temporal and cross-dimensional dependencies of multivariate long-term time series and compensates for local dependencies within the segments thereby captures local series features comprehensively and addressing the issue of insufficient information utilization. MSCformer synthesizes dependency information extracted from various temporal segments at different scales and reconstructs future series using linear layers. MSCformer exhibits higher forecasting accuracy, outperforming existing methods in multiple domains including energy, transportation, weather, electricity, disease and finance.

A deep learning-based cascade algorithm for pancreatic tumor segmentation.

Pancreatic tumors are small in size, diverse in shape, and have low contrast and high texture similarity with surrounding tissue. As a result, the segmentation model is easily confused by complex and changeable background information, leading to inaccurate positioning of small targets and false positives and false negatives. Therefore, we design a cascaded pancreatic tumor segmentation algorithm. In the first stage, we use a general multi-scale U-Net to segment the pancreas, and we exploit a multi-scale segmentation network based on non-local localization and focusing modules to segment pancreatic tumors in the second stage. The non-local localization module learns channel and spatial position information, searches for the approximate area where the pancreatic tumor is located from a global perspective, and obtains the initial segmentation results. The focusing module conducts context exploration based on foreground features (or background features), detects and removes false positive (or false negative) interference, and obtains more accurate segmentation results based on the initial segmentation. In addition, we design a new loss function to alleviate the insensitivity to small targets. Experimental results show that the proposed algorithm can more accurately locate pancreatic tumors of different sizes, and the Dice coefficient outperforms the existing state-of-the-art segmentation model. The code will be available at https://github.com/HeyJGJu/Pancreatic-Tumor-SEG.

Object-oriented multi-scale segmentation and multi-feature fusion-based method for identifying typical fruit trees in arid regions using Sentinel-1/2 satellite images

Fruit tree identification that is quick and precise lays the groundwork for scientifically evaluating orchard yields and dynamically monitoring planting areas. This study aims to evaluate the applicability of time series Sentinel-1/2 satellite data for fruit tree classification and to provide a new method for accurately extracting fruit tree species. Therefore, the study area selected is the Tarim Basin, the most important fruit-growing region in northwest China. The main focus is on identifying several major fruit tree species in this region. Time series Sentinel-1/2 satellite images acquired from the Google Earth Engine (GEE) platform are used for the study. A multi-scale segmentation approach is applied, and six categories of features including spectral, phenological, texture, polarization, vegetation index, and red edge index features are constructed. A total of forth-four features are extracted and optimized using the Vi feature importance index to determine the best time phase. Based on this, an object-oriented (OO) segmentation combined with the Random Forest (RF) method is used to identify fruit tree species. To find the best method for fruit tree identification, the results are compared with three other widely used traditional machine learning algorithms: Support Vector Machine (SVM), Gradient Boosting Decision Tree (GBDT), and Classification and Regression Tree (CART). The results show that: (1) the object-oriented segmentation method helps to improve the accuracy of fruit tree identification features, and September satellite images provide the best time window for fruit tree identification, with spectral, phenological, and texture features contributing the most to fruit tree species identification. (2) The RF model has higher accuracy in identifying fruit tree species than other machine learning models, with an overall accuracy (OA) and a kappa coefficient (KC) of 94.60% and 93.74% respectively, indicating that the combination of object-oriented segmentation and RF algorithm has great value and potential for fruit tree identification and classification. This method can be applied to large-scale fruit tree remote sensing classification and provides an effective technical means for monitoring fruit tree planting areas using medium-to-high-resolution remote sensing images.

Object-based image retrieval and detection for surveillance video

With technological advancement worldwide, the video surveillance market is growing drastically in a versatile field. Monitoring, browsing, and retrieving a specific object in a long video becomes difficult due to the enormous amount of data produced by the surveillance camera. With limitations on human resources and browsing time, there is a need for a new video analytics model to handle more complex tasks, such as object detection and query retrieval. The current approach involves techniques like unsupervised segmentation, multiscale segmentation, and feature-based descriptions. However, these methods often encounter extensive space and time consumption challenges. A solution has been developed for retrieving targeted objects from surveillance videos via user queries, employing a graphical interface for input. Extracting relevant frames based on user-entered text queries is enabled through using YOLOv8 for object detection. Users interact through a graphical user interface deployed on a Jetson Xavier Development board. The system's outcome is a time-efficient and highly accurate automated model for object detection and query retrieval, eliminating human errors associated with manually locating objects in videos upon user queries.

Multiscale segmentation net for segregating heterogeneous brain tumors: Gliomas on multimodal MR images

In this research, the 3D volumetric segmentation of heterogeneous brain tumors such as Gliomas- anaplastic astrocytoma, and Glioblastoma Multiforme (GBM) is performed to extract enhancing tumor (ET), whole tumor (WT), and tumor core (TC) regions using T1, T2, and FLAIR images. Therefore, a deep learning-based encoder-decoder architecture named “MS-SegNet” using 3D multi-scale convolutional layers is proposed. The proposed architecture employs multi-scale feature extraction (MS-FE) block the filter size 3 × 3 × 3 to extract confined information like tumor boundary and edges of necrotic part. The filter of size 5 × 5 × 5 focuses on varied features like shape, size, and location of tumor region with edema. The local and global features from different MR modalities are extracted for segmenting thin and meshed boundaries of heterogeneous tumors between anatomical sub-regions like peritumoral edema, enhancing tumor, and necrotic tumor core. The learning parameters on introducing the MS-FE block are reduced to 10 million, which is much less than other architectures like 3D-Unet which takes into consideration 27 million features leading to the consumption of less computational power. A customized loss function is also prophesied based on a combination of dice loss and focal loss along with metrics such as accuracy and Intersection over Union (IoU) i.e. the overlapping of ground truth mask and predicted value for addressing the class imbalance problem. For evaluating the efficacy of the proposed method, four evaluation metrics such as Dice Coefficient (DSC), Sensitivity, Specificity, and Hausdorff95 distance (H95) are employed for analyzing the model's overall performance. It is observed that the proposed MS-SegNet architecture achieved the DSC of 0.81, 0.91, and 0.83 on BraTS 2020; 0.86, 0.92, and 0.84 on BraTS 2021 for ET, WT, and TC respectively. The developed model is also tested on a real-time dataset collected from the Post Graduate Institute of Medical Education & Research (PGIMER), Chandigarh. The DSC of 0.79, 0.76, and 0.68 for ET, WT, and TC respectively on the real-time dataset. These findings show that deep learning models with enhanced feature extraction capabilities can be readily trained to attain high accuracy in segmenting heterogeneous brain tumors and hold promising results. In the future, other tumor datasets will be explored for the detection and treatment planning of brain tumors to check the effectiveness of the model in real-world healthcare environments.

Resilience analysis of urban commercial area under the COVID-19 epidemic using night-time light remote sensing data

ABSTRACT The global outbreak of the novel coronavirus has had a great impact on commercial areas, particularly in Wuhan, the first city in China affected by the epidemic. Exploring the changing pattern of these areas during the epidemic period is crucial for effectively restoring the urban economic level and promoting economic development on the basis of epidemic prevention and control in the post-epidemic era. The paper proposes a resilience analysis of urban commercial areas during the COVID-19 epidemic using time-series night-time light remote sensing data. Based on the constructed time-series night-time light remote sensing dataset and considering the urban impervious surface, the urban commercial area was extracted under multi-scale segmentation. Based on night-time light data before and after the epidemic, the resilience of representative commercial areas in Wuhan City, Hubei Province during the COVID-19 epidemic was analysed using a modified improved resilience assessment framework. The results showed that the lighting values of commercial areas and impervious areas decreased by up to 30% following the implementation of city lockdown measures. The change of light brightness in the commercial areas was more prominent, and the range of change is larger than that in the non-commercial areas. The lighting brightness of the commercial areas exhibited a significant downward trend throughout the entire lockdown period, and the downward trend will still remain for a period of time after unlocking. Among all the commercial areas, Wuguang commercial area demonstrated the highest recovery rate during the lockdown period and instantaneous recovery rate after the lockdown, with relatively low closure loss and the highest level of resilience.

Recognition of small water bodies under complex terrain based on SAR and optical image fusion algorithm

Understanding the spatial and temporal distribution of small water bodies is essential for managing water resources, crafting conservation policies, and preserving watershed ecosystems and biodiversity. However, existing studies often rely on a single remote sensing data source (optical or microwave), focusing on large-scale, flat areas and lacking comprehensive monitoring of small water bodies in complex terrain. Therefore, considering the complementary advantages of multisource remote sensing (multispectral and SAR), this paper proposes a multispectral and SAR fusion algorithm, named Multispectral and SAR Fusion algorithm (MASF), to better capture the remote sensing characteristics of small water bodies in complex areas. Based on this, a dataset containing spectral, texture, and geometric features is constructed, and multi-scale segmentation and random forest algorithms are applied for identification of small water bodies in complex terrain. The results demonstrate that the proposed fusion algorithm MASF exhibits minimal spectral distortion (SAM < 3.5, ERGAS <21, RMSE <0.01) and robust spatial feature enhancement (PSNR >40, SSIM >0.999, CC > 0.99). The Overall Accuracy (OA) and Kappa coefficients for both experimental areas surpassed 0.9. For rivers and reservoirs, both Producer's Accuracy (PA) and User's Accuracy (UA) exceeded 0.9. The UA for agricultural ponds exceeded 0.8. Comparative analysis with three other types of water-related data products shows that the freshwater identification results in this study have certain advantages in local small water bodies. Our research holds significant implications for the utilization of water resources in mountainous areas, prevention and control of floods and floods, as well as the development of aquaculture industry.

Mangrove Species Classification from Unmanned Aerial Vehicle Hyperspectral Images Using Object-Oriented Methods Based on Feature Combination and Optimization.

Accurate and timely acquisition of the spatial distribution of mangrove species is essential for conserving ecological diversity. Hyperspectral imaging sensors are recognized as effective tools for monitoring mangroves. However, the spatial complexity of mangrove forests and the spectral redundancy of hyperspectral images pose challenges to fine classification. Moreover, finely classifying mangrove species using only spectral information is difficult due to spectral similarities among species. To address these issues, this study proposes an object-oriented multi-feature combination method for fine classification. Specifically, hyperspectral images were segmented using multi-scale segmentation techniques to obtain different species of objects. Then, a variety of features were extracted, including spectral, vegetation indices, fractional order differential, texture, and geometric features, and a genetic algorithm was used for feature selection. Additionally, ten feature combination schemes were designed to compare the effects on mangrove species classification. In terms of classification algorithms, the classification capabilities of four machine learning classifiers were evaluated, including K-nearest neighbor (KNN), support vector machines (SVM), random forests (RF), and artificial neural networks (ANN) methods. The results indicate that SVM based on texture features achieved the highest classification accuracy among single-feature variables, with an overall accuracy of 97.04%. Among feature combination variables, ANN based on raw spectra, first-order differential spectra, texture features, vegetation indices, and geometric features achieved the highest classification accuracy, with an overall accuracy of 98.03%. Texture features and fractional order differentiation are identified as important variables, while vegetation index and geometric features can further improve classification accuracy. Object-based classification, compared to pixel-based classification, can avoid the salt-and-pepper phenomenon and significantly enhance the accuracy and efficiency of mangrove species classification. Overall, the multi-feature combination method and object-based classification strategy proposed in this study provide strong technical support for the fine classification of mangrove species and are expected to play an important role in mangrove restoration and management.

Research on an Object-Oriented Intelligent Extraction Method For Landslide

Landslides are the most important type of geological disaster development in China. Heavy rainfall and earthquakes often cause mass landslides. Rapid extraction of postdisaster landslide information is an important method for realizing scientific and efficient emergency investigations and can provide a key basis for disaster assessment and emergency response decision-making. Rapid extraction of postdisaster landslide information is an important method for realizing scientific and efficient emergency investigations and can provide a key basis for disaster assessment and emergency response decision-making. Using Fujian as an example, based on basic topography, geology and other data, the multiscale segmentation method is used for image segmentation, and different features are selected. The applicability of the rule-based extraction method and support vector machine, random forest and other machine learning methods. The applicability of the rule-based extraction method and support vector machine, random forest and other machine learning methods in small-scale landslide extraction in the study area is compared. The results showed that the extraction accuracy of the rule-based extraction method was 90.86%, the extraction accuracy of the support vector machine was 65.95%, and the extraction accuracy of the random forest was 93.43%. A comparison of the three methods revealed that the random forest method was most suitable for landslide extraction in the study area.

A Novel UNet 3+ Change Detection Method Considering Scale Uncertainty in High-Resolution Imagery

The challenge of detecting changes in high-resolution remote sensing imagery often stems from the difficulties in effectively extracting features and constructing appropriate change detection models considering the scale characteristics of ground objects. To solve these issues, we propose a novel UNet 3+ change detection method that considers the scale characteristics inherent in various land-cover change types. Our method includes three key steps: a multi-scale segmentation method, a class-specific UNet 3+ method, and an object-oriented change detection method based on UNet 3+. To verify the effectiveness of this method, we select two datasets for experiments and compare our proposed method with the UNet 3+ single-scale sampling method, the class-specific UNet 3+ single-scale sampling method, and the UNet 3+ multi-scale hierarchical sampling method. Our experimental results show that our proposed method has higher overall accuracy and F1, lower missed detection rate and false detection rate, and can detect more changes in ground features than other methods. To verify the scalability of this method, we compare this method with traditional change detection methods such as PCA-k-means, OCVA, a single-scale sampling method based on random forest, and a class-specific object-based method. Experimental results and accuracy indexes show that our proposed method better considers the scale characteristics of ground objects and achieves higher accuracy. Additionally, we compared our proposed method with other DLCD methods including LamboiseNet, BIT, CDNet, FCSiamConc, and FCSiamDiff. Our results show that our proposed method effectively considers edge information and has an acceptable time consumption. Our approach not only considers the full-scale characteristics of the feature extraction but also the scale characteristics of the change detection model. In addition, it considers a more practical feature extraction unit (object), making it more accurate.

A modular framework for multi-scale tissue imaging and neuronal segmentation.

The development of robust tools for segmenting cellular and sub-cellular neuronal structures lags behind the massive production of high-resolution 3D images of neurons in brain tissue. The challenges are principally related to high neuronal density and low signal-to-noise characteristics in thick samples, as well as the heterogeneity of data acquired with different imaging methods. To address this issue, we design a framework which includes sample preparation for high resolution imaging and image analysis. Specifically, we set up a method for labeling thick samples and develop SENPAI, a scalable algorithm for segmenting neurons at cellular and sub-cellular scales in conventional and super-resolution STimulated Emission Depletion (STED) microscopy images of brain tissues. Further, we propose a validation paradigm for testing segmentation performance when a manual ground-truth may not exhaustively describe neuronal arborization. We show that SENPAI provides accurate multi-scale segmentation, from entire neurons down to spines, outperforming state-of-the-art tools. The framework will empower image processing of complex neuronal circuitries.

Object-Based Semi-Supervised Spatial Attention Residual UNet for Urban High-Resolution Remote Sensing Image Classification

Accurate urban land cover information is crucial for effective urban planning and management. While convolutional neural networks (CNNs) demonstrate superior feature learning and prediction capabilities using image-level annotations, the inherent mixed-category nature of input image patches leads to classification errors along object boundaries. Fully convolutional neural networks (FCNs) excel at pixel-wise fine segmentation, making them less susceptible to heterogeneous content, but they require fully annotated dense image patches, which may not be readily available in real-world scenarios. This paper proposes an object-based semi-supervised spatial attention residual UNet (OS-ARU) model. First, multiscale segmentation is performed to obtain segments from a remote sensing image, and segments containing sample points are assigned the categories of the corresponding points, which are used to train the model. Then, the trained model predicts class probabilities for all segments. Each unlabeled segment’s probability distribution is compared against those of labeled segments for similarity matching under a threshold constraint. Through label propagation, pseudo-labels are assigned to unlabeled segments exhibiting high similarity to labeled ones. Finally, the model is retrained using the augmented training set incorporating the pseudo-labeled segments. Comprehensive experiments on aerial image benchmarks for Vaihingen and Potsdam demonstrate that the proposed OS-ARU achieves higher classification accuracy than state-of-the-art models, including OCNN, 2OCNN, and standard OS-U, reaching an overall accuracy (OA) of 87.83% and 86.71%, respectively. The performance improvements over the baseline methods are statistically significant according to the Wilcoxon Signed-Rank Test. Despite using significantly fewer sparse annotations, this semi-supervised approach still achieves comparable accuracy to the same model under full supervision. The proposed method thus makes a step forward in substantially alleviating the heavy sampling burden of FCNs (densely sampled deep learning models) to effectively handle the complex issue of land cover information identification and classification.

A segmentation-based algorithm for classification of benign and malignancy Thyroid nodules with multi-feature information.

The aim of this study is to propose a new diagnostic model based on "segmentation + classification" to improve the routine screening of Thyroid nodule ultrasonography by utilizing the key domain knowledge of medical diagnostic tasks. A Multi-scale segmentation network based on a pyramidal pooling structure of multi-parallel void spaces is proposed. First, in the segmentation network, the exact information of the underlying feature space is obtained by an Attention Gate. Second, the inflated convolutional part of Atrous Spatial Pyramid Pooling (ASPP) is cascaded for multiple downsampling. Finally, a three-branch classification network combined with expert knowledge is designed, drawing on doctors' clinical diagnosis experience, to extract features from the original image of the nodule, the regional image of the nodule, and the edge image of the nodule, respectively, and to improve the classification accuracy of the model by utilizing the Coordinate attention (CA) mechanism and cross-level feature fusion. The Multi-scale segmentation network achieves 94.27%, 93.90% and 88.85% of mean precision (mPA), Dice value (Dice) and mean joint intersection (MIoU), respectively, and the accuracy, specificity and sensitivity of the classification network reaches 86.07%, 81.34% and 90.19%, respectively. Comparison tests show that this method outperforms the U-Net, AGU-Net and DeepLab V3+ classical models as well as the nnU-Net, Swin UNetr and MedFormer models that have emerged in recent years. This algorithm, as an auxiliary diagnostic tool, can help physicians more accurately assess the benign or malignant nature of Thyroid nodules. It can provide objective quantitative indicators, reduce the bias of subjective judgment, and improve the consistency and accuracy of diagnosis. Codes and models are available at https://github.com/enheliang/Thyroid-Segmentation-Network.git.

Uncertainties of landslide susceptibility prediction: influences of different study area scales and mapping unit scales

This study aims to investigate the effects of different mapping unit scales and study area scales on the uncertainty rules of landslide susceptibility prediction (LSP). To illustrate various study area scales, Ganzhou City in China, its eastern region (Ganzhou East), and Ruijin County in Ganzhou East were chosen. Different mapping unit scales are represented by grid units with spatial resolution of 30 and 60 m, as well as slope units that were extracted by multi-scale segmentation method. The 3855 landslide locations and 21 typical environmental factors in Ganzhou City are first determined to create spatial datasets with input-outputs. Then, landslide susceptibility maps (LSMs) of Ganzhou City, Ganzhou East and Ruijin County are produced using a support vector machine (SVM) and random forest (RF), respectively. The LSMs of the above three regions are then extracted by mask from the LSM of Ganzhou City, along with the LSMs of Ruijin County from Ganzhou East. Additionally, LSMs of Ruijin at various mapping unit scales are generated in accordance. Accuracy and landslide susceptibility indexes (LSIs) distribution are used to express LSP uncertainties. The LSP uncertainties under grid units significantly decrease as study area scales decrease from Ganzhou City, Ganzhou East to Ruijin County, whereas those under slope units are less affected by study area scales. Of course, attentions should also be paid to the broader representativeness of large study areas. The LSP accuracy of slope units increases by about 6%–10% compared with those under grid units with 30 m and 60 m resolution in the same study area's scale. The significance of environmental factors exhibits an averaging trend as study area scale increases from small to large. The importance of environmental factors varies greatly with the 60 m grid unit, but it tends to be consistent to some extent in the 30 m grid unit and the slope unit.Graphic abstract

An Object-Based Approach to Extract Aquaculture Ponds with 10-Meter Resolution Sentinel-2 Images: A Case Study of Wenchang City in Hainan Province

Coastal aquaculture has made an important contribution to global food security and the economic development of coastal zones in recent decades. However, it has also damaged these coastal zones’ ecosystems. Moreover, coastal aquaculture is poised to play a key role in the achievement of Sustainable Development Goals (SDGs). Consequently, extracting aquaculture has become crucial and valuable. However, due to the limitations of remote sensing image spatial resolution and traditional extraction methods, most research studies focus on aquaculture areas containing dikes rather than individually separable aquaculture ponds (ISAPs). This is not an accurate estimation of these aquaculture areas’ true size. In our study, we propose a rapid and effective object-based method of extracting ISAPs. We chose multi-scale segmentation to generate semantically meaningful image objects for various types of land cover, and then built a decision tree classifier according to the unique features of ISAPs. The results show that our method can remove small rivers and other easily confused features, which has thus far been difficult to accomplish with conventional methods. We obtained an overall precision value of 85.61% with a recall of 84.04%; compared to the support vector machine’s (SVM) overall precision value of 78.85% and recall rate of 61.21%, our method demonstrates greater accuracy and efficiency. We used this method to test the transferability of the algorithm to nearby areas, and the obtained accuracy exceeded 80%. The method proposed in this study could provide a readily available solution for the simple and efficient extracting of ISAPs and shows high spatiotemporal transferability.

Crop Classification Combining Object-Oriented Method and Random Forest Model Using Unmanned Aerial Vehicle (UAV) Multispectral Image

The accurate and timely identification of crops holds paramount significance for effective crop management and yield estimation. Unmanned aerial vehicle (UAV), with their superior spatial and temporal resolution compared to satellite-based remote sensing, offer a novel solution for precise crop identification. In this study, we evaluated a methodology that integrates object-oriented method and random forest (RF) algorithm for crop identification using multispectral UAV images. The process involved a multiscale segmentation algorithm, utilizing the optimal segmentation scale determined by Estimation of Scale Parameter 2 (ESP2). Eight classification schemes (S1–S8) were then developed by incorporating index (INDE), textural (GLCM), and geometric (GEOM) features based on the spectrum (SPEC) features of segmented objects. The best-trained RF model was established through three steps: feature selection, parameter tuning, and model training. Subsequently, we determined the feature importance for different classification schemes and generated a prediction map of vegetation for the entire study area based on the best-trained RF model. Our results revealed that S5 (SPEC + GLCM + INDE) outperformed others, achieving an impressive overall accuracy (OA) and kappa coefficient of 92.76% and 0.92, respectively, whereas S4 (SPEC + GEOM) exhibited the lowest performance. Notably, geometric features negatively impacted classification accuracy, while the other three feature types positively contributed. The accuracy of ginger, luffa, and sweet potato was consistently lower across most schemes, likely due to their unique colors and shapes, posing challenges for effective discrimination based solely on spectrum, index, and texture features. Furthermore, our findings highlighted that the most crucial feature was the INDE feature, followed by SPEC and GLCM, with GEOM being the least significant. For the optimal scheme (S5), the top 20 most important features comprised 10 SPEC, 7 INDE, and 3 GLCM features. In summary, our proposed method, combining object-oriented and RF algorithms based on multispectral UAV images, demonstrated high classification accuracy for crops. This research provides valuable insights for the accurate identification of various crops, serving as a reference for future advancements in agricultural technology and crop management strategies.

GFSegNet: A multi-scale segmentation model for mining area ground fissures

Precise identification of ground fissures is of paramount importance for the safety and environmental management of coal mining areas. However, the surface environment in coal mining regions is complex, and, to date, the efficiency of artificial fissure detection has been relatively low. Therefore, we have proposed a ground fissure automatic identification model based on an encoder–decoder architecture known as the Ground Fissure Segmentation Network (GFSegNet). The encoder adopts a deep-shallow decoupled mode. The shallow network achieves spatial and spectral domain interaction by introducing adaptive Fourier convolution. The deep network adopts a hierarchical Transformer with an efficient self-attention mechanism for global modeling of fine-grained semantics. The decoder is designed as a multi-scale feature fusion structure embedded in pyramid pooling modules, aiming to efficiently utilize multi-scale ground fissure information. To advance the application of deep learning in ground fissure identification, we created a coal mining area ground fissure segmentation dataset from drone imagery, known as the mine ground fissure unmanned aerial vehicle dataset (MGF-UAV). On this dataset, the overall performance of GFSegNet surpasses the current leading segmentation models, and its reliability and generalization capabilities are further validated on additional datasets (Crack500, DeepCrack, CrackForest and ISPRS-Postdam). This research has brought expansion and innovation to the field of automatic ground fissure recognition in coal mining areas, offering new perspectives and methodologies for the application of deep learning techniques in this domain.

Long sequence time-series forecasting method based on multi-scale segmentation

Long sequence time-series forecasting method based on multi-scale segmentation