Fully Convolutional Network Research Articles

VSegNet - A Variant SegNet for Improving Segmentation Accuracy in Medical Images with Class Imbalance and Limited Data

Deep learning methods for many medical image segmentation task encounter challenges like smaller datasets and class imbalance. This study proposes a variant SegNet (vSegNet) designed to deliver significantly accurate and reliable segmentation results on such datasets. The novelty lies in designing encoder and decoder blocks with an appropriate number of convolution layers and using the Dice score and Hausdorff distance (HD) as compound loss function in learning. This study used public datasets consisting of chest X-rays, axial CT slices, foot ulcer images, and subset of SPIDER dataset to benchmark segmentation task of the proposed neural network model with other popular networks like U-Net, SegNet, DeepLabv3+, VGG16, MobileNetV2, and fully convolutional network (FCN). For the segmentation of lungs in chest X-rays, vertebral body in CT, augmented data for the previous case, foot ulcer dataset, and segmentation of vertebrae, intervertebral disks and spinal canal in SPIDER dataset (MRI dataset) respectively, the proposed vSegNet performed with a Dice score of 0.96 ± 0.01, 0.90 ± 0.20, 0.95 ± 0.02, 0.86 ± 0.07, and 0.95 ± 0.01 and the HD of 14.33 ± 7.74, 8.45 ± 7.08, 7.99 ± 6.05, 29.32 ± 25.64, and 8.45 ± 2.81 with respect to the ground truth on the test dataset. These results highlight the effectiveness of the proposed model in delivering both higher segmentation accuracy and improved boundary delineation. The proposed network, vSegNet has demonstrated as an effective model for semantic segmentation on class-imbalanced smaller datasets, surpassing all other networks considered in this study in terms of mIoU, BF score, Dice score, HD, accuracy, precision, recall and F1 score on a variety of anatomical regions and medical imaging modalities.

Forecasting future earthquakes with deep neural networks: Application to California

Summary We use the spatial map of the logarithm of past estimated released earthquake energies as input of Fully Convolutional Networks (FCN) to forecast future earthquakes. This model is applied to California and compared with an elaborated version of the Epidemic Type Aftershock Sequence (ETAS) model. Our long-term earthquake forecast simulations show that the FCN model is close to the ETAS model in predicting earthquakes with $M \ge 3.0,\ 4.0,\ {\rm{and\ }}5.0$ according to the Molchan diagram. Moreover, training and implementing the FCN model is 2000∼4000 times faster than calibrating the ETAS model and generating its probabilistic forecasts. The FCN model is straightforward in terms of its neural network structure and feature engineering. It does not require extensive knowledge of statistical seismology or the analysis of earthquake catalog completeness. Using the earthquake catalog with $M \ge 0$ as FCN input can enhance the model's performance in some time-magnitude prediction windows.

Lamb Wave TDTE Super-Resolution Imaging Assisted by Deep Learning

Abstract Ultrasonic Lamb waves undergo complex mode conversion and diffraction at non-penetrating defects, such as plate corrosion and cracks. Lamb wave imaging has a resolution limit due to the guided wave dispersion characteristics and Rayleigh criterion limitations. In this paper, a full convolutional network is designed to segment and reconstruct the received signals, enabling the automatic identification of target modalities. This approach eliminates clutter and mode conversion interference when calculating direct and accompanying acoustic fields in time-domain topological energy imaging. Subsequently, the measured accompanying acoustic field is reversed for adaptive focusing on defects and enhance the imaging quality. To circumvent the limitations of the Rayleigh criterion, the direct acoustic field and the accompanying acoustic field were fused to characterize the pixel distribution in the imaging region, achieving Lamb wave super-resolution imaging. Experimental results indicate that compared to the sign coherence factor-total focusing method (SCF-TFM), the proposed method achieves a 31.41% improvement in lateral resolution and a 29.53% increase in signal-to-noise ratio for single-blind-hole defects. In the case of multiple-blind-hole defects with spacings greater than the Rayleigh criterion resolution limit, it exhibits a 27.23% enhancement in signal-to-noise ratio. On the contrary, when the defect spacings are relatively smaller than the limit, this method has a higher resolution limit than SCF-TFM in super-resolution imaging.

Advances in Medical Image Segmentation: A Comprehensive Review of Traditional, Deep Learning and Hybrid Approaches.

Medical image segmentation plays a critical role in accurate diagnosis and treatment planning, enabling precise analysis across a wide range of clinical tasks. This review begins by offering a comprehensive overview of traditional segmentation techniques, including thresholding, edge-based methods, region-based approaches, clustering, and graph-based segmentation. While these methods are computationally efficient and interpretable, they often face significant challenges when applied to complex, noisy, or variable medical images. The central focus of this review is the transformative impact of deep learning on medical image segmentation. We delve into prominent deep learning architectures such as Convolutional Neural Networks (CNNs), Fully Convolutional Networks (FCNs), U-Net, Recurrent Neural Networks (RNNs), Adversarial Networks (GANs), and Autoencoders (AEs). Each architecture is analyzed in terms of its structural foundation and specific application to medical image segmentation, illustrating how these models have enhanced segmentation accuracy across various clinical contexts. Finally, the review examines the integration of deep learning with traditional segmentation methods, addressing the limitations of both approaches. These hybrid strategies offer improved segmentation performance, particularly in challenging scenarios involving weak edges, noise, or inconsistent intensities. By synthesizing recent advancements, this review provides a detailed resource for researchers and practitioners, offering valuable insights into the current landscape and future directions of medical image segmentation.

Sky-GVIO: Enhanced GNSS/INS/Vision Navigation with FCN-Based Sky Segmentation in Urban Canyon

Accurate, continuous, and reliable positioning is critical to achieving autonomous driving. However, in complex urban canyon environments, the vulnerability of stand-alone sensors and non-line-of-sight (NLOS) caused by high buildings, trees, and elevated structures seriously affect positioning results. To address these challenges, a sky-view image segmentation algorithm based on a fully convolutional network (FCN) is proposed for NLOS detection in global navigation satellite systems (GNSSs). Building upon this, a novel NLOS detection and mitigation algorithm (named S−NDM) uses a tightly coupled GNSS, inertial measurement units (IMUs), and a visual feature system called Sky−GVIO with the aim of achieving continuous and accurate positioning in urban canyon environments. Furthermore, the system combines single-point positioning (SPP) with real-time kinematic (RTK) methodologies to bolster its operational versatility and resilience. In urban canyon environments, the positioning performance of the S−NDM algorithm proposed in this paper is evaluated under different tightly coupled SPP−related and RTK−related models. The results exhibit that the Sky−GVIO system achieves meter-level accuracy under the SPP mode and sub-decimeter precision with RTK positioning, surpassing the performance of GNSS/INS/Vision frameworks devoid of S−NDM. Additionally, the sky-view image dataset, inclusive of training and evaluation subsets, has been made publicly accessible for scholarly exploration.

Partial Discharge Detection Technique Based on Full Convolutional Network with Channel-wise Convolution and Channel Mixing

Abstract The occurrence of partial discharge (PD) serves as an indication of power equipment failure, which, if not given due attention, may result in severe power accidents. Traditionally, the detection of PD involves applying various pre-processing techniques to the original signal and extracting specialized signal features that are subsequently classified using a classifier. The process is intricate and demands extensive expertise. One drawback of the conventional detection approach lies in its failure to consider the information conveyed between the phases of a three-phase electrical signal during the process of identifying PD in medium voltage three-phase cables. The present study proposes a novel method for detecting PDs, which is based on channel-wise convolution and channel mixing(C2CM) using full convolutional networks. Firstly, a set of pulses for each phase of a three-phase signal is extracted and combined to form a three-phase pulse set, serving as the input to the network. Subsequently, we introduce a FCN-C2CM network designed specifically for PD detection, capable of learning both the time-domain features of the input signal and the phase features of the three-phase signal, thereby enhancing recognition accuracy. We evaluated our approach using online testing tools on publicly available datasets, with experimental results demonstrating its superiority over existing.

Fully convolutional networks-based particle distribution analysis at multiphase interfaces

The intricate interplay between droplet dynamics and particle characteristics has led to the extensive use of particle-laden droplets in diverse applications, spanning industrial engineering and scientific research. Accurate particle distribution analysis at multiphase interfaces is crucial for understanding the complex behaviors of these soft matters, for example, liquid marbles (LMs). However, traditional image analysis methods for particle-laden interfaces often rely on manual processing, which is both time-consuming and susceptible to human error. In this study, we present a pixel-level image recognition technique based on fully convolutional networks (FCNs) to automatically analyze the interfacial particle distribution of LMs exhibiting clear core-shell structures. The FCNs-based method enables efficient and accurate segmentation of target particles on sessile LMs, utilizing experimental data obtained from an in-situ optical imaging device. This approach significantly expedites the analysis of particle distribution, including proportion, concentration, and cluster centers. We assess the performance of the proposed method using image data of monolayer LMs encapsulated by dispersed polystyrene microspheres, demonstrating its superiority over traditional techniques in terms of accuracy and generalization. This investigation aims to offer novel insights into determining pertinent particulate characteristics within similar solid-liquid hybrid microsystems.

Overcoming the Barrier of Incompleteness: A Hyperspectral Image Classification Full Model.

Deep learning-based methods have shown promising outcomes in many fields. However, the performance gain is always limited to a large extent in classifying hyperspectral image (HSI). We discover that the reason behind this phenomenon lies in the incomplete classification of HSI, i.e., existing works only focus on a certain stage that contributes to the classification, while ignoring other equally or even more significant phases. To address the above issue, we creatively put forward three elements needed for complete classification: the extensive exploration of available features, adequate reuse of representative features, and differential fusion of multidomain features. To the best of our knowledge, these three elements are being established for the first time, providing a fresh perspective on designing HSI-tailored models. On this basis, an HSI classification full model (HSIC-FM) is proposed to overcome the barrier of incompleteness. Specifically, a recurrent transformer corresponding to Element 1 is presented to comprehensively extract short-term details and long-term semantics for local-to-global geographical representation. Afterward, a feature reuse strategy matching Element 2 is designed to sufficiently recycle valuable information aimed at refined classification using few annotations. Eventually, a discriminant optimization is formulized in accordance with Element 3 to distinctly integrate multidomain features for the purpose of constraining the contribution of different domains. Numerous experiments on four datasets at small-, medium-, and large-scale demonstrate that the proposed method outperforms the state-of-the-art (SOTA) methods, such as convolutional neural network (CNN)-, fully convolutional network (FCN)-, recurrent neural network (RNN)-, graph convolutional network (GCN)-, and transformer-based models (e.g., accuracy improvement of more than 9% with only five training samples per class). The code will be available soon at https://github.com/jqyang22/ HSIC-FM.

Arc bubble edge detection method based on deep transfer learning in underwater wet welding.

The stability of arc bubble is a crucial indicator of underwater wet welding process. However, limited research exists on detecting arc bubble edges in such environments, and traditional algorithms often produce blurry and discontinuous results. To address these challenges, we propose a novel arc bubble edge detection method based on deep transfer learning for processing underwater wet welding images. The proposed method integrates two training stages: pre-training and fine-tuning. In the pre-training stage, a large source domain dataset is used to train VGG16 as a feature extractor. In the fine-tuning stage, we introduce the Attention-Scale-Semantics (ASS) model, which consists of a Convolutional Block Attention Module (CBAM), a Scale Fusion Module (SCM) and a Semantic Fusion Module (SEM). The ASS model is further trained on a small target domain dataset specific to underwater wet welding to fine-tune the model parameters. The CBAM can adaptively weight the feature maps, focusing on more crucial features to better capture edge information. The SCM training method maximizes feature utilization and simplifies training by combining multi-scale features. Additionally, the skip structure of SEM effectively mitigates semantic loss in the high-level network, enhancing the accuracy of edge detection. On the BSDS500 dataset and a self-constructed underwater wet welding dataset, the ASS model was evaluated against conventional edge detection models-Richer Convolutional Features (RCF), Fully Convolutional Network (FCN), and UNet-as well as state-of-the-art models LDC and TEED. In terms of Mean Absolute Error (MAE), accuracy, and other evaluation metrics, the ASS model consistently outperforms these models, demonstrating edge detection capabilities that are both effective and stable in detecting arc bubble edges in underwater wet welding images.

The Data Analysis of Enterprise Operational Risk Prediction Under Machine Learning

In the digital age, the financial sector faces increasingly severe risk management challenges. Traditional methods often rely on historical data and statistical models, which struggle to cope with the high volatility of the market. These methods exhibit poor adaptability in rapidly changing financial markets and often fail to meet demands in terms of accuracy and reliability. To address these issues, this study proposes a law risk prediction model based on deep learning—the WBIF model. This model integrates Bidirectional Long Short-Term Memory (BiLSTM) and Fully Convolutional Networks (FCN) and employs the Whale Optimization Algorithm (WOA) for parameter optimization. Experimental results show that compared to traditional models, the WBIF model reduces the Mean Absolute Error (MAE) by 51.73% on the UCI machine learning library dataset and improves accuracy by 12% on the Kaggle credit card fraud detection dataset.

Deep neural networks for automated damage classification in image-based visual data of reinforced concrete structures

Significant strides in deep learning for image recognition have expanded the potential of visual data in assessing damage to reinforced concrete (RC) structures. Our study proposes an automated technique, merging convolutional neural networks (CNNs) and fully convolutional networks (FCNs), to detect, classify, and segment building damage. These deep networks extract RC damage-related features from high-resolution smartphone images (3264 × 2448 pixels), categorized into two groups: damage (exposed reinforcement and spalled concrete) and undamaged area. With a labeled dataset of 2000 images, fine-tuning of network architecture and hyperparameters ensures effective training and testing. Remarkably, we achieve 98.75 % accuracy in damage classification and 95.98 % in segmentation, without overfitting. Both CNNs and FCNs play crucial roles in extracting features, showcasing the adaptability of deep learning. Our promising results validate the potential of these techniques for inspectors, providing an effective means to assess the severity of identified damage in image-based evaluations.

A Light-Weight Self-Supervised Infrared Image Perception Enhancement Method

Convolutional Neural Networks (CNNs) have achieved remarkable results in the field of infrared image enhancement. However, the research on the visual perception mechanism and the objective evaluation indicators for enhanced infrared images is still not in-depth enough. To make the subjective and objective evaluation more consistent, this paper uses a perceptual metric to evaluate the enhancement effect of infrared images. The perceptual metric mimics the early conversion process of the human visual system and uses the normalized Laplacian pyramid distance (NLPD) between the enhanced image and the original scene radiance to evaluate the image enhancement effect. Based on this, this paper designs an infrared image-enhancement algorithm that is more conducive to human visual perception. The algorithm uses a lightweight Fully Convolutional Network (FCN), with NLPD as the similarity measure, and trains the network in a self-supervised manner by minimizing the NLPD between the enhanced image and the original scene radiance to achieve infrared image enhancement. The experimental results show that the infrared image enhancement method in this paper outperforms existing methods in terms of visual perception quality, and due to the use of a lightweight network, it is also the fastest enhancement method currently.

A model-based deep learning framework for damage classification and detection in polycarbonate infused with AEROSIL under dynamic loading conditions

Composite 3D printing is a significant engineering application owing to its robustness, ability to achieve complex geometries, and ease of use. Polycarbonate, particularly when infused with AEROSIL, is an interesting thermoplastic and potential candidate for 3D printing with enhanced properties. The primary objective of this research is to develop a new model-based deep-learning framework to classify and detect damage in this material under dynamic loading conditions. To achieve this, a FASTCAM high-speed camera was placed in front of the SHPB test setup to capture dynamic damage. The test results were then used as label inputs for training the advanced deep learning algorithms, focusing on dense image recognition techniques for detailed damage analysis. The study involved a series of fully convolutional networks (FCNs), evaluating semantic segmentation with U-Net and instance segmentation with state-of-the-art frameworks such as YOLOv8 and Mask R–CNN. A comparative analysis revealed that deep learning models outperform traditional methods, providing efficient and accurate damage classification and detection. The U-Net model demonstrated the ability to recognize cubes and bars but was limited in detecting minor damage regardless of size. YOLO-V8, which specializes in case segmentation, achieved remarkable performance in detecting significant damage but struggled to accurately identify minor damage. By leveraging deep learning techniques, this study enables an efficient and accurate damage assessment, which is crucial for ensuring the reliability and safety of composite structures in various industries.

Advanced Global Prototypical Segmentation Framework for Few-Shot Hyperspectral Image Classification.

With the advancement of deep learning, related networks have shown strong performance for Hyperspectral Image (HSI) classification. However, these methods face two main challenges in HSI classification: (1) the inability to capture global information of HSI due to the restriction of patch input and (2) insufficient utilization of information from limited labeled samples. To overcome these challenges, we propose an Advanced Global Prototypical Segmentation (AGPS) framework. Within the AGPS framework, we design a patch-free feature extractor segmentation network (SegNet) based on a fully convolutional network (FCN), which processes the entire HSI to capture global information. To enrich the global information extracted by SegNet, we propose a Fusion of Lateral Connection (FLC) structure that fuses the low-level detailed features of the encoder output with the high-level features of the decoder output. Additionally, we propose an Atrous Spatial Pyramid Pooling-Position Attention (ASPP-PA) module to capture multi-scale spatial positional information. Finally, to explore more valuable information from limited labeled samples, we propose an advanced global prototypical representation learning strategy. Building upon the dual constraints of the global prototypical representation learning strategy, we introduce supervised contrastive learning (CL), which optimizes our network with three different constraints. The experimental results of three public datasets demonstrate that our method outperforms the existing state-of-the-art methods.

AN INTELLIGENT MODEL FOR BENIGN AND MALIGNANT PULMONARY NODULE ANALYSIS USING U-NET NETWORKS AND MULTILEVEL ATTENTION MECHANISMS

A key study area throughout the medical sector for image processing and analysis is medical image segmentation. The diagnosis and treatment strategies of doctors may have a solid foundation owing to accurate and effective medical image segmentation. Conventional approaches in this field rely on manual feature extraction, which makes segmentation complex, costs doctors’ time and energy, and involves a subjective evaluation that is readily susceptible to diagnostic errors. Researchers have applied convolutional neural network-based deep learning techniques to the segmentation of medical images as a result of their impressive advancements and successes in the field of computer vision. The research described here uses the U-Net network’s outstanding feature learning capabilities and end-to-end processing mode for lung CT image segmentation via fully convolutional network (FCN) research. However, focusing on valuable, crucial information aspects in the U-Net network is challenging. This study employed multilevel attention mechanisms on the basis of U-Net networks to enhance the model’s accuracy in lung CT image segmentation. These mechanisms were inspired by attention mechanisms. By improving the segmentation accuracy and optimizing the segmentation effect, the new model embeds a self-attention module in front of each upsampling layer in the U-Net model. This module provides more detailed information by stitching the self-attention module of the original image and then suppresses irrelevant and redundant information by using the effect of feature extraction of the upsampling layer. Several additional comparative experiments were conducted on the 2019nCoVR dataset. The outcomes demonstrate the efficacy of the optimized model described in this paper and its application results in improved segmentation effects in lung CT images. Additionally, the new model has distinct advantages over existing approaches that are typical of medical image segmentation, which represent its higher level of lung CT image segmentation.

A Multi-Stage Automatic Method Based on a Combination of Fully Convolutional Networks for Cardiac Segmentation in Short-Axis MRI

Magnetic resonance imaging (MRI) is a non-invasive technique used in cardiac diagnosis. Using it, specialists can measure the masses and volumes of the right ventricle (RV), left ventricular cavity (LVC), and myocardium (MYO). Segmenting these structures is an important step before this measurement. However, this process can be laborious and error-prone when done manually. This paper proposes a multi-stage method for cardiac segmentation in short-axis MRI based on fully convolutional networks (FCNs). This automatic method comprises three main stages: (1) the extraction of a region of interest (ROI); (2) MYO and LVC segmentation using a proposed FCN called EAIS-Net; and (3) the RV segmentation using another proposed FCN called IRAX-Net. The proposed method was tested with the ACDC and M&Ms datasets. The main evaluation metrics are end-diastolic (ED) and end-systolic (ES) Dice. For the ACDC dataset, the Dice results (ED and ES, respectively) are 0.960 and 0.904 for the LVC, 0.880 and 0.892 for the MYO, and 0.910 and 0.860 for the RV. For the M&Ms dataset, the ED and ES Dices are 0.861 and 0.805 for the LVC, 0.733 and 0.759 for the MYO, and 0.721 and 0.694 for the RV. These results confirm the feasibility of the proposed method.

Enhancing food crop classification in agriculture through dipper throat optimization and deep learning with remote sensing

Remote sensing images (RSIs), a keystone of modern agricultural technology, refer to spectral or visual data captured from drones, satellites, or aircraft without direct physical contact with the Earth's surface. These images provide a wide-ranging view of agricultural landscapes, providing valuable insights into land use, crop health, and environmental conditions. Agricultural food crop classification, a vital application within precision agriculture, includes the detection and classification of different crops cultivated in a certain region. Traditionally reliant on manual techniques, the development of technologies, particularly the incorporation of RSIs, has revolutionized this process. Agricultural food crop classification has become more sophisticated and automated by harnessing the wealth of data received from RS, which facilitates precise management and monitoring of crops on a large scale. Deep learning (DL), a branch of artificial intelligence, plays a more effective role in these synergies. The incorporation of DL into the RSI analysis enables high-precision and efficient detection of various crop types, assisting more informed decision-making in agriculture. This study proposes a new Dipper Throat Optimization Algorithm with Deep Learning based Food Crop Classification (DTOADL-FCC) algorithm using Remote Sensing Imaging for Agricultural Resource Management. The DTOADL-FCC method aims to apply DL algorithms for the classification of different crop types. In the DTOADL-FCC method, fully convolutional network (FCN) based segmentation process is performed. Next, the DTOADL-FCC method exploits the SE-ResNet model for learning intrinsic and complex features. The DTOADL-FCC method makes use of DTOA for the hyperparameter tuning process. Lastly, the classification of crop types takes place using the extreme learning machine (ELM) model. The study utilizes mathematical formulations including activation functions, loss functions, fitness calculations, and iterative update processes. A brief set of simulations showcases that the DTOADL-FCC method achieves remarkable performance over other techniques with much improved results.

Automatic Foreign Matter Segmentation System for Superabsorbent Polymer Powder: Application of Diffusion Adversarial Representation Learning

In current industries, sampling inspections of the quality of powders, such as superabsorbent polymers (SAPs) still are conducted via visual inspection. The size of samples and foreign matter are around 500 μm, making them difficult for humans to identify. An automatic foreign matter detection system for powder has been developed in the present study. The powder samples can be automatically delivered, distributed, and recycled, and images of them are captured through the hardware of the system, while the identification software of this system was developed based on diffusion adversarial representation learning (DARL). The background image is a foreign-matter-free powder image with an input image size of 1024 × 1024 × 3. Since DARL includes adversarial segmentation, a diffusion process, and synthetic image generation, the DARL model was trained using a diffusion block with the employment of a U-Net attention mechanism and a spatial-adaptation de-normalization (SPADE) layer through the adoption of a loss function from a vanilla generative adversarial network (GAN). This model was then compared with supervised models such as a fully convolutional network (FCN), U-Net, and DeepLABV3+, as well as with an unsupervised Otsu threshold segmentation. It should be noted that only 10% of the training samples were utilized for the DARL to learn and the intersection over union (IoU) of the DARL can reach up to 80.15%, which is much higher than the 59.00%, 53.47%, 49.39%, and 30.08% for the Otsu threshold segmentation, FCN, U-Net, and DeepLABV3+ models. Therefore, the performance of the model developed in the present study would not be degraded due to an insufficient number of samples containing foreign matter. In practical applications, there is no need to collect, label, and design features for a large number of foreign matter samples before using the developed system.

A Segment Anything Model based weakly supervised learning method for crop mapping using Sentinel-2 time series images

Automatic crop mapping is essential for various agricultural applications. Although fully convolutional networks (FCNs) have shown effectiveness in crop mapping, they rely on labor-intensive pixel-level annotations. Weakly supervised semantic segmentation (WSSS) methods offer a solution by enabling pixel-level segmentation with less costly annotations, such as point, bounding box (bbox), and image-level annotations. However, these weak annotations often lack complete object information, leading to reduced accuracy. Moreover, there is limited exploration of WSSS methods in medium-resolution satellite imagery, such as Sentinel-2. Therefore, this study proposes SAMWS, a WSSS method based on the Segment Anything Model (SAM) for crop mapping using Sentinel-2 time series images. Leveraging SAM, our method can generate high-quality pseudo labels and accommodate various weak annotations without extensive adjustments. SAMWS comprises three stages: 1) finetuning SAM with adapters; 2) generating pseudo labels using weak annotations and finetuned SAM; and 3) training a segmentation network using pseudo labels for crop mapping. Experiments conducted on PASTIS and Munich datasets demonstrate the superiority of our approach. After SAM was finetuned with adapters, the F1-scores for parcel segmentation using point and bbox prompts increased by 75.0 % and 14.4 %, respectively, reaching 0.880 and 0.931. Additionally, our method achieves classification results closest to fully supervised learning when using point, bbox, and image-level annotations, with F1-scores of 0.810, 0.817, and 0.779, respectively. Our approach offers valuable insights into leveraging foundation models in the remote sensing domain and contains significant potential for crop monitoring. The relevant code will be made publicly available at https://github.com/Nick0317Sun/SAMWS.

The street space planning and design of artificial intelligence-assisted deep learning neural network in the Internet of Things

This study begins by discussing Internet of Things (IoT) technology and analyzing the classification of street space into four types, along with the Green Looking Ratio (GLR). Following this, the Fully Convolutional Network (FCN)-8s framework is employed to construct a street view image semantic segmentation model based on FCN principles. Subsequently, IoT technology is utilized to analyze the proportion of GLR and satisfaction in the street space within the historical urban area of T City. The findings reveal a significant positive correlation (significance level p < 0.05, R2 = 0.919) between the GLR satisfaction score of street view images and the average GLR of the area. Among the four types of street space—life leisure, historical streets, traffic areas, and landscape-style streets—the dissatisfaction rates with GLR are 35 %, 33 %, 20 %, and 18 %, respectively, correlating with varying GLR satisfaction levels. To enhance street space greening, planting ponds and boxes are proposed for "blind spots” and "dead corners,” thereby completing greenery in these areas. These initiatives aim to improve street greening policies, integrate street function zones, and advance the scientific greening of urban streets. The analysis of GLR and satisfaction in street spaces provides valuable insights for refining urban street space greening efforts.