Semantic Segmentation Algorithms Research Articles

Improved keypoint localization network for tea bud based on YOLO framework

The precise localization of picking points is the primary challenge that should be addressed by the robotic tea bud harvester. The efficient identification and accurate positioning of picking points directly affects the efficiency of tea buds harvesting. Compared with the target detection and semantic segmentation algorithms, the keypoint detection algorithms do not require to incorporate target shape features for accurately localizing the picking point, which allows to significantly decrease the computational load, and thus facilitates the subsequent point cloud processing. This study introduces a tea bud keypoint detection network referred to as TBKNet. This model uses the concept of structural reparameterization to reconstruct the CSPDarknet53 backbone network, and constructs an asymptotic parallel feature fusion network by incorporating the CA attention mechanism into the asymptotic feature pyramid network. In addition, in order to accelerate the convergence of the model, a keypoint regression loss function, which considers the angle and Euclidean distance, is proposed. The experimental results show that TBNKet reaches the highest accuracy with an average precision of 87.1 % for keypoint detection. It has 5.7 %, 16.9 %, and 3.3 % higher mAP values compared with the DEKR, YOLOPose, and YOLOPv8-Pose models, respectively. This is efficient in identifying and localizing keypoints of tea buds, and it can provide guidance for similar intensive harvesting tasks.

A Self-Supervised Few-Shot Semantic Segmentation Method Based on Multi-Task Learning and Dense Attention Computation

Nowadays, autonomous driving technology has become widely prevalent. The intelligent vehicles have been equipped with various sensors (e.g. vision sensors, LiDAR, depth cameras etc.). Among them, the vision systems with tailored semantic segmentation and perception algorithms play critical roles in scene understanding. However, the traditional supervised semantic segmentation needs a large number of pixel-level manual annotations to complete model training. Although few-shot methods reduce the annotation work to some extent, they are still labor intensive. In this paper, a self-supervised few-shot semantic segmentation method based on Multi-task Learning and Dense Attention Computation (dubbed MLDAC) is proposed. The salient part of an image is split into two parts; one of them serves as the support mask for few-shot segmentation, while cross-entropy losses are calculated between the other part and the entire region with the predicted results separately as multi-task learning so as to improve the model’s generalization ability. Swin Transformer is used as our backbone to extract feature maps at different scales. These feature maps are then input to multiple levels of dense attention computation blocks to enhance pixel-level correspondence. The final prediction results are obtained through inter-scale mixing and feature skip connection. The experimental results indicate that MLDAC obtains 55.1% and 26.8% one-shot mIoU self-supervised few-shot segmentation on the PASCAL-5i and COCO-20i datasets, respectively. In addition, it achieves 78.1% on the FSS-1000 few-shot dataset, proving its efficacy.

Border-Enhanced Triple Attention Mechanism for High-Resolution Remote Sensing Images and Application to Land Cover Classification

With the continuous development and popularization of remote sensing technology, remote sensing images have been widely used in the field of land cover classification. Since remote sensing images have complex spatial structure and texture features, it is becoming a challenging problem to accurately categorize them. Land cover classification has practical application value in various fields, such as environmental monitoring and protection, urban and rural planning and management, and climate change research. In recent years, remote sensing image classification methods based on deep learning have been rapidly developed, in which semantic segmentation technology has become one of the mainstream methods for land cover classification using remote sensing image. Traditional semantic segmentation algorithms tend to ignore the edge information, resulting in poor classification of the edge part in land cover classification, and there are numerous attention mechanisms to make improvements for these problems. In this paper, a triple attention mechanism, BETAM (Border-Enhanced Triple Attention Mechanism), for edge feature enhancement of high-resolution remote sensing images is proposed. Furthermore, a new model on the basis of the semantic segmentation network model DeeplabV3+ is also introduced, which is called DeepBETAM. The triple attention mechanism BETAM is able to capture feature dependencies in three dimensions: position, space, and channel, respectively. Through feature importance weighting, modeling of spatial relationships, and adaptive learning capabilities, the model BETAM pays more attention to edge features, thus improving the accuracy of edge detection. A remote sensing image dataset SMCD (Subject Meticulous Categorization Dataset) is constructed to verify the robustness of the attention mechanism BETAM and the model DeepBETAM. Extensive experiments were conducted on the two self-built datasets FRSID and SMCD. Experimental results showed that the mean Intersection over Union (mIoU), mean Pixel Accuracy (mPA), and mean Recall (mRecall) of DeepBETAM are 63.64%, 71.27%, and 71.31%, respectively. These metrics are superior to DeeplabV3+, DeeplabV3+(SENet), DeeplabV3+(CBAM), DeeplabV3+(SAM), DeeplabV3+(ECANet), and DeeplabV3+(CAM), which are network models that incorporate different attention mechanisms. The reason is that BETAM has better edge segmentation results and segmentation accuracy. Meanwhile, on the basis of the self-built dataset, the four main classifications of buildings, cultivated land, water bodies and vegetation were subdivided and detected, and good experimental results were obtained, which verified the robustness of the attention mechanism BETAM and the model DeepBETAM. The method has broad application prospects and can provide favorable support for research and application in the field of surface classification.

Research on a Train Safety Driving Method Based on Fusion of an Incremental Clustering Algorithm and Lightweight Shared Convolution

This paper addresses the challenge of detecting unknown or unforeseen obstacles in railway track transportation, proposing an innovative detection strategy that integrates an incremental clustering algorithm with lightweight segmentation techniques. In the detection phase, the paper innovatively employs the incremental clustering algorithm as a core method, combined with dilation and erosion theories, to expand the boundaries of point cloud clusters, merging adjacent point cloud elements into unified clusters. This method effectively identifies and connects spatially adjacent point cloud clusters while efficiently eliminating noise from target object point clouds, thereby achieving more precise recognition of unknown obstacles on the track. Furthermore, the effective integration of this algorithm with lightweight shared convolutional semantic segmentation algorithms enables accurate localization of obstacles. Experimental results using two combined public datasets demonstrate that the obstacle detection average recall rate of the proposed method reaches 90.3%, significantly enhancing system reliability. These findings indicate that the proposed detection strategy effectively improves the accuracy and real-time performance of obstacle recognition, thereby presenting important practical application value for ensuring the safe operation of railway tracks.

Evaluation of OCT biomarker changes in treatment-naive neovascular AMD using a deep semantic segmentation algorithm.

To determine real-life quantitative changes in OCT biomarkers in a large set of treatment naive patients in a real-life setting undergoing anti-VEGF therapy. For this purpose, we devised a novel deep learning based semantic segmentation algorithm providing the first benchmark results for automatic segmentation of 11 OCT features including biomarkers for neovascular age-related macular degeneration (nAMD). Training of a Deep U-net based semantic segmentation ensemble algorithm for state-of-the-art semantic segmentation performance which was used to analyze OCT features prior to, after 3 and 12 months of anti-VEGF therapy. High F1 scores of almost 1.0 for neurosensory retina and subretinal fluid on a separate hold-out test set with unseen patients. The algorithm performed worse for subretinal hyperreflective material and fibrovascular PED, on par with drusenoid PED, and better in segmenting fibrosis. In the evaluation of treatment naive OCT scans, significant changes occurred for intraretinal fluid (mean: 0.03 µm3 to 0.01 µm3, p < 0.001), subretinal fluid (0.08 µm3 to 0.01 µm3, p < 0.001), subretinal hyperreflective material (0.02 µm3 to 0.01 µm3, p < 0.001), fibrovascular PED (0.12 µm3 to 0.09 µm3, p = 0.02) and central retinal thickness C0 (225.78 µm3 to 169.40 µm3). The amounts of intraretinal fluid, fibrovascular PED, and ERM were predictive of poor outcome. The segmentation algorithm allows efficient volumetric analysis of OCT scans. Anti-VEGF provokes most potent changes in the first 3 months while a gradual loss of RPE hints at a progressing decline of visual acuity. Additional research is required to understand how these accurate OCT predictions can be leveraged for a personalized therapy regimen.

Study on a Landslide Segmentation Algorithm Based on Improved High-Resolution Networks

Landslides are a kind of geological hazard with great destructive potential. When a landslide event occurs, a reliable landslide segmentation method is important for assessing the extent of the disaster and preventing secondary disasters. Although deep learning methods have been applied to improve the efficiency of landslide segmentation, there are still some problems that need to be solved, such as the poor segmentation due to the similarity between old landslide areas and the background features and missed detections of small-scale landslides. To tackle these challenges, a proposed high-resolution semantic segmentation algorithm for landslide scenes enhances the accuracy of landslide segmentation and addresses the challenge of missed detections in small-scale landslides. The network is based on the high-resolution network (HR-Net), which effectively integrates the efficient channel attention mechanism (efficient channel attention, ECA) into the network to enhance the representation quality of the feature maps. Moreover, the primary backbone of the high-resolution network is further enhanced to extract more profound semantic information. To improve the network’s ability to perceive small-scale landslides, atrous spatial pyramid pooling (ASPP) with ECA modules is introduced. Furthermore, to address the issues arising from inadequate training and reduced accuracy due to the unequal distribution of positive and negative samples, the network employs a combined loss function. This combined loss function effectively supervises the training of the network. Finally, the paper enhances the Loess Plateau landslide dataset using a fractional-order-based image enhancement approach and conducts experimental comparisons on this enriched dataset to evaluate the enhanced network’s performance. The experimental findings show that the proposed methodology achieves higher accuracy in segmentation performance compared to other networks.

Semantic segmentation algorithm for video from UAV based on adaptive keyframe scheduling via similarity measurement

Abstract Unmanned aerial vehicle (UAV) videos exhibit complex object motion features and significant differences between frame features. To solve the problems of feature information loss and drastic accuracy decline in applying the video semantic segmentation method based on the fixed-period update strategy of keyframes, a keyframe recognition method based on similarity measurement is proposed, forming a video semantic segmentation algorithm based on adaptive keyframe scheduling. one keyframe recognition method based on pixel similarity measurement is established by modeling the similarity relationship between low-level pixels in adjacent frames. Meanwhile, the other keyframe recognition method based on feature similarity measurement is established by constructing a shallow Siamese network to measure the similarity relationship between features of frames. Then a discriminative network is constructed based on the obtained similarity of inter frames, and the segmentation process is accelerated by reusing features of keyframes through the optical flow network. Thereby a video semantic segmentation method for UAV based on adaptive keyframe strategy is established. The effectiveness of the proposed video semantic segmentation algorithm is verified on UAVid dataset. The results demonstrated that the speed of the proposed algorithm reaches 53.2 FPS and 54.5 FPS on the premise that the mean intersection over union is higher than 40% (this value is compared with the segmentation accuracy in the balanced mode when the similarity threshold is 0.76 and 0.88, respectively), which is 18.5 FPS and 19.8 FPS higher than the PSPNet image semantic segmentation algorithm. In addition, analysis of experiment results shows that the pixel-similarity-based keyframe recognition is suitable for high-precision video semantic segmentation scenes that need to improve segmentation efficiency, and the feature-similarity-based keyframe recognition is more suitable for high real-time video semantic segmentation tasks that require a small decrease in overall algorithm accuracy. &amp;#xD;In a word, the proposed video semantic segmentation algorithm based on adaptive keyframe scheduling via similarity measurement can improve segmentation speed while ensuring segmentation accuracy and stability.&amp;#xD;

AdSegNet: a deep network to localize billboard in outdoor scenes

AbstractOver the past decade, there has been a remarkable expansion in the popularity of online videos, due to the variety of content that has become accessible on the internet. This expansion presents an opportunity for advertising and marketing agencies to take advantage of targeted advertisements. Targeted advertisements can be accomplished by replacing an existing advertisement within an image frame with a new one. There is a limited amount of research on the general task of localizing billboard or advertisement board in outdoor scenes. Therefore, in this study, we proposed a deep neural network that uses a fusion of VGG16 and SegNet architecture to accurately identify the location of an advertisement in an image frame. To evaluate the effectiveness of our proposed method, we compare our proposed method to other semantic segmentation algorithms using a publicly available dataset of outdoor scenes annotated with binary maps of billboards. Our experimental results show that the proposed method achieves 98.58% training accuracy for billboard localization, while testing results gave 96.43% testing accuracy. Additionally, the low RMSE score of our AdSegNet model suggests that it can accurately determine the four corners of the billboard. Therefore, our approach could be beneficial to advertising and marketing agencies that seek to utilize targeted advertisements

Research on identification of nucleus-shaped anomaly regions in space electric field

The presence of nucleus-shaped anomalous regions in the power spectrum image of the electric field VLF frequency band has been discovered in previous studies. To detect and analyze these nucleus-shaped abnormal areas and improve the recognition rate of nucleus-shaped abnormal areas, this paper proposes a new nucleus-shaped abnormal area detection model ODM_Unet (Omni-dimensional Dynamic Mobile U-net) based on U-net network. Firstly, the power spectrum image data used for training is created and labeled to form a dataset of nucleus-shaped anomalous regions; Secondly, the ODConv (Omni-dimensional Dynamic Convolution) module with embedded attention mechanism was introduced to improve the encoder, extracting nucleus-shaped anomaly region information from four dimensions and focusing on the features of different input data; An SDI (Semantics and Detail Infusion) module is introduced between the encoder and decoder to solve the problem of detail semantic loss in high-level images caused by the reduction of downsampling image size; In the decoder stage, the SCSE (Spatial and Channel Squeeze-and-Excitation) attention module is introduced to more finely adjust the feature maps output through the SDI module. The experimental results show that compared with the current popular semantic segmentation algorithms, the ODM_Unet model has the best detection performance in nucleus-shaped anomaly areas. Using this model to detect data from November 2021 to October 2022, it was found that the frequency of nucleus-shaped anomaly areas is mostly between 0 and 12.5KHz, with geographic spatial distribution ranging from 40° to 70° south and north latitudes, and magnetic latitude spatial distribution ranging from 58° to 80° south and north latitudes. This method has reference significance for detecting other types of spatial electromagnetic field disturbances.

Semantic Segmentation Algorithm for Video from UAV Based on Adaptive Keyframe Scheduling via Similarity Measurement

Abstract Unmanned aerial vehicle (UAV) videos exhibit complex object motion features and significant differences between frame features. To solve the problems of feature information loss and drastic accuracy decline in applying the video semantic segmentation method based on the fixed-period update strategy of keyframes, a keyframe recognition method based on similarity measurement is proposed, forming a video semantic segmentation algorithm based on adaptive keyframe scheduling. one keyframe recognition method based on pixel similarity measurement is established by modeling the similarity relationship between low-level pixels in adjacent frames. Meanwhile, the other keyframe recognition method based on feature similarity measurement is established by constructing a shallow Siamese network to measure the similarity relationship between features of frames. Then a discriminative network is constructed based on the obtained similarity of inter frames, and the segmentation process is accelerated by reusing features of keyframes through the optical flow network. Thereby a video semantic segmentation method for UAV based on adaptive keyframe strategy is established. The effectiveness of the proposed video semantic segmentation algorithm is verified on UAVid dataset. The results demonstrated that the speed of the proposed algorithm reaches 53.2 FPS and 54.5 FPS on the premise that the mean intersection over union is higher than 40% (this value is compared with the segmentation accuracy in the balanced mode when the similarity threshold is 0.76 and 0.88, respectively), which is 18.5 FPS and 19.8 FPS higher than the PSPNet image semantic segmentation algorithm. In addition, analysis of experiment results shows that the pixel-similarity-based keyframe recognition is suitable for high-precision video semantic segmentation scenes that need to improve segmentation efficiency, and the feature-similarity-based keyframe recognition is more suitable for high real-time video semantic segmentation tasks that require a small decrease in overall algorithm accuracy. &amp;#xD;In a word, the proposed video semantic segmentation algorithm based on adaptive keyframe scheduling via similarity measurement can improve segmentation speed while ensuring segmentation accuracy and stability.&amp;#xD;

3D measurement of precise part in complex circumstance using line structured light and improved U-Net

Abstract Line structured light scanning is extensively utilized for the 3D measurement of precise metal parts, but the curvature surfaces and specific materials of these parts generate specular reflection, making it challenging to accurately extract the center of the laser stripe in complex circumstances. Therefore, the primary challenges are the noise separation in the laser stripe image and the extraction of the laser stripe center under complex circumstances. To solve the above problems, an improved U-Net semantic segmentation algorithm is proposed by adding an attention mechanism and modifying skip connections to the classical U-Net network structure for accurate laser stripe segmentation. Secondly, the dual smoothing method of mean smoothing and Savitzky–Golay smoothing is combined with the Hessian matrix algorithm to complete the subpixel extraction of the center point of the laser stripe. Finally, taking the blade and shaft part as the measurement objects, the experimental results demonstrate that the method can obtain more complete, smoother, and denser results than the traditional method under highly reflective surfaces, vital interference spots, and strong ambient light. The proposed method is used for the 3D measurement of the shaft parts, and the diameter measurement maximum error is 0.029 mm, verifying the feasibility of the proposed method.

Efficient and lightweight layer-wise in-situ defect detection in laser powder bed fusion via knowledge distillation and structural re-parameterization

Powder bed quality is critical in Laser Powder Bed Fusion (LPBF) as defects in the powder bed will affect the quality of the forming parts. Recently, numerous powder bed defect detection methods based on semantic segmentation algorithms have been developed. However, due to the computational resource constraints and real-time requirements in industry scenarios, these heavy models face challenges in deploying into the LPBF process monitoring system. Meanwhile, existing lightweight models struggle to achieve sufficient performance on industrial data due to their limited feature extraction capabilities. To address the challenges in industrial deployment, this paper proposes a lightweight and efficient LPBF layer-wise defect detection paradigm to achieve a balance between performance and efficiency. Aiming at improving the performance of the lightweight model, this paper proposes a structured Knowledge Distillation framework, in which a pre-trained high-performance segmentation model (UNet++) is used to guide the training process of a lightweight model. To address the impact of model discrepancies on the effectiveness of Knowledge Distillation and further improve the inference speed, this paper constructs a specific lightweight model and applies Structural Re-parameterization to deeply compress the model. Moreover, we created a dataset comprising 406 images of powder-bed defects, with each image annotated at the pixel level. Massive experiments based on the dataset demonstrate the effectiveness of the proposed paradigm, with an excellent trade-off in performance and efficiency. The speed of the proposed model is approximately 5 times faster than that of high-performance models while maintaining comparable performance.

Deep Learning-Based Real-time Ureter Identification in Laparoscopic Colorectal Surgery.

Iatrogenic ureteral injury is a serious complication of abdominopelvic surgery. Identifying the ureters intraoperatively is essential to avoid iatrogenic ureteral injury. Here, we developed a model that may minimize this complication. We applied a deep learning-based semantic segmentation algorithm to the ureter recognition task and developed a deep learning model called UreterNet. This study aimed to verify whether the ureters could be identified in videos of laparoscopic colorectal surgery. Semantic segmentation of the ureter area was performed using a convolutional neural network-based approach. Feature Pyramid Networks were used as the convolutional neural network architecture for semantic segmentation. Precision, recall, and the dice coefficient were used as the evaluation metrics in this study. We created 14,069 annotated images from 304 videos, with 9537, 2266, and 2266 images in the training, validation, and test datasets, respectively. Concerning ureter recognition performance, precision, recall, and the Dice coefficient for the test data were 0.712, 0.722, and 0.716, respectively. Regarding the real-time performance on recorded videos, it took 71 ms for UreterNet to infer all pixels corresponding to the ureter from a single still image and 143 ms to output and display the inferred results as a segmentation mask on the laparoscopic monitor. UreterNet is a noninvasive method for identifying the ureter in videos of laparoscopic colorectal surgery and can potentially improve surgical safety. Although this could lead to the development of an image-navigated surgical system, it is necessary to verify whether UreterNet reduces the occurrence of iatrogenic ureteral injury.

LandslideNet: A landslide semantic segmentation network based on single-temporal optical remote sensing images

Swiftly and accurately acquiring the spatial distribution, location, and magnitude of landslides while documenting them in a landslide cataloging database can furnish crucial information for precise disaster mitigation measures and secondary hazard prevention. The extraction of landslides using existing semantic segmentation algorithms may give rise to issues such as false detection and missed detection due to the diverse shape and texture features of landslides in remote sensing images, the abundance of spectral features, and the complexity of the environment. In this article, we proposed LandslideNet, a novel model specifically designed for accurate segmentation of landslides in single-temporal high spatial resolution optical remote sensing images. By constructing a landslide image dataset and employing the LandslideNet model, we successfully identify and segment landslides with high precision. Quantitative experimental results demonstrate that our LandslideNet achieves superior performance compared to widely used semantic segmentation models including U-Net, PSPNet, Deeplabv3+, HRNetv2, Segformer and GELAN-c with F1-score, mIoU, FWIoU, mPA and OA reaching 72.53 %, 78.41 %, 99.86 %, 83.33 % and 99.93 % respectively. Moreover, our model exhibits lower complexity while demonstrating improved capability in detecting landslides with complex shapes and different sizes.

Enhancing semantic segmentation in chest X-ray images through image preprocessing: ps-KDE for pixel-wise substitution by kernel density estimation.

In medical imaging, the integration of deep-learning-based semantic segmentation algorithms with preprocessing techniques can reduce the need for human annotation and advance disease classification. Among established preprocessing techniques, Contrast Limited Adaptive Histogram Equalization (CLAHE) has demonstrated efficacy in improving segmentation algorithms across various modalities, such as X-rays and CT. However, there remains a demand for improved contrast enhancement methods considering the heterogeneity of datasets and the various contrasts across different anatomic structures. This study proposes a novel preprocessing technique, ps-KDE, to investigate its impact on deep learning algorithms to segment major organs in posterior-anterior chest X-rays. Ps-KDE augments image contrast by substituting pixel values based on their normalized frequency across all images. We evaluate our approach on a U-Net architecture with ResNet34 backbone pre-trained on ImageNet. Five separate models are trained to segment the heart, left lung, right lung, left clavicle, and right clavicle. The model trained to segment the left lung using ps-KDE achieved a Dice score of 0.780 (SD = 0.13), while that of trained on CLAHE achieved a Dice score of 0.717 (SD = 0.19), p<0.01. ps-KDE also appears to be more robust as CLAHE-based models misclassified right lungs in select test images for the left lung model. The algorithm for performing ps-KDE is available at https://github.com/wyc79/ps-KDE. Our results suggest that ps-KDE offers advantages over current preprocessing techniques when segmenting certain lung regions. This could be beneficial in subsequent analyses such as disease classification and risk stratification.

Detection and segmentation of wire rope surface deficiency based on YOLOv8 and U-Net

Abstract The presence of surface defects in wire ropes (WR) may lead to potential safety hazards and performance degradation, necessitating timely detection and repair. Hence, this paper proposes a method for detecting surface defects in WR based on the deep learning models YOLOv8s and U-Net, aiming to identify surface defects in real-time and extract defect data, thereby enhancing the efficiency of surface defect detection. Firstly, the ECA attention mechanism is incorporated into the YOLOv8 algorithm to enhance detection performance, achieving real-time localization and identification of surface defects in WR. Secondly, in order to obtain detailed defect data, the U-Net semantic segmentation algorithm is employed for morphological segmentation of defects, thereby obtaining the contour features of surface defects. Finally, in conjunction with OpenCV technology, the segmentation results of the defects are quantified to extract data, obtaining parameters such as the area and perimeter of the surface defects in the WR. Experimental results demonstrate that the improved YOLOv8-ECA model exhibits good accuracy and robustness, with the model’s mAP@0.5 reaching 84.78%, an increase of 1.13% compared to the base model, an accuracy rate of 90.70%, and an FPS of 65. The U-Net model can efficiently perform segmentation processing on surface defects of WR, with an mIOU of 83.54% and an mPA of 90.78%. This method can rapidly, accurately, and specifically detect surface defects in WR, which is of significant importance in preventing industrial production safety accidents.

Source-free domain adaptation for semantic image segmentation using internal representations.

Semantic segmentation models trained on annotated data fail to generalize well when the input data distribution changes over extended time period, leading to requiring re-training to maintain performance. Classic unsupervised domain adaptation (UDA) attempts to address a similar problem when there is target domain with no annotated data points through transferring knowledge from a source domain with annotated data. We develop an online UDA algorithm for semantic segmentation of images that improves model generalization on unannotated domains in scenarios where source data access is restricted during adaptation. We perform model adaptation by minimizing the distributional distance between the source latent features and the target features in a shared embedding space. Our solution promotes a shared domain-agnostic latent feature space between the two domains, which allows for classifier generalization on the target dataset. To alleviate the need of access to source samples during adaptation, we approximate the source latent feature distribution via an appropriate surrogate distribution, in this case a Gaussian mixture model (GMM).

Research on semantic segmentation algorithm of high latitude urban river ice based on deep transfer learning

ABSTRACT Automated observation methods for monitoring river ice in high-latitude urban areas are crucial for resource utilization, risk assessment, and navigation. However, current research lacks actual-scale river ice classification, such as low-altitude surveys. This study established a dataset of river ice in the Songhua River near Harbin, Northeast China, using UAV aerial photography and applied the RININet semantic segmentation algorithm for precise classification of different ice types in low-altitude aerial remote sensing images. To address environmental challenges, a feature extraction method integrating channel and spatial attention mechanisms was adopted, along with an improved pyramid pool structure to enhance feature recognition. Additionally, a two-stage transfer learning method established an ice recognition database, overcoming issues like small data volume and high annotation costs. Comparative evaluation metrics demonstrated the high accuracy of the semantic segmentation framework. Furthermore, a method for estimating ice blockage risk was proposed, applicable to various urban river ice management tasks, with practical significance.

Machine Learning and Deep Learning Approach for Medical Image Analysis Summary Generator

Colorectal cancer, which is frequent, recognized tumours in both genders around the globe. As per the report generated by WHO in 2018, colon cancer placed in the third position, whereas 1.80 million individuals are affected. Precisely, it is the succeeding leading cancer, which is the second most common cause of cancer in females, and the third for males. The loss of control over the integrity of epidermal cells in bowel or malignancy can be the cause of colorectal cancer. An effective way to recognize colon cancer at an early stage and substantial treatment can reduce the ensuing death rates to a great extent. To perform Screening of Morphology of Malignant Tumor Cells in the colon, a Gastroenterologist may refer to cancer diagnosis tests for pathological images. In any Histology method, the process takes a significant duration of time due to infinite numbers of glands in the gastrointestinal system, which may lead to irreconcilable outcomes. By diagnosing through computer algorithms, can give practical and contributory results. Hence, accurate gland segmentation is one crucial prerequisite stage to get reliable and informative morphological image data. In recent times, the scholars applied machine learning algorithms to pathological image analysis for the diagnosis of cancer disease. We propose that features extracted from the diagnostic tests, given as input to a machine learning architecture used along with semantic segmentation algorithm, provide results that are accurate than the existing image segmentation algorithms. This work is the extensive review of machine learning architectures used for semantic segmentation on the histological images of the colon.In our project we will be using the following algorithms such as Adaboost as existing and Convolution Neural Network (CNN) as proposed and its accuracy is been calculated and well compared to other algorithms. It is found that CNN performs less than other algorithms

Enhancing automated inspection in metal industries: zero-shot segmentation of surface defects using bounding box prompts

Surface defect detection poses a challenging problem that has been addressed for decades. Many of actual solutions are based on deep learning algorithms. However, these algorithms require a large amount of data to train accurate models. This becomes especially problematic for semantic segmentation algorithms, which need labeled datasets at the pixel level, a laborious and time-consuming task. Therefore, this paper proposes a semi-supervised method in which the predictions of an object detector are combined with the segmentation of a zero-shot model, eliminating the need to label a dataset for semantic segmentation. Results are compared with relevant supervised semantic segmentation models, such as UNet and DeepLabv3+. UNet achieves an F1 score of 0.824, while DeepLabv3+ achieves 0.847. The proposed method combining YOLOv8n and Segment Anything Model achieves an F1 score of 0.804. This slight loss of F1 is compensated by the significant time savings, unlike UNet and DeepLabv3+, where labeling of the dataset is necessary.