Accurate Segmentation Results Research Articles

High-performance laser speckle contrast image vascular segmentation without delicate pseudo-label reliance

Laser speckle contrast imaging (LSCI) is a noninvasive, label-free technique that allows real-time investigation of the microcirculation situation of biological tissue. High-quality microvascular segmentation is critical for analyzing and evaluating vascular morphology and blood flow dynamics. However, achieving high-quality vessel segmentation has always been a challenge due to the cost and complexity of label data acquisition and the irregular vascular morphology. In addition, supervised learning methods heavily rely on high-quality labels for accurate segmentation results, which often necessitate extensive labeling efforts. Here, we propose a novel approach LSWDP for high-performance real-time vessel segmentation that utilizes low-quality pseudo-labels for nonmatched training without relying on a substantial number of intricate labels and image pairing. Furthermore, we demonstrate that our method is more robust and effective in mitigating performance degradation than traditional segmentation approaches on diverse style data sets, even when confronted with unfamiliar data. Importantly, the dice similarity coefficient exceeded 85% in a rat experiment. Our study has the potential to efficiently segment and evaluate blood vessels in both normal and disease situations. This would greatly benefit future research in life and medicine.

Multi-dimensional dense attention network for pixel-wise segmentation of optic disc in colour fundus images.

Segmentation of retinal fragments like blood vessels, Optic Disc (OD), and Optic Cup (OC) enables the early detection of different retinal pathologies like Diabetic Retinopathy (DR), Glaucoma, etc. Accurate segmentation of OD remains challenging due to blurred boundaries, vessel occlusion, and other distractions and limitations. These days, deep learning is rapidly progressing in the segmentation of image pixels, and a number of network models have been proposed for end-to-end image segmentation. However, there are still certain limitations, such as limited ability to represent context, inadequate feature processing, limited receptive field, etc., which lead to the loss of local details and blurred boundaries. A multi-dimensional dense attention network, or MDDA-Net, is proposed for pixel-wise segmentation of OD in retinal images in order to address the aforementioned issues and produce more thorough and accurate segmentation results. In order to acquire powerful contexts when faced with limited context representation capabilities, a dense attention block is recommended. A triple-attention (TA) block is introduced in order to better extract the relationship between pixels and obtain more comprehensive information, with the goal of addressing the insufficient feature processing. In the meantime, a multi-scale context fusion (MCF) is suggested for acquiring the multi-scale contexts through context improvement. Specifically, we provide a thorough assessment of the suggested approach on three difficult datasets. In the MESSIDOR and ORIGA data sets, the suggested MDDA-NET approach obtains accuracy levels of 99.28% and 98.95%, respectively. The experimental results show that the MDDA-Net can obtain better performance than state-of-the-art deep learning models under the same environmental conditions.

Video-Instrument Synergistic Network for Referring Video Instrument Segmentation in Robotic Surgery.

Surgical instrument segmentation is fundamentally important for facilitating cognitive intelligence in robot-assisted surgery. Although existing methods have achieved accurate instrument segmentation results, they simultaneously generate segmentation masks of all instruments, which lack the capability to specify a target object and allow an interactive experience. This paper focuses on a novel and essential task in robotic surgery, i.e., Referring Surgical Video Instrument Segmentation (RSVIS), which aims to automatically identify and segment the target surgical instruments from each video frame, referred by a given language expression. This interactive feature offers enhanced user engagement and customized experiences, greatly benefiting the development of the next generation of surgical education systems. To achieve this, this paper constructs two surgery video datasets to promote the RSVIS research. Then, we devise a novel Video-Instrument Synergistic Network (VIS-Net) to learn both video-level and instrument-level knowledge to boost performance, while previous work only utilized video-level information. Meanwhile, we design a Graph-based Relation-aware Module (GRM) to model the correlation between multi-modal information (i.e., textual description and video frame) to facilitate the extraction of instrument-level information. Extensive experimental results on two RSVIS datasets exhibit that the VIS-Net can significantly outperform existing state-of-the-art referring segmentation methods. We will release our code and dataset for future research (Git).

Cross-Correlation Driven Aerial Image Segmentation: Leveraging Multi-Scale Features and Edge Information

Abstract: Semantic segmentation of remote sensing images is crucial for interpreting these large, rich in information scenes and our study introduces a new method for segmenting remote sensing imagery (RSI) when faced with limited training data and imbalanced classes. Our approach utilizes a unique potential function that merges information from both super pixel segmentation and edge detection. This combination allows the model to effectively analyze features at various scales and reduce the influence of potential errors in super pixel segmentation. Furthermore, the inclusion of edge details extracted via the Sketch token algorithm refines object boundaries, yielding more accurate segmentation results. This work offers a promising solution for achieving reliable interpretation of RSIs in scenarios with limited training data.

ERSegDiff: a diffusion-based model for edge reshaping in medical image segmentation

Medical image segmentation is a crucial field of computer vision. Obtaining correct pathological areas can help clinicians analyze patient conditions more precisely. We have observed that both CNN-based and attention-based neural networks often produce rough segmentation results around the edges of the regions of interest. This significantly impacts the accuracy of obtaining the pathological areas. Without altering the original data and model architecture, further refining the initial segmentation outcomes can effectively address this issue and lead to more satisfactory results. Recently, diffusion models have demonstrated outstanding results in image generation, showcasing their powerful ability to model distributions. We believe that this ability can greatly enhance the accuracy of the reshaping results. This research proposes ERSegDiff, a neural network based on the diffusion model for reshaping segmentation borders. The diffusion model is trained to fit the distribution of the target edge area and is then used to modify the segmentation edge to produce more accurate segmentation results. By incorporating prior knowledge into the diffusion model, we can help it more accurately simulate the edge probability distribution of the samples. Moreover, we introduce the edge concern module, which leverages attention mechanisms to produce feature weights and further refine the segmentation outcomes. To validate our approach, we employed the COVID-19 and ISIC-2018 datasets for lung segmentation and skin cancer segmentation tasks, respectively. Compared with the baseline model, ERSegDiff improved the dice score by 3%–4% and 2%–4%, respectively, and achieved state-of-the-art scores compared to several mainstream neural networks, such as swinUNETR.

Multi-scale reciprocal consistency learning for semi-supervised left atrial segmentation

Abstract Accurate and enough labels are crucial to constructing an excellent deep-learning framework in processing medical scans. However, the expensive cost of medical labels greatly impedes this process. In this case, semi-supervised learning has shown great potential due to its efficient use of unlabeled data. Therefore, we present a novel multi-scale reciprocal consistency network (RC-NET) to utilize the unlabeled data more efficiently for more accurate 3D left atrial segmentation. Our model consists of a common encoder and two independent decoders with inconsistent up-sampling. The decoders generate feature maps of hidden layers at different resolutions during the up-sampling process. Lower-resolution features typically contain local and detailed information, while higher-resolution features involve global or abstract information. Subsequently, we applied consistency learning to these feature maps. By combining local and global semantic information, the model can obtain a comprehensive understanding of the segmentation targets. The experimental data indicate the MRC-Net outperforms many semi-supervised learning methods. It achieves more accurate segmentation results by efficiently utilizing unlabeled data. This provides a completely new approach to improving semi-supervised learning.

Bidirectional correlation-driven inter-frame interaction Transformer for referring video object segmentation

Referring video object segmentation (RVOS) aims to segment the target object in a video sequence described by a language expression. Typical multimodal Transformer based RVOS approaches process video sequence in a frame-independent manner to reduce the high computational cost, which however restricts the performance due to the lack of inter-frame interaction for temporal coherence modeling and spatio-temporal representation learning of the referred object. Besides, the absence of sufficient cross-modal interactions results in weak correlation between the visual and linguistic features, which increases the difficulty of decoding the target information and limits the performance of the model. In this paper, we propose a bidirectional correlation-driven inter-frame interaction Transformer, dubbed BIFIT, to address these issues in RVOS. Specifically, we design a lightweight and plug-and-play inter-frame interaction module in the Transformer decoder to efficiently learn the spatio-temporal features of the referred object, so as to decode the object information in the video sequence more precisely and generate more accurate segmentation results. Moreover, a bidirectional multi-level vision-language interaction module is implemented before the multimodal Transformer to enhance the correlation between the linguistic and multi-level visual features, thus facilitating the language queries to decode more precise object information from visual features and ultimately improving the segmentation performance. Extensive experimental results on four benchmarks validate the superiority of our BIFIT over state-of-the-art methods and the effectiveness of our proposed modules. The code is available in https://github.com/LANMNG/BIFIT.

A Novel Mis-Seg-Focus Loss Function Based on a Two-Stage nnU-Net Framework for Accurate Brain Tissue Segmentation.

Brain tissue segmentation plays a critical role in the diagnosis, treatment, and study of brain diseases. Accurately identifying these boundaries is essential for improving segmentation accuracy. However, distinguishing boundaries between different brain tissues can be challenging, as they often overlap. Existing deep learning methods primarily calculate the overall segmentation results without adequately addressing local regions, leading to error propagation and mis-segmentation along boundaries. In this study, we propose a novel mis-segmentation-focused loss function based on a two-stage nnU-Net framework. Our approach aims to enhance the model's ability to handle ambiguous boundaries and overlapping anatomical structures, thereby achieving more accurate brain tissue segmentation results. Specifically, the first stage targets the identification of mis-segmentation regions using a global loss function, while the second stage involves defining a mis-segmentation loss function to adaptively adjust the model, thus improving its capability to handle ambiguous boundaries and overlapping anatomical structures. Experimental evaluations on two datasets demonstrate that our proposed method outperforms existing approaches both quantitatively and qualitatively.

DFSNet: A 3D Point Cloud Segmentation Network toward Trees Detection in an Orchard Scene.

In order to guide orchard management robots to realize some tasks in orchard production such as autonomic navigation and precision spraying, this research proposed a deep-learning network called dynamic fusion segmentation network (DFSNet). The network contains a local feature aggregation (LFA) layer and a dynamic fusion segmentation architecture. The LFA layer uses the positional encoders for initial transforming embedding, and progressively aggregates local patterns via the multi-stage hierarchy. The fusion segmentation module (Fus-Seg) can format point tags by learning a multi-embedding space, and the generated tags can further mine the point cloud features. At the experimental stage, significant segmentation results of the DFSNet were demonstrated on the dataset of orchard fields, achieving an accuracy rate of 89.43% and an mIoU rate of 74.05%. DFSNet outperforms other semantic segmentation networks, such as PointNet, PointNet++, D-PointNet++, DGCNN, and Point-NN, with improved accuracies over them by 11.73%, 3.76%, 2.36%, and 2.74%, respectively, and improved mIoUs over the these networks by 28.19%, 9.89%, 6.33%, 9.89, and 24.69%, respectively, on the all-scale dataset (simple-scale dataset + complex-scale dataset). The proposed DFSNet can capture more information from orchard scene point clouds and provide more accurate point cloud segmentation results, which are beneficial to the management of orchards.

A survey on brain MRI segmentation

Neurological disorders pose a significant challenge in medical diagnostics, requiring accurate and efficient analysis of brain Magnetic Resonance Imaging (MRI) scans. This study introduces a novel approach for enhanced neurological diagnosis through the application of deep learning techniques to automate the segmentation of brain structures in MRI images. The proposed method leverages the power of convolutional neural networks (CNNs) to extract intricate patterns and features from complex neuro imaging data. The research involves the development and training of a deep learning model capable of accurately delineating key anatomical regions, such as the cortex, hippocampus, and ventricles. The model is trained on a large data set of annotated MRI scans, optimizing its performance through rigorous validation processes. The utilization of deep learning enables the algorithm to learn and generalize from diverse imaging data, improving its adaptability to variations in patient demographics and scanner characteristics. To evaluate the effectiveness of the proposed approach, comprehensive experiments are conducted on a diverse set of MRI datasets, encompassing various neurological conditions. Quantitative metrics, including Dice coefficient and Hausdorff distance, are employed to assess the segmentation accuracy compared to ground truth annotations. Additionally, the clinical relevance of the automated segmentation is validated through collaboration with neurologists and radiologists. The results demonstrate that the deep learning- enabled segmentation method consistently outperforms traditional image processing techniques, providing more accurate and reliable segmentation results. The proposed approach not only streamlines the diagnostic process but also has the potential to uncover subtle abnormalities that may be overlooked by manual inspection. In conclusion, the integration of deep learning into the segmentation of brain MRI scans presents a promising avenue for enhancing neurological diagnosis. The automated and precise delineation of brain structures contributes to the efficiency and accuracy of diagnostic workflows, ultimately improving patient outcomes and facilitating timely interventions in the realm of neurological disorders.

ViNe-Seg: deep-learning-assisted segmentation of visible neurons and subsequent analysis embedded in a graphical user interface.

Segmentation of neural somata is a crucial and usually the most time-consuming step in the analysis of optical functional imaging of neuronal microcircuits. In recent years, multiple auto-segmentation tools have been developed to improve the speed and consistency of the segmentation process, mostly, using deep learning approaches. Current segmentation tools, while advanced, still encounter challenges in producing accurate segmentation results, especially in datasets with a low signal-to-noise ratio. This has led to a reliance on manual segmentation techniques. However, manual methods, while customized to specific laboratory protocols, can introduce variability due to individual differences in interpretation, potentially affecting dataset consistency across studies. In response to this challenge, we present ViNe-Seg: a deep-learning-based semi-automatic segmentation tool that offers (i) detection of visible neurons, irrespective of their activity status; (ii) the ability to perform segmentation during an ongoing experiment; (iii) a user-friendly graphical interface that facilitates expert supervision, ensuring precise identification of Regions of Interest; (iv) an array of segmentation models with the option of training custom models and sharing them with the community; and (v) seamless integration of subsequent analysis steps. ViNe-Seg code and documentation are publicly available at https://github.com/NiRuff/ViNe-Seg and can be installed from https://pypi.org/project/ViNeSeg/.

Evidential Uncertainty-Guided Mitochondria Segmentation for 3D EM Images

Recent advances in deep learning have greatly improved the segmentation of mitochondria from Electron Microscopy (EM) images. However, suffering from variations in mitochondrial morphology, imaging conditions, and image noise, existing methods still exhibit high uncertainty in their predictions. Moreover, in view of our findings, predictions with high levels of uncertainty are often accompanied by inaccuracies such as ambiguous boundaries and amount of false positive segments. To deal with the above problems, we propose a novel approach for mitochondria segmentation in 3D EM images that leverages evidential uncertainty estimation, which for the first time integrates evidential uncertainty to enhance the performance of segmentation. To be more specific, our proposed method not only provides accurate segmentation results, but also estimates associated uncertainty. Then, the estimated uncertainty is used to help improve the segmentation performance by an uncertainty rectification module, which leverages uncertainty maps and multi-scale information to refine the segmentation. Extensive experiments conducted on four challenging benchmarks demonstrate the superiority of our proposed method over existing approaches.

The Crack Diffusion Model: An Innovative Diffusion-Based Method for Pavement Crack Detection

Pavement crack detection is of significant importance in ensuring road safety and smooth traffic flow. However, pavement cracks come in various shapes and forms which exhibit spatial continuity, and algorithms need to adapt to different types of cracks while preserving their continuity. To address these challenges, an innovative crack detection framework, CrackDiff, based on the generative diffusion model, is proposed. It leverages the learning capabilities of the generative diffusion model for the data distribution and latent spatial relationships of cracks across different sample timesteps and generates more accurate and continuous crack segmentation results. CrackDiff uses crack images as guidance for the diffusion model and employs a multi-task UNet architecture to predict mask and noise simultaneously at each sampling step, enhancing the robustness of generations. Compared to other models, CrackDiff generates more accurate and stable results. Through experiments on the Crack500 and DeepCrack pavement datasets, CrackDiff achieves the best performance (F1 = 0.818 and mIoU = 0.841 on Crack500, and F1 = 0.841 and mIoU = 0.862 on DeepCrack).

ENHANCING TONGUE REGION SEGMENTATION THROUGH SELF-ATTENTION AND TRANSFORMER BASED

As an essential component of traditional Chinese medicine diagnosis, tongue diagnosis has faced limitations in clinical practice due to its subjectivity and reliance on the experience of physicians. Recent advancements in deep learning techniques have opened new possibilities for the automated analysis and diagnosis of tongue images. In this paper, we collected 500 tongue images from various patients. These images were initially preprocessed and annotated, resulting in the dataset used for this experiment. This project is based on the previously proposed segmentation method using Harnessing Self-Attention and Transformer, which is divided into three key stages: feature extraction, feature fusion, and segmentation prediction. By organically combining these three key stages, our tongue region segmentation model is better equipped to handle complex tongue images and provides accurate segmentation results. The segmentation DICE coefficient reaches 0.953, which is of significant importance for the automation and objectivity of tongue diagnosis in traditional Chinese medicine.

Infant head and brain segmentation from magnetic resonance images using fusion-based deep learning strategies

Magnetic resonance (MR) imaging is widely used for assessing infant head and brain development and for diagnosing pathologies. The main goal of this work is the development of a segmentation framework to create patient-specific head and brain anatomical models from MR images for clinical evaluation. The proposed strategy consists of a fusion-based Deep Learning (DL) approach that combines the information of different image sequences within the MR acquisition protocol, including the axial T1w, sagittal T1w, and coronal T1w after contrast. These image sequences are used as input for different fusion encoder–decoder network architectures based on the well-established U-Net framework. Specifically, three different fusion strategies are proposed and evaluated, namely early, intermediate, and late fusion. In the early fusion approach, the images are integrated at the beginning of the encoder–decoder architecture. In the intermediate fusion strategy, each image sequence is processed by an independent encoder, and the resulting feature maps are then jointly processed by a single decoder. In the late fusion method, each image is individually processed by an encoder–decoder, and the resulting feature maps are then combined to generate the final segmentations. A clinical in-house dataset consisting of 19 MR scans was used and divided into training, validation, and testing sets, with 3 MR scans defined as a fixed validation set. For the remaining 16 MR scans, a cross-validation approach was adopted to assess the performance of the methods. The training and testing processes were carried out with a split ratio of 75% for the training set and 25% for the testing set. The results show that the early and intermediate fusion methodologies presented the better performance (Dice coefficient of 97.6 ± 1.5% and 97.3 ± 1.8% for the head and Dice of 94.5 ± 1.7% and 94.8 ± 1.8% for the brain, respectively), whereas the late fusion method generated slightly worst results (Dice of 95.5 ± 4.4% and 93.8 ± 3.1% for the head and brain, respectively). Nevertheless, the volumetric analysis showed that no statistically significant differences were found between the volumes of the models generated by all the segmentation strategies and the ground truths. Overall, the proposed frameworks demonstrate accurate segmentation results and prove to be feasible for anatomical model analysis in clinical practice.

EAIS-Former: An efficient and accurate image segmentation method for fruit leaf diseases

Fruit leaf disease segmentation is an essential foundation for achieving accurate disease diagnosis and identification. However, shadows caused by folded leaves and serrations on leaves can lead to difficulty in extracting edge features, affecting the accuracy of leaf segmentation. In addition, the varying shapes and blurred boundaries of disease spots can further lead to poor segmentation performance of spots. To address the above problems, this work proposes a method called EAIS-Former by combining the advantages of global modeling of Transformer, local processing and positional coding of convolutional neural network (CNN) for accurate segmentation in fruit leaf disease images. Dual scale overlap (DSO) patch embedding is designed to effectively extract multi-scale disease features by dual paths to alleviate omission of lesions. Ultra large convolution (ULC) Transformer block is customized for performing positional encoding and global modeling to efficiently extract global and positional features of leaves and diseases. Skip convolutional local optimization (SCLO) module is proposed to optimize the local detail and edge information and improve the pixel classification ability of the model so that the segmentation results of leaves and spots can be finer and more tiny spots can be extracted. Double layer upsampling (DLU) decoder is built to efficiently fuse the detail information with the semantic information and output the accurate segmentation results of leaves and spots. The experimental results show that the proposed method reach 99.04%, 98.64%, 99.24%, 99.42%, 98.59% and 98.58% intersection over union (IoU) for leaf segmentation on apple rust, pomegranate cercospora spot, mango anthracnose, jamun fungal disease, apple alternaria blotch and apple gray spot datasets, respectively. The IoU of lesion segmentation achieve 94.47%, 94.54%, 83.83%, 86.60%, 89.59% and 88.76%, respectively. In contrast to DeepLabv3+, the accuracy of disease segmentation is raised by 5.25%, 5.15%, 5.55%, 7.64%, 7.04% and 9.35%, respectively. Compared with U-Net, the proposed method improves the accuracy of disease spot segmentation by 4.3%, 4.44%, 5.26%, 9.42%, 5.87% and 6.53% under the six fruit leaf test sets, respectively. In addition, total parameters and FLOPs of the proposed method are only 18.44% and 8.47% of U-Net, respectively. Therefore, this study can provide an efficient and accurate method for the task of fruit leaf disease spot segmentation, which provides a sufficient basis for the accurate analysis of fruit leaves and diseases.

Sd-net: a semi-supervised double-cooperative network for liver segmentation from computed tomography (CT) images

IntroductionThe automatic segmentation of the liver is a crucial step in obtaining quantitative biomarkers for accurate clinical diagnosis and computer-aided decision support systems. This task is challenging due to the frequent presence of noise and sampling artifacts in computerized tomography (CT) images, as well as the complex background, variable shapes, and blurry boundaries of the liver. Standard segmentation of medical images based on full-supervised convolutional networks demands accurate dense annotations. Such a learning framework is built on laborious manual annotation with strict requirements for expertise, leading to insufficient high-quality labels. MethodsTo overcome such limitation and exploit massive weakly labeled data, we relaxed the rigid labeling requirement and developed a semi-supervised double-cooperative network (SD- Net). SD-Net is trained to segment the complete liver volume from preoperative abdominal CT images by using limited labeled datasets and large-scale unlabeled datasets. Specifically, to enrich the diversity of unsupervised information, we construct SD-Net consisting of two collaborative network models. Within the supervised training module, we introduce an adaptive mask refinement approach. First, each of the two network models predicts the labeled dataset, after which adaptive mask refinement of the difference predictions is implemented to obtain more accurate liver segmentation results. In the unsupervised training module, a dynamic pseudo-label generation strategy is proposed. First each of the two models predicts unlabeled data and the better prediction is considered as pseudo-labeling before training. Results and discussionBased on the experimental findings, the proposed method achieves a dice score exceeding 94%, indicating its high level of accuracy and its suitability for everyday clinical use.

Semantic Segmentation of Surface Cracks in Urban Comprehensive Pipe Galleries Based on Global Attention

Cracks inside urban underground comprehensive pipe galleries are small and their characteristics are not obvious. Due to low lighting and large shadow areas, the differentiation between the cracks and background in an image is low. Most current semantic segmentation methods focus on overall segmentation and have a large perceptual range. However, for urban underground comprehensive pipe gallery crack segmentation tasks, it is difficult to pay attention to the detailed features of local edges to obtain accurate segmentation results. A Global Attention Segmentation Network (GA-SegNet) is proposed in this paper. The GA-SegNet is designed to perform semantic segmentation by incorporating global attention mechanisms. In order to perform precise pixel classification in the image, a residual separable convolution attention model is employed in an encoder to extract features at multiple scales. A global attention upsample model (GAM) is utilized in a decoder to enhance the connection between shallow-level features and deep abstract features, which could increase the attention of the network towards small cracks. By employing a balanced loss function, the contribution of crack pixels is increased while reducing the focus on background pixels in the overall loss. This approach aims to improve the segmentation accuracy of cracks. The comparative experimental results with other classic models show that the GA SegNet model proposed in this study has better segmentation performance and multiple evaluation indicators, and has advantages in segmentation accuracy and efficiency.

δARD loss for low-contrast medical image segmentation

Medical image segmentation is essential to image-based disease analysis and has proven to be significantly helpful for doctors to make decisions. Due to the low-contrast of some medical images, the accurate segmentation of medical images has always been a challenging problem. The experiment found that UNet with current loss functions cannot capture subtle information in target contours or regions in low-contrast medical images, which are crucial for subsequent disease diagnosis. We propose a robust loss by incorporating the difference in average radial derivative (ARD), length and region area to further help the network to achieve more accurate segmentation results. We evaluated the proposed loss function using UNet as the base segmentation network compared to five conventional loss functions on one private and four public medical image datasets. Experimental results illustrate that UNet with the proposed loss function can achieve the best segmentation performance, even better than the outstanding deep learning models with original loss functions. Furthermore, three representative datasets were chosen to validate the effectiveness of the proposed δARD loss function with seven different models. The experiments revealed δARD loss’s plug-and-play feature and its robustness over multiple models and datasets.

Motion segmentation using Ward’s hierarchical agglomerative clustering for crowd disaster risk mitigation

Motion segmentation has gained increasing attention due to its significance for many public surveillance applications, such as behavior understanding and density estimation. Thus ensuring crowd risk mitigation and safety. Although numerous solutions have been put out to deal with this issue, it remains challenging due to factors like scene fluctuations, cluttered backgrounds, and severe occlusions. The present paper proposes a novel framework, spatio-angular-shape Ward linkage (SAS-WL), to segment human motion based on tracked trajectories features in crowd scenes. In the proposed SAS-WL, first the motion features are captured from the crowd video through the generalized-KLT (gKLT) keypoint tracker. The tracklets are then examined to keep only the significant and long-term tracklets. Then, spatio-angular-shape motion features are obtained from those long-term tracklets. Next, Ward’s linkage was utilized for performing motion pattern segmentation. In addition, we propose an improved Ward’s linkage method and integrate it with the obtained features to increase the quality of the clustering results. One of the significant advantages of the SAS-WL is its capability to address various densities in different crowd scenes. Moreover, the SAS-WL achieves accurate segmentation results. We validated our findings with videos of real-world crowd scenes. We introduce a novel dataset along with its manually annotated ground truth, comprising 21 diverse crowd videos. This dataset aims to enhance the assessment of our framework’s performance. Obtaining results on a diversity of challenging crowd scenarios demonstrates that this framework provides precise motion segmentation results.