3D Segmentation Research Articles

Temporomandibular joint CBCT image segmentation via multi-view ensemble learning network.

Accurate segmentation of the temporomandibular joint (TMJ) from cone beam CT (CBCT) images holds significant clinical value for diagnosing temporomandibular joint osteoarthrosis (TMJOA) and related conditions. Convolutional neural network-based medical image segmentation methods have achieved state-of-the-art performance in various segmentation tasks. However, 3D medical images segmentation requires substantial global context and rich spatial semantic information, demanding much more GPU memory and computational resources. To address these challenges in 3D medical image segmentation, we propose a novel network- the MVEL-Net (Multi-view Ensemble Learning Network) for TMJ CBCT image segmentation. By resampling images along three dimensions, we generate multiple weak learners with different spatial semantic information. A subsequent strong learning network effectively integrates the outputs from these weak learners to achieve more accurate segmentation results. We evaluated our network model using a clinical dataset comprising 88 subjects with TMJ CBCT images. The average Dice similarity coefficient (DSC) was 0.9817 ± 0.0049, the average surface distance was 0.0540 ± 0.0179mm, and the 95% Hausdorff distance was 0.1743 ± 0.0550mm. Our proposed MVEL-Net demonstrates excellent segmentation performance on TMJ from CBCT images, while using fewer GPU memory resources compared to other 3D networks. The effectiveness of this method in capturing spatial context could be leveraged for tasks like organ segmentation from volumetric scans. This may facilitate wider adoption of AI-based solutions for automated analysis of 3D medical images.

Deep learning enables the fully automated quantification of high-resolution cardiac CT images: human in loop for model development

Abstract Introduction Cardiac computed tomography (CCT) images provide vast spatial and temporal information. Segmentation of the structure of interest is necessary to provide quantitative information. However, manual segmentation of cardiac substructures is highly time-consuming. Objective This study aims to develop a robust deep-learning segmentation model for cardiac substructure segmentation in 3D CCT images. Method We initially developed a 3D U-Net architecture, incorporating extensive augmentation, for the segmentation of the Left Ventricle Myocardium (LVM), the blood cavities of the Left and Right Ventricles (LV, RV), and the Left and Right Atria (LA, RA). This model utilized CT images from 20 patients who had available manual segmentation. Subsequently, we applied this initial model to datasets from two centers, including different generations of scanners. We then visually inspected the segmentation, selected the highest-quality segmentations, and modify it if necessary, and excluded the low-quality data. We continued fine-tuning the model with the new dataset until we reached a count of 456 patients. As there were multiple images from one patient during this model's development, we generated datasets to develop a new model using the entire new dataset to avoid any data leakage in the reported metrics. The model was developed using data from Center 1 (5-fold cross-validation) and then evaluated on an external test set from Center 2 (126 patients) and also 4D images from Center 1. Various metrics were calculated to assess the model's performance. Results In the internal test set, utilizing 5-fold CV, the model demonstrated high segmentation accuracy, achieving an overall Dice coefficient of 0.98, with individual scores of 0.96 for LVM, 0.98 for LV, 0.98 for RV, 0.99 for RA, and 0.98 for LA. We assessed the automatic quantification capability of the segmentation model from 256 patients, resulting in an R2 value greater than 0.92 for both LV end-diastolic and systolic volumes. In contrast, the model maintained robust performance on the external dataset, achieving an overall Dice coefficient of 0.96, with individual scores of 0.95 for LVM, 0.98 for LV, 0.97 for RV, 0.98 for RA, and 0.94 for LA. Conclusion We provided a large cohort of ground truth segmentations for different cardiac CT substructures using a human-in-the-loop strategy. Subsequently, we developed a deep learning model for highly accurate automated segmentation of these substructures. This model allows for fast and fully automatic segmentation and quantification of 3D and 4D cardiac CT images, from which various quantitative metrics can be extracted from different cardiac substructures.

Fast‐MedNeXt: Accelerating the MedNeXt Architecture to Improve Brain Tumour Segmentation Efficiency

ABSTRACTWith the rapid development of medical imaging technology, 3D image segmentation technology has gradually become a mainstream method, especially in brain tumour detection and diagnosis showing its unique advantages. The technique makes full use of 3D spatial information to locate and analyze tumours more accurately, thus playing an important role in improving diagnostic accuracy, optimising treatment planning and promoting research. However, it also suffers from significant computational expenditure and delayed processing pace. In this paper, we propose an innovative optimisation scheme to address this problem. We thoroughly investigate the MedNeXt network and propose Fast‐MedNeXt, which aims to increase the processing speed while maintaining accuracy. First, we introduce the partial convolution (PConv) technique, which replaces the deep convolutional layers in the network. This improvement effectively reduces computation and memory requirements while maintaining efficient feature extraction. Second, based on PConv, we propose PConv‐Down and PConv‐Up modules, which are applied to the up‐sampling and down‐sampling modules to further optimise the network structure and improve efficiency. To confirm the efficacy of the approach, we carried out a sequence of tests in the multimodal brain tumour segmentation challenge 2021 (BraTS2021). By comparing with the MedNeXt series network, the Fast‐MedNeXt reduced the latency by 22.1%, 20.5%, 15.8%, and 11.4% respectively, while the average accuracy also increased by 0.475% and 0.2% respectively. These significant performance improvements demonstrate the effectiveness of Fast‐MedNeXt in 3D medical image segmentation tasks and provide a new and more efficient solution for the field.

RMCNet: A Liver Cancer Segmentation Network Based on 3D Multi-Scale Convolution, Attention, and Residual Path

Abdominal CT images are important clues for diagnosing liver cancer lesions. However, liver cancer presents challenges such as significant differences in tumor size, shape, and location, which can affect segmentation accuracy. To address these challenges, we propose an end-to-end 3D segmentation algorithm, RMCNet. In the shallow encoding part of RMCNet, we incorporated a 3D multiscale convolution (3D-Multiscale Convolution) module to more effectively extract tumors of varying sizes. Moreover, the convolutional block attention module (CBAM) is used in the encoding part to help the model focus on both the shape and location of tumors. Additionally, a residual path is introduced in each encoding layer to further enrich the extracted feature maps. Our method achieved DSC scores of 76.56% and 72.96%, JCC scores of 75.82% and 71.25%, HD values of 11.07 mm and 17.06 mm, and ASD values of 2.54 mm and 10.51 mm on the MICCAI 2017 Liver Tumor Segmentation public dataset and the 3Dircadb-01 public dataset, respectively. Compared to other methods, RMCNet demonstrates superior segmentation performance and stronger generalization capability.

Adversarial Unsupervised Domain Adaptation for 3D Semantic Segmentation with 2D Image Fusion of Dense Depth

AbstractUnsupervised domain adaptation (UDA) is increasingly used for 3D point cloud semantic segmentation tasks due to its ability to address the issue of missing labels for new domains. However, most existing unsupervised domain adaptation methods focus only on uni‐modal data and are rarely applied to multi‐modal data. Therefore, we propose a cross‐modal UDA on multi‐modal datasets that contain 3D point clouds and 2D images for 3D Semantic Segmentation. Specifically, we first propose a Dual discriminator‐based Domain Adaptation (Dd‐bDA) module to enhance the adaptability of different domains. Second, given that the robustness of depth information to domain shifts can provide more details for semantic segmentation, we further employ a Dense depth Feature Fusion (DdFF) module to extract image features with rich depth cues. We evaluate our model in four unsupervised domain adaptation scenarios, i.e., dataset‐to‐dataset (A2D2 → SemanticKITTI), Day‐to‐Night, country‐to‐country (USA → Singapore), and synthetic‐to‐real (VirtualKITTI → SemanticKITTI). In all settings, the experimental results achieve significant improvements and surpass state‐of‐the‐art models.

Point cloud segmentation method based on an image mask and its application verification

Abstract Accurately perceiving three-dimensional (3D) environments or objects is crucial for the advancement of artificial intelligence (AI) interaction technologies. Currently, various types of sensors are employed to obtain point cloud data for 3D object detection or segmentation tasks. While this multi-sensor approach provides more precise 3D data than monocular or stereo cameras, it is also more expensive. The advent of RGB-D cameras, which provide both RGB images and depth information, addresses this issue.
In this study, we propose a point cloud segmentation method based on image masks. By using an RGB-D camera to capture color and depth images, we generate image masks through object recognition and segmentation. Given the mapping relationship between RGB image pixels and point clouds, these image masks can be further used to extract the point cloud data of the target objects. The experimental results revealed that the average accuracy of target segmentation was 84.78%, which was close to that of PointNet++. Compared with three traditional segmentation algorithms, the accuracy was improved by nearly 23.97%. The running time of our algorithm is reduced by 95.76% compared to the PointNet++ algorithm, which has the longest running time; and by 15.65% compared to the LCCP algorithm, which has the shortest running time among traditional methods. Compared with PointNet++, the segmentation accuracy was improved. This method addressed the issues of low robustness and excessive reliance on manual feature extraction in traditional point cloud segmentation methods, providing valuable support and reference for the accurate segmentation of 3D point clouds.

Automated volumetric analysis of the inner ear fluid space from hydrops magnetic resonance imaging using 3D neural networks

Due to the development of magnetic resonance (MR) imaging processing technology, image-based identification of endolymphatic hydrops (EH) has played an important role in understanding inner ear illnesses, such as Meniere’s disease or fluctuating sensorineural hearing loss. We segmented the inner ear, consisting of the cochlea, vestibule, and semicircular canals, using a 3D-based deep neural network model for accurate and automated EH volume ratio calculations. We built a dataset of MR cisternography (MRC) and HYDROPS-Mi2 stacks labeled with the segmentation of the perilymph fluid space and endolymph fluid space of the inner ear to devise a 3D segmentation deep neural network model. End-to-end learning was used to segment the perilymph fluid and the endolymph fluid spaces simultaneously using aligned pair data of the MRC and HYDROPS-Mi2 stacks. Consequently, the segmentation performance of the total fluid space and endolymph fluid space had Dice similarity coefficients of 0.9574 and 0.9186, respectively. In addition, the EH volume ratio calculated by experienced otologists and the EH volume ratio value predicted by the proposed deep learning model showed high agreement according to the interclass correlation coefficient (ICC) and Bland–Altman plot analysis.

AI-based 3D analysis of retinal vasculature associated with retinal diseases using OCT angiography

Retinal vasculature is the only vascular system in the human body that can be observed in a non-invasive manner, with a phenotype associated with a wide range of ocular, cerebral, and cardiovascular diseases. OCT and OCT angiography (OCTA) provide powerful imaging methods to visualize the three-dimensional morphological and functional information of the retina. In this study, based on OCT and OCTA multimodal inputs, a multitask convolutional neural network model was built to realize 3D segmentation of retinal blood vessels and disease classification for different retinal diseases, overcoming the limitations of existing methods that can only perform 2D analysis of OCTA. Two hundred thirty sets of OCT and OCTA data from 109 patients, including 138,000 cross-sectional images in normal and diseased eyes (age-related macular degeneration, retinal vein occlusion, and central serous chorioretinopathy), were collected from four commercial OCT systems for model training, validation, and testing. Experimental results verified that the proposed method was able to achieve a DICE coefficient of 0.956 for 3D segmentation of blood vessels and an accuracy of 91.49% for disease classification, and further enabled us to evaluate the 3D reconstruction of retinal vessels, explore the interlayer connections of superficial and deep vasculatures, and reveal the 3D quantitative vessel characteristics in different retinal diseases.

Weakly supervised 3D point cloud semantic segmentation for architectural heritage using teacher-guided consistency and contrast learning

Point cloud semantic segmentation is significant for managing and protecting architectural heritage. Currently, fully supervised methods require a large amount of annotated data, while weakly supervised methods are difficult to transfer directly to architectural heritage. This paper proposes an end-to-end teacher-guided consistency and contrastive learning weakly supervised (TCCWS) framework for architectural heritage point cloud semantic segmentation, which can fully utilize limited labeled points to train network. Specifically, a teacher-student framework is designed to generate pseudo labels and a pseudo label dividing module is proposed to distinguish reliable and ambiguous point sets. Based on it, a consistency and contrastive learning strategy is designed to fully utilize supervision signals to learn the features of point clouds. The framework is tested on the ArCH dataset and self-collected point cloud, which demonstrates that the proposed method can achieve effective semantic segmentation of architectural heritage using only 0.1 % of annotated points.

Stone instance segmentation of rubble masonry based on laser scanning point clouds

Laser scanning allows for objective area-based analysis of water dam structures to enable targeted interventions in case of displacements, requiring comparison of the same areas over different epochs. This comparison improves if identical areas, e.g. stones, from multiple epochs can be automatically derived in advance. We present an instance segmentation algorithm based on a 3D point cloud with reflected intensity information to identify individual stones in rubble masonry dams that can be used within deformation monitoring. The algorithm uses initial k-means classification followed by image-based processing steps, resulting in a segmented 3D point cloud with individual stones. It is evaluated against a manually labeled reference and analyzed on terrestrial laser scanning (TLS) and UAV-based data sets. Correctly identified stones are 89.92% for TLS and 90.82% for UAV data. Additionally, stone centroids and shapes were evaluated without significant deviation. A first outlook on deformation analysis was provided using ICP matching of stones from two simulated epochs.

Automatic Segmentation of the Jaws Used in Guided Insertion of Orthodontic Mini Implants to Improve Their Stability and Precision.

Background and Objectives: With the goal of identifying regions with bicortical bone and avoiding root contact, the present study proposes an innovative technique for the simulation of the insertion of mini orthodontic implants using automatic jaw segmentation. The simulation of mini implants takes place in 3D rendering visualization instead of Multi-Planar Reconstruction (MPR) sections. Materials and Methods: The procedure involves utilizing software that automatically segments the jaw, teeth, and implants, ensuring their visibility in 3D rendering images. These segmented files are utilized as study models to determine the optimum location for simulating orthodontic implants, in particular locations characterized by limited distances between the implant and the roots, as well as locations where the bicortical structures are present. Results: By using this method, we were able to simulate the insertion of mini implants in the maxilla by applying two cumulative requirements: the implant tip needs to be positioned in a bicortical area, and it needs to be situated more than 0.6 mm away from the neighboring teeth's roots along all of their axes. Additionally, it is possible to replicate the positioning of the mini implant in order to distalize the molars in the mandible while avoiding the mandibular canal and the path of molar migration. Conclusions: The utilization of automated segmentation and visualization techniques in 3D rendering enhances safety measures during the simulation and insertion of orthodontic mini implants, increasing the insertion precision and providing an advantage in the identification of bicortical structures, increasing their stability.

HBIM MODELLING PROCESS FROM 3D POINT CLOUDS BY APPLYING ARTIFICIAL INTELLIGENCE ALGORITHMS IN CULTURAL HERITAGE

In the context of Cultural Heritage (CH), the widespread adoption of 3D point cloud technology, coupled with Artificial Intelligence (AI) algorithms, plays a pivotal role. These technologies facilitate the creation of as-built models by integrating Building Information Modelling (BIM) strategies, enhancing collaboration within the Architecture, Engineering, and Construction (AEC) sector. Leveraging computer vision, robotics, and remote sensing, 3D points clouds provide rich data. However, manual segmentation and classification are labor-intensive and error prone. Consequently, researchers increasingly turn to machine learning (ML) and deep learning (DL) techniques for automating these tasks. The transition from manual reconstruction to automated procedures is crucial. Despite progress, gaps remain, particularly in incorporating 3D point cloud segmentation into Historical Building Information Modelling (HBIM). The lack of conclusive evidence regarding automated derivation of parametric attributes from segmentation outcomes underscores the need for further exploration. Addressing this gap is essential for cultural asset documentation, conservation, and upkeep. By automating the segmentation and classification of 3D point clouds, efficient communication via a shared database becomes feasible. The article aims to review studies on semantically parsing and classifying 3D point clouds using AI algorithms, particularly within complex cultural heritage geometries, shedding light on potential benefits and barriers.

Spiral volumetric optoacoustic tomography of reduced oxygen saturation in the spinal cord of M83 mouse model of Parkinson's disease.

Metabolism and bioenergetics in the central nervous system play important roles in the pathophysiology of Parkinson's disease (PD). Here, we employed a multimodal imaging approach to assess oxygenation changes in the spinal cord of the transgenic M83 murine model of PD overexpressing the mutated A53T alpha-synuclein form in comparison with non-transgenic littermates. In vivo spiral volumetric optoacoustic tomography (SVOT) was performed to assess oxygen saturation (sO2) in the spinal cords of M83 mice and non-transgenic littermates. Ex vivo high-field T1-weighted (T1w) magnetic resonance imaging (MRI) at 9.4T was used to assess volumetric alterations in the spinal cord. 3D SVOT analysis and deep learning-based automatic segmentation of T1w MRI data for the mouse spinal cord were developed for quantification. Immunostaining for phosphorylated alpha-synuclein (pS129 α-syn), as well as vascular organization (CD31 and GLUT1), was performed after MRI scan. In vivo SVOT imaging revealed a lower sO2SVOT in the spinal cord of M83 mice compared to non-transgenic littermates at sub-100μm spatial resolution. Ex vivo MRI-assisted by in-house developed deep learning-based automatic segmentation (validated by manual analysis) revealed no volumetric atrophy in the spinal cord of M83 mice compared to non-transgenic littermates at 50μm spatial resolution. The vascular network was not impaired in the spinal cord of M83 mice in the presence of pS129 α-syn accumulation. We developed tools for deep-learning-based analysis for the segmentation of mouse spinal cord structural MRI data, and volumetric analysis of sO2SVOT data. We demonstrated non-invasive high-resolution imaging of reduced sO2SVOT in the absence of volumetric structural changes in the spinal cord of PD M83 mouse model.

MG-Net: A fetal brain tissue segmentation method based on multiscale feature fusion and graph convolution attention mechanisms

Background and Objective:Fetal brain tissue segmentation provides foundational support for comprehensively understanding the neurodevelopment of normal and congenital disease-affected fetuses. Manual labeling is very time-consuming, and automated segmentation methods can greatly improve the efficiency of doctors. At the same time, fetal brain tissue undergoes various changes throughout the pregnancy, leading to a continuous change in tissue contrast, which greatly increases the difficulty of training segmentation methods. This study aims to develop an automated segmentation model that can efficiently and accurately segment fetal brain tissue, improving the workflow for medical professionals. Methods:We propose a novel deep learning-based segmentation model that incorporates three innovative components: Firstly, a new Dual Dilated Attention Block (DDAB) is proposed in the encoder part to enhance the feature extraction of local spatial and structural contextual information. Secondly, a Multi-scale Deformable Transformer (MSDT) is integrated into the bottleneck to improve the feature extraction of global information on local spatial and structural contextual information. Thirdly, we use a novel block based on Graph Convolution Attention (GCAB) in the decoder, which effectively enhances the features at the decoder.The code is available at https://github.com/unicoco7/MG-Net/. Results:We trained and tested on the FeTA 2021 and FeTA 2022 datasets, and evaluated using seven popular metrics, including Dice, IoU, MAE, BoundaryF, PRE, SEN, and SPE. Compared to the current state-of-the-art 3D segmentation models such as nnFormer, SwinUNETR, and 3DUX-net, our proposed method has surpassed all of them in metrics like Dice, IoU, and MAE. Specifically, on the FeTA 2021 dataset, our model achieved a Dice of 0.8666, an IoU of 0.7646, and an MAE of 0.0027; on the FeTA 2022 dataset, it achieved a Dice of 0.8552, an IoU of 0.7470, and an MAE of 0.0005. Conclusion:In this paper, we propose a model for three-dimensional fetal brain tissue segmentation based on multi-scale feature fusion and graph convolution attention mechanism, and conduct experimental evaluation on the FeTA 2021 and FeTA 2022 datasets. Understanding the boundaries of fetal brain tissue is crucial for doctors’ diagnosis, so the proposed model is expected to improve the speed and accuracy of doctors’ diagnoses.

Vessel Geometry Estimation for Patients with Peripheral Artery Disease

The estimation of vessels’ centerlines is a critical step in assessing the geometry of the vessel, the topological representation of the vessel tree, and vascular network visualization. In this research, we present a novel method for obtaining geometric parameters from peripheral arteries in 3D medical binary volumes. Our approach focuses on centerline extraction, which yields smooth and robust results. The procedure starts with a segmented 3D binary volume, from which a distance map is generated using the Euclidean distance transform. Subsequently, a skeleton is extracted, and seed points and endpoints are identified. A search methodology is used to derive the best path on the skeletonized 3D binary array while tracking from the goal points to the seed point. We use the distance transform to calculate the distance between voxels and the nearest vessel surface, while also addressing bifurcations when vessels divide into multiple branches. The proposed method was evaluated on 22 real cases and 10 synthetically generated vessels. We compared our method to different state-of-the-art approaches and demonstrated its better performance. The proposed method achieved an average error of 1.382 mm with real patient data and 0.571 mm with synthetic data, both of which are lower than the errors obtained by other state-of-the-art methodologies. This extraction of the centerline facilitates the estimation of multiple geometric parameters of vessels, including radius, curvature, and length.

An objective comparison of methods for augmented reality in laparoscopic liver resection by preoperative-to-intraoperative image fusion from the MICCAI2022 challenge

Augmented reality for laparoscopic liver resection is a visualisation mode that allows a surgeon to localise tumours and vessels embedded within the liver by projecting them on top of a laparoscopic image. Preoperative 3D models extracted from Computed Tomography (CT) or Magnetic Resonance (MR) imaging data are registered to the intraoperative laparoscopic images during this process. Regarding 3D-2D fusion, most algorithms use anatomical landmarks to guide registration, such as the liver’s inferior ridge, the falciform ligament, and the occluding contours. These are usually marked by hand in both the laparoscopic image and the 3D model, which is time-consuming and prone to error. Therefore, there is a need to automate this process so that augmented reality can be used effectively in the operating room. We present the Preoperative-to-Intraoperative Laparoscopic Fusion challenge (P2ILF), held during the Medical Image Computing and Computer Assisted Intervention (MICCAI 2022) conference, which investigates the possibilities of detecting these landmarks automatically and using them in registration. The challenge was divided into two tasks: (1) A 2D and 3D landmark segmentation task and (2) a 3D-2D registration task. The teams were provided with training data consisting of 167 laparoscopic images and 9 preoperative 3D models from 9 patients, with the corresponding 2D and 3D landmark annotations. A total of 6 teams from 4 countries participated in the challenge, whose results were assessed for each task independently. All the teams proposed deep learning-based methods for the 2D and 3D landmark segmentation tasks and differentiable rendering-based methods for the registration task. The proposed methods were evaluated on 16 test images and 2 preoperative 3D models from 2 patients. In Task 1, the teams were able to segment most of the 2D landmarks, while the 3D landmarks showed to be more challenging to segment. In Task 2, only one team obtained acceptable qualitative and quantitative registration results. Based on the experimental outcomes, we propose three key hypotheses that determine current limitations and future directions for research in this domain.

Fully automated method for three-dimensional segmentation and fine classification of mixed dentition in cone-beam computed tomography using deep learning

ObjectiveTo establish a high-precision, automated model using deep learning for the fine classification and three-dimensional (3D) segmentation of mixed dentition in cone-beam computed tomography (CBCT) images. MethodsA high-precision, automated deep learning model was built based on modified nnU-Net and U-Net networks and was used to classify and segment mixed dentition. It was trained on a series of 336 CBCT scans and tested using 120 mixed dentition CBCT scans from three centers and 143 permanent dentition CBCT scans from a public dataset. The diagnostic performance of the model was assessed and compared with those of two observers with different seniority levels. ResultsThe model achieved accurate classification and segmentation of specific tooth positions in the internal and external mixed dentition datasets (Dice similarity coefficient: 0.964 vs. 0.951; Jaccard coefficient: 0.931 vs. 0.921; precision: 0.963 vs. 0.945; recall: 0.945 vs. 0.941; F-1 score: 0.954 vs. 0.943). These indices consistently exceeded 0.9 across multiple conditions, including fillings, malocclusion, and supernumerary tooth, with an average symmetric surface distance of 0.091 ± 0.029 mm. For permanent dentition, the Dice similarity and Jaccard coefficients exceeded 0.90, the average symmetric surface distance was 0.190 ± 0.092 mm, and precision and recall exceeded 0.94. With the aid of the model, the performance of junior dentists in mixed dentition classification and segmentation improved significantly; in contrast, there was no significant improvement in the performance of senior dentists. The speed of segmentation conducted by the dentists increased by 20.9–22.8 times. ConclusionThe artificial intelligence model has strong clinical applicability, robustness, and generalizability for mixed and permanent dentition. Clinical SignificanceThe precise classification and 3D segmentation of mixed dentition in dentofacial deformities, supernumerary teeth, and metal artifacts present challenges. This study developed a deep learning approach to analyze CBCT scans, enhancing diagnostic accuracy and efficacy. It facilitates detailed measurements of tooth morphology and movement as well as informed orthodontic planning and orthotic design. Additionally, this method supports dental education by assisting doctors in explaining CBCT images to the families of pediatric patients.

On filling the intra-class and inter-class gaps for few-shot segmentation

Few-shot segmentation (FSS) has made remarkable success through prototypical learning. However, owing to the scarcity of support data, FSS methods continue to suffer from huge intra-class and inter-class gaps. In this paper, we introduce a unified network, termed FGNet++, aimed at addressing both gaps. FGNet++ comprises a Self-Adaptive Module (SAM) to emphasize the query features and generate enhanced prototypes for self-alignment. These prototypes contain the intrinsic information of each query sample, thereby mitigating the intra-class appearance gaps. Moreover, we augment SAM with a Feature Transformation Module (FTM) to further reduce intra-class appearance discrepancies. On the other hand, we introduce an Inter-class Feature Separation Module (IFSM) dedicated to bridge the inter-class gap. With a B-SLIC based background loss and a cross-category loss for training, IFSM makes it easy to distinguish the feature space of the target class from other non-target classes. Furthermore, to assess the generality of our approach, we extend our work to 3D point cloud few-shot segmentation and present FGNet-3D. Experimental results demonstrate that our method successfully mitigates both intra-class and inter-class gaps in FSS through SAM and IFSM, respectively, and achieves state-of-the-art performances on multiple datasets compared with previous approaches.

Artificial intelligence-aided semi-automatic joint trace detection from textured three-dimensional models of rock mass

It is of great importance to obtain precise trace data, as traces are frequently the sole visible and measurable parameter in most outcrops. The manual recognition and detection of traces on high-resolution three-dimensional (3D) models are relatively straightforward but time-consuming. One potential solution to enhance this process is to use machine learning algorithms to detect the 3D traces. In this study, a unique pixel-wise texture mapper algorithm generates a dense point cloud representation of an outcrop with the precise resolution of the original textured three-dimensional (3D) model. A virtual digital image rendering was then employed to capture virtual images of selected regions. This technique helps to overcome limitations caused by the surface morphology of the rock mass, such as restricted access, lighting conditions, and shading effects. After AI-powered trace detection on two-dimensional (2D) images, a 3D data structuring technique was applied to the selected trace pixels. In the 3D data structuring, the trace data were structured through 2D thinning, 3D reprojection, clustering, segmentation, and segment linking. Finally, the linked segments were exported as 3D polylines, with each polyline in the output corresponding to a trace. The efficacy of the proposed method was assessed using a 3D model of a real-world case study, which was used to compare the results of artificial intelligence (AI)-aided and human intelligence trace detection. Rosette diagrams, which visualize the distribution of trace orientations, confirmed the high similarity between the automatically and manually generated trace maps. In conclusion, the proposed semi-automatic method was easy to use, fast, and accurate in detecting the dominant jointing system of the rock mass.

In Vitro Comparison of Pulsed-Thulium:YAG, Holmium:YAG, and Thulium Fiber Laser.

Objective: To characterize the pulse characteristics and risk of fiber fracture (ROF) of the pulsed-Thulium:YAG (p-Tm:YAG) laser and to compare its ablation volumes (AVs) against Holmium:Yttrium-Aluminium-Garnet (Ho:YAG) laser and Thulium fiber laser (TFL). Materials and Methods: p-Tm:YAG (100 W-Thulio, Dornier-Medtech©, Germany) was characterized using single-use 272 μm core-diameter-fibers. p-Tm:YAG characterization included pulse shape, duration, and peak power (PP) studies. ROF was assessed after 5 minutes of continuous laser activation (CLA) at five decreasing fiber bend radii (1, 0.9, 0.75, 0.6, and 0.45 cm). p-Tm:YAG, Ho:YAG (120 W-Cyber-Ho, Quanta®, USA), and TFL (60 W-TFLDrive, Coloplast®, Denmark) AVs were compared using a 20-mm linear CLA at 2 mm/second velocity in contact with 20 mm3 hard stone phantoms (HSP) and soft stone phantoms (SSP) (15:3 and 15:5 water to powder ratio, respectively) fully submerged in saline at 0.5 J-20 Hz or 1 J-10 Hz. After CLA, phantoms underwent three-dimensional (3D) micro-scanning (CT) and subsequent 3D segmentation to estimate the AVs, using 3DSlicer©. Each experiment was performed in triplicate. Results: p-Tm:YAG presents a uniform pulse profile in all of the available preset modes. PP ranged from 564 to 2199 W depending on pulse mode. No laser fiber fracture occurred at any bend radius. p-Tm:YAG achieved similar mean AVs to TFL and Ho:YAG for HSP (8.96 ± 3.1 vs 9.78 ± 1.1 vs 8.8 ± 2.8 mm3, p = 0.67) but TFL was associated with higher AVs compared with p-Tm:YAG and Ho:YAG (12.86 ± 1.85 vs 10.12 ± 1.89 vs 7.56 ± 2.21 mm3, p = 0.002) against SSP. AVs for HSP increased with pulse energy for p-Tm:YAG and Ho:YAG and (11.56 ± 1.8 vs 6.36 ± 0.84 mm3 and 11.27 ± 1.98 vs 6.34 ± 0.55 mm3, p = 0.03 and p = 0.02), whereas AVs for SSP were similar across laser settings for all laser sources. AVs with TFL were similar across laser settings for both phantom types. Conclusion: p-Tm:YAG combines intermediate PP between Ho:YAG and TFL, a uniform pulse profile, no ROF with increasing deflection and effective ablation rates. Further clinical studies are needed to confirm these in vitro results.