Characteristics Of Medical Images Research Articles

AUTOMATIC EFFUSION MEASUREMENT WITH LIMITED LABELED DATA

Accurate quantification of effusion volume is becoming more important as OA is increasingly recognized to have inflammatory components including joint effusion. Effective clinical management requires accurate quantification of features related to inflammation; particularly synovitis and joint effusion which represents a target for therapy. Rather than relying on highly variable subjective assessment of joint effusions, with the development of deep learning techniques we have witnessed increased automation of radiological assessments. However, most of these techniques use supervised learning and are trained on large annotated datasets. Acquiring “ground truth” labels for large datasets is expensive and time-consuming. This becomes even more complicated and challenging when it comes to detecting medical image features like effusion. Detecting effusions accurately requires a high level of expertise. Because pockets of joint fluid can be in unexpected locations, human experts frequently need to step back to look at the entire image stack multiple times to prevent inattentional error. Therefore, proposing a method for learning from limited labeled data is crucial for medical image analysis. To perform automated measurement of knee effusion volume using minimal labeled data. In this method, we aim to develop an alternative deep learning training strategy based on self-supervised pretraining on unlabeled knee MRI scans. This study requires two sets of data: 1) a large unlabeled dataset, and 2) a small labeled dataset. For the large unlabeled dataset, we have used 4 different OAI MRI sequence data (64k slices have been selected randomly). For the labeled dataset we have used low-resolution sagittal Turbo Spin Echo (TSE) MR sequences from the OAI dataset. Effusion regions were extracted by a trained musculoskeletal radiologist (DC) for 23 participants (a total of 31 scans) using an interactive software developed in-house. We have used 5 scans for the test and 26 scans (a total of 700 slices) for training. In this method, IMaskRCNN deep learning architecture with the ResNet-101 backbone have been used. The training process has been performed in two-phase, self-supervised pretraining, and fine-tuning. The self-supervised pretraining using the fill-blank method was performed on unlabeled images to learn visual representations in musculoskeletal MRIs. After pretraining, we fined-tuned last layers of the network (backbone weights have been frozen) using the training division of the small TSE dataset. The dice similarity coefficient, Intersection over union (IoU) was used to compare the result of the segmentation between the predicted output and the ground truth. Qualitative results of the proposed method is presented in the figure. As shown the network was able to provide a good prediction of effusion location and extracting it. The segmentation model using the proposed pretraining method was successful in finding the location of effusion for 90% of the slices with IoU = 60%. The dice score for the detected effusion is 0.70 indicates a high agreement between the automatic segmentation and the labels provided by the expert. Self-supervised pretraining on the OAI dataset, can be a solution to the scarcity of pixel-wise ground truth (GT) for effusion quantification. Alberta Innovates, AHS Chair in Diagnostic Imaging, Medical Imaging Consultants, CIHR. CORRESPONDENCE ADDRESS: banafshe.felfeliyan@ucalgary.ca

Intelligent cloud assistance for healthcare sectors

E-healthcare systems have been measured by the drastically facilitating healthcare monitoring, earlier intervention and disease modelling and proof-based medical consultancy using medical image feature extraction and text mining. Due to certain resource constraints encountered in wearable devices, it is essential to outsource frequently generated healthcare information of individuals to cloud systems. Regrettably, handling both computation and storage to some un-trusted entity is a sequence of privacy and security crisis. The prevailing approaches significantly concentrate on finely tuning privacy preservation statistical medical text analysis and access, which is barely considered as a dynamic fluctuation of health condition and analysis of medical image. In this work, an effectual and secure privacy preservation dynamic medical modelling scheme has been anticipated as a healthcare service with cloud-based e-healthcare solution that offers automated functions to notify nearby hospitals in providing immediate proper treatment for medical emergencies.

Radiomics and deep learning approach to the differential diagnosis of parotid gland tumors.

Advances in computer technology and growing expectations from computer-aided systems have led to the evolution of artificial intelligence into subsets, such as deep learning and radiomics, and the use of these systems is revolutionizing modern radiological diagnosis. In this review, artificial intelligence applications developed with radiomics and deep learning methods in the differential diagnosis of parotid gland tumors (PGTs) will be overviewed. The development of artificial intelligence models has opened new scenarios owing to the possibility of assessing features of medical images that usually are not evaluated by physicians. Radiomics and deep learning models come to the forefront in computer-aided diagnosis of medical images, even though their applications in the differential diagnosis of PGTs have been limited because of the scarcity of data sets related to these rare neoplasms. Nevertheless, recent studies have shown that artificial intelligence tools can classify common PGTs with reasonable accuracy. All studies aimed at the differential diagnosis of benign vs. malignant PGTs or the identification of the commonest PGT subtypes were identified, and five studies were found that focused on deep learning-based differential diagnosis of PGTs. Data sets were created in three of these studies with MRI and in two with computed tomography (CT). Additional seven studies were related to radiomics. Of these, four were on MRI-based radiomics, two on CT-based radiomics, and one compared MRI and CT-based radiomics in the same patients.

Automatic Translation of Medical Information Based on Text Feature Recognition

In order to improve the effect of the medical information automatic translation system, based on the text feature recognition technology of medical image, this paper constructs an automatic translation system that can recognize medical images. On the basis of the medical information image retrieval based on the combination of text information and visual information, this paper uses automatic image annotation technology and semantic similarity calculation method to extract the text and semantic features of medical information images. Then, this paper uses the inherent multi-information fusion capability of the Bayesian inference network to fuse the text features of medical information images and the semantic features of image content together to realize medical information image retrieval. Finally, this paper designs experiments to test the performance of the medical information automatic translation system. The research shows that the system constructed in this paper has certain effects.

Decomposing normal and abnormal features of medical images for content-based image retrieval of glioma imaging.

In medical imaging, the characteristics purely derived from a disease should reflect the extent to which abnormal findings deviate from the normal features. Indeed, physicians often need corresponding images without abnormal findings of interest or, conversely, images that contain similar abnormal findings regardless of normal anatomical context. This is called comparative diagnostic reading of medical images, which is essential for a correct diagnosis. To support comparative diagnostic reading, content-based image retrieval (CBIR) that can selectively utilize normal and abnormal features in medical images as two separable semantic components will be useful. In this study, we propose a neural network architecture to decompose the semantic components of medical images into two latent codes: normal anatomy code and abnormal anatomy code. The normal anatomy code represents counterfactual normal anatomies that should have existed if the sample is healthy, whereas the abnormal anatomy code attributes to abnormal changes that reflect deviation from the normal baseline. By calculating the similarity based on either normal or abnormal anatomy codes or the combination of the two codes, our algorithm can retrieve images according to the selected semantic component from a dataset consisting of brain magnetic resonance images of gliomas. Moreover, it can utilize a synthetic query vector combining normal and abnormal anatomy codes from two different query images. To evaluate whether the retrieved images are acquired according to the targeted semantic component, the overlap of the ground-truth labels is calculated as metrics of the semantic consistency. Our algorithm provides a flexible CBIR framework by handling the decomposed features with qualitatively and quantitatively remarkable results.

Generalized methodology for radiomic feature selection and modeling in predicting clinical outcomes

Background. Quantitative radiomic features of medical images could provide clinical significance in assisting decision-making, but the existing feature selection and modeling methods are usually parameter-dependent. We aim to develop and validate a generalized radiomic method applicable to a variety of clinical outcomes. Methods and materials. A generalized methodology for radiomic feature selection and modeling (‘GRFM’ for short), including two-step feature selection and logistic regression, was proposed for studying clinical outcomes correlations. The two-step feature selection consists of Pearson correlation analysis followed by a sequential forward floating selection algorithm to identify robust feature subsets. We also applied an adaptive searching strategy to systematically determine globally optimal parameters, rather than relying on preset parameters. The area under the receiver operating characteristic curve (AUC) was used to evaluate the performance of three outcomes: lymph node metastasis of gastric cancer (GC), the five-year survival status of high-grade osteosarcoma (HOS), and the pathological grade of pancreatic neuroendocrine tumors (pNETs). Results. The optimal Pearson thresholds were 0.85, 0.80 and 0.75, and the optimal feature numbers were 11, 14 and 8 in GC, HOS and pNETs, respectively. The AUC values of the three predictive models combined with the corresponding parameters were 0.9017 versus 0.9026, 0.7652 versus 0.7113, and 0.8438 versus 0.8212 for the training and validation cohorts, showing promissing generality and classifier performance . Conclusion. The proposed method was helpful in predicting different clinical outcomes, and has potential application as a general and noninvasive prediction tool to guide clinical decision-making in various cancer sites.

Feature Extraction Processing Method of Medical Image Fusion Based on Neural Network Algorithm

Medical image technology is becoming more and more important in the medical field. It not only provides important information about internal organs of the body for clinical analysis and medical treatment but also assists doctors in diagnosing and treating various diseases. However, in the process of medical image feature extraction, there are some problems, such as inconspicuous feature extraction and low feature preparation rate. Combined with the learning idea of convolution neural network, the image multifeature vectors are quantized in a deeper level, which makes the image features further abstract and not only makes up for the one-sidedness of single feature description but also improves the robustness of feature descriptors. This paper presents a medical image processing method based on multifeature fusion, which has high feature extraction effect on medical images of chest, lung, brain and liver, and can better express the feature relationship of medical images. Experimental results show that the accuracy of the proposed method is more than 5% higher than that of other methods, which shows that the performance of the proposed method is better.

Text-based multi-dimensional medical images retrieval according to the features-usage correlation.

Emerging medical imaging applications in healthcare, the number and volume of medical images is growing dramatically. Information needs of users in such circumstances, either for clinical or research activities, make the role of powerful medical image search engines more significant. In this paper, a text-based multi-dimensional medical image indexing technique is proposed in which correlation of the features-usages (according to the user’s queries) is considered to provide an off-the content indexing while taking users’ interestingness into account. Assuming that each medical image has some extracted features (e.g., based on the DICOM standard), correlations of the features are discovered by performing data mining techniques (i.e., quantitative association pattern discovery), on the history of users’ queries as a data set. Then, based on the pairwise correlation of the features of medical images (a.k.a. Affinity), set of the all features is fragmented into subsets (using method like the vertical fragmentation of the tables in distribution of relational DBs). After that, each of these subsets of the features turn into a hierarchy of the features (by applying a hierarchical clustering algorithm on that subset), subsequently all of these distinct hierarchies together make a multi-dimensional structure of the features of medical images, which is in fact the proposed text-based (feature-based) multi-dimensional index structure. Constructing and using such text-based multi-dimensional index structure via its specific required operations, medical image retrieval process would be improved in the underlying medical image search engine. Generally, an indexing technique is to provide a logical representation of documents in order to optimize the retrieval process. The proposed indexing technique is designed such that can improve retrieval of medical images in a medical image search engine in terms of its effectiveness and efficiency. Considering correlation of the features of the image would semantically improve precision (effectiveness) of the retrieval process, while traversing them through the hierarchy in one dimension would try to optimize (i.e., minimize) the resources to have a better efficiency. The proposed text-based multi-dimensional indexing technique is implemented using the open source search engine Lucene, and compared with the built-in indexing technique available in the Lucene search engine, and also with the Terrier platform (available for the benchmarking of information retrieval systems) and other the most related indexing techniques. Evaluation results of memory usage and time complexity analysis, beside the experimental evaluations efficiency and effectiveness measures show that the proposed multi-dimensional indexing technique significantly improves both efficiency and effectiveness for a medical image search engine.Graphical abstract

Lumbar Disc Herniation Automatic Detection in Magnetic Resonance Imaging Based on Deep Learning.

Background: Lumbar disc herniation (LDH) is among the most common causes of lower back pain and sciatica. The causes of LDH have not been fully elucidated but most likely involve a complex combination of mechanical and biological processes. Magnetic resonance imaging (MRI) is a tool most frequently used for LDH because it can show abnormal soft tissue areas around the spine. Deep learning models may be trained to recognize images with high speed and accuracy to diagnose LDH. Although the deep learning model requires huge numbers of image datasets to train and establish the best model, this study processed enhanced medical image features for training the small-scale deep learning dataset.Methods: We propose automatic detection to assist the initial LDH exam for lower back pain. The subjects were between 20 and 65 years old with at least 6 months of work experience. The deep learning method employed the YOLOv3 model to train and detect small object changes such as LDH on MRI. The dataset images were processed and combined with labeling and annotation from the radiologist’s diagnosis record.Results: Our method proves the possibility of using deep learning with a small-scale dataset with limited medical images. The highest mean average precision (mAP) was 92.4% at 550 images with data augmentation (550-aug), and the YOLOv3 LDH training was 100% with the best average precision at 550-aug among all datasets. This study used data augmentation to prevent under- or overfitting in an object detection model that was trained with the small-scale dataset.Conclusions: The data augmentation technique plays a crucial role in YOLOv3 training and detection results. This method displays a high possibility for rapid initial tests and auto-detection for a limited clinical dataset.

Medical Image Segmentation Algorithm Based on Multi-scale Color Wavelet Texture

In order to improve the segmentation accuracy of brain tumor magnetic resonance medical image, a segmentation method of brain tumor magnetic resonance medical image based on multi-scale color wavelet texture features is proposed. The segmentation model of brain tumor magnetic resonance medical image is established, and the motion damage information of brain tumor magnetic resonance medical image is adaptively fused in the ultrasound imaging environment. The medical image information is enhanced by using the motion skeletal muscle block matching technology. According to the suspicious point feature matching method of brain tumor, the fusion detection and processing of brain tumor magnetic resonance medical image are carried out. The multi-scale color wavelet texture feature detection method is used to extract the image features of brain tumor MRI points, and the CT bright spot features are used to analyze the features of brain tumor MRI medical images. Combined with the adaptive neural network training method, the automatic detection of brain tumor magnetic resonance medical image is completed, and the suspected brain tumor points are extracted, so as to realize the segmentation of brain tumor magnetic resonance medical image. Simulation results show that the proposed method can effectively improve the segmentation accuracy of brain tumor MRI medical image, and has high resolution and accuracy for suspicious brain tumor detection.

An annotated T2-weighted magnetic resonance image collection of testicular germ and non-germ cell tumors

Testicular cancer is a rare tumor with a worldwide incidence that has increased over the last few decades. The majority of these tumors are testicular non-germ (TNGCTs) and germ cell tumors (TGCTs); the latter divided into two broad classes - seminomatous (SGCTs) and non-seminomatous germ cell tumors (NSGCTs). Although ultrasonography (US) maintains a primary role in the diagnostic workup of scrotal pathology, magnetic resonance imaging (MRI) has emerged as the imaging modality recommended for challenging cases, providing additional information to clarify inconclusive/equivocal US. In this work we describe and publicly share a collection of 44 images of annotated T2-weighted MRI lesions from 42 patients. Given that testicular cancer is a rare tumor, we are confident that this collection can be used to validate statistical models and to further investigate TNGCT and TGCT peculiarities using medical imaging features.

Testing soft tissue radiodensity parameters interplay with age and self-reported physical activity.

Aging well is directly associated to a healthy lifestyle. The focus of this paper is to relate individual wellness with medical image features. Non-linear trimodal regression analysis (NTRA) is a novel method that models the radiodensitometric distributions of x-ray computed tomography (CT) cross-sections. It generates 11 patient-specific parameters that describe the quality and quantity of muscle, fat, and connective tissues. In this research, the relationship of these 11 NTRA parameters with age, physical activity, and lifestyle is investigated in the 3,157 elderly volunteers AGES-I dataset. First, univariate statistical analyses were performed, and subjects were grouped by age and self-reported past (youth–midlife) and present (within 12 months of the survey) physical activity to ascertain which parameters were the most influential. Then, machine learning (ML) analyses were conducted to classify patients using NTRA parameters as input features for three ML algorithms. ML is also used to classify a Lifestyle index using the age groups. This classification analysis yielded robust results with the lifestyle index underlying the relevant differences of the soft tissues between age groups, especially in fat and connective tissue. Univariate statistical models suggested that NTRA parameters may be susceptible to age and differences between past and present physical activity levels. Moreover, for both age and physical activity, lean muscle parameters expressed more significant variation than fat and connective tissues.

A Review of the Role of the S-Detect Computer-Aided Diagnostic Ultrasound System in the Evaluation of Benign and Malignant Breast and Thyroid Masses.

Computer-aided diagnosis (CAD) systems have attracted extensive attention owing to their performance in the field of image diagnosis and are rapidly becoming a promising auxiliary tool in medical imaging tasks. These systems can quantitatively evaluate complex medical imaging features and achieve efficient and high-diagnostic accuracy. Deep learning is a representation learning method. As a major branch of artificial intelligence technology, it can directly process original image data by simulating the structure of the human brain neural network, thus independently completing the task of image recognition. S-Detect is a novel and interactive CAD system based on a deep learning algorithm, which has been integrated into ultrasound equipment and can help radiologists identify benign and malignant nodules, reduce physician workload, and optimize the ultrasound clinical workflow. S-Detect is becoming one of the most commonly used CAD systems for ultrasound evaluation of breast and thyroid nodules. In this review, we describe the S-Detect workflow and outline its application in breast and thyroid nodule detection. Finally, we discuss the difficulties and challenges faced by S-Detect as a precision medical tool in clinical practice and its prospects.

Fusion of medical images based on salient features extraction by PSO optimized fuzzy logic in NSST domain

The aim of multimodal medical image fusion is to extract information from different modal images into a single one so that the single fusion image contains the salient features of the source images to the maximum extent. Different medical imaging modalities such as CT and MRI are presented as different visual morphology, which often show different complementary salient features in clinical diagnosis. According to this characteristic, in order to fuse different salient features of multimodal medical images into a single image and provide a new dimension of information for clinical diagnosis to improve the diagnosis accuracy, an improved image fusion algorithm based on visual salience detection is proposed in this paper. The visual salience of two registered source images is calculated by the GBVS algorithm, and the low-frequency and high-frequency sub-bands are obtained by decomposing the source images in NSST domain. For the low-frequency sub-bands, fuzzy logic system is used to obtain the respective weights of the fused low-frequency sub-band with the local energy and GBVS graph as input. For the high-frequency sub-bands, the NSML values of each sub-band are calculated and compared to obtain the fused high-frequency sub-band. The final fused image is obtained by the inverse NSST transformation. In addition, PSO algorithm is used to optimize the membership function of fuzzy logic system for better adaption to medical images and feature extraction. By applying this multimodal medical image fusion method, the visual quality of the image is effectively improved and the salient features of tissues are preserved well. Experiments on fusion of grayscale, color and ultrasound multimodal medical images show that the proposed method has advantages on retention of image salient features. Compared with other models, the fused image obtained by the proposed method has higher objective indexes with clearer edge contour, higher overall contrast, and no ringing effect and artifacts.

Content Based Medical Image Retrieval Based on Salient Regions Combined with Deep Learning

In traditional text based medical image retrieval system, it is hard to find visually similar images in large medical image database. Content-based image retrieval is developed to retrieve similar images and it is based on visual attributes describing the content of an image. Developing a method for content based medical image retrieval is a challenging task. This paper proposed a new method for content-based medical image retrieval based on salient regions and deep learning. The proposed method includes two stages: an offline task to extract local object features and an online task for content-based image retrieval in database. In first stage, we extract local object features of medical image depending on shape, texture and intensity, and features extracted by deep learning applied in saliency of decomposition. Secondly, we make online task for content-based image retrieval in database. The user gives query image as an input and the system will retrieve n top most similar images by similarity comparison with bag of code words feature values obtained in the first stage. Evaluation of the proposed method is based on Precision and Recall values. Our dataset includes 5 groups of medical images with their quality varying from low to high. With the best medical image quality group, the accuray can be 91.61% for Precision and 89.61% for Recall. Comparing the average values with others methods, the results of the proposed method are more than 2 to 5% better.

Semi-supervised GAN-based Radiomics Model for Data Augmentation in Breast Ultrasound Mass Classification

Background and ObjectiveThe capability of deep learning radiomics (DLR) to extract high-level medical imaging features has promoted the use of computer-aided diagnosis of breast mass detected on ultrasound. Recently, generative adversarial network (GAN) has aided in tackling a general issue in DLR, i.e., obtaining a sufficient number of medical images. However, GAN methods require a pair of input and labeled images, which require an exhaustive human annotation process that is very time-consuming. The aim of this paper is to develop a radiomics model based on a semi-supervised GAN method to perform data augmentation in breast ultrasound images. MethodsA total of 1447 ultrasound images, including 767 benign masses and 680 malignant masses were acquired from a tertiary hospital. A semi-supervised GAN model was developed to augment the breast ultrasound images. The synthesized images were subsequently used to classify breast masses using a convolutional neural network (CNN). The model was validated using a 5-fold cross-validation method. ResultsThe proposed GAN architecture generated high-quality breast ultrasound images, verified by two experienced radiologists. The improved performance of semi-supervised learning increased the quality of the synthetic data produced in comparison to the baseline method. We achieved more accurate breast mass classification results (accuracy 90.41%, sensitivity 87.94%, specificity 85.86%) with our synthetic data augmentation compared to other state-of-the-art methods. ConclusionThe proposed radiomics model has demonstrated a promising potential to synthesize and classify breast masses on ultrasound in a semi-supervised manner.

Medical image fusion using Transfer Learning and L‐BFGS optimization algorithm

AbstractMedical image fusion can effectively combine different images with different parts and complements each other, which is a hotspot in image processing. However, the medical image acquisition equipment usually obtains single image, so it is unable to use dataset to train convolutional neural network to extract stable image features. This paper proposes an approach using the Transfer Learning combined with the Limited Broyden, Fletcher, Goldfarb, and Shanno (L‐BFGS) optimization algorithm to achieve single medical image fusion. The Transfer Learning which includes pre‐trained model and parameters can be used as a feature extractor to extract or compress features in medical images. Firstly, different single medical images were input into the trained VGG16 Transfer Learning parameter model to extract image features, and then the maximum features between different images were obtained through feature comparison. Finally, L‐BFGS optimization algorithm is used to approximate the initial image features to the maximum features, to achieve the fusion effect (the initial image can be any image of the same size and depth as the source image). The experimental results show that the algorithm is effective and very suitable for medical image fusion.

Deep Multi-path Network Integrating Incomplete Biomarker and Chest CT Data for Evaluating Lung Cancer Risk.

Clinical data elements (CDEs) (e.g., age, smoking history), blood markers and chest computed tomography (CT) structural features have been regarded as effective means for assessing lung cancer risk. These independent variables can provide complementary information and we hypothesize that combining them will improve the prediction accuracy. In practice, not all patients have all these variables available. In this paper, we propose a new network design, termed as multi-path multi-modal missing network (M3Net), to integrate the multi-modal data (i.e., CDEs, biomarker and CT image) considering missing modality with multiple paths neural network. Each path learns discriminative features of one modality, and different modalities are fused in a second stage for an integrated prediction. The network can be trained end-to-end with both medical image features and CDEs/biomarkers, or make a prediction with single modality. We evaluate M3Net with datasets including three sites from the Consortium for Molecular and Cellular Characterization of Screen-Detected Lesions (MCL) project. Our method is cross validated within a cohort of 1291 subjects (383 subjects with complete CDEs/biomarkers and CT images), and externally validated with a cohort of 99 subjects (99 with complete CDEs/biomarkers and CT images). Both cross-validation and external-validation results show that combining multiple modality significantly improves the predicting performance of single modality. The results suggest that integrating subjects with missing either CDEs/biomarker or CT imaging features can contribute to the discriminatory power of our model (p < 0.05, bootstrap two-tailed test). In summary, the proposed M3Net framework provides an effective way to integrate image and non-image data in the context of missing information.

Deep learning based data-adaptive descriptor for non-rigid multi-modal medical image registration

Non-rigid multi-modal medical image registration is a challenging task in the field of medical image processing and analysis because of the unpredictable complicated deformations and the nonfunctional intensity relation between images. The structural representation based registration (SRR) method can address these factors to some extent by transforming this challenging problem into the mono-modal image registration. However, the existing SSR algorithms generally rely on handcrafted features for structural representation, which tend to lead to inaccurate registered results. To address this problem, this paper has proposed a novel Laplacian Eigenmaps based deep learning network for 2D medical image registration. The proposed network is firstly used to extract the intrinsic features of different modal medical images. Then the self-similarity of extracted features is explored to construct the learning based data-adaptive descriptor (LDAD) for structural representations. The sum of squared differences (SSD) between the structural representations of the reference and floating images is used as the similarity metric to construct the objective function for image registration. The experimental results show that the LDAD based registration method can produce visually better registered results and provide higher registration accuracy for different test images than several state-of-the-art registration methods in terms of target registration error.

Medical image segmentation algorithm based on multilayer boundary perception-self attention deep learning model

Traditional medical image segmentation methods have problems such as low segmentation accuracy and low adaptive ability. Therefore, many scholars have proposed a medical image segmentation method based on deep learning, which has achieved good results in the field of medical image segmentation. However, this type of method has the following problems in the application process: (1) Medical image segmentation target boundary positioning problem. Constrained by factors such as medical image contrast, heterogeneity, and boundary resolution, existing convolution models still cannot accurately locate boundaries. (2) Deep adaptability of deep learning network structure to medical images. Because medical images have more distinct and different feature information than natural images, the current deep learning-based medical segmentation methods have not fully considered this feature. In view of this, this paper proposes a multi-level boundary-aware RUNet segmentation model. The network structure consists of a U-Net-based segmentation network and a multi-level boundary detection network. It can solve the problem of boundary positioning. At the same time, in order to solve the problem of poor adaptability of deep learning network structures to medical images, this paper proposes to introduce a new interactive self-attention module into deep learning models. It can make the feature map get global information, and realize the effective extraction of medical image feature information. It solves the problem of weak matching between the deep learning network structure and medical images. Based on the above ideas, this paper proposes an image segmentation algorithm based on a multi-layer boundary perception-self-attention mechanism deep learning model. This method and other mainstream segmentation algorithms are used to perform experiments on related medical databases. The results show that the proposed method not only improves the segmentation effect significantly compared with traditional machine learning methods, but also improves it to a certain extent compared with other deep learning methods.