Multimodal Imaging Research Articles

Accurate segmentation of liver tumor from multi-modality non-contrast images using a dual-stream multi-level fusion framework

The use of multi-modality non-contrast images (i.e., T1FS, T2FS and DWI) for segmenting liver tumors provides a solution by eliminating the use of contrast agents and is crucial for clinical diagnosis. However, this remains a challenging task to discover the most useful information to fuse multi-modality images for accurate segmentation due to inter-modal interference. In this paper, we propose a dual-stream multi-level fusion framework (DM-FF) to, for the first time, accurately segment liver tumors from non-contrast multi-modality images directly. Our DM-FF first designs an attention-based encoder–decoder to effectively extract multi-level feature maps corresponding to a specified representation of each modality. Then, DM-FF creates two types of fusion modules, in which a module fuses learned features to obtain a shared representation across multi-modality images to exploit commonalities and improve the performance, and a module fuses the decision evidence of segment to discover differences between modalities to prevent interference caused by modality’s conflict. By integrating these three components, DM-FF enables multi-modality non-contrast images to cooperate with each other and enables an accurate segmentation. Evaluation on 250 patients including different types of tumors from two MRI scanners, DM-FF achieves a Dice of 81.20%, and improves performance (Dice by at least 11%) when comparing the eight state-of-the-art segmentation architectures. The results indicate that our DM-FF significantly promotes the development and deployment of non-contrast liver tumor technology.

Segmentation model of soft tissue sarcoma based on self-supervised learning.

Soft tissue sarcomas, similar in incidence to cervical and esophageal cancers, arise from various soft tissues like smooth muscle, fat, and fibrous tissue. Effective segmentation of sarcomas in imaging is crucial for accurate diagnosis. This study collected multi-modal MRI images from 45 patients with thigh soft tissue sarcoma, totaling 8,640 images. These images were annotated by clinicians to delineate the sarcoma regions, creating a comprehensive dataset. We developed a novel segmentation model based on the UNet framework, enhanced with residual networks and attention mechanisms for improved modality-specific information extraction. Additionally, self-supervised learning strategies were employed to optimize feature extraction capabilities of the encoders. The new model demonstrated superior segmentation performance when using multi-modal MRI images compared to single-modal inputs. The effectiveness of the model in utilizing the created dataset was validated through various experimental setups, confirming the enhanced ability to characterize tumor regions across different modalities. The integration of multi-modal MRI images and advanced machine learning techniques in our model significantly improves the segmentation of soft tissue sarcomas in thigh imaging. This advancement aids clinicians in better diagnosing and understanding the patient's condition, leveraging the strengths of different imaging modalities. Further studies could explore the application of these techniques to other types of soft tissue sarcomas and additional anatomical sites.

SIMFusion: A semantic information-guided modality-specific fusion network for MR Images

Multi-modal medical image fusion aims to integrate distinct imaging modalities to yield more comprehensive and precise medical images, which can benefit the subsequent image analysis tasks. However, prevailing state-of-the-art image fusion methods, despite substantial advancements, do not explicitly address the efficient handling of complementary information between modalities. Moreover, most current multi-modal medical image fusion methods encounter challenges when integrating with practical tasks, which lack the guidance of semantic information, thus hindering the generation of high-quality images for accurate identification of lesion areas. To deal with these challenges, this paper introduces a novel semantic information-guided modality-specific fusion network for multi-modal magnetic resonance (MR) images, named SIMFusion. Specifically, we propose the decomposition branch to capture common and specific features from MR images of different modalities for fusion to reduce information redundancy through correlated mutual information loss. Subsequently, we obtain their semantic characteristics via the semantic branch utilizing a pre-train segmentation network and, finally, achieve an adaptive balance between the two sets of features through a specialized fusion strategy. Extensive experiments demonstrate the superiority of SIMFusion over existing competing techniques on both BraTS2019 and ISLES2022 datasets, with 8.1% improvement in MI and 38.7 % in VIFF in T2-T1ce image pairs, highlighting the potential of the proposed method as a promising solution for MR image fusion in practical applications.

Ophthalmic findings in the KIF1A-associated neurological disorder (KAND)

PurposeTo define the ophthalmic manifestations in KIF1A-associated neurological disorder (KAND), a rare, progressive neurodegenerative disorder caused by pathogenic variants in the KIFA1 gene. DesignCross-sectional study. MethodsClinical ophthalmic examination and multimodal imaging were performed for 24 participants enrolled in the KIF1AOutcome measures, Assessments, Longitudinal And endpoints (KOALA) Study. Visual evoked potentials (VEP) were performed on select participants. ResultsThe average central visual acuity in pediatric participants was 20/43 (logMAR 0.329, range 0.0-1.0), and 20/119 (logMAR 0.773, range 0.471-1.351) in adults. Ninety-five percent of participants examined had some degree of optic nerve atrophy detected by clinical examination and/or optical coherence tomography (OCT). Almost forty percent had strabismus. Color vision, visual fields and stereopsis were impaired in most participants who were able to participate in testing. VEP showed varying degrees of signal slowing and diffuseness. ConclusionsOptic nerve atrophy is the primary ocular finding in individuals with KAND and is present at higher prevalence than previously reported. The degree of the atrophy is likely dependent on the severity of the pathogenic variant and possibly the age of the patient. Adults had worse vision on average than children, suggesting possible decline in vision with age. Strabismus in this cohort was common. Visual evoked potentials showed findings consistent with optic neuropathy and visual dysfunction even in the absence of obvious structural changes on OCT. Families should be counseled regarding visual impairment in KAND patients, so as to obtain appropriate support and assistance to maximize safety, functionality, and learning.

Alzheimer's Disease stage recognition from MRI and PET imaging data using Pareto-Optimal Quantum Dynamic Optimization

The threat posed by Alzheimer's disease (AD) to human health has grown significantly. However, the precise diagnosis and classification of AD stages remain a challenge. Neuroimaging methods such as structural magnetic resonance imaging (sMRI) and fluorodeoxyglucose positron emission tomography (FDG-PET) have been used to diagnose and categorize AD. However, feature selection approaches that are frequently used to extract additional data from multimodal imaging are prone to errors. This paper suggests using a static pulse-coupled neural network and a Laplacian pyramid to combine sMRI and FDG-PET data. After that, the fused images are used to train the Mobile Vision Transformer (MViT), optimized with Pareto-Optimal Quantum Dynamic Optimization for Neural Architecture Search, while the fused images are augmented to avoid overfitting and then classify unfused MRI and FDG-PET images obtained from the AD Neuroimaging Initiative (ADNI) and Open Access Series of Imaging Studies (OASIS) datasets into various stages of AD. The architectural hyperparameters of MViT are optimized using Quantum Dynamic Optimization, which ensures a Pareto-optimal solution. The Peak Signal-to-Noise Ratio (PSNR), the Mean Squared Error (MSE), and the Structured Similarity Indexing Method (SSIM) are used to measure the quality of the fused image. We found that the fused image was consistent in all metrics, having 0.64 SIMM, 35.60 PSNR, and 0.21 MSE for the FDG-PET image. In the classification of AD vs. cognitive normal (CN), AD vs. mild cognitive impairment (MCI), and CN vs. MCI, the precision of the proposed method is 94.73%, 92.98% and 89.36%, respectively. The sensitivity is 90. 70%, 90. 70%, and 90. 91% while the specificity is 100%, 100%, and 85. 71%, respectively, in the ADNI MRI test data.

Multimodal imaging evaluation of early neurological deterioration following acute ischemic stroke.

Early neurologic deterioration occurs in up to one-third of patients with acute ischemic stroke (IS), often leading to poor functional outcomes. At present, few studies have applied amide proton transfer (APT) imaging to the evaluation of early neurological deterioration (END). This study analyzed the value of computed tomography perfusion (CTP) combined with multimodal magnetic resonance imaging (MRI) in patients with acute IS with END. This retrospective study included patients with acute IS who were admitted to the neurology inpatient department in a tertiary hospital from October 2021 to June 2023. Patients with acute IS underwent CTP within 24 hours of stroke onset and MRI [arterial spin labeling (ASL), susceptibility-weighted imaging (SWI), and APT] within 7 days. END was defined as an elevation of ≥2 points on the National Institute of Health Stroke Scale (NIHSS) within 7 days of stroke onset. Univariable and multivariable analyses were used to compare clinical and imaging biomarkers in patients with acute IS with and without END. The performance of potential biomarkers in distinguishing between the two groups was evaluated using receiver operating characteristic (ROC) curve analysis. Among the 70 patients with acute IS, 20 (29%) had END. After conducting univariable analysis, variables were selected for entry into a binary logistic regression analysis based on our univariable analysis results, previous research findings, clinical experience, and methodological standards. The results indicated that relative cerebral blood volume (CBV) on CTP, relative cerebral blood flow (CBF) on ASL, and relative signal intensity on amide proton transfer-weighted (APTw) imaging were independent risk factors for END. The areas under the ROC curves for these risk factors were 0.710 [95% confidence interval (CI): 0.559-0.861, P=0.006], 0.839 (95% CI: 0.744-0.933, P<0.001), and 0.804 (95% CI: 0.676-0.932, P<0.001), respectively. The combined area under the curve (AUC), sensitivity, and specificity of the four indices (0.941, 100%, and 78%, respectively) were higher than those of the four indices alone. CTP combined with multi-modal MRI better evaluated hemodynamics, tissue metabolism, and other relevant patient information, providing an objective basis for the clinical assessment of patients with acute IS with END and facilitating the development of accurate and personalized treatment plans.

Hyperreflective Ganglion Cell Layer Band in Gyrate Atrophy.

We have described the hyperreflective ganglion cell layer band (HGCB) in a series of cases of gyrate atrophy. Clinical fundus examination and multimodal imaging which included optical coherence tomography (OCT) was done in all cases. Four patients (one male, three female) were studied. In all four cases, a hyperreflective band was noted in the ganglion cell layer. In three patients, the band was continuous, and in one patient, the band was patchy. To conclude, HGCB is a novel OCT sign in gyrate atrophy and can be valuable in prognostication of disease. [Ophthalmic Surg Lasers Imaging Retina 2024;55:XX-XX.].

Multimodal Imaging, Including Laser Speckle Flowgraphy: A Case of Retinal Metastasis.

Intraocular metastases of systemic cancer are most frequently located in the choroid, followed by the iris and ciliary body, while retinal metastases are extremely rare. Here we present a case of retinal metastasis and analyze multimodal imaging. A 66-year-old woman with a medical history of breast cancer 5 years earlier was referred to our Department struggling with blurry vision in her right eye. At initial examination, her best-corrected visual acuity (BCVA) was 1.0 oculus dexter (OD). Fundus examination revealed a yellowish elevated lesion with irregular surface, measuring 2 papillary diameters, along with serous retinal detachment (SRD) on the temporal side of the optic disc. Optical coherence tomography showed SRD with an isointense nodule extending across all retinal layers. Fluorescein angiography showed hyperfluorescence and vigorous fluorescence leakage inside the tumor in the early and late phases, respectively. Indocyanine green angiography depicted feeder and drainage vessels within the mass. Laser speckle flowgraphy (LSFG) showed a cold signal inside the tumor. Based on these clinical findings, the mass was diagnosed as a retinal metastasis. Eight days after the initial visit, the patient underwent external beam radiation to the right eye. One month after the initial diagnosis, her BCVA was 0.7 OD, the tumor was localized, and SRD had decreased. LSFG indicated vascular remodeling with marginally warmer signals in the tumor. LSFG of the retinal metastasis showed a cold signal, suggesting low tumor blood flow velocity and that the tumor may have grown slowly. LSFG findings are likely to play a supportive role in clinical diagnosis and contribute to better understanding of pathogenesis in juxtapapillary tumors.

The differential effects of integrase strand transfer inhibitors and efavirenz on neuropsychiatric conditions and brain imaging in HIV-positive men who have sex with men

Integrase strand transfer inhibitors (INSTIs) have emerged as the first-line choice for treating human immunodeficiency virus (HIV) infection due to their superior efficacy and safety. However, the impact of INSTIs on the development of neuropsychiatric conditions in people living with HIV (PLWH) is not fully understood due to limited data. In this study, we conducted a cross-sectional examination of PLWH receiving antiretroviral therapy, with a specific focus on HIV-positive men who have sex with men (MSM) on INSTI-based regimens (n = 61) and efavirenz (EFV)-based regimens (n = 28). Participants underwent comprehensive neuropsychiatric evaluations and multimodal magnetic resonance imaging (MRI) scans, including T1-weighted images and resting-state functional MRI. Compared to the EFV group, the INSTI group exhibited primarily reduced gray matter volume (GMV) in the right superior parietal gyrus, higher regional homogeneity (ReHo) in the left postcentral gyrus, lower ReHo in the right orbital part of the inferior frontal gyrus, and increased voxel-wise functional connectivity for the seed region in the left inferior temporal gyrus with clusters in the right cuneus. Furthermore, the analysis revealed a main effect of antiretroviral drugs on GMV changes, but no main effect of neuropsychiatric disorders or their interaction. The repeated analysis of participants who did not switch regimens confirmed the GMV changes in the INSTI group, validating the initial findings. Our study demonstrated gray matter atrophy and functional brain changes in PLWH on INSTI-based regimens compared to those on EFV-based regimens. These neuroimaging results provide valuable insights into the characteristics of brain network modifications in PLWH receiving INSTI-based regimens.

Quantitative susceptibility mapping based basal ganglia segmentation via AGSeg: leveraging active gradient guiding mechanism in deep learning.

With better visual contrast and the ability for magnetic susceptibility quantification analysis, quantitative susceptibility mapping (QSM) has emerged as an important magnetic resonance imaging (MRI) method for basal ganglia studies. Precise segmentation of basal ganglia is a prerequisite for quantification analysis of tissue magnetic susceptibility, which is crucial for subsequent disease diagnosis and surgical planning. The conventional method of localizing and segmenting basal ganglia heavily relies on layer-by-layer manual annotation by experts, resulting in a tedious amount of workload. Although several morphology registration and deep learning based methods have been developed to automate segmentation, the voxels around the nuclei boundary remain a challenge to distinguish due to insufficient tissue contrast. This paper proposes AGSeg, an active gradient guidance-based susceptibility and magnitude information complete (MIC) network for real-time and accurate basal ganglia segmentation. Various datasets, including clinical scans and data from healthy volunteers, were collected across multiple centers with different magnetic field strengths (3T/5T/7T), with a total of 210 three-dimensional (3D) susceptibility measurements. Manual segmentations following fixed rules for anatomical borders annotated by experts were used as ground truth labels. The proposed network took QSM maps and Magnitude images as two individual inputs, of which the features are selectively enhanced in the proposed magnitude information complete (MIC) module. AGSeg utilized a dual-branch architecture, with Seg-branch aiming to generate a proper segmentation map and Grad-branch to reconstruct the gradient map of regions of interest (ROIs). With the support of the newly designed active gradient module (AGM) and gradient guiding module (GGM), the Grad-branch provided attention guidance for the Seg-branch, facilitating it to focus on the boundary of target nuclei. Ablation studies were conducted to assess the functionality of the proposed modules. Significant performance decrement was observed after ablating relative modules. AGSeg was evaluated against several existing methods on both healthy and clinical data, achieving an average Dice similarity coefficient (DSC) =0.874 and average 95% Hausdorff distance (HD95) =2.009. Comparison experiments indicated that our model had superior performance on basal ganglia segmentation and better generalization ability over existing methods. The AGSeg outperformed all implemented comparison deep learning algorithms with average DSC enhancement ranging from 0.036 to 0.074. The current work integrates a deep learning-based method into automated basal ganglia segmentation. The high processing speed and segmentation robustness of AGSeg contribute to the feasibility of future surgery planning and intraoperative navigation. Experiments show that leveraging active gradient guidance mechanisms and magnitude information completion can facilitate the segmentation process. Moreover, this approach also offers a portable solution for other multi-modality medical image segmentation tasks.

Latent relation shared learning for endometrial cancer diagnosis with incomplete multi-modality medical images

Latent relation shared learning for endometrial cancer diagnosis with incomplete multi-modality medical images

CFIFusion: Dual‐Branch Complementary Feature Injection Network for Medical Image Fusion

ABSTRACTThe goal of fusing medical images is to integrate the diverse information that multimodal medical images hold. However, the challenges lie in the limitations of imaging sensors and the issue of incomplete modal information retention, which make it difficult to produce images encompassing both functional and anatomical information. To overcome these obstacles, several medical image fusion techniques based on CNN or transformer architectures have been presented. Nevertheless, CNN technique struggles to establish extensive dependencies between the fused and source images, and transformer architecture often overlooks shallow complementary features. To augment both the feature extraction capacity and the stability of the model, we introduce a framework, called dual‐branch complementary feature injection fusion (CFIFusion) technique, a for multimodal medical image fusion framework that combines unsupervised models of CNN model and transformer techniques. Specifically, in our framework, the entire source image and segmented source image are input into an adaptive backbone network to learn global and local features, respectively. To further retain the source images' complementary information, we design a multi‐scale complementary feature extraction framework as an auxiliary module, focusing on calculating feature differences at each level to capture the shallow complementary information. Then, we design a shallow information preservation module tailored for sliced image characteristics. Experimental results on the Harvard whole brain atlas dataset demonstrate that CFIFusion shows greater benefits than recent state‐of‐the‐art algorithms in terms of both subjective and objective evaluations.

Resting-state neural activity and cerebral blood flow alterations in type 2 diabetes mellitus: Insights from hippocampal subfields.

In this study, multimodal magnetic resonance imaging (MRI) imaging was used to deeply analyze the changes of hippocampal subfields perfusion and function in patients with type 2 diabetes mellitus (T2DM), aiming to provide image basis for the diagnosis of hippocampal-related nerve injury in patients with T2DM. We recruited 35 patients with T2DM and 40 healthy control subjects (HCs). They underwent resting-state functional MRI (rs-fMRI), arterial spin labeling (ASL) scans, and a series of cognitive tests. Then, we compared the differences of two groups in the cerebral blood flow (CBF) value, amplitude of low-frequency fluctuation (ALFF) value, and regional homogeneity (ReHo) value of the bilateral hippocampus subfields. The CBF values of cornu ammonis area 1 (CA1), dentate gyrus (DG), and subiculum in the right hippocampus of T2DM group were significantly lower than those of HCs. The ALFF values of left hippocampal CA3, subiculum, and bilateral hippocampus amygdala transition area (HATA) were higher than those of HCs in T2DM group. The ReHo values of CA3, DG, subiculum, and HATA in the left hippocampus of T2DM group were higher than those of HCs. In the T2DM group, HbAc1 and FINS were negatively correlated with imaging characteristics in some hippocampal subregions. This study indicates that T2DM patients had decreased perfusion in the CA1, DG, and subiculum of the right hippocampus, and the right hippocampus subiculum was associated with chronic hyperglycemia. Additionally, we observed an increase in spontaneous neural activity within the left hippocampal CA3, subiculum, and bilateral HATA regions, as well as an enhanced local neural coordination in the left hippocampal CA3, DG, HATA, and subiculum among patients with type 2 diabetes, which may reflect an adaptive compensation for cognitive decline. However, this compensation may decline with the exacerbation of metabolic disorders.

CMAF-Net: a cross-modal attention fusion-based deep neural network for incomplete multi-modal brain tumor segmentation.

The information between multimodal magnetic resonance imaging (MRI) is complementary. Combining multiple modalities for brain tumor image segmentation can improve segmentation accuracy, which has great significance for disease diagnosis and treatment. However, different degrees of missing modality data often occur in clinical practice, which may lead to serious performance degradation or even failure of brain tumor segmentation methods relying on full-modality sequences to complete the segmentation task. To solve the above problems, this study aimed to design a new deep learning network for incomplete multimodal brain tumor segmentation. We propose a novel cross-modal attention fusion-based deep neural network (CMAF-Net) for incomplete multimodal brain tumor segmentation, which is based on a three-dimensional (3D) U-Net architecture with encoding and decoding structure, a 3D Swin block, and a cross-modal attention fusion (CMAF) block. A convolutional encoder is initially used to extract the specific features from different modalities, and an effective 3D Swin block is constructed to model the long-range dependencies to obtain richer information for brain tumor segmentation. Then, a cross-attention based CMAF module is proposed that can deal with different missing modality situations by fusing features between different modalities to learn the shared representations of the tumor regions. Finally, the fused latent representation is decoded to obtain the final segmentation result. Additionally, channel attention module (CAM) and spatial attention module (SAM) are incorporated into the network to further improve the robustness of the model; the CAM to help focus on important feature channels, and the SAM to learn the importance of different spatial regions. Evaluation experiments on the widely-used BraTS 2018 and BraTS 2020 datasets demonstrated the effectiveness of the proposed CMAF-Net which achieved average Dice scores of 87.9%, 81.8%, and 64.3%, as well as Hausdorff distances of 4.21, 5.35, and 4.02 for whole tumor, tumor core, and enhancing tumor on the BraTS 2020 dataset, respectively, outperforming several state-of-the-art segmentation methods in missing modalities situations. The experimental results show that the proposed CMAF-Net can achieve accurate brain tumor segmentation in the case of missing modalities with promising application potential.

CFIFusion: Dual‐Branch Complementary Feature Injection Network for Medical Image Fusion

ABSTRACTThe goal of fusing medical images is to integrate the diverse information that multimodal medical images hold. However, the challenges lie in the limitations of imaging sensors and the issue of incomplete modal information retention, which make it difficult to produce images encompassing both functional and anatomical information. To overcome these obstacles, several medical image fusion techniques based on CNN or transformer architectures have been presented. Nevertheless, CNN technique struggles to establish extensive dependencies between the fused and source images, and transformer architecture often overlooks shallow complementary features. To augment both the feature extraction capacity and the stability of the model, we introduce a framework, called dual‐branch complementary feature injection fusion (CFIFusion) technique, a for multimodal medical image fusion framework that combines unsupervised models of CNN model and transformer techniques. Specifically, in our framework, the entire source image and segmented source image are input into an adaptive backbone network to learn global and local features, respectively. To further retain the source images' complementary information, we design a multi‐scale complementary feature extraction framework as an auxiliary module, focusing on calculating feature differences at each level to capture the shallow complementary information. Then, we design a shallow information preservation module tailored for sliced image characteristics. Experimental results on the Harvard whole brain atlas dataset demonstrate that CFIFusion shows greater benefits than recent state‐of‐the‐art algorithms in terms of both subjective and objective evaluations.

Corpus callosum damage in PSP and unsteady PD patients: A multimodal MRI study

IntroductionPostural instability (PI) is a common disabling symptom in Parkinson’s disease (PD) patients, but the brain alterations underlying this sign are not fully understood yet. This study aimed to investigate the association between PI and callosal damage in PD and progressive supranuclear palsy (PSP) patients, using multimodal MR imaging. MethodsOne-hundred and two PD patients stratified according to the presence/absence of PI (PD-steady N=58; PD-unsteady N=44), 69 PSP patients, and 38 healthy controls (HC) underwent structural and diffusion 3 T brain MRI. Thickness, fractional anisotropy (FA) and mean diffusivity (MD) were calculated over 50 equidistant points covering the whole midsagittal profile of the corpus callosum (CC) and compared among groups. Associations between imaging metrics and postural instability score were investigated using linear regression. ResultsBoth PSP and PD-unsteady patient groups showed CC involvement in comparison with HC, while no difference was found between PD-steady patients and controls. The CC damage was more severe and widespread in PSP than in PD patients. The CC genu was the regions most damaged in PD-unsteady patients compared with PD-steady patients, showing significant microstructural alterations of MD and FA metrics. Linear regression analysis pointed at the MD in the CC genu as the main contributor to PI among the considered MRI metrics. ConclusionThis study identified callosal microstructural alterations associated with PI in unsteady PD and PSP patients, which provide new insights on PI pathophysiology and might serve as imaging biomarkers for assessing postural instability progression and treatment response.

Research into super-resolution in medical imaging from 2000 to 2023: bibliometric analysis and visualization.

Super-resolution (SR) refers to the use of hardware or software methods to enhance the resolution of low-resolution (LR) images and produce high-resolution (HR) images. SR is applied frequently across a variety of medical imaging contexts, particularly in the enhancement of neuroimaging, with specific techniques including SR microscopy-used for diagnostic biomarkers-and functional magnetic resonance imaging (fMRI)-a neuroimaging method for the measurement and mapping of brain activity. This bibliometric analysis of the literature related to SR in medical imaging was conducted to identify the global trends in this field, and visualization via graphs was completed to offer insights into future research prospects. In order to perform a bibliometric analysis of the SR literature, this study sourced all publications from the Web of Science Core Collection (WoSCC) database published from January 1, 2000, to October 11, 2023. A total of 3,262 articles on SR in medical imaging were evaluated. VOSviewer was used to perform co-occurrence and co-authorship analysis, and network visualization of the literature data, including author, journal, publication year, institution, and keywords, was completed. From 2000 to 2023, the annual publication volume surged from 13 to 366. The top three journals in this field in terms of publication volume were as follows: (I) Scientific Reports (86 publications), (II) IEEE Transactions on Medical Imaging (74 publications), and (III) IEEE Transactions on Ultrasonics Ferroelectrics and Frequency Control (56 publications). The most prolific country, institution, and author were the United States (1,017 publications; 31,301 citations), the Chinese Academy of Sciences (124 publications; 2,758 citations), and Dinggang Shen (20 publications; 671 citations), respectively. A cluster analysis of the top 100 keywords was conducted, which revealed the presence of five co-occurrence clusters: (I) SR and artificial intelligence (AI) for medical image enhancement, (II) SR and inverse problem processing concepts for positron emission tomography (PET) image processing, (III) SR ultrasound through microbubbles, (IV) SR microscopy for Alzheimer and Parkinson diseases, and (V) SR in brain fMRI: rapid acquisition and precise imaging. The most recent high-frequency keywords were deep learning (DL), magnetic resonance imaging (MRI), and convolutional neural networks (CNNs). Over the past two decades, the output of publications by countries, institutions, and authors in the field of SR in medical imaging has steadily increased. Based on bibliometric analysis of international trends, the resurgence of SR in medical imaging has been facilitated by advancements in AI. The increasing need for multi-center and multi-modal medical images has further incentivized global collaboration, leading to the diverse research paths in SR medical imaging among prominent scientists.

Multimodal Analysis of the Retinal Manifestations of Tuberous Sclerosis Complex: A Case Series.

We used a multi-modal imaging approach including fundus fluorescein angiography (FFA) to assess the retinal lesions in tuberous sclerosis complex (TSC) and evaluate their correlation with intracranial tuber burden on magnetic resonance imaging (MRI). Participants with TSC underwent bilateral fundus photography, optical coherence tomography (OCT), infrared (IR) imaging, and FFA. Participants' most recent MRI brain scans were analyzed to determine intracranial tuber load. Nine participants were included. OCT identified all retinal astrocytic hamartoma (RAH) lesions, IR identified 75%, fundus photography identified 63%, and FFA detected just 57%. On FFA, 20% of flat-type hamartomas and all multi-nodular and transitional types were hyperfluorescent. There were significant positive correlations between the quantities of intracranial tubers and all TSC-retinal lesions (r = 0.8, P < 0.01) and all RAH lesions (r = 0.8, P = 0.01). A multimodal imaging-based approach with fundal photography, IR imaging, and OCT should be used to assess the retina in TSC as it may indicate the intracranial tuber burden. [Ophthalmic Surg Lasers Imaging Retina 2024;55:XX-XX.].

Intelligent fault diagnosis of bearings driven by double-level data fusion based on multichannel sample fusion and feature fusion under time-varying speed conditions

Bearing fault diagnosis holds paramount importance in guaranteeing the smooth operation of mechanical systems. However, single-channel vibration sensor data poses limitations in providing a comprehensive representation of bearing fault characteristics, and the fault diagnosis model extracts fault features with insufficient representativeness, resulting in low reliability and poor generalization capability of the model in the face of variable operating conditions. Therefore, a novel intelligent fault diagnosis model of bearings driven by double-level data fusion (DLDF) is developed in this paper. Initially, the fusion weights of each channel's data are obtained using the information entropy method. Then, a novel multi-modal image fusion strategy is proposed to integrate the time-frequency representations of vibration data from channels X, Y, and Z at a specific measurement point. Finally, the shallow and deep feature components extracted from the CNN model and the feature components obtained through different mapping methods are fused to extract more representative fault features, achieving a reliable diagnosis of bearing faults under time-varying speed conditions. The efficacy and reliability of the proposed approach are demonstrated through the fault diagnosis outcomes of two sets of bearing experimental data under time-varying speed conditions.

RUN: A COGNITIVE ACCOUNT OF ITS MEANING TRANSFERENCE IN THE LIGHT OF AN IMAGE-SCHEMA BASED MODEL

This article aims at providing a more comprehensive picture of how meanings of “run” are transferred from spatial to non-spatial meanings by using the combined framework of Multimodal Image Theory and Extended Conceptual Metaphor. To be specific, 368 concordances of “run” extracted from the corpus of Contemporary American English in 2017, Genre Spoken were systematically analyzed to first identify the word’s meanings in its contexts of use and then account for its meaning transference. In other words, the prototypical meaning of “run” and its image complexes in three spaces namely Visual space, Maneuver space, and Kinetic space were analyzed in the light of Multimodal Image Theory, which provides concrete image-schemas mapped onto the word’s non-spatial meanings found in its Mental space in association with a range of conceptual metaphors. It has been shown that mapping together with image-schema transformations are the mechanisms of the word meaning transference.