Medical Imaging Research Articles

A Comprehensive Review of Artificial Intelligence Approaches in Kidney Cancer Medical Images Diagnosis, Datasets, Challenges and Issues and Future Directions

Various diseases are prevalent in global populations and can be attributed to human lifestyles, economic conditions, social factors, genetics, and other country-specific factors. Our study provides a detailed analysis of the current methods and uses of artificial intelligence (AI) in diagnosing kidney cancer. This literature review examines the most recent advancements and uses of AI in diagnosing cancer of the kidneys, emphasizing its significant influence on medical diagnosis and patient treatment. Evaluate their efficacy, explore prospective areas for future study and development, and identify obstacles and constraints, offering a fundamental review of critical advancements in AI, machine learning, and deep learning. AI-powered diagnostic tools expedite the analysis of intricate images and enhance the early identification of diseases, ultimately leading to improved patient results. Furthermore, the utilization of AI-driven image processing enables the customization of treatment regimens, thereby enhancing the efficiency of healthcare provision. This review primarily highlights the importance of conducting additional research and improving AI to transform the detection and treatment of kidney cancer.

MRI radiomics captures early treatment response in patient-derived organoid endometrial cancer mouse models

BackgroundRadiomics can capture microscale information in medical images beyond what is visible to the naked human eye. Using a clinically relevant mouse model for endometrial cancer, the objective of this study was to develop and validate a radiomic signature (RS) predicting response to standard chemotherapy.MethodsMice orthotopically implanted with a patient-derived grade 3 endometrioid endometrial cancer organoid model (O-PDX) were allocated to chemotherapy (combined paclitaxel/carboplatin, n=11) or saline/control (n=13). During tumor progression, the mice underwent weekly T2-weighted (T2w) magnetic resonance imaging (MRI). Segmentation of primary tumor volume (vMRI) allowed extraction of radiomic features from whole-volume tumor masks. A radiomic model for predicting treatment response was derived employing least absolute shrinkage and selection operator (LASSO) statistics at endpoint images in the orthotopic O-PDX (RS_O), and subsequently applied on the earlier study timepoints (RS_O at baseline, and week 1-3). For external validation, the radiomic model was tested in a separate T2w-MRI dataset on segmented whole-volume subcutaneous tumors (RS_S) from the same O-PDX model, imaged at three timepoints (baseline, day 3 and day 10/endpoint) after start of chemotherapy (n=8 tumors) or saline/control (n=8 tumors).ResultsThe RS_O yielded rapidly increasing area under the receiver operating characteristic (ROC) curves (AUCs) for predicting treatment response from baseline until endpoint; AUC=0.38 (baseline); 0.80 (week 1), 0.85 (week 2), 0.96 (week 3) and 1.0 (endpoint). In comparison, vMRI yielded AUCs of 0.37 (baseline); 0.69 (w1); 0.83 (week 2); 0.92 (week 3) and 0.97 (endpoint). When tested in the external validation dataset, RS_S yielded high accuracy for predicting treatment response at day10/endpoint (AUC=0.85) and tended to yield higher AUC than vMRI (AUC=0.78, p=0.18). Neither RS_S nor vMRI predicted response at day 3 in the external validation set (AUC=0.56 for both).ConclusionsWe have developed and validated a radiomic signature that was able to capture chemotherapeutic treatment response both in an O-PDX and in a subcutaneous endometrial cancer mouse model. This study supports the promising role of preclinical imaging including radiomic tumor profiling to assess early treatment response in endometrial cancer models.

Compact pixelated scintillator detector investigation for gamma ray detection

Objective. A scintillator is a luminescent material that converts high-energy photons into visible light and is widely used in medical imaging. Different scintillators are applied to gamma imaging in proton therapy and boron neutron capture therapy (BNCT). A pixelated scintillator is suitable for position measurement. The energy resolution, detection efficiency and position measurement of pixelated scintillators coupled to a SiPM were investigated via two kinds of detectors. The goal of this manuscript was to accurately measure the gamma source position through spectrum analysis in selection of energy windows for characteristic gamma lines. Approach. Scintillators were effectively manufactured and encapsulated before testing, especially for the easily deliquescent LaBr3. The compact front-end electronic prototype modules with 2 × 2 array SiPMs in stacked form and 1 × 10 array SiPMs in parallel form were developed for gamma ray energy resolution and efficiency measurements with a radioactive source of 22Na, which had two energy gamma lines at 511 keV and 1274 keV. Energy calibration was used for accurate energy window selection when measuring the position of the gamma source. Main results. Evident inconsistencies were present between different pixels of the same type of scintillator. Thus, an energy calibration method was needed. LaBr3 was the first candidate scintillator for the gamma ray spectrum measurement since it exhibited the best performance with an energy resolution of ∼5%. The recommended size of LaBr3 was 5 × 5 mm2, which had a higher efficiency than the 3 × 3 mm2 size. The gamma count of the multiple mode of the 2 × 2 array was much higher than that of the single mode, while the energy resolution was poorer. Thus, multiple mode was not suitable for gamma ray detection. The 1 × 10 array detector had the potential to measure the gamma ray source position and could be used for proton therapy and BNCT. A small deviation of 0.22 cm was observed in the measurement of the source center position with Energy Window 1 for 511 keV and Energy Window 2 for 1274 keV before the energy calibration. No deviation was observed after energy calibration. Thus, to achieve a higher accuracy position measurement, automatic energy calibration algorithm was coded into data acquisition software. Significance. The characteristic gamma lines produced by particle therapy are abundant and useful for imaging technology. Our developed compact pixelated scintillator detector coupled with SiPMs could measure the gamma spectrum with high resolution. The energy calibration and window selection method could measure the position of the source with high accuracy. Therefore, an advanced imaging device based on the energy spectrum for particle therapy could be potentially attainable.

Advancements in Video Deblurring: A Comprehensive Review

Video deblurring is a critical task in computer vision, aimed at restoring the clarity of videos distorted by motion blur or other factors. It holds immense importance across various domains, including surveillance, entertainment, medical imaging, and autonomous driving, where clear visual information is crucial for decision-making and analysis. This article provides an overview of recent advancements in video deblurring techniques, ranging from convolutional neural network (CNN)-based methods to Transformer-based models and event-based reconstruction approaches. By synthesizing insights from recent research, this review delves into the applications and methodologies of these techniques, showcasing their effectiveness in real-world scenarios. By fostering knowledge exchange and inspiring further advancements in the field, this review aims to contribute to the continuous improvement of video processing technologies for enhanced visual quality and analysis. Keywords: Video Deblurring, Video Restoration, deep learning, Convolutional Neural Networks, Event Based Reconstruction, Transformers, Image Processing

A multichannel analysis of imbalanced computed tomography data for lung cancer classification

Lung cancer holds the highest fatality rate among cancers, emphasizing the importance of early detection. Computer algorithms have gained prominence across various domains, including lung cancer diagnosis. These algorithms assist specialists, especially in medical imaging, yet current efforts lack comprehensive CT data analysis; especially in handling imbalanced datasets and fully exploiting spatial information. The lack of spatial analysis hinders the ability to identify subtle variations in texture and structure that are crucial for detecting lung cancer early and accurately. Therefore, this study uses a multichannel analysis of computed tomography (CT) images and deep learning-based ensemble learning (MC-ECNN) to find lung cancer even when the data is not balanced. Firstly, the data imbalance issue is tackled through the synthetic minority oversampling technique (SOMTE); afterwards, a multi-channel analysis of the data is performed to explore a distinct set of abstract features. Lastly, a deep ensemble learning method is used to classify the extracted distinct abstract feature set into the appropriate classes. The proposed method uses the discrete Fast Fourier transform (DFFT) and discrete cosine transform (DCT), along with the actual CT scans, for the multi-channel analysis of the data in different domains. The proposed model yielded 99.60% test accuracy on unseen data, which is at least 3% better than the other state-of-the-art studies considered for the comparison. In addition to the classification accuracy, the efficacy of the proposed model has also been justified through precision, recall, F1-score, support value, and misclassification rate.

Med-ImageTools: An open-source Python package for robust data processing pipelines and curating medical imaging data

Background Machine learning and AI promise to revolutionize the way we leverage medical imaging data for improving care but require large datasets to train computational models that can be implemented in clinical practice. However, processing large and complex medical imaging datasets remains an open challenge. Methods To address this issue, we developed Med-ImageTools, a new Python open-source software package to automate data curation and processing while allowing researchers to share their data processing configurations more easily, lowering the barrier for other researchers to reproduce published works. Use cases We have demonstrated the efficiency of Med-ImageTools across three different datasets, resulting in significantly reduced processing times. Conclusions The AutoPipeline feature will improve the accessibility of raw clinical datasets on public archives, such as the Cancer Imaging Archive (TCIA), the largest public repository of cancer imaging, allowing machine learning researchers to process analysis-ready formats without requiring deep domain knowledge.

Investigation of a potential upstream harmonization based on image appearance matching to improve radiomics features robustness: a phantom study

Objective. Radiomics is a promising valuable analysis tool consisting in extracting quantitative information from medical images. However, the extracted radiomics features are too sensitive to variations in used image acquisition and reconstruction parameters. This limited robustness hinders the generalizable validity of radiomics-assisted models. Our aim is to investigate a possible harmonization strategy based on matching image quality to improve feature robustness. Approach. We acquired CT scans of a phantom with two scanners across different dose levels and percentages of Iterative Reconstruction algorithms. The detectability index was used as a comprehensive task-based image quality metric. A statistical analysis based on the Intraclass Correlation Coefficient was performed to determine if matching image quality/appearance could enhance the robustness of radiomics features extracted from the phantom images. Additionally, an Artificial Neural Network was trained on these features to automatically classify the scanner used for image acquisition. Main results. We found that the ICC of the features across protocols providing a similar detectability index improves with respect to the ICC of the features across protocols providing a different detectability index. This improvement was particularly noticeable in features relevant for distinguishing between scanners. Significance. This preliminary study demonstrates that a harmonization based on image quality/appearance matching could improve radiomics features robustness and heterogeneous protocols can be used to obtain a similar image appearance in terms of the detectability index. Thus protocols with a lower dose level could be selected to reduce the amount of radiation dose delivered to the patient and simultaneously obtain a more robust quantitative analysis.

Utilization of Waste Marble and Bi2O3-NPs as a Sustainable Replacement for Lead Materials for Radiation Shielding Applications

In an attempt to reutilize marble waste, a new approach is presented in the current study to promote its use in the field of shielding against ionizing radiation. In this study, we aimed to develop a novel and sustainable/eco-friendly lead-free radiation shielding material by improving artificial marble (AM) produced from marble waste combined with polyester by reinforcing it with bismuth oxide (Bi2O3) nanoparticles. Six samples of AM samples doped with different concentrations (0%, 5%, 10%, 15%, 20%, and 25%) of Bi2O3 nanoparticles were prepared. The linear attenuation coefficient (LAC) values were measured experimentally through the narrow beam method at different energies (0.0595 MeV, 0.6617 MeV, 1.1730 MeV, and 1.330 MeV) for all samples with various concentrations of Bi2O3. Radiological shielding parameters such as half value layer (HVL), tenth-value layer (TVL), and radiation shielding efficiency (RSE) were estimated and compared for all the different samples. The results prove that increasing the concentration of Bi2O3 leads to the enhancement of the radiation shielding properties of the AM as a shielding material. It was observed that as the energy increases, the efficiency of the samples falls. High energy dependence was found when calculating the HVL and TVL values of the samples, which increased with increases in the energy of the incident photons. A comparison between the sample with the most efficient gamma radiation attenuation capability (AM-25%), concrete, and lead was conducted, and a discussion regarding their radiation shielding properties is presented herein. The results show that the AM-25% sample is superior to the ordinary concrete over all the studied energy ranges, as evidenced by its significantly lower HVLs. On the contrary, lead is superior to the AM-25% sample over all the studied energy ranges owing to its unbeatable density as a shielding material. Overall, this new type of artificial marble has the potential to be used as a radiation shielding material at low- to medium-gamma energy regions, specifically in medical imaging and radiation therapy.

A machine learning method for precise detection of spine bone mineral density

Osteoporosis is prevalent among the elderly and requires precise diagnostic approaches for effective treatment and prevention. This work introduces a machine learning-based method for the accurate grading of osteoporosis via the analysis of high-resolution computed tomography (HRCT) images of the spine. This approach allows for the precise extraction of the trabecular component of vertebral bodies, thereby enabling accurate measurement of bone density. Evaluated in 183 individuals, our method demonstrated enhanced stability in bone density prediction and reduced bias when juxtaposed with traditional random sampling techniques. Despite the inherent risk of overestimation, the machine learning model more accurately approximates the actual bone quality compared to conventional clinical methods, which typically involve the random extraction of 3–4 trabecular bone slices from the spine. These findings offer a novel approach to the clinical assessment of osteoporosis, underscoring the significant potential of integrating machine learning into existing medical image analysis workflows.

ChatGPT and Medicine: Together We Embrace the AI Renaissance

The generative artificial intelligence (AI) model ChatGPT holds transformative prospects in medicine. The development of such models has signaled the beginning of a new era where complex biological data can be made more accessible and interpretable. ChatGPT is a natural language processing tool that can process, interpret, and summarize vast data sets. It can serve as a digital assistant for physicians and researchers, aiding in integrating medical imaging data with other multiomics data and facilitating the understanding of complex biological systems. The physician’s and AI’s viewpoints emphasize the value of such AI models in medicine, providing tangible examples of how this could enhance patient care. The editorial also discusses the rise of generative AI, highlighting its substantial impact in democratizing AI applications for modern medicine. While AI may not supersede health care professionals, practitioners incorporating AI into their practices could potentially have a competitive edge.

A comparative study of an on premise AutoML solution for medical image classification

Automated machine learning (AutoML) allows for the simplified application of machine learning to real-world problems, by the implicit handling of necessary steps such as data pre-processing, feature engineering, model selection and hyperparameter optimization. This has encouraged its use in medical applications such as imaging. However, the impact of common parameter choices such as the number of trials allowed, and the resolution of the input images, has not been comprehensively explored in existing literature. We therefore benchmark AutoKeras (AK), an open-source AutoML framework, against several bespoke deep learning architectures, on five public medical datasets representing a wide range of imaging modalities. It was found that AK could outperform the bespoke models in general, although at the cost of increased training time. Moreover, our experiments suggest that a large number of trials and higher resolutions may not be necessary for optimal performance to be achieved.

Consumer electronics based smart technologies for enhanced terahertz healthcare having an integration of split learning with medical imaging

The proposed work contains three major contribution, such as smart data collection, optimized training algorithm and integrating Bayesian approach with split learning to make privacy of the patent data. By integrating consumer electronics device such as wearable devices, and the Internet of Things (IoT) taking THz image, perform EM algorithm as training, used newly proposed slit learning method the technology promises enhanced imaging depth and improved tissue contrast, thereby enabling early and accurate disease detection the breast cancer disease. In our hybrid algorithm, the breast cancer model achieves an accuracy of 97.5 percent over 100 epochs, surpassing the less accurate old models which required a higher number of epochs, such as 165.

HST-MRF: Heterogeneous Swin Transformer With Multi-Receptive Field for Medical Image Segmentation.

The Transformer has been successfully used in medical image segmentation due to its excellent long-range modeling capabilities. However, patch segmentation is necessary when building a Transformer class model. This process ignores the tissue structure features within patch, resulting in the loss of shallow representation information. In this study, we propose a Heterogeneous Swin Transformer with Multi-Receptive Field (HST-MRF) model that fuses patch information from different receptive fields to solve the problem of loss of feature information caused by patch segmentation. The heterogeneous Swin Transformer (HST) is the core module, which achieves the interaction of multi-receptive field patch information through heterogeneous attention and passes it to the next stage for progressive learning, thus complementing the patch structure information. We also designed a two-stage fusion module, multimodal bilinear pooling (MBP), to assist HST in further fusing multi-receptive field information and combining low-level and high-level semantic information for accurate localization of lesion regions. In addition, we developed adaptive patch embedding (APE) and soft channel attention (SCA) modules to retain more valuable information when acquiring patch embedding and filtering channel features, respectively, thereby improving model segmentation quality. We evaluated HST-MRF on multiple datasets for polyp, skin lesion and breast ultrasound segmentation tasks. Experimental results show that our proposed method outperforms state-of-the-art models and can achieve superior performance. Furthermore, we verified the effectiveness of each module and the benefits of multi-receptive field segmentation in reducing the loss of structural information through ablation experiments and qualitative analysis.

A Novel Data Augmentation Method for Radiomics Analysis Using Image Perturbations.

Radiomics extracts hundreds of features from medical images to quantitively characterize a region of interest (ROI). When applying radiomics, imbalanced or small dataset issues are commonly addressed using under or over-sampling, the latter being applied directly to the extracted features. Aim of this study is to propose a novel balancing and data augmentation technique by applying perturbations (erosion, dilation, contour randomization) to the ROI in cardiac computed tomography images. From the perturbed ROIs, radiomic features are extracted, thus creating additional samples. This approach was tested addressing the clinical problem of distinguishing cardiac amyloidosis (CA) from aortic stenosis (AS) and hypertrophic cardiomyopathy (HCM). Twenty-one CA, thirty-two AS and twenty-one HCM patients were included in the study. From each original and perturbed ROI, 107 radiomic features were extracted. The CA-AS dataset was balanced using the perturbation-based method along with random over-sampling, adaptive synthetic (ADASYN) and the synthetic minority oversampling technique (SMOTE). The same methods were tested to perform data augmentation dealing with CA and HCM. Features were submitted to robustness, redundancy, and relevance analysis testing five feature selection methods (p-value, least absolute shrinkage and selection operator (LASSO), semi-supervised LASSO, principal component analysis (PCA), semi-supervised PCA). Support vector machine performed the classification tasks, and its performance were evaluated by means of a 10-fold cross-validation. The perturbation-based approach provided the best performances in terms of f1 score and balanced accuracy in both CA-AS (f1 score: 80%, AUC: 0.91) and CA-HCM (f1 score: 86%, AUC: 0.92) classifications. These results suggest that ROI perturbations represent a powerful approach to address both data balancing and augmentation issues.

GMIM: Self-supervised pre-training for 3D medical image segmentation with adaptive and hierarchical masked image modeling

Self-supervised pre-training and fully supervised fine-tuning paradigms have received much attention to solve the data annotation problem in deep learning fields. Compared with traditional pre-training on large natural image datasets, medical self-supervised learning methods learn rich representations derived from unlabeled data itself thus avoiding the distribution shift between different image domains. However, nowadays state-of-the-art medical pre-training methods were specifically designed for downstream tasks making them less flexible and difficult to apply to new tasks. In this paper, we propose grid mask image modeling, a flexible and general self-supervised method to pre-train medical vision transformers for 3D medical image segmentation. Our goal is to guide networks to learn the correlations between organs and tissues by reconstructing original images based on partial observations. The relationships are consistent within the human body and invariant to disease type or imaging modality. To achieve this, we design a Siamese framework consisting of an online branch and a target branch. An adaptive and hierarchical masking strategy is employed in the online branch to (1) learn the boundaries or small contextual mutation regions within images; (2) to learn high-level semantic representations from deeper layers of the multiscale encoder. In addition, the target branch provides representations for contrastive learning to further reduce representation redundancy. We evaluate our method through segmentation performance on two public datasets. The experimental results demonstrate our method outperforms other self-supervised methods. Codes are available at https://github.com/mobiletomb/Gmim.

Data Format Standardization and DICOM Integration for Hyperpolarized 13C MRI.

Hyperpolarized (HP) 13C MRI has shown promise as a valuable modality for in vivo measurements of metabolism and is currently in human trials at 15 research sites worldwide. With this growth, it is important to adopt standardized data storage practices as it will allow sites to meaningfully compare data. In this paper, we (1) describe data that we believe should be stored and (2) demonstrate pipelines and methods that utilize the Digital Imaging and Communications in Medicine (DICOM) standard. This includes proposing a set of minimum set of information that is specific to HP 13C MRI studies. We then show where the majority of these can be fit into existing DICOM attributes, primarily via the "Contrast/Bolus" module. We also demonstrate pipelines for utilizing DICOM for HP 13C MRI. DICOM is the most common standard for clinical medical image storage and provides the flexibility to accommodate the unique aspects of HP 13C MRI, including the HP agent information but also spectroscopic and metabolite dimensions. The pipelines shown include creating DICOM objects for studies on human and animal imaging systems with various pulse sequences. We also show a python-based method to efficiently modify DICOM objects to incorporate the unique HP 13C MRI information that is not captured by existing pipelines. Moreover, we propose best practices for HP 13C MRI data storage that will support future multi-site trials, research studies, and technical developments of this imaging technique.

Typicality- and instance-dependent label noise-combating: a novel framework for simulating and combating real-world noisy labels for endoscopic polyp classification

Learning with noisy labels aims to train neural networks with noisy labels. Current models handle instance-independent label noise (IIN) well; however, they fall short with real-world noise. In medical image classification, atypical samples frequently receive incorrect labels, rendering instance-dependent label noise (IDN) an accurate representation of real-world scenarios. However, the current IDN approaches fail to consider the typicality of samples, which hampers their ability to address real-world label noise effectively. To alleviate the issues, we introduce typicality- and instance-dependent label noise (TIDN) to simulate real-world noise and establish a TIDN-combating framework to combat label noise. Specifically, we use the sample’s distance to decision boundaries in the feature space to represent typicality. The TIDN is then generated according to typicality. We establish a TIDN-attention module to combat label noise and learn the transition matrix from latent ground truth to the observed noisy labels. A recursive algorithm that enables the network to make correct predictions with corrections from the learned transition matrix is proposed. Our experiments demonstrate that the TIDN simulates real-world noise more closely than the existing IIN and IDN. Furthermore, the TIDN-combating framework demonstrates superior classification performance when training with simulated TIDN and actual real-world noise.

Bromine‐Enhanced Organic Materials for X‐ray Sensors: Unveiling the Potential of Small Molecules and Polymers through Material Design and Film Fabrication

AbstractOrganic X‐ray sensors are a promising new class of detectors with the potential to revolutionize medical imaging, security screening, and other applications. However, the development of high‐performance organic X‐ray sensors is challenged by low sensitivity. This paper reports on the development of nine X‐ray sensors based on new organic materials. It is demonstrated that the incorporation of bromine atoms into the sidechains of carbazolyl‐containing organic molecules significantly enhances their X‐ray sensitivity. This research suggests that incorporating a variety of high‐atomic‐number chemical elements into well‐established organic semiconductors is a promising strategy for designing efficient X‐ray sensor materials.

Advancements in Deep Learning for Minimally Invasive Surgery: A Journey through Surgical System Evolution

The surge in artificial intelligence (AI) applications across diverse fields owes much to advancements in deep learning and computational processing speed. In medicine, AI's reach extends to medical image analysis and genomic data interpretation. More recently, AI's role in analyzing minimally invasive surgery (MIS) videos has gained traction, with a growing body of research focusing on organ and anatomy identification, instrument recognition, procedure recognition, surgical phase delineation, surgery duration prediction, optimal incision line identification, and surgical education. Concurrently, the development of autonomous surgical robots, exemplified by the Smart Tissue Autonomous Robot (STAR) and RAVEN systems, has shown promising strides. Notably, STAR is currently employed in laparoscopic imaging to discern the surgical site from laparoscopic images and is undergoing trials for an automated suturing system, albeit in animal models. This review contemplates the prospect of fully autonomous surgical robots in the future.

Advancements in Deep Learning for Minimally Invasive Surgery: A Journey through Surgical System Evolution

The surge in artificial intelligence (AI) applications across diverse fields owes much to advancements in deep learning and computational processing speed. In medicine, AI's reach extends to medical image analysis and genomic data interpretation. More recently, AI's role in analyzing minimally invasive surgery (MIS) videos has gained traction, with a growing body of research focusing on organ and anatomy identification, instrument recognition, procedure recognition, surgical phase delineation, surgery duration prediction, optimal incision line identification, and surgical education. Concurrently, the development of autonomous surgical robots, exemplified by the Smart Tissue Autonomous Robot (STAR) and RAVEN systems, has shown promising strides. Notably, STAR is currently employed in laparoscopic imaging to discern the surgical site from laparoscopic images and is undergoing trials for an automated suturing system, albeit in animal models. This review contemplates the prospect of fully autonomous surgical robots in the future.