Integration Of Imaging Data Research Articles

Identification of mild cognitive impairment using multimodal 3D imaging data and graph convolutional networks

Abstract Objective. Mild cognitive impairment (MCI) is a precursor stage of dementia characterized by mild cognitive decline in one or more cognitive domains, without meeting the criteria for dementia. MCI is considered a prodromal form of Alzheimer's disease (AD). Early identification of MCI is crucial for both intervention and prevention of AD. To accurately identify MCI, a novel multimodal 3D imaging data integration graph convolutional network model is designed in this paper. Approach. The proposed model utilizes 3D-VGGNet to extract three-dimensional features from multimodal imaging data (such as sMRI and FDG-PET), which are then fused into feature vectors as the node features of a population graph. Non-imaging features of participants are combined with the multimodal imaging data to construct a population sparse graph. Additionally, in order to optimize the connectivity of the graph, we employed the Pairwise Attribute Estimation (PAE) method to compute the edge weights based on non-imaging data, thereby enhancing the effectiveness of the graph structure. Subsequently, a population-based graph convolutional network (GCN) integrates the structural and functional features of different modal images into the features of each participant for MCI classification. Main results. Experiments on the ADNI demonstrated accuracies of 98.57%, 96.03%, and 96.83% for the NC-EMCI, NC-LMCI, and EMCI-LMCI classification tasks, respectively. The AUC, specificity, sensitivity, and F1-score are also superior to state-of-the-art models, demonstrating the effectiveness of the proposed model. Furthermore, the proposed model is applied to the ABIDE dataset for autism diagnosis, achieving an accuracy of 91.43% and outperforming the state-of-the-art models, indicating excellent generalization capabilities of the proposed model. Significance. This study demonstrate the proposed model’s ability to integrate multimodal imaging data and its excellent ability to recognize MCI. This will help achieve early warning for AD and intelligent diagnosis of other brain neurodegenerative diseases.

Vispro improves imaging analysis for Visium spatial transcriptomics.

Spatial transcriptomics (ST) is a cutting-edge technology that enables the comprehensive analysis of gene expression while preserving the spatial context of tissues. Within this framework, histological images serve a crucial role, providing spatially cohesive information that is often challenging to capture through gene expression alone. However, the imaging process in ST data presents inherent challenges, such as variability in image quality, artifacts from fiducial markers, and difficulty in distinguishing tissue regions. These challenges can significantly impair the accuracy and effectiveness of downstream analyses. To address these limitations, we developed Vispro, an end-to-end, fully automated image processing tool tailored for ST data. Vispro integrates four key modules: fiducial marker detection, marker removal and image restoration, tissue region detection, and segmentation of disconnected tissue areas. These modules systematically enhance the quality of ST images, reducing artifacts and improving tissue segmentation accuracy. Furthermore, by improving the integrity of image data, we demonstrate that Vispro facilitates downstream analyses such as cell segmentation and image registration, empowering researchers to extract more detailed and accurate biological insights from complex tissue architectures.

Is it feasible to develop a supervised learning algorithm incorporating spinopelvic mobility to predict impingement in patients undergoing total hip arthroplasty?

Precise implant positioning, tailored to individual spinopelvic biomechanics and phenotype, is paramount for stability in total hip arthroplasty (THA). Despite a few studies on instability prediction, there is a notable gap in research utilizing artificial intelligence (AI). The objective of our pilot study was to evaluate the feasibility of developing an AI algorithm tailored to individual spinopelvic mechanics and patient phenotype for predicting impingement. This international, multicentre prospective cohort study across two centres encompassed 157 adults undergoing primary robotic arm-assisted THA. Impingement during specific flexion and extension stances was identified using the virtual range of motion (ROM) tool of the robotic software. The primary AI model, the Light Gradient-Boosting Machine (LGBM), used tabular data to predict impingement presence, direction (flexion or extension), and type. A secondary model integrating tabular data with plain anteroposterior pelvis radiographs was evaluated to assess for any potential enhancement in prediction accuracy. We identified nine predictors from an analysis of baseline spinopelvic characteristics and surgical planning parameters. Using fivefold cross-validation, the LGBM achieved 70.2% impingement prediction accuracy. With impingement data, the LGBM estimated direction with 85% accuracy, while the support vector machine (SVM) determined impingement type with 72.9% accuracy. After integrating imaging data with a multilayer perceptron (tabular) and a convolutional neural network (radiograph), the LGBM's prediction was 68.1%. Both combined and LGBM-only had similar impingement direction prediction rates (around 84.5%). This study is a pioneering effort in leveraging AI for impingement prediction in THA, utilizing a comprehensive, real-world clinical dataset. Our machine-learning algorithm demonstrated promising accuracy in predicting impingement, its type, and direction. While the addition of imaging data to our deep-learning algorithm did not boost accuracy, the potential for refined annotations, such as landmark markings, offers avenues for future enhancement. Prior to clinical integration, external validation and larger-scale testing of this algorithm are essential.

Navigating the Multimodal Landscape: A Review on Integration of Text and Image Data in Machine Learning Architectures

Images and text have become essential parts of the multimodal machine learning (MMML) framework in today’s world because data are always available, and technological breakthroughs bring disparate forms together, and while text adds semantic richness and narrative to images, images capture visual subtleties and emotions. Together, these two media improve knowledge beyond what would be possible with just one revolutionary application. This paper investigates feature extraction and advancement from text and image data using pre-trained models in MMML. It offers a thorough analysis of fusion architectures, outlining text and image data integration and evaluating their overall advantages and effects. Furthermore, it draws attention to the shortcomings and difficulties that MMML currently faces and guides areas that need more research and development. We have gathered 341 research articles from five digital library databases to accomplish this. Following a thorough assessment procedure, we have 88 research papers that enable us to evaluate MMML in detail. Our findings demonstrate that pre-trained models, such as BERT for text and ResNet for images, are predominantly employed for feature extraction due to their robust performance in diverse applications. Fusion techniques, ranging from simple concatenation to advanced attention mechanisms, are extensively adopted to enhance the representation of multimodal data. Despite these advancements, MMML models face significant challenges, including handling noisy data, optimizing dataset size, and ensuring robustness against adversarial attacks. Our findings highlight the necessity for further research to address these challenges, particularly in developing methods to improve the robustness of MMML models.

Prediction of ovarian cancer using artificial intelligence tools.

Ovarian cancer is a common type of cancer and a leading cause of death in women. Therefore, accurate and fast prediction of ovarian tumors is crucial. One of the appropriate and precise methods for predicting and diagnosing this cancer is to build a model based on artificial intelligence methods. These methods provide a tool for predicting ovarian cancer according to the characteristics and conditions of each person. In this study, a data set included records related to 171 cases of benign ovarian tumors, and 178 records related to cases of ovarian cancer were analyzed. The data set contains the records of blood test results and tumor markers of the patients. After data preprocessing, including removing outliers and replacing missing values, the weight of the effective factors was determined using information gain indices and the Gini index. In the next step, predictive models were created using random forest (RF), support vector machine (SVM), decision trees (DT), and artificial neural network (ANN) models. The performance of these models was evaluated using the 10-fold cross-validation method using the indicators of specificity, sensitivity, accuracy, and the area under the receiver operating characteristic curve. Finally, by comparing the performance of the models, the best predictive model of ovarian cancer was selected. The most important predictive factors were HE4, CA125, and NEU. The RF model was identified as the best predictive model, with an accuracy of more than 86%. The predictive accuracy of DT, SVM, and ANN models was estimated as 82.91%, 85.25%, and 79.35%, respectively. Various artificial intelligence (AI) tools can be used with high accuracy and sensitivity in predicting ovarian cancer. Therefore, the use of these tools can help specialists and patients with early, easier, and less expensive diagnosis of ovarian cancer. Future studies can leverage AI to integrate image data with serum biomarkers, thereby facilitating the creation of novel models and advancing the diagnosis and treatment of ovarian cancer.

Color image encryption scheme for distributed architecture with SCFP chaotic map

Image protection mechanism in distributed cloud network is an essential component of information security field. In this paper, a novel one-dimensional sine-cosine fractional power chaotic map (SCFP) is proposed. Results of various dynamical system tests illustrate that SCFP exhibits superior chaotic behavior over its infinite positive real parameter range, whose complexity and unpredictability can guarantee the strength of image cryptosystem. Furthermore, a color image encryption scheme tailored for distributed architecture is devised. Firstly, a hybrid cryptographic mechanism is designed to perform diffusion and confusion encryption for image data and ECC public key encryption for intermediate keys. Secondly, the diffusion structure elevates processing units to row-column level, and the diffusion order is dictated by a pseudo-random sequence generated by SCFP. Thirdly, the confusion structure extends the unbiased and efficient Fisher-Yates algorithm into a 2D space, and adopts a design of dual plaintext-related key. Lastly, three techniques namely QOI lossless compression, DE information embedding and threshold secret sharing are integrated to resolve issues of data volume inflation, key synchronization difficulty and poor fault tolerance. Simulation experiments conducted on multiple color images demonstrate that the proposed scheme offers significant ciphertext randomness, sufficiently large key space and strong key sensitivity, which can ensure the integrity of image data and resist various typical cryptographic attacks, and outperforms existing schemes oriented to centralized architecture in terms of security and efficiency.

Traumatic axonal injury: Clinic, forensic and biomechanics perspectives

Identification of Traumatic axonal injury (TAI) is critical in clinical practice, particularly in terms of long-term prognosis, but also for medico-legal issues, to verify whether the death or the after-effects were attributable to trauma. Multidisciplinary approaches are an undeniable asset when it comes to solving these problems. The aim of this work is therefore to list the different techniques needed to identify axonal lesions and to understand the lesion mechanisms involved in their formation. Imaging can be used to assess the consequences of trauma, to identify indirect signs of TAI, to explain the patient’s initial symptoms and even to assess the patient’s prognosis. Three-dimensional reconstructions of the skull can highlight fractures suggestive of trauma. Microscopic and immunohistochemical techniques are currently considered as the most reliable tools for the early identification of TAI following trauma. Finite element models use mechanical equations to predict biomechanical parameters, such as tissue stresses and strains in the brain, when subjected to external forces, such as violent impacts to the head. These parameters, which are difficult to measure experimentally, are then used to predict the risk of injury. The integration of imaging data with finite element models allows researchers to create realistic and personalized computational models by incorporating actual geometry and properties obtained from imaging techniques. The personalization of these models makes their forensic approach particularly interesting.

A New Hybrid Approach for Image Security using Steganography and Encryption

In today's digital age, ensuring the security and confidentiality of image data is paramount, particularly with the proliferation of online communication and storage platforms. This project proposes a hybrid approach for enhancing image security by synergistically integrating encryption and steganography techniques. The combination of these two methods aims to fortify the protection of digital images against unauthorized access and tampering. Encryption ensures the confidentiality of image content by converting it into an unintelligible form using robust cryptographic algorithms. Concurrently, steganography conceals the encrypted data within the image itself, embedding it imperceptibly into the pixels or metadata. The synergy of encryption and steganography not only safeguards the integrity of image data but also adds an additional layer of concealment, making it arduous for adversaries to detect and decipher sensitive information. Through this project, the efficacy of the hybrid approach will be evaluated through experimentation and analysis, with the ultimate goal of providing a comprehensive solution for image security in various applications and contexts.

Abstract PO3-09-01: Integrating pathomic and radiomic images to classify risk of subsequent events among women with DCIS

Abstract Background Multiple sources of ~omic data can be generated from women at different stages of developing breast cancer, the leading cancer diagnosed in women worldwide. Traditionally interrogation of risk factors to study associations and develop prediction models for future breast events has been limited to one or few risk factors, or summary scores of clinical and tumor characteristics. Methods to bring mammography images and breast biopsies of precancer lesions together to summarize risk of cancer developing in the breast are urgently needed. Integration of these two sources has not been performed to date, but has potential to increase accuracy of risk prediction. Approach The Repository of Archival Human Breast Tissue (RAHBT) was established in 2007 at Washington University School of Medicine (WUSM) and maintains biospecimens and medical record data of women treated with breast-conserving surgery (BCS) or mastectomy for breast cancer at WUSM and six other St Louis metropolitan hospitals between 1981-2016. Prospective follow-up of cases is achieved through health records and Siteman tumor registry. Among 1831 patients with pathologically confirmed DCIS who had no prior cancer, 174 developed breast events at least six months after initial DCIS diagnosis. For each case diagnosed between January 1998 and March 2016 with subsequent breast events, two DCIS controls were matched on race, year of diagnosis (±5 years), age (±5 years), and type of surgery. Tissue micro arrays (TMAs) are constructed after breast pathology review and processed for H&E and imaged. Breast cancer risk factor data are uniformly retrieved form the medical records at time of processing cases of DCIS. Mammogram images are retrieved for all women. Full-field digital mammograms (FFDM) are all using the same technology (Hologic). Risk factors and outcome variables: ipsilateral breast events (IBE) was defined as the development of invasive cancer or DCIS in the treated breast at least 6 months post-diagnosis. Follow-up time was calculated from the date of DCIS diagnosis to the date of first IBE, death, or last follow-up, whichever occurred first. The predictors included commonly used clinicopathological factors: age, tumor grade (high vs. low/intermediate), comedonecrosis, surgical margins (close (≤2mm) vs. negative ( >2mm)), local treatment (BCS only and mastectomy vs. BCS+radiation), and endocrine therapy. BMI, menopausal status, and ER were also available for evaluation as predictors. We limited this analysis to women with digital mammograms immediately prior to diagnosis and include 128 cases and controls. Validation cohort As the RAHBT cohort continues to be followed additional second breast events have been documented after the cut off for events identified through March 2016, and the identical procedures used to review/confirm DCIS and subsequent breast events, construct TMAs, process H&E and images, and assemble risk factor data, and the associated digital mammograms. We have 13 additional ipsilateral breast events with complete data and their controls for independently testing the model performance. Statistical methods Propose novel supervised learning approach to integrate image data from mammograms and TMA slides that accommodates agreement between multi-omics. Results 128 (cases and controls, 21.9% ipsilateral subsequent events) identified for development and internal cross validation. Median age at diagnosis was 52 and median time to subsequent breast event was 63 mo. Controlling for the clinical/pathologic risk factors (age, BMI, BI-RADs density, treatment, tumor grade, parous, menopausal status, ER status, and race) and integrating the whole mammogram and TMA pathology images, we observe a 5-yr ipsilateral AUC = 0.74; 10-yr AUC 0.75. The independent validation is ongoing. Conclusions Integrating heterogeneous multiomic data sources can generate significant improvement in long term risk prediction after initial DCIS diagnosis. Citation Format: Shih-Ting Huang, Debbie Bennett, Robert West, Graham Colditz, Shu Jiang. Integrating pathomic and radiomic images to classify risk of subsequent events among women with DCIS [abstract]. In: Proceedings of the 2023 San Antonio Breast Cancer Symposium; 2023 Dec 5-9; San Antonio, TX. Philadelphia (PA): AACR; Cancer Res 2024;84(9 Suppl):Abstract nr PO3-09-01.

BC-QNet: A quantum-infused ELM model for breast cancer diagnosis

The timely and accurate diagnosis of breast cancer is pivotal for effective treatment, but current automated mammography classification methods have their constraints. In this study, we introduce an innovative hybrid model that marries the power of the Extreme Learning Machine (ELM) with FuNet transfer learning, harnessing the potential of the MIAS dataset. This novel approach leverages an Enhanced Quantum-Genetic Binary Grey Wolf Optimizer (Q-GBGWO) within the ELM framework, elevating its performance. Our contributions are twofold: firstly, we employ a feature fusion strategy to optimize feature extraction, significantly enhancing breast cancer classification accuracy. The proposed methodological motivation stems from optimizing feature extraction for improved breast cancer classification accuracy. The Q-GBGWO optimizes ELM parameters, demonstrating its efficacy within the ELM classifier. This innovation marks a considerable advancement beyond traditional methods. Through comparative evaluations against various optimization techniques, the exceptional performance of our Q-GBGWO-ELM model becomes evident. The classification accuracy of the model is exceptionally high, with rates of 96.54 % for Normal, 97.24 % for Benign, and 98.01 % for Malignant classes. Additionally, the model demonstrates a high sensitivity with rates of 96.02 % for Normal, 96.54 % for Benign, and 97.75 % for Malignant classes, and it exhibits impressive specificity with rates of 96.69 % for Normal, 97.38 % for Benign, and 98.16 % for Malignant classes. These metrics are reflected in its ability to classify three different types of breast cancer accurately. Our approach highlights the innovative integration of image data, deep feature extraction, and optimized ELM classification, marking a transformative step in advancing early breast cancer detection and enhancing patient outcomes.

Evaluating ChatGPT-4's Diagnostic Accuracy: Impact of Visual Data Integration.

In the evolving field of health care, multimodal generative artificial intelligence (AI) systems, such as ChatGPT-4 with vision (ChatGPT-4V), represent a significant advancement, as they integrate visual data with text data. This integration has the potential to revolutionize clinical diagnostics by offering more comprehensive analysis capabilities. However, the impact on diagnostic accuracy of using image data to augment ChatGPT-4 remains unclear. This study aims to assess the impact of adding image data on ChatGPT-4's diagnostic accuracy and provide insights into how image data integration can enhance the accuracy of multimodal AI in medical diagnostics. Specifically, this study endeavored to compare the diagnostic accuracy between ChatGPT-4V, which processed both text and image data, and its counterpart, ChatGPT-4, which only uses text data. We identified a total of 557 case reports published in the American Journal of Case Reports from January 2022 to March 2023. After excluding cases that were nondiagnostic, pediatric, and lacking image data, we included 363 case descriptions with their final diagnoses and associated images. We compared the diagnostic accuracy of ChatGPT-4V and ChatGPT-4 without vision based on their ability to include the final diagnoses within differential diagnosis lists. Two independent physicians evaluated their accuracy, with a third resolving any discrepancies, ensuring a rigorous and objective analysis. The integration of image data into ChatGPT-4V did not significantly enhance diagnostic accuracy, showing that final diagnoses were included in the top 10 differential diagnosis lists at a rate of 85.1% (n=309), comparable to the rate of 87.9% (n=319) for the text-only version (P=.33). Notably, ChatGPT-4V's performance in correctly identifying the top diagnosis was inferior, at 44.4% (n=161), compared with 55.9% (n=203) for the text-only version (P=.002, χ2 test). Additionally, ChatGPT-4's self-reports showed that image data accounted for 30% of the weight in developing the differential diagnosis lists in more than half of cases. Our findings reveal that currently, ChatGPT-4V predominantly relies on textual data, limiting its ability to fully use the diagnostic potential of visual information. This study underscores the need for further development of multimodal generative AI systems to effectively integrate and use clinical image data. Enhancing the diagnostic performance of such AI systems through improved multimodal data integration could significantly benefit patient care by providing more accurate and comprehensive diagnostic insights. Future research should focus on overcoming these limitations, paving the way for the practical application of advanced AI in medicine.

Color image encryption algorithm based on Mackey–Glass time-delay chaotic system and quantum random walk

To ensure the confidentiality and integrity of image data and prevent unauthorized data tampering and privacy leaks. This study proposes a new color image encryption scheme based on the Mackey–Glass time-delay chaotic system and quantum random walk. This approach fully leverages the unpredictability of quantum random walks to generate random values. It combines the differences in Hamming distance between the three RGB channels of color images to create a highly complex and random key. The overall image and the three independent RGB channels are arranged in ascending order using Logistic-tent chaotic mapping and the Mackey–Glass time-delay chaotic system to obfuscate the image data. The deformed fractional-order Lorenz chaotic system is introduced, integrated with DNA encoding and decoding technology, and XOR operations are performed to achieve encryption at the spatial and pixel levels, thereby increasing the complexity of decryption. Through extensive experimental research, this solution has demonstrated excellent results in tests such as adjacent pixel correlation, information entropy, and key sensitivity. It has an excellent ability to protect the privacy of images and provides a reliable guarantee for the security of image data.

Clinical and neuroimaging predictors of benzodiazepine response in catatonia: A machine learning approach

Catatonia is a well characterized psychomotor syndrome combining motor, behavioural and neurovegetative signs. Benzodiazepines are the first-choice treatment, effective in 70 % of cases. Currently, the factors associated with benzodiazepine resistance remain unknown. We aimed to develop machine learning models using clinical and neuroimaging data to predict benzodiazepine response in catatonic patients. This study examined a cohort of catatonic patients who underwent standardized clinical evaluation, 3 T brain MRI, and benzodiazepine trial. Based on clinical response, patients were classified as benzodiazepine responders or non-responders. Cortical thickness and regional brain volumes were measured. Two machine learning models (linear model and gradient boosting tree model) were developed to identify predictors of treatment response using clinical, demographic, and neuroimaging data. The cohort included 65 catatonic patients, comprising 30 benzodiazepine responders and 35 non-responders. Using clinical data alone, the linear model achieved 63% precision, 51% recall, a specificity of 61%, and 58% AUC, while the gradient boosting tree (GBT) model attained 46% precision, 60% recall, a specificity of 62% and 64% AUC. Incorporating neuroimaging data improved model performance, with the linear model achieving 66% precision, 57% recall, a specificity of 67%, and 70% AUC, and the GBT model attaining 50% precision, 50% recall, a specificity of 62% and 70% AUC. The integration of imaging data with demographic and clinical information significantly enhanced the predictive performance of the models. The duration of the catatonic syndrome, along with the presence of mitgehen (passive obedience) and immobility/stupor, and the volume of the right medial orbito-frontal cortex emerged as important factors in predicting non-response to benzodiazepines.

Enhancing transvenous lead extraction risk prediction: Integrating imaging biomarkers into machine learning models

BackgroundMachine learning (ML) models have been proposed to predict risk related to transvenous lead extraction (TLE). ObjectiveThe purpose of this study was to test whether integrating imaging data into an existing ML model increases its ability to predict major adverse events (MAEs; procedure-related major complications and procedure-related deaths) and lengthy procedures (≥100 minutes). MethodsWe hypothesized certain features—(1) lead angulation, (2) coil percentage inside the superior vena cava (SVC), and (3) number of overlapping leads in the SVC—detected from a pre-TLE plain anteroposterior chest radiograph (CXR) would improve prediction of MAE and long procedural times. A deep-learning convolutional neural network was developed to automatically detect these CXR features. ResultsA total of 1050 cases were included, with 24 MAEs (2.3%) . The neural network was able to detect (1) heart border with 100% accuracy; (2) coils with 98% accuracy; and (3) acute angle in the right ventricle and SVC with 91% and 70% accuracy, respectively. The following features significantly improved MAE prediction: (1) ≥50% coil within the SVC; (2) ≥2 overlapping leads in the SVC; and (3) acute lead angulation. Balanced accuracy (0.74–0.87), sensitivity (68%–83%), specificity (72%–91%), and area under the curve (AUC) (0.767–0.962) all improved with imaging biomarkers. Prediction of lengthy procedures also improved: balanced accuracy (0.76–0.86), sensitivity (75%–85%), specificity (63%–87%), and AUC (0.684–0.913). ConclusionRisk prediction tools integrating imaging biomarkers significantly increases the ability of ML models to predict risk of MAE and long procedural time related to TLE.

Integrated indoor positioning methods to optimize computations and prediction accuracy enhancement

AbstractIndoor GPS location estimation encounters accuracy challenges from intricate building structures and diverse signal interferences. Trilateration methods utilising APs are typically employed to estimate indoor locations. Nevertheless, estimation errors from multipath effects and high power consumption of sensors employed in location estimation curtail battery life. To address this issue, research into location estimation methods utilising machine learning has been conducted. However, challenges involving the selection of the optimal access point locations and obtaining dense RSSI data have been noted. In this article presents a solution based on sparse radio maps for decreasing the expenses of collecting RSSI data while simultaneously enhancing indoor location accuracy through the integration of image data. The proposed approach integrates matrix‐based RSSI indoor positioning (M‐RIP) for initial location estimation and feature‐based image indoor positioning (F‐IIP) for position determination via image feature matching. Furthermore, extended area‐based post‐processing (EA‐PP) is employed to augment M‐RIP's precision and minimize image matching computation in F‐IIP, improving overall performance. This article utilizes actual building data to validate the precision of the position estimation and efficiency of computation reduction using the proposed method.

Advancements and Challenges in the Image-Based Diagnosis of Lung and Colon Cancer: A Comprehensive Review.

Image-based diagnosis has become a crucial tool in the identification and management of various cancers, particularly lung and colon cancer. This review delves into the latest advancements and ongoing challenges in the field, with a focus on deep learning, machine learning, and image processing techniques applied to X-rays, CT scans, and histopathological images. Significant progress has been made in imaging technologies like computed tomography (CT), magnetic resonance imaging (MRI), and positron emission tomography (PET), which, when combined with machine learning and artificial intelligence (AI) methodologies, have greatly enhanced the accuracy of cancer detection and characterization. These advances have enabled early detection, more precise tumor localization, personalized treatment plans, and overall improved patient outcomes. However, despite these improvements, challenges persist. Variability in image interpretation, the lack of standardized diagnostic protocols, unequal access to advanced imaging technologies, and concerns over data privacy and security within AI-based systems remain major obstacles. Furthermore, integrating imaging data with broader clinical information is crucial to achieving a more comprehensive approach to cancer diagnosis and treatment. This review provides valuable insights into the recent developments and challenges in image-based diagnosis for lung and colon cancers, underscoring both the remarkable progress and the hurdles that still need to be overcome to optimize cancer care.

Optimal Information Hiding: Advanced Bitstream‐Based Watermarking for Secure and Efficient Integration of Image Data in Digital Videos

Video watermarking is a technique used to embed a visible or invisible mark onto a video file in order to claim ownership, protect intellectual property rights, and detect unauthorized users. The issue of video piracy arises due to the advancement of Internet services and the utilization of various storage technologies. This problem becomes particularly significant with the widespread propagation of media through online channels. The constant progress in sharing of data, videos, images, and applications necessitates the implementation of measures focused on security and the protection of intellectual ownership rights. To address this issue, we proposed a novel Bitstream video watermarking technique that integrates cutting‐edge methodologies to seamlessly embed image data within digital videos. This technique stands apart from less sophisticated watermarking methods by capitalizing on spatial and temporal domain concepts in video processing. An experiment is conducted to analyze the time required for the insertion and extraction processes to gain insights into the performance of bitstream watermarking in the video. While enhancing the existing approach, we systematically explored diverse strategies aimed at augmenting watermark capacity, bolstering robustness, and heightening visual imperceptibility. These strategies encompassed the intricate infusion of watermark fragments into the frame area through chaotic mechanisms, the integration of error‐correcting codes to ensure data fidelity, and the selective omission of dynamic video segments during information extraction processes. Rigorous experimentations are undertaken by the constraints of lossy compression scenarios, maintaining equivalent or reduced bitrate parameters. The findings substantiate the favorable outcomes stemming from the implemented enhancement, affirming the tangible suitability of the phase watermarking technique for the protection of video copyrights. In order to assess the quality of the bitstream video watermarking technique, the peak signal‐to‐noise ratio (PSNR), structural similarity index (SSIM), and normalized correlation coefficient (NCC) are computed and examined by the testing data. The suggested model achieved a PSNR value up to 32.52 dB, SSIM value up to 0.97, and NCC value is 1. The dynamic range (DR) and spatial resolution (SR) are measured in the evaluation process. Security is enhanced significantly after implementing the multifaceted approach. The watermarking scheme is more robust and can effectively resist the potential attacks. In summary, this study advances the field of video watermarking by proposing a sophisticated bitstream technique and rigorously evaluating its performance. The outcomes underscore its practical viability for copyright protection, contributing to a more secure digital media landscape.

Artificial intelligence in medical imaging is a tool for clinical routine and scientific discovery

The emergence of powerful machine learning methodology together with an increasing amount of data collected during clinical routine have fostered a growing role of artificial intelligence (AI) in medicine. Algorithms have become part of clinical care enhancing image reconstruction, detecting cancer or predicting individual risk to support treatment decisions and patient management. The entry into clinical care is determined by technological feasibility, integration into effective workflows, and immediacy of benefits. At the same time, research is advancing the integration of imaging data and other modalities such as genomics, and the linking of observations made at large scale with the understanding of underlying biological processes. AI will have impact in imaging and precision medicine not only because of the successful application of techniques established in other domains, but primarily because of the effective joint development of new technology and corresponding advance of diagnosis and care.

Fusion of electronic health records and radiographic images for a multimodal deep learning prediction model of atypical femur fractures

Atypical femur fractures (AFF) represent a very rare type of fracture that can be difficult to discriminate radiologically from normal femur fractures (NFF). AFFs are associated with drugs that are administered to prevent osteoporosis-related fragility fractures, which are highly prevalent in the elderly population. Given that these fractures are rare and the radiologic changes are subtle currently only 7% of AFFs are correctly identified, which hinders adequate treatment for most patients with AFF. Deep learning models could be trained to classify automatically a fracture as AFF or NFF, thereby assisting radiologists in detecting these rare fractures. Historically, for this classification task, only imaging data have been used, using convolutional neural networks (CNN) or vision transformers applied to radiographs. However, to mimic situations in which all available data are used to arrive at a diagnosis, we adopted an approach of deep learning that is based on the integration of image data and tabular data (from electronic health records) for 159 patients with AFF and 914 patients with NFF. We hypothesized that the combinatorial data, compiled from all the radiology departments of 72 hospitals in Sweden and the Swedish National Patient Register, would improve classification accuracy, as compared to using only one modality. At the patient level, the area under the ROC curve (AUC) increased from 0.966 to 0.987 when using the integrated set of imaging data and seven pre-selected variables, as compared to only using imaging data. More importantly, the sensitivity increased from 0.796 to 0.903. We found a greater impact of data fusion when only a randomly selected subset of available images was used to make the image and tabular data more balanced for each patient. The AUC then increased from 0.949 to 0.984, and the sensitivity increased from 0.727 to 0.849.These AUC improvements are not large, mainly because of the already excellent performance of the CNN (AUC of 0.966) when only images are used. However, the improvement is clinically highly relevant considering the importance of accuracy in medical diagnostics. We expect an even greater effect when imaging data from a clinical workflow, comprising a more diverse set of diagnostic images, are used.

Multi-attribute hierarchical clustering for product family division of customized wooden doors

To improve the production system for customized wooden doors and to gain research and development efficiency, this paper proposed the feasibility of using hierarchical clustering algorithms to cluster a company’s customized wooden door products and its application to rational product family architecture. The particular use of multi-attribute feature data to locate products and the integration of image data into the database can make the original hierarchical clustering more compatible and adaptable for application to customized wooden doors. The preprocessed data was analyzed by clustering to obtain the clustering results and similarity relationships. Hierarchical clustering results were uneven and not entirely interpreted. However, the internal order structure of clusters and the clustering process could be clearly observed, and the distance hierarchical relationship between the products could be obtained, which was beneficial to the division of the product architecture. The results illustrated that processing using hierarchical clustering of multi-attribute data is feasible for optimizing customized wooden door product systems. In addition, the product architecture, product coding rules, and front-end development process were established to improve standardization and research and development efficiency. There is still great potential for developing the custom wooden door category in custom furniture companies.