ViTCXRResNet : Harnessing Explainable Artificial Intelligence in Medical Imaging—Chest X‐Ray‐Based Patients Demographic Prediction
ABSTRACT Patient demographic prediction involves estimating age, gender, ethnicity, and other personal characteristics using X‐rays. This can help in personalized medicine and improved healthcare outcomes. It can assist in automated diagnosis for some diseases that exhibit age and gender‐specific prevalence. It can also help in forensic science to identify individuals when demographic information is missing. Insights from deep learning can verify the gender and age of self‐reported individuals through chest X‐rays (CXRs). In this proposed work, we have deployed an artificial intelligence (AI) enabled model which focuses on two tasks: gender classification and age prediction from CXRs. For gender classification, the model combines ResNet‐50 (CNN) and Vision Transformer (ViT) to leverage both local feature extraction and global contextual understanding for predicting gender and is called ViTCXRResNet. The model was trained and validated on an Amazon Web Services (SPR) dataset of 10702 images, split with an 80–20 ratio, which was evaluated with classification metrics to determine the model's behavior. For age prediction, extracted features from ResNet‐50 were used with dimensionality reduction through principal component analysis (PCA). A fully connected feedforward neural network was trained on the reduced feature set to predict age. The classification and regression model achieves accuracy results of 93.46% for gender classification and 0.86 for the R 2 score for age prediction on the SPR dataset. For visual interpretation, explainable AI (Gradient‐weighted Class Activation Mapping) was utilized to visualize and find out which parts of the image are prioritized for classifying gender. The proposed model yields high classification accuracy in gender detection and significant accuracy in age prediction. The model shows competitive accuracy compared to existing methods. Further, the demographic prediction stability of the model was proven on two different ethnic groups, such as the Japanese Society of Radiological Technology (JSRT) and Montgomery (USA) datasets.
- Research Article
1
- 10.7759/cureus.70008
- Sep 23, 2024
- Cureus
The rapid advancement of artificial intelligence (AI) in medical imaging has generated significant interest and debate among healthcare professionals, researchers, and the general public. This study aims to explore trends and public perception of AI in medical imaging by analyzing social media discussions. Using a retrospective content analysis approach, social media posts from X (formerly known as Twitter) and Reddit were collected, covering discussions from 2019 to 2024. A total of 1,022 posts were analyzed after data cleaning, employing both qualitative and quantitative methods to examine sentiment, themes, and keyword frequencies. The sentiment analysis revealed that 55% of the comments expressed positive sentiments towards AI in medical imaging, emphasizing its potential to enhance diagnostic accuracy and efficiency. Neutral sentiments accounted for 35% of the posts, while 10% expressed negative sentiments, primarily focusing on concerns related to job displacement, ethical issues, and data privacy. Thematic analysis identified four primary themes: ethical and privacy concerns, job displacement, trust and reliability, and workflow efficiency. Keyword frequency analysis highlighted significant discussions around AI, imaging, and radiology. The results underscore both the optimism and concerns associated with AI in medical imaging, emphasizing the need for ongoing dialogue among technology developers, healthcare providers, and the public. Addressing ethical and privacy concerns, and integrating AI responsibly into clinical workflows, is crucial for maximizing its benefits and minimizing potential risks. These findings provide valuable insights into public perceptions and inform strategies for the effective and ethical implementation of AI technologies in healthcare.
- Research Article
5
- 10.2147/jmdh.s451301
- Jul 1, 2024
- Journal of multidisciplinary healthcare
This study aimed to investigate the knowledge, attitudes, and practice (KAP) of radiologists regarding artificial intelligence (AI) in medical imaging in the southeast of China. This cross-sectional study was conducted among radiologists in the Jiangsu, Zhejiang, and Fujian regions from October to December 2022. A self-administered questionnaire was used to collect demographic data and assess the KAP of participants towards AI in medical imaging. A structural equation model (SEM) was used to analyze the relationships between KAP. The study included 452 valid questionnaires. The mean knowledge score was 9.01±4.87, the attitude score was 48.96±4.90, and 75.22% of participants actively engaged in AI-related practices. Having a master's degree or above (OR=1.877, P=0.024), 5-10 years of radiology experience (OR=3.481, P=0.010), AI diagnosis-related training (OR=2.915, P<0.001), and engaging in AI diagnosis-related research (OR=3.178, P<0.001) were associated with sufficient knowledge. Participants with a junior college degree (OR=2.139, P=0.028), 5-10 years of radiology experience (OR=2.462, P=0.047), and AI diagnosis-related training (OR=2.264, P<0.001) were associated with a positive attitude. Higher knowledge scores (OR=5.240, P<0.001), an associate senior professional title (OR=4.267, P=0.026), 5-10 years of radiology experience (OR=0.344, P=0.044), utilizing AI diagnosis (OR=3.643, P=0.001), and engaging in AI diagnosis-related research (OR=6.382, P<0.001) were associated with proactive practice. The SEM showed that knowledge had a direct effect on attitude (β=0.481, P<0.001) and practice (β=0.412, P<0.001), and attitude had a direct effect on practice (β=0.135, P<0.001). Radiologists in southeastern China hold a favorable outlook on AI-assisted medical imaging, showing solid understanding and enthusiasm for its adoption, despite half lacking relevant training. There is a need for more AI diagnosis-related training, an efficient standardized AI database for medical imaging, and active promotion of AI-assisted imaging in clinical practice. Further research with larger sample sizes and more regions is necessary.
- Research Article
- 10.1002/ird3.70008
- Apr 1, 2025
- iRADIOLOGY
ABSTRACTA revolution in medical diagnosis and treatment is being driven by the use of artificial intelligence (AI) in medical imaging. The diagnostic efficacy and accuracy of medical imaging are greatly enhanced by AI technologies, especially deep learning, that performs image recognition, feature extraction, and pattern analysis. Furthermore, AI has demonstrated significant promise in assessing the effects of treatments and forecasting the course of diseases. It also provides doctors with more advanced tools for managing the conditions of their patients. AI is poised to play a more significant role in medical imaging, especially in real‐time image processing and multimodal fusion. By integrating multiple forms of image data, multimodal fusion technology provides more comprehensive disease information, whereas real‐time image analysis can assist surgeons in making more precise decisions. By tailoring treatment regimens to each patient's unique needs, AI enhances both the effectiveness of treatment and the patient experience. Overall, AI in medical imaging promises a bright future, significantly enhancing diagnostic precision and therapeutic efficacy, and ultimately delivering higher‐quality medical care to patients.
- Research Article
6
- 10.1016/j.cpet.2021.09.005
- Nov 19, 2021
- PET Clinics
Evidence-Based Artificial Intelligence in Medical Imaging
- Research Article
- 10.30574/wjarr.2024.23.3.2751
- Sep 30, 2024
- World Journal of Advanced Research and Reviews
The rapid integration of artificial intelligence (AI) in medical imaging has transformed the healthcare landscape, enabling precision therapy for a range of diseases. This article explores the key roles of AI in medical imaging, particularly focusing on three vital areas: segmentation, laser-guided procedures, and protective shielding. AI-driven segmentation tools offer unprecedented accuracy in identifying pathological regions, improving diagnostic efficiency, and aiding in personalized treatment plans. Laser-guided procedures, powered by AI algorithms, provide enhanced precision in targeting affected tissues, minimizing damage to healthy tissues, and promoting faster recovery times. Additionally, AI has made significant strides in optimizing protective shielding techniques, ensuring patient safety while minimizing radiation exposure during imaging and therapy. The article discusses the technological advances, clinical applications, challenges, and future directions of AI in these domains. Through this synthesis, the potential of AI to revolutionize medical imaging and contribute to more effective, safer, and personalized therapies becomes evident.
- Research Article
2
- 10.2174/0115734056250970231117111810
- Jan 11, 2024
- Current Medical Imaging Formerly Current Medical Imaging Reviews
Artificial intelligence (AI) in medical imaging rapidly expands regarding image processing and interpretation. Therefore, the aim was to explore radiographers' and radiologists' perceptions and attitudes towards AI use in medical imaging technologies in Saudi Arabia. The survey was distributed online, and responses were collected from 173 participants nationwide. Data analysis was performed using SPSS Statistics (version 27). The participants scored an average of 1.7, 1.6, and 1.8 on a scale of 1-3 for attitudinal perspectives on clinical application and the positive and negative impact of integrating AI technology in diagnostic radiology. Lack of knowledge (43.9%) and perceived cyber threats (37.7%) were the most cited factors hindering AI implementation in Saudi Arabia. The radiographradiology radiologists in this study had a favorable attitude toward AI integration in diagnostic radiology; nonetheless, concerns were raised about data protection, cyber security, AI-related errors, and decision-making challenges.
- Discussion
- 10.1136/jitc-2025-012468
- Sep 9, 2025
- Journal for Immunotherapy of Cancer
Neoadjuvant immunochemotherapy (nICT) has demonstrated significant potential in improving pathological response rates and survival outcomes for patients with locally advanced esophageal squamous cell carcinoma (ESCC). However, substantial interindividual variability in therapeutic outcomes highlights the urgent need for more precise predictive tools to guide clinical decision-making. Traditional biomarkers remain limited in both predictive performance and clinical feasibility. In recent years, the application of artificial intelligence (AI) in medical imaging has expanded rapidly. By incorporating voxel-level feature maps, the combination of radiomics and deep learning enables the extraction of rich textural, morphological, and microstructural features, while autonomously learning high-level abstract representations from clinical CT images, thereby revealing biological heterogeneity that is often imperceptible to conventional assessments. Leveraging these high-dimensional representations, AI models can provide more accurate predictions of nICT response. Future advancements in foundation models, multimodal integration, and dynamic temporal modeling are expected to further enhance the generalizability and clinical applicability of AI. AI-powered medical imaging is poised to support all stages of perioperative management in ESCC, playing a pivotal role in high-risk patient identification, dynamic monitoring of therapeutic response, and individualized treatment adjustment, thereby comprehensively advancing precision nICT.
- Research Article
- 10.1016/j.clinimag.2024.110212
- Jun 1, 2024
- Clinical Imaging
What makes a good scientific presentation on artificial intelligence in medical imaging?
- Research Article
5
- 10.60084/ijcr.v2i1.150
- May 4, 2024
- Indonesian Journal of Case Reports
This study tackles the pressing challenge of lung cancer detection, the foremost cause of cancer-related mortality worldwide, hindered by late detection and diagnostic limitations. Aiming to improve early detection rates and diagnostic reliability, we propose an approach integrating Deep Convolutional Neural Networks (DCNN) with Explainable Artificial Intelligence (XAI) techniques, specifically focusing on the Residual Network (ResNet) architecture and Gradient-weighted Class Activation Mapping (Grad-CAM). Utilizing a dataset of 1,000 CT scans, categorized into normal, non-cancerous, and three types of lung cancer images, we adapted the ResNet50 model through transfer learning and fine-tuning for enhanced specificity in lung cancer subtype detection. Our methodology demonstrated the modified ResNet50 model's effectiveness, significantly outperforming the original architecture in accuracy (91.11%), precision (91.66%), sensitivity (91.11%), specificity (96.63%), and F1-score (91.10%). The inclusion of Grad-CAM provided insightful visual explanations for the model's predictions, fostering transparency and trust in computer-assisted diagnostics. The study highlights the potential of combining DCNN with XAI to advance lung cancer detection, suggesting future research should expand dataset diversity and explore multimodal data integration for broader applicability and improved diagnostic capabilities.
- Book Chapter
- 10.1201/9781003175865-4
- Aug 26, 2021
Medical imaging plays an essential role in healthcare for timely diagnosis of diseases, disease staging, selection of appropriate treatment, planning, delivery, risk prediction, etc. It has been developed enormously due to the technological revolution globally. It starts from 2D technologies like Radiography, Mammography, etc., moves into 3D technologies like Computerized Tomography (CT), Magnetic Resonance Imaging (MRI), Positron Emission Tomography (PET), Medical Ultrasound, etc., and 4D technologies as well. They have been introduced to improve the accuracy of medical imaging, consistency in interpretation of images, image evaluation, etc. Even though these techniques bring a lot of benefits and potentials, they have their drawbacks that would be reduced with the effective usage of Artificial Intelligence (AI), Machine Learning (ML), and radiomics. Based on these, this chapter (i) discusses the state-of-art of AI, ML and radiomics in medical imaging, (ii) explores the potentials of AI in various imaging modalities, such as CT, Mammography, MRI, Medical Ultrasound, and PET, (iii) indicates the applications, and challenges in AI towards precision medicine, and (iv) creates awareness about the present status, and future perspectives of AI in medical imaging in order to develop new algorithms that can be suitable for routine clinical practice.
- Research Article
19
- 10.1017/s0266462322000551
- Jan 1, 2022
- International Journal of Technology Assessment in Health Care
Artificial intelligence (AI) is seen as a major disrupting force in the future healthcare system. However, the assessment of the value of AI technologies is still unclear. Therefore, a multidisciplinary group of experts and patients developed a Model for ASsessing the value of AI (MAS-AI) in medical imaging. Medical imaging is chosen due to the maturity of AI in this area, ensuring a robust evidence-based model. MAS-AI was developed in three phases. First, a literature review of existing guides, evaluations, and assessments of the value of AI in the field of medical imaging. Next, we interviewed leading researchers in AI in Denmark. The third phase consisted of two workshops where decision makers, patient organizations, and researchers discussed crucial topics for evaluating AI. The multidisciplinary team revised the model between workshops according to comments. The MAS-AI guideline consists of two steps covering nine domains and five process factors supporting the assessment. Step 1 contains a description of patients, how the AI model was developed, and initial ethical and legal considerations. In step 2, a multidisciplinary assessment of outcomes of the AI application is done for the five remaining domains: safety, clinical aspects, economics, organizational aspects, and patient aspects. We have developed an health technology assessment-based framework to support the introduction of AI technologies into healthcare in medical imaging. It is essential to ensure informed and valid decisions regarding the adoption of AI with a structured process and tool. MAS-AI can help support decision making and provide greater transparency for all parties.
- Discussion
6
- 10.1016/j.ejmp.2021.05.008
- Mar 1, 2021
- Physica Medica
Focus issue: Artificial intelligence in medical physics.
- Single Book
- 10.1201/9781032626345
- Jan 9, 2025
Explainable Artificial Intelligence in Medical Imaging
- Research Article
2
- 10.33187/jmsm.1417160
- May 8, 2024
- Journal of Mathematical Sciences and Modelling
The integration of artificial intelligence (AI) applications in the healthcare sector is ushering in a significant transformation, particularly in developing more effective strategies for early diagnosis and treatment of contagious diseases like tuberculosis. Tuberculosis, a global public health challenge, demands swift interventions to prevent its spread. While deep learning and image processing techniques show potential in extracting meaningful insights from complex radiological images, their accuracy is often scrutinized due to a lack of explainability. This research navigates the intersection of AI and tuberculosis diagnosis by focusing on explainable artificial intelligence (XAI). A meticulously designed deep learning model for tuberculosis detection is introduced alongside an exploration of XAI to unravel complex decisions. The core belief is that XAI, by elucidating diagnostic decision rationale, enhances the reliability of AI in clinical settings. Emphasizing the pivotal role of XAI in tuberculosis diagnosis, this study aims to impact future research and practical implementations, fostering the adoption of AI-driven disease diagnosis methodologies for global health improvement.
- Preprint Article
- 10.26226/m.64ae6f4e56241620f72a7570
- Aug 30, 2023
Review about explainable artificial intelligence in medical imaging
- Ask R Discovery
- Chat PDF
AI summaries and top papers from 250M+ research sources.