Explainable Artificial Intelligence Research Articles

Rapid detection and interpretation of heart murmurs using phonocardiograms, transfer learning and explainable artificial intelligence.

Cardiovascular disease, which remains one of the main causes of death, can be prevented by early diagnosis of heart sounds. Certain noisy signals, known as murmurs, may be present in heart sounds. On auscultation, the degree of murmur is closely related to the patient's clinical condition. Computer-aided decision-making systems can help doctors to detect murmurs and make faster decisions. The Mel spectrograms were generated from raw phonocardiograms and then presented to the OpenL3 network for transfer learning. In this way, the signals were classified to predict the presence or absence of murmurs and their level of severity. Pitch level (healthy, low, medium, high) and Levine scale (healthy, soft, loud) were used. The results obtained without prior segmentation are very impressive. The model used was then interpreted using an Explainable Artificial Intelligence (XAI) method, Occlusion Sensitivity. This approach shows that XAI methods are necessary to know the features used internally by the artificial neural network then to explain the automatic decision taken by the model. The averaged image of the occlusion sensitivity maps can give us either an overview or a precise detail per pixel of the features used. In the field of healthcare, particularly cardiology, for rapid diagnostic and preventive purposes, this work could provide more detail on the important features of the phonocardiogram.

Weighted ensemble deep learning approach for classification of gastrointestinal diseases in colonoscopy images Aided by explainable AI

Gastrointestinal diseases are significant health issues worldwide, requiring early diagnosis due to their serious health implications. Therefore, detecting these diseases using artificial intelligence-based medical decision support systems through colonoscopy images plays a critical role in early diagnosis. In this study, a deep learning-based method is proposed for the classification of gastrointestinal diseases and colon anatomical landmarks using colonoscopy images. For this purpose, five different Convolutional Neural Network (CNN) models, namely Xception, ResNet-101, NASNet-Large, EfficientNet, and NASNet-Mobile, were trained. An ensemble model was created using class-based recall values derived from the validation performances of the top three models (Xception, ResNet-101, NASNet-Large). A user-friendly Graphical User Interface (GUI) was developed, allowing users to perform classification tasks and use Gradient-weighted Class Activation Mapping (Grad-CAM), an explainable AI tool, to visualize the regions from which the model derives information. Grad-CAM visualizations contribute to a better understanding of the model’s decision-making processes and play an important role in the application of explainable AI. In the study, eight labels, including anatomical markers such as z-line, pylorus, and cecum, as well as pathological findings like esophagitis, polyps, and ulcerative colitis, were classified using the KVASIR V2 dataset. The proposed ensemble model achieved a 94.125% accuracy on the KVASIR V2 dataset, demonstrating competitive performance compared to similar studies in the literature. Additionally, the precision and F1 score values ​​of this model are equal to 94.168% and 94.125%, respectively. These results suggest that the proposed method provides an effective solution for the diagnosis of GI diseases and can be beneficial for medical education.

Deciphering the nonlinear and synergistic role of building energy variables in shaping carbon emissions: A LightGBM- SHAP framework in office buildings

As the global demand for sustainable buildings continues to rise, accurately assessing and managing carbon emissions during the operational phase of buildings has become an urgent challenge. This study employs machine learning and Explainable Artificial Intelligence (XAI) to explore the impact and synergistic effects of energy variables on carbon emissions in office building operations. Initially, energy consumption data from 28 office buildings in China were collected to construct a dataset comprising 24 energy indicators across four dimensions. The Lightweight Gradient Boosting Machine (LightGBM) and Extreme Gradient Boosting (XGBoost) models were used to predict building carbon emission, PV carbon offset, and net carbon emission based on different energy parameters. The SHapley Additive exPlanations (SHAP) method was utilized to interpret the model results from both global and local perspectives. The study results indicate that: (1) The LightGBM model, optimized with GridSearchCV, shows better stability and reliability in predicting carbon emissions. (2) SHAP bar plots和SHAP beeswarm plots reveal that the WWR in the ES dimension and the PVArea in the EP dimension are the most critical variables affecting building carbon emission and PV carbon offset. (3) SHAP dependence plots show that the contributions of energy variables are not independent, with differentiated synergistic effects among variables in emission reduction. (4) SHAP force plots consider interactions among multiple variables, identifying key variable ranges to minimize building carbon emission and maximize PV carbon offset.

Employing Convolutional Neural Networks And Explainable Artificial intelligence for the Detection of Seizures from Electroencephalogram Signal

A seizure is a rapid, uncontrolled burst of electrical activity in the brain. Epilepsy is a neurological disorder caused by repeated seizures. Effective management requires early detection. This research aims to create a convolutional neural network (CNN) and explainable artificial intelligence (XAI) integrated system for epileptic seizure detection, using techniques such as Shapley additive explanation (SHAP) for better interpretability. The relevant data is acquired from a variety of electroencephalogram (EEG) dataset to facilitate the development of the model. To identify the EEG data, the proposed system combines deep learning models with feature extraction technique. Model visualization and XAI approaches like feature importance analysis from SHAP values offer clear insights into the model's decision-making process. Evaluation criteria like specificity and accuracy are used to assess the models' performance. This framework's objective is to create simple seizure detection systems that assist early epilepsy patient identification and individualized treatment plans. This research aims in opening the door to improved patient care and treatment by developing the field of epilepsy seizure detection.

Impact of federated learning and explainable artificial intelligence for medical image diagnosis

Medical image recognition has enormous potential to benefit from the recent developments in federated learning (FL) and interpretable artificial intelligence (AI). The function of FL and explainable artificial intelligence (XAI) in the diagnosis of brain cancers is discussed in this paper. XAI and FL techniques are vital for ensuring data ethics during medical image processing. This paper highlights the benefits of FL, such as cooperative model training and data privacy preservation, and the significance of XAI approaches in providing logical justifications for model predictions. A number of case studies on the segmentation of medical images employing FL were reviewed to compares and contrasts various methods for assessing the efficacy of FL and XAI based diagnostic models for brain tumors. The relevance of FL and XAI to improve the accuracy and interpretability during medical image diagnosis have been presented. Future research directions are also described indicating as to integrate data from various modes, create standardised evaluation processes, and manage ethical issues. This paper is intended to provide a deeper insight on relevance of FL and XAI in medical image diagnosis.

Explainable artificial intelligence for traffic signal detection using LIME algorithm

As technology progresses, so does everything around us, such as televisions, mobile phones, and robots, which grow wiser. Of these technologies, artificial intelligence (AI) is used to aid the computer in making decisions comparable to humans, and this intelligence is supplied to the machine as a model. As AI deals with the concept of Black-Box, the model’s decisions were poorly comprehended by the end users. Explainable AI (XAI) is where humans can understand the judgments and decisions made by the AI. Earlier, the predictions made by the AI were not as easy as we know the data now, and there was some confusion regarding the predictions made by the AI. The intention for the use of XAI is to improve the user interface of products and services by helping them trust the decisions made by AI. The machine learning (ML) model White-box shows us the result that can be understood by the people in that domain, wherein the end users cannot understand the decisions. To further enhance traffic signal detection using XAI, the concept called local interpretable model- agnostic explanation (LIME) algorithm has been taken into consideration and the performance is improved in this paper.

Revolutionizing the Future of Hydrological Science: Impact of Machine Learning and Deep Learning amidst Emerging Explainable AI and Transfer Learning

Artificial Intelligence (AI), Machine Learning (ML), and Deep Learning (DL) are revolutionizing hydrology, driving significant advancements in water resource management, modeling, and prediction. This review synthesizes cutting-edge developments, methodologies, and applications of AI-ML-DL across key hydrological processes. By critically evaluating these techniques against traditional models, we highlight their superior ability to capture complex, nonlinear relationships and adapt to diverse environments. We further explore AI applications in precipitation forecasting, evapotranspiration estimation, groundwater dynamics, and extreme event prediction (floods, droughts, and compound events), showcasing their timely potential in addressing critical water-related challenges. A particular emphasis is placed on Explainable AI (XAI) and transfer learning as essential tools for improving model transparency and applicability, enabling broader stakeholder trust and cross-regional adaptability. The review also addresses persistent challenges, including data limitations, computational demands, and model interpretability, proposing solutions that integrate emerging technologies like quantum computing, the Internet of Things (IoT), and interdisciplinary collaboration. This review charts a strategic course for future research and practice by bridging AI advancements with practical hydrological applications. Our findings highlight the importance of embracing AI-driven approaches for next-generation hydrological modeling and provide actionable understandings for researchers, practitioners, and policymakers. As hydrology faces escalating challenges due to human-induced climate change and growing water demands, the continued evolution of AI-integrated models and innovations in data handling and stakeholder engagement will be imperative. In conclusion, the findings emphasize the critical role of AI-driven hydrological modeling in addressing global water challenges, including climate change adaptation, sustainable water resource management, and disaster risk reduction.

Understanding explainable artificial intelligence techniques: a comparative analysis for practical application

Understanding explainable artificial intelligence techniques: a comparative analysis for practical application

A novel incremental ensemble learning for real-time explainable forecasting of electricity price

The development of a stable, safe, secure and sustainable energy future is a challenge for all countries these days. In terms of electricity price, its volatile nature makes its prediction a complex task. A precise real-time forecast of the electricity price can have significant consequences for the economy and risks faced. This work presents a new ensemble learning algorithm for making real-time predictions of electricity price in Spain. It combines long and short-term behavior patterns following an online incremental learning approach, keeping the model always up to date. The detection of novelties and unexpected behaviors in the time series streams allows the algorithm to provide more accurate predictions than the reference machine learning algorithms with which it is compared. In addition, the proposed algorithm predicts in real-time and the predictions obtained are interpretable, thus contributing to the Explainable Artificial Intelligence.

Comparative analysis of machine learning models and explainable AI for agriculture drought prediction: A case study of the Ta-pieh mountains

Comparative analysis of machine learning models and explainable AI for agriculture drought prediction: A case study of the Ta-pieh mountains

AI-driven anomaly detection in cloud computing environments

The rapid adoption of cloud computing has changed the way businesses manage and store data, but it has also introduced new security challenges. One of the most pressing concerns in cloud environments is the detection of anomalies, which can signal potential security breaches, system failures, or performance issues. Traditional anomaly detection methods often fall short due to the complexity, scalability, and dynamic nature of cloud infrastructures. In recent years, Artificial Intelligence (AI)-driven anomaly detection techniques, particularly those leveraging machine learning and deep learning, have shown promise in overcoming these limitations. This paper reviews AI-driven approaches to anomaly detection in cloud computing environments, exploring their applications in enhancing cloud security, optimizing performance, and ensuring efficient resource management. The paper examines the strengths of various AI techniques, including supervised and unsupervised learning, deep learning, and hybrid models, highlighting their capacity to detect complex, previously unknown anomalies. Despite their advantages, implementing AI-based systems in cloud environments presents challenges, including data quality issues, scalability concerns, and computational resource requirements. Solutions such as federated learning and model optimization techniques are explored as methods to address these challenges. Furthermore, the paper discusses future research directions, including the integration of AI-driven anomaly detection with emerging technologies like blockchain and IoT, and the potential for advancements in self-supervised learning and explainable AI (XAI). This review concludes by emphasizing the critical role of AI in securing cloud infrastructures and the promising future of anomaly detection in the cloud computing landscape.

EXplainable artificial intelligence (XAI) in business management research: a success/failure system perspective

PurposeeXplainable artificial intelligence (XAI) is an evaluation framework that allows users to understand artificial intelligence (AI) processes and increases the reliability of AI-produced results. XAI assists managers in making better decisions by providing transparency and interpretability in AI systems. This study explores the development of XAI in business management research.Design/methodology/approachThis study collects and analyzes business management research related to XAI using common management keywords as the basis. We used the success/failure system to explore its research guidelines XAI in business management.FindingsThe study found significant growth in XAI research within business management. This research will be discussed from various management disciplinary perspectives to help scholars understand the current research directions. Additionally, we utilize a success/failure system to explore how this theory can be applied to artificial intelligence and business management research.Originality/valueThe success/failure system offers a comprehensive framework encompassing the evolution of the cosmos, nature, and ecology. This theory can offer valuable insights for business management in XAI and competitive societies, governments, and enterprises, enabling them to formulate effective strategies for the future.

Biomechanics of Parkinson’s Disease with Systems Based on Expert Knowledge and Machine Learning: A Scoping Review

Patients with Parkinson’s disease (PD) can present several biomechanical alterations, such as tremors, rigidity, bradykinesia, postural instability, and gait alterations. The Movement Disorder Society–Unified Parkinson’s Disease Rating Scale (MDS-UPDRS) has a good reputation for uniformly evaluating motor and non-motor aspects of PD. However, motor clinical assessment depends on visual observations, which are mostly qualitative, with subtle differences not recognized. Many works have examined evaluations and analyses of these biomechanical alterations. However, there are no reviews on this topic. This paper presents a scoping review of computer models based on expert knowledge and machine learning (ML). The eligibility criteria and sources of evidence are represented by papers in journals indexed in the Journal Citation Report (JCR), and this paper analyzes the data, methods, results, and application opportunities in clinical environments or as support for new research. Finally, we analyze the results’ explainability and the acceptance of such systems as tools to help physicians, both now and in future contributions. Many researchers have addressed PD biomechanics by using explainable artificial intelligence or combining several analysis models to provide explainable and transparent results, considering possible biases and precision and creating trust and security when using the models.

Automating Abercrombie: Machine‐learning trademark distinctiveness

AbstractTrademark law protects marks to enable firms to signal their products' qualities to consumers. To qualify for protection, a mark must be able to identify and distinguish goods. US courts typically locate a mark on a “spectrum of distinctiveness”—known as the Abercrombie spectrum—that categorizes marks as fanciful, arbitrary, or suggestive, and thus as “inherently distinctive,” or as descriptive or generic, and thus as not inherently distinctive. This article explores whether locating trademarks on the Abercrombie spectrum can be automated using current natural‐language processing techniques. Using about 1.5 million US trademark registrations between 2012 and 2019 as well as 2.2 million related USPTO office actions, the article presents a machine‐learning model that learns semantic features of trademark applications and predicts whether a mark is inherently distinctive. Our model can predict trademark actions with 86% accuracy overall, and it can identify subsets of trademark applications where it is highly certain in its predictions of distinctiveness. Using an eXplainable AI (XAI) algorithm, we further analyze which features in trademark applications drive our model's predictions. We then explore the practical and normative implications of our approach. On a practical level, we outline a decision‐support system that could, as a “robot trademark clerk,” assist trademark experts in their determination of a trademark's distinctiveness. Such a system could also help trademark experts understand which features of a trademark application contribute the most toward a trademark's distinctiveness. On a theoretical level, we discuss the normative limits of the Abercrombie spectrum and propose to move beyond Abercrombie for trademarks whose distinctiveness is uncertain. We discuss how machine‐learning projects in the law not only inform us about the aspects of the legal system that may be automated in the future, but also force us to tackle normative tradeoffs that may be invisible otherwise.

The Future of Artificial Intelligence: Trends and Predictions

Artificial Intelligence (AI) has evolved rapidly, transforming diverse industries and societal functions. This paper provides a comprehensive overview of AI's current landscape, examining its advancements, applications, and ethical challenges. Key trends are explored, including innovations in machine learning and deep learning, AI’s expanding role across industries, and its potential for addressing climate change and sustainability. Furthermore, the paper highlights AI's role in enhancing human-machine collaboration, paving the way for systems that augment rather than replace human capabilities. Predictions for AI’s future are discussed, such as the emergence of artificial general intelligence (AGI), advancements in autonomous systems, the impact of quantum computing on AI, and innovations in AI-specific hardware. The paper also examines ethical and societal challenges, such as privacy, algorithmic bias, and the need for global governance, addressing the urgent call for responsible AI. In light of these trends, the paper emphasizes future research directions, encouraging interdisciplinary collaboration and a focus on explainable, robust, and resilient AI models. This work aims to shed light on the transformative potential of AI while advocating for ethical practices to ensure a positive and sustainable impact on society.

A Review on PDF Malware Detection: Toward Machine Learning Modeling with Explainability Analysis

The "PDF Malware Detection: Toward Machine Learning Modeling with Explainability Analysis" project aims to develop a machine learning model to detect malware embedded within PDF files, focusing on enhancing both detection accuracy and transparency. By leveraging explainable AI techniques, the model seeks not only to identify malicious PDFs but also to provide insights into the decision-making process, offering a clear understanding of the features contributing to the detection of potential threats. This project combines cybersecurity and machine learning to improve the safety of digital documents in a user-comprehensible way.

Using Explainable AI and Transfer Learning to Understand and Predict the Maintenance of Atlantic Blocking With Limited Observational Data

AbstractBlocking events are an important cause of extreme weather, especially long‐lasting blocking events that trap weather systems in place. The duration of blocking events is, however, underestimated in climate models. Explainable Artificial Intelligence are a class of data analysis methods that can help identify physical causes of prolonged blocking events and diagnose model deficiencies. We demonstrate this approach on an idealized quasigeostrophic (QG) model developed by Marshall and Molteni (1993), https://doi.org/10.1175/1520‐0469(1993)050<1792:taduop>2.0.co;2. We train a convolutional neural network (CNN), and subsequently, build a sparse predictive model for the persistence of Atlantic blocking, conditioned on an initial high‐pressure anomaly. Shapley Additive ExPlanation (SHAP) analysis reveals that high‐pressure anomalies in the American Southeast and North Atlantic, separated by a trough over Atlantic Canada, contribute significantly to prediction of sustained blocking events in the Atlantic region. This agrees with previous work that identified precursors in the same regions via wave train analysis. When we apply the same CNN to blockings in the ERA5 atmospheric reanalysis, there is insufficient data to accurately predict persistent blocks. We partially overcome this limitation by pre‐training the CNN on the plentiful data of the Marshall‐Molteni model, and then using Transfer learning (TL) to achieve better predictions than direct training. SHAP analysis before and after TL allows a comparison between the predictive features in the reanalysis and the QG model, quantifying dynamical biases in the idealized model. This work demonstrates the potential for machine learning methods to extract meaningful precursors of extreme weather events and achieve better prediction using limited observational data.

Explainable Pre-Trained Language Models for Sentiment Analysis in Low-Resourced Languages

Sentiment analysis is a crucial tool for measuring public opinion and understanding human communication across digital social media platforms. However, due to linguistic complexities and limited data or computational resources, it is under-represented in many African languages. While state-of-the-art Afrocentric pre-trained language models (PLMs) have been developed for various natural language processing (NLP) tasks, their applications in eXplainable Artificial Intelligence (XAI) remain largely unexplored. In this study, we propose a novel approach that combines Afrocentric PLMs with XAI techniques for sentiment analysis. We demonstrate the effectiveness of incorporating attention mechanisms and visualization techniques in improving the transparency, trustworthiness, and decision-making capabilities of transformer-based models when making sentiment predictions. To validate our approach, we employ the SAfriSenti corpus, a multilingual sentiment dataset for South African under-resourced languages, and perform a series of sentiment analysis experiments. These experiments enable comprehensive evaluations, comparing the performance of Afrocentric models against mainstream PLMs. Our results show that the Afro-XLMR model outperforms all other models, achieving an average F1-score of 71.04% across five tested languages, and the lowest error rate among the evaluated models. Additionally, we enhance the interpretability and explainability of the Afro-XLMR model using Local Interpretable Model-Agnostic Explanations (LIME) and Shapley Additive Explanations (SHAP). These XAI techniques ensure that sentiment predictions are not only accurate and interpretable but also understandable, fostering trust and reliability in AI-driven NLP technologies, particularly in the context of African languages.

Artificial Intelligence in Landscape Ecology: Recent Advances, Perspectives, and Opportunities

Abstract Purpose of Review Artificial intelligence (AI) is disrupting science and discovery across disciplines, offering new modes of inquiry that are changing how questions are asked and answered and upsetting established norms. In this paper, we review the state of the art of AI in landscape ecology and offer six areas of opportunity for landscape ecologists to capitalize on AI tools moving forward. These areas include geospatial AI (GeoAI), geometric AI, Explainable AI (xAI), generative AI (GenAI), Natural Language Processing (NLP), and robotics. Recent Findings Landscape ecology has a long history of using AI, notably machine learning methods for image classification tasks, agent-based modeling, and species distribution modeling but also knowledge representation and automated reasoning for landscape generation and spatial planning. Methods have become more diverse and complex in recent years, with a new generation of AI-based tools rapidly emerging. These new tools have potential to improve how landscape ecologists map, measure, and model landscape patterns and processes as well as improve the explainability of model outputs. Summary There are many untapped opportunities for landscape ecologists to leverage emerging AI-based tools in research and practice including generating virtual landscapes for simulating processes such as wildfires and leveraging natural language processing to generate new insights from text data. Regardless of the application, researchers using AI tools must also consider the ethical implications of data and algorithmic biases and critically assess how these methods can be used responsibly.

Role of Machine and Deep Learning Algorithms in Secure Intrusion Detection Systems (IDS) for IOT & Smart Cities

In this study the authors have examines various machine learning algorithms that could be used in IDS for making secure IoT and Smart Cities. The study examines various deep learning architectures of supervised, unsupervised, and semi-supervised learning methods to improve security and resource usage. Federated learning, edge computing, explainable AI, adversarial machine learning defense, and transfer learning are also explored for smart farming and IoT challenges. Machine learning has the potential to improve security and agricultural sustainability, but it must be researched and developed.