Local Interpretable Model-agnostic Explanations Research Articles

Transferring Black-Box Decision Making to a White-Box Model

In the rapidly evolving realm of artificial intelligence (AI), black-box algorithms have exhibited outstanding performance. However, their opaque nature poses challenges in fields like medicine, where the clarity of the decision-making processes is crucial for ensuring trust. Addressing this need, the study aimed to augment these algorithms with explainable AI (XAI) features to enhance transparency. A novel approach was employed, contrasting the decision-making patterns of black-box and white-box models. Where discrepancies were noted, training data were refined to align a white-box model’s decisions closer to its black-box counterpart. Testing this methodology on three distinct medical datasets revealed consistent correlations between the adapted white-box models and their black-box analogs. Notably, integrating this strategy with established methods like local interpretable model-agnostic explanations (LIMEs) and SHapley Additive exPlanations (SHAPs) further enhanced transparency, underscoring the potential value of decision trees as a favored white-box algorithm in medicine due to its inherent explanatory capabilities. The findings highlight a promising path for the integration of the performance of black-box algorithms with the necessity for transparency in critical decision-making domains.

A Deep Learning Approach for Chromium Detection and Characterization from Soil Hyperspectral Data

High levels of chromium (Cr) in soil pose a significant threat to both humans and the environment. Laboratory-based chemical analysis methods for Cr are time consuming and expensive; thus, there is an urgent need for a more efficient method for detecting Cr in soil. In this study, a deep neural network (DNN) approach was applied to the Land Use and Cover Area frame Survey (LUCAS) dataset to develop a hyperspectral soil Cr content prediction model with good generalizability and accuracy. The optimal DNN model was constructed by optimizing the spectral preprocessing methods and DNN hyperparameters, which achieved good predictive performance for Cr detection, with a correlation coefficient value of 0.79 on the testing set. Four important hyperspectral bands with strong Cr sensitivity (400–439, 1364–1422, 1862–1934, and 2158–2499 nm) were identified by permutation importance and local interpretable model-agnostic explanations. Soil iron oxide and clay mineral content were found to be important factors influencing soil Cr content. The findings of this study provide a feasible method for rapidly determining soil Cr content from hyperspectral data, which can be further refined and applied to large-scale Cr detection in the future.

FireXplainNet: Optimizing Convolution Block Architecture for Enhanced Wildfire Detection and Interpretability

The early detection of wildfires is a crucial challenge in environmental monitoring, pivotal for effective disaster management and ecological conservation. Traditional detection methods often fail to detect fires accurately and in a timely manner, resulting in significant adverse consequences. This paper presents FireXplainNet, a Convolutional Neural Network (CNN) base model, designed specifically to address these limitations through enhanced efficiency and precision in wildfire detection. We optimized data input via specialized preprocessing techniques, significantly improving detection accuracy on both the Wildfire Image and FLAME datasets. A distinctive feature of our approach is the integration of Local Interpretable Model-agnostic Explanations (LIME), which facilitates a deeper understanding of and trust in the model’s predictive capabilities. Additionally, we have delved into optimizing pretrained models through transfer learning, enriching our analysis and offering insights into the comparative effectiveness of FireXplainNet. The model achieved an accuracy of 87.32% on the FLAME dataset and 98.70% on the Wildfire Image dataset, with inference times of 0.221 and 0.168 milliseconds, respectively. These performance metrics are critical for the application of real-time fire detection systems, underscoring the potential of FireXplainNet in environmental monitoring and disaster management strategies.

Interpretable Landslide Susceptibility Evaluation Based on Model Optimization

Machine learning (ML) is increasingly utilized in Landslide Susceptibility Mapping (LSM), though challenges remain in interpreting the predictions of ML models. To reveal the response relationship between landslide susceptibility and evaluation factors, an interpretability model was constructed to analyze how the results of the ML model are realized. This study focuses on Zhenba County in Shaanxi Province, China, employing both Random Forest (RF) and Support Vector Machine (SVM) to develop LSM models optimized through Random Search (RS). To enhance interpretability, the study incorporates techniques such as Partial Dependence Plot (PDP), Local Interpretable Model-Agnostic Explanations (LIMEs), and Shapley Additive Explanations (SHAP). The RS-optimized RF model demonstrated superior performance, achieving an Area Under the Curve (AUC) of 0.965. The interpretability model identified the NDVI and distance from road as important factors influencing landslides occurrence. NDVI plays a positive role in the occurrence of landslides in this region, and the landslide-prone areas are within 500 m from the road. These analyses indicate the importance of improved hyperparameter selection in enhancing model accuracy and performance. The interpretability model provides valuable insights into LSM, facilitating a deeper understanding of landslide formation mechanisms and guiding the formulation of effective prevention and control strategies.

Exploring forest fire susceptibility and management strategies in Western Himalaya: Integrating ensemble machine learning and explainable AI for accurate prediction and comprehensive analysis

Forest fires pose a significant threat to ecosystems and socio-economic activities, necessitating the development of accurate predictive models for effective management and mitigation. In this study, we present a novel machine learning approach combined with Explainable Artificial Intelligence (XAI) techniques to predict forest fire susceptibility in Nainital district. Our innovative methodology integrates several robust models — AdaBoost, Gradient Boosting Machine (GBM), XGBoost and Random Forest — with a Deep Neural Network (DNN) as a meta-model in a stacking framework. This approach not only utilises the individual strengths of these models, but also improves the overall prediction performance and reliability. By using XAI techniques, in particular SHAP (SHapley Additive exPlanations) and LIME (Local Interpretable Model-agnostic Explanations), we improve the interpretability of the models and provide insights into the decision-making processes. Our results show the effectiveness of the ensemble model in categorising forest fire susceptibility into different zones: very low, low, moderate, high and very high. In particular, the stacking ensemble and XGBoost models identified extensive areas of high and very high susceptibility, with precision, recall and F1 values underpinning their effectiveness. These models achieved ROC AUC values above 0.90, with XGBoost performing exceptionally well with an AUC of 0.94. The precision, recall and F1 values for these models are remarkably high. The inclusion of confidence intervals for the most important metrics in all models emphasises their robustness and reliability and supports their practical use in forest fire management. Through SHAP summary plots, we analyze the global variable importance, revealing annual rainfall and Evapotranspiration (ET) as key factors influencing susceptibility. Local analysis using LIME consistently highlights the importance of annual rainfall, ET, and distance from roads across all models. This study fills an important research gap by providing a comprehensive and interpretable modelling approach that improves our ability to predict and effectively manage forest fire risk and is consistent with environmental protection and sustainable development goals.

XAI-FusionNet: Diabetic foot ulcer detection based on multi-scale feature fusion with explainable artificial intelligence

Diabetic foot ulcer (DFU) poses a significant threat to individuals affected by diabetes, often leading to limb amputation. Early detection of DFU can greatly improve the chances of survival for diabetic patients. This work introduces FusionNet, a novel multi-scale feature fusion network designed to accurately differentiate DFU skin from healthy skin using multiple pre-trained convolutional neural network (CNN) algorithms. A dataset comprising 6963 skin images (3574 healthy and 3389 ulcer) from various patients was divided into training (6080 images), validation (672 images), and testing (211 images) sets. Initially, three image preprocessing techniques - Gaussian filter, median filter, and motion blur estimation - were applied to eliminate irrelevant, noisy, and blurry data. Subsequently, three pre-trained CNN algorithms -DenseNet201, VGG19, and NASNetMobile - were utilized to extract high-frequency features from the input images. These features were then inputted into a meta-tuner module to predict DFU by selecting the most discriminative features. Statistical tests, including Friedman and analysis of variance (ANOVA), were employed to identify significant differences between FusionNet and other sub-networks. Finally, three eXplainable Artificial Intelligence (XAI) algorithms - SHAP (SHapley Additive exPlanations), LIME (Local Interpretable Model-agnostic Explanations), and Grad-CAM (Gradient-weighted Class Activation Mapping) - were integrated into FusionNet to enhance transparency and explainability. The FusionNet classifier achieved exceptional classification results with 99.05% accuracy, 98.18% recall, 100.00% precision, 99.09% AUC, and 99.08% F1 score. We believe that our proposed FusionNet will be a valuable tool in the medical field to distinguish DFU from healthy skin.

Global and local interpretability techniques of supervised machine learning black box models for numerical medical data

The most effective machine learning classification techniques, such as artificial neural networks, are not easily interpretable, which limits their usefulness in critical areas, such as medicine, where errors can have severe consequences. Researchers have been working to balance the trade-off between the model performance and interpretability. In this study, seven interpretability techniques (global surrogate, accumulated local effects, local interpretable model-agnostic explanations (LIME), Shapley additive explanations (SHAP), model agnostic post hoc local explanations (MAPLE), local rule-based explanation (LORE), and Contextual Importance and Utility (CIU)) were evaluated to interpret five medical classifiers (multilayer perceptron, support vector machines, random forests, extreme gradient boosting, and naïve bayes) using six model performance metrics and three interpretability technique metrics across six medical numerical datasets. The results confirmed the effectiveness of integrating global and local interpretability techniques, and highlighted the superior performance of global SHAP explainer and local CIU explanations. The quantitative evaluations of explanations emphasised the importance of assessing these interpretability techniques before employing them to interpret black box models.

Explainable Artificial Intelligence Approach for Diagnosing Faults in an Induction Furnace

For over a century, induction furnaces have been used in the core of foundries for metal melting and heating. They provide high melting/heating rates with optimal efficiency. The occurrence of faults not only imposes safety risks but also reduces productivity due to unscheduled shutdowns. The problem of diagnosing faults in induction furnaces has not yet been studied, and this work is the first to propose a data-driven framework for diagnosing faults in this application. This paper presents a deep neural network framework for diagnosing electrical faults by measuring real-time electrical parameters at the supply side. Experimental and sensory measurements are collected from multiple energy analyzer devices installed in the foundry. Next, a semi-supervised learning approach, known as the local outlier factor, has been used to discriminate normal and faulty samples from each other and label the data samples. Then, a deep neural network is trained with the collected labeled samples. The performance of the developed model is compared with several state-of-the-art techniques in terms of various performance metrics. The results demonstrate the superior performance of the selected deep neural network model over other classifiers, with an average F-measure of 0.9187. Due to the black box nature of the constructed neural network, the model predictions are interpreted by Shapley additive explanations and local interpretable model-agnostic explanations. The interpretability analysis reveals that classified faults are closely linked to variations in odd voltage/current harmonics of order 3, 11, 13, and 17, highlighting the critical impact of these parameters on the model’s prediction.

Explaining Misinformation Detection Using Large Language Models

Large language models (LLMs) are a compressed repository of a vast corpus of valuable information on which they are trained. Therefore, this work hypothesizes that LLMs such as Llama, Orca, Falcon, and Mistral can be used for misinformation detection by making them cross-check new information with the repository on which they are trained. Accordingly, this paper describes the findings from the investigation of the abilities of LLMs in detecting misinformation on multiple datasets. The results are interpreted using explainable AI techniques such as Local Interpretable Model-Agnostic Explanations (LIME), SHapley Additive exPlanations (SHAP), and Integrated Gradients. The LLMs themselves are also asked to explain their classification. These complementary approaches aid in better understanding the inner workings of misinformation detection using LLMs and lead to conclusions about their effectiveness at the task. The methodology is generic and nothing specific is assumed for any of the LLMs, so the conclusions apply generally. Primarily, when it comes to misinformation detection, the experiments show that the LLMs are limited by the data on which they are trained.

Interpretable intelligent fault diagnosis strategy for fixed-wing UAV elevator fault diagnosis based on improved cross entropy loss

The current popular machine learning-based fault diagnosis methods make it difficult to explain the diagnostic results, leading to low user trust in such diagnostic techniques. In this regard, this paper explores the study of the interpretability of intelligent fault diagnosis algorithms using the elevator of a fixed-wing unmanned aerial vehicle (UAV) as a diagnostic object. The Transformer model combines excellent modeling capability and efficient sequence data processing, is chosen to mine fault signal features to guarantee accurate diagnosis. Among the proposed interpretable fault diagnosis models, the local interpretable model-agnostic explanations (LIME) model is used to provide explicit interpretability for the decision-making process of the diagnosis model. In addition, a loss function called RDCE (reinforced diagnostic cross-entropy) Loss is designed to minimize the negative impact of different sample sizes for different fault types on the diagnostic performance. This loss function is designed to weigh the various types of faults to speed up the convergence of the model and improve the diagnostic accuracy. By comparing the proposed diagnostic strategy with other commonly used machine learning models, including long short term memory and recurrent neural network (RNN), the average diagnostic accuracy of the proposed diagnostic strategy is 99.97%, significantly better than that of the comparison algorithms. At the same time, this paper provides an in-depth interpretable analysis of the diagnostic process of the Transformer. The diagnostic process of the Transformer model gives the reasons for the diagnostic results from the point of view of the kind of features processed by the model. Based on this, the diagnostic model is simplified. After streamlining the number of features from 40 to 24 according to their importance, the diagnostic accuracy of the model is improved by 0.26%, and the diagnostic efficiency is improved. In addition, the proposed diagnostic strategy also shows significant advantages in terms of noise robustness.

Prediction of Cr(VI) and As(V) adsorption on goethite using hybrid surface complexation-machine learning model

This study aimed to develop surface complexation modeling-machine learning (SCM-ML) hybrid model for chromate and arsenate adsorption on goethite. The feasibility of two SCM-ML hybrid modeling approaches was investigated. Firstly, we attempted to utilize ML algorithms and establish the parameter model, to link factors influencing the adsorption amount of oxyanions with optimized surface complexation constants. However, the results revealed the optimized chromate or arsenate surface complexation constants might fall into local extrema, making it unable to establish a reasonable mapping relationship between adsorption conditions and surface complexation constants by ML algorithms. In contrast, species-informed models were successfully obtained, by incorporating the surface species information calculated from the unoptimized SCM with the adsorption condition as input features. Compared with the optimized SCM, the species-informed model could make more accurate predictions on pH edges, isotherms, and kinetic data for various input conditions (for chromate: root mean square error (RMSE) on test set = 5.90 %; for arsenate: RMSE on test set = 4.84 %). Furthermore, the utilization of the interpretable formula based on Local Interpretable Model-Agnostic Explanations (LIME) enabled the species-informed model to provide surface species information like SCM. The species-informed SCM-ML hybrid modeling method proposed in this study has great practicality and application potential, and is expected to become a new paradigm in surface adsorption model.

Unlocking Machine Learning Model Decisions: A Comparative Analysis of LIME and SHAP for Enhanced Interpretability

XAI is critical for establishing trust and enabling the appropriate development of machine learning models. By offering transparency into how these models make judgements, XAI enables researchers and users to uncover potential biases, admit limits, and eventually enhance the fairness and dependability of AI systems. In this paper, we demonstrates two techniques, LIME and SHAP, used to improve the interpretability of machine learning models. Assessing Explainable AI (XAI) approaches is critical in searching for transparent and interpretable artificial intelligence (AI) models. Explainable AI (XAI) approaches are designed to provide insight into how complex models make decisions. This paper thoroughly analyzes two prominent XAI methods: Shapley Additive explanations (SHAP) and Local Interpretable Model-agnostic Explanations (LIME). This study aims to understand the decision made by a machine learning model and how the model came to that decision. We discuss the approaches and framework of both LIME and SHAP and assess their behavior in predicting the model's outcome.

BMB-LIME: LIME with modeling local nonlinearity and uncertainty in explainability

The majority of eXplainable Artificial Intelligence (XAI) methods assume the local linearity of the decision boundary, leading to significant errors when dealing with non-linear local decision boundaries. Moreover, explanation methods relying on perturbation samples yield only a constant value for feature contributions. This study aims to overcome these limitations by introducing a novel explanation method that accurately captures non-linear local classification boundaries or regression splines while also quantifying the uncertainty associated with each feature contribution. Expanding upon the state-of-the-art XAI method, Local Interpretable Model-agnostic Explanations (LIME), we propose a nonlinear local explainer called BMB-LIME (Bootstrap aggregating Multivariate adaptive regression splines Bayesian LIME). BMB-LIME is constructed using weighted multivariate adaptive regression splines (MARS) with bootstrap aggregating and models the uncertainty of feature contributions within a Bayesian framework. Through a series of experiments, we demonstrate the superior performance of the BMB-LIME local explainer over baseline methods in terms of local fidelity and stability. Its adjusted r-squared is statistically significant by at least 80.5 percent, and it consistently demonstrates over 89.1 percent consistency in feature contribution and Jaccard similarity across diverse real-world and simulated datasets. The proposed method not only enhances fidelity and stability but also improves the measurement of uncertainty in explanations, thereby significantly contributing to the trustworthiness and transparency of XAI.

Sustainable energy transition in cities: A deep statistical prediction model for renewable energy sources management for low-carbon urban development

This study proposes a novel approach to sustainable energy transition in urban environments, focusing on the prediction and management of renewable energy outputs for low-carbon urban development. We introduce a new intelligent prediction model based on Gated Recurrent Unit (GRU) Networks to forecast the output power of both tidal and biomass units. The GRU model, known for its capability in capturing sequential dependencies, is employed to enhance the accuracy of renewable energy predictions in the context of urban sustainability. To address the interpretability challenges inherent in complex deep learning models, we leverage LIME (Local Interpretable Model-agnostic Explanations). By integrating LIME into our GRU-based prediction model, we enhance transparency and understandability. This approach facilitates the identification of key factors influencing predictions, providing stakeholders and decision-makers with valuable insights for effective sustainable energy management. The proposed hybrid model is applied to the digital model of real tidal and biomass sites in China, allowing for a statistical examination of renewable integration and energy management strategies. The results offer a comprehensive understanding of the dynamics between renewable energy sources and urban development, paving the way for informed decision-making in the pursuit of low-carbon and resilient cities. This research contributes to the broader discourse on sustainable urban development by offering a robust statistical framework for renewable energy integration and management in urban environments.

Unlocking Machine Learning Model Decisions: A Comparative Analysis of LIME and SHAP for Enhanced Interpretability

XAI is critical for establishing trust and enabling the appropriate development of machine learning models. By offering transparency into how these models make judgements, XAI enables researchers and users to uncover potential biases, admit limits, and eventually enhance the fairness and dependability of AI systems. In this paper, we demonstrates two techniques, LIME and SHAP, used to improve the interpretability of machine learning models. Assessing Explainable AI (XAI) approaches is critical in searching for transparent and interpretable artificial intelligence (AI) models. Explainable AI (XAI) approaches are designed to provide insight into how complex models make decisions. This paper thoroughly analyzes two prominent XAI methods: Shapley Additive explanations (SHAP) and Local Interpretable Model-agnostic Explanations (LIME). This study aims to understand the decision made by a machine learning model and how the model came to that decision. We discuss the approaches and framework of both LIME and SHAP and assess their behavior in predicting the model's outcome.

Advancing Educational Insights: Explainable AI Models for Informed Decision-Making

Abstract: Over the past two decades, the integration of machine learning (ML) techniques within educational frameworks has garnered significant attention. However, despite its widespread adoption, there remains a dearth of research focusing on developing AI systems with a core emphasis on interpretability and explainability. This paper seeks to bridge this gap by proposing an advanced framework that not only predicts students' performance accurately but also offers reliable and interpretable results tailored for career counseling. The framework merges the concepts of ML and Explainable AI (XAI) to address the complexities of career counseling in educational settings. Drawing inspiration from educational data mining, the framework aims to provide insights conducive to students' career growth and decision-making processes. By incorporating MLbased White and Black Box models, the approach analyzes a comprehensive educational dataset comprising academic and employability attributes crucial for job placements and skill development. To enhance interpretability, the framework leverages the NGBoost algorithm, known for its efficiency in prediction modeling. Additionally, it integrates Local Interpretable Modelagnostic Explanations (LIME) and Shapley Additive Explanations (SHAP) methods for providing both local and global explanations of model predictions, ensuring transparency and comprehensibility. Through a series of use cases, the paper showcases the applicability and effectiveness of the framework in providing actionable insights to educators and students alike. In conclusion, this research contributes to the advancement of career counseling in educational contexts by offering a robust and interpretable ML-based framework. By providing transparent insights into students' academic performance and career prospects, the approach facilitates informed decision-making and supports personalized guidance for optimal career trajectories.

A Time–Frequency Image Quality Evaluation Method Based on Improved LIME

Deep learning has the characteristics of high efficiency, high accuracy and low knowledge dependence, and has become a hot method in the research field of rotating machinery fault diagnosis. The time–frequency transform can show both the time and frequency characteristics of the vibration signal, so the time–frequency image is often used as the input of deep learning networks. At present, there are many time–frequency transform methods, and how to choose one is a problem worth discussing. This paper proposed a time–frequency image quality evaluation method based on improved local interpretable model-agnostic explanations (LIME). With the input of deep learning networks as the application background, this method evaluates the time–frequency image quality of rotating machinery vibration signals from two aspects: the accuracy of the diagnosis results and the consistency of the interpretation results with prior knowledge. The feasibility of the proposed evaluation method is verified by experiments on the measured data set, and engineers’ trust in the deep learning model is improved.

From pixels to prognosis: unveiling radiomics models with SHAP and LIME for enhanced interpretability

Radiomics-based prediction models have shown promise in predicting Radiation Pneumonitis (RP), a common adverse outcome of chest irradiation. Τhis study looks into more than just RP: it also investigates a bigger shift in the way radiomics-based models work. By integrating multi-modal radiomic data, which includes a wide range of variables collected from medical images including cutting-edge PET/CT imaging, we have developed predictive models that capture the intricate nature of illness progression. Radiomic features were extracted using PyRadiomics, encompassing intensity, texture, and shape measures. The high-dimensional dataset formed the basis for our predictive models, primarily Gradient Boosting Machines (GBM)—XGBoost, LightGBM, and CatBoost. Performance evaluation metrics, including Multi-Modal AUC-ROC, Sensitivity, Specificity, and F1-Score, underscore the superiority of the Deep Neural Network (DNN) model. The DNN achieved a remarkable Multi-Modal AUC-ROC of 0.90, indicating superior discriminatory power. Sensitivity and specificity values of 0.85 and 0.91, respectively, highlight its effectiveness in detecting positive occurrences while accurately identifying negatives. External validation datasets, comprising retrospective patient data and a heterogeneous patient population, validate the robustness and generalizability of our models. The focus of our study is the application of sophisticated model interpretability methods, namely SHAP (SHapley Additive exPlanations) and LIME (Local Interpretable Model-Agnostic Explanations), to improve the clarity and understanding of predictions. These methods allow clinicians to visualize the effects of features and provide localized explanations for every prediction, enhancing the comprehensibility of the model. This strengthens trust and collaboration between computational technologies and medical competence. The integration of data-driven analytics and medical domain expertise represents a significant shift in the profession, advancing us from analyzing pixel-level information to gaining valuable prognostic insights.

Machine learning in small sample neuroimaging studies: Novel measures for schizophrenia analysis.

Novel features derived from imaging and artificial intelligence systems are commonly coupled to construct computer-aided diagnosis (CAD) systems that are intended as clinical support tools or for investigation of complex biological patterns. This study used sulcal patterns from structural images of the brain as the basis for classifying patients with schizophrenia from unaffected controls. Statistical, machine learning and deep learning techniques were sequentially applied as a demonstration of how a CAD system might be comprehensively evaluated in the absence of prior empirical work or extant literature to guide development, and the availability of only small sample datasets. Sulcal features of the entire cerebral cortex were derived from 58 schizophrenia patients and 56 healthy controls. No similar CAD systems has been reported that uses sulcal features from the entire cortex. We considered all the stages in a CAD system workflow: preprocessing, feature selection and extraction, and classification. The explainable AI techniques Local Interpretable Model-agnostic Explanations and SHapley Additive exPlanations were applied to detect the relevance of features to classification. At each stage, alternatives were compared in terms of their performance in the context of a small sample. Differentiating sulcal patterns were located in temporal and precentral areas, as well as the collateral fissure. We also verified the benefits of applying dimensionality reduction techniques and validation methods, such as resubstitution with upper bound correction, to optimize performance.

Evaluation of the Relation between Ictal EEG Features and XAI Explanations.

Epilepsy is a neurological disease with one of the highest rates of incidence worldwide. Although EEG is a crucial tool for its diagnosis, the manual detection of epileptic seizures is time consuming. Automated methods are needed to streamline this process; although there are already several works that have achieved this, the process by which it is executed remains a black box that prevents understanding of the ways in which machine learning algorithms make their decisions. A state-of-the-art deep learning model for seizure detection and three EEG databases were chosen for this study. The developed models were trained and evaluated under different conditions (i.e., three distinct levels of overlap among the chosen EEG data windows). The classifiers with the best performance were selected, then Shapley Additive Explanations (SHAPs) and Local Interpretable Model-Agnostic Explanations (LIMEs) were employed to estimate the importance value of each EEG channel and the Spearman's rank correlation coefficient was computed between the EEG features of epileptic signals and the importance values. The results show that the database and training conditions may affect a classifier's performance. The most significant accuracy rates were 0.84, 0.73, and 0.64 for the CHB-MIT, Siena, and TUSZ EEG datasets, respectively. In addition, most EEG features displayed negligible or low correlation with the importance values. Finally, it was concluded that a correlation between the EEG features and the importance values (generated by SHAP and LIME) may have been absent even for the high-performance models.