Level Data Fusion Research Articles

A compressor blade crack detection method based on the multilevel information fusion of acoustic and vibration signals

Single-signal crack detection methods perform unsatisfactorily in the presence of noise, prompting the need for alternative approaches. Leveraging multisource signals, which contain rich and complementary information, is a promising direction. In light of this, a compressor blade crack detection method based on the multilevel information fusion of acoustic and vibration signals is proposed. First, a multiscale data-level fusion convolutional neural network is designed, which fuses multisource homogeneous signals for crack detection. Second, multiple networks are trained with acoustic and vibration signals as inputs, respectively. Softmax layer of each network provides preliminary probabilities for each category, while the precision for each category in the validation set is calculated. Finally, an improved Dempster–Shafer theory approach is proposed to derive the final probability for each category according to the preliminary probabilities and precision, after which crack detection is realized. The proposed method is validated with experimental data from five categories of blades.

Feature-Level Fusion Multi-Sensor Aggregation Temporal Network for Smartphone-Based Human Activity Recognition

Smartphone-based Human Activity Recognition (HAR) identifies human movements using inertial signals gathered from multiple smartphone sensors. Generally, these signals are stacked as one (data-level fusion) and fed into deep learning algorithms for feature extractions. This research studies feature-level fusion, individually processing inertial signals from each sensor, and proposes a lightweight deep temporal learning model, Feature-Level Fusion Multi-Sensor Aggregation Temporal Network (FLF-MSATN), that performs feature extraction on inertial signals from each sensor separately. The raw signals, segmented into equally sized time windows, are passed into individual Dilated-Pooled Convolutional Heads (DPC Heads) for temporal feature analysis. Each DPC Head has a spatiotemporal block containing dilated causal convolutions and average pooling, to extract underlying patterns. The DPC Heads’ outputs are concatenated and passed into a Global Average Pooling layer to generate a condensed confidence map before activity classification. FLF-MSATN is assessed using a subject-independent protocol on a publicly available HAR dataset, UCI HAR, and a self-collected HAR dataset, achieving 96.67% and 82.70% accuracies, respectively. A Data-Level Fusion MSATN is built to compare and verify the model performance attained by the proposed FLF-MSATN. The empirical results show that implementing FLF-MSATN enhances the accuracy by ~3.4% for UCI HAR and ~9.68% for self-collected datasets.

Research on model transfer strategies based on the fusion of NIR-MIR spectral data

This study investigated the impact of different data fusion strategies on the performance of soluble solids content (SSC) prediction models based on near-infrared and mid-infrared spectroscopic techniques. In the data-level fusion approach, we applied standard normal variate and multiplicative scatter correction for pre-processing the NIR and MIR data. For the feature-level fusion, we utilized successive projections algorithm and competitive adaptive reweighted sampling to select informative wavelengths, and then applied direct orthogonal projection (DOP) for model transfer. The study employed a dataset of 150 honey samples to evaluate the impact of different data fusion strategies on model performance. To effectively evaluate model performance, we utilized the coefficient of R2 and RMSEP as evaluation metrics. By comparing the results of data-level fusion, feature-level fusion and single-spectrum model transfer, the results showed that spectral data fusion improved the model transfer performance compared to the single-spectrum approach, with feature-level fusion exhibiting the most significant advantages. The effective variable selection techniques in feature-level fusion successfully removed a substantial amount of interfering data and significantly reduced noise influence, thereby improving the model accuracy. Specifically, the use of feature-level fusion improved the predictive model’s R2 from 0.319 to 0.878 and reduced the RMSEP from 1.974 to 0.613°Brix, demonstrating the significant advantages of this approach in enhancing model transfer performance. The research findings provide important reference and theoretical support for future studies in the field of food quality assessment and other near-infrared spectroscopic data applications. This not only validates the effectiveness of the feature-level fusion approach, but also lays the foundation for establishing efficient and reliable predictive models.

Space Traffic Management: Data Fusion

This article provides an overview of and terminology associated with the topic of data fusion, especially as it relates to, and for the purposes of promoting space sustainability and enabling Space Traffic Coordination (STC) and Space Traffic Management (STM). First, the terminology and organizations (data contributors and aggregators) associated with data fusion is discussed. Next, the various “levels” of data fusion are delineated, and a detailed breakdown of the data levels associated with STC and STM (and indeed all space operations) is provided. The taxonomy of data required for safe collaborative space activities are detailed. And finally, data fusion is explored in the context of STC and STM, including the levels, techniques, data sources, and state representations used. And finally, the benefits and limitations of the various data fusion types and levels are outlined with practical examples provided.

Gearbox fault diagnosis based on RGT-MFFIN and multi-sensor fusion image generation

Abstract In gearbox fault diagnosis based on vibration and torque state data, traditional one-dimensional time-frequency domain analysis methods often suffer from insufficient feature expression and mining, and require complex noise reduction and filtering preprocessing. To address this issue, this paper proposes a fusion image generation method that integrates the advantages of recurrence plot (RP) and Gramian angular summation field (GASF) to generate recurrence Gramian transformed (RGT) images. This approach integrates both global and local fault information, making the fault characteristics more intuitive and easier to analyze. Given that multi-sensor collaboration can enhance feature representation, feature-level fusion increases the computational burden, and decision-level fusion is prone to losing inter-sensor correlation information, this paper adopts data-level fusion for image sample enhancement. In the diagnostic method, the challenge of traditional convolutional neural networks (CNNs) in extracting diverse geometric linear structures from fused images is addressed by introducing deformable convolutional blocks for initial feature extraction. Additionally, a multi-scale feature fusion interaction network (MFFIN) is constructed. This network incorporates a channel-space interactive attention mechanism on top of multi-scale feature extraction, assigning weights to features according to their importance while facilitating the interaction of feature information. Finally, validation is carried out using public datasets, and the experimental results show that the proposed method demonstrates significant advantages in classification accuracy and robustness under variable operating conditions and noise, thereby proving its effectiveness and practicality.

Multi-Source Image Fusion Based Regional Classification Method for Apple Diseases and Pests

Efficient diagnosis of apple diseases and pests is crucial to the healthy development of the apple industry. However, the existing single-source image-based classification methods have limitations due to the constraints of single-source input image information, resulting in low classification accuracy and poor stability. Therefore, a classification method for apple disease and pest areas based on multi-source image fusion is proposed in this paper. Firstly, RGB images and multispectral images are obtained using drones to construct an apple diseases and pests canopy multi-source image dataset. Secondly, a vegetation index selection method based on saliency attention is proposed, which uses a multi-label ReliefF feature selection algorithm to obtain the importance scores of vegetation indices, enabling the automatic selection of vegetation indices. Finally, an apple disease and pest area multi-label classification model named AMMFNet is constructed, which effectively combines the advantages of RGB and multispectral multi-source images, performs data-level fusion of multi-source image data, and combines channel attention mechanisms to exploit the complementary aspects between multi-source data. The experimental results demonstrated that the proposed AMMFNet achieves a significant subset accuracy of 92.92%, a sample accuracy of 85.43%, and an F1 value of 86.21% on the apple disease and pest multi-source image dataset, representing improvements of 8.93% and 10.9% compared to prediction methods using only RGB or multispectral images. The experimental results also proved that the proposed method can provide technical support for the coarse-grained positioning of diseases and pests in apple orchards and has good application potential in the apple planting industry.

The clinical and imaging data fusion model for single-period cerebral CTA collateral circulation assessment.

The Chinese population ranks among the highest globally in terms of stroke prevalence. In the clinical diagnostic process, radiologists utilize computed tomography angiography (CTA) images for diagnosis, enabling a precise assessment of collateral circulation in the brains of stroke patients. Recent studies frequently combine imaging and machine learning methods to develop computer-aided diagnostic algorithms. However, in studies concerning collateral circulation assessment, the extracted imaging features are primarily composed of manually designed statistical features, which exhibit significant limitations in their representational capacity. Accurately assessing collateral circulation using image features in brain CTA images still presents challenges. To tackle this issue, considering the scarcity of publicly accessible medical datasets, we combined clinical data with imaging data to establish a dataset named RadiomicsClinicCTA. Moreover, we devised two collateral circulation assessment models to exploit the synergistic potential of patients' clinical information and imaging data for a more accurate assessment of collateral circulation: data-level fusion and feature-level fusion. To remove redundant features from the dataset, we employed Levene's test and T-test methods for feature pre-screening. Subsequently, we performed feature dimensionality reduction using the LASSO and random forest algorithms and trained classification models with various machine learning algorithms on the data-level fusion dataset after feature engineering. Experimental results on the RadiomicsClinicCTA dataset demonstrate that the optimized data-level fusion model achieves an accuracy and AUC value exceeding 86% . Subsequently, we trained and assessed the performance of the feature-level fusion classification model. The results indicate the feature-level fusion classification model outperforms the optimized data-level fusion model. Comparative experiments show that the fused dataset better differentiates between good and bad side branch features relative to the pure radiomics dataset. Our study underscores the efficacy of integrating clinical and imaging data through fusion models, significantly enhancing the accuracy of collateral circulation assessment in stroke patients.

Comparison of data fusion strategies for automated prostate lesion detection using mpMRI correlated with whole mount histology

BackgroundIn this work, we compare input level, feature level and decision level data fusion techniques for automatic detection of clinically significant prostate lesions (csPCa).MethodsMultiple deep learning CNN architectures were developed using the Unet as the baseline. The CNNs use both multiparametric MRI images (T2W, ADC, and High b-value) and quantitative clinical data (prostate specific antigen (PSA), PSA density (PSAD), prostate gland volume & gross tumor volume (GTV)), and only mp-MRI images (n = 118), as input. In addition, co-registered ground truth data from whole mount histopathology images (n = 22) were used as a test set for evaluation.ResultsThe CNNs achieved for early/intermediate / late level fusion a precision of 0.41/0.51/0.61, recall value of 0.18/0.22/0.25, an average precision of 0.13 / 0.19 / 0.27, and F scores of 0.55/0.67/ 0.76. Dice Sorensen Coefficient (DSC) was used to evaluate the influence of combining mpMRI with parametric clinical data for the detection of csPCa. We compared the DSC between the predictions of CNN’s trained with mpMRI and parametric clinical and the CNN’s trained with only mpMRI images as input with the ground truth. We obtained a DSC of data 0.30/0.34/0.36 and 0.26/0.33/0.34 respectively. Additionally, we evaluated the influence of each mpMRI input channel for the task of csPCa detection and obtained a DSC of 0.14 / 0.25 / 0.28.ConclusionThe results show that the decision level fusion network performs better for the task of prostate lesion detection. Combining mpMRI data with quantitative clinical data does not show significant differences between these networks (p = 0.26/0.62/0.85). The results show that CNNs trained with all mpMRI data outperform CNNs with less input channels which is consistent with current clinical protocols where the same input is used for PI-RADS lesion scoring.Trial registrationThe trial was registered retrospectively at the German Register for Clinical Studies (DRKS) under proposal number Nr. 476/14 & 476/19.

In situ monitoring with melt pool data based on multi-signal fusion method in laser powder bed fusion

In situ monitoring technologies for additive manufacturing are severely affected by signal-to-defect spatial registration, and a single monitoring solution that captures a specific process signature cannot identify defects with sufficient accuracy in industrial applications. In this paper, a data partitioning method was proposed to reduce registration errors and facilitate the extraction of defect-related representative features from data segments. Then, three multi-signal fusion methods based on convolutional neural networks were established from feature-level fusion, decision-level fusion, and data-level fusion, which enhanced the signal-to-defect correlation by means of complementary sensor information. The results showed that the feature-level fusion obtained the optimal classification performance compared with the other two fusion strategies. Among them, the classification accuracies of 100-, 150-, 200-, 300-, 400-, and 500-μm defects reached 74.41%, 89.84%, 90.82%, 93.95%, 97.85%, and 98.83%, respectively. The proposed data fusion approach outperformed the individual signal-based models for quality classification.

A Condition Monitoring Method of Hydraulic Gear Pumps Based on Multilevel Mechanism-Data Fusion

Pumps are important components in aviation fuel hydraulic systems, and thanks to the development of sensor technology and industrial intelligence technology, it is possible to achieve efficient state monitoring of pumps. However, when data quality is poor or the amount of data is small, a single data-driven model may not be able to meet diagnostic accuracy. A condition monitoring method for hydraulic gear pumps based on mechanism-data fusion is proposed. The method combines a mechanism model based on the volumetric efficiency formula with a data-driven model based on vibration signals. First, the parameters of volumetric efficiency are solved by fitting the pressure–flow relationship. Subsequently, a multichannel fusion and multikernel function-weighted ensemble support vector classification (MCMK-SVC) is developed, to establish a data-driven model. Finally, through data-level fusion, feature-level fusion, and decision-level fusion, a condition monitoring model based on mechanism-data fusion is built. Experimental verification shows that the accuracy of the three levels of fusion models exceeds 96.9%. Compared to the single data-driven model or other traditional data-driven models, the accuracy of the proposed method has improved by 3% to 33%, demonstrating the effectiveness of the mechanism-data fusion model.

Classification of diverse plastic samples by LIBS and Raman data fusion

The plastic production and usage in the world is steadily increasing. This leads to increased amounts of plastic waste. Most of the waste could be potentially recycled, but only 14 % of plastic waste is recycled. In order to increase the share of recycling in plastic waste management, the recycling process should be completely automated. The problematic part of sorting is being solved by either manual (labor-intensive) or spectroscopy-based (still in development) methods. In this work, we propose the data fusion of Laser-Induced Breakdown Spectroscopy (LIBS) and Raman spectroscopy as a fast, robust, and reliable way to sort/classify any potential polymer material. The sample set of this work consists of several types of polymers in clear, colored, and even mixture versions. So far, no LIBS/Raman classification works involved all these categories in one experiment. Additionally, the low and medium level of data fusion is discussed, and the performance is compared. By using LIBS and Raman data fusion method and both linear and nonlinear chemometric techniques, increased accuracy reaching more than 98 % in the classification of investigated plastic samples was achieved, which was a significant improvement when compared with singular methods classification accuracy.

Radar target recognition based on data-level fusion of radar multi-dimensional information

Radar target recognition based on data-level fusion of radar multi-dimensional information

A two-level fusion model of vibro-acoustic signals for centrifugal fan blade crack detection

Blade crack detection is the key to ensuring the smooth and safe operation of centrifugal fans. However, a single vibration signal is difficult to fully reflect the health state of the blade and is susceptible to noise interference in the industrial field, which makes it difficult to detect blade cracks. Therefore, a two-level fusion model of vibro-acoustic signals is proposed for blade crack detection of centrifugal fans. Firstly, based on the designed correlated degree of cyclostationarity fusion rule, the data-level fusion of multi-source homogeneous vibro-acoustic signals is completed, and the fused signals with more obvious fault features are obtained. Then, a one-dimensional feature pyramid network is proposed to extract the vibro-acoustic features and generate initial decisions. Finally, a basic probability assignment acquisition method based on the precision of the initial classifiers and a weighted average method based on the Pignistic probability distance are proposed to minimize the conflict between multi-source evidence, and the Dempster-Shafer evidence theory method is used to obtain the blade crack detection results. The effectiveness of the proposed method is verified by the centrifugal fan blade crack detection experiments. Compared with other related methods, the proposed method has better detection performance and stronger robustness.

Deception Velocity-Based Method to Discriminate Physical Targets and Active False Targets in a Multistatic Radar System

Due to the silent operation of the receiver station in a multistatic radar system, it is difficult for the jammer to generate the cooperative active deception target for the multistatic radar system. Making use of the spatial diversity property, a data level fusion method is proposed to counter the active deception jamming in this paper. According to the spatial correlation difference in physical target and active false target motion states, the deception velocity of the physical target, which is obtained by the radial velocity of each receiver, obeys the Gaussian distribution with zero mean, and the one of the active false target obeys the Gaussian distribution with the mean being its true deception velocity. Based on this fact, the active false target and physical target are discriminated by the deception velocity testing. The proposed deception velocity-based (DVB) method can keep a constant misjudgment probability for physical targets and discriminate active false targets effectively, especially in large deception velocity cases. The simulation verifies the feasibility and validity of the proposed discrimination method. Moreover, the proposed method can be combined with the location information association method to enhance the ability to discriminate the range–velocity joint deception of false targets.

Multi-sensor data fusion framework for energy optimization in smart homes

Advancements in Internet of Energy (IoE) technologies drive the development of several energy efficient frameworks for better energy optimization, economic savings, safety, and security in smart homes. However, certain challenges such as real-time operational data for each micro-moment, proper application of data fusion techniques, and end-to-end computing and deployment architecture prevent the establishment of an effective energy-efficient framework to provide personalized energy-saving recommendations. This work presents energy management for smart spaces (EMSS), the proposed energy efficiency framework implemented in an edge-cloud computing platform that fuses data from heterogeneous data sources (environmental sensors, camera, plug data, etc.) at appropriate data fusion levels and process them to generate actionable, explainable, personalized, and persuasive recommendations at the right moment. The user response to the generated recommendations triggers the actuators to perform respective energy-saving actions and provide more personalized future recommendations. Further, SMARTHome - a data generation framework based on configurable scenario files and a set of software codes was proposed to generate synthetic data with respect to different building types and micro-moments. The functionalities of the EMSS (device and user registration), user dashboard, analytics, and energy-saving recommendations were made accessible to the user through web and mobile applications. The validation analysis of the EMSS was performed by (i) comparative analysis of the machine learning and deep learning algorithms used by the decision engine to generate energy-saving recommendations and (ii) benchmarking of EMSS based on the taxonomy of data fusion-based energy efficiency frameworks for smart homes.

Physical Activity Integration in Blood Glucose Level Prediction: Different Levels of Data Fusion.

Blood glucose level (BGL) prediction contributes to more effective management of type 1 diabetes. Physical activity (PA) is a crucial factor in diabetes management. It affects BGL, and it is imperative to effectively deploy PA in BGL prediction to support diabetes management systems by incorporating this crucial factor. Due to the erratic nature of PA's impact on BGL inter- and intra-patients and insufficient knowledge, deploying PA in BGL prediction is challenging. Hence, optimal approaches for PA fusion with BGL are demanded to improve the performance of BGL prediction. To address this gap, we propose novel methodologies for extracting and integrating information from PA data into BGL prediction. This paper proposes several novel PA-informed prediction models by developing different approaches for extracting information from PA data and fusing this information with BGL data in signal, feature, and decision levels to find the optimal approach for deploying PA in BGL prediction models. For signal-level fusion, different automatically-recorded PA data are fused with BGL data. Also, three feature engineering approaches are developed for feature-level fusion: subjective assessments of PA, objective assessments of PA, and statistics of PA. Furthermore, in decision-level fusion, ensemble learning is used to combine predictions from models trained with different inputs. Then, a comparative investigation is performed between the developed PA-informed approaches and the no-fusion approach, as well as between themselves. The analyses are performed on the publicly available Ohio dataset with rigorous evaluation. The results show that deploying PA can statistically significantly improve BGL prediction performance. The results show that deploying PA can statistically significantly improve BGL prediction performance. Also, among the developed approaches to leveraging PA in BGL prediction, fusing heart rate data at the signal-level and PA intensity categories at the feature-level with BGL data are the most effective ways. Our developed methodologies contribute to determining optimal approaches, including the kind of PA information and fusion method, to improve the performance of BGL prediction effectively.

MVMM: Multiview Multimodal 3-D Object Detection for Autonomous Driving

Object detection in 3D space is a fundamental technology in the autonomous driving system. Among the published 3D object detection methods, the single-modal methods based on point clouds have been widely studied. One problem exposed by these methods is that point clouds lack color and texture features. The limitation in conveying semantic information often leads to failures in detection. In contrast, the multi-modal methods based on the image and point clouds fusion may solve this problem, but relevant research is not sufficient. In this work, a single-stage multi-view multi-modal 3D object detector (MVMM) is proposed, which can naturally and efficiently extract semantic and geometric information from the image and point clouds. Specifically, the data-level fusion approach of point clouds coloring is used for combining information from the camera and LIDAR. Next, an encoder-decoder backbone is devised to extract features from colored points in the range view. Then, colored points are concatenated with the range view features, voxelized, and fed into the point view bridge for down-sampling. Finally, the down-sampled feature map is used by the bird's eye view backbone and the detection head for generating 3D results based on predefined anchors. According to extensive experiments on the KITTI dataset, MVMM achieves competitive performance while runs at 27 FPS on the 1080 Ti GPU. Particularly, MVMM performs extremely well in difficult scenes (e.g., heavy occlusion and truncation) due to the understanding of fused information.

MMAF-Net: Multi-view multi-stage adaptive fusion for multi-sensor 3D object detection

In this paper, we propose a 3D object detection method called MMAF-Net that is based on the multi-view and multi-stage adaptive fusion of RGB images and LiDAR point cloud data. This is an end-to-end architecture, which combines the characteristics of RGB images, the front view of point clouds based on reflection intensity, and the bird’s eye view of point clouds. It also adopts a multi-stage fusion approach of “data-level fusion + feature-level fusion” to fully exploit the strength of multimodal information. Our proposed method addresses key challenges found in current 3D object detection methods for autonomous driving, including insufficient feature extraction from multimodal data, rudimentary fusion techniques, and sensitivity to distance and occlusion. To ensure the comprehensive integration of multimodal information, we present a series of targeted fusion methods. Firstly, we propose a novel input form that encodes dense point cloud reflectivity information into the image to enhance its representational power. Secondly, we design the Region Attention Adaptive Fusion module utilizing an attention mechanism to guide the network in adaptively adjusting the importance of different features. Finally, we extend the 2D DIOU (Distance Intersection over Union) loss function to 3D and develop a joint regression loss based on 3D_DIOU and SmoothL1 to optimize the similarity between detected and ground truth boxes. The experimental results on the KITTI dataset demonstrate that MMAF-Net effectively addresses the challenges posed by highly obscured or crowded scenes while maintaining real-time performance and improving the detection accuracy of smaller and more difficult objects that are occluded at far distances.

Three-dimensional hybrid fusion networks for current-based bearing fault diagnosis

Abstract Intelligent fault diagnosis (IFD) techniques commonly use vibration-based measurements to perform health monitoring of critical rotating components in industrial systems. However, these vibration-based approaches may be limited in cost-sensitive applications, because the installation of vibration sensors is inconvenient and vibration sensors are expensive. Considering the difficulties of IFD using only current-related information from the motor current signal (MCS), this paper proposes a three-dimensional hybrid-fusion neural network (3D-HFN) that can automatically perform both data- and feature-level fusion of multi-phase current signals for MCS-based IFD of the rolling bearing. The 3D-HFN consists of the multivariate variational mode decomposition (MVMD) and an improved three-dimensional convolution neural network (3D-CNN). Firstly, MVMD is proposed to process multi-phase current signals, which adaptively acquire several intrinsic mode functions with mode-alignment properties. Subsequently, signal-to-image conversion and 3D stacking methods are used to construct 3D-like data in the current-phase dimension, which can fully preserve the interaction relationship between different phases using data-level fusion. Finally, an improved 3D-CNN with multiscale feature fusion and the smooth maximum unit is proposed to learn the 3D-like data and identify different health conditions for the rolling bearing. An open-source dataset with composite bearing faults is used to validate the merits of the proposed method. Experimental results show that the proposed approach has achieved more reliable diagnosis performance than other hand-crafted or 2D/3D-CNN-based algorithms in MCS-based IFD of the rolling bearing.

Explainable AI-based Alzheimer's prediction and management using multimodal data.

According to the World Health Organization (WHO), dementia is the seventh leading reason of death among all illnesses and one of the leading causes of disability among the world's elderly people. Day by day the number of Alzheimer's patients is rising. Considering the increasing rate and the dangers, Alzheimer's disease should be diagnosed carefully. Machine learning is a potential technique for Alzheimer's diagnosis but general users do not trust machine learning models due to the black-box nature. Even, some of those models do not provide the best performance because of using only neuroimaging data. To solve these issues, this paper proposes a novel explainable Alzheimer's disease prediction model using a multimodal dataset. This approach performs a data-level fusion using clinical data, MRI segmentation data, and psychological data. However, currently, there is very little understanding of multimodal five-class classification of Alzheimer's disease. For predicting five class classifications, 9 most popular Machine Learning models are used. These models are Random Forest (RF), Logistic Regression (LR), Decision Tree (DT), Multi-Layer Perceptron (MLP), K-Nearest Neighbor (KNN), Gradient Boosting (GB), Adaptive Boosting (AdaB), Support Vector Machine (SVM), and Naive Bayes (NB). Among these models RF has scored the highest value. Besides for explainability, SHapley Additive exPlanation (SHAP) is used in this research work. The performance evaluation demonstrates that the RF classifier has a 10-fold cross-validation accuracy of 98.81% for predicting Alzheimer's disease, cognitively normal, non-Alzheimer's dementia, uncertain dementia, and others. In addition, the study utilized Explainable Artificial Intelligence based on the SHAP model and analyzed the causes of prediction. To the best of our knowledge, we are the first to present this multimodal (Clinical, Psychological, and MRI segmentation data) five-class classification of Alzheimer's disease using Open Access Series of Imaging Studies (OASIS-3) dataset. Besides, a novel Alzheimer's patient management architecture is also proposed in this work.