An Incremental Naive Bayes Learner for Real-time Health Prediction

Abstract

Healthcare monitoring systems have improved with the Internet of Things and machine learning prediction models. Traditional batch machine-learning approaches cannot generate an effective model since most data will be continuous and real-time. Real-time medical data processing is challenging since the entire data is unavailable during prediction. Here, a continuous model adaptation based on incremental learning is demanded. The development of such a system can significantly improve patient outcomes and reduce healthcare costs. This paper proposes an Incremental Naive Bayes Learner that can handle concept drifts in data. The algorithm keeps a sliding window of data constantly updated as new data is added. The adaptive window size determines how much data is used to train the model at any given time. After processing each chunk of data, the algorithm calculates the model’s accuracy. The system detects a concept drift and dynamically updates the training set if the accuracy drops below a predefined threshold. We conducted a comparative evaluation of state-of-the-art batch and incremental learning algorithms on different medical datasets, demonstrating the impact of incremental learning. The results demonstrate the effectiveness of our approach: the Agrawal dataset achieved the highest accuracy at 66.6%, followed by Dialysis at 61.6%, while Liver and HCC achieved 50% and 58.3% accuracy, respectively. This approach ensures a sustained high level of accuracy in healthcare monitoring systems over time, even amidst concept drift.