Development of a Wearable Camera and AI Algorithm for Medication Behavior Recognition.

Hwiwon Lee,Sekyoung Youm

doi:10.3390/s21113594

Abstract

As many as 40% to 50% of patients do not adhere to long-term medications for managing chronic conditions, such as diabetes or hypertension. Limited opportunity for medication monitoring is a major problem from the perspective of health professionals. The availability of prompt medication error reports can enable health professionals to provide immediate interventions for patients. Furthermore, it can enable clinical researchers to modify experiments easily and predict health levels based on medication compliance. This study proposes a method in which videos of patients taking medications are recorded using a camera image sensor integrated into a wearable device. The collected data are used as a training dataset based on applying the latest convolutional neural network (CNN) technique. As for an artificial intelligence (AI) algorithm to analyze the medication behavior, we constructed an object detection model (Model 1) using the faster region-based CNN technique and a second model that uses the combined feature values to perform action recognition (Model 2). Moreover, 50,000 image data were collected from 89 participants, and labeling was performed on different data categories to train the algorithm. The experimental combination of the object detection model (Model 1) and action recognition model (Model 2) was newly developed, and the accuracy was 92.7%, which is significantly high for medication behavior recognition. This study is expected to enable rapid intervention for providers seeking to treat patients through rapid reporting of drug errors.

Highlights

Digital innovation technologies, such as the internet of things (IoT), artificial intelligence (AI), mobile devices, big data, and the cloud, are combined with a medical system that has relied on analog technology
The smartwatch-based automatic medication behavior monitoring system developed by InHandPlus, Inc. (Seoul, Korea) is designed to enable automatic medication behavior analysis and customized healthcare services based on the user’s medication history data by applying AI technology
A digital medication management platform was developed by applying a smartwatch and AI technology for medication management to solve the problem of noncompliance with medication, which is a social issue

Summary

Introduction

Digital innovation technologies, such as the internet of things (IoT), artificial intelligence (AI), mobile devices, big data, and the cloud, are combined with a medical system that has relied on analog technology. Medical information is converted into digital data. Personalized medical services that analyze and use these data have begun to be provided [1]. The commercialization of 5G technology is expected to develop the digital healthcare market further. With the use of big data and the development of AI technology, the application possibilities in the field are endless, and the application of digital and AI technology is expected to create a new market in the medical information/system field, where the manual system still dominates [2]. Effective patient health tracking based on technology and wearable devices, reduction of false diagnosis rates by medical staff, and cost savings for medical institutions and pharmaceutical companies have been reported [3,4]

Objectives

Methods

Results

Conclusion