Classification of Various Daily Behaviors in Lifelog Using Deep Learning

Abstract

In the information age, the analysis of human behavioral patterns is of significant interest, and extensive data collection is crucial in the context of privacy protection. From 2011 to 2023, the authors collaborated with more than 20 volunteers to construct and collect 30,791 lifelog using mobile devices; these lifelog included a sizable amount of multi-type data containing behavioral activity information, temporal location information, textual description information, and media images. In this paper, we propose a DCP-BiLSTM (Description + Cluster + Position) And Bidirectional Long-Short Term Memory (BiLSTM) personal big data behavior classification model for the lifelog dataset, which uses text description information + GPS information classified by DB-SCAN + location information, it is validated on Liulifelog to better address the behavior prediction problem of lifelog data. Unlike the traditional text classification approach, which is based on a unique lifelog dataset, BiLSTM can combine bidirectional semantic variables comprising description information and location information into the DCP-BiLSTM model. Evaluation of the DCP-BiLSTM demonstrates that can increase the performance and accuracy of behavior prediction, and the BiLSTM that incorporates description and location information to build, not only identifies daily user activity but also corrects the bias caused by manual analysis's one-sidedness and has greater prediction performance.