Deep Neural Network-Based Indoor Emergency Awareness Using Contextual Information From Sound, Human Activity, and Indoor Position on Mobile Device

Abstract

Context-aware computing, which gathers information about the environment at a given time and adapts its behavior accordingly, can be effectively applied to a monitoring system that automatically detects and copes with emergency situations. In this paper, we propose an indoor emergency awareness alarm system using a deep neural network on a mobile device for at-risk people, such as the elderly and children. The proposed system detects emergency situations and quickly delivers the state of the person being monitored to a guardian using a mobile transmission system. To do this, three types of contextual information, including sound, human activity, and indoor location, are instantly recognized by the protected person’s mobile device. Both sound and human activity are used to improve the recognition accuracy of emergency situations provided to guardians’ mobile devices. Sound events are detected by a residual neural network, and human activities are recognized by applying the accelerometer and gyroscope signals of the mobile device to a deep spiking neural network. In addition, the indoor location where the emergency occurred is detected by the deep spiking neural network. The experimental results show the high accuracy of the indoor emergency awareness framework.