Human behaviour detection dataset (HBDset) using computer vision for evacuation safety and emergency management

Abstract

During emergency evacuation, it is crucial to accurately detect and classify different groups of evacuees based on their behaviours using computer vision. Traditional object detection models trained on standard image databases often fail to recognise individuals in specific groups such as the elderly, disabled individuals and pregnant women, who require additional assistance during emergencies. To address this limitation, this study proposes a novel image dataset called the Human Behaviour Detection Dataset (HBDset), specifically collected and annotated for public safety and emergency response purposes. This dataset contains eight types of human behaviour categories, i.e. the normal adult, child, holding a crutch, holding a baby, using a wheelchair, pregnant woman, lugging luggage and using a mobile phone. The dataset comprises more than 1,500 images collected from various public scenarios, with more than 2,900 bounding box annotations. The images were carefully selected, cleaned and subsequently manually annotated using the LabelImg tool. To demonstrate the effectiveness of the dataset, classical object detection algorithms were trained and tested based on the HBDset, and the average detection accuracy exceeds 90 %, highlighting the robustness and universality of the dataset. The developed open HBDset has the potential to enhance public safety, provide early disaster warnings and prioritise the needs of vulnerable individuals during emergency evacuation.