A spatial scene reconstruction framework in emergency response scenario

Abstract

Listen

Translate article

Rapid and accurate acquisition and analysis of information is crucial for emergency management, but traditional methods have limitations such as incomplete information acquisition and slow processing speed. The natural language oriented spatial scene reconstruction method provides a new solution for emergency management, but existing generative models have limited understanding of spatial relationships and lack high-quality training samples. To address these issues, this paper proposes a novel spatial scene reconstruction framework. Specifically, the BERT based spatial information knowledge graph extraction method is used to encode the input text, label and classify the encoded text, identify spatial objects and relationships in the text, and accurately extract spatial information. Additionally, a large number of manual experiments were conducted to explore quantitative biases in human spatial cognition, and based on the obtained biases, a greedy resolution method based on cost functions was used to fine tune the layout of conflicting spatial objects and solve the conflicting spatial information in the spatial information knowledge graph. Finally, use graph convolutional neural networks to obtain scene knowledge graph embeddings that consider spatial constraints. In addition, a high-quality training sample set of “text-scene-knowledge graph” was constructed.