In response to the challenge of high cognitive pressure and difficulty for commanders in cross-layer operations during the transition from traditional two-dimensional command and control system interfaces to mixed reality human-computer interaction interfaces, this paper conducts research on the information fusion display method for the human-computer interaction interface of the mixed reality command and control system. First, based on the findings of previous research, we developed a five-layer human-computer interaction interface for a mixed reality command and control system in typical combat scenarios. An evaluation experiment was designed and the resulting data analyzed. This analysis revealed that there are problems with low work efficiency and high cognitive load in the information acquisition process in cross-layer interaction operations. Consequently, we conducted research into the methods of integrating and displaying interactive interface information, integrating and displaying interactive and display interface information, and integrating and displaying complex situation interface information. The research findings indicate that: (1) The optimal display ratio for mixed reality 2D interface integration is 3:2. (2) The optimal display scheme for mixed reality 2D interface fusion is a combination of the main and secondary interfaces, with the main interface table displaying global information and the secondary interface displaying accurate information. (3) The optimal display scheme for mixed reality 2D and 3D interface fusion is the display of overall class information in 2D and the accurate identification of class information in 3D. The findings of this research can be applied to the design of human-computer interaction interfaces for mixed reality command and control systems in complex battlefield environments.
Read full abstract