Immersive Interactive Virtual Fish Swarm Simulation Based on Infrared Sensors

Abstract

Virtual simulation and 3D interaction have shown great potentials in a variety of domains for our future life. For a virtual fish swarm simulation system, the simulation of cohesion behaviors of fish swarm and the interaction between human and fish swarm are two key components to create immersive interactive experiences. However, it is a huge challenge to create a realistic fish swarm simulation system while providing a natural and comfortable interaction. In this paper, we propose a method for immersive virtual fish swarm simulation based on infrared sensors. Based on dynamic weight constraints, we propose a particle swarm optimization method for fish swarm cohesion simulation, which separates a particle swarm by the state of each particle and dynamically controls the particle swarm, making the movement behavior of virtual fish more realistic. In addition, an interactive fast skinning method is proposed for cartoon fishes, which leverages image segmentation, Optical Character Recognition (OCR) and bone skinning are used to generate cartoon fishes based on user-created colors. With infrared sensors, we propose a method for virtual fish swarm interaction, where the positions of human skeleton are processed by an action analyzer, achieving real-time user interactions with fish swarms. With all the proposed techniques integrated in a system, the experimental results show that our method is feasible and effective.