In order to avoid the influence of external environmental factors on athletes’ physical fitness and technical tactics, the author proposes the design and research of an integrated simulation training system for athletes’ physical fitness and technical tactics based on virtual reality. The hardware unit of the design system includes a 3D scanner module, VR glasses module, locator module, tracker module, and wireless transceiver device. The software module introduces virtual reality technology and designs a visual simulation module, trained object detection module, trained object tracking module, and overall control module. The simulation experiment results show that compared with existing systems, the training scene output clarity and frame rate of the designed system are better, and the thread switching time and signal mixing time are shorter, which fully proves that the designed system has higher operating efficiency and better application performance.