Abstract This paper takes the video of volleyball game collected by fixed camera as an example to study the moving targets in the volleyball video sequence, complete the prediction and tracking of volleyball and players, and trace the depiction. For moving objects tracking, firstly, the ID and location information on the objects blob is received through image segmentation. Secondly, tracking algorithm is a combination of centroid tracking algorithm and Kalman filter. The algorithm can provide players and volleyball object tracking. In the process of tracking, Kalman filter is imposed to forecast the motion information to improve the tracking precision. On the basis of the moving object tracking, this paper takes path generating the module to describe players tracks and preserve motion information. Based on the principle of double camera measure to reconstruct 3D information by two images taken from different angles at the same time, 3D information is used to match the volleyball trajectory. Experimental results show that the rate of accuracy of moving target tracking algorithm higher than 92%, the algorithm can realize the real-time and stable while ensuring the accuracy, providing the necessary basis for accurately video analysis.