Video Synthesis at Tennis Player Viewpoint from Multiple View Videos

Abstract

In this paper, we propose a new method for synthesizing player-view from multiple videos in tennis. Our method is divided into two key techniques: virtual-view synthesis and player's view-point estimation. In the former technique, the existing method view interpolation, which is a technique of synthesizing images in an intermediate viewpoint from the real images in two view-points, restricts a viewpoint position between two viewpoints. To avoid this restriction, we propose a new method of the ability to set up a viewpoint position freely. In the latter, viewpoint position is computed from the center of gravity of a player region in captured videos using epipolar geometry. By applying the computed player's viewpoint to the former method, we can synthesize player-view image. Experimental results demonstrate that the proposed method can successfully provide tennis player-view video in tennis.