A simple method for digital mixing of real and CG moving image sequences

Abstract

This paper presents a simple method for a digital moving image post-production task. The target task is to compose a digital moving image sequence by mixing synthetic 3-D computer graphics (CG) moving image sequences and real moving image sequences taken with video cameras. The digital mixing task of real and CG moving image sequences must play an increasingly important role especially in the two analogous new ideas of digital image post-production. The two new ideas are augmented reality (AR) and virtual reality (VR). In AR synthetic 3-D CG images of moving objects are superimposed on real moving image sequences taken with video cameras. In VR first the imagery of moving objects is extracted or recovered from real moving image sequences taken with video cameras, and then the images reproduced from the recovered imagery are introduced into the synthetic artificial 3-D CG environment generated on the computer, and thus the moving image sequences reproduced from the recovered imagery are superimposed on the synthetic 3-D CG moving image sequences. We examine the post-production approach to augmented reality.