Developing New Program Production Techniques Using the “Virtual Set” and the Motion Capture System at NHK

Abstract

The practical usage of the virtual set and the motion capture system have been of interest to numerous broadcasters. The combination of these systems is expected to be an attractive tool for realizing a diverse new type of content for television broadcast programs. — Utilizing the latest computer technologies, we at NHK have recently developed a real-time computer graphics production system which combines our “virtual set” and motion capture system. The virtual set creates three dimensional computer images which are synchronized with camera motion or zoom. These three dimensional images can be composited into live video images. The motion capture system maps actual real-time human body motion onto a computer generated human character using data collected from magnetic sensors attached to the body. — We describe our recent works in various broadcast program productions such as the 1995 Japanese House of Counselors Election Coverage and the NHK special series TV programs and discuss solutions for the various problems regarding hardware and software systems and real-time three dimensional production methods. We also discuss what new talents and skills for these new types of productions need to be fostered.