Web-based real-time multiview 3D display system

Abstract

In this paper, a new web-based multi-view 3D display system through the intermediate views synthesis using an adaptive disparity estimation algorithm is proposed and its performance is analyzed by comparison to those of the conventional disparity estimation algorithms. First, the feature value indicating the local image complexity is extracted from the input stereo sequences by using the edge detection and disparity estimation. Then, the matching window size for disparity estimation is adaptively selected depending on the magnitude of this feature value. This new approach is not only able to reduce the disparity vector mismatch encountered in the conventional dense disparity estimation with small matching window size, but is also able to reduce the blocking effect associated with the disparity estimation using a large matching window size. With some experimental results on a sequence of stereo image captured by the web-cameras, it is found that the adaptive algorithm improves PSNRs on the average in comparison with those of the conventional algorithms and multi-view images can be generated through the process of real-time IVS. Finally it is suggested that this approach can be applied to the web-based real-time 3D video communication system.