Field-sequential Video Research Articles

Stereoscopic demultiplexing of field-sequential video

Much research has been devoted to investigating the generation of stereoscopic video based on catadioptric stereo systems. These systems, which utilize a proper combination of mirrors and lens, can capture stereoscopic video using only one camera. The left and right images are usually multiplexed to generate an interlaced video where each image corresponds to one field. This field-sequential format unavoidably reduces vertical resolution of the image pair by half. We proposed a notion called stereoscopic demultiplexing (SD) to recover the original resolution of the image pairs from the field-sequential video. To increase the sharpness of the image and avoid jagged artifacts, interpolation along the edge direction is emphasized. Because the SD problem is similar to deinterlacing, several methods previously used in deinterlacing were evaluated, and a new edge adaptive interpolation (EAI) approach was proposed. This new method can estimate edge direction with higher accuracy and obtain better image quality. Several experimental results show that the proposed algorithm outperforms the other popular deinterlacing methods both visually and quantitatively. Since resolution of the display technology is higher and better than that of current catadioptric stereo systems, we believe that further improvement in the resolution of the acquisition device by software is necessary to make 3-D applications more economical and popular.

3-D vision technology applied to advanced minimally invasive surgery systems.

Current-generation vision for laparoscopic surgery involves flat two-dimensional display on a video monitor; this approach makes it difficult to accurately place the tip of a surgical instrument in the three-dimensional real space of the patient. The surgeon must rely on motion parallax, monocular cues, and other indirect evidence of depth to judge accurately the correct spatial relationship of objects in the field of view. Stereoscopic video can return accuracy to the surgeon. Critical elements in creating stereovision are the biophysical laws governing field of view, focal point, depth of field, accommodation, and convergence. In addition, engineering constraints must be followed, such as fitting a 10-mm port, which are compatible with current systems and economic feasibility. There are two methods for 3-D vision under development which are variations on the same theme of modifying standard laparoscopes by using lenses, mirrors and prisms, and optical shuttering. One method uses two video cameras to simultaneous capture two separate images from a paired optical system. Each image is alternately transmitted to the video monitor (field sequential video) and viewed with electronic or polarizing glasses for a 3-D image. Another method uses a standard laparoscope, optically splits this one image into alternating right/left images, and reconstructs the image as above. A major challenge for both systems is that the distance between the optical elements in the laparoscope is not greater than 10 mm apart and fixed, whereas the human interpupillary distance is greater than 650 mm and can accommodate.(ABSTRACT TRUNCATED AT 250 WORDS)