Display Surface Research Articles

P‐36: Touch Panel Display Filtering for Portable Night Vision Compatible Devices

AbstractA series of thick films has been developed using a colored polymeric for use on small and medium‐area displays requiring both touch compatibility and low Near Infrared (NIR) emissions. The films are designed to optimize energy emissions in the NIR with minimal degradation in sensitivity or color rendering while also maintaining the advantages of single and multi‐touch color displays.This paper attempts to touch upon the challenges to address in designing a filtering material for such application environments. The paper will also compare the advantages of these new generation materials to existing materials such as tacky polymers that often create undesired contact triggering, optical interference and contamination damage to the display surface.

Conformal Visualization for Partially-Immersive Platforms.

Current immersive VR systems such as the CAVE provide an effective platform for the immersive exploration of large 3D data. A major limitation is that in most cases at least one display surface is missing due to space, access or cost constraints. This partially-immersive visualization results in a substantial loss of visual information that may be acceptable for some applications, however it becomes a major obstacle for critical tasks, such as the analysis of medical data. We propose a conformal deformation rendering pipeline for the visualization of datasets on partially-immersive platforms. The angle-preserving conformal mapping approach is used to map the 360°3D view volume to arbitrary display configurations. It has the desirable property of preserving shapes under distortion, which is important for identifying features, especially in medical data. The conformal mapping is used for rasterization, realtime raytracing and volume rendering of the datasets. Since the technique is applied during the rendering, we can construct stereoscopic images from the data, which is usually not true for image-based distortion approaches. We demonstrate the stereo conformal mapping rendering pipeline in the partially-immersive 5-wall Immersive Cabin (IC) for virtual colonoscopy and architectural review.

Autocalibrating Tiled Projectors on Piecewise Smooth Vertically Extruded Surfaces

In this paper, we present a novel technique to calibrate multiple casually aligned projectors on fiducial-free piecewise smooth vertically extruded surfaces using a single camera. Such surfaces include cylindrical displays and CAVEs, common in immersive virtual reality systems. We impose two priors to the display surface. We assume the surface is a piecewise smooth vertically extruded surface for which the aspect ratio of the rectangle formed by the four corners of the surface is known and the boundary is visible and segmentable. Using these priors, we can estimate the display's 3D geometry and camera extrinsic parameters using a nonlinear optimization technique from a single image without any explicit display to camera correspondences. Using the estimated camera and display properties, the intrinsic and extrinsic parameters of each projector are recovered using a single projected pattern seen by the camera. This in turn is used to register the images on the display from any arbitrary viewpoint making it appropriate for virtual reality systems. The fast convergence and robustness of this method is achieved via a novel dimension reduction technique for camera parameter estimation and a novel deterministic technique for projector property estimation. This simplicity, efficiency, and robustness of our method enable several coveted features for nonplanar projection-based displays. First, it allows fast recalibration in the face of projector, display or camera movements and even change in display shape. Second, this opens up, for the first time, the possibility of allowing multiple projectors to overlap on the corners of the CAVE-a popular immersive VR display system. Finally, this opens up the possibility of easily deploying multiprojector displays on aesthetic novel shapes for edutainment and digital signage applications.

Real-Time Detection and Reading of LED/LCD Displays for Visually Impaired Persons.

Modern household appliances, such as microwave ovens and DVD players, increasingly require users to read an LED or LCD display to operate them, posing a severe obstacle for persons with blindness or visual impairment. While OCR-enabled devices are emerging to address the related problem of reading text in printed documents, they are not designed to tackle the challenge of finding and reading characters in appliance displays. Any system for reading these characters must address the challenge of first locating the characters among substantial amounts of background clutter; moreover, poor contrast and the abundance of specular highlights on the display surface - which degrade the image in an unpredictable way as the camera is moved - motivate the need for a system that processes images at a few frames per second, rather than forcing the user to take several photos, each of which can take seconds to acquire and process, until one is readable.We describe a novel system that acquires video, detects and reads LED/LCD characters in real time, reading them aloud to the user with synthesized speech. The system has been implemented on both a desktop and a cell phone. Experimental results are reported on videos of display images, demonstrating the feasibility of the system.

The WALL: participatory design workspace in support of creativity, collaboration, and socialization

A key challenge faced by organizations is to provide project teams with workspaces, information, and collaboration technologies that fosters creativity and high-performance team productivity. This requires understanding the relation between and impacts of (1) workspace, (2) activity and content that is created, and (3) social, behavioral, and cognitive aspects of work. This paper describes an exploratory study of everyday activities in the context of knowledge work in a shared workspace used by a high-tech global design team that explores future products. The study formalizes key elements for productive knowledge work as a function of tasks, context, and team. It identifies enablers, hindrances, and requirements for physical, virtual, and social work environments. The study identified, through semi-structured interviews, surveys, and on-site shadowing, a key workspace component that facilitates dynamic participation of all team members. This workspace component is a wall used as a large, public, physical display surface for project content (the WALL). The WALL acts as a mediator for individual reflection-in-action and team reflection-in-interaction. It serves as “social glue” both between individuals and between geographically distributed subgroups.

Optical See-Through Head Mounted Display Direct Linear Transformation Calibration Robustness in the Presence of User Alignment Noise

The correct spatial registration between virtual and real objects in optical see-through augmented reality implies accurate estimates of the user's eyepoint relative to the location and orientation of the display surface. A common approach is to estimate the display parameters through a calibration procedure involving a subjective alignment exercise. Human postural sway and targeting precision contribute to imprecise alignments, which in turn adversely affect the display parameter estimation resulting in registration errors between virtual and real objects. The technique commonly used has its origin in computer vision, and calibrates stationary cameras using hundreds of correspondence points collected instantaneously in one video frame where precision is limited only by pixel quantization and image blur. Subsequently the input noise level is several order of magnitudes greater when a human operator manually collects correspondence points one by one. This paper investigates the effect of human alignment noise on view parameter estimation in an optical see-through head mounted display to determine how well a standard camera calibration method performs at greater noise levels than documented in computer vision literature. Through Monte-Carlo simulations we show that it is particularly difficult to estimate the user's eyepoint in depth, but that a greater distribution of correspondence points in depth help mitigate the effects of human alignment noise.

라인형 레이저를 이용한 비전기반 차량용 폐오일필터 검출 시스템

There are so many successful applications to image processing systems in industries. In this study we propose a position detection system for used oil filter by using a line laser. We have been done on the development of line laser as interaction devices. A camera captures images of a display surface of a used oil filter and then a laser beam location is extracted from the captured image. This image is processed and used as a cursor position. We also discuss an algorithm that can distinguish the front part and rear part. In particular we present a robust and efficient linear detection algorithm that allows us to use our system under a variety lighting conditions, and allows us to reduce the amount of image parsing required to find a laser position by an order of magnitude.

Design and fabrication of an off-axis see-through head-mounted display with an x–y polynomial surface

An off-axis optical system with an x-y polynomial surface for a see-through head-mounted display (HMD) is presented. With the use of an x-y polynomial surface, an off-axis see-through HMD system with one tilted spherical combiner and six relay optical lenses is designed. An off-axis see-through HMD with a 15 mm exit pupil, a 40 degrees x 30 degrees FOV, and 70 mm eye relief is achieved. Furthermore, a binocular off-axis see-through HMD prototype is fabricated and the performance of the system is experimentally tested; 972 cd/m(2) of luminance is measured at the position of the exit pupil of the HMD. A typical augmented reality image captured outdoors with the HMD prototype is also demonstrated.

Scalable Multi‐view Registration for Multi‐Projector Displays on Vertically Extruded Surfaces

AbstractRecent work have shown that it is possible to register multiple projectors on non‐planar surfaces using a single uncalibrated camera instead of a calibrated stereo pair when dealing with a special class of non‐planar surfaces, vertically extruded surfaces. However, this requires the camera view to contain the entire display surface. This is often an impossible scenario for large displays, especially common in visualization, edutainment, training and simulation applications. In this paper we present a new method that can achieve an accurate geometric registration even when the field‐of‐view of the uncalibrated camera can cover only a part of the vertically extruded display at a time. We pan and tilt the camera from a single point and employ a multi‐view approach to register the projectors on the display. This allows the method to scale easily both in terms of camera resolution and display size. To the best of our knowledge, our method is the first to achieve a scalable multi‐view geometric registration of large vertically extruded displays with a single uncalibrated camera. This method can also handle a different situation of having multiple similarly oriented cameras in different locations, if the camera focal length is known.

31.3: A System LCD with Integrated 3‐Dimensional Input Device

AbstractWe present a System LCD with novel 3‐dimensional input device for use in next generation mobile products. The 3D input function is formed by a directional image sensor integrated onto the display TFT substrate and is used to detect the location of multiple objects above or on the display surface. In order to prove the concept of this novel technology, a 2.6“VGA System LCD incorporating the 3D input function was fabricated and tested. Measurement results confirm operation of the system and accurate detection of objects up to 20mm from the display surface.

A common approach to characterizing autostereoscopic and polarization‐based 3‐D displays

Abstract— Autostereoscopic and polarization‐based stereoscopic 3‐D displays recreate 3‐D images by providing different images in the two eyes of an observer. This aim is achieved differently for these two families of 3‐D displays. It is shown that viewing‐angle measurements can be applied to characterize both types of displays. Viewing‐angle luminance measurements are made at different locations on the display surface for each view emitted by the display. For autostereoscopic displays, a Fourier‐optics instrument with an ultra‐high‐angular‐resolution VCMaster3D is used. For polarization‐based displays, a standard Fourier‐optics instrument with additional glass filters is used. Then, what will be seen by an observer in front of the display is computed. Monocular and binocular quality criteria (left‐ and right‐eye contrast, 3‐D contrast) was used to quantify the ability to perceive depth for any observer position. Qualified monocular and binocular viewing spaces (QMVS and QBVS) are deduced. Precise 3‐D characteristics are derived such as maximum 3‐D contrast, optical viewing freedom in each direction, color shifts, and standard contrast. A quantitative comparison between displays of all types becomes possible.

Investigation of the effect of ambient lighting on contrast sensitivity using a novel method for conducting visual research on LCDS

The DICOM part 14 greyscale standard display function provides one way of harmonising image appearance under different monitor luminance settings. This function is based on ideal observer conditions, where the eye is always adapted to the target luminance and thereby also at peak contrast sensitivity. Clinical workstations are, however, often submitted to variations in ambient light due to a sub-optimal reading room light environment. Also, clinical images are inhomogeneous and low-contrast patterns must be detected even at luminance levels that differ from the eye adaptation level. All deviations from ideal luminance conditions cause the observer to detect patterns with reduced eye sensitivity but the magnitude of this reduction is unclear. A method is presented to display well-defined sinusoidal low-contrast test patterns on an liquid crystal display. The observers were exposed to light from three different areas: (i) the test pattern covering approximately 2 degrees x 2 degrees; (ii) the remaining of the display surface and (iii) ambient light from outside the display area covering most of the observers' field of view. By adjusting the luminance from each of these three areas, the observers' ability to detect low-contrast patterns under sub-optimal viewing conditions was studied. Ambient light from outside the display area has a moderate effect on the contrast threshold, except for the combination of high ambient light and dark objects, where the contrast threshold increased considerably.

Acoustics of technology enabled collaborative learning environments.

Collaborative classrooms and workstations are increasingly common in higher education buildings. These spaces present unique acoustical challenges that force designers to rethink traditional concepts and solutions. In student‐centered classrooms, the lecturer is removed as the visual and acoustical center of attention. Instead, students are seated in groups around technology enabled workstations, often facing away from the lecturer and other students. Acoustical conditions must support small‐group interaction, classroom discussion, and learning via multimedia content. Outside the classroom, collaborative workstations vary greatly, but typically facilitate small‐group interaction around a multimedia display and/or work surface. To promote impromptu use by students, these spaces are often open to highly public areas of learning commons, classroom buildings, and digital libraries. Traditional noise control solutions fail to isolate these spaces without compromising their spontaneous feel and function. Despite obvious acoustical challenges, both space types will continue to proliferate and new acoustical solutions must be developed.

BiDi screen

We transform an LCD into a display that supports both 2D multi-touch and unencumbered 3D gestures. Our BiDirectional (BiDi) screen, capable of both image capture and display, is inspired by emerging LCDs that use embedded optical sensors to detect multiple points of contact. Our key contribution is to exploit the spatial light modulation capability of LCDs to allow lensless imaging without interfering with display functionality. We switch between a display mode showing traditional graphics and a capture mode in which the backlight is disabled and the LCD displays a pinhole array or an equivalent tiled-broadband code. A large-format image sensor is placed slightly behind the liquid crystal layer. Together, the image sensor and LCD form a mask-based light field camera, capturing an array of images equivalent to that produced by a camera array spanning the display surface. The recovered multi-view orthographic imagery is used to passively estimate the depth of scene points. Two motivating applications are described: a hybrid touch plus gesture interaction and a light-gun mode for interacting with external light-emitting widgets. We show a working prototype that simulates the image sensor with a camera and diffuser, allowing interaction up to 50 cm in front of a modified 20.1 inch LCD.

Achieving eye contact in a one-to-many 3D video teleconferencing system

We present a set of algorithms and an associated display system capable of producing correctly rendered eye contact between a three-dimensionally transmitted remote participant and a group of observers in a 3D teleconferencing system. The participant's face is scanned in 3D at 30Hz and transmitted in real time to an autostereoscopic horizontal-parallax 3D display, displaying him or her over more than a 180° field of view observable to multiple observers. To render the geometry with correct perspective, we create a fast vertex shader based on a 6D lookup table for projecting 3D scene vertices to a range of subject angles, heights, and distances. We generalize the projection mathematics to arbitrarily shaped display surfaces, which allows us to employ a curved concave display surface to focus the high speed imagery to individual observers. To achieve two-way eye contact, we capture 2D video from a cross-polarized camera reflected to the position of the virtual participant's eyes, and display this 2D video feed on a large screen in front of the real participant, replicating the viewpoint of their virtual self. To achieve correct vertical perspective, we further leverage this image to track the position of each audience member's eyes, allowing the 3D display to render correct vertical perspective for each of the viewers around the device. The result is a one-to-many 3D teleconferencing system able to reproduce the effects of gaze, attention, and eye contact generally missing in traditional teleconferencing systems.

Myogenic induction of human mesenchymal stem cells by culture on dendrimer-immobilized surface with d-glucose display

Culture surfaces were designed by immobilizing dendrimer with d-glucose display, that is, 1st-generation (G1) and 3rd-generation (G3) dendrimer surfaces. In the cultures of human mesenchymal stem cells (hMSCs), the effect of the prepared culture surfaces was examined in terms of regulating cell morphology and differentiation. The time-lapse observation revealed that the cells on the G3 surface showed more dynamic behaviors of temporal stretching and contracting associated with stimulated migration, as compared with the cells on the G1 and plain surfaces. On the G3 surface, moreover, a frequency of round-shaped cells increased, and spreading of the cells was appreciably suppressed. From the cytoskeletal staining of F-actin, it was found that the immature stress fibers were of significance in the cells on the G3 surface. In addition, the cells on the G3 surface expressed RhoA inactivation and Rac1 activation during the culture, indicating that the G3 surface permits the regulation of RhoA and Rac1 expression associated with altering in cellular morphology and migratory behaviors. It was also found that desmin expression was, in particular, promoted on the G3 surface, thus supporting the consideration that a balance of Rho family GTPases activation induces myogenesis in hMSCs. The current results suggest that the dendrimer surface can be a potential tool for the guided differentiation of hMSCs directing to myocyte-like cells in the absence of an aqueous myogenesis-inducing factor.

41.2: Autostereoscopic Display Based on Enhanced Integral Photography Using Overlaid Multiple Projectors

AbstractWe constructed an autostereoscopic display based on enhanced IP using overlaid multiple projectors. The display provides autostereoscopic images whose resolution is greater than SVGA in an 800 by 400 mm area. Tilting the display surface increases the depth of the autostereoscopic images. We also constructed equipment for calibrating the display.

There and Back Again: Cross-Display Object Movement in Multi-Display Environments

ABSTRACT Multi-display environments (MDEs) are now becoming common, and are becoming more complex, with more displays and more types of display in the environment. One crucial requirement specific to MDEs is that users must be able to move objects from one display to another; this cross-display movement is a frequent and fundamental part of interaction in any application that spans two or more display surfaces. Although many cross-display movement techniques exist, the differences between MDEs—the number, location, and mixed orientation of displays, and the characteristics of the task they are being designed for—require that interaction techniques be chosen carefully to match the constraints of the particular environment. As a way to facilitate interaction design in MDEs, we present a taxonomy that classifies cross-display object movement techniques according to three dimensions: the referential domain that determines how displays are selected, the relationship of the input space to the display configuration, and the control paradigm for executing the movement. These dimensions are based on a descriptive model of the task of cross-display object movement. The taxonomy also provides an analysis of current research that designers and researchers can use to understand the differences between categories of interaction techniques.

Using an Interactive Display to Demonstrate Transportation Planning and Design Issues

An ongoing challenge worldwide has been to attract sufficient numbers of new people into transportation careers. When trying to understand what transportation engineering is about, many people often find that examples of practical applications are particularly useful. In this way, people acquire initial interest in a problem and then realize its real-world application to a career in transportation. Recently, funds donated to the University of Canterbury in New Zealand were used to develop an interactive transportation display board for both existing and prospective students. The display represents a landscape on which a new road route would be determined. The display surface is subdivided into hexagonal sections, each with a “cost” reflecting the relative difficulty of road construction in that location (e.g., due to mountains, rivers, or development). Magnetic road elements (each with a value reflecting the costs to road users) are then placed on the display to create a connection between the chosen endpoints. The intention is that the display's users determine the most optimal road alignment for minimizing construction costs, road user costs, or both. Since its creation, the display has been used at various sites, both on campus and at career expos, and has proven to be immensely popular with visitors. The display's potential as an educational tool for use in math, science, or geography classes has also been identified. This paper outlines the development of the display, its applications to date, and the transportation lessons the display can highlight.

The effect of stereoscopic viewing in a word‐search task with a layered background

Abstract— The benefits of stereoscopic viewing were explored in searching in words superimposed over a background. In the first experiment, eight participants searched for text in a normal 2‐D display, a 3‐D display using a parallax barrier, and a darkened 2‐D display of equivalent brightness to the 3‐D display. Word‐search performance was significantly faster for the bright 2‐D display vs. the 3‐D display, but when brightness was controlled, performance on the 3‐D display was better relative to the 2‐D (dim) display. In a second experiment, the effect of floating text vs. sinking background disparity was assessed across four background conditions. Twenty participants saw only the floating‐text (FT) condition and 20 participants saw only the sinking‐background (SB) condition. Performance of the SB group was significantly better than that of FT group, and the advantage of SB disparity was greater with the more‐complex backgrounds. Thus, when a parallax‐barrier 3‐D display is used to view text or other figural information overlaid on a background, it is proposed that the layer of primary interest (foreground) should be displayed with zero disparity (on the physical display surface) with the secondary layer (background) appearing to be sunk beneath that surface.