Display Mode Research Articles

Further Comparison of 4 Display Modes for a Multi-Resolution Foveated Laparoscope.

Background. To overcome field of view and ergonomic limitations of standard laparoscopes, we are developing a multi-resolution foveated laparoscope (MRFL), which can simultaneously obtain both wide- and zoomed-in-view images. To facilitate the effectiveness of our MRFL, we have been investigating various ways of organizing and visualizing dual-view multi-resolution images acquired by the MRFL. In our prior study, we implemented and compared 6 display modes for the MRFL, assuming a typical clinical environment where a standard (but limited) resolution monitor is available. To take full advantage of our MRFL, displays having sufficient screen resolutions might be advantageous. The present study aims to further understand the effects of view configurations through displays with a standard high-definition (HD) resolution and a 4K resolution. In this study, we compare 3 display modes for limited-resolution displays against a new mode for sufficient-resolution displays. Methods. Twenty subjects performed 3 evaluation trials of a touching task with each display mode in an emulated MRFL environment. Various objective measurements including task completion time and the number of collisions, and subjective preference were recorded. Results. The new mode showed a better task completion time than the other modes, while it maintained a low number of collisions similar to the others. Moreover, the majority of participants selected the new mode as their most preferred one. Conclusions. With a sufficient display resolution, the co-registration between the unblocked and unwarped wide context view and the high-resolution zoomed-in view offered by the new mode was highly effective on both task performance and user preference.

Investigation of effect of different virtual reality environments on saccadic eye movement: Construct validity testing in healthy older adults

This paper describes two experiments designed to (1) ascertain whether the way in which architectural plans are displayed on a computer screen influences the quality of their correction by humans, and (2) identify the visual exploration strategies adopted in this type of task. Results of the first “spot the difference” experiment showed that superimposing the plans yielded better error correction performances than displaying them side by side. Furthermore, a sequential display mode, where the second plan only gradually appeared on the screen, improved error search effectiveness. In the second experiment, eye movement recordings revealed that superimposition increased plan comparison efficiency by making it easier to establish coreference between the two sources of information. The improvement in effectiveness in the sequential condition was shown to be linked to the attentional guidance afforded by this display mode, which helped users to make a more thorough exploration of the plans.

Retracted: VR Technology in Bluish- white Porcelain Display Design of Fanchang Kiln

With the world entering the new millennium, many rare cultural relics and architectural sites are in danger. It is very urgent and important to carry out rescue protection measures for some precious architectural heritages. This paper mainly studies the application of VR technology in the Bluish- white porcelain display design of Fanchang kiln. This paper analyzes the display elements of Bluish- white porcelain of Fanchang kiln from the principles and characteristics of Bluish- white porcelain display of Fanchang kiln, and discusses the characteristics of virtual display of Bluish- white porcelain of Fanchang kiln based on the characteristics of virtual display. The Bluish- white porcelain of Fanchang kiln is classified according to the use function, and the virtual display characteristics of different types of Fanchang kiln Bluish- white porcelain and their suitable virtual display mode are explored. Finally, combined with the panoramic image display technology and graphic VR display technology, the best virtual display mode suitable for different types of Fanchang kiln Bluish- white porcelain is made, and the interactive design is realized in the virtual software, and then the virtual display application is completed in the interactive projection of network and fixed occasions. Through the exploration of the virtual display mode of Fanchang kiln Bluish- white porcelain, the best virtual expression mode suitable for different types of Fanchang kiln Bluish- white porcelain is found. With the support of virtual reality technology, it realizes all-round browsing, scene roaming and information interaction of Fanchang kiln Bluish- white porcelain, providing an interactive platform for designers and consumers, so that the design can better meet the market demand, Improve efficiency. Experimental results show that the system runs smoothly in the application, and the user experience reaches more than 93.2%, which meets the actual application requirements.

2D/3D mixed frontal projection system based on integral imaging.

Two-dimensional (2D)/three-dimensional (3D) convertible or mixed display is one of the most important factors for the fast penetration of 3D display into the display market. In this paper, we propose a 2D/3D mixed frontal projection system that mainly contains a liquid crystal micro-lens array (LCMLA) and a quarter-wave retarding film with pinholes (QWRF-P). The LCMLA exhibits the focusing effect or no optical effect depending on the polarization direction of the incident lights. The forward incident lights pass through the LCMLA without any bending. After passing through the QWRF-P twice, half of the backward lights change the polarization direction with 90°, and the other half remains. Using our designed system, different display modes, including 2D display, 3D display, and 2D/3D mixed display, can be realized. The unique feature of the proposed 2D/3D mixed frontal projection system is that it can switch the display modes by simply changing the image sources without the need of any active optical devices. Moreover, the proposed system is compact, simple and space-efficient, which is suitable for the application in glassless 3D cinema and home 3D theatre.

P‐128: High‐SNR Fingerprinting Structure with Switchable Backlight for Liquid‐Crystal Displays

An optical fingerprinting solution with a switchable backlight is demonstrated for liquid crystal displays (LCDs). In fingerprinting mode, the collimated infrared light is applied to improve the signal‐noise ratio (SNR) between the valley and ridge of the fingerprint. Compare with the conventional backlight, the SNR of the proposed structure can be improved by 84%. Furthermore, the fingerprinting mode and the display mode may work at the same time without interference because of the different wavelength and light path. It shows the great potential application of LCD based optical fingerprint.

59‐1: FFS‐Based Privacy LCD with High Contrast and Transmittance

We have developed an FFS‐based LCD that can be switched between two display modes: 1) wide view mode with high contrast ratio and 2) narrow view mode enabling privacy. By combining the new LCD configuration with Soft Veil View technology, our 5.3‐inch prototype has successfully enabled: 1) enhanced optical properties and 2) privacy mode with a larger off‐axis area that prevents unauthorized image viewing.

Enhanced resolution of holographic stereograms by moving or diffusing a virtual pinhole array.

In this paper, two different display modes, the "pinhole mode" and the "lens mode" of the pinhole-type integral imaging (PII) based hologram are demonstrated by proper use of random phase. The performances of resolution, fill factor and image depth, of the two display modes are analyzed. Two different methods, the moving array lenslet technique (MALT) and the high-resolution elemental image array (EIA) encoding are introduced for the spatial resolution enhancement of the two display modes, respectively. Both methods enhance the spatial resolution without increasing the total pixel number or the space-bandwidth product (SBP) of the hologram. Both simulation and optical experiments verify that the proposed methods enhance the spatial resolution of PII-based hologram at a very low cost.

Voxel based evaluation of sequential radiotherapy treatment plans with different dose fractionation schemes.

This study presents a methodology for voxel-based evaluation of two phase sequential radiotherapy treatment plans having conventional dose scheme in the first phase and subsequent hypofractionation dose scheme in the second phase based upon different priority [planning target volume (PTV), clinical target volume (CTV) and organs at risk (OAR)] of display modes. A case of carcinoma prostate was selected for demonstration. Varian Eclipse treatment planning system (TPS) was used for contouring and planning. In the first phase, a dose of 52 Gy in 26 fractions to the PTV and in the second phase, a dose of 19.5 Gy in 3 fractions to the PTV Boost was planned on the same CT data set. Both the plans (Phase 1 and Phase 2) were exported and processed using "Voxel-based radiobiology display (VRb) tool". Plan Sum for Biologically effective dose (BED)-Cube and equivalent dose of 2Gy (EQD2)-Cube was reconstructed using a combination of linear quadratic (LQ) and linear quadratic-linear (LQ-L) radiobiological models. Tumor control probability (TCP) and normal tissue complication probability (NTCP) for different target volumes and organs were also calculated using EQD2-volume histograms of the Plan Sum. An in-house graphical user interface (GUI) is developed to present the qualitative and quantitative evaluation of the multiphase treatment plans with different display modes and dose regimens. The voxel based TCP obtained for the combined target volume was 90.56%. NTCP for the bladder and rectum was calculated from the Plan Sum histograms and found to be 0.33% and ~0.0% respectively. The proposed methodology using the VRb tool offers superior plan evaluation for multiphase sequential radiotherapy treatment plans over the existing methods. PTV, CTV and OAR priority based display modes in VRb tool offers better understanding of radiobiological evaluation of sequential radiotherapy treatment plans.

Digital images and in-person evaluation of Anthurium ‘Tropical’ postharvest quality

Abstract Accurate quality classification is one of the requirements of the flower market, which is becoming increasing more sophisticated and demanding. However, there is a lack of information regarding how such classification is performed, and it is often conducted in a less empirical and more subjective way. Therefore, this work aimed to compare the efficiency of personal classification (in-person) and using digital images to determine the quality of anthurium cv. Tropical (Anthurium andraeanum Lind.). Three experiments were performed regarding the recording of the images and the display mode of the images and comparing three methods of classifying postharvest quality of anthurium. It was concluded that measurements of colorimetric parameters can be performed anywhere on the spathe, but the period in which the parameters are measured does affect. Evaluators differ in the thoroughness with which they assign grades, and there is no need for prior knowledge to assess quality using images. The L* parameter measured by the colorimeter presented higher correlation with the evaluation of postharvest quality of Anthurium andraeanum Lind. ‘Tropical’. Classification by images can be performed using different electronic devices, and in-person classification is more rigorous than classification conducted using digital images.

High SNR fingerprinting structure for LC displays.

An optical fingerprinting solution with a switchable backlight is demonstrated for liquid crystal displays (LCDs). In fingerprinting mode, the collimated infrared light is applied to improve the signal-noise ratio (SNR) between the valley and ridge of the fingerprint. Compared with the conventional backlight, the proposed structure can effectively improve the SNR. Furthermore, the fingerprinting mode and the display mode may work at the same time without interference because of the different wavelengths and light paths. It shows the great potential application of LCD-based optical fingerprints.

Where to buy face masks? Survey of applications using Taiwan's open data in the time of coronavirus disease 2019.

Background:The coronavirus disease 2019 (COVID-19) had spread rapidly since late December 2019. Personal protective equipment was essential to prevent transmission. Owing to shortage of face masks, Taiwan government began to implement quasi rationing on February 6, 2020, by allowing each resident to purchase two masks in seven days. Taiwan National Health Insurance Administration offered online data with real-time updates on face mask availability in all contracted pharmacies and selected local health centers. Based on the open data, numerous software applications quickly emerged to assist the public in finding sales locations efficiently.Methods:Up until March 15, 2020, the Public Digital Innovation Space of Taiwan government had recorded 134 software applications of face mask availability, and 24 software applications were excluded due to defect, duplicate, and unavailability. These applications were analyzed according to platform, developer type, and display mode.Results:Of the 110 valid software applications, 67 (60.9%) applications were deployed on websites, followed by 21 (19.1%) on social networking sites, 19 (17.3%) as mobile applications, and 3 (2.7%) in other modes. Nearly two thirds (n = 70) of applications were developed by individuals, one third (n = 37) by commercial companies, only two applications by central and local governments, and one by a nongovernmental organization. With respect to the display mode, 47 (42.7%) applications adopted map-view only, 41 (37.3%) adopted table-view only, and 19 (17.3%) adopted both modes. Of the remaining three applications, two offered voice user interfaces and one used augmented reality.Conclusion:Taiwan’s open data strategy facilitated rapid development of software applications for information dissemination to the public during the COVID-19 crisis. The transparency of real-time data could help alleviate the panic of the public. The collaborative contributions from the grassroots in disasters were priceless treasures.

Spine Surgery Supported by Augmented Reality.

Study Design:A prospective, case-based, observational study.Objectives:To investigate how microscope-based augmented reality (AR) support can be utilized in various types of spine surgery.Methods:In 42 spinal procedures (12 intra- and 8 extradural tumors, 7 other intradural lesions, 11 degenerative cases, 2 infections, and 2 deformities) AR was implemented using operating microscope head-up displays (HUDs). Intraoperative low-dose computed tomography was used for automatic registration. Nonlinear image registration was applied to integrate multimodality preoperative images. Target and risk structures displayed by AR were defined in preoperative images by automatic anatomical mapping and additional manual segmentation.Results:AR could be successfully applied in all 42 cases. Low-dose protocols ensured a low radiation exposure for registration scanning (effective dose cervical 0.29 ± 0.17 mSv, thoracic 3.40 ± 2.38 mSv, lumbar 3.05 ± 0.89 mSv). A low registration error (0.87 ± 0.28 mm) resulted in a reliable AR representation with a close matching of visualized objects and reality, distinctly supporting anatomical orientation in the surgical field. Flexible AR visualization applying either the microscope HUD or video superimposition, including the ability to selectively activate objects of interest, as well as different display modes allowed a smooth integration in the surgical workflow, without disturbing the actual procedure. On average, 7.1 ± 4.6 objects were displayed visualizing target and risk structures reliably.Conclusions:Microscope-based AR can be applied successfully to various kinds of spinal procedures. AR improves anatomical orientation in the surgical field supporting the surgeon, as well as it offers a potential tool for education.

Effects of different non-driving-related-task display modes on drivers’ eye-movement patterns during take-over in an automated vehicle

Highly automated vehicles relieve drivers from driving tasks, allowing them to engage in non-driving-related-tasks (NDRTs). However, drivers are required to take over control in certain circumstances due to the limitations of highly automated vehicles. This study focused on drivers’ eye-movement patterns during take-overs when an NDRT (watching videos) was presented via a head-up-display (HUD) and a mobile device display (MDD), compared to no NDRT as the baseline. The experiment was conducted in a high-fidelity driving simulator with real-world driving videos scenarios. Forty-six participants took part in the experiment by completing three drives in three counterbalanced conditions (HUD, MDD and baseline). A take-over-request was issued towards the end of automated driving requesting drivers to stop the NDRT and take over control. Eye-movement data including pupil diameter, blinks, glance duration and number of AOI (Area of Interest) were collected and analysed. The results show that during automated driving, drivers were more engaged in the MDD NDRT with smaller pupil diameter and shorter glance duration on the front scenario compared to the HUD and baseline modes. The number of AOI was reduced during automated driving in both MDD and HUD modes. The take-over-request redirected drivers’ visual attention back to the driving task from NDRT by increasing drivers’ pupil diameter, glance duration and number of AOI. However, the effect of MDD NDRT on pupil diameter and glance duration continued even after the take-over-request when the NDRT was terminated. The study demonstrated HUD is a better display to help maintain drivers’ attention on the road.

Markerless cooperative augmented reality-based smart manufacturing double-check system: Case of safe PCBA inspection following automatic optical inspection

Augmented reality (AR) is a key technology anchored towards realizing Industry 4.0 smart manufacturing aims. In manufacturing inspection, AR has previously been employed to support operators in assessing thickness of manufactured parts, ship building, aircraft subassemblies and printed circuit board assemblies (PCBAs) with or without external markers in standalone head-mounted (HMD) or handheld systems. These AR systems often use optical see-through (OST) or video see-through (VST) technologies. Currently, cyber physical integration of processes in an industrial system synergizes production through increased efficiency and improved quality while facilitating customization. An operator manually double-checking/inspecting a product that has previously been automatically inspected can better rely on this existing defect location information once it is contextually and spatially overlaid within their field of view to intuitively and efficiently execute the task. Additional interactive information provided can quickly reorient a user, provide necessary contextual reference, and monitor progress of the task while alerting them of their safety. In this study, adopting an automatic optical inspection (AOI) wirelessly aided HMD-OST AR-based manual inspection system requiring no external markers for contextual registration is a promising direction towards smart and safe PCBA manufacturing in line with Industry 4.0. Animated rectangular bracket of high color contrast is employed to localize the spawned AOI defect point, an arrow overlaid with distance text provides user guidance, a contextual resizable image facilitates user double-checking and a progress bar tracks the inspection progress while monitoring tracking state. We evaluate the developed system's robustness, effectiveness of display technology used, suitability of contextual against static display modes, and display technology influence on various inspection attributes in a user study. Results demonstrate the system to be robust, OST-HMD outperforms handheld VST devices, contextual display mode to be significantly preferred to static mode, and display technology employed has no significant influence on the inspection attributes. Finally, registration precision results demonstrate usability of the system while superposition of distance to orientation information raises the inspection rate of PCBAs.

Computer-assisted navigation in complex cervical spine surgery: tips and tricks.

Stereotactic navigation is quickly establishing itself as the gold standard for accurate placement of spinal instrumentation and providing real-time anatomic referencing. There have been substantial improvements in computer-aided navigation over the last decade producing improved accuracy with intraoperative scanning while shortening registration time. The newest iterations of modeling software create robust maps of the anatomy while tracking software localizes instruments in multiple display modes. As a result, stereotactic navigation has become an effective adjunct to spine surgery, particularly improving instrumentation accuracy in the setting of atypical anatomy. This article provides an overview of stereotactic navigation applied to complex cervical spine surgery, details the means for registration and direct referencing, and shares our preferred methods to implement this promising technology.

Factored Occlusion: Single Spatial Light Modulator Occlusion-capable Optical See-through Augmented Reality Display.

Occlusion is a powerful visual cue that is crucial for depth perception and realism in optical see-through augmented reality (OST-AR). However, existing OST-AR systems additively overlay physical and digital content with beam combiners - an approach that does not easily support mutual occlusion, resulting in virtual objects that appear semi-transparent and unrealistic. In this work, we propose a new type of occlusion-capable OST-AR system. Rather than additively combining the real and virtual worlds, we employ a single digital micromirror device (DMD) to merge the respective light paths in a multiplicative manner. This unique approach allows us to simultaneously block light incident from the physical scene on a pixel-by-pixel basis while also modulating the light emitted by a light-emitting diode (LED) to display digital content. Our technique builds on mixed binary/continuous factorization algorithms to optimize time-multiplexed binary DMD patterns and their corresponding LED colors to approximate a target augmented reality (AR) scene. In simulations and with a prototype benchtop display, we demonstrate hard-edge occlusions, plausible shadows, and also gaze-contingent optimization of this novel display mode, which only requires a single spatial light modulator.

Depth sensitivity investigation on multi-view glasses-free 3D display

Compared with the 2-view 3D display, the multiview 3D display provides more views to the observers, which allows a stereoscopic perception relatively closer to real viewing condition. Depth sensitivity (DS) on multi-view 3D display has not been investigated with respect to view number and stimulus contents. A lenticular glasses-free 3D display with alternative view numbers (2 views and 28 views) was used as the test platform. Two types of stimulus were implemented for DS investigation, including random dot stereogram (RDS) and contour stereogram (CS). 20 adults (22.8 ±2.1 years old) with normal vision participated in the experiment. Experimental results showed that the DS on 2-view display mode was consistent with that measured with the conventional DS test (t-ratio = 0.2560, P=0.8569). Besides, the DS was significantly better for 28-view display mode, compared with 2- view display mode (t-ratio = 4.326, P<0.0001). For the influence of stimulus type, subjects were able to perceive more precise depth information with the RDS (t-ratio=2.023, P=0.0422), compared with the CS. The proposed investigation indicates that depth perception is closely related to view numbers and stimulus content, the proposed investigation provides essential cues for the choice of view numbers and contents to achieve the desired perception effect.

Research on Design and Experience of Immersive Virtual Reality Psychological Relaxation Game Based on Image

With the continuous progress of digital media technology and the rapid development of the game entertainment industry, people have put forward more demands on the display mode and immersion of games. Immersive stereoscopic display game based on game engine supports multi-machine and multi-projection display under various display environments, and has good stereoscopic effect and immersion feeling. The effect of psychological relaxation is highly related to immersive virtual reality environment. The relaxing effect in immersive environment is better than that in non-immersive environment. The more immersive the environment, the stronger the sense of presence, and the better the relaxing effect. With the improvement of virtual reality technology and the popularity of equipment, it provides a convenient and feasible way for the general public to obtain self-discipline of psychological relaxation. The effect of psychological relaxation is highly correlated with the immersive virtual reality environment. The relaxation effect in the immersive environment is better than that in the non-immersive environment. The more immersive the environment, the stronger the sense of presence and the better the relaxation effect.

Real Scene Pickup Method of Elemental Image Array Based on Convergent Camera Array

Limited available methods for the generation of an elemental image array (EIA) may be the most severe bottleneck for the promotion and application of integral imaging. To obtain rich information of three dimensional (3D) real scene at a relatively low cost, and solve the pseudoscopic problem in real display mode, we propose an EIA generation method based on convergent camera array through establishing the optical mapping model between the proposed method and the classical computer virtual generation method. We expound the basic principle of solving the pseudoscopic problem by changing the relative position of object and center of the convergent camera array in this paper. The experimental results indicate that the generated EIA can be displayed without the pseudoscopic problem in real display mode, relative position relationships of the objects in 3D real scene can also be accurately restored. Both preliminary optical experiments and the optical analysis are conducted to prove the feasibility and validity of the proposed method.

Video Key Frame Monitoring Algorithm and Virtual Reality Display Based on Motion Vector

In this article, a motion vector-based video key frame detection algorithm is proposed to solve the problem of miss election and missing selection caused by the difficulty in detecting the moving target characteristics of the video key frame. Firstly, the entropy of adjacent frame difference and the two-dimensional entropy of image are introduced, and the combination of the two is taken as the measurement of the difference between video frames. Secondly, outliers are detected by statistical tools to obtain the lens boundary, thus realizing the adaptive lens detection of video content. Then, ViBe algorithm is used to detect the foreground object in the video sequence and extract the scale-invariant feature transformation features of the foreground moving object. Finally, the motion vector is introduced, and the sum of the block matching results is motion vector by partitioning the two adjacent frames and performing block matching. The magnitude of motion vector reflects the intensity of motion in the video, so active and inactive motion regions are obtained, and the similarity of video frames is calculated according to the defined formula, and key frames are extracted in these regions respectively. The experimental results show that the detection algorithm proposed in this article improves the video results with rich motion information obviously, and the objective indexes and subjective scores are improved to some extent, which improves the universality of the algorithm. In addition, this article also studies the display mode of key frame extraction results in virtual reality environment. The key frame display mode of video in virtual reality is optimized mainly by changing the display mode of information and changing the scene and testing the result of user task execution.