Single Display Research Articles

Examining Potential User Experience Trade-Offs Between Common Computer Display Configurations.

To determine how ultrawide (UW) and dual displays configurations can influence neck biomechanics and performance compared to a single display. Studies have assessed neck kinematics and performance when using dual displays, but these studies have used screen sizes smaller than today's display size, have inconsistent participant placement, and few have assessed these two variables together. Seventeen participants completed five tasks on six display configurations. Neck kinematics and performance were tracked for each configuration. Centered configurations produced significantly different median neck rotation angles compared to secondary configurations (p < .001) for three of the tasks. A 34" curved UW display with a longer viewing distance produced similar neck kinematics to a single 24" display with the potential to also reduce screen interactions. When compared to single, the benefit of secondary versus centered monitors was dependent on the type of task being performed. Users may prefer the UW, centered dual, and secondary dual configurations over the single display. The benefit of secondary versus centered displays is dependent on the type of task being performed. Dual displays are still beneficial but should be used with a monitor arm to switch between centered and secondary configurations as necessary. Future work should look at larger UW displays to see if these results hold compared to dual display configurations. The results can be used to make evidence-based guidelines for displays based on size and task. Researchers can use this information to design future studies looking at specific configurations.

23‐1: Invited Paper: Single and Tandem OLED Display Technologies with High Efficiency and Long Lifetime

RGB side‐by‐side (SBS) top‐emission (TE) flexible OLED display with high efficiency and long lifetime has been developed for mobile and automotive applications. We have firstly developed a high reliability single‐type OLED display with a lifetime over 1,000 hours under 900 cd/m2 driving at 85 °C and with wide color gamut (over 110% of NTSC ratio). This is especially useful for the automotive displays. In addition, we have also focused on a blue TE tandem OLED for improving the current efficiency and achieved the blue index of 320 with two‐stacked tandem OLED. This is 1.6 times larger than that of the blue single‐type OLED.

Tandem Interactive Sensing Display De‐Convoluting Dynamic Pressure and Temperature

AbstractDespite great advances in stimuli‐interactive displays, which can directly visualize pressure, temperature, and humidity, a single interactive display platform capable of quantitatively discriminating the dynamic variation of two stimuli has yet to be developed. Here, a tandem interactive sensing display demonstrates not only direct visualization of both pressure and temperature but also the quantitative de‐convolution of these two simultaneously varied stimuli. The tandem display consists of five polymer layers vertically stacked on a transparent substrate: a temperature‐responsive ionic polymer, field‐induced blue light‐emitting unit (1), conductive polymer electrode with a parallel gap, field‐induced orange‐light‐emitting unit (2), and topologically structured pressure‐responsive layer. Impedance change of the responsive layers upon dynamic temperature and pressure is monitored simultaneously, providing stimuli‐interactive electroluminescence of light‐emitting units (1) and (2), respectively, when an alternating current (AC) field is applied between two polymer electrodes. Dynamic and simultaneous variation of temperature, 30–80 °C, and pressure, 0.5–20 kPa, are conveniently mapped in 3D coordinates of light intensity (z‐axis) and color (x‐y plane), producing a 2D contour surface plot. This provides an efficient and quantitative de‐convolution of unknown combinations of temperature and pressure stimuli. Furthermore, arrays of the tandem interactive displays broaden the versatility of dynamic visualization of multiple stimuli.

Research on FUI Style Design of Big Data Information Visualization

The purpose of the article is as follows, studying the FUI style of the interface for big data information visualization design among various styles of visualization interface in the 21st century. There are three research methods in this paper. Firstly, combing the concept of FUI and summarizing the design features of FUI style interface of big data information visualization from the perspective of design psychology. Secondly, the characteristics of government business big data information visualization and the needs of users are analyzed. Finally, the FUI design style is used in the government business big data information visualization display interface design. The FUI style presentation mode of big data information visualization and the dynamic interaction mode of FUI style interface are discussed. The conclusion is as follows, FUI is more in line with the people's psychological expectation of "future technology visual style" in big data information visualization display, highlighting the FUI data display focus on the prediction function of future events; FUI achieves visual balance through reasonable typesetting, comfortable color matching, uniform decorative shapes, etc. In terms of visual display, it not only meets the requirements of data display design, but also achieves the visual unity of partial data display design and overall data display. FUI mostly adopts flat design and simple dynamic interaction design, which conforms to users' gesture operation and people's visual browsing behavior habits in the era of mobile Internet, and meanwhile improves the utilization rate of single screen display of government departments.

MR and ultrasound cardiac image dynamic visualization and synchronization over Internet for distributed heart function diagnosis.

Dual-modality 4D cardiac data visualization can convey a significant amount of complementary image information from various sources into a single and meaningful display. Even though there are existing publications on combining multiple medical images into a unique representation, there has been no work on rendering a series of cardiac image sequences, acquired from multiple sources, using web browsers and synchronizing the result over the Internet in real time. The ability to display multi-modality beating heart images using Web-based technology is hampered by the lack of efficient algorithms for fusing and visualizing constantly updated multi-source images and streaming the rendering results using internet protocols. To address this practical issue, in this paper we introduce a new Internet-based algorithm and a software platform running on a Node.js server, where a series of registered cardiac images from both magnetic resonance (MR) and ultrasound are employed to display dynamic fused cardiac structures in web browsers. Taking advantage of the bidirectional WebSocket protocol and WebGL-based graphics acceleration, internal cardiac structures are dynamically displayed, and the results of rendering and data exploration are synchronized among all the connected client computers. The presented research and software have the potential to provide clinicians with comprehensive information and intuitive feedback relating to cardiac behavior and anatomy and could impact areas such as distributed diagnosis of cardiac function and collaborative treatment planning for various heart diseases.

Abstract 14656: Fusion of Fluoroscopy and Echocardiography During the Mitraclip® Procedure Reduces Time to Transseptal Puncture and Radiation Exposure

Introduction: Transseptal puncture (TSP) is an essential step in percutaneous structural heart interventions, such as the MitraClip® procedure. Radiation exposure is a hazard for Interventional Cardiologists, Echocardiographers, and patients. Advancements in shielding and radiation equipment have reduced this exposure, but further reduction is desired. EchoNav® (Philips) fuses fluoroscopy and echocardiography resulting in a single multimodal image display. Prior studies demonstrated reduced time to TSP with use of EchoNav® but failed to show significant reduction in radiation. We hypothesized that increased experience using EchoNav® would further decrease TSP time and radiation dose. Methods: Single center, retrospective analysis evaluated 202 patients undergoing MitraClip® procedure pre and post-EchoNav® from 6/2010 to 12/2019: 8 pre and 194 post. We measured time to TSP and radiation exposure by Air Kerma and dose area product (DAP). For the post-EchoNav® cases, we evaluated these variables by 2-year time periods to examine change over time. Results: Comparing pre and post-EchoNav ® procedures, time to TSP was non-significantly reduced overall (40.00±14.95 to 33.63±15.92, p=0.23). However, post-EchoNav ® had a decreasing trend (48.00±28.39, 43.47±15.86, 28.45±11.94, 27.55±10.64; R 2 =0.89, p =0.009) that was significantly less than pre-EchoNav ® by the third time period (40.00±14.95 vs 28.45±11.94, p=0.05) and remained less in the fourth (40.00±14.95 vs 27.55±10.64, p=0.03). Radiation was reduced post-EchoNav ® by both DAP (264.52±150.03 to 109.00±97.68) (p=0.02) and Air Kerma (1472.92±883.50 to 582.49±485.28) (p=0.05). Significant radiation reduction occurred by the third time period for Air Kerma (1472.92±883.50 vs 494.12±413,79, p=0.03) and second time period for DAP (264.52±150.03 to 127.51±110.35, p=0.03). Conclusion: These results suggest that use of EchoNav® has a learning curve, but ultimately reduces time to TSP and radiation.

Aligning Realities: Correlating Content between Projected and Head Worn Displays

Enabling the effective representation of an object’s position and depth in augmented reality (AR) is crucial not just for realism, but also to enable augmented reality’s wider utilization in real world applications. Domains such as architecture and building design cannot leverage AR’s advantages without the effective representation of position. Prior work has examined how the human visual system perceives and interprets such cues in AR. However, it has focused on application systems that only use a single AR modality, i.e., head-mounted display, tablet/handheld, or projection. However, given the respective limitations of each modality regarding shared experience, stereo display, field of view, etc., prior work has ignored the possible benefits of utilizing multiple AR modalities together. By using multiple AR systems together, we can attempt to address the deficiencies of one modality by leveraging the features of other modalities. This work examines methods for representing position in a multi-modal AR system consisting of a stereo head-mounted display and a ceiling mounted projection system. Given that the AR content is now rendered across two separate AR realities, how does the user know which projected object matches the object shown in their head-mounted display? We explore representations to correlate and fuse objects across modalities. In this paper, we review previous work on position and depth in AR, before then describing multiple representations for head-mounted and projector-based AR that can be paired together across modalities. To the authors’ knowledge, this work represents the first step towards utilizing multiple AR modalities in which the AR content is designed directly to compliment deficiencies in the other modality.

Foveated display system based on a doublet geometric phase lens.

We propose a new concept of a foveated display with a single display module. A multi-resolution and wide field of view (FOV) can be simultaneously achieved using only a single display, based on temporal polarization-multiplexing. The polarization-dependent lens set functions as an optical window or beam expander system depending on the polarization state, which can provide two operating modes: fovea mode for a high-resolution and peripheral mode for a wide viewing angle. By superimposing two-mode images, the proposed system supports a foveated and wide FOV image without an ultra-high-resolution display. We demonstrate the feasibility of the proposed configuration through the proof-of-concept system.

What eye movements reveal about strategy encoding of words in younger and older adults

ABSTRACTThe main goal of this study was to explore the organizational strategies used by younger and older adults when encoding words, using eye-tracking. Participants had to learn a set of organizable words and then a set of non-organizable words, each presented on a single display. Participants were then asked to recall the words of each set in the order in which they came to their mind. Hence, the participants’ encoding strategies revealed by eye-tracking could be directly related to their subsequent memory performance. The results confirmed the detrimental impact of aging on memory and the weaker use of organizational strategies by older adults during the recall phase. The eye-tracking data showed that when they encode the words, older adults do not look at them for as long as younger adults, probably because of slower eye movements. They also revealed that compared to younger adults, older adults were much less able to adapt their word scanning strategy according to whether the words to encode were organizable or not. Finally, the relationships that were found between the recall scores and the eye-tracking data suggest that the eye movement pattern at learning can predict how people will recall the words.

Abstract TP54: Visual Aids for Patient, Family, and Physician Decision Making About Late Imaging-Guided Endovascular Thrombectomy for Acute Ischemic Stroke

Background: Speedy decision-making is helpful for optimal outcomes from endovascular thrombectomy (EVT) for acute ischemic stroke (AIS). Visual displays may facilitate rapid review of relevant outcomes with different courses of action, but have not yet been developed for late-presenting patients selected for EVT based on multimodal CT or MR imaging. Methods: From pooled, study-level randomized trial (DAWN and DEFUSE 3) data, 100 person-icon arrays (Kuiper-Marshall personographs) were generated showing beneficial and adverse effects of endovascular thrombectomy for patients with acute cerebral ischemia and large vessel occlusion using (1) automated (algorithmic) and (2) expert-guided joint outcome table specification. Results: Among imaging-selected patients 6-24 hours from last known well, for the full 7-category modified Rankin Scale (mRS), endovascular thrombectomy had number needed to treat to benefit 1.9 (IQR 1.9-2.1) and number needed to harm 40.0 (29.2-58.3). Visual displays of treatment effects among 100 patients showed that, with EVT: 52 patients have better disability outcome, including 32 more achieving functional independence (mRS 0-2); 3 patients have worse disability outcome, including 1 more experiencing severe disability or death (mRS 5-6), mediated by symptomatic intracranial hemorrhage and infarct in new territory. The person-icon figure integrated these outcomes, and early side-effects, in a single display (Figure). Similar features were present in person-icon figures based on a 6-level mRS (levels 5 and 6 combined) rather than 7-level mRS, and giving special emphasis to normal or near-normal outcome (mRS 0-1) rather than functional independence (mR 0-2). Conclusion: Personograph visual decision aids are now available to rapidly educate patients, family, and healthcare providers on the benefits and risks of late, imaging-guided endovascular thrombectomy therapies for acute ischemic stroke.

Hairball Buster: A Graph Triage Method for Viewing and Comparing Graphs

Abstract Hairball buster (HB) (also called node-neighbor centrality or NNC) is an approach to graph analytic triage that uses simple calculations and visualization to quickly understand and compare graphs. Rather than displaying highly interconnected graphs as ‘hairballs’ that are difficult to understand, HB provides a simple standard visual representation of a graph and its metrics, combining a monotonically decreasing curve of node metrics with indicators of each node’s neighbors’ metrics. The HB visual is canonical, in the sense that it provides a standard output for each node-link graph. It helps analysts quickly identify areas for further investigation, and also allows for easy comparison between graphs of different data sets. The calculations required for creating an HB display is order M plus N log N, where N is the number of nodes and M is the number of edges. This paper includes examples of the HB approach applied to four real-world data sets. It also compares HB to similar visual approaches such as degree histograms, adjacency matrices, blockmodeling, and force-based layout techniques. HB presents greater information density than other algorithms at lower or equal calculation cost, efficiently presenting information in a single display that is not available in any other single display.

Wireless Displaying Device

The present invention relates to wireless displaying device for displaying a large number of information within a single display device. The main aim of this paper is to develop a cost-effective device that is capable of storing the large no. of information and control the data wirelessly. The information displayed on the device can be changed by sending a message through a mobile phone directly to the displaying device wirelessly

Diagnostics via partial residual plots in inverseGaussianregression

AbstractRegression diagnostics is the basic requirement to apply regression analysis to reach reliable conclusions. Generalized linear models also required diagnostics for its implementation. The construction of partial residuals using response residuals for the inverse Gaussian regression model is carried out to explore the structure and usefulness for visualizing diagnostics and curvature as a function of selected predictors. The current study established the performance of partial residual plots over conventional diagnostic methods. The comparison has been made using aerial biomass data and with the help of simulation study. It has been observed that partial residual plots provide much better diagnosis than do conventional methods. Moreover, multiple diagnostics in a single display provide better perceptive towards lack of fit, specification, and data anomalies.

A flexible technique to select objects via convolutional neural network in VR space

Most studies on the selection techniques of projection-based VR systems are dependent on users wearing complex or expensive input devices, however there are lack of more convenient selection techniques. In this paper, we propose a flexible 3D selection technique in a large display projection-based virtual environment. Herein, we present a body tracking method using convolutional neural network (CNN) to estimate 3D skeletons of multi-users, and propose a region-based selection method to effectively select virtual objects using only the tracked fingertips of multi-users. Additionally, a multi-user merge method is introduced to enable users actions and perception to realign when multiple users observe a single stereoscopic display. By comparing with state-of-the-art CNN-based pose estimation methods, the proposed CNN-based body tracking method enables considerable estimation accuracy with the guarantee of real-time performance. In addition, we evaluate our selection technique against three prevalent selection techniques and test the performance of our selection technique in a multi-user scenario. The results show that our selection technique significantly increases the efficiency and effectiveness, and is of comparable stability to support multi-user interaction.

Advanced hemodynamic monitoring in critically ill neonates

The neonatal circulation is unique due to the presence of fetal shunts. With the advances in biomedical technology, the assessment of sick newborn infants has improved significantly. It allows to collect, store and analyze the complex physiometric data and provides a foundation for advances in diagnosis and management of neonatal cardiovascular compromise. This could allow the clinician to have objective information to compliment the clinical assessment. Additionally, serial assessments and trending of measured parameters provides longitudinal information on disease pathophysiology and the response to treatment.The advanced hemodynamic monitoring however has to be structured and focussed to get the relevant information to compliment clinical signs and symptoms. It however has an inherent risk of inappropriate or over-treatment leading to a state of confusion. The following questions should thus be addressed at the outset:1. Objectives of assessment and goal of therapy2. Available techniques and processing information3. Point assessment vs continuous assessment4. Invasive monitoring vs non-invasive monitoringThe goal of hemodynamic monitoring is to optimise end-organ perfusion. The delivery of oxygen (DO2) depends on gas exchange, haematocrit, macrocirculation (preload, cardiac function and afterload) and microcirculation (capillary and end organ perfusion) (Table 1)1. The point-of-care functional echocardiography is helpful for initial assessment to complement continuous assessment techniques such as non-invasive continuous hemodynamic monitoring and in emergency situations of hemodynamic instability.When utilising these techniques, the limitations of individual devices and the interaction between them should be known. As compared to point-of-care assessment, when non-invasive monitoring devices are used, the trending of data from them with simultaneous single screen longitudinal display of values is helpful for diagnosis of disease and assessing response to treatment (Figure 1).2 The examples are continuous cardiac output, blood pressure, central venous pressure, pulse oximetry and near infrared spectroscopy. The trending of heart rate monitoring has already been utilised for early detection of sepsis using HeRO monitor. There has been interest in continuous amplitude integrated EEG but so far it is limited to research trials.We compared measurement of cardiac output with echocardiography with non-invasive cardiac output monitoring. We observed that absolute values were different but the trend on longitudinal assessment was comparable. This could be due to the fact that non-invasive cardiac output assessment methods utilise indirect techniques such as electric velocimetry, arterial pulse contour analysis etc. Using an example of a baby with septic shock, one can understand how the hemodynamic monitoring can guide initial management.3 BP = cardiac output (CO) x systemic vascular resistance (SVR) (Figure 2) 4 If a patient has low CO, high SVR and normal BP, the choice of treatment is inodilators e.g., milrinone. If CO, SVR and BP are all low, commence treatment with norepinephrine and add epinephrine. If high CO and low BP and SVR, give fluid bolus initially and titrate therapy.The integration of advanced hemodynamic monitoring in clinical care is akin to whole genome sequencing where a large amount of information is gathered which requires processing. Utilising this information is a challenge at present but it has the potential to open gateways for precision medicine.5

46.4: Compact Stereoscopic Augmented Reality Goggle with Single Display Panel

A light path for stereoscopic near eye display utilizing single display panel has been proposed and embedded in an existing snow goggle for AR display function with its original form factor and ID design intact. The prototype demonstrates sufficient quality to display numbers or symbols for data information or guiding.

Rb7SrY2(B5O10)3: A Rare-Earth Pentaborate with Moderate Second-Harmonic Response and Interesting Phase-Matching Behavior

Phase-matchable (PM) capacity is an indispensable factor in evaluating the applicable prospect of a new nonlinear optical crystal. Obtaining an accurate and credible PM curve by the Kurtz-Perry method using a small single crystal is indeed crucial. Here, we reported a new borate NLO crystal Rb7SrY2(B5O10)3 (I) and studied the influence of the arrangement of micro-[B5O10] groups on its birefringence. Interestingly, the synthesized polycrystalline powder and grinded single crystal display divergent PM and non-PM behavior, respectively. Combining theoretical calculations and analysis, I is demonstrated to be non-phase matchable for the second-harmonic generation (SHG) process of a 1064 nm laser.

App usage prediction for dual display device via two-phase sequence modeling

There have been many recent studies dealing with issues regarding app usage prediction. A number of smartphone manufacturers have recently released flexible dual display devices for multitasking purposes. In spite of many studies achieving higher levels of prediction accuracy, owing to certain practical limitations, they have not been effectively applied to real dual display devices. First, they trained their prediction model using only existing data collected from a single display device. Thus, they are unable to reflect the multitasking usage of dual display devices in their model prediction. In addition, previous studies have mostly been based on a Markov assumption, which needs to calculate the transition probability for all pairs of apps, which is difficult to calculate for newly installed apps. To address these limitations, we initially trained our prediction model using data collected from a single display during the first phase, and re-trained the prediction model using data collected from the prototype of a dual display device, which we developed along with LG Electronics, during the second phase. In addition, we applied an app prediction user interface to the prototype. Next, we applied a stacked long–short term memory architecture, a type of sequential deep learning architecture, to train the prediction model without calculating the transition probability. The experiment results show that our proposed method achieves an effective app usage prediction for dual display devices in a qualitative way, and outperforms all other approaches in quantitative experiments with top-3 and top-5 level accuracies. The reason for the higher performance of the proposed method is that it captures the real usage of a dual display and reflects multitasking use in its app usage prediction. In addition, we also verified the effects of a few variables such as the location, time, and two-phase training.

Single SLM full-color holographic three-dimensional video display based on image and frequency-shift multiplexing

A single spatial-light-modulator (SLM) full-color holographic 3-D video display based on image and frequency-shift multiplexing (IFSM) is proposed. In the frequency-shift multiplexing (FSM), three-color holograms are multiplied with their respective phase factors for shifted-separations of their corresponding frequency-spectrums on the Fourier plane. This FSM process, however, causes three-color images to be reconstructed at the center-shifted locations depending on their multiplied phase factors. Center-shifts of those color images due to the FSM can be balanced out just by generation of three-color holograms whose centers are pre-shifted to the opposite directions to those of the image shifts with the novel-look-up-table (NLUT) based on its shift-invariance property, which is called image-shift multiplexing (ISM). These image and frequency-shifted holograms are then multiplexed into a single color-multiplexed hologram and loaded on the SLM, and from which a full-color 3-D image can be reconstructed on the optical 4-f lens system without any color dispersion just by employing a simple pinhole filter mask. Fourier-optical analysis and experiments with 3-D objects in motion confirm the feasibility of the proposed system.

Investigating color appearance in optical see‐through augmented reality

AbstractColor appearance for real objects has been studied over decades and it has been well modeled. However, in augmented reality (AR) environments, virtual content is added to a real background and a mixed appearance is perceived. In this research, we studied color appearance in AR and investigated the applicability of the CAM16 color appearance model, one of the most comprehensive current color appearance models, in an AR environment. Using a benchtop optical mixing apparatus as an AR simulator, objective measurements of mixed colors in AR were performed. Then a psychophysical color matching experiment was performed with combinations of mixed foreground and background colors. The results showed that CAM16 is not accurate in predicting the color appearance in AR environment; therefore, it was modified with the addition of chromatic simultaneous contrast, resulting in an improved fit to the AR experiment data. A second psychophysical color matching experiment was performed on a single display to compare the color perception in AR with color perception in real world from a single display.