3D Display System Research Articles

3D Multiview Holographic Display with Wide Field of View Based on Metasurface

Abstract3D display technology offers a more realistic visual experience by allowing users to perceive depth and spatial awareness, enhancing interactivity and immersion. Among various approaches, multiview display technology constructs 3D images by offering multiple smooth views along the horizontal plane. Metasurfaces, with ultra‐thin physical structures and flexible functional designs, are positioned to make significant contributions to the evolution of 3D display technologies. Here, a 3D multiview holographic display system based on metasurfaces is proposed. Using generalized Snell's law, a spatially multiplexed metasurface is designed with nine views and achieves 3D display by cascading the metasurface with a spatial light modulator (SLM). By projecting holograms onto different areas of the metasurface via the SLM, corresponding reconstructed images can be observed from specific designed directions. Thanks to the large numerical aperture (NA) of the metasurface, the system successfully achieves nine views within a 120° field of view (FOV, with a theoretical maximum of 180°), validated experimentally. This system promises potential applications in VR/AR display, surgical navigation, geographic information system (GIS), and other fields.

Assessing the surgical competency of novice surgeons by using a three-dimensional heads-up display microscope.

To evaluate the surgical performance of novice surgeons operating on a three-dimensional (3D) heads-up display system compared to those using a traditional microscope (TM). Prospective study design in a private practice setting. Twenty novice surgeons with similar experiences in cataract surgery were selected. Each surgeon performed 20 phacoemulsification cataract surgeries: 10 surgeries on the 3D heads-up display microscope, and 10 surgeries using a TM system. Data were collected from a total of 400 patients operated on by 20 surgeons. Outcome measures were recorded and graded according to the International Council of Ophthalmology's Ophthalmology Surgical Competency Assessment Rubric-Phacoemulsification system. The main outcome measure was mean surgical competency scores. Overall, 400 data points were equally distributed between TM (200) and 3D (200) surgeries. The mean surgical competency scores were 60.19 (11.41) for TM surgeries and 62.99 (11.11) for 3D surgeries. 3D surgeries had significantly higher surgical competency scores than TM surgeries ( P = 0.013). The mean surgical duration for TM and 3D surgeries was 35.98 (6.02) min and 34.31 (7.12) min, respectively. 3D surgeries took significantly less time than TM surgeries ( P = 0.012). The overall mean best corrected visual acuity in the logarithm of the minimum angle of resolution units was 0.27 (0.42); in TM and 3D surgeries, it was 0.28 (0.43) units and 0.26 (0.41) units, respectively. The 3D heads-up display system enhances stereopsis in cataract surgery, making it a valuable training tool for novice surgeons in phacoemulsification procedures.

P‐9.18: Driver of the Light Valve and Backlight in a 3D Display System

P‐9.18: Driver of the Light Valve and Backlight in a 3D Display System

Quality analysis of diffraction grating based 3D light field display system: Identifying optimal system parameters

Revealing the relationship between the parameters and display performance metrics is crucial to designing a high-quality three-dimensional (3D) light field display (LFD) system. However, there is currently no such analysis available for the diffraction grating (DG)-based 3D LFD system. In this paper, the light field mathematical model of the DG-based 3D LFD system is established and the influence of the main parameters of the DG-based 3D LFD system on the display quality is analyzed. A quality analysis methodology for the reconstructed light field of the DG-based 3D LFD system is proposed. This quality analysis methodology can be adopted as a design criterion for the DG-based 3D LFD system.

Comparison of 3D heads-up display system with conventional surgical microscopy for minimally invasive glaucoma surgery on an artificial eye model

ObjectifComparer un nouveau dispositif de visualisation tête haute en 3 dimensions (3D) au microscope chirurgical classique dans la chirurgie du glaucome à effraction minimale (MIGS, pour minimally invasive glaucoma surgery) sur un modèle d’œil artificiel et évaluer l'opinion des chirurgiens ophtalmologistes à cet égard. Matériel et MéthodesAinsi, 21 ophtalmologistes qui participaient au congrès annuel de la Société canadienne d'ophtalmologie de 2021 à Halifax (Nouvelle-Écosse) ont pris part à une activité de transfert des compétences de 90 minutes sur la MIGS. À l'aide d'un modèle d’œil artificiel (SimulEYE iTrack; InsEYE LLC, Westlake Village, Californie), les participants ont réalisé des MIGS à l'aide d'un dispositif de visualisation tête haute en 3D (Zeiss Artevo 800; Carl Zeiss Meditec, Iéna, Allemagne) et d'un microscope chirurgical classique. Par la suite, les participants et les formateurs ont rempli un formulaire de 16 questions en vue de comparer les 2 systèmes (dispositif de visualisation tête haute en 3D vs microscope chirurgical classique). Les réponses ont été enregistrées sur une échelle Likert double en 9 points s’échelonnant comme suit : de fortement en faveur du dispositif de visualisation tête haute en 3D (1) à fortement en faveur du microscope chirurgical classique (9). Le test U de Mann–Whitney pour analyse non paramétrique a servi à comparer les réponses des formateurs à celles des participants, de même que les réponses des experts à celles des novices. RésultatsLes réponses favorisaient le dispositif de visualisation tête haute en 3D par rapport au microscope chirurgical classique; pour l'ensemble des questions, elles variaient de 1 (fortement en faveur du dispositif de visualisation tête haute en 3D) à 5 (équivalence des dispositifs). Le test U de Mann–Whitney n'a pas relevé de différence significative entre les réponses des formateurs et celles des participants, ni entre celles les experts et des novices. La plupart des évaluations favorisant le dispositif de visualisation tête haute en 3D portaient sur la configuration ergonomique du modèle chirurgical, la profondeur de champ et/ou le champ d'observation de même que sur son utilité pour entraîner des résidents à réaliser des MIGS. Les évaluations qui indiquaient une équivalence entre le dispositif de visualisation tête haute en 3D et le microscope chirurgical classique portaient sur les défaillances du système et les décalages de l'image pendant la chirurgie. ConclusionsTous les ophtalmologistes, sans égard à leur degré d'expérience, ont préféré le dispositif de visualisation tête haute en 3D au microscope chirurgical classique pour réaliser une MIGS simulée. D'après les résultats du sondage, le recours au dispositif de visualisation tête haute en 3D permet d'enseigner efficacement la MIGS sur un modèle d’œil artificiel, surtout depuis l'avènement de la formation axée sur les compétences en ophtalmologie.

Viewing angle enhancement for integral imaging display using two overlapped panels.

Integral imaging three-dimensional (3D) display relies on display panel to provide visual information, but the intrinsic trade-off between the wide viewing angle and high resolution refrains its application in high-throughput 3D display. We propose a method to enhance the viewing angle without sacrificing the resolution by using two overlapped panels. The additionally introduced display panel is composed of two parts: the information area and the transparent area. The transparent area loaded with blank information enables light passing through without any modulation, while the opaque information area is loaded with element image array (EIA) for 3D display. The configuration of the introduced panel can block crosstalk from the original 3D display and establish a new and viewable perspective. Experimental results show that the horizontal viewing angle can be effectively extended from 8° to 16°, demonstrating the feasibility and effectiveness of our proposed method. This method provides the 3D display system with a higher space-bandwidth product, making it a potential technique to be applied for high information-capacity display, including integral imaging and holography.

Analytical model for three-dimensional light-field displays based on voxel construction

Three-dimensional light-field displays (3D-LFDs) can provide viewers with glass-free 3D images. The display effect of reconstructed 3D images is closely related to the number of 3D object points that the 3D display system can construct, which can be regarded as the information quantity of the 3D-LFDs. However, the information quantity presented by a 3D-LFD is limited by fixed hardware parameters such as display panels and optical components. It is difficult to present an ideal 3D visual experience with the increase in display depth. In this paper, an analytical model based on voxel construction for 3D-LFDs is proposed, which can estimate the information quantity that a 3D-LFD can reproduce. The variation regularity of information quantity with display depth is analyzed and the influence of hardware parameters on display effect is discussed. With the proposed strategies, the display effect can be improved in a targeted manner without blurring and aliasing by adjusting the hardware parameters in display systems and matching the information quantity at different display depths.

4: Wide‐Viewing Angle Integral Imaging 3D Display System Based on Aspherical Compound Lens Array

4: Wide‐Viewing Angle Integral Imaging 3D Display System Based on Aspherical Compound Lens Array

High-Quality Holographic 3D Display System Based on Virtual Splicing of Spatial Light Modulator

High-Quality Holographic 3D Display System Based on Virtual Splicing of Spatial Light Modulator

P‐7.20: Depth‐enhanced Integral Imaging 3D Display System

A depth-enhance integral imaging (InIm) 3D display system is proposed. Two InIm 3D displays that are placed vertically and be used in the proposed system by combining a transmissive mirror device (TMD) and a semi-transparent mirror (STM) to enhance the depth. Due to the distance between the two InIm 3D displays and the TMD is different, so the 3D display proposed achieves the extension of depth of field (DOF). The experimental results demonstrate the validity of our proposed system.

3D Point Cloud Generation Based on Multi-Sensor Fusion

Traditional precise engineering surveys adopt manual static, discrete observation, which cannot meet the dynamic, continuous, high-precision and holographic fine measurements required for large-scale infrastructure construction, operation and maintenance, where mobile laser scanning technology is becoming popular. However, in environments without GNSS signals, it is difficult to use mobile laser scanning technology to obtain 3D data. We fused a scanner with an inertial navigation system, odometer and inclinometer to establish and track mobile laser measurement systems. The control point constraints and Rauch-Tung-Striebel filter smoothing were fused, and a 3D point cloud generation method based on multi-sensor fusion was proposed. We verified the method based on the experimental data; the average deviation of positioning errors in the horizontal and elevation directions were 0.04 m and 0.037 m, respectively. Compared with the stop-and-go mode of the Amberg GRP series trolley, this method greatly improved scanning efficiency; compared with the method of generating a point cloud in an absolute coordinate system based on tunnel design data conversion, this method improved data accuracy. It effectively avoided the deformation of the tunnel, the sharp increase of errors and more accurately and quickly processed the tunnel point cloud data. This method provided better data support for subsequent tunnel analysis such as 3D display, as-built surveying and disease system management of rail transit tunnels.

Model for wireless image correlation assisted by sensors based on 3D display technology

The utilization of 3D display systems offers significant advantages to end-users. Sequencing technologies are essential for accessing an autonomous, auto-balanced, non-glass 3D world with greatly improved visual acuity. To have both social and emotional depth cues on a 3D display is difficult. Because of the theoretically constant feature vectors provided, certain 3D overall volume display approaches cannot produce shadows or structures. Hence, in this paper, a Wireless Sensor Assisted Image Correlation framework (WSAICF) has been proposed to enhance the current competitiveness, performance experience, and better visual understanding of the 3d display systems. In 3D presentations, the Steep Learning algorithm is used to enhance social depth estimations rapidly. The WSAICF method is integrated with the Deep Learning algorithm to enhance the emotional depth indicators of 3D display systems. The simulation result shows that an image correlation system achieves 97 % reliability, 99 % performance, 96 % viability, 11 % resilience, and 95 % efficiency.

3D Visualization System in Descemet Membrane Endothelial Keratoplasty (DMEK): A Six-Month Comparison with Conventional Microscope.

Background: To compare the efficacy and safety of Descemet membrane endothelial keratoplasty (DMEK) surgery using the three-dimensional (3D) display system NGENUITY to DMEK surgery performed with the traditional microscope (TM) in patients affected by Fuchs Endothelial Corneal Disease (FECD). Methods: Retrospective comparative study of 40 pseudophakic eyes of 40 patients affected by FECD who underwent DMEK surgery. Twenty patients (3D group) were operated on using the 3D display system and 20 patients (TM group) were operated on using the traditional microscope. Best spectacle corrected visual acuity (BSCVA), central corneal thickness (CCT), endothelial cell density (ECD) and corneal densitometry (CD) values were documented before and at 1, 3 and 6 months after DMEK. Intra- and postoperative complications were recorded. Results: The baseline assessments did not differ between the two groups (p > 0.05). Global surgical time and time to perform descemetorhexis were significantly lower in the TM group (p = 0.04 and p = 0.02, respectively). BSCVA, CCT, ECD and CD values did not differ significantly in the two groups at all follow-ups (p > 0.05). Complication rate was similar between the two groups. Conclusion: Three-dimensional display systems can be securely employed in DMEK surgery considering the satisfactory clinical outcomes, including Scheimpflug CD. Nevertheless, the slightly longer surgical time of the 3D DMEKs may lead to surgeons’ hesitancy. The main advantages of the heads-up approach may be the improved ergonomic comfort during surgery and the utility of assistants in surgical training.

The influence of stereoscopic vision on surgical performance in minimal invasive surgery—a substudy of the IDOSP-Study (Influence of 3D- vs. 4 K-Display Systems on Surgical Performance in minimal invasive surgery)

PurposeThis study is a secondary analysis of the IDOSP trial published in the Annals of Surgery 2020. The aim of this study was to examine the influence of stereo acuity on surgical performance in a laparoscopic training parkour with 3D- versus 4 K-2D-display technique.MethodsThe surgical performance of medical students (MS), non-board-certified surgeons (NBC), and board-certified surgeons (BC) was compared using 3D- versus 4 K-2D-display technique at a training parkour in a randomized cross-over trial. Stereo acuity was tested by TNO and Titmus Stereo tests.ResultsEighty-nine participants were included in this sub-trial. The median stereo acuity for all participants, measured with the Titmus test, was 25 s arc, with TNO test 30 s arc. Higher quality stereo vision, measured with the Titmus test, correlated significantly with a reduced parkour time (r = 0.26, p = 0.02) and error (r = 0.21, p = 0.048) with the 3D screen. The TNO test did not correlate significantly with parkour performance. There was no statistically significant correlation between parkour time nor error and stereo acuity using the 4 K system (p > 0.457 respectively). Higher age showed a significant correlation with lower stereo acuity measured with TNO (r = 0.21, p = 0.014), but not with the Titmus test (r = − 0.7, p = 0.39). Seven percent of the group “NBC and BC” showed reduced stereo acuity > 120 s arc with the Titmus test and 3% with the TNO test.ConclusionHigh-quality stereo vision is of utmost importance for surgical skills using a 3D-display system. This was most obvious for MS and for tasks that place particularly high demands on hand–eye coordination. The Titmus test was more precise than the TNO test to predict the benefit of a 3D monitor system. Experience and fine motor skills could partly compensate for a poorer stereo acuity.Trial registrationThis trial was registered at clinicaltrials.gov (trial number: NCT03445429, registered February 26, 2018).

Design of 3D Display System for Intangible Cultural Heritage Based on Generative Adversarial Network

This paper designs a three-dimensional display system for intangible cultural heritage based on generative adversarial networks. The system function is realized through four modules: input module, data processing module, 3D model generation module, and model output module. Two 3D model reconstruction methods are used to realize the transformation from 2D images to 3D models. In the low-resolution Nuo surface 3D construction, multiresidual dense blocks are introduced and applied to the deep image super-resolution network. The experimental comparison results show that the quadratic optimization multifusion 3D construction model proposed in this paper can achieve considerable improvement and can improve the reconstruction accuracy by about 6.3%. In the high-resolution 3D construction of the Nuo surface, a generative adversarial network model is used to improve the generator, discriminator, and loss function of the original SRGAN model. Experimental results show that this method can generate super-resolution images with more realistic and natural depth maps. In addition, when it is used for high-resolution 3D Nuo surface sculpting, it can also generate 3D voxel Nuo surfaces with more details.

Integrated Multi-view 3D Image Capture and Motion Parallax 3D Display System

We propose an integrated 3D image capture and display system using a transversely moving camera, regular 2D display screen and user tracking that can facilitate the multi-view capture of a real scene or object and display the captured perspective views in 3D. The motion parallax 3D technique is used to capture the depth information of the object and display the corresponding views to the user using head tracking. The system is composed of two parts, the first part consists of a horizontally moving camera interfaced with a customized camera control and capture application. The second part consist of a regular LCD screen combined with web camera and user tracking application. The 3D multi-view images captured through the imaging setup are relayed to the display based on the user location and corresponding view is dynamically displayed on the screen based on the viewing angle of the user with respect to the screen. The developed prototype system provides the multi-view capture of 60 views with the step size of 1 cm and greater than 40˚ field-of-view overlap. The display system relays 60 views providing the viewing angle coverage of ±35˚ where the angular difference between two views is 1.2˚.

Glasses-Assisted 3D Display System-Guided Descemet Membrane Endothelial Keratoplasty Tissue Preparation.

The aim of this study was to evaluate the feasibility of Descemet membrane endothelial keratoplasty (DMEK) tissue preparation using a glasses-assisted 3-dimensional (3D) display system and to compare it with a conventional surgical microscope. Healthy pairs of human corneas suitable for penetrating keratoplasty surgery were selected for this study. The tissues were randomly divided into 2 groups. Each pair of corneas had 1 cornea (group 1) prepared with NGENUITY (Alcon) with a 5-second staining time with vision blue, and the fellow cornea (group 2) was prepared using a OPMI Lumera 700 surgical microscope (Carl Zeiss Meditec, Jena, Germany) with a 30-second staining time. DMEK graft preparation time, speed of stripping, graft width, and endothelial cell loss were evaluated. Twenty-eight pairs of corneas were included in this study. The graft preparation time was significantly higher in the 3D group than in the conventional group (498 ± 147 vs. 418 ± 85 seconds, P value = 0.031). The mean speed of stripping was 0.59 ± 0.081 mm/s in group 1 and 0.089 ± 0.005 mm/s in group 2 ( P value = 0.024). The mean endothelial cell density in group 1 and group 2 before tissue preparation was 2162 ± 115.21 and 2153 ± 122.45, respectively ( P value > 0.1). After tissue preparation, the endothelial cell density reduced to 1911 ± 150.72 in group 1 and 1998 ± 90.72 in group 2 ( P value = P value > 0.05). The graft width was 5.05 ± 0.71 mm in group 1 and 4.92 ± 0.23 mm in group 2 ( P value > 0.05). DMEK tissue preparation with 3D display system NGENUITY is feasible with a slightly increased preparation time. The improved visualization allows a reduced staining time that could be beneficial for eye banks because it may reduce the toxic effect of staining colorants.

Retracted] Virtual Reality‐Based Digital Restoration Methods and Applications for Ancient Buildings

At a time of rapid technological development, 3D stereoscopic images and virtual reality technology are being used in art and design, as well as in the digital conservation of ancient buildings and their restoration. Virtual reality art is a high degree of integration between art and digital technology and is a new form of digital art. As a means of presenting architectural art, digital restoration of ancient buildings is a form of expression that combines knowledge, art, and technology. The digital restoration of ancient buildings and the creation of a 3D interactive display system are of great value for the realization of real space and the preservation of ancient sites. In this paper, we design a system that combines 3D stereoscopic and virtual reality technologies for the restoration of ancient buildings. Through the research and practice of this system, it can be translated into relevant design application research in other art and design fields, which is of great practical significance for future virtual reality expansion space.

Holographic 3D Display System with Large Size

Holographic 3D Display System with Large Size

3D displays in augmented and virtual realities with holographic optical elements [Invited

Three-dimensional (3D) displays have been vastly investigated in the past few decades. Recent development of augmented reality (AR) and virtual reality (VR) has further demanded to compress the 3D display system into a compact platform, such as wearable near-eye displays. Holographic optical elements (HOEs) have received widespread attention owing to their lightweight, thin formfactor, and low cost, and thus have been widely deployed in various 3D display systems. In this review article, we first describe the working principle of some 3D techniques used in AR and VR headsets, and then present 3D display systems employing HOEs, and finally analyze how HOEs influence the system design and performance.