3D Experience Research Articles

Enhanced resolution and speckle-free three-dimensional printing of macular optical coherence tomography angiography.

Enhanced resolution and speckle-free three-dimensional printing of macular optical coherence tomography angiography.

Multisensory Inclusive Design Education: A 3D Experience

Inclusive design should be an integral part of the curriculum in the education of environmental design disciplines, incorporating empathic understanding. Among the empathic methods that are employed, ‘build-to-learn’ that promotes experiential learning is effective in students’ multisensory and bodily engagement with the process and product. This paper discusses an exercise in a Human Factors/Ergonomics course in interior design where students create ‘A 3D Experience’. Analysis of exemplary work suggests various ways in which different senses may come forth into awareness to sometimes enrich and at other times limit embodied space, thus opening up a venue of inclusivity in novel and unpredictable ways. Research conducted on student perspectives reveals that the assignment had positive impact on their understanding and awareness of, and attitudes towards, inclusive design, as well as creative thinking.

3DTV at home

Stereoscopic 3D (S3D) movies have become widely popular in the movie theaters, but the adoption of S3D at home is low even though most TV sets support S3D. It is widely believed that S3D with glasses is not the right approach for the home. A much more appealing approach is to use automulti-scopic displays that provide a glasses-free 3D experience to multiple viewers. A technical challenge is the lack of native multiview content that is required to deliver a proper view of the scene for every viewpoint. Our approach takes advantage of the abundance of stereoscopic 3D movies. We propose a real-time system that can convert stereoscopic video to a high-quality multiview video that can be directly fed to automultiscopic displays. Our algorithm uses a wavelet-based decomposition of stereoscopic images with per-wavelet disparity estimation. A key to our solution lies in combining Lagrangian and Eulerian approaches for both the disparity estimation and novel view synthesis, which leverages the complementary advantages of both techniques. The solution preserves all the features of Eulerian methods, e.g., subpixel accuracy, high performance, robustness to ambiguous depth cases, and easy integration of inter-view aliasing while maintaining the advantages of Lagrangian approaches, e.g., robustness to large disparities and possibility of performing non-trivial disparity manipulations through both view extrapolation and interpolation. The method achieves real-time performance on current GPUs. Its design also enables an easy hardware implementation that is demonstrated using a field-programmable gate array. We analyze the visual quality and robustness of our technique on a number of synthetic and real-world examples. We also perform a user experiment which demonstrates benefits of the technique when compared to existing solutions.

Опыт применения трехмерного моделирования при реконструкции мостов

Objective: To state 3D modeling application experience in bridgeworks reconstruction by the example of Palace Bridge in Saint Petersburg. Methods: It was shown that one of the possible spheres of bridge 3D models application was the acquisition of spatial data of bridge constructions and components’ arrangement, as well as the analysis of main axis position with respect to each other. The technology of acquiring the initial data for modeling was given, the essence of which is in composite application of surface laser scanning, electronic tacheometer line and angle measurements, and measurement of difference in elevation by digital levelling instrument. Order of processing field evidence was stated, as well as the main used software products – CREDO_DAT, X-TOOLS, Autodesk AutoCAD. Results: Fragments of 3D facility models. Practical importance: Opportunity and operability of 3D models application in the process of bridgework reconstruction. The article might be of interest for bridgework design engineers, as well as students and postgraduates, studying the construction and maintenance of bridgeworks.

Streaming and 3D mapping of AGRI-data on mobile devices

Farm monitoring and operations generate heterogeneous AGRI-data from a variety of different sources that have the potential to be delivered to users ‘on the go’ and in the field to inform farm decision making. A software framework capable of interfacing with existing web mapping services to deliver in-field farm data on commodity mobile hardware was developed and tested. This raised key research challenges related to: robustness of data steaming methods under typical farm connectivity scenarios, and mapping and 3D rendering of AGRI-data in an engaging and intuitive way. The presentation of AGRI-data in a 3D and interactive context was explored using different visualisation techniques; currently the 2D presentation of AGRI- data is the dominant practice, despite the fact that mobile devices can now support sophisticated 3D graphics via programmable pipelines. The testing found that WebSockets were the most reliable streaming method for high resolution image/texture data. From our focus groups there was no single visualisation technique that was preferred demonstrating that a range of methods is a good way to satisfy a large user base. Improved 3D experience on mobile phones is set to revolutionize the multimedia market and a key challenge is identifying useful 3D visualisation methods and navigation tools that support the exploration of data driven 3D interactive visualisation frameworks for AGRI-data.

Three-dimensional display optimization with measurable energy model.

3D displays have been developed to provide users with a realistic 3D experience. Although various studies have endeavored to establish design principles for 3D displays, a generalized optimized model does not exist in the literature thus far. These circumstances have led to the manufacture of independently qualified 3D products, but expanding these applications remains a challenge. In this paper, we suggest a measurement model and an optimization method for optimized 3D display design. The proposed optimization can be applied to rotatable 3D displays and various pixel structures. Our experimental results based on manufactured displays and simulations confirm the proposed theory of optimization model.

A wellness platform for stereoscopic 3D video systems using EEG-based visual discomfort evaluation technology

Recent advances in three-dimensional (3D) video technology have extended the range of our experience while providing various 3D applications to our everyday life. Nevertheless, the so-called visual discomfort (VD) problem inevitably degrades the quality of experience in stereoscopic 3D (S3D) displays. Meanwhile, electroencephalography (EEG) has been regarded as one of the most promising brain imaging modalities in the field of cognitive neuroscience. In an effort to facilitate comfort with S3D displays, we propose a new wellness platform using EEG. We first reveal features in EEG signals that are applicable to practical S3D video systems as an index for VD perception. We then develop a framework that can automatically determine severe perception of VD based on the EEG features during S3D video viewing by capitalizing on machine-learning-based braincomputer interface technology. The proposed platform can cooperate with advanced S3D video systems whose stereo baseline is adjustable. Thus, the optimal S3D content can be reconstructed according to a viewer's sensation of VD. Applications of the proposed platform to various S3D industries are suggested, and further technical challenges are discussed for follow-up research.

Virtual Reality for Management of Pain in Hospitalized Patients: Results of a Controlled Trial

BackgroundImprovements in software and design and reduction in cost have made virtual reality (VR) a practical tool for immersive, three-dimensional (3D), multisensory experiences that distract patients from painful stimuli.ObjectiveThe objective of the study was to measure the impact of a onetime 3D VR intervention versus a two-dimensional (2D) distraction video for pain in hospitalized patients.MethodsWe conducted a comparative cohort study in a large, urban teaching hospital in medical inpatients with an average pain score of ≥3/10 from any cause. Patients with nausea, vomiting, dementia, motion sickness, stroke, seizure, and epilepsy and those placed in isolation were excluded. Patients in the intervention cohort viewed a 3D VR experience designed to reduce pain using the Samsung Gear Oculus VR headset; control patients viewed a high-definition, 2D nature video on a 14-inch bedside screen. Pre- and postintervention pain scores were recorded. Difference-in-difference scores and the proportion achieving a half standard deviation pain response were compared between groups.ResultsThere were 50 subjects per cohort (N=100). The mean pain reduction in the VR cohort was greater than in controls (−1.3 vs −0.6 points, respectively; P=.008). A total of 35 (65%) patients in the VR cohort achieved a pain response versus 40% of controls (P=.01; number needed to treat=4). No adverse events were reported from VR.ConclusionsUse of VR in hospitalized patients significantly reduces pain versus a control distraction condition. These results indicate that VR is an effective and safe adjunctive therapy for pain management in the acute inpatient setting; future randomized trials should confirm benefit with different visualizations and exposure periods.Trial RegistrationClinicaltrials.gov NCT02456987; https://clinicaltrials.gov/ct2/show/NCT02456987 (Archived by WebCite at http://www.webcitation.org/6pJ1P644S)

To immerse or not? Experimenting with two virtual retail environments

PurposeThe purpose of this paper is to examine the determinants of users’ simulated experience in a virtual store and to show the subsequent impact of that experience on engagement. The outcome of that engagement is examined in relation to enjoyment, satisfaction and purchase intentions.Design/methodology/approachThe method comprised an experiment comparing users’ perceptions of a standard 2D online clothing store with an enhanced, immersive one that aimed to provide shopping value approaching that of a traditional store by using a 3D experience where participants wore special glasses and a data glove.FindingsResults demonstrate the major role of telepresence components in simulated experience and the critical role of that experience, along with hedonic and utilitarian values, in engagement. Purchase intention is influenced by satisfaction, which is in turn influenced by enjoyment and engagement. Engagement in turn is influenced by utilitarian and hedonic value and the experience of product simulation or telepresence, which is composed of control, colour and graphics vividness, and 3D authenticity. In the immersive, 3D environment, experience is more associated with engagement and enjoyment, leading to greater purchase intention. The immersive, 3D environment, thus, has the potential to rival traditional shopping in terms of experience, resulting in higher sales for retailers and satisfaction for consumers.Originality/valueThis work has evaluated a robust model of purchase intention and demonstrated it to hold not only in a 3D environment on a conventional computer platform, but also in an immersive one, where participants wear special glasses and a data glove.

From stereoscopic recording to virtual reality headsets: Designing a new way to learn surgery

ObjectiveTo improve surgical practice, there are several different approaches to simulation. Due to wearable technologies, recording 3D movies is now easy. The development of a virtual reality headset allows imagining a different way of watching these videos: using dedicated software to increase interactivity in a 3D immersive experience. The objective was to record 3D movies via a main surgeon's perspective, to watch files using virtual reality headsets and to validate pedagogic interest. Material and methodsSurgical procedures were recorded using a system combining two side-by-side cameras placed on a helmet. We added two LEDs just below the cameras to enhance luminosity. Two files were obtained in mp4 format and edited using dedicated software to create 3D movies. Files obtained were then played using a virtual reality headset. Surgeons who tried the immersive experience completed a questionnaire to evaluate the interest of this procedure for surgical learning. ResultsTwenty surgical procedures were recorded. The movies capture a scene which is extended 180° horizontally and 90° vertically. The immersive experience created by the device conveys a genuine feeling of being in the operating room and seeing the procedure first-hand through the eyes of the main surgeon. All surgeons indicated that they believe in pedagogical interest of this method. ConclusionsWe succeeded in recording the main surgeon's point of view in 3D and watch it on a virtual reality headset. This new approach enhances the understanding of surgery; most of the surgeons appreciated its pedagogic value. This method could be an effective learning tool in the future.

The Added Value of 3D Echo to Assess RV Geometry and Function

Quantitative assessment of the right ventricle (RV) by conventional echocardiography is a challenging task due to its complex asymmetric geometry (limiting the ability to adequately visualize both inflow and outflow tracts in the same view), highly trabeculated endocardial borders, lack of precise anatomic landmarks, and unfavourable position of the RV in the chest. Furthermore, two-dimensional echocardiography (2DE) diameters of the RV vary significantly with minor rotation or tilting the transducer and may be inaccurate, leading to an under- or overestimation of RV size. Three-dimensional echocardiography (3DE) opened a new era in echocardiographic evaluation of the RV. 3DE allows to include all three parts of the RV (i.e. inflow, outflow and apical trabecular part) in the same dataset. RV acquisitions derived from stitching together consecutive multi-beat volumes offer high temporal and spatial resolution. These data sets can be further analysed using dedicated software packages to obtain the mapping of the RV endocardial surface and to measure the RV volumes and function without using geometrical assumptions or approximations. Despite a slight underestimation, RV 3DE measurements closely correlate with RV volumes measured by cardiac magnetic resonance (CMR) and by volumetric thermodilution during cardiac catheterization both in children and adults. It’s worth stressing out that 3DE remains the only echocardiographic technique capable of a reliable calculation of RV EF from end-diastolic and end-systolic volume measurements. In the most recent meta-analysis aimed to explore the accuracy of different imaging modalities (2DE, 3DE, radionuclide ventriculography, computerized tomography- CT, gated single-photon emission CT, and invasive cardiac cineventriculography) for RV EF using CMR as reference method, 3DE has proven to be the most reliable technique, overestimating the RV EF only by 1.16% (range -0.59 to 2.92%). Normative data for 3DE RV volumes and EF including age-, body size-, and sex-specific reference values based on large cohort studies of healthy volunteers is also available. Inclusion of the recommendations for 3D RV volumetric analysis in laboratories with appropriate 3D platforms and experience in the most recent edition of chamber quantification guidelines highlights the importance of 3DE in the assessment of RV.

Interactive Simulation of Human-robot Collaboration Using a Force Feedback Device

In this paper, we demonstrate the use of interactive simulation as a tool for workcell validation and optimization. The proposed technique uses real-time physics simulation to immerse the design engineer or production planner inside a responsive virtual model of the factory. The user can interact with components and tools, as well as with the robots performing their assigned tasks, including collaborative steps. The hand guiding function of sensitive lightweight robots can be simulated using force feedback devices. Future application scenarios can be directly tested in the assembly process simulation. Thanks to this first-person 3D experience, a better understanding of the risks, complexity and potential improvements can be reached. With this knowledge, it is possible in early planning stages to define the first working and protection areas for safety programming. These are necessary for the human-robot collaboration to be safe. In addition to safety, the process reliability can be optimized in the simulation, too.

3D printing process selection model based on triangular intuitionistic fuzzy numbers in cloud manufacturing

The distributed and customized 3D printing can be realized by 3D printing services in a cloud manufacturing environment. As a growing number of 3D printers are becoming accessible on various 3D printing service platforms, there raises the concern over the validation of virtual product designs and their manufacturing procedures for novices as well as users with 3D printing experience before physical products are produced through the cloud platform. This paper presents a 3D model to help users validate their designs and requirements not only in the traditional digital 3D model properties like shape and size, but also in physical material properties and manufacturing properties when producing physical products like surface roughness, print accuracy and part cost. These properties are closely related to the process of 3D printing and materials. In order to establish the 3D model, the paper analyzes the model of the 3D printing process selection in the cloud platform. Triangular intuitionistic fuzzy numbers are applied to generate a set of 3D printers with the same process and material. Based on the 3D printing process selection model, users can establish the 3D model and validate their designs and requirements on physical material properties and manufacturing properties before printing physical products.

Exploring the Value of Educational Accessibility and Learning through Virtual Worlds

Virtual worlds allow for an immersive 3D experience with rich interactive content and learning potential for students. Through this technology, educators have abundant creative power to design and facilitate meaningful learning experiences. Even though online games and virtual worlds have been aroun

JAVRE: A Joint Asymmetric Video Rendering and Encoding Approach to Enable Optimized Cloud Mobile 3D Virtual Immersive User Experience

With the growing adoption of mobile devices as the primary device for information and media consumption, and recent growth in availability of mobile devices with auto-stereoscopic 3D displays, the time has come to enable rich 3D virtual immersive experiences on mobile devices, like 3D display gaming, 3D virtual classroom, 3D virtual art gallery, etc., which are currently enabled on PC platforms. Instead of developing such compute-intensive applications on mobile devices, a scalable and portable approach is to take advantage of the elastic cloud resources. In this paper, we explore the possibility of developing a cloud based mobile 3D virtual immersive application architecture, where the 3D video rendering and encoding are performed on cloud servers, with the resulting 3D video streamed to mobile 3D devices through wireless networks. However, with the significantly higher bit rate requirement for 3D videos, ensuring user experience is a challenge considering the inherent dynamic variability of mobile networks. In this paper, in order to address this challenge, we propose a joint asymmetric graphics rendering and video encoding approach called JAVRE, where both the encoding quality and rendering richness of the left view and the right view can be asymmetric. Specifically, we first develop two mathematical models (user experience model and video bit rate model) through subjective and objective tests. Then we propose an optimization algorithm that can automatically choose the video encoding settings and graphics rendering settings for the left view and the right view to ensure the best user experience given the network conditions. Experiments conducted using real 4G-LTE network profiles and a commercial cloud service demonstrate significant improvement in user experience when JAVRE is used.

Hybrid ASIC/FPGA System for Fully Automatic Stereo-to-Multiview Conversion Using IDW

Recently, multiview autostereoscopic dis-plays (MADs), which enable a limited glasses-free 3D experience, have become commercially available. The main problem of MADs is that they require several (typically eight or nine) views, while most of the 3D video content is in stereoscopic 3D today. In order to bridge this gap, the research community started to devise automatic multiview synthesis (MVS) methods. These algorithms require real-time processing and should be portable to end-user devices to develop their full potential. To this end, we revisit an algorithmic solution based on image domain warping (IDW) and devise a hardware architecture of a complete synthesis pipeline, provide insights into where the computationally challenging parts are, and present implementation results of a hybrid field programmable gate array/application-specific integrated circuit prototype, which is the first hardware implementation of a complete IDW-based MVS system. Based on these results, we also estimate the complexity and energy efficiency of a fully integrated solution in 65- and 28-nm CMOS technology and show that a full-high-definition real-time solution on a single chip is within reach. The proposed architecture could be used as a coprocessor in a system-on-chip targeting 3D TV sets, thereby enabling efficient content generation with limited user interaction (e.g., depth range adjustment) in real time.

3D Displays.

Creating realistic three-dimensional (3D) experiences has been a very active area of research and development, and this article describes progress and what remains to be solved. A very active area of technical development has been to build displays that create the correct relationship between viewing parameters and triangulation depth cues: stereo, motion, and focus. Several disciplines are involved in the design, construction, evaluation, and use of 3D displays, but an understanding of human vision is crucial to this enterprise because in the end, the goal is to provide the desired perceptual experience for the viewer. In this article, we review research and development concerning displays that create 3D experiences. And we highlight areas in which further research and development is needed.

Effects of 3D Printing Campaign Experiences on Attitude and Purchase Intention

Effects of 3D Printing Campaign Experiences on Attitude and Purchase Intention

Adaptive delivery of immersive 3D multi-view video over the Internet

The increase in Internet bandwidth and the developments in 3D video technology have paved the way for the delivery of 3D Multi-View Video (MVV) over the Internet. However, large amounts of data and dynamic network conditions result in frequent network congestion, which may prevent video packets from being delivered on time. As a consequence, the 3D video experience may well be degraded unless content-aware precautionary mechanisms and adaptation methods are deployed. In this work, a novel adaptive MVV streaming method is introduced which addresses the future generation 3D immersive MVV experiences with multi-view displays. When the user experiences network congestion, making it necessary to perform adaptation, the rate-distortion optimum set of views that are pre-determined by the server, are truncated from the delivered MVV streams. In order to maintain high Quality of Experience (QoE) service during the frequent network congestion, the proposed method involves the calculation of low-overhead additional metadata that is delivered to the client. The proposed adaptive 3D MVV streaming solution is tested using the MPEG Dynamic Adaptive Streaming over HTTP (MPEG-DASH) standard. Both extensive objective and subjective evaluations are presented, showing that the proposed method provides significant quality enhancement under the adverse network conditions.

3D Experiential Marketing in International Industrial Fair

This study explores the effect of buyers’ 3D experiences on their purchase intention, as well as the moderating effect of exhibitors’ corporate image on the above relationship. This study uses the purposive sampling method to survey buyers of the famous International Woodworking Machine Fair in China. Analytical results from 91 visitors are summarized as: the higher the international mechanical fair buyers’ feel experience, think experience and act experience, then the higher their purchase intention; buyers’ relate experience has a negative prediction effect on purchase intention; exhibitors’ corporate image has a moderating effect on the relationship between buyers’ feel experiences and purchase intention; exhibitors’ corporate image has a moderating effect on the relationship between buyers’ relate experience and purchase intention.