Display Refresh Rate Research Articles

Model-based navigation of transcranial focused ultrasound neuromodulation in humans: Application to targeting the amygdala and thalamus

BackgroundTranscranial focused ultrasound (tFUS) neuromodulation has shown promise in animals but is challenging to translate to humans because of the thicker skull that heavily scatters ultrasound waves. ObjectiveWe develop and disseminate a model-based navigation (MBN) tool for acoustic dose delivery in the presence of skull aberrations that is easy to use by non-specialists. MethodsWe pre-compute acoustic beams for thousands of virtual transducer locations on the scalp of the subject under study. We use the hybrid angular spectrum solver mSOUND, which runs in ∼4 s per solve per CPU yielding pre-computation times under 1 h for scalp meshes with up to 4000 faces and a parallelization factor of 5. We combine this pre-computed set of beam solutions with optical tracking, thus allowing real-time display of the tFUS beam as the operator freely navigates the transducer around the subject’ scalp. We assess the impact of MBN versus line-of-sight targeting (LOST) positioning in simulations of 13 subjects. ResultsOur navigation tool has a display refresh rate of ∼10 Hz. In our simulations, MBN increased the acoustic dose in the thalamus and amygdala by 8–67 % compared to LOST and avoided complete target misses that affected 10–20 % of LOST cases. MBN also yielded a lower variability of the deposited dose across subjects than LOST. ConclusionsMBN may yield greater and more consistent (less variable) ultrasound dose deposition than transducer placement with line-of-sight targeting, and thus could become a helpful tool to improve the efficacy of tFUS neuromodulation.

High throughput rate with block-based control for micro-LED display

This paper proposes the implementation of a Micro LED control and driving system by block addressing method to promote the system throughput rate. The efficient memory control schedule is presented for block addressing access with real-time processing. The control panel receives the SPI signal, which is then decoded to determine the relative block address for updating the memory data. Only the moving blocks are transmitted to the receiver for display updating. The still blocks do not need to be sent to the receiver; instead, the display data comes from the local memory, which stores the previous frame data. With this approach, the communication bandwidth can be reduced, and the refresh rate of display can be promoted. Experiments show that the use of this block-based processing method can increase the overall frame rate efficiently. Using FPGA control, the processing speed for micro-LED modules can reach 600 to 1100 FPS, depending on the video's motion characteristics..

Spatiotemporal image quality of virtual reality head mounted displays

Virtual reality (VR) head mounted displays (HMDs) require both high spatial resolution and fast temporal response. However, methods to quantify the VR image quality in the spatiotemporal domain when motion exists are not yet standardized. In this study, we characterize the spatiotemporal capabilities of three VR devices: the HTC VIVE, VIVE Pro, and VIVE Pro 2 during smooth pursuit. A spatiotemporal model for VR HMDs is presented using measured spatial and temporal characteristics. Among the three evaluated headsets, the VIVE Pro 2 improves the display temporal performance using a fast 120 Hz refresh rate and pulsed emission with a small duty cycle of 5%. In combination with a high pixel resolution beyond 2 k times 2 k per eye, the VIVE Pro 2 achieves an improved spatiotemporal performance compared to the VIVE and VIVE Pro in the high spatial frequency range above 8 cycles per degree during smooth pursuit. The result demonstrates that reducing the display emission duty cycle to less than 20% is beneficial to mitigate motion blur in VR HMDs. Frame rate reduction (e.g., to below 60 Hz) of the input signal compared to the display refresh rate of 120 Hz yields replicated shadow images that can affect the image quality under motion. This work supports the regulatory science research efforts in development of testing methods to characterize the spatiotemporal performance of VR devices for medical use.

헤드 마운티드 디스플레이를 위한 시간 제약 렌더링을 이용한 적응적 포비티드 광선 추적법

Ray tracing-based rendering creates by far more realistic images than the traditional rasterization-based rendering. However, it is still burdensome when implemented for a Head-Mounted Display (HMD) system that demands a wide field of view and a high display refresh rate. Furthermore, for presenting high-quality images on the HMD screen, a sufficient number of ray sampling should be carried out per pixel to alleviate visually annoying spatial and temporal aliases. In this paper, we extend the recent selective foveated ray tracing technique by Kim et al. [<xref ref-type="bibr" rid="B1">1</xref>], and propose an improved real-time rendering technique that realizes the rendering effect of the classic Whitted-style ray tracing on the HMD system. In particular, by combining the ray tracing hardware-based acceleration technique and time-constrained rendering scheme, we show that fast HMD ray tracing is possible that is well suited to human visual systems.

Furion: Engineering High-Quality Immersive Virtual Reality on Today's Mobile Devices

Despite the growing market penetration, today's high-end virtual reality (VR) systems remain tethered, which not only limits users' VR experience but also creates a safety hazard. In this paper, we perform a systematic design study of the “elephant in the room” facing the VR industry - is it feasible to enable high-quality VR apps on untethered mobile devices such as smartphones? Our quantitative, performance-driven design study makes two contributions. First, we show that the QoE achievable for high-quality VR applications on today's mobile hardware and wireless networks via local rendering or offloading is about 10X away from the acceptable QoE, yet waiting for future mobile hardware or next-generation wireless networks (e.g., 5G) is unlikely to help, because of power limitation and the higher CPU utilization needed for processing packets under higher data rate. Second, we present Furion, a VR framework that enables high-quality, immersive mobile VR on today's mobile devices and wireless networks. Furion exploits a key insight about the VR workload that foreground interactions and background environment have contrasting predictability and rendering workload, and employs a split renderer architecture running on both the phone and the server. Supplemented with video compression, use of panoramic frames, parallel decoding on multiple cores on the phone, and view-based bitrate adaptation we demonstrate Furion can support high-quality VR apps on today's smartphones over WiFi, with under 14 ms latency and 60 FPS (the phone display refresh rate).

立体表現と色彩表現を有する水滴ディスプレイのリフレッシュレート向上に関する研究( アート&エンタテインメント2)

立体表現と色彩表現を有する水滴ディスプレイのリフレッシュレート向上に関する研究( アート&エンタテインメント2)

Psychophysical Assessment of Perceptual Performance With Varying Display Frame Rates

This study assesses the impact of display refresh rate on the perception of dynamic visual stimuli in humans. A projection platform was developed in that context, allowing control of the frame rate on a trial-by-trial basis. Using this display, we introduce a series of psychophysical experiments aimed to quantitatively assess objective perceptual performance at different frame rates. Tasks that are often implicitly performed when watching movies on a television set, or when wearing a head mounted display, were chosen: speed discrimination, spatial discrimination, and reading abilities, with stimuli undergoing horizontal motion in a wide range of speeds ( $16-38\;\text{deg/s}$ ). The results show that whatever the stimuli or the task, performance is significantly better at high frame rate (HFR) compared to 60 Hz, providing clear-cut evidence that low refresh rates limit the ability to reliably analyze moving stimuli. These results extend those of previous psychophysical experiments performed at low refresh rates, further characterize genuine visual performance in humans and provide an objective benchmarking methodology allowing to assess visual performance with a variety of displays. Results indicate that for low resolution displays, where increasing spatial resolution is not an option, increasing frame rate could benefit motion perception. We discuss these results and their implications with regards to current and emerging categories of visual displays, such as head mounted displays.

Testing the accuracy of timing reports in visual timing tasks with a consumer-grade digital camera.

This study tested the accuracy of a visual timing task using a readily available and relatively inexpensive consumer grade digital camera. A visual inspection time task was recorded using short high-speed video clips and the timing as reported by the task's program was compared to the timing as recorded in the video clips. Discrepancies in these two timing reports were investigated further and based on display refresh rate, a decision was made whether the discrepancy was large enough to affect the results as reported by the task. In this particular study, the errors in timing were not large enough to impact the results of the study. The procedure presented in this article offers an alternative method for performing a timing test, which uses readily available hardware and can be used to test the timing in any software program on any operating system and display.

빠른 갱신속도의 변화가 상호작용 정확도에 미치는 영향에 관한 연구

본 논문에서는 시각적 피드백을 중심으로 하는 상호작용 시스템에서 화면 갱신속도와 상호작용 정확도의 상관관계를 다룬다. 일반적으로 인간의 시각인지 한계점은 초당 60프레임으로 생각되고 있으나, 본 연구에서는 이보다 높은 갱신속도가 사용자의 상호작용 정확도에 미치는 영향에 대해 알아보고자 한다. 실험을 통해 초당 60프레임 이상의 갱신속도에서도 상호작용 정확도는 증가함을 알 수 있었다. 이러한 결과에 영향을 준 원인을 이미지 렌더링 갱신속도와 사용자 입력 갱신속도 두 가지로 추정하여 이를 확인하기 위한 추가실험을 진행하였다. 비록 모니터의 화면 재생률이 초당 60프레임으로 되어있었지만 vertical sync를 사용하지 않음으로써 그 이상의 갱신속도와의 차이를 느낄 수 있었다. 실험결과를 통해 사용자 입력 갱신속도보다 이미지 렌더링 갱신속도가 상호작용 정확도에 더 큰 영향을 줌을 확인하였다. 본 연구는 상호작용 정확도를 높이기 위해 더욱 높은 갱신속도의 필요성을 제기하며, 인간의 시각인지 한계점은 초당 60프레임 이상이 될 수 있음을 보인다.

Using a High-Speed Movie Camera to Evaluate Slice Dropping in Clinical Image Interpretation with Stack Mode Viewers

The purpose of this study is to verify objectively the rate of slice omission during paging on picture archiving and communication system (PACS) viewers by recording the images shown on the computer displays of these viewers with a high-speed movie camera. This study was approved by the institutional review board. A sequential number from 1 to 250 was superimposed on each slice of a series of clinical Digital Imaging and Communication in Medicine (DICOM) data. The slices were displayed using several DICOM viewers, including in-house developed freeware and clinical PACS viewers. The freeware viewer and one of the clinical PACS viewers included functions to prevent slice dropping. The series was displayed in stack mode and paged in both automatic and manual paging modes. The display was recorded with a high-speed movie camera and played back at a slow speed to check whether slices were dropped. The paging speeds were also measured. With a paging speed faster than half the refresh rate of the display, some viewers dropped up to 52.4% of the slices, while other well-designed viewers did not, if used with the correct settings. Slice dropping during paging was objectively confirmed using a high-speed movie camera. To prevent slice dropping, the viewer must be specially designed for the purpose and must be used with the correct settings, or the paging speed must be slower than half of the display refresh rate.

A Shared-Aperture Tracking Display for Augmented Reality

The operation and performance of a six degree-of-freedom (DOF) shared-aperture tracking system with image overlay is described. This unique tracking technology shares the same aperture or scanned optical beam with the visual display, virtual retinal display (VRD). This display technology provides high brightness in an AR helmet-mounted display, especially in the extreme environment of a military cockpit. The VRD generates an image by optically scanning visible light directly to the viewer's eye. By scanning both visible and infrared light, the head-worn display can be directly coupled to a head-tracking system. As a result, the proposed tracking system requires minimal calibration between the user's viewpoint and the tracker's viewpoint. This paper demonstrates that the proposed shared-aperture tracking system produces high accuracy and computational efficiency. The current proof-of-concept system has a precision of +/− 0.05 and +/− 0.01 deg. in the horizontal and vertical axes, respectively. The static registration error was measured to be 0.08 +/− 0.04 and 0.03 +/− 0.02 deg. for the horizontal and vertical axes, respectively. The dynamic registration error or the system latency was measured to be within 16.67 ms, equivalent to our display refresh rate of 60 Hz. In all testing, the VRD was fixed and the calibrated motion of a robot arm was tracked. By moving the robot arm within a restricted volume, this real-time shared-aperture method of tracking was extended to six-DOF measurements. Future AR applications of our shared-aperture tracking and display system will be highly accurate head tracking when the VRD is helmet mounted and worn within an enclosed space, such as an aircraft cockpit.

The effects of intermittent illumination on a visual inspection task.

Two experiments are described in which eye movements were monitored as subjects performed a simple target-spotting task under conditions of intermittent illumination produced by varying the display-screen frame rate on a computer VDU. In Experiment 1, subjects executed a saccade from a fixation point to a target which appeared randomly at a fixed eccentricity of 14 character positions to the left or right. Saccade latency did not differ reliably as a function of screen refresh rate, but average saccade extent at 70 Hz and 110 Hz was reliably shorter than at 90 Hz and 100 Hz. Experiment 2 examined the same task using a range of target eccentricities (7, 14, and 28 character positions to the left and right) and across a wider range of screen refresh rates. The results confirmed the curvilinear relationship obtained in Experiment 1, with average saccade extent reliably shorter at refresh rates of 50 Hz and 125 Hz than at 75 Hz and 100 Hz. While the effect was greater for remote targets, analyses of the proportional target error failed to show a reliable interaction between target eccentricity and display refresh rate. In contrast to Experiment 1, there was a pronounced effect of refresh rate on saccade latency (corrected for time to write the screen frame), with shorter latencies at higher refresh rates. It may be concluded that pulsation at frequencies above fusion disrupts saccade control. However, the curvilinear functional relationship between screen refresh rate and saccade extent obtained in these studies differs from previously reported effects of intermittent illumination on the average size of "entry saccades" (the first saccade to enter a given word) in a task involving word identification (Kennedy & Murray, 1993a, 1996). This conflict of data may arise in part because within-word adjustments in viewing position, which are typical of normal reading, influence measures of average saccade extent.