Visual information processing of 2D, virtual 3D and real-world objects marked by theta band responses: Visuospatial processing and cognitive load as a function of modality.

Abstract

While pictures share global similarities with the real-world objects they depict, the latter have unique characteristics going beyond 2D representations. Due to its three-dimensional presentation mode, Virtual Reality (VR) is increasingly used to further approach real-world visual processing, yet it remains unresolved to what extent VR yields process comparable to real-world processes. Consequently, our study examined visuospatial processing by a triangular comparison of 2D objects, virtual 3D objects and real 3D objects. The theta band response (TBR) was analysed as an electrophysiological correlate of visual processing, allowing for the differentiation of predominantly stimulus-driven processes mirrored in the evoked response and internal, complex processing reflected in the induced response. Our results indicate that the differences between conditions driven by sensory features go beyond a binary division into 2D and 3D materials but are based on further sensory features: The evoked posterior TBR differentiated between all conditions but revealed fewer differences between processing of real-world and VR objects. Moreover, the induced midfrontal TBR indicated higher cognitive load for 2D objects compared to VR and real-world objects, while no difference between both latter conditions was revealed. In conclusion, our results demonstrate that the transferability of 2D- and VR-based findings to real-world processes depends to some degree on whether predominantly sensory stimulus features or higher cognitive processes are examined. Yet although VR and real-world processes are not to be equated based on our results, their comparison yielded fewer significant differences relative to the PC condition, advising the use of VR to examine visuospatial processing.