Binocular viewing geometry shapes neural processing of slanted planes: Results from theoretical V1 modeling and human psychophysics

Abstract

An important component of real-world scene perception is the estimation of 3D surface orientation (slant and tilt). However, neither the neural circuits that compute 3D orientation nor the supporting computations have been fully uncovered. To help address that gap, we apply a projective geometry framework to the study of both the neural processing and perception of 3D orientation, building on recent work that suggests the mapping of the 3D environment onto the two retinae shapes both the tuning of neurons in area MT to motion-in-depth and corresponding patterns of perceptual errors in human psychophysics (Bonnen et al., 2020). The projection of slanted planes results in interocular disparities in retinal orientation, and interestingly, binocular V1 neurons can have different monocular orientation preferences (Bridge & Cumming, 2001), which could make them sensitive to orientation disparities. Therefore, we have constructed an encoding model that predicts responses of binocular V1 neurons to the orientation disparities produced by a stimulus plane with varying slant, given each theoretical neuron’s monocular orientation preferences and ocular dominance level. The resulting slant tuning curves are noncanonical in shape, do not tile slant evenly, and are strongly affected by viewing distance. Notably, at greater viewing distances, extreme slants (beyond approximately +/- 70 degrees) are encoded by steep portions of the curves, but moderate and low slants are encoded by relatively flat portions. As expected based on those observations, our model population decoder performs best at extreme slants, and performance degrades as slant approaches zero and as viewing distance increases. We additionally observed these patterns in human perceptual performance on a slant discrimination task. These results support the theory that the neural processing of 3D scene components is shaped by projective geometry and represent a step toward advancing understanding of the computations supporting 3D orientation perception.