Judgments Of Motion Direction Research Articles

Poster Session: Investigating temporal evolutions of perceptual choice within biological and artificial neural networks.

Perceptual decisions involve a process that evolves over time until it reaches a decision boundary. It's important to understand how this process unfolds. Recent psychophysical data indicates that the visual system extracts motion axis information faster than motion direction information (Kwon et al., 2015, J Vision). To understand the underlying mechanisms, we developed a biophysically realistic cortical network model of decision making. We generalized the two-variable reduced spiking neural network (Wong et al., 2006, J Neuroscience) to four-variable. The network input is based on motion energy (Adelson et al., 1985, Josa a) and the temporal profile of surround influence (Tadin et al., 2006, J Neuroscience). The model reproduces the prior experimental findings, showing the motion axis extraction before direction extraction. It reveals a stronger axis-wise inhibitory connection between the selective neural populations than the direction-wise inhibitory connection. We further designed a recurrent deep neural network to validate the neural population connectivity pattern. Our model provides a quantitative explanation for the temporal evolution of motion direction judgments. The results show that the spatiotemporal filtering for visual motion integration, the center-surround antagonism, and stronger axis-wise inhibitory connection between the selective neural populations can explain how the visual system can extract motion axis orientation before detecting motion direction.

Confirmation Bias through Selective Overweighting of Choice-Consistent Evidence

People's assessments of the state of the world often deviate systematically from the information available to them [1]. Such biases can originate from people's own decisions: committing to a categorical proposition, or a course of action, biases subsequent judgment and decision-making. This phenomenon, called confirmation bias [2], has been explained as suppression of post-decisional dissonance [3, 4]. Here, we provide insights into the underlying mechanism. It is commonly held that decisions result from the accumulation of samples of evidence informing about the state of the world [5-8]. We hypothesized that choices bias the accumulation process by selectively altering the weighting (gain) of subsequent evidence, akin to selective attention. We developed a novel psychophysical task to test this idea. Participants viewed two successive random dot motion stimuli and made two motion-direction judgments: a categorical discrimination after the first stimulus and a continuous estimation of the overall direction across both stimuli after the second stimulus. Participants' sensitivity for the second stimulus was selectively enhanced when that stimulus was consistent with the initial choice (compared to both, first stimuli and choice-inconsistent second stimuli). A model entailing choice-dependent selective gain modulation explained this effect better than several alternative mechanisms. Choice-dependent gain modulation was also established in another task entailing averaging of numerical values instead of motion directions. We conclude that intermittent choices direct selective attention during the evaluation of subsequent evidence, possibly due to decision-related feedback in the brain [9]. Our results point to a recurrent interplay between decision-making and selective attention.

Response of the multiple-demand network during simple stimulus discriminations

The multiple-demand (MD) network is sensitive to many aspects of task difficulty, including such factors as rule complexity, memory load, attentional switching and inhibition. Many accounts link MD activity to top-down task control, raising the question of response when performance is limited by the quality of sensory input, and indeed, some prior results suggest little effect of sensory manipulations. Here we examined judgments of motion direction, manipulating difficulty by either motion coherence or salience of irrelevant dots. We manipulated each difficulty type across six levels, from very easy to very hard, and additionally manipulated whether difficulty level was blocked, and thus known in advance, or randomized. Despite the very large manipulations employed, difficulty had little effect on MD activity, especially for the coherence manipulation. Contrasting with these small or absent effects, we observed the usual increase of MD activity with increased rule complexity. We suggest that, for simple sensory discriminations, it may be impossible to compensate for reduced stimulus information by increased top-down control.

Temporal evolution of motion direction judgments

Existing models of perceptual decision-making for moving stimuli assume a continuous accumulation of sensory signals for a given direction of motion (Smith & Ratcliff, 2004). This predicts concurrent improvements in estimating motion axis (orientation of motion direction) and motion direction over time. Here, we present a novel finding that the visual system can extract motion axis orientation before detecting motion direction. Methods and results: To estimate the temporal evolution of motion direction judgments, we asked participants to adjust an on-screen arrow to indicate perceived direction of moving stimuli varying in duration (rigid texture motion; randomly chosen direction; 99% contrast, 11° radius, 5°/s speed; stimuli presented at 360Hz). As expected, participants’ responses were completely random for very brief stimulus motions (5ms) and distributed around the actual motion direction for long durations (>90ms). Interestingly, for intermediate durations (30-60ms), participants’ responses exhibited a clear bimodal distribution with equal peaks in the actual motion direction and in the opposite direction. These results indicate that participants extract motion axis information before having a sense of the actual motion direction. In a related experiment, we found that for certain brief stimulus durations, subjects were 100% correct at estimating motion axis while being at chance at perceiving motion direction. Next, we ran several experiments to rule out possible contributions of spatial signals (i.e., the well-known motion streaks). Finally, we explored the contrast and size dependency of this result (5-99% contrast; 1°-11° radius). The results reveled that rapid and early coding of motion axis was mainly associated with large, high-contrast moving stimuli, stimuli associated with center-surround suppression of motion signals (Tadin et al., 2003). Conclusion: We show the visual system can extract motion axis information considerably faster than motion direction information. The specificity to large, high-contrast motion stimuli offers new clues how center-surround suppression affects motion perception. Meeting abstract presented at VSS 2015

The effective reference frame in perceptual judgments of motion direction

The retinotopic projection of stimulus motion depends both on the motion of the stimulus and the movements of the observer. In this study, we aimed to quantify the contributions of endogenous (retinotopic) and exogenous (spatiotopic and motion-based) reference frames on judgments of motion direction. We used a variant of the induced motion paradigm and we created different experimental conditions in which the predictions of each reference frame were different. Finally, assuming additive contributions from different reference frames, we used a linear model to account for the data. Our results suggest that the effective reference frame for motion perception emerges from an amalgamation of motion-based, retinotopic and spatiotopic reference frames. In determining the percept, the influence of relative motion, defined by a motion-based reference frame, dominates those of retinotopic and spatiotopic motions within a finite region. We interpret these findings within the context of the Reference Frame Metric Field (RFMF) theory, which states that local motion vectors might have perceptual reference-frame fields associated with them, and interactions between these fields determine the selection of the effective reference frame.

Quantifying "the aperture problem" for judgments of motion direction in natural scenes.

The response of motion-selective neurons in primary visual cortex is ambiguous with respect to the two-dimensional (2D) velocity of spatially extensive objects. To investigate how local neural activity is integrated in the computation of global motion, we asked observers to judge the direction of a rigidly translating natural scene viewed through 16 apertures. We report a novel relative oblique effect: local contour orientations parallel or orthogonal to the direction of motion yield more precise and less biased estimates of direction than other orientations. This effect varies inversely with the local orientation variance of the natural scenes. Analysis of contour orientations across aperture pairings extends previous research on plaids and indicates that observers are biased toward the faster moving contour for Type I pairings. Finally, we show that observers' bias and precision as a function of the orientation statistics of natural scenes can be accounted for by an interaction between naturally arising anisotropies in natural scenes and a template model of MT that is optimally tuned for isotropic stimuli.

Functional roles and cultural modulations of the medial prefrontal and parietal activity associated with causal attribution

Causal understanding of physical events is culturally universal. However, behavioral studies suggest that how we perceive causality is culturally sensitive, with East Asian culture emphasizing contextual factors and Western culture emphasizing dispositional factors guiding causal relationships. The present study investigated potential neural substrates of the cultural difference in causal attribution of physical events. Using functional magnetic resonance imaging, Experiment 1 scanned Chinese subjects during causality or motion direction judgments when viewing animations of object collisions and identified a causal-attribution related neural circuit consisting of the medial/lateral prefrontal cortex, left parietal/temporal cortex, and cerebellum. Moreover, by manipulating the task demand of causal inference and the complexity of contextual information in physical events, we showed that the medial prefrontal activity was modulated by the demand to infer causes of physical events whereas the left parietal activity was modulated by contextual complexity of physical events. Experiment 2 investigated cultural differences in the medial prefrontal and left parietal activity associated with causal attribution of physical events by scanning two independent groups of American and Chinese subjects. We found that, while the medial prefrontal activity involved in causality judgments was comparable in the two cultural groups, the left parietal activity associated with causality judgments was stronger in Chinese than in Americans regardless of whether the contextual information was attended. Our findings suggest that causal inference in the medial prefrontal cortex is universally implicated in causal reasoning whereas contextual processing in the left parietal cortex is sensitive to cultural differences in causality perception.

Effects of Surface Markings on Judgments of Motion Direction

The effects of surface markings on perceived motion direction were examined for a rotating sphere in a structure-from-motion display. The markings were dot patterns representing separate line segments or intersecting line segments (crosses) covering the surface of the sphere. The orientation of the surface markings and their intersection angles affected the perceived direction of motion, suggesting that the markings were not interpreted as geodesics or planar cuts on the surface. The perceived direction of motion was biased towards the mean orientation of the markings over the visible area of the surface. A similar bias was observed for translating planar stimuli covered with crosses, suggesting that the bias is not specific to curved surfaces or motion in depth. The deviation between the simulated motion direction and the external horizontal and vertical axes also affected the perceived motion direction. These results suggest that the average orientation of surface contours with respect to an external reference frame influences the perceived direction of motion.

Light adaptation in motion direction judgments.

We examined the time course of light adaptation in the visual motion system. Subjects judged the direction of a two-frame apparent-motion display, with the two frames separated by a 50-ms interstimulus interval of the same mean luminance. The phase of the first frame was randomly determined on each trial. The grating presented in the second frame was phase shifted either leftward or rightward by pi/2 with respect to the grating in the first frame. At some variable point during the first frame, the mean luminance of the pattern increased or decreased by 1-3 log units. Mean luminance levels varied from scotopic or low mesopic to photopic levels. We found that the perceived direction of motion depended jointly on the luminance level of the first frame grating and the time at which the shift in average luminance occurs. When the average luminance increases from scotopic or mesopic to photopic levels at least 0.5 s before the offset of the first frame, motion in the 3pi/2 direction is perceived. When average luminance decreases to low mesopic or scotopic levels, motion in the pi/2 direction is perceived if the change occurs 1.0 s or more before first frame offset, depending on the size of the luminance step. Thus light adaptation in the visual motion system is essentially complete within 1 s. This suggests a rapid change in the shape (biphasic or monophasic) of the temporal impulse response functions that feed into a first-order motion mechanism.

Perceptual motion standstill in rapidly moving chromatic displays.

In motion standstill, a quickly moving object appears to stand still, and its details are clearly visible. It is proposed that motion standstill can occur when the spatiotemporal resolution of the shape and color systems exceeds that of the motion systems. For moving red-green gratings, the first- and second-order motion systems fail when the grating is isoluminant. The third-order motion system fails when the green/red saturation ratio produces isosalience (equal distinctiveness of red and green). When a variety of high-contrast red-green gratings, with different spatial frequencies and speeds, were made isoluminant and isosalient, the perception of motion standstill was so complete that motion direction judgments were at chance levels. Speed ratings also indicated that, within a narrow range of luminance contrasts and green/red saturation ratios, moving stimuli were perceived as absolutely motionless. The results provide further evidence that isoluminant color motion is perceived only by the third-order motion system, and they have profound implications for the nature of shape and color perception.

On a new mineral, pyrophosphorite, and anhydrous pyrophosphate of lime from the West Indies

<h3>Abstract</h3> The multiple-demand (MD) network is sensitive to many aspects of task difficulty, including such factors as rule complexity, memory load, attentional switching and inhibition. Many accounts link MD activity to top-down task control, raising the question of response when performance is limited by the quality of sensory input, and indeed, some prior results suggest little effect of sensory manipulations. Here we examined judgments of motion direction, manipulating difficulty by either motion coherence or salience of irrelevant dots. We manipulated each difficulty type across six levels, from very easy to very hard, and additionally manipulated whether difficulty level was blocked, and thus known in advance, or randomized. Despite the very large manipulations employed, difficulty had little effect on MD activity, especially for the coherence manipulation. Contrasting with these small or absent effects, we observed the usual increase of MD activity with increased rule complexity. We suggest that, for simple sensory discriminations, it may be impossible to compensate for reduced stimulus information by increased top-down control.