Multiple Identity Tracking Research Articles

Gaze Behavior and Cognitive Performance on Tasks of Multiple Object Tracking and Multiple Identity Tracking by Handball Players and Non-Athletes.

Multiple object tracking (MOT) and multiple identity tracking (MIT) each measure the ability to track moving objects visually. While prior investigators have mainly compared athletes and non-athletes on MOT, MIT more closely resembles dynamic real-life environments. Here we compared the performance and gaze behavior of handball players with non-athletes on both MOT and MIT. Since previous researchers have shown that MOT and MIT engage different eye movement strategies, we had participants track 3-5 targets among 10 moving objects. In MOT, the objects were identical, while in MIT they differed in shape and color. Although we observed no group differences for tracking accuracy, the eye movements of athletes were more target-oriented than those of non-athletes. We concluded that tasks and stimuli intended by researchers to demonstrate that athletes' show better object tracking than non-athletes should be specific to the athletes' type of sport and should use more perception-action coupled measures. An implication of this conclusion is that the differences in object tracking skills between athletes and non-athletes is highly specific to the skills demanded by the athletes' sport.

Multiple object tracking with extended occlusions.

In everyday life, we often view objects through a limited aperture (e.g., soccer players on TV or cars slipping into our blind spot on a busy road), where objects often move out of view and reappear in a different place later. We modelled this situation in a series of multiple object tracking (MOT) experiments, in which we introduced a cover on the edges of the observed area and manipulated its width. This method introduced systematic occlusions, which were longer than those used in previous MOT studies. Experiment 1 (N = 50) showed that tracking under such conditions is possible, although difficult. An item-level analysis confirmed that people made more errors in targets that were covered longer and more often. In Experiment 2 (N = 50), we manipulated the tracking workload and found that the participants were less affected by the cover when the tracking load was low. In Experiment 3 (N = 50), we asked the participants to keep track of the objects' identities (multiple identity tracking [MIT]). Although MIT is subjectively more demanding, memorising identities improved performance in the most difficult cover conditions. Contrary to previous reports, we also found that even partial occlusions negatively affected tracking.

The effect of object features on target and identity localization in multiple identity tracking

The effect of object features on target and identity localization in multiple identity tracking

Multiple identity tracking strategies vary by age: An ERP study

Top-down modulation underlies our ability to focus attention on task-relevant stimuli and ignore irrelevant distractions. Although age-related differences in neural correlates of top-down modulation have been investigated in multiple studies using variety of tasks (Gazzaley et al., 2005; Störmer et al., 2013), the effect of age on top-down modulation in a multiple identity tracking (MIT) task is still unknown. Thus, we investigated age-related differences in the MIT task by employing event-related potentials (ERPs). Participants tracked ten uniquely colored disks, two of which were randomly designated as targets at the beginning of each trial; the targets moved among four stationary distractors (serving as ERP baseline) and four moving distractors. Each type of stimulus was probed during the trial to capture differential patterns of brain activation. Tracking performance was similar across age groups. ERP data showed that younger adults performed the MIT task by enhancing the unique identities associated with targets relative to distractors through feature-based tracking. Older adults showed a pattern of distractor suppression engaging both location- and feature-based tracking strategies. Thus, our findings suggest that compared to younger adults, older adults engage greater levels of neural activity to achieve the same level of performance. These findings are discussed in light of theories of cognitive aging.

Eye Behavior During Multiple Object Tracking and Multiple Identity Tracking.

We review all published eye-tracking studies to date that have used eye movements to examine multiple object (MOT) or multiple identity tracking (MIT). In both tasks, observers dynamically track multiple moving objects. In MOT the objects are identical, whereas in MIT they have distinct identities. In MOT, observers prefer to fixate on blank space, which is often the center of gravity formed by the moving targets (centroid). In contrast, in MIT observers have a strong preference for the target-switching strategy, presumably to refresh and maintain identity-location bindings for the targets. To account for the qualitative differences between MOT and MIT, two mechanisms have been posited, a position tracking (MOT) and an identity tracking (MOT & MIT) mechanism. Eye-tracking studies of MOT have also demonstrated that observers execute rescue saccades toward targets in danger of becoming occluded or are about to change direction after a collision. Crowding attracts the eyes close to it in order to increase visual acuity for the crowded objects to prevent target loss. It is suggested that future studies should concentrate more on MIT, as MIT more closely resembles tracking in the real world.

Two-year-olds succeed at MIT: Multiple identity tracking in 20- and 25-month-old infants

Infants’ ability to remember objects and their locations emerges during the first year of life. However, not much is known about infants’ ability to track objects’ identities in a dynamic environment. Here, we tailored the delayed match retrieval eye-tracking paradigm to study infants’ ability to track two object identities during occlusion—an infant version of multiple identity tracking (MIT). Delayed match retrieval uses virtual “cards” as stimuli that are first shown face up, exposing to-be-remembered information, and then turned face down, occluding it. Here, cards were subject to movement during the face-down occlusion period. We used complex non-nameable objects as card faces to discourage verbal rehearsal. In three experiments (N = 110), we compared infants’ ability to track object identities when two previously exposed cards were static (Experiment 1), were moved into new positions along the same trajectory (Experiment 2), or were moved along different trajectories (Experiment 3) while face down. We found that 20-month-olds could remember two object identities when static; however, it was not until 25 months of age that infants could track when movement was introduced. Our results show that the ability to track multiple identities in visual working memory is present by 25 months.

Tracking the identity of moving words: Stimulus complexity and familiarity affects tracking accuracy

SummaryIn two experiments, participants tracked the identity and location of moving words. The task bears resemblance to one performed by air traffic controllers who track multiple moving aircraft, where they are identified with relatively complex alphanumeric call signs. In Experiment 1, stimulus familiarity was manipulated by comparing the tracking of familiar words and pseudowords. In Experiment 2, also stimulus complexity was varied by having the participants track short and long words. Stimulus complexity affected tracking: Short words were easier to track than long words. Moreover, familiarity of identity affected tracking of short words (short familiar words were easier to track than short pseudo‐words) but not of long words. The results are interpreted within the framework of the model of multiple identity tracking model. Mathematical simulations suggest that observers may not have enough time for full identification of complex identities in a dynamic situation. Practical implications of the results for air traffic control are discussed.

Model of Multiple Identity Tracking (MOMIT) 2.0: Resolving the serial vs. parallel controversy in tracking

The present study investigated whether during tracking of multiple moving objects with distinct identities only one identity is tracked at each moment (serial tracking) or whether multiple identities can be tracked simultaneously (parallel tracking). By adopting the gaze-contingent display change technique, we manipulated in real time the presence/absence of object identities during tracking. The data on performance accuracy revealed a serial tracking pattern for facial images and a parallel pattern for color discs: when tracking faces, the presence/absence of only the currently foveated identity impacted the performance, whereas when tracking colors, the presence of multiple identities across the visual field led to improved tracking performance. This pattern is consistent with the identifiability of the different types of objects in the visual field. The eye movements during MIT showed a bias towards visiting and dwelling on individual targets when facial identities were present and towards visiting the blank areas between targets when color identities were present. Nevertheless, the eye visits were predominately on individual targets regardless of the type of objects and the presence of object identities. The eye visits to targets were beneficial for target tracking, particularly in face tracking. We propose the Model of Multiple Identity Tracking (MOMIT) 2.0 which accounts for the results and reconcile the serial vs. parallel controversy. The model suggests that observers cooperatively use attention, eye movements, perception, and working memory for dynamic tracking. Tracking appears more serial when high-resolution information needs to be sampled and maintained for discriminating the targets, whereas it appears more parallel when low-resolution information is sufficient.

A New Multiple Object Awareness Paradigm Shows that Imperfect Knowledge of Object Location Is Still Knowledge

Keeping track of multiple moving items is a fundamental perceptual skill. Nevertheless, our capacity in tasks such as multiple object tracking (MOT) [1,2], multiple identity tracking (MIT) [3, 4], or change detection [5] is very low-typically just two to four items. In standard tracking tasks, observers monitor M out of N items as they move about the screen. At testing time, observers are asked to mark all tracked items or to state if a specific item is a target. If they are wrong about an item, they are considered completely wrong. Similarly, in an identity tracking experiment, observers might be asked, "Where is the horse?" If they mark the neighboring location where the cow is hidden, again, they are marked completely wrong. If an observer knew approximately, but not exactly, where the horse was, she would get no credit for that knowledge. In our multiple object awareness task, observers continue to click on locations until they locate the target for that trial so that any imprecise knowledge can be used in observers' responses. A model in which location information degrades with time after an item is attended can be used to estimate a new capacity of multiple object awareness-the number of items about which the observer has some location information. This capacity is at least double the usual capacity estimates for identity tracking.

Chasing Animals With Split Attention: Are Animals Prioritized in Visual Tracking?

Some evolutionary psychologists have hypothesized that animals have priority in human attention. That is, they should be detected and selected more efficiently than other types of objects, especially man-made ones. Such a priority mechanism should automatically deploy more attentional resources and dynamic monitoring toward animal stimuli than nonanimals. Consequently, we postulated that variations of the multiple object or identity tracking and multiple event monitoring tasks should be particularly suitable paradigms for addressing the animate monitoring hypothesis, given their dynamic properties and dependency on divided attention. We used images of animals and artifacts and found neither a substantial sign of improvement in tracking the positions associated with animal stimuli nor a significant distracting effect of animals. We also failed to observe a significant prioritization in orders of response for positions associated with animals. While we observed an advantage for animals in event monitoring, this appeared to be dependent on properties of the task, as confirmed in further experiments. Moreover, we observed a small but inconclusive advantage for animals in identity accuracy. Thus, under certain conditions, some bias toward animals could be observed, but the evidence was weak and inconclusive. To conclude, effect sizes were generally small and not conclusively in favor of the expected attentional bias for animals. We found moderate to strong evidence that images of animals do not improve positional tracking, do not act as more effective distractors, are not selected prior to artifacts in the response phase, and are not easier to monitor for changes in size.

Close coupling between eye movements and serial attentional refreshing during multiple-identity tracking

ABSTRACTMultiple-identity tracking (MIT) is a dynamic task in which observers track multiple moving objects of distinct identities and then report the location of each target object. The present study examined participant’ eye movements during MIT in order to investigate the relationship between eye movements and attentional performance during the task. The results showed that fixations were predominately directed to individual targets during tracking. When successfully landed on targets, the fixations dwelled for longer duration; otherwise, they were terminated quickly. As the attentional demands for processing the targets increased, fixations landed on the targets more frequently while fixations outside targets decreased both in number and duration. The attentionally more demanding targets were fixated more frequently than the attentionally less demanding ones. The most recently fixated target was tracked with higher performance, while the tracking accuracy for the more previously fixated targets gradually decreased. Taken together, the results indicate that fixations are tightly coupled with attention during MIT, switching serially from target to target for refreshing each object representation to facilitate the tracking of identities and locations of multiple targets.

The effect of identity switch in Multiple Identity Tracking

The effect of identity switch in Multiple Identity Tracking

The semantic category-based grouping in the Multiple Identity Tracking task

In the Multiple Identity Tracking (MIT) task, categorical distinctions between targets and distractors have been found to facilitate tracking (Wei, Zhang, Lyu, & Li in Frontiers in Psychology, 7, 589, 2016). The purpose of this study was to further investigate the reasons for the facilitation effect, through six experiments. The results of Experiments 1-3 excluded the potential explanations of visual distinctiveness, attentional distribution strategy, and a working memory mechanism, respectively. When objects' visual information was preserved and categorical information was removed, the facilitation effect disappeared, suggesting that the visual distinctiveness between targets and distractors was not the main reason for the facilitation effect. Moreover, the facilitation effect was not the result of strategically shifting the attentional distribution, because the targets received more attention than the distractors in all conditions. Additionally, the facilitation effect did not come about because the identities of targets were encoded and stored in visual working memory to assist in the recovery from tracking errors; when working memory was disturbed by the object identities changing during tracking, the facilitation effect still existed. Experiments 4 and 5 showed that observers grouped targets together and segregated them from distractors on the basis of their categorical information. By doing this, observers could largely avoid distractor interference with tracking and improve tracking performance. Finally, Experiment 6 indicated that category-based grouping is not an automatic, but a goal-directed and effortful, strategy. In summary, the present findings show that a semantic category-based target-grouping mechanism exists in the MIT task, which is likely to be the major reason for the tracking facilitation effect.

Fate of the extra item in multiple identity tracking task

Fate of the extra item in multiple identity tracking task

Brain activation of semantic category-based grouping in multiple identity tracking task.

Using Multiple Identity Tracking task and the functional magnetic resonance imaging (fMRI) technology, the present study aimed to isolate and visualize the functional anatomy of neural systems involved in the semantic category-based grouping process. Three experiment conditions were selected and compared: the category-based targets grouping (TG) condition, the targets-distractors grouping (TDG) condition and the homogenous condition. In the TG condition, observers could utilize the categorical distinction between targets and distractors, to construct a uniform presentation of targets, that is, to form a group of the targets to facilitate tracking. In the TDG condition, half the targets and half the distractors belonged to the same category. Observers had to inhibit the grouping of targets and distractors in one category to complete tracking. In the homogenous condition, where targets and distractors consisted of the same objects, no grouping could be formed. The “TG-Homogenous” contrast (p<0.01) revealed the activation of the left fusiform and the pars triangularis of inferior frontal gyrus (IFG). The “TG-TDG” contrast only revealed the activation of the left anterior cingulate gyrus (ACC). The fusiform and IFG pars triangularis might participate in the representation of semantic knowledge, IFG pars triangularis might relate intensely with the classification of semantic categories. The ACC might be responsible for the initiation and maintenance of grouping representation.

Angry faces are tracked more easily than neutral faces during multiple identity tracking

ABSTRACTWe investigated whether and how emotional facial expressions affect sustained attention in face tracking. In a multiple-identity and object tracking paradigm, participants tracked multiple target faces that continuously moved around together with several distractor faces, and subsequently reported where each target face had moved to. The emotional expression (angry, happy, and neutral) of the target and distractor faces was manipulated. Tracking performance was better when the target faces were angry rather than neutral, whereas angry distractor faces did not affect tracking. The effect persisted when the angry faces were presented upside-down and when surface features of the faces were irrelevant to the ongoing task. There was only suggestive and weak evidence for a facilitatory effect of happy targets and a distraction effect of happy distractors in comparison to neutral faces. The results show that angry expressions on the target faces can facilitate sustained attention on the targets via increased vigilance, yet this effect likely depends on both emotional information and visual features of the angry faces.

Cortical Circuit for Binding Object Identity and Location During Multiple-Object Tracking.

Sustained multifocal attention for moving targets requires binding object identities with their locations. The brain mechanisms of identity-location binding during attentive tracking have remained unresolved. In 2 functional magnetic resonance imaging experiments, we measured participants’ hemodynamic activity during attentive tracking of multiple objects with equivalent (multiple-object tracking) versus distinct (multiple identity tracking, MIT) identities. Task load was manipulated parametrically. Both tasks activated large frontoparietal circuits. MIT led to significantly increased activity in frontoparietal and temporal systems subserving object recognition and working memory. These effects were replicated when eye movements were prohibited. MIT was associated with significantly increased functional connectivity between lateral temporal and frontal and parietal regions. We propose that coordinated activity of this network subserves identity-location binding during attentive tracking.

Identity information of multiple moving objects is extracted in a serial manner during multiple identity tracking: An eye-tracking study

Identity information of multiple moving objects is extracted in a serial manner during multiple identity tracking: An eye-tracking study

How facial attractiveness affects sustained attention

The present study investigated whether and how facial attractiveness affects sustained attention. We adopted a multiple-identity tracking paradigm, using attractive and unattractive faces as stimuli. Participants were required to track moving target faces amid distractor faces and report the final location of each target. In Experiment 1, the attractive and unattractive faces differed in both the low-level properties (i.e., luminance, contrast, and color saturation) and high-level properties (i.e., physical beauty and age). The results showed that the attractiveness of both the target and distractor faces affected the tracking performance: The attractive target faces were tracked better than the unattractive target faces; when the targets and distractors were both unattractive male faces, the tracking performance was poorer than when they were of different attractiveness. In Experiment 2, the low-level properties of the facial images were equalized. The results showed that the attractive target faces were still tracked better than unattractive targets while the effects related to distractor attractiveness ceased to exist. Taken together, the results indicate that during attentional tracking the high-level properties related to the attractiveness of the target faces can be automatically processed, and then they can facilitate the sustained attention on the attractive targets, either with or without the supplement of low-level properties. On the other hand, only low-level properties of the distractor faces can be processed. When the distractors share similar low-level properties with the targets, they can be grouped together, so that it would be more difficult to sustain attention on the individual targets.

The Categorical Distinction Between Targets and Distractors Facilitates Tracking in Multiple Identity Tracking Task.

This study investigates the tracking facilitation effect during categorical distinction between targets and distractors in the Multiple Identity Tracking task. We asked observers to track four targets in a total of eight moving objects, and manipulated categorical distinctions of targets and distractors across four experiments, with different combinations of inter-category and intra-category differences. Results show that tracking performance was significantly better when the targets and distractors were inter-category different, compared to when the targets and distractors were identical or intra-category distinctive. As the inter-category distinction between targets and distractors narrowed, tracking performance improved, but the inter-category facilitation effect decreased. These results may indicate a category-based grouping effect: the observers organized the targets within the same semantic category into one group and made the targets more easily and accurately rediscovered when lost during tracking. Furthermore, the tracking facilitation of categorical distinction diminished when all the objects were inverted. This proved that besides their visual distinctiveness, objects’ semantic category information also played an important role during tracking.