Flanking Letters Research Articles

Investigating the crowding effect on letters and symbols in deaf adults

Reading requires the transformation of a complex array of visual features into sounds and meaning. For deaf signers who experience changes in visual attention and have little or no access to the sounds of the language they read, understanding the visual constraints underlying reading is crucial. This study aims to explore a fundamental aspect of visual perception intertwined with reading: the crowding effect. This effect manifests as the struggle to distinguish a target letter when surrounded by flanker letters. Through a two-alternative forced choice task, we assessed the recognition of letters and symbols presented in isolation or flanked by two or four characters, positioned either to the left or right of fixation. Our findings reveal that while deaf individuals exhibit higher accuracy in processing letters compared to symbols, their performance falls short of that of their hearing counterparts. Interestingly, despite their proficiency with letters, deaf individuals didn’t demonstrate quicker letter identification, particularly in the most challenging scenario where letters were flanked by four characters. These outcomes imply the development of a specialized letter processing system among deaf individuals, albeit one that may subtly diverge from that of their hearing counterparts.

The temporal dynamics of visual crowding in letter recognition: Modulating crowding with alternating flicker presentations.

Visual crowding reduces the visibility of a peripherally presented group of stimuli. This is especially challenging for peripheral reading because adjacent letters or characters perceptually crowd one another. We investigated the temporal course of spatial visual crowding by sequentially alternating the visibility of the target and flanking letters within a trigram letter stimulus presented 9° below fixation. We found that alternation rates of roughly 3Hz released half of the total effect of crowding, whereas 10Hz alternation rates elicited near-crowded performance. Furthermore, we found a robust performance asymmetry whereby presenting the target first elicited better performance than presenting the flankers first, an effect resembling forward masking. These results held for conditions of high, medium, and low spatial crowding. Future work will determine whether the alternation rates found in the current study can improve peripheral reading.

How crowding challenges (feedforward) convolutional neural networks

Are (feedforward) convolutional neural networks (CNNs) good models for the human visual system? Here, we used visual crowding as a well-controlled psychophysical test to probe CNNs. Visual crowding is a ubiquitous breakdown of object recognition in the human visual system, whereby targets become jumbled and unrecognisable in the presence of flanking objects. Humans exhibit several well-documented effects of crowding, such as invariance to size, where the size of the target and flanker letters may be changed without impacting the strength of crowding. We show that feedforward CNNs are unable to reproduce invariance to size, confusion between target and flanker identities, and importantly uncrowding, where paradoxically increasing the number of flankers improves performance. We investigate this phenomenon using a recurrent, neurally inspired model called LAMINART, which we find can reproduce uncrowding as observed in humans. Furthermore, we show that capsule networks, a recurrent family of CNNs with grouping and segmentation mechanisms, outperform any other models of uncrowding to date, demonstrating the importance of grouping and segmentation in mechanisms in visual information processing in general.

A nonspatial sound modulates processing of visual distractors in a flanker task.

Successful navigation of information-rich, multimodal environments involves processing of both auditory and visual information. The extent to which information within each modality is processed varies due to many factors, but the influence of auditory stimuli on the processing of visual stimuli in these multimodal environments is not well understood. Previous research has shown that a preceding sound leads to decreased reaction times in visual tasks (Bertelson, 1967). The current study examines if a non-spatial, task-irrelevant sound additionally alters processing of visual distractors that flank a central target. We utilized a version of a flanker task in which participants responded to a central letter surrounded by two irrelevant flanker letters. When these flankers are associated with a conflicting response, a congruency effect occurs such that reaction time to the target is slowed (Eriksen & Eriksen, 1974). In two experiments using this task, results showed that a preceding tone caused general speeding of reaction time across flanker types, consistent with alerting. The tone also caused decreased variation in response time. Critically, the tone modulated the congruency effect, with a greater speeding for congruent flankers than for incongruent flankers. This suggests that the influence of flanker identity was more intense after tone presentation, consistent with a nonspatial sound increasing perceptual and/or response-association processing of flanking stimuli.

A diffusion model analysis of the effects of aging in the Flanker Task.

The diffusion decision model (DDM) has been used to investigate the effects of aging on information processing in simple response time (RT) tasks. These analyses have consistently shown that the age-related slowing of RTs can be accounted for by slower processing speed in sensorimotor systems and more cautious responding. However, previous DDM assessments of aging have ignored conflict tasks (e.g., the flanker task), the dominant paradigm for investigating age-related differences in executive control, as the DDM is unable to combine task-relevant and task-irrelevant stimulus information. Our study used two recently developed extensions of the DDM-the diffusion model for conflict tasks (DMC) and the shrinking spotlight diffusion model (SSP)-to provide the first model-based assessment of age-related differences in a flanker task featuring a manipulation of the spacing between target and flanking letters. Consistent with previous findings, older adults were globally slower than younger adults, and the magnitude of the flanker effect was larger for older than younger adults only when the spacing between the target and flanking letters was small. Fits of the models to data revealed a superiority of the DMC over the SSP. The DMC accounts for experimental findings with a 62-ms slowing of the nondecision component of RT for older compared to younger adults, a more cautious decision criterion, and enhanced processing of the target and flanking letters in the near periphery, suggesting a stronger attentional engagement in the task. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Grouping Effects on Foveal Spatial Interactions in Children.

PurposeGrouping of flankers from the target can modulate crowding in adults. Visual acuity in children is measured clinically using charts with targets and different flankers to enhance spatial interactions. We investigated grouping effects on interactions using visual acuity letters, flanked by contours and letters, in children.MethodsVisual acuity for isolated and flanked letters was measured in 155 three- to 11-year old children and 32 adults. Flankers were one stroke width from the target and were a box or four bars and black or red letters. Magnitudes of interaction were flanked minus isolated logMAR acuities. Psychometric function slopes were also examined.ResultsMagnitudes of interaction by contours did not change significantly with age. They were 0.047 ± 0.014 logMAR more with bars than a box. Interaction from flanking letters reduced with age, adults being not different from 9- to 11-year-olds for black and red letter surrounds. It was weaker by 0.033 ± 0.013 logMAR when a black letter was surrounded by red rather than black letters. Psychometric function slopes for visual acuity were steepest for the youngest children (3–5 years).ConclusionsFor contour and letter flankers, grouping effects on interaction magnitude are age independent. Grouping bars into a box forming a single object reduces magnitude of effect. Grouping letter flankers by color and ungrouping them from the target reduce interaction magnitude by ∼8%, suggesting that luminance-defined form dominates. Differently colored letter flankers of high-luminance contrast on acuity charts could draw attention to the target but retain significant interaction strength.

Age-related differences in the attentional white bear

The cognitive aging literature suggests that aging populations exhibit impairments in the proactive inhibition of attention. Although proactive inhibition is often preceded by the allocation of attention toward the predicted or known spatial location of to-be-ignored stimuli, proactive allocation of attention has not been assessed in aging populations. In this study, an older and younger cohort engaged in the attentional-white-bear paradigm which measures proactive allocation of attention. In this task, on 80% of trials, participants must identify a centrally located letter surrounded by congruent or incongruent flanker letters. The flanker locations are fixed and predictable within each block of the study. On 20% of trials, they must identify which of two dots appear first on the screen. One dot appears in the same location as the flanker, and one appears in an empty location during the flanker task. The typical white-bear effect is that, despite the dots appearing at the same time, participants more often report the dot in the location of the flanker (i.e., the potentially to-be-ignored location) to appear first. The magnitude of this effect is interpreted as the magnitude of attentional allocation prior to inhibition. In Experiment 1, there was no difference in the magnitude of the attentional white bear between younger and aging cohorts. However, when the attentional system was sufficiently taxed by reducing the flanker presentation (Experiments 2a and 2b), age-related differences emerged. In particular, older participants showed a reduced white-bear effect, reflecting a potential impairment in the proactive allocation of attention toward the location of expected distractors.

Sequential conflict resolution under multiple concurrent conflicts: An ERP study

The purpose of the present study was to determine whether responding to multiple concurrent conflicts results in a simultaneous or sequential conflict resolution. To this end, we measured event-related potentials (ERPs) in a paradigm combining a Stroop and a flanker task. In this paradigm, participants were asked to respond to the color of the central letter while ignoring the meaning of the word (Stroop task) and the color of the flanking letters (flanker task). Trials were either incongruent (i.e., inducing a conflict between two response alternatives) or congruent (i.e., inducing no response conflict) in both tasks, or incongruent in one task and congruent in the other task. The behavioral results showed a smaller Stroop congruency effect (i.e., a smaller difference between Stroop incongruent and congruent trials) for flanker incongruent than for flanker congruent trials, replicating previous findings. The ERP results showed that an early ERP component (i.e., P2) was associated with the resolution of the flanker conflict, whereas a later component (i.e., N450) was associated with the resolution of the Stroop conflict. Together, these findings emphasize a sequential organization of conflict resolution processes in the brain which is adaptive when facing multiple concurrent conflicts.

Effect of stimulus configuration on crowding in strabismic amblyopia.

Foveal vision in strabismic amblyopia can show increased levels of crowding, akin to typical peripheral vision. Target-flanker similarity and visual-acuity test configuration may cause the magnitude of crowding to vary in strabismic amblyopia. We used custom-designed visual acuity tests to investigate crowding in observers with strabismic amblyopia. LogMAR was measured monocularly in both eyes of 11 adults with strabismic or mixed strabismic/anisometropic amblyopia using custom-designed letter tests. The tests used single-letter and linear formats with either bar or letter flankers to introduce crowding. Tests were presented monocularly on a high-resolution display at a test distance of 4 m, using standardized instructions. For each condition, five letters of each size were shown; testing continued until three letters of a given size were named incorrectly. Uncrowded logMAR was subtracted from logMAR in each of the crowded tests to highlight the crowding effect. Repeated-measures ANOVA showed that letter flankers and linear presentation individually resulted in poorer performance in the amblyopic eyes (respectively, mean normalized logMAR = 0.29, SE = 0.07, mean normalized logMAR = 0.27, SE = 0.07; p < 0.05) and together had an additive effect (mean = 0.42, SE = 0.09, p < 0.001). There was no difference across the tests in the fellow eyes (p > 0.05). Both linear presentation and letter rather than bar flankers increase crowding in the amblyopic eyes of people with strabismic amblyopia. These results suggest the influence of more than one mechanism contributing to crowding in linear visual-acuity charts with letter flankers.

Integration of parafoveal orthographic information during foveal word reading: beyond the sub-lexical level?

Prior research has shown that processing of a given target word is facilitated by the simultaneous presentation of orthographically related stimuli in the parafovea. Here we investigate the nature of such spatial integration processes by presenting orthographic neighbours of target words in the parafovea, considering that neighbours have been shown to inhibit, rather than facilitate, recognition of target words in foveal masked priming research. In Experiment 1, we used the gaze-contingent boundary paradigm to manipulate the parafoveal information subjects received while they fixated a target word within a sentence. In Experiment 2, we used the Flanking Letters Lexical Decision paradigm to manipulate parafoveal information while subjects read isolated words. Parafoveal words were either a higher-frequency orthographic neighbour of targets words (e.g., blue-blur) or a high-frequency unrelated word (e.g., hand-blur). We found that parafoveal orthographic neighbours facilitated, rather than inhibited, processing of the target. Thus, the present findings provide further evidence that orthographic information is integrated across multiple words and suggest that either the integration process does not enable simultaneous access to those words' lexical representations, or that lexical representations activated by spatially distinct stimuli do not compete for recognition.

Detecting distortions of peripherally presented letter stimuli under crowded conditions.

When visual features in the periphery are close together they become difficult to recognize: something is present but it is unclear what. This is called "crowding". Here we investigated sensitivity to features in highly familiar shapes (letters) by applying spatial distortions. In Experiment1, observers detected which of four peripherally presented (8 deg of retinal eccentricity) target letters was distorted (spatial 4AFC). The letters were presented either isolated or surrounded by four undistorted flanking letters, and distorted with one of two types of distortion at a range of distortion frequencies and amplitudes. The bandpass noise distortion ("BPN") technique causes spatial distortions in Cartesian space, whereas radial frequency distortion ("RF") causes shifts in polar coordinates. Detecting distortions in target letters was more difficult in the presence of flanking letters, consistent with the effect of crowding. The BPN distortion type showed evidence of tuning, with sensitivity to distortions peaking at approximately 6.5 c/deg for unflanked letters. The presence of flanking letters causes this peak to rise to approximately 8.5 c/deg. In contrast to the tuning observed for BPN distortions, RF distortion sensitivity increased as the radial frequency of distortion increased. In a series of follow-up experiments, we found that sensitivity to distortions is reduced when flanking letters were also distorted, that this held when observers were required to report which target letter was undistorted, and that this held when flanker distortions were always detectable. The perception of geometric distortions in letter stimuli is impaired by visual crowding.

Effects of flanker type and position on foveal letter recognition

Our ability to identify a foveally viewed letter at resolution threshold reduces when flankers are placed at a certain distance from it, compared to when it is presented on its own. In this study, we investigated how type and position of flankers influences foveal letter recognition. We measured participants’ performance to identify unflanked Sheridan-Gardiner letters (A, H, O, U, T, V or X), using a seven-alternative-forced-choice paradigm with the method of constant stimuli to obtain 80-90% correct response. Performance was measured again to identify a target letter in the presence of different flanker types. Flankers were bars and letters (placed either to the left and right of the target, above and below the target or on four sides of the target), and a surrounding box. Separation between the target letter and flankers varied between zero (abutting) and ten stroke widths (two letter sizes). For all flanker types, separation between the target ad the flankers significantly influenced performance (all p &lt; 0.0001). Flankers abutting the target and at separation of one stroke width caused the largest reduction in performance, regardless of flanker type. For bar flankers, the largest drop in performance (up to 50 percent) occurred with bars placed on all four sides of the target. For letter flankers, flankers placed above and below the target reduced performance as much as four surrounding flankers. At separation of one stroke width, flanking letters and bars caused a further 10% reduction in performance than a surrounding box. Our results would have significant implications on the design of crowded visual acuity charts, especially those that are available on the market, which have different crowding features between them.

Spatio-temporal properties of letter crowding.

Crowding between adjacent letters has been investigated primarily as a spatial effect. The purpose of this study was to investigate the spatio-temporal properties of letter crowding. Specifically, we examined the systematic changes in the degradation effects in letter identification performance when adjacent letters were presented with a temporal asynchrony, as a function of letter separation and between the fovea and the periphery. We measured proportion-correct performance for identifying the middle target letter in strings of three lowercase letters at the fovea and 10° in the inferior visual field, for a range of center-to-center letter separations and a range of stimulus onset asynchronies (SOA) between the target and flanking letters (positive SOAs: target preceded flankers). As expected, the accuracy for identifying the target letters reduces with decreases in letter separation. This crowding effect shows a strong dependency on SOAs, such that crowding is maximal between 0 and ∼100 ms (depending on conditions) and diminishes for larger SOAs (positive or negative). Maximal crowding does not require the target and flanking letters to physically coexist for the entire presentation duration. Most importantly, crowding can be minimized even for closely spaced letters if there is a large temporal asynchrony between the target and flankers. The reliance of letter identification performance on SOAs and how it changes with letter separations imply that the crowding effect can be traded between space and time. Our findings are consistent with the notion that crowding should be considered as a spatio-temporal, and not simply a spatial, effect.

Rapid and long-lasting reduction of crowding through training.

Crowding is the failure to identify an object in the peripheral visual field in the presence of nearby objects. Recent studies have shown that crowding can be alleviated after several days of training, but the processes underlying this improvement are still unclear. Here we tested whether a few hundred trials within a short period of training can alleviate crowding, whether the learning is location specific, and whether the improvement reflects facilitation by target enhancement or flankers suppression. Observers were asked to identify the orientation of a letter in the periphery surrounded by two flanker letters. Observers were tested before (pretest) and after (posttest) training (600 trials). In Experiment 1 we tested whether learning is location specific or can transfer to a different location; the training and test occurred at the same or different hemifields. In a control experiment, we ruled out alternative explanations for the learning effect in Experiment 1. In Experiment 2, we assessed different components of feature selection by training with either the same flanker polarity as the pre/posttest but opposite polarity group (flanker polarity group) or the same target polarity as the pre/posttest but opposite flanker polarity (target polarity group). Following training, overall performance increased in all four conditions, but only the same-location group (Experiment 1) and the same flanker polarity (Experiment 2) showed a significant reduction in crowding as assessed by the distance at which the flankers no longer interfere with target identification, that is, the critical spacing. These results show that training can rapidly reduce crowding and that improvement primarily reflects learning to ignore the irrelevant flankers. Remarkably, in the two conditions in which training significantly reduced crowding, the benefit of short training persisted for up to a year.

Influence of Stereoscopic Depth on the Flanker Compatibility Effect

Modern air-traffic control displays feature complex symbology that may negatively impact operator performance efficiency. Manipulations of stereoscopic depth have been proposed as a means to declutter such displays and thereby to enhance operator performance. In this study, we employed a flanker task designed by Eriksen and Eriksen (1974) to further investigate that possibility. Participants were required to correctly respond to target letters from the sets H and K and S and C that were bordered horizontally by response compatible and response incompatible flanking letters. Using a stereoscopic imaging technique, the flanking letters were made to appear .1 and .8 cm in front of or behind the target letters, or on the same plane as the target letters. Consistent with the findings of Eriksen and Eriksen (1974), when all letters appeared on the same plane, response times (RTs) to target letters in the presence of response incompatible flanking letters were significantly elevated in comparison to RTs in the presence of response compatible flanking letters. These effects were eliminated when the flankers appeared to be slightly in front of the target letters or at both distances behind the target letters. However, the flanker effects were restored when the flankers appeared well in front of the target letters. The results suggest that the decluttering ability of stereoscopic depth is complex and dependent on the relative apparent distance between the targets and their bordering flanker elements.

Crowding by a repeating pattern

Theinability to recognize a peripheral target among flankers is called crowding. For a foveal target, crowding can be distinguished from overlap masking by its sparing of detection, linear scaling with eccentricity, and invariance with target size.Crowding depends on the proximity and similarity of the flankers to the target. Flankers that are far from or dissimilar to the target do not crowd it. On a gray page, text whose neighboring letters have different colors, alternately black and white, has enough dissimilarity that it might escape crowding. Since reading speed is normally limited by crowding, escape from crowding should allow faster reading. Yet reading speed is unchanged (Chung & Mansfield, 2009). Why? A recent vernier study found that using alternating-color flankers produces strong crowding (Manassi, Sayim, & Herzog, 2012). Might that effect occur with letters and reading? Critical spacing is the minimum center-to-center target-flanker spacing needed to correctly identify the target. We measure it for a target letter surrounded by several equidistant flanker letters of the same polarity, opposite polarity, or mixed polarity: alternately white and black. We find strong crowding in the alternating condition, even though each flanker letter is beyond its own critical spacing (as measured in a separate condition). Thus a periodic repeating pattern can produce crowding even when the individual elements do not. Further, in all conditions we find that, once a periodic pattern repeats (two cycles), further repetition does not affect critical spacing of the innermost flanker.

Foveal crowding differs in children and adults.

We used custom-designed acuity tests to compare the magnitude and extent of crowded letter recognition in children and adults. Visual acuity (logMAR) was measured monocularly in children and adults using five custom-designed letter tests with varying degrees of crowding: single letter, single letter surrounded by four flanking bars, single letter surrounded by four flanking letters, line of five letters surrounded by flanking bars, and line of five letters surrounded by flanking letters. The tests were constructed using Sloan letters and presented on an iPad (Apple Incorporated, Cupertino, CA) at 4 m using a standardized endpoint and instructions. Crowded logMAR was normalized to unflanked logMAR and results were analyzed in three groups: younger children aged 4-6 (n = 32), older children, aged 7-9 (n = 30), and adults (n = 27). Both groups of children showed a greater extent of crowding than the adults. The adult participants showed no difference in performance between single or linear presentation and letter or bar flankers. Letter flankers and linear presentation individually resulted in poorer performance in the younger children p < 0.001 and p = 0.003, respectively (mean normalized logMAR 0.17 in each case) and together had an additive effect (mean 0.24), p < 0.001. Crowding in the older children was adult-like except in the linear presentation with letter flankers, p < 0.001. These results indicate that both target-flanker similarity and linear presentation contribute more to foveal crowding in young children than in adults.

How hand placement modulates interference from extraneous stimuli.

Placing the hands around the position in which the relevant target letter for an Eriksen flanker task appears has been shown to reduce the interference produced by incompatible, irrelevant flanker letters presented outside of the hands. This result has been attributed to the hands providing an attentional window in the space between them, which results in enhanced processing of the stimulus within it. Alternatively, the hands may act as a reference frame relative to which attention can also be directed more effectively to the space outside of the hands. We conducted four experiments to test implications of the attention window and reference-frame accounts, using left and right foot-press responses. Although placing the hands around the inner letter reduced interference on flanker-incompatible trials, as previously found, it did so just as much when the letter outside of the hands was specified as the target and the letter between the hands was the distractor. Also, placement of wooden blocks around the inner letter reduced interference to a similar extent, again regardless of whether the inner or outer letter was designated as the target. These findings support the view that the reduction in flanker interference produced by placing the hands around the inner letter is due to their providing a reference frame relative to which visual attention can be directed either inside or outside.

Tests of a model of multi-word reading: Effects of parafoveal flanking letters on foveal word recognition

We used the “flanking letters lexical decision” paradigm of Dare and Shillcock (2013) in order to test a model of multi-word reading. In the model, multiple words (on fixation, and to the left and right of fixation) are processed in parallel by a bank of location-specific letter detectors. These letter detectors feed information forward to a “bag of bigrams” that represents location-invariant sublexical orthographic information for all words processed in parallel. Bigrams are only formed within words (i.e., between spaces) but activate all compatible word representations. The model accounts for a finding reported by Dare and Shillcock (2013): Word recognition is facilitated when flanking letter pairs are present in the target (e.g. RO ROCK CK) compared with different letter flankers (ST ROCK EN), but independently of the position of the flanking bigrams (e.g., CK ROCK RO). In the present study we replicate this key finding and show that, as predicted by the model, although bigram position does not matter, within-bigram letter position does. Word recognition is harder when the position of letters within bigram flankers is reversed (e.g., OR ROCK KC/KC ROCK OR), but these conditions still facilitate with respect to a different letter flanker condition.

Attentional capture by emotional faces in adolescence.

Poor decision making during adolescence occurs most frequently when situations are emotionally charged. However, relatively few studies have measured the development of cognitive control in response to emotional stimuli in this population. This study used both affective (emotional faces) and non-affective (letter) stimuli in two different flanker tasks to assess the ability to ignore task-irrelevant but distracting information, in 25 adults and 25 adolescents. On the non-emotional (letter) flanker task, the presence of incongruent flanking letters increased the number of errors, and also slowed participants’ ability to identify a central letter. Adolescents committed more errors than adults, but there were no age-related differences for the reaction time interference effect in the letter condition. Post-hoc testing revealed that age-related differences on the task were driven by the younger adolescents (11-14 years); adults and older adolescents (15-17 years) were equally accurate in the letter condition. In contrast, on the emotional face flanker task, not only were adolescents less accurate than adults but they were also more distracted by task-irrelevant fearful faces as evidenced by greater reaction time interference effects. Our findings suggest that the ability to self-regulate in adolescents, as evidenced by the ability to suppress irrelevant information on a flanker task, is more difficult when stimuli are affective in nature. The ability to ignore irrelevant flankers appears to mature earlier for non-affective stimuli than for affective stimuli.