Perceptual Salience Research Articles

Effective connectivity reveals distinctive patterns in response to others’ genuine affective experience of disgust

Empathy is significantly influenced by the identification of others’ emotions. In a recent study, we have found increased activation in the anterior insular cortex (aIns) that could be attributed to affect sharing rather than perceptual saliency, when seeing another person genuinely experiencing pain as opposed to merely acting to be in pain. In that prior study, effective connectivity between aIns and the right supramarginal gyrus (rSMG) was revealed to represent what another person really feels. In the present study, we used a similar paradigm to investigate the corresponding neural signatures in the domain of empathy for disgust - with participants seeing others genuinely sniffing unpleasant odors as compared to pretending to smell something disgusting (in fact the disgust expressions in both conditions were acted for reasons of experimental control). Consistent with the previous findings on pain, we found stronger activations in aIns associated with affect sharing for genuine disgust (inferred) compared with pretended disgust. However, instead of rSMG we found engagement of the olfactory cortex. Using dynamic causal modeling (DCM), we estimated the neural dynamics of aIns and the olfactory cortex between the genuine and pretended conditions. This revealed an increased excitatory modulatory effect for genuine disgust compared to pretended disgust. For genuine disgust only, brain-to-behavior regression analyses highlighted a link between the observed modulatory effect and a few empathic traits. Altogether, the current findings complement and expand our previous work, by showing that perceptual saliency alone does not explain responses in the insular cortex. Moreover, it reveals that different brain networks are implicated in a modality-specific way when sharing the affective experiences associated with pain vs. disgust.

Incentive motivation improves numerosity discrimination in children and adolescents

We recently showed that incentive motivation improves the precision of the Approximate Number System (ANS) in young adults. To shed light on the development of incentive motivation, the present study investigated whether this effect and its underlying mechanisms may also be observed in younger samples. Specifically, seven-year-old children (n = 23; 12 girls) and 14-year-old adolescents (n = 30; 15 girls) performed a dot comparison task with monetary reward incentives. Both age groups showed higher accuracy in a reward compared to a neutral condition and, similarly, higher processing efficiency as revealed by the drift rate parameter of the EZ-diffusion model. Furthermore, in line with the Incentive Salience Hypothesis, phasic pupil dilations—indicating the activation of the brain’s salience network—were greater in incentivized trials in both age groups. Together these finding suggest that incentive modulation improves numerosity discrimination in children and adolescents by enhancing the perceptual saliency of numerosity information. However, the observed reward anticipation effects were less pronounced in children relative to adolescents. Furthermore, unlike previous findings regarding young adults, the decision thresholds of children and adolescents were not raised by the monetary reward, which may indicate a more protracted development of incentive regulation of response caution than perceptual evidence accumulation.

Developmental differences in the impact of perceptual salience on short-term memory performance and meta-memory skills

In everyday life, individuals are surrounded by many stimuli that compete to access attention and memory. Evidence shows that perceptually salient stimuli have more chances to capture attention resources, thus to be encoded into short-term memory (STM). However, the impact of perceptual salience on STM at different developmental stages is entirely unexplored. Here we assessed STM performance and meta-memory skills of 6, 10, and 18 years-old participants (total N = 169) using a delayed match-to-sample task. On each trial, participants freely explored a complex (cartoon-like) scene for 4 s. After a retention interval of 4 s, they discriminated the same/different position of a target-object extracted from the area of maximal or minimal salience of the initially-explored scene. Then, they provided a confidence judgment of their STM performance, as an index of meta-memory skills. When taking into account ‘confident’ responses, we found increased STM performance following targets at maximal versus minimal salience only in adult participants. Similarly, only adults showed enhanced meta-memory capabilities following maximal versus minimal salience targets. These findings documented a late development in the impact of perceptual salience on STM performance and in the improvement of metacognitive capabilities to properly judge the content of one’s own memory representation.

A multi-autoencoder fusion network guided by perceptual distillation

In this study, a novel distillation paradigm named perceptual distillation is proposed to guide the training of image fusion networks without ground truths. In the paradigm, the student network which we called main autoencoder takes in source images and produces a fused image, and the teacher network is a well-trained network exploited to compute teacher representations of images. Knowledge in the teacher representations of source images is distilled and transferred to our student main autoencoder with the help of the perceptual saliency scheme. The scheme also derives a pixel level scheme of pixel compensation, which combines with source image to enhance the pixel intensity of the fused image. Moreover, a multi-autoencoder architecture is developed by assembling two auxiliary decoders behind the main autoencoder. The architecture is trained with self-supervision to consolidate fusion training against the limitation of teacher network. Qualitative and quantitative experiments demonstrate that the proposed network achieves the state-of-the-art performance on multi-source image fusion compared with the existing fusion methods.

Neural alterations of emotion processing in atypical trajectories of psychotic-like experiences

The aim of this study was to investigate the neural bases of facial emotion processing before the onset of clinical psychotic symptoms in youth belonging to well-defined developmental trajectories of psychotic-like experiences (PLEs). A unique sample of 86 youths was recruited from a population-based sample of over 3800 adolescents who had been followed from 13 to 17 years of age. Three groups were identified based on validated developmental trajectories: a control trajectory with low and decreasing PLEs, and two atypical trajectories with moderate to elevated baseline PLEs that subsequently decreased or increased. All had functional magnetic resonance imaging data collected during a facial emotion processing task. Functional activation and connectivity data were analyzed for different contrasts. The increasing PLE trajectory displayed more positive psychotic symptoms while the decreasing trajectory exhibited more negative symptoms relative to the control group. During face processing, both atypical trajectories displayed decreased activations of the right inferior frontal gyrus (IFG), while the increasing trajectory displayed a negative signal in the precentral gyrus. The increasing PLE trajectory also displayed impaired connectivity between the amygdala, ventromedial prefrontal cortex, and cerebellum, and between the IFG, precuneus, and temporal regions, while the decreasing trajectory exhibited reduced connectivity between the amygdala and visual regions during emotion processing. Both atypical PLE trajectories displayed alterations in brain regions involved in attention salience. While the increasing trajectory with more positive symptoms exhibited dysconnectivity in areas that influence emotion salience and face perception, the decreasing trajectory with more negative symptoms had impairments in visual information integration areas. These group-specific features might account for the differential symptom expression.

An increase in spontaneous activity mediates visual habituation.

SUMMARYThe cerebral cortex is spontaneously active, but the function of this ongoing activity remains unclear. To test whether spontaneous activity encodes learned experiences, we measured the response of neuronal populations in mouse primary visual cortex with chronic two-photon calcium imaging during visual habituation to a specific oriented stimulus. We find that, during habituation, spontaneous activity increases in neurons across the full range of orientation selectivity, eventually matching that of evoked levels. This increase in spontaneous activity robustly correlates with the degree of habituation. Moreover, boosting spontaneous activity with two-photon optogenetic stimulation to the levels of visually evoked activity accelerates habituation. Our study shows that cortical spontaneous activity is linked to habituation, and we propose that habituation unfolds by minimizing the difference between spontaneous and stimulus-evoked activity levels. We conclude that baseline spontaneous activity could gate incoming sensory information to the cortex based on the learned experience of the animal.

Effects of F0 contour depth differences on school-age children’s speech recognition in a two-talker masker

This study investigated the extent to which children (ages 5–17) can take advantage of differences in fundamental frequency (F0) contour between target and masker speech to improve speech-in-speech recognition. A number of studies show that differences in F0 and F0 contour between talkers support better speech-in-speech recognition for adults, suggesting it is an important cue for recognizing speech in multitalker environments. However, children’s use of F0 contour differences during speech-in-speech recognition is less well understood. In the present study, sentence recognition was measured adaptively in a two-talker speech masker. Target and masker sentences were recorded with either normal, flat, or exaggerated F0 contours. Results revealed that children’s sentence recognition was impacted by differences in F0 contour depth in both target and masker speech, but the pattern of results differed between children and adults in some conditions. For children, the consistent nature of the flat F0 contour often had a greater impact on speech recognition thresholds (SRTs) than target/masker differences in F0 contour depth. Observed age effects did not appear to be due to limitations in children’s ability to use F0 contour differences in general but are likely related to the perceptual salience of the target contour relative to the masker.

Motion-aware future frame prediction for video anomaly detection based on saliency perception

Motion-aware future frame prediction for video anomaly detection based on saliency perception

Do Diacritics Entail an Early Processing Cost in the Absence of Abstract Representations? Evidence from Masked Priming in English.

Using the masked priming technique, word recognition experiments in various languages have shown slower response times for a target word like NEVEU (nephew, in French) when preceded by a diacritical prime like néveu than by the identity prime neveu. The most common account of this effect is linguistic: diacritical and non-diacritical vowels (e.g., é and e) activate different letter representations (e.g., compare neveu /nə.vø/ vs. néveu /ne.vø/). However, another explanation is that the reduced effectiveness of the diacritical primes is merely due to the perceptual salience of accent marks in the first moments of word processing. Here, we designed a masked priming experiment that tested this perceptual salience account by comparing the effectiveness of diacritical versus non-diacritical primes in a language where diacritics have no linguistic value, namely, English (e.g., nórth-NORTH vs. north-NORTH). We found a small but reliable cost due to the diacritical primes, thus revealing that perceptual salience reduced the effectiveness of the primes. However, the effect sizes were substantially smaller than in the experiments in languages with diacritical marks, thus suggesting that the néveu-NEVEU versus neveu-NEVEU difference relies on both linguistic and perceptual sources.

Merger Reversal in St. Louis: Implementation and Implications

While examples have been clearly attested in the literature, the reversal of a merger is an uncommon occurrence that apparently contradicts principles underlying sound change. Understanding the implications of merger reversal therefore requires understanding of their implementation: whether there was a full merger in the first place, what the phonetic path taken to separate the merger was, and whether there was a social motivation behind the reversal. I take this approach in a case study of the traditional start-north merger of St. Louis English, which has reversed in recent decades. I show that the merger was most likely a near merger, that the reversal was achieved by raising north and fronting start, and that the reversal, at least the raising of north, was socially motivated. I argue that the data highlights the role of perceptual salience in reversing mergers and illustrates that merger reversal can at times be chain shift-like in appearance, if not execution.

Seeking motivation and reward: Roles of dopamine, hippocampus, and supramammillo-septal pathway.

Reinforcement learning and goal-seeking behavior are thought to be mediated by midbrain dopamine neurons. However, little is known about neural substrates of curiosity and exploratory behavior, which occur in the absence of clear goal or reward. This is despite behavioral scientists having long suggested that curiosity and exploratory behaviors are regulated by an innate drive. We refer to such behavior as information-seeking behavior and propose 1) key neural substrates and 2) the concept of environment prediction error as a framework to understand information-seeking processes. The cognitive aspect of information-seeking behavior, including the perception of salience and uncertainty, involves, in part, the pathways from the posterior hypothalamic supramammillary region to the hippocampal formation. The vigor of such behavior is modulated by the following: supramammillary glutamatergic neurons; their projections to medial septal glutamatergic neurons; and the projections of medial septal glutamatergic neurons to ventral tegmental dopaminergic neurons. Phasic responses of dopaminergic neurons are characterized as signaling potentially important stimuli rather than rewards. This paper describes how novel stimuli and uncertainty trigger seeking motivation and how these neural substrates modulate information-seeking behavior.

Length is not all that matters: testing the role of number identity and the ratio of fillers in comparisons of multi-digits with different digit length

Research in multi-digit number comparison usually considers stimuli with the same number of digits (e.g., 3452 vs. 7831). Surprisingly, there is almost no research on the comparison of numbers that differ in length (e.g., 995 vs. 1000), which demands a focus on the number of digits in each multi-digit, despite the fact that the role of number length has been explicitly acknowledged in componential models of multi-digit processing. Our study explores whether the comparison of pairs of natural numbers that differ in length is affected by the identity of the leftmost digit of each multi-digit, and asks what is the effect of having variable proportions of trials with pairs of numbers of the same-length in the task. Across three studies participants compared numbers in blocks with different proportions of same-length multi-digit pairs (Experiment 1 and 2: 25% vs. 50% vs. 75%; Experiment 3: 0% vs. 50%). Stimuli in the different-length condition were length-digit congruent (the number with more digits starting with a larger digit: 2384 vs. 107) or length-digit incongruent (the number with more digits starting with a smaller number: 2675 vs. 398). Response times were shorter in length-digit congruent pairs than in the incongruent pairs. Unexpectedly, this effect was only slightly modulated by the proportion of same-/different-length multi-digit pairs in the experimental set. Despite its perceptual saliency, length is not the only information considered when comparing different-length numbers. The leftmost-digit is also taken into account, with variable relevance here, depending on the characteristics of the stimuli set.

(Ir)regular Mood Swings: Lexical Variability in Heritage Speakers’ Oral Production of Subjunctive Mood

AbstractPrevious research indicates that heritage speakers (HSs) of Spanish produce both subjunctive and indicative mood in expected subjunctive contexts. The present study sheds new light on this pattern by testing the effects of morphological regularity on HSs’ mood production in volitional contexts, where Spanish‐dominant speakers (e.g., first‐generation immigrants) use almost exclusively subjunctive forms. Results of an elicited production task, completed by 42 HSs and 10 first‐generation controls, reveal that HSs differentiate between the two moods. Despite this sensitivity, HSs also exhibit variability, which is strongly conditioned by regularity. Whereas HSs produce subjunctive forms almost categorically with irregular verbs, their subjunctive production with regular verbs is more variable, a pattern we link to irregular verbs’ higher relative lexical autonomy and perceptual salience. Instead of classifying HSs’ morphological knowledge in binary terms, we argue for the importance of exploring how variability with mood is shaped by the morphological characteristics of individual lexical items.

Visual saliency guided perceptual adaptive quantization based on HEVC intra-coding for planetary images.

Due to the limited storage space of spacecraft and downlink bandwidth in the data delivery during planetary exploration, an efficient way for image compression onboard is essential to reduce the volume of acquired data. Applicable for planetary images, this study proposes a perceptual adaptive quantization technique based on Convolutional Neural Network (CNN) and High Efficiency Video Coding (HEVC). This technique is used for bitrate reduction while maintaining the subjective visual quality. The proposed algorithm adaptively determines the Coding Tree Unit (CTU) level Quantization Parameter (QP) values in HEVC intra-coding using the high-level features extracted by CNN. A modified model based on the residual network is exploited to extract the saliency map for a given image automatically. Furthermore, based on the saliency map, a CTU level QP adjustment technique combining global saliency contrast and local saliency perception is exploited to realize a flexible and adaptive bit allocation. Several quantitative performance metrics that efficiently correlate with human perception are used for evaluating image quality. The experimental results reveal that the proposed algorithm achieves better visual quality along with a maximum of 7.17% reduction in the bitrate as compared to the standard HEVC coding.

Perceptual Motivation for Action

In this paper we focus on a kind of perceptual states that we call perceptual motivations, that is, perceptual experiences that plausibly motivate us to act, such as itching, perceptual salience and pain. Itching seems to motivate you to scratch, perceiving a stimulus as salient seems to motivate you to attend to it and feeling a pain in your hand seems to motivate actions such as withdrawing from the painful stimulus. Five main accounts of perceptual motivation are available: Descriptive, Conative, Imperativist, Reflexive and Dual Content views. Some of these have been developed in detail and others are natural extensions of existing views. However, we argue that none provides a satisfactory account of the target perceptual states. Driven by the failings of each account, we identify three conditions that any satisfactory theory of perceptual motivation must meet: Direct Motivational Force, Non-Obligatory Force and Intention-Independent Influence. Then we offer an account that attempts to fulfil these conditions: the Affordance Model. This model of perceptual motivation is premised on the claim that each of the target states involves the perception of a specific affordance for action and the triggering of Automatic Motor Initiations (AMIs). We suggest that AMIs can explain the motivational force of these perceptual states.

Subject–Verb Number Agreement in Bilingual Processing: (Lack of) Age of Acquisition and Proficiency Effects

Children acquire language more easily than adults, though it is controversial whether this faculty declines as a result of a critical period or something else. To address this question, we investigate the role of age of acquisition and proficiency on morphosyntactic processing in adult monolinguals and bilinguals. Spanish monolinguals and intermediate and advanced early and late bilinguals of Spanish read sentences with adjacent subject–verb number agreements and violations and chose one of four pictures. Eye-tracking data revealed that all groups were sensitive to the violations and attended more to more salient plural and preterit verbs than less obvious singular and present verbs, regardless of AoA and proficiency level. We conclude that the processing of adjacent SV agreement depends on perceptual salience and language use, rather than AoA or proficiency. These findings support usage-based theories of language acquisition.

Visual perceptual salience and novel referent selection in children with and without autism spectrum disorder.

Many young children with autism spectrum disorder (ASD) demonstrate striking delays in early vocabulary development. Experimental studies that teach the meanings of novel nonwords can determine the effects of linguistic and attentional factors. One factor that may affect novel referent selection in children with ASD is visual perceptual salience-how interesting (i.e., striking) stimuli are on the basis of their visual properties. The goal of the current study was to determine how the perceptual salience of objects affected novel referent selection in children with ASD and children who are typically developing (TD) of similar ages (mean age 3-4 years). Using a screen-based experimental paradigm, children were taught the names of four unfamiliar objects: two high-salience objects and two low-salience objects. Their comprehension of the novel words was assessed in low-difficulty and high-difficulty trials. Gaze location was determined from video by trained research assistants. Contrary to initial predictions, findings indicated that high perceptual salience disrupted novel referent selection in the children with ASD but facilitated attention to the target object in age-matched TD peers. The children with ASD showed no significant evidence of successful novel referent selection in the high-difficulty trials. Exploratory reaction time analyses suggested that the children with autism showed "stickier" attention-had more difficulty disengaging (i.e., looking away)-from high-salience distracter images than low-salience distracter images, even though the two images were balanced in salience for any given test trial. These findings add to growing evidence that high perceptual salience has the potential to disrupt novel referent selection in children with ASD. These results underscore the complexity of novel referent selection and highlight the importance of taking the immediate testing context into account. In particular, it is important to acknowledge that screen-based assessments and screen-based learning activities used with children with ASD are not immune to the effects of lower level visual features, such as perceptual salience.

Hierarchical Decoding Network Based on Swin Transformer for Detecting Salient Objects in RGB-T Images

Although conventional deep convolutional neural networks are effective for contextual semantic segmentation of objects, recent vision transformers can capture global information of an image and are better at capturing semantic associations over longer ranges. In addition, some existing saliency detection methods disregard the guidance of high-level semantic information for low-level features during decoding, and only use layer-by-layer transmission for encoding. Therefore, we propose a hierarchical decoding network based on a swin transformer to perform red–green–blue and thermal (RGB-T) salient object detection (SOD). First, a sine–cosine fusion module performs multimodality intersections and exploits complementarity. As a second fusion stage, an advanced semantic information guidance module adjusts high-level semantic information and low-level detailed characteristics. Finally, a global saliency perception module fuses cross-layer information in a top-down path. Comprehensive experiments demonstrate that the proposed network outperforms 12 state-of-the-art methods on three RGB-T SOD datasets.

The double-edged sword of manager caring behavior: Implications for employee wellbeing.

While managers play a critical role in supporting employee wellbeing, prior research suggests that doing so can take a toll on managers themselves. However, we know little about the potential implications of this for employees. Drawing from the leadership-wellbeing literature and social psychological theories of guilt, we propose that manager caring behavior is associated with both positive (vitality) and negative (guilt) employee wellbeing. We find support for these relationships in Study 1 (N = 264) with a time-separated survey. In Study 2, we replicate these findings, and in addition, we examine a negative perceptual response to manager care: employee-rated manager role overload. Drawing on perceptual salience research, we propose that the negative relationship between manager care and employee-rated manager role overload is exacerbated in a team environment where employees fail to care for each other (i.e., a weak caring climate). Study 2 (N = 360) largely supports our hypotheses with multilevel, time-separated field data. The findings suggest that managers should not be expected to "go it alone" to support employee wellbeing because doing so may relate negatively to employee outcomes. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Eye-hand coordination: memory-guided grasping during obstacle avoidance.

When reaching to grasp previously seen, now out-of-view objects, we rely on stored perceptual representations to guide our actions, likely encoded by the ventral visual stream. So-called memory-guided actions are numerous in daily life, for instance, as we reach to grasp a coffee cup hidden behind our morning newspaper. Little research has examined obstacle avoidance during memory-guided grasping, though it is possible obstacles with increased perceptual salience will provoke exacerbated avoidance maneuvers, like exaggerated deviations in eye and hand position away from obtrusive obstacles. We examined the obstacle avoidance strategies adopted as subjects reached to grasp a 3D target object under visually-guided (closed loop or open loop with full vision prior to movement onset) and memory-guided (short- or long-delay) conditions. On any given trial, subjects reached between a pair of flanker obstacles to grasp a target object. The positions and widths of the obstacles were manipulated, though their inner edges remained a constant distance apart. While reach and grasp behavior was consistent with the obstacle avoidance literature, in that reach, grasp, and gaze positions were biased away from obstacles most obtrusive to the reaching hand, our results reveal distinctive avoidance approaches undertaken depend on the availability of visual feedback. Contrary to expectation, we found subjects reaching to grasp after a long delay in the absence of visual feedback failed to modify their final fixation and grasp positions to accommodate the different positions of obstacles, demonstrating a more moderate, rather than exaggerative, obstacle avoidance strategy.